2024-09-12T01:08:04.919 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T01:08:04.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:08:05.056 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901539 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901539' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDlninQrnBmb/QkUOcHSYD9Mu2Sj8scTHNWsOfeX+jq5jWHMnslE5Zwwe7lvnTD/sR51VfTRhzLr5AWFbj49bc4= smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWXDZt7KPM87hjKRkDkl9tGwSHjWOs1l7NbLDHHWs1joUmNyckXuZhf0uiI7HGB0dU0w90921Seb1TPz5BYpKw= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNn/1htTAxl+fKQcTqAp2hJYtwRreW/mA+1WuKM9MX4J8Yfa76/H2SVRlEx8SlIBhM9i8mDURaqjOecSpSGo1wU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T01:08:05.057 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T01:08:05.057 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T01:08:05.058 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T01:08:05.059 INFO:teuthology.task.internal:Checking packages... 2024-09-12T01:08:05.081 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T01:08:05.081 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:08:05.081 INFO:teuthology.packaging:ref: None 2024-09-12T01:08:05.081 INFO:teuthology.packaging:tag: None 2024-09-12T01:08:05.081 INFO:teuthology.packaging:branch: squid 2024-09-12T01:08:05.082 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:08:05.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T01:08:05.324 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T01:08:05.326 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T01:08:05.333 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T01:08:05.333 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T01:08:05.343 INFO:teuthology.task.internal:Saving configuration 2024-09-12T01:08:05.365 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T01:08:05.371 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T01:08:05.403 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901539', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:02:45.721535', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDlninQrnBmb/QkUOcHSYD9Mu2Sj8scTHNWsOfeX+jq5jWHMnslE5Zwwe7lvnTD/sR51VfTRhzLr5AWFbj49bc4='} 2024-09-12T01:08:05.433 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901539', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:02:45.722958', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWXDZt7KPM87hjKRkDkl9tGwSHjWOs1l7NbLDHHWs1joUmNyckXuZhf0uiI7HGB0dU0w90921Seb1TPz5BYpKw='} 2024-09-12T01:08:05.461 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901539', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:02:45.724134', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNn/1htTAxl+fKQcTqAp2hJYtwRreW/mA+1WuKM9MX4J8Yfa76/H2SVRlEx8SlIBhM9i8mDURaqjOecSpSGo1wU='} 2024-09-12T01:08:05.461 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T01:08:05.468 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T01:08:05.468 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T01:08:05.468 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T01:08:05.468 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T01:08:05.586 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbbecd63520>, signals=[15]) 2024-09-12T01:08:05.586 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T01:08:05.804 INFO:teuthology.task.internal:Opening connections... 2024-09-12T01:08:05.804 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T01:08:05.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:08:05.913 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T01:08:05.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:08:05.996 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-09-12T01:08:05.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:08:06.087 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T01:08:06.093 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-12T01:08:06.112 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-12T01:08:06.112 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-12T01:08:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-09-12T01:08:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-09-12T01:08:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-09-12T01:08:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:08:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-09-12T01:08:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:08:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:08:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-09-12T01:08:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:08:06.171 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:08:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:08:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:08:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:08:06.172 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:08:06.172 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-12T01:08:06.199 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-09-12T01:08:06.217 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-09-12T01:08:06.217 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-09-12T01:08:06.275 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-09-12T01:08:06.275 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-09-12T01:08:06.275 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-09-12T01:08:06.275 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:08:06.276 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-09-12T01:08:06.276 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:08:06.276 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:08:06.276 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-09-12T01:08:06.276 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:08:06.276 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:08:06.276 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:08:06.276 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:08:06.277 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:08:06.277 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:08:06.277 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-09-12T01:08:06.306 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-09-12T01:08:06.325 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-09-12T01:08:06.325 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-09-12T01:08:06.383 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-09-12T01:08:06.384 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-09-12T01:08:06.384 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-09-12T01:08:06.384 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:08:06.384 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-09-12T01:08:06.384 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:08:06.384 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:08:06.384 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-09-12T01:08:06.384 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:08:06.384 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:08:06.384 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:08:06.384 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:08:06.384 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:08:06.384 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:08:06.385 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-09-12T01:08:06.415 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T01:08:06.425 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T01:08:06.431 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T01:08:06.432 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:08:06.435 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:08:06.437 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:08:06.454 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T01:08:06.459 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T01:08:06.459 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:08:06.492 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:08:06.495 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:08:06.604 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T01:08:06.705 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T01:08:06.719 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T01:08:06.719 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-12T01:08:06.719 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-12T01:08:06.719 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:08:06.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:08:06.737 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-12T01:08:06.795 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-503.el9.x86_64 2024-09-12T01:08:06.795 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.14.0-503.el9.x86_64 2024-09-12T01:08:06.795 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2024-09-12T01:08:09.244 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-12T01:08:11.062 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-12T01:08:15.287 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-12T01:08:16.980 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-12T01:08:17.759 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T01:08:23.206 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T01:08:25.197 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T01:08:25.197 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T01:08:25.302 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-12T01:08:25.314 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-12T01:08:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-12T01:08:25.314 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-12T01:08:25.314 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-12T01:08:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T01:08:25.314 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-12T01:08:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T01:08:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T01:08:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T01:08:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:08:25.315 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-12T01:08:25.315 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-12T01:08:25.315 INFO:teuthology.orchestra.run.smithi081.stdout:Install 4 Packages 2024-09-12T01:08:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:08:25.316 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 79 M 2024-09-12T01:08:25.316 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 126 M 2024-09-12T01:08:25.316 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-12T01:08:25.650 INFO:teuthology.orchestra.run.smithi081.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 106 kB/s | 23 kB 00:00 2024-09-12T01:08:25.975 INFO:teuthology.orchestra.run.smithi081.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-12T01:08:26.467 INFO:teuthology.orchestra.run.smithi081.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 35 MB/s | 29 MB 00:00 2024-09-12T01:08:26.851 INFO:teuthology.orchestra.run.smithi081.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 24 MB/s | 35 MB 00:01 2024-09-12T01:08:26.851 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:08:26.851 INFO:teuthology.orchestra.run.smithi081.stdout:Total 51 MB/s | 79 MB 00:01 2024-09-12T01:08:27.533 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-12T01:08:27.890 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-12T01:08:27.891 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-12T01:08:28.871 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-12T01:08:28.871 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-12T01:08:31.347 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-12T01:08:32.044 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:08:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:08:34.910 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:08:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:08:39.858 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:08:39.899 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:08:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:09:22.962 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:09:23.001 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:09:23.385 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:09:23.385 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:09:23.385 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:09:23.386 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:09:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:09:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:09:24.251 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-12T01:09:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T01:09:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T01:09:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T01:09:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T01:09:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:09:24.251 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-12T01:09:24.593 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:09:24.713 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:09:24.713 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:09:24.713 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T01:09:24.713 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T01:09:24.713 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T01:09:24.714 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-12T01:09:24.714 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T01:09:24.714 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:09:24.773 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:09:24.773 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:09:24.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-09-12T01:09:24.810 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-09-12T01:09:24.810 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-09-12T01:09:24.810 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-09-12T01:09:24.811 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 82.el9 2024-09-12T01:09:24.811 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-09-12T01:09:24.811 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T01:09:24.811 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-09-12T01:09:24.811 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8274670 2024-09-12T01:09:24.811 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-09-12T01:09:24.811 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T01:09:24.811 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T01:09:24.811 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T01:09:24.811 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T01:09:24.811 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-09-12T01:09:24.811 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-09-12T01:09:24.811 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T01:09:24.812 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-09-12T01:09:24.812 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-09-12T01:09:24.812 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:09:24.812 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T01:09:24.812 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T01:09:24.812 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T01:09:24.812 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-09-12T01:09:24.812 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:09:24.812 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T01:09:24.813 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T01:09:24.813 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 5.14.0-505.el9.x86_64 2024-09-12T01:09:24.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T01:09:25.469 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-12T01:09:26.769 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T01:09:26.798 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-12T01:09:26.800 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-12T01:09:26.815 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.M7GZKqLhb8 2024-09-12T01:09:26.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.M7GZKqLhb8 2024-09-12T01:09:26.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.M7GZKqLhb8 2024-09-12T01:09:27.016 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.M7GZKqLhb8 is 6KB 2024-09-12T01:09:27.065 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.M7GZKqLhb8 2024-09-12T01:09:27.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T01:09:27.150 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T01:09:27.150 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T01:09:27.150 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T01:09:27.151 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T01:09:27.152 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T01:09:27.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-12T01:09:57.314 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T01:09:57.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-12T01:09:57.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:10:31.997 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-12T01:10:40.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-12T01:10:41.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:10:59.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-12T01:11:11.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-12T01:11:11.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:11:11.732 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-12T01:11:12.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-12T01:11:12.115 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T01:11:12.116 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-12T01:11:12.130 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-505.el9.x86_64 2024-09-12T01:11:12.130 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T01:11:12.130 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T01:11:12.130 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T01:11:13.131 DEBUG:teuthology.parallel:result is None 2024-09-12T01:11:13.132 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T01:11:13.140 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T01:11:13.140 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:11:13.142 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:11:13.145 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:11:13.163 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T01:11:13.218 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T01:11:13.248 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T01:11:13.249 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:11:13.251 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:11:13.253 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:11:13.357 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T01:11:13.363 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T01:11:13.364 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:11:13.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:11:13.381 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:11:13.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:11:13.399 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:11:13.401 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:11:13.425 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:11:13.458 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:11:13.478 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:11:13.512 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:11:13.531 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:11:13.539 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:11:13.583 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:11:13.585 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T01:11:13.592 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T01:11:13.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:11:13.595 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:11:13.597 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:11:13.626 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T01:11:13.718 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T01:11:13.719 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:11:13.721 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:11:13.723 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:11:13.741 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:11:13.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:11:13.866 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:11:13.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:11:13.986 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:11:13.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:11:14.049 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:11:14.103 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:11:14.146 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:11:14.240 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:11:14.273 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:11:14.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:11:14.340 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:11:14.394 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:11:14.441 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:11:14.551 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:11:14.578 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:11:14.578 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:11:14.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-12T01:11:14.649 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-09-12T01:11:14.651 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-09-12T01:11:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:11:14.726 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:11:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:11:15.079 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T01:11:15.246 INFO:teuthology.task.internal:Starting timer... 2024-09-12T01:11:15.246 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T01:11:15.734 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T01:11:15.791 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T01:11:15.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-09-12T01:11:15.957 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-09-12T01:11:15.960 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-09-12T01:11:16.013 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-09-12T01:11:16.014 DEBUG:teuthology.orchestra.run.smithi189:> sudo service auditd rotate 2024-09-12T01:11:16.074 INFO:teuthology.orchestra.run.smithi189.stdout:Rotating logs: 2024-09-12T01:11:16.076 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T01:11:16.076 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-09-12T01:11:16.110 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-09-12T01:11:16.110 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-09-12T01:11:16.130 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-09-12T01:11:16.130 DEBUG:teuthology.orchestra.run.smithi189:> /usr/sbin/getenforce 2024-09-12T01:11:16.150 INFO:teuthology.orchestra.run.smithi189.stdout:Permissive 2024-09-12T01:11:16.150 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi189.front.sepia.ceph.com': 'permissive'} 2024-09-12T01:11:16.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:11:16.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:11:16.176 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:11:16.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:11:16.202 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:11:16.228 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:11:16.228 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T01:11:16.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:11:16.308 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:11:16.371 DEBUG:teuthology.orchestra.run.smithi189:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:11:16.402 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T01:11:16.412 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T01:11:16.415 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T01:11:16.549 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T01:11:16.560 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T01:11:16.561 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi100.front.sepia.ceph.com,smithi189.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T01:15:29.263 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com')] 2024-09-12T01:15:29.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-12T01:15:29.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:15:29.359 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-12T01:15:29.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-12T01:15:29.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T01:15:29.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:15:29.521 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-12T01:15:29.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-12T01:15:29.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-12T01:15:29.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:15:29.686 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-12T01:15:29.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-12T01:15:29.775 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T01:15:29.785 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T01:15:29.786 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:15:29.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:15:29.789 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:15:29.789 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:15:29.792 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:15:29.792 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:15:29.818 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:15:29.819 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:15:29.832 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:15:29.833 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:15:29.845 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:15:29.858 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-09-12T01:15:29.858 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-09-12T01:15:29.861 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:15:29.869 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-09-12T01:15:29.870 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-09-12T01:15:29.883 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:15:29.883 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:15:29.886 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: ntpd: command not found 2024-09-12T01:15:29.897 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:15:29.897 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:15:29.898 INFO:teuthology.orchestra.run.smithi189.stdout:506 Cannot talk to daemon 2024-09-12T01:15:29.913 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:15:29.928 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:15:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:15:29.959 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:15:29.960 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-12T01:15:29.960 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:15:29.960 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:15:29.960 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:15:29.960 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:15:29.962 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:15:29.965 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:15:29.965 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-12T01:15:29.965 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:15:29.965 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:15:29.965 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:15:29.965 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:15:29.985 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:15:29.989 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:15:29.990 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-12T01:15:29.990 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:15:29.990 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:15:29.990 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:15:29.990 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:15:29.991 INFO:teuthology.run_tasks:Running task install... 2024-09-12T01:15:29.999 DEBUG:teuthology.task.install:project ceph 2024-09-12T01:15:30.000 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T01:15:30.000 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T01:15:30.000 INFO:teuthology.task.install:Using flavor: default 2024-09-12T01:15:30.009 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T01:15:30.009 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T01:15:30.010 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:15:30.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:15:30.012 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:15:30.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:15:30.014 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:15:30.014 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:15:30.173 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:15:30.173 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:15:30.185 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:15:30.185 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:15:30.197 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:15:30.197 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:15:30.303 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:15:30.303 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:15:30.303 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:15:30.319 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:15:30.319 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:15:30.319 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:15:30.328 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:15:30.329 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:15:30.331 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:15:30.331 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:15:30.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:15:30.345 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:15:30.346 DEBUG:teuthology.orchestra.run.smithi189:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:15:30.358 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:15:30.358 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:15:30.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:15:30.412 DEBUG:teuthology.orchestra.run.smithi189:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:15:30.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:15:30.469 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:15:30.486 DEBUG:teuthology.orchestra.run.smithi189:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:15:30.500 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:15:30.533 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-09-12T01:15:30.535 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-09-12T01:15:30.551 INFO:teuthology.orchestra.run.smithi189.stdout:check_obsoletes = 1 2024-09-12T01:15:30.552 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum clean all 2024-09-12T01:15:30.563 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-09-12T01:15:30.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-09-12T01:15:30.761 INFO:teuthology.orchestra.run.smithi100.stdout:45 files removed 2024-09-12T01:15:30.780 INFO:teuthology.orchestra.run.smithi189.stdout:45 files removed 2024-09-12T01:15:30.789 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:15:30.791 INFO:teuthology.orchestra.run.smithi081.stdout:45 files removed 2024-09-12T01:15:30.807 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:15:30.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:15:31.349 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 293 kB/s | 84 kB 00:00 2024-09-12T01:15:31.361 INFO:teuthology.orchestra.run.smithi189.stdout:ceph packages for x86_64 300 kB/s | 84 kB 00:00 2024-09-12T01:15:31.381 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-12T01:15:31.633 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T01:15:31.645 INFO:teuthology.orchestra.run.smithi189.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T01:15:31.665 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T01:15:31.909 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T01:15:31.912 INFO:teuthology.orchestra.run.smithi189.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T01:15:31.940 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T01:15:32.559 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-12T01:15:33.724 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-12T01:15:34.362 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.2 MB 00:02 2024-09-12T01:15:35.885 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 20 MB 00:02 2024-09-12T01:15:37.246 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-12T01:15:39.250 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-12T01:15:41.077 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.5 MB 00:01 2024-09-12T01:15:42.553 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 19 kB 00:00 2024-09-12T01:15:42.871 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-12T01:15:43.332 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T01:15:43.493 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-12T01:15:44.447 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 19 kB 00:00 2024-09-12T01:15:45.193 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-12T01:15:46.118 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 19 kB 00:01 2024-09-12T01:15:47.256 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-12T01:15:48.754 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T01:15:50.632 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-12T01:15:51.075 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:15:51.076 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:15:51.089 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:15:51.090 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:15:51.091 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:15:51.092 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:15:51.094 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:15:51.096 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:15:51.097 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:15:51.160 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-12T01:15:51.184 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-12T01:15:51.184 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-12T01:15:51.184 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-12T01:15:51.184 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-12T01:15:51.184 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:15:51.184 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:15:51.184 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:15:51.184 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:15:51.184 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:15:51.184 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:15:51.185 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:15:51.185 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:15:51.185 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:15:51.185 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:15:51.185 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:15:51.185 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:15:51.185 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:15:51.185 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:15:51.185 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:15:51.185 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:15:51.185 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:15:51.185 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:15:51.186 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:15:51.186 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:15:51.186 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:15:51.186 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:15:51.186 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:15:51.186 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:15:51.186 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:15:51.186 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:15:51.186 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:15:51.186 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:15:51.186 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:15:51.186 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:15:51.186 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:15:51.187 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:15:51.187 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:15:51.187 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:15:51.187 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:15:51.187 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:15:51.187 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:15:51.187 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-09-12T01:15:51.187 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:15:51.187 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:15:51.187 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:15:51.187 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:15:51.187 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:15:51.187 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:15:51.188 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:15:51.188 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:15:51.188 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-12T01:15:51.188 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:15:51.188 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:15:51.188 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:15:51.188 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:15:51.188 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:15:51.188 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:15:51.188 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:15:51.188 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:15:51.188 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:15:51.188 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:15:51.189 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:15:51.189 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:15:51.189 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:15:51.189 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:15:51.189 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:15:51.189 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:15:51.189 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:15:51.189 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:15:51.189 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:15:51.189 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:15:51.189 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:15:51.189 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:15:51.190 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:15:51.190 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:15:51.190 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:15:51.190 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:15:51.190 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:15:51.190 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:15:51.190 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:15:51.190 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:15:51.190 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:15:51.190 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:15:51.190 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:15:51.190 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:15:51.190 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:15:51.191 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:15:51.191 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:15:51.191 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:15:51.191 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:15:51.191 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:15:51.191 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:15:51.191 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:15:51.191 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:15:51.191 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:15:51.191 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:15:51.191 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:15:51.191 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:15:51.191 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:15:51.192 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:15:51.192 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:15:51.192 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:15:51.192 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:15:51.192 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:15:51.192 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:15:51.192 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:15:51.192 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:15:51.192 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:15:51.192 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:15:51.192 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:15:51.192 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:15:51.193 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:15:51.193 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:15:51.193 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:15:51.193 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:15:51.193 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:15:51.193 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:15:51.193 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:15:51.193 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:15:51.193 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:15:51.193 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:15:51.193 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:15:51.193 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:15:51.193 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:15:51.194 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:15:51.194 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:15:51.194 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:15:51.194 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:15:51.194 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:15:51.194 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:15:51.194 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:15:51.194 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:15:51.194 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:15:51.194 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:15:51.195 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:15:51.195 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:15:51.195 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:15:51.195 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:15:51.195 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:15:51.195 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:15:51.195 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:15:51.195 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:15:51.195 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:15:51.195 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:15:51.195 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:15:51.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:15:51.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:15:51.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:15:51.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:15:51.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:15:51.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:15:51.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:15:51.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:15:51.196 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:15:51.196 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:15:51.196 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:15:51.197 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:15:51.197 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:15:51.197 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:15:51.197 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:15:51.197 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:15:51.197 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-09-12T01:15:51.197 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:15:51.197 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:15:51.197 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-12T01:15:51.197 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-12T01:15:51.197 INFO:teuthology.orchestra.run.smithi100.stdout:Install 148 Packages 2024-09-12T01:15:51.197 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 8 Packages 2024-09-12T01:15:51.198 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:15:51.198 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 226 M 2024-09-12T01:15:51.198 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-12T01:15:51.706 INFO:teuthology.orchestra.run.smithi100.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-12T01:15:51.931 INFO:teuthology.orchestra.run.smithi100.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.9 MB/s | 897 kB 00:00 2024-09-12T01:15:52.006 INFO:teuthology.orchestra.run.smithi100.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.9 MB/s | 145 kB 00:00 2024-09-12T01:15:52.082 INFO:teuthology.orchestra.run.smithi100.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-12T01:15:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 1.5 MB 00:00 2024-09-12T01:15:52.257 INFO:teuthology.orchestra.run.smithi100.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 9.5 MB/s | 2.4 MB 00:00 2024-09-12T01:15:52.516 INFO:teuthology.orchestra.run.smithi100.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-12T01:15:52.695 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T01:15:52.735 INFO:teuthology.orchestra.run.smithi100.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 18 MB/s | 21 MB 00:01 2024-09-12T01:15:52.785 INFO:teuthology.orchestra.run.smithi100.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 505 kB/s | 25 kB 00:00 2024-09-12T01:15:52.903 INFO:teuthology.orchestra.run.smithi189.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:15:52.904 INFO:teuthology.orchestra.run.smithi189.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:15:52.916 INFO:teuthology.orchestra.run.smithi189.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:15:52.917 INFO:teuthology.orchestra.run.smithi189.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:15:52.918 INFO:teuthology.orchestra.run.smithi189.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:15:52.919 INFO:teuthology.orchestra.run.smithi189.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:15:52.920 INFO:teuthology.orchestra.run.smithi189.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:15:52.923 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:15:52.924 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:15:52.988 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-09-12T01:15:53.018 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-12T01:15:53.018 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2024-09-12T01:15:53.018 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-12T01:15:53.018 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2024-09-12T01:15:53.019 INFO:teuthology.orchestra.run.smithi189.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:15:53.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:15:53.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:15:53.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:15:53.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:15:53.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:15:53.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:15:53.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:15:53.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:15:53.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:15:53.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:15:53.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:15:53.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:15:53.020 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:15:53.020 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:15:53.020 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:15:53.020 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:15:53.020 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:15:53.020 INFO:teuthology.orchestra.run.smithi189.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:15:53.020 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:15:53.020 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:15:53.020 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:15:53.020 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:15:53.020 INFO:teuthology.orchestra.run.smithi189.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:15:53.020 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:15:53.021 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:15:53.021 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:15:53.021 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:15:53.021 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:15:53.021 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:15:53.021 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:15:53.021 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:15:53.021 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:15:53.021 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:15:53.021 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:15:53.021 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:15:53.021 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:15:53.022 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrading: 2024-09-12T01:15:53.022 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:15:53.022 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:15:53.022 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:15:53.022 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:15:53.022 INFO:teuthology.orchestra.run.smithi189.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:15:53.022 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:15:53.022 INFO:teuthology.orchestra.run.smithi189.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:15:53.022 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:15:53.022 INFO:teuthology.orchestra.run.smithi189.stdout:Installing dependencies: 2024-09-12T01:15:53.022 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:15:53.022 INFO:teuthology.orchestra.run.smithi189.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:15:53.023 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:15:53.023 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:15:53.023 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:15:53.023 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:15:53.023 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:15:53.023 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:15:53.023 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:15:53.023 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:15:53.023 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:15:53.023 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:15:53.023 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:15:53.023 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:15:53.024 INFO:teuthology.orchestra.run.smithi189.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:15:53.024 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:15:53.024 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:15:53.024 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:15:53.024 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:15:53.024 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:15:53.024 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:15:53.024 INFO:teuthology.orchestra.run.smithi189.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:15:53.024 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:15:53.024 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:15:53.024 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:15:53.024 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:15:53.024 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:15:53.025 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:15:53.025 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:15:53.025 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:15:53.025 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:15:53.025 INFO:teuthology.orchestra.run.smithi189.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:15:53.025 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:15:53.025 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:15:53.025 INFO:teuthology.orchestra.run.smithi189.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:15:53.025 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:15:53.025 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:15:53.025 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:15:53.025 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:15:53.025 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:15:53.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:15:53.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:15:53.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:15:53.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:15:53.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:15:53.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:15:53.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:15:53.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:15:53.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:15:53.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:15:53.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:15:53.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:15:53.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:15:53.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:15:53.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:15:53.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:15:53.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:15:53.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:15:53.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:15:53.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:15:53.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:15:53.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:15:53.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:15:53.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:15:53.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:15:53.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:15:53.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:15:53.029 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:15:53.029 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:15:53.029 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:15:53.029 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:15:53.029 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:15:53.029 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:15:53.029 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:15:53.029 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:15:53.029 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:15:53.029 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:15:53.029 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:15:53.029 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:15:53.030 INFO:teuthology.orchestra.run.smithi189.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:15:53.031 INFO:teuthology.orchestra.run.smithi189.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:15:53.031 INFO:teuthology.orchestra.run.smithi189.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:15:53.031 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:15:53.031 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:15:53.031 INFO:teuthology.orchestra.run.smithi189.stdout:Installing weak dependencies: 2024-09-12T01:15:53.031 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:15:53.031 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:15:53.031 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-09-12T01:15:53.031 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-12T01:15:53.031 INFO:teuthology.orchestra.run.smithi189.stdout:Install 148 Packages 2024-09-12T01:15:53.031 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrade 8 Packages 2024-09-12T01:15:53.031 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:15:53.032 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 226 M 2024-09-12T01:15:53.032 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-09-12T01:15:53.335 INFO:teuthology.orchestra.run.smithi100.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 16 MB/s | 17 MB 00:01 2024-09-12T01:15:53.394 INFO:teuthology.orchestra.run.smithi100.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-12T01:15:53.544 INFO:teuthology.orchestra.run.smithi100.stdout:(12/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 10 MB/s | 11 MB 00:01 2024-09-12T01:15:53.569 INFO:teuthology.orchestra.run.smithi100.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 154 kB/s | 27 kB 00:00 2024-09-12T01:15:53.595 INFO:teuthology.orchestra.run.smithi100.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 633 kB/s | 32 kB 00:00 2024-09-12T01:15:53.628 INFO:teuthology.orchestra.run.smithi100.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 752 kB 00:00 2024-09-12T01:15:53.654 INFO:teuthology.orchestra.run.smithi100.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-12T01:15:53.687 INFO:teuthology.orchestra.run.smithi100.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-12T01:15:53.700 INFO:teuthology.orchestra.run.smithi189.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-12T01:15:53.721 INFO:teuthology.orchestra.run.smithi100.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 7.4 MB/s | 506 kB 00:00 2024-09-12T01:15:53.780 INFO:teuthology.orchestra.run.smithi100.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 773 kB/s | 45 kB 00:00 2024-09-12T01:15:53.880 INFO:teuthology.orchestra.run.smithi100.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.3 MB/s | 136 kB 00:00 2024-09-12T01:15:53.964 INFO:teuthology.orchestra.run.smithi100.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-12T01:15:53.989 INFO:teuthology.orchestra.run.smithi100.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 162 kB 00:00 2024-09-12T01:15:54.022 INFO:teuthology.orchestra.run.smithi100.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.3 MB/s | 321 kB 00:00 2024-09-12T01:15:54.048 INFO:teuthology.orchestra.run.smithi100.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-12T01:15:54.059 INFO:teuthology.orchestra.run.smithi189.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.4 MB/s | 897 kB 00:00 2024-09-12T01:15:54.073 INFO:teuthology.orchestra.run.smithi100.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T01:15:54.098 INFO:teuthology.orchestra.run.smithi100.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T01:15:54.142 INFO:teuthology.orchestra.run.smithi189.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.7 MB/s | 145 kB 00:00 2024-09-12T01:15:54.174 INFO:teuthology.orchestra.run.smithi100.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-12T01:15:54.224 INFO:teuthology.orchestra.run.smithi100.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 21 MB/s | 3.1 MB 00:00 2024-09-12T01:15:54.249 INFO:teuthology.orchestra.run.smithi100.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 424 kB/s | 32 kB 00:00 2024-09-12T01:15:54.283 INFO:teuthology.orchestra.run.smithi100.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.4 MB/s | 146 kB 00:00 2024-09-12T01:15:54.617 INFO:teuthology.orchestra.run.smithi100.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 9.7 MB/s | 3.6 MB 00:00 2024-09-12T01:15:54.717 INFO:teuthology.orchestra.run.smithi100.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 17 MB/s | 7.4 MB 00:00 2024-09-12T01:15:54.742 INFO:teuthology.orchestra.run.smithi100.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 1.9 MB/s | 249 kB 00:00 2024-09-12T01:15:54.767 INFO:teuthology.orchestra.run.smithi100.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 981 kB/s | 49 kB 00:00 2024-09-12T01:15:54.793 INFO:teuthology.orchestra.run.smithi100.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 328 kB/s | 16 kB 00:00 2024-09-12T01:15:54.818 INFO:teuthology.orchestra.run.smithi100.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.5 MB/s | 285 kB 00:00 2024-09-12T01:15:54.860 INFO:teuthology.orchestra.run.smithi100.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 437 kB/s | 18 kB 00:00 2024-09-12T01:15:54.867 INFO:teuthology.orchestra.run.smithi189.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 4.1 MB/s | 5.4 MB 00:01 2024-09-12T01:15:54.894 INFO:teuthology.orchestra.run.smithi100.stdout:(38/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 7.4 MB/s | 765 kB 00:00 2024-09-12T01:15:54.918 INFO:teuthology.orchestra.run.smithi189.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 3.1 MB/s | 2.4 MB 00:00 2024-09-12T01:15:55.014 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:15:55.014 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:15:55.026 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:15:55.027 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:15:55.028 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:15:55.029 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:15:55.031 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:15:55.033 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:15:55.034 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:15:55.097 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-12T01:15:55.101 INFO:teuthology.orchestra.run.smithi189.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 6.5 MB/s | 1.5 MB 00:00 2024-09-12T01:15:55.117 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-12T01:15:55.117 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-12T01:15:55.117 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-12T01:15:55.117 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-12T01:15:55.117 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:15:55.117 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:15:55.117 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:15:55.117 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:15:55.117 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:15:55.118 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:15:55.118 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:15:55.118 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:15:55.118 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:15:55.118 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:15:55.118 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:15:55.118 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:15:55.118 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:15:55.118 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:15:55.118 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:15:55.118 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:15:55.118 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:15:55.118 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:15:55.119 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:15:55.119 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:15:55.119 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:15:55.119 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:15:55.119 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:15:55.119 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:15:55.119 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:15:55.119 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:15:55.119 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:15:55.119 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:15:55.119 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:15:55.119 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:15:55.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:15:55.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:15:55.120 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:15:55.120 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:15:55.120 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:15:55.120 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:15:55.120 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:15:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-09-12T01:15:55.120 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:15:55.120 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:15:55.120 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:15:55.120 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:15:55.121 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:15:55.121 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:15:55.121 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:15:55.121 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:15:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-12T01:15:55.121 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:15:55.121 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:15:55.121 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:15:55.121 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:15:55.121 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:15:55.121 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:15:55.121 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:15:55.122 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:15:55.122 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:15:55.122 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:15:55.122 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:15:55.122 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:15:55.122 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:15:55.122 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:15:55.122 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:15:55.122 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:15:55.122 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:15:55.123 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:15:55.123 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:15:55.123 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:15:55.123 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:15:55.123 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:15:55.123 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:15:55.123 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:15:55.123 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:15:55.123 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:15:55.123 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:15:55.123 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:15:55.123 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:15:55.124 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:15:55.124 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:15:55.124 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:15:55.124 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:15:55.124 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:15:55.124 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:15:55.124 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:15:55.124 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:15:55.124 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:15:55.124 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:15:55.124 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:15:55.124 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:15:55.124 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:15:55.125 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:15:55.125 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:15:55.125 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:15:55.125 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:15:55.125 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:15:55.125 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:15:55.125 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:15:55.125 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:15:55.125 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:15:55.125 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:15:55.125 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:15:55.125 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:15:55.126 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:15:55.126 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:15:55.126 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:15:55.126 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:15:55.126 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:15:55.126 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:15:55.126 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:15:55.126 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:15:55.126 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:15:55.126 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:15:55.126 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:15:55.127 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:15:55.127 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:15:55.127 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:15:55.127 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:15:55.127 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:15:55.127 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:15:55.127 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:15:55.127 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:15:55.127 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:15:55.127 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:15:55.127 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:15:55.127 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:15:55.127 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:15:55.128 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:15:55.128 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:15:55.128 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:15:55.128 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:15:55.128 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:15:55.128 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:15:55.128 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:15:55.128 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:15:55.128 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:15:55.128 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:15:55.128 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:15:55.129 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:15:55.129 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:15:55.129 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:15:55.129 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:15:55.129 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:15:55.129 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:15:55.129 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:15:55.129 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:15:55.129 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:15:55.129 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:15:55.129 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:15:55.130 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-12T01:15:55.131 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-12T01:15:55.131 INFO:teuthology.orchestra.run.smithi081.stdout:Install 148 Packages 2024-09-12T01:15:55.131 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 8 Packages 2024-09-12T01:15:55.131 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:15:55.131 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 226 M 2024-09-12T01:15:55.131 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-12T01:15:55.361 INFO:teuthology.orchestra.run.smithi100.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 19 MB/s | 49 MB 00:02 2024-09-12T01:15:55.478 INFO:teuthology.orchestra.run.smithi100.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 129 kB/s | 80 kB 00:00 2024-09-12T01:15:55.570 INFO:teuthology.orchestra.run.smithi100.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-12T01:15:55.595 INFO:teuthology.orchestra.run.smithi100.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 818 kB/s | 191 kB 00:00 2024-09-12T01:15:55.621 INFO:teuthology.orchestra.run.smithi081.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-12T01:15:55.629 INFO:teuthology.orchestra.run.smithi100.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-12T01:15:55.654 INFO:teuthology.orchestra.run.smithi100.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-12T01:15:55.688 INFO:teuthology.orchestra.run.smithi100.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T01:15:55.702 INFO:teuthology.orchestra.run.smithi189.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 6.0 MB/s | 4.7 MB 00:00 2024-09-12T01:15:55.713 INFO:teuthology.orchestra.run.smithi100.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-12T01:15:55.755 INFO:teuthology.orchestra.run.smithi100.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 6.6 MB/s | 1.2 MB 00:00 2024-09-12T01:15:55.780 INFO:teuthology.orchestra.run.smithi100.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-12T01:15:55.872 INFO:teuthology.orchestra.run.smithi081.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.5 MB/s | 897 kB 00:00 2024-09-12T01:15:55.889 INFO:teuthology.orchestra.run.smithi100.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 986 kB/s | 107 kB 00:00 2024-09-12T01:15:55.922 INFO:teuthology.orchestra.run.smithi100.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-12T01:15:55.948 INFO:teuthology.orchestra.run.smithi100.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-12T01:15:55.980 INFO:teuthology.orchestra.run.smithi081.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-12T01:15:55.981 INFO:teuthology.orchestra.run.smithi100.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-12T01:15:56.005 INFO:teuthology.orchestra.run.smithi081.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.1 MB/s | 145 kB 00:00 2024-09-12T01:15:56.006 INFO:teuthology.orchestra.run.smithi100.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-09-12T01:15:56.032 INFO:teuthology.orchestra.run.smithi100.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-12T01:15:56.057 INFO:teuthology.orchestra.run.smithi100.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-12T01:15:56.082 INFO:teuthology.orchestra.run.smithi100.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-12T01:15:56.116 INFO:teuthology.orchestra.run.smithi100.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T01:15:56.122 INFO:teuthology.orchestra.run.smithi081.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 2.4 MB 00:00 2024-09-12T01:15:56.141 INFO:teuthology.orchestra.run.smithi100.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-09-12T01:15:56.200 INFO:teuthology.orchestra.run.smithi100.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-12T01:15:56.242 INFO:teuthology.orchestra.run.smithi100.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 588 kB/s | 24 kB 00:00 2024-09-12T01:15:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 6.1 MB/s | 1.5 MB 00:00 2024-09-12T01:15:56.276 INFO:teuthology.orchestra.run.smithi100.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-09-12T01:15:56.301 INFO:teuthology.orchestra.run.smithi100.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-09-12T01:15:56.326 INFO:teuthology.orchestra.run.smithi100.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T01:15:56.351 INFO:teuthology.orchestra.run.smithi100.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T01:15:56.365 INFO:teuthology.orchestra.run.smithi081.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 19 MB/s | 4.7 MB 00:00 2024-09-12T01:15:56.376 INFO:teuthology.orchestra.run.smithi100.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-12T01:15:56.752 INFO:teuthology.orchestra.run.smithi100.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.9 MB/s | 3.0 MB 00:00 2024-09-12T01:15:56.819 INFO:teuthology.orchestra.run.smithi100.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 11 MB/s | 4.9 MB 00:00 2024-09-12T01:15:56.927 INFO:teuthology.orchestra.run.smithi100.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-12T01:15:56.932 INFO:teuthology.orchestra.run.smithi081.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 19 MB/s | 11 MB 00:00 2024-09-12T01:15:56.969 INFO:teuthology.orchestra.run.smithi100.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 3.2 MB/s | 137 kB 00:00 2024-09-12T01:15:57.149 INFO:teuthology.orchestra.run.smithi081.stdout:(9/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 21 MB 00:01 2024-09-12T01:15:57.174 INFO:teuthology.orchestra.run.smithi081.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 104 kB/s | 25 kB 00:00 2024-09-12T01:15:57.232 INFO:teuthology.orchestra.run.smithi081.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-12T01:15:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:(70/156): postgresql-13.16-1.el9.x86_64.rpm 3.2 MB/s | 1.6 MB 00:00 2024-09-12T01:15:57.283 INFO:teuthology.orchestra.run.smithi081.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 542 kB/s | 27 kB 00:00 2024-09-12T01:15:57.324 INFO:teuthology.orchestra.run.smithi081.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 766 kB/s | 32 kB 00:00 2024-09-12T01:15:57.335 INFO:teuthology.orchestra.run.smithi189.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 5.6 MB/s | 21 MB 00:03 2024-09-12T01:15:57.393 INFO:teuthology.orchestra.run.smithi189.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 432 kB/s | 25 kB 00:00 2024-09-12T01:15:57.400 INFO:teuthology.orchestra.run.smithi081.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 9.8 MB/s | 752 kB 00:00 2024-09-12T01:15:57.420 INFO:teuthology.orchestra.run.smithi100.stdout:(71/156): postgresql-server-13.16-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-09-12T01:15:57.462 INFO:teuthology.orchestra.run.smithi100.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-09-12T01:15:57.467 INFO:teuthology.orchestra.run.smithi081.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-12T01:15:57.534 INFO:teuthology.orchestra.run.smithi081.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 127 kB 00:00 2024-09-12T01:15:57.579 INFO:teuthology.orchestra.run.smithi100.stdout:(73/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-12T01:15:57.621 INFO:teuthology.orchestra.run.smithi100.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-12T01:15:57.669 INFO:teuthology.orchestra.run.smithi081.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 3.7 MB/s | 506 kB 00:00 2024-09-12T01:15:57.671 INFO:teuthology.orchestra.run.smithi100.stdout:(75/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.4 MB/s | 1.0 MB 00:00 2024-09-12T01:15:57.747 INFO:teuthology.orchestra.run.smithi100.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-12T01:15:57.797 INFO:teuthology.orchestra.run.smithi100.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-12T01:15:57.814 INFO:teuthology.orchestra.run.smithi100.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-09-12T01:15:57.831 INFO:teuthology.orchestra.run.smithi100.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 573 kB/s | 19 kB 00:00 2024-09-12T01:15:57.864 INFO:teuthology.orchestra.run.smithi100.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 1.0 MB/s | 35 kB 00:00 2024-09-12T01:15:57.889 INFO:teuthology.orchestra.run.smithi100.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-12T01:15:57.990 INFO:teuthology.orchestra.run.smithi100.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-09-12T01:15:58.043 INFO:teuthology.orchestra.run.smithi081.stdout:(18/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 9.4 MB/s | 17 MB 00:01 2024-09-12T01:15:58.065 INFO:teuthology.orchestra.run.smithi100.stdout:(83/156): python3-babel-2.9.1-2.el9.noarch.rpm 9.9 MB/s | 6.0 MB 00:00 2024-09-12T01:15:58.107 INFO:teuthology.orchestra.run.smithi100.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-12T01:15:58.110 INFO:teuthology.orchestra.run.smithi189.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 5.6 MB/s | 17 MB 00:03 2024-09-12T01:15:58.118 INFO:teuthology.orchestra.run.smithi081.stdout:(19/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-12T01:15:58.132 INFO:teuthology.orchestra.run.smithi100.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-09-12T01:15:58.143 INFO:teuthology.orchestra.run.smithi081.stdout:(20/156): python3-ceph-argparse-19.1.1-298.gb53 451 kB/s | 45 kB 00:00 2024-09-12T01:15:58.158 INFO:teuthology.orchestra.run.smithi100.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-12T01:15:58.169 INFO:teuthology.orchestra.run.smithi081.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 2.6 MB/s | 136 kB 00:00 2024-09-12T01:15:58.177 INFO:teuthology.orchestra.run.smithi189.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 228 kB 00:00 2024-09-12T01:15:58.194 INFO:teuthology.orchestra.run.smithi081.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.1 MB/s | 162 kB 00:00 2024-09-12T01:15:58.208 INFO:teuthology.orchestra.run.smithi100.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T01:15:58.211 INFO:teuthology.orchestra.run.smithi189.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 814 kB/s | 27 kB 00:00 2024-09-12T01:15:58.227 INFO:teuthology.orchestra.run.smithi081.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-12T01:15:58.244 INFO:teuthology.orchestra.run.smithi189.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 952 kB/s | 32 kB 00:00 2024-09-12T01:15:58.250 INFO:teuthology.orchestra.run.smithi100.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 6.5 MB/s | 279 kB 00:00 2024-09-12T01:15:58.253 INFO:teuthology.orchestra.run.smithi081.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-12T01:15:58.275 INFO:teuthology.orchestra.run.smithi100.stdout:(89/156): python3-protobuf-3.14.0-13.el9.noarch 1.8 MB/s | 269 kB 00:00 2024-09-12T01:15:58.280 INFO:teuthology.orchestra.run.smithi081.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T01:15:58.300 INFO:teuthology.orchestra.run.smithi100.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T01:15:58.304 INFO:teuthology.orchestra.run.smithi081.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T01:15:58.326 INFO:teuthology.orchestra.run.smithi100.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T01:15:58.368 INFO:teuthology.orchestra.run.smithi100.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-12T01:15:58.371 INFO:teuthology.orchestra.run.smithi081.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-12T01:15:58.395 INFO:teuthology.orchestra.run.smithi189.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 4.9 MB/s | 752 kB 00:00 2024-09-12T01:15:58.409 INFO:teuthology.orchestra.run.smithi100.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-12T01:15:58.438 INFO:teuthology.orchestra.run.smithi081.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 19 MB/s | 3.1 MB 00:00 2024-09-12T01:15:58.445 INFO:teuthology.orchestra.run.smithi189.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 3.2 MB/s | 163 kB 00:00 2024-09-12T01:15:58.463 INFO:teuthology.orchestra.run.smithi081.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 347 kB/s | 32 kB 00:00 2024-09-12T01:15:58.491 INFO:teuthology.orchestra.run.smithi081.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.8 MB/s | 146 kB 00:00 2024-09-12T01:15:58.495 INFO:teuthology.orchestra.run.smithi189.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-12T01:15:58.502 INFO:teuthology.orchestra.run.smithi100.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.4 MB/s | 221 kB 00:00 2024-09-12T01:15:58.544 INFO:teuthology.orchestra.run.smithi100.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 865 kB/s | 36 kB 00:00 2024-09-12T01:15:58.585 INFO:teuthology.orchestra.run.smithi100.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-12T01:15:58.694 INFO:teuthology.orchestra.run.smithi100.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-12T01:15:58.736 INFO:teuthology.orchestra.run.smithi100.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-12T01:15:58.795 INFO:teuthology.orchestra.run.smithi100.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-12T01:15:58.812 INFO:teuthology.orchestra.run.smithi189.stdout:(17/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 3.4 MB/s | 11 MB 00:03 2024-09-12T01:15:58.837 INFO:teuthology.orchestra.run.smithi189.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 1.4 MB/s | 506 kB 00:00 2024-09-12T01:15:58.862 INFO:teuthology.orchestra.run.smithi100.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-09-12T01:15:58.880 INFO:teuthology.orchestra.run.smithi081.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 19 MB/s | 7.4 MB 00:00 2024-09-12T01:15:58.896 INFO:teuthology.orchestra.run.smithi189.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 775 kB/s | 45 kB 00:00 2024-09-12T01:15:58.904 INFO:teuthology.orchestra.run.smithi100.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-12T01:15:58.939 INFO:teuthology.orchestra.run.smithi081.stdout:(32/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 7.5 MB/s | 3.6 MB 00:00 2024-09-12T01:15:58.946 INFO:teuthology.orchestra.run.smithi189.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.7 MB/s | 136 kB 00:00 2024-09-12T01:15:58.964 INFO:teuthology.orchestra.run.smithi081.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.9 MB/s | 249 kB 00:00 2024-09-12T01:15:58.989 INFO:teuthology.orchestra.run.smithi081.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 982 kB/s | 49 kB 00:00 2024-09-12T01:15:58.996 INFO:teuthology.orchestra.run.smithi100.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-12T01:15:59.005 INFO:teuthology.orchestra.run.smithi189.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.7 MB/s | 162 kB 00:00 2024-09-12T01:15:59.014 INFO:teuthology.orchestra.run.smithi081.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 328 kB/s | 16 kB 00:00 2024-09-12T01:15:59.049 INFO:teuthology.orchestra.run.smithi081.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.7 MB/s | 285 kB 00:00 2024-09-12T01:15:59.082 INFO:teuthology.orchestra.run.smithi081.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 11 MB/s | 765 kB 00:00 2024-09-12T01:15:59.089 INFO:teuthology.orchestra.run.smithi189.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 321 kB 00:00 2024-09-12T01:15:59.107 INFO:teuthology.orchestra.run.smithi081.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 311 kB/s | 18 kB 00:00 2024-09-12T01:15:59.163 INFO:teuthology.orchestra.run.smithi100.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 5.1 MB/s | 863 kB 00:00 2024-09-12T01:15:59.164 INFO:teuthology.orchestra.run.smithi189.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.9 MB/s | 301 kB 00:00 2024-09-12T01:15:59.206 INFO:teuthology.orchestra.run.smithi189.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 2.3 MB/s | 100 kB 00:00 2024-09-12T01:15:59.213 INFO:teuthology.orchestra.run.smithi100.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T01:15:59.238 INFO:teuthology.orchestra.run.smithi100.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-12T01:15:59.256 INFO:teuthology.orchestra.run.smithi189.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T01:15:59.264 INFO:teuthology.orchestra.run.smithi100.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-12T01:15:59.372 INFO:teuthology.orchestra.run.smithi100.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-12T01:15:59.397 INFO:teuthology.orchestra.run.smithi100.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T01:15:59.423 INFO:teuthology.orchestra.run.smithi100.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T01:15:59.448 INFO:teuthology.orchestra.run.smithi100.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-12T01:15:59.473 INFO:teuthology.orchestra.run.smithi100.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T01:15:59.507 INFO:teuthology.orchestra.run.smithi100.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-12T01:15:59.541 INFO:teuthology.orchestra.run.smithi100.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T01:15:59.566 INFO:teuthology.orchestra.run.smithi100.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T01:15:59.656 INFO:teuthology.orchestra.run.smithi189.stdout:(26/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 7.8 MB/s | 3.1 MB 00:00 2024-09-12T01:15:59.716 INFO:teuthology.orchestra.run.smithi100.stdout:(115/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-12T01:15:59.723 INFO:teuthology.orchestra.run.smithi189.stdout:(27/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 5.9 MB/s | 5.3 MB 00:00 2024-09-12T01:15:59.741 INFO:teuthology.orchestra.run.smithi100.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 184 kB/s | 32 kB 00:00 2024-09-12T01:15:59.748 INFO:teuthology.orchestra.run.smithi189.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-09-12T01:15:59.758 INFO:teuthology.orchestra.run.smithi081.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 19 MB/s | 49 MB 00:02 2024-09-12T01:15:59.773 INFO:teuthology.orchestra.run.smithi189.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 635 kB/s | 32 kB 00:00 2024-09-12T01:15:59.775 INFO:teuthology.orchestra.run.smithi100.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 429 kB/s | 14 kB 00:00 2024-09-12T01:15:59.799 INFO:teuthology.orchestra.run.smithi189.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-12T01:15:59.817 INFO:teuthology.orchestra.run.smithi100.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 8.8 MB/s | 358 kB 00:00 2024-09-12T01:15:59.892 INFO:teuthology.orchestra.run.smithi100.stdout:(119/156): python3-numpy-1.20.1-5.el9.x86_64.rp 2.5 MB/s | 5.1 MB 00:02 2024-09-12T01:15:59.934 INFO:teuthology.orchestra.run.smithi100.stdout:(120/156): python3-cheroot-8.6.0-4.el9.noarch.r 895 kB/s | 172 kB 00:00 2024-09-12T01:15:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.0 MB/s | 303 kB 00:00 2024-09-12T01:15:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T01:16:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-12T01:16:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:(124/156): python3-google-auth-2.34.0-1.el9.noa 1.4 MB/s | 220 kB 00:00 2024-09-12T01:16:00.069 INFO:teuthology.orchestra.run.smithi100.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-12T01:16:00.094 INFO:teuthology.orchestra.run.smithi100.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-12T01:16:00.119 INFO:teuthology.orchestra.run.smithi100.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-12T01:16:00.145 INFO:teuthology.orchestra.run.smithi100.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-12T01:16:00.179 INFO:teuthology.orchestra.run.smithi100.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-12T01:16:00.204 INFO:teuthology.orchestra.run.smithi100.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T01:16:00.229 INFO:teuthology.orchestra.run.smithi100.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T01:16:00.257 INFO:teuthology.orchestra.run.smithi189.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 7.4 MB/s | 3.6 MB 00:00 2024-09-12T01:16:00.271 INFO:teuthology.orchestra.run.smithi100.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.7 MB/s | 1.0 MB 00:00 2024-09-12T01:16:00.274 INFO:teuthology.orchestra.run.smithi081.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 67 kB/s | 80 kB 00:01 2024-09-12T01:16:00.296 INFO:teuthology.orchestra.run.smithi100.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-12T01:16:00.322 INFO:teuthology.orchestra.run.smithi100.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-12T01:16:00.324 INFO:teuthology.orchestra.run.smithi189.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.7 MB/s | 249 kB 00:00 2024-09-12T01:16:00.347 INFO:teuthology.orchestra.run.smithi100.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T01:16:00.373 INFO:teuthology.orchestra.run.smithi100.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-12T01:16:00.375 INFO:teuthology.orchestra.run.smithi189.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 991 kB/s | 49 kB 00:00 2024-09-12T01:16:00.398 INFO:teuthology.orchestra.run.smithi100.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-12T01:16:00.417 INFO:teuthology.orchestra.run.smithi189.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 396 kB/s | 16 kB 00:00 2024-09-12T01:16:00.423 INFO:teuthology.orchestra.run.smithi100.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T01:16:00.448 INFO:teuthology.orchestra.run.smithi100.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T01:16:00.474 INFO:teuthology.orchestra.run.smithi100.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T01:16:00.484 INFO:teuthology.orchestra.run.smithi189.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.2 MB/s | 285 kB 00:00 2024-09-12T01:16:00.524 INFO:teuthology.orchestra.run.smithi100.stdout:(141/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-12T01:16:00.549 INFO:teuthology.orchestra.run.smithi100.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 742 kB/s | 74 kB 00:00 2024-09-12T01:16:00.558 INFO:teuthology.orchestra.run.smithi081.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 552 kB/s | 801 kB 00:01 2024-09-12T01:16:00.574 INFO:teuthology.orchestra.run.smithi100.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T01:16:00.583 INFO:teuthology.orchestra.run.smithi081.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 236 kB/s | 191 kB 00:00 2024-09-12T01:16:00.608 INFO:teuthology.orchestra.run.smithi100.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-12T01:16:00.633 INFO:teuthology.orchestra.run.smithi100.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-12T01:16:00.659 INFO:teuthology.orchestra.run.smithi100.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T01:16:00.667 INFO:teuthology.orchestra.run.smithi189.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 8.5 MB/s | 7.4 MB 00:00 2024-09-12T01:16:00.692 INFO:teuthology.orchestra.run.smithi100.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-12T01:16:00.709 INFO:teuthology.orchestra.run.smithi189.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 3.3 MB/s | 765 kB 00:00 2024-09-12T01:16:00.734 INFO:teuthology.orchestra.run.smithi189.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 273 kB/s | 18 kB 00:00 2024-09-12T01:16:00.743 INFO:teuthology.orchestra.run.smithi100.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T01:16:00.843 INFO:teuthology.orchestra.run.smithi189.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-12T01:16:00.918 INFO:teuthology.orchestra.run.smithi189.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-12T01:16:00.943 INFO:teuthology.orchestra.run.smithi189.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-12T01:16:00.951 INFO:teuthology.orchestra.run.smithi100.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 3.2 MB 00:00 2024-09-12T01:16:00.968 INFO:teuthology.orchestra.run.smithi189.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-09-12T01:16:01.002 INFO:teuthology.orchestra.run.smithi189.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-09-12T01:16:01.026 INFO:teuthology.orchestra.run.smithi100.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 9.3 MB/s | 3.4 MB 00:00 2024-09-12T01:16:01.050 INFO:teuthology.orchestra.run.smithi081.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 327 kB/s | 253 kB 00:00 2024-09-12T01:16:01.052 INFO:teuthology.orchestra.run.smithi189.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-12T01:16:01.078 INFO:teuthology.orchestra.run.smithi189.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-12T01:16:01.103 INFO:teuthology.orchestra.run.smithi189.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T01:16:01.127 INFO:teuthology.orchestra.run.smithi100.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 6.0 MB/s | 2.3 MB 00:00 2024-09-12T01:16:01.128 INFO:teuthology.orchestra.run.smithi189.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T01:16:01.152 INFO:teuthology.orchestra.run.smithi100.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 326 kB/s | 41 kB 00:00 2024-09-12T01:16:01.186 INFO:teuthology.orchestra.run.smithi100.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-12T01:16:01.251 INFO:teuthology.orchestra.run.smithi081.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 160 kB/s | 106 kB 00:00 2024-09-12T01:16:01.294 INFO:teuthology.orchestra.run.smithi100.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 5.3 MB/s | 1.8 MB 00:00 2024-09-12T01:16:01.378 INFO:teuthology.orchestra.run.smithi100.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-09-12T01:16:01.419 INFO:teuthology.orchestra.run.smithi100.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 5.1 MB/s | 1.4 MB 00:00 2024-09-12T01:16:01.426 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:16:01.426 INFO:teuthology.orchestra.run.smithi100.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-12T01:16:01.576 INFO:teuthology.orchestra.run.smithi081.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-09-12T01:16:01.751 INFO:teuthology.orchestra.run.smithi081.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 193 kB/s | 135 kB 00:00 2024-09-12T01:16:01.968 INFO:teuthology.orchestra.run.smithi081.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 174 kB/s | 125 kB 00:00 2024-09-12T01:16:01.987 INFO:teuthology.orchestra.run.smithi189.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 780 kB/s | 689 kB 00:00 2024-09-12T01:16:02.056 INFO:teuthology.orchestra.run.smithi189.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-12T01:16:02.077 INFO:teuthology.orchestra.run.smithi081.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-12T01:16:02.152 INFO:teuthology.orchestra.run.smithi081.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-12T01:16:02.202 INFO:teuthology.orchestra.run.smithi081.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-12T01:16:02.319 INFO:teuthology.orchestra.run.smithi081.stdout:(51/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-12T01:16:02.378 INFO:teuthology.orchestra.run.smithi081.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 943 kB 00:00 2024-09-12T01:16:02.403 INFO:teuthology.orchestra.run.smithi081.stdout:(53/156): python3-urllib3-1.26.5-6.el9.noarch.r 260 kB/s | 215 kB 00:00 2024-09-12T01:16:02.429 INFO:teuthology.orchestra.run.smithi081.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 300 kB/s | 33 kB 00:00 2024-09-12T01:16:02.479 INFO:teuthology.orchestra.run.smithi081.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 367 kB/s | 18 kB 00:00 2024-09-12T01:16:02.529 INFO:teuthology.orchestra.run.smithi081.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 112 kB/s | 11 kB 00:00 2024-09-12T01:16:02.579 INFO:teuthology.orchestra.run.smithi081.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-12T01:16:02.587 INFO:teuthology.orchestra.run.smithi189.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 41 kB/s | 22 kB 00:00 2024-09-12T01:16:02.613 INFO:teuthology.orchestra.run.smithi081.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-09-12T01:16:02.660 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-12T01:16:02.809 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-12T01:16:02.809 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-12T01:16:02.830 INFO:teuthology.orchestra.run.smithi081.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.6 MB/s | 662 kB 00:00 2024-09-12T01:16:02.905 INFO:teuthology.orchestra.run.smithi081.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 327 kB/s | 24 kB 00:00 2024-09-12T01:16:02.956 INFO:teuthology.orchestra.run.smithi081.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-12T01:16:02.989 INFO:teuthology.orchestra.run.smithi081.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 1.5 MB/s | 581 kB 00:00 2024-09-12T01:16:03.063 INFO:teuthology.orchestra.run.smithi189.stdout:(51/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 8.6 MB/s | 49 MB 00:05 2024-09-12T01:16:03.073 INFO:teuthology.orchestra.run.smithi081.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-12T01:16:03.087 INFO:teuthology.orchestra.run.smithi189.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 97 kB/s | 107 kB 00:01 2024-09-12T01:16:03.123 INFO:teuthology.orchestra.run.smithi081.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-12T01:16:03.148 INFO:teuthology.orchestra.run.smithi081.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-12T01:16:03.341 INFO:teuthology.orchestra.run.smithi081.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.1 MB/s | 3.0 MB 00:00 2024-09-12T01:16:03.630 INFO:teuthology.orchestra.run.smithi189.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 58 kB/s | 33 kB 00:00 2024-09-12T01:16:03.707 INFO:teuthology.orchestra.run.smithi081.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-09-12T01:16:03.838 INFO:teuthology.orchestra.run.smithi189.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 251 kB/s | 313 kB 00:01 2024-09-12T01:16:03.908 INFO:teuthology.orchestra.run.smithi081.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 4.4 MB/s | 910 kB 00:00 2024-09-12T01:16:03.966 INFO:teuthology.orchestra.run.smithi081.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-12T01:16:04.138 INFO:teuthology.orchestra.run.smithi189.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-12T01:16:04.247 INFO:teuthology.orchestra.run.smithi189.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-09-12T01:16:04.364 INFO:teuthology.orchestra.run.smithi189.stdout:(57/156): libaio-devel-0.3.111-13.el9.x86_64.rp 21 kB/s | 11 kB 00:00 2024-09-12T01:16:04.458 INFO:teuthology.orchestra.run.smithi081.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.7 MB/s | 4.9 MB 00:01 2024-09-12T01:16:04.525 INFO:teuthology.orchestra.run.smithi081.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-09-12T01:16:04.575 INFO:teuthology.orchestra.run.smithi081.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-12T01:16:04.595 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-12T01:16:04.596 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-12T01:16:04.750 INFO:teuthology.orchestra.run.smithi081.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-09-12T01:16:04.801 INFO:teuthology.orchestra.run.smithi081.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-12T01:16:04.814 INFO:teuthology.orchestra.run.smithi189.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 80 kB/s | 45 kB 00:00 2024-09-12T01:16:04.884 INFO:teuthology.orchestra.run.smithi081.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-12T01:16:04.964 INFO:teuthology.orchestra.run.smithi189.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 194 kB/s | 160 kB 00:00 2024-09-12T01:16:04.968 INFO:teuthology.orchestra.run.smithi081.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-12T01:16:05.043 INFO:teuthology.orchestra.run.smithi081.stdout:(77/156): postgresql-server-13.16-1.el9.x86_64. 5.4 MB/s | 5.8 MB 00:01 2024-09-12T01:16:05.068 INFO:teuthology.orchestra.run.smithi081.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-09-12T01:16:05.094 INFO:teuthology.orchestra.run.smithi081.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-12T01:16:05.144 INFO:teuthology.orchestra.run.smithi081.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-12T01:16:05.169 INFO:teuthology.orchestra.run.smithi081.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-12T01:16:05.253 INFO:teuthology.orchestra.run.smithi081.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-12T01:16:05.314 INFO:teuthology.orchestra.run.smithi189.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 697 kB/s | 662 kB 00:00 2024-09-12T01:16:05.345 INFO:teuthology.orchestra.run.smithi081.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-12T01:16:05.404 INFO:teuthology.orchestra.run.smithi081.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T01:16:05.454 INFO:teuthology.orchestra.run.smithi081.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-09-12T01:16:05.498 INFO:teuthology.orchestra.run.smithi189.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 46 kB/s | 24 kB 00:00 2024-09-12T01:16:05.538 INFO:teuthology.orchestra.run.smithi081.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-09-12T01:16:05.621 INFO:teuthology.orchestra.run.smithi081.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-12T01:16:05.690 INFO:teuthology.orchestra.run.smithi189.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 664 kB/s | 581 kB 00:00 2024-09-12T01:16:05.705 INFO:teuthology.orchestra.run.smithi081.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-12T01:16:05.755 INFO:teuthology.orchestra.run.smithi081.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T01:16:05.856 INFO:teuthology.orchestra.run.smithi081.stdout:(90/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-09-12T01:16:05.881 INFO:teuthology.orchestra.run.smithi081.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 428 kB/s | 54 kB 00:00 2024-09-12T01:16:05.907 INFO:teuthology.orchestra.run.smithi189.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 80 kB/s | 47 kB 00:00 2024-09-12T01:16:05.948 INFO:teuthology.orchestra.run.smithi081.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.3 MB/s | 5.1 MB 00:00 2024-09-12T01:16:05.973 INFO:teuthology.orchestra.run.smithi081.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-12T01:16:05.998 INFO:teuthology.orchestra.run.smithi081.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-09-12T01:16:06.049 INFO:teuthology.orchestra.run.smithi081.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-12T01:16:06.074 INFO:teuthology.orchestra.run.smithi081.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-09-12T01:16:06.099 INFO:teuthology.orchestra.run.smithi081.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T01:16:06.149 INFO:teuthology.orchestra.run.smithi081.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T01:16:06.175 INFO:teuthology.orchestra.run.smithi081.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-12T01:16:06.200 INFO:teuthology.orchestra.run.smithi081.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T01:16:06.225 INFO:teuthology.orchestra.run.smithi081.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T01:16:06.251 INFO:teuthology.orchestra.run.smithi081.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 889 kB/s | 45 kB 00:00 2024-09-12T01:16:06.266 INFO:teuthology.orchestra.run.smithi189.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 381 kB/s | 292 kB 00:00 2024-09-12T01:16:06.334 INFO:teuthology.orchestra.run.smithi081.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-12T01:16:06.410 INFO:teuthology.orchestra.run.smithi081.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-12T01:16:06.432 INFO:teuthology.orchestra.run.smithi189.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 254 kB/s | 188 kB 00:00 2024-09-12T01:16:06.443 INFO:teuthology.orchestra.run.smithi081.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.0 MB/s | 309 kB 00:00 2024-09-12T01:16:06.469 INFO:teuthology.orchestra.run.smithi081.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-12T01:16:06.533 INFO:teuthology.orchestra.run.smithi189.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 61 kB/s | 38 kB 00:00 2024-09-12T01:16:06.544 INFO:teuthology.orchestra.run.smithi081.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-09-12T01:16:06.619 INFO:teuthology.orchestra.run.smithi081.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-09-12T01:16:06.644 INFO:teuthology.orchestra.run.smithi081.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-12T01:16:06.670 INFO:teuthology.orchestra.run.smithi081.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 207 kB/s | 26 kB 00:00 2024-09-12T01:16:06.704 INFO:teuthology.orchestra.run.smithi081.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-12T01:16:06.729 INFO:teuthology.orchestra.run.smithi081.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-12T01:16:06.762 INFO:teuthology.orchestra.run.smithi081.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-12T01:16:06.796 INFO:teuthology.orchestra.run.smithi081.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-12T01:16:06.813 INFO:teuthology.orchestra.run.smithi081.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2024-09-12T01:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 863 kB/s | 14 kB 00:00 2024-09-12T01:16:06.847 INFO:teuthology.orchestra.run.smithi081.stdout:(117/156): python3-cachetools-4.2.4-1.el9.noarc 964 kB/s | 32 kB 00:00 2024-09-12T01:16:06.872 INFO:teuthology.orchestra.run.smithi081.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-12T01:16:06.906 INFO:teuthology.orchestra.run.smithi081.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T01:16:06.940 INFO:teuthology.orchestra.run.smithi081.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-12T01:16:06.965 INFO:teuthology.orchestra.run.smithi081.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T01:16:06.990 INFO:teuthology.orchestra.run.smithi081.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T01:16:07.015 INFO:teuthology.orchestra.run.smithi081.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-12T01:16:07.041 INFO:teuthology.orchestra.run.smithi081.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-12T01:16:07.066 INFO:teuthology.orchestra.run.smithi081.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-12T01:16:07.091 INFO:teuthology.orchestra.run.smithi081.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-12T01:16:07.116 INFO:teuthology.orchestra.run.smithi081.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 786 kB/s | 20 kB 00:00 2024-09-12T01:16:07.167 INFO:teuthology.orchestra.run.smithi081.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-09-12T01:16:07.192 INFO:teuthology.orchestra.run.smithi081.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:16:07.242 INFO:teuthology.orchestra.run.smithi081.stdout:(130/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.7 MB/s | 2.0 MB 00:00 2024-09-12T01:16:07.268 INFO:teuthology.orchestra.run.smithi081.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-09-12T01:16:07.293 INFO:teuthology.orchestra.run.smithi081.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-12T01:16:07.318 INFO:teuthology.orchestra.run.smithi081.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-12T01:16:07.344 INFO:teuthology.orchestra.run.smithi081.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T01:16:07.369 INFO:teuthology.orchestra.run.smithi081.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-12T01:16:07.394 INFO:teuthology.orchestra.run.smithi081.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-12T01:16:07.428 INFO:teuthology.orchestra.run.smithi081.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2024-09-12T01:16:07.433 INFO:teuthology.orchestra.run.smithi189.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.2 MB/s | 4.9 MB 00:01 2024-09-12T01:16:07.453 INFO:teuthology.orchestra.run.smithi081.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T01:16:07.487 INFO:teuthology.orchestra.run.smithi081.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-09-12T01:16:07.512 INFO:teuthology.orchestra.run.smithi081.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 609 kB/s | 36 kB 00:00 2024-09-12T01:16:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-12T01:16:07.571 INFO:teuthology.orchestra.run.smithi081.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T01:16:07.583 INFO:teuthology.orchestra.run.smithi189.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-12T01:16:07.596 INFO:teuthology.orchestra.run.smithi081.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-12T01:16:07.622 INFO:teuthology.orchestra.run.smithi081.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 800 kB/s | 20 kB 00:00 2024-09-12T01:16:07.642 INFO:teuthology.orchestra.run.smithi189.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-09-12T01:16:07.647 INFO:teuthology.orchestra.run.smithi081.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-12T01:16:07.672 INFO:teuthology.orchestra.run.smithi081.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-12T01:16:07.731 INFO:teuthology.orchestra.run.smithi081.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-12T01:16:07.982 INFO:teuthology.orchestra.run.smithi081.stdout:(148/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 13 MB/s | 3.2 MB 00:00 2024-09-12T01:16:08.040 INFO:teuthology.orchestra.run.smithi081.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 9.3 MB/s | 3.4 MB 00:00 2024-09-12T01:16:08.232 INFO:teuthology.orchestra.run.smithi081.stdout:(150/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.8 MB/s | 16 MB 00:02 2024-09-12T01:16:08.292 INFO:teuthology.orchestra.run.smithi189.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 194 kB/s | 137 kB 00:00 2024-09-12T01:16:08.350 INFO:teuthology.orchestra.run.smithi189.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 993 kB/s | 910 kB 00:00 2024-09-12T01:16:08.801 INFO:teuthology.orchestra.run.smithi189.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-09-12T01:16:08.841 INFO:teuthology.orchestra.run.smithi081.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 67 kB/s | 41 kB 00:00 2024-09-12T01:16:09.034 INFO:teuthology.orchestra.run.smithi189.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 128 kB/s | 87 kB 00:00 2024-09-12T01:16:09.208 INFO:teuthology.orchestra.run.smithi081.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 1.9 MB/s | 2.3 MB 00:01 2024-09-12T01:16:09.258 INFO:teuthology.orchestra.run.smithi081.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 1.5 MB/s | 1.8 MB 00:01 2024-09-12T01:16:09.334 INFO:teuthology.orchestra.run.smithi189.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 992 kB/s | 1.0 MB 00:01 2024-09-12T01:16:09.701 INFO:teuthology.orchestra.run.smithi189.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 92 kB/s | 61 kB 00:00 2024-09-12T01:16:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 282 kB/s | 249 kB 00:00 2024-09-12T01:16:10.077 INFO:teuthology.orchestra.run.smithi189.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-09-12T01:16:10.168 INFO:teuthology.orchestra.run.smithi189.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 294 kB/s | 245 kB 00:00 2024-09-12T01:16:10.233 INFO:teuthology.orchestra.run.smithi081.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.3 MB/s | 1.4 MB 00:01 2024-09-12T01:16:10.375 INFO:teuthology.orchestra.run.smithi081.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-09-12T01:16:10.382 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:16:10.382 INFO:teuthology.orchestra.run.smithi081.stdout:Total 15 MB/s | 226 MB 00:15 2024-09-12T01:16:10.477 INFO:teuthology.orchestra.run.smithi189.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 320 kB/s | 248 kB 00:00 2024-09-12T01:16:10.652 INFO:teuthology.orchestra.run.smithi189.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 45 kB/s | 26 kB 00:00 2024-09-12T01:16:10.710 INFO:teuthology.orchestra.run.smithi189.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 35 kB/s | 19 kB 00:00 2024-09-12T01:16:10.936 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-12T01:16:11.032 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:16:11.070 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:16:11.132 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:16:11.169 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:16:11.191 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:16:11.234 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:16:11.236 INFO:teuthology.orchestra.run.smithi189.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 227 kB/s | 172 kB 00:00 2024-09-12T01:16:11.261 INFO:teuthology.orchestra.run.smithi189.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 57 kB/s | 35 kB 00:00 2024-09-12T01:16:11.554 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:16:11.626 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-12T01:16:11.667 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:16:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-12T01:16:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-12T01:16:11.806 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:16:11.835 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:16:11.836 INFO:teuthology.orchestra.run.smithi189.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.5 MB/s | 5.1 MB 00:01 2024-09-12T01:16:11.927 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:16:11.956 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:16:12.053 INFO:teuthology.orchestra.run.smithi189.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 281 kB/s | 222 kB 00:00 2024-09-12T01:16:12.087 INFO:teuthology.orchestra.run.smithi189.stdout:(85/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 295 kB/s | 250 kB 00:00 2024-09-12T01:16:12.102 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:16:12.170 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:16:12.201 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:16:12.301 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:16:12.323 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:16:12.386 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:16:12.408 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:16:12.435 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:16:12.512 INFO:teuthology.orchestra.run.smithi189.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 114 kB/s | 77 kB 00:00 2024-09-12T01:16:12.634 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:16:12.671 INFO:teuthology.orchestra.run.smithi189.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 68 kB/s | 42 kB 00:00 2024-09-12T01:16:12.762 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:16:12.877 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:16:12.929 INFO:teuthology.orchestra.run.smithi189.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 320 kB/s | 269 kB 00:00 2024-09-12T01:16:12.976 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:16:13.053 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:16:13.282 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:16:13.313 INFO:teuthology.orchestra.run.smithi189.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 198 kB/s | 159 kB 00:00 2024-09-12T01:16:13.395 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:16:13.497 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:16:13.513 INFO:teuthology.orchestra.run.smithi189.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 331 kB/s | 279 kB 00:00 2024-09-12T01:16:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:16:13.547 INFO:teuthology.orchestra.run.smithi189.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 83 kB/s | 51 kB 00:00 2024-09-12T01:16:13.559 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:16:13.623 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:16:13.669 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:16:13.701 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:16:13.753 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:16:13.785 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:16:13.813 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:16:13.881 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:16:13.935 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:16:13.966 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:16:13.977 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-12T01:16:13.977 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-12T01:16:13.989 INFO:teuthology.orchestra.run.smithi189.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 79 kB/s | 54 kB 00:00 2024-09-12T01:16:14.001 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:16:14.079 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:16:14.113 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:16:14.164 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:16:14.172 INFO:teuthology.orchestra.run.smithi189.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-09-12T01:16:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:16:14.270 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:16:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:16:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:16:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:16:14.564 INFO:teuthology.orchestra.run.smithi189.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 77 kB/s | 44 kB 00:00 2024-09-12T01:16:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:16:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:16:15.089 INFO:teuthology.orchestra.run.smithi189.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-12T01:16:15.106 INFO:teuthology.orchestra.run.smithi189.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 236 kB/s | 221 kB 00:00 2024-09-12T01:16:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:16:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:16:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:16:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:16:15.315 INFO:teuthology.orchestra.run.smithi189.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 48 kB/s | 36 kB 00:00 2024-09-12T01:16:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:16:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:16:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:16:15.575 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:16:15.640 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:16:15.671 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:16:15.716 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:16:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:16:15.765 INFO:teuthology.orchestra.run.smithi189.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 70 kB/s | 47 kB 00:00 2024-09-12T01:16:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:16:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:16:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:16:15.957 INFO:teuthology.orchestra.run.smithi189.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 358 kB/s | 304 kB 00:00 2024-09-12T01:16:16.007 INFO:teuthology.orchestra.run.smithi189.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 83 kB/s | 58 kB 00:00 2024-09-12T01:16:16.026 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:16:16.069 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:16:16.110 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:16:16.211 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:16:16.518 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:16:16.541 INFO:teuthology.orchestra.run.smithi189.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 124 kB/s | 96 kB 00:00 2024-09-12T01:16:16.599 INFO:teuthology.orchestra.run.smithi189.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 99 kB/s | 64 kB 00:00 2024-09-12T01:16:16.650 INFO:teuthology.orchestra.run.smithi189.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 71 kB/s | 45 kB 00:00 2024-09-12T01:16:16.683 INFO:teuthology.orchestra.run.smithi189.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-12T01:16:16.725 INFO:teuthology.orchestra.run.smithi189.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-12T01:16:16.750 INFO:teuthology.orchestra.run.smithi189.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 845 kB/s | 19 kB 00:00 2024-09-12T01:16:16.776 INFO:teuthology.orchestra.run.smithi189.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-09-12T01:16:16.801 INFO:teuthology.orchestra.run.smithi189.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T01:16:16.802 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:16:16.826 INFO:teuthology.orchestra.run.smithi189.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T01:16:16.851 INFO:teuthology.orchestra.run.smithi189.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-12T01:16:16.877 INFO:teuthology.orchestra.run.smithi189.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T01:16:16.910 INFO:teuthology.orchestra.run.smithi189.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-09-12T01:16:16.944 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:16:16.952 INFO:teuthology.orchestra.run.smithi189.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-12T01:16:16.968 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:16:16.977 INFO:teuthology.orchestra.run.smithi189.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.9 MB/s | 43 kB 00:00 2024-09-12T01:16:17.003 INFO:teuthology.orchestra.run.smithi189.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T01:16:17.028 INFO:teuthology.orchestra.run.smithi189.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 558 kB/s | 14 kB 00:00 2024-09-12T01:16:17.051 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:16:17.053 INFO:teuthology.orchestra.run.smithi189.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-12T01:16:17.087 INFO:teuthology.orchestra.run.smithi189.stdout:(118/156): python3-asyncssh-2.13.2-5.el9.noarch 3.0 MB/s | 548 kB 00:00 2024-09-12T01:16:17.121 INFO:teuthology.orchestra.run.smithi189.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-12T01:16:17.146 INFO:teuthology.orchestra.run.smithi189.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T01:16:17.171 INFO:teuthology.orchestra.run.smithi189.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T01:16:17.178 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:16:17.197 INFO:teuthology.orchestra.run.smithi189.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T01:16:17.217 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:16:17.222 INFO:teuthology.orchestra.run.smithi189.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-12T01:16:17.245 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:16:17.247 INFO:teuthology.orchestra.run.smithi189.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-12T01:16:17.273 INFO:teuthology.orchestra.run.smithi189.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-12T01:16:17.287 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:16:17.331 INFO:teuthology.orchestra.run.smithi189.stdout:(126/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 4.4 MB 00:00 2024-09-12T01:16:17.334 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:16:17.356 INFO:teuthology.orchestra.run.smithi189.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 233 kB/s | 19 kB 00:00 2024-09-12T01:16:17.366 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:16:17.382 INFO:teuthology.orchestra.run.smithi189.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-12T01:16:17.396 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:16:17.407 INFO:teuthology.orchestra.run.smithi189.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:16:17.431 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:16:17.432 INFO:teuthology.orchestra.run.smithi189.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T01:16:17.464 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:16:17.466 INFO:teuthology.orchestra.run.smithi189.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-12T01:16:17.499 INFO:teuthology.orchestra.run.smithi189.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T01:16:17.505 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:16:17.525 INFO:teuthology.orchestra.run.smithi189.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-12T01:16:17.540 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:16:17.558 INFO:teuthology.orchestra.run.smithi189.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-09-12T01:16:17.600 INFO:teuthology.orchestra.run.smithi189.stdout:(135/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.5 MB/s | 2.0 MB 00:00 2024-09-12T01:16:17.625 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:16:17.625 INFO:teuthology.orchestra.run.smithi189.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 422 kB/s | 28 kB 00:00 2024-09-12T01:16:17.651 INFO:teuthology.orchestra.run.smithi189.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 715 kB/s | 90 kB 00:00 2024-09-12T01:16:17.676 INFO:teuthology.orchestra.run.smithi189.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-09-12T01:16:17.679 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:16:17.701 INFO:teuthology.orchestra.run.smithi189.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-12T01:16:17.718 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:16:17.726 INFO:teuthology.orchestra.run.smithi189.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T01:16:17.743 INFO:teuthology.orchestra.run.smithi189.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-12T01:16:17.760 INFO:teuthology.orchestra.run.smithi189.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-12T01:16:17.786 INFO:teuthology.orchestra.run.smithi189.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-12T01:16:17.811 INFO:teuthology.orchestra.run.smithi189.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-12T01:16:17.822 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:16:17.836 INFO:teuthology.orchestra.run.smithi189.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T01:16:17.861 INFO:teuthology.orchestra.run.smithi189.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T01:16:17.879 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:16:17.904 INFO:teuthology.orchestra.run.smithi189.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-12T01:16:17.945 INFO:teuthology.orchestra.run.smithi189.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T01:16:18.129 INFO:teuthology.orchestra.run.smithi189.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-09-12T01:16:18.196 INFO:teuthology.orchestra.run.smithi189.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-09-12T01:16:18.238 INFO:teuthology.orchestra.run.smithi189.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 981 kB/s | 41 kB 00:00 2024-09-12T01:16:18.280 INFO:teuthology.orchestra.run.smithi189.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 5.9 MB/s | 249 kB 00:00 2024-09-12T01:16:18.338 INFO:teuthology.orchestra.run.smithi189.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-12T01:16:18.414 INFO:teuthology.orchestra.run.smithi189.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-09-12T01:16:18.464 INFO:teuthology.orchestra.run.smithi189.stdout:(155/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 5.6 MB/s | 3.2 MB 00:00 2024-09-12T01:16:18.572 INFO:teuthology.orchestra.run.smithi189.stdout:(156/156): librados2-19.1.1-298.gb53b6d3e.el9.x 4.8 MB/s | 3.4 MB 00:00 2024-09-12T01:16:18.579 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:16:18.579 INFO:teuthology.orchestra.run.smithi189.stdout:Total 8.9 MB/s | 226 MB 00:25 2024-09-12T01:16:18.584 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:16:18.635 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:16:18.669 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:16:18.765 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:16:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:16:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:16:18.947 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:16:18.989 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:16:19.171 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:16:19.203 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:16:19.280 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:16:19.820 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-09-12T01:16:19.913 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:16:19.974 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-09-12T01:16:19.974 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-09-12T01:16:20.025 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:16:20.288 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-12T01:16:20.389 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:16:20.435 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:16:20.590 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:16:20.623 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:16:20.649 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:16:20.714 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:16:21.047 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:16:21.158 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:16:21.222 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:16:21.265 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:16:21.292 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:16:21.299 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:16:21.327 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:16:21.360 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:16:21.384 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:16:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:16:21.582 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:16:21.636 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:16:21.668 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:16:21.672 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:16:21.715 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:16:21.759 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:16:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:16:21.805 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:16:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:16:21.837 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:16:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:16:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:16:21.872 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:16:21.950 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-09-12T01:16:21.950 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-09-12T01:16:22.059 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:16:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:16:22.347 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:16:22.373 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:16:22.444 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:16:22.488 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:16:22.506 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:16:22.537 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:16:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:16:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:16:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:16:23.000 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:16:23.036 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:16:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:16:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:16:23.190 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:16:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:16:23.274 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:16:23.307 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:16:23.334 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:16:23.402 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:16:23.456 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:16:23.488 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:16:23.538 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:16:23.607 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:16:23.650 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:16:23.693 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:16:23.722 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:16:23.791 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:16:23.837 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:16:23.911 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:16:24.051 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:16:24.114 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:16:24.633 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:16:24.727 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:16:24.755 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:16:24.770 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:16:24.807 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:16:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:16:24.845 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:16:24.896 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:16:25.047 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:16:25.098 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:16:25.152 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:16:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:16:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:16:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:16:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:16:25.349 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:16:25.385 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:16:25.387 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:16:25.428 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:16:25.462 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:16:25.462 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:16:25.462 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:16:25.463 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:16:25.469 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:16:25.497 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:16:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:16:25.647 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:16:25.688 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:16:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:16:25.998 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:16:26.055 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:16:26.088 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:16:26.112 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:16:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:16:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:16:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:16:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:16:26.443 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:16:26.490 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:16:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:16:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:16:26.587 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:16:26.620 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:16:26.662 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:16:26.696 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:16:26.782 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:16:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:16:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:16:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:16:27.025 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:16:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:16:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:16:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:16:27.946 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:16:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:16:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:16:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:16:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:16:28.190 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-09-12T01:16:28.301 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:16:28.339 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:16:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:16:28.384 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:16:28.401 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:16:28.435 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:16:28.460 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:16:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:16:28.503 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:16:28.841 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:16:28.953 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:16:29.074 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:16:29.123 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:16:29.124 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:16:29.222 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:16:29.248 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:16:29.250 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:16:29.403 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:16:29.456 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:16:29.484 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:16:29.589 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:16:29.618 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:16:29.681 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:16:29.719 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:16:29.746 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:16:29.946 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:16:30.083 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:16:30.209 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:16:30.309 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:16:30.377 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:16:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:16:30.595 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:16:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:16:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:16:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:16:30.698 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:16:30.793 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:16:30.832 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:16:30.866 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:16:30.929 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:16:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:16:30.987 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:16:31.019 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:16:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:16:31.062 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:16:31.095 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:16:31.123 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:16:31.138 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:16:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:16:31.190 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:16:31.212 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:16:31.245 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:16:31.276 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:16:31.319 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:16:31.403 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:16:31.438 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:16:31.482 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:16:31.511 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:16:31.580 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:16:31.625 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:16:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:16:31.700 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:16:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:16:31.796 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:16:31.826 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:16:31.833 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:16:32.100 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:16:32.625 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:16:33.033 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:16:33.033 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:16:33.033 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:16:33.033 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:16:33.033 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:16:33.033 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:16:33.070 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:16:33.123 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:16:33.197 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:16:33.236 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:16:33.272 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:16:33.319 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:16:33.355 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:16:33.398 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:16:33.441 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:16:33.576 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:16:33.617 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:16:33.666 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:16:33.769 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:16:33.800 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:16:33.840 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:16:33.866 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:16:33.891 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:16:33.964 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:16:34.091 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:16:34.112 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:16:34.122 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:16:34.148 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:16:34.159 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:16:34.201 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:16:34.240 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:16:34.272 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:16:34.302 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:16:34.345 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:16:34.378 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:16:34.420 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:16:34.454 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:16:34.540 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:16:34.593 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:16:34.624 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:16:34.711 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:16:34.725 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:16:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:16:34.775 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:16:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:16:34.877 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:16:34.877 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:16:34.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:16:34.922 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:16:35.498 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:16:35.547 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:16:35.580 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:16:35.678 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:16:35.736 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:16:35.780 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:16:35.875 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:16:35.916 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:16:36.100 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:16:36.131 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:16:36.208 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:16:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:16:36.973 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:16:37.417 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:16:37.417 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-09-12T01:16:37.417 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-09-12T01:16:37.417 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-09-12T01:16:37.417 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-09-12T01:16:37.417 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-09-12T01:16:37.418 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-09-12T01:16:37.418 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-09-12T01:16:37.418 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:16:37.593 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:16:37.609 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:16:37.609 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:37.610 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:16:37.610 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:16:38.189 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:16:38.269 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:16:38.296 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:16:38.330 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:16:38.639 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:16:38.693 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:16:38.801 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:16:38.839 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:16:38.875 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:16:39.096 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:16:39.123 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:16:39.123 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:39.123 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:16:39.123 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:16:39.123 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:16:39.123 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:16:39.353 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:16:39.372 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:16:39.387 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:16:39.395 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:16:39.395 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:39.396 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:16:39.396 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:16:39.396 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:16:39.396 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:16:39.458 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:16:39.489 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:16:39.831 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:16:39.855 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:16:39.855 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:39.855 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:16:39.855 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:16:39.855 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:16:39.855 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:16:39.961 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:16:40.017 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:16:40.072 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:16:40.263 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:16:40.332 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:16:40.409 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:16:40.498 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:16:40.646 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:16:40.724 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:16:40.755 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:16:40.783 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:16:41.175 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:16:41.215 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:16:41.247 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:16:41.309 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:16:41.338 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:16:41.769 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:16:41.810 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:16:42.353 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:16:42.374 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:16:42.397 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:16:42.407 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:16:42.492 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:16:42.492 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:16:42.492 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:16:42.492 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:16:42.523 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:16:43.366 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:16:43.407 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:16:43.509 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:16:43.677 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:16:43.709 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:16:43.734 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:16:43.734 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:43.734 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:16:43.734 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:16:43.734 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:16:43.735 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:16:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:16:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:16:43.894 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:16:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:16:44.867 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:16:44.896 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:16:44.920 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:16:44.920 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:44.921 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:16:44.921 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:16:44.921 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:16:44.921 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:16:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:16:44.987 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:16:44.987 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:44.987 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:16:44.987 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:16:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:16:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:16:45.063 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:45.063 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:16:45.063 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:16:45.063 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:16:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:16:45.365 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:16:45.389 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:16:45.389 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:45.389 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:16:45.389 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:16:45.390 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:16:45.390 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:16:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:16:46.649 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-09-12T01:16:46.649 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-09-12T01:16:46.649 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-09-12T01:16:46.649 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-09-12T01:16:46.649 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-09-12T01:16:46.649 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-09-12T01:16:46.649 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-09-12T01:16:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:16:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:16:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:16:46.830 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:46.830 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:16:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:16:48.317 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:16:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:16:48.350 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:48.350 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:16:48.350 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:16:48.350 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:16:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:16:48.585 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:16:48.615 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:16:48.615 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:48.615 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:16:48.616 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:16:48.616 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:16:48.616 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:16:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:16:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:16:49.077 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:49.077 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:16:49.077 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:16:49.077 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:16:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:16:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:16:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:16:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:16:49.488 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:16:49.537 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:16:49.606 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:16:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:16:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:16:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:16:49.919 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:16:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:16:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:16:49.960 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:16:50.000 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:16:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:16:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:16:50.239 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:16:50.290 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:16:50.321 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:16:50.350 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:16:50.397 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:16:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:16:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:16:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:16:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:16:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:16:51.016 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:16:51.053 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:16:51.074 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:16:51.619 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:16:51.654 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:16:51.903 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:16:51.992 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:16:52.033 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:16:52.114 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:16:52.145 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:16:52.170 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:16:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:16:52.204 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:16:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:16:52.313 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:16:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:16:52.423 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:16:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:16:52.428 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:16:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:16:52.616 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:16:52.617 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:16:52.654 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:16:52.701 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:16:52.756 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:16:52.763 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:16:52.916 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:16:52.940 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:16:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:16:52.964 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:52.964 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:16:52.964 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:16:52.964 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:16:52.964 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:16:53.015 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:16:53.028 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:16:53.125 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:16:53.185 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:16:54.103 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:16:54.135 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:16:54.159 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:16:54.159 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:54.159 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:16:54.159 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:16:54.160 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:16:54.160 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:16:54.202 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:16:54.225 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:16:54.225 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:54.226 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:16:54.226 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:16:54.286 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:16:54.310 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:16:54.310 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:54.310 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:16:54.310 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:16:54.310 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:16:54.310 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:16:54.611 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:16:54.635 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:16:54.635 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:54.635 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:16:54.635 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:16:54.636 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:16:54.636 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:16:54.803 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:16:54.804 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /sys 2024-09-12T01:16:54.804 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /proc 2024-09-12T01:16:54.804 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /mnt 2024-09-12T01:16:54.804 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /var/tmp 2024-09-12T01:16:54.804 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /home 2024-09-12T01:16:54.804 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /root 2024-09-12T01:16:54.804 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /tmp 2024-09-12T01:16:54.804 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:16:54.992 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:16:55.008 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:16:55.008 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:55.008 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:16:55.008 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:16:56.470 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:16:56.496 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:16:56.497 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:56.497 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:16:56.497 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:16:56.497 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:16:56.497 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:16:56.720 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:16:56.744 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:16:56.744 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:56.744 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:16:56.744 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:16:56.744 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:16:56.744 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:16:57.179 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:16:57.204 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:16:57.204 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:16:57.204 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:16:57.204 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:16:57.204 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:16:57.204 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:16:57.309 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:16:57.365 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:16:57.421 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:16:57.604 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:16:57.655 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:16:57.723 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:16:57.837 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:16:57.975 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:16:58.030 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:16:58.061 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:16:58.090 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:16:58.403 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:16:58.403 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:16:58.403 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:16:58.403 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:16:58.403 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:16:58.403 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:16:58.403 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:16:58.403 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:16:58.403 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:16:58.403 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:16:58.404 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:16:58.404 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:16:58.404 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:16:58.404 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:16:58.404 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:16:58.404 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:16:58.404 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:16:58.404 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:16:58.404 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:16:58.404 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:16:58.404 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:16:58.404 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:16:58.404 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:16:58.405 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:16:58.405 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:16:58.405 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:16:58.405 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:16:58.405 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:16:58.405 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:16:58.405 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:16:58.405 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:16:58.405 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:16:58.405 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:16:58.405 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:16:58.405 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:16:58.405 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:16:58.406 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:16:58.406 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:16:58.406 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:16:58.406 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:16:58.406 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:16:58.406 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:16:58.406 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:16:58.406 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:16:58.406 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:16:58.406 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:16:58.406 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:16:58.406 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:16:58.407 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:16:58.407 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:16:58.407 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:16:58.407 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:16:58.407 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:16:58.407 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:16:58.407 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:16:58.407 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:16:58.407 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:16:58.407 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:16:58.407 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:16:58.407 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:16:58.407 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:16:58.408 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:16:58.408 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:16:58.408 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:16:58.408 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:16:58.408 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:16:58.408 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:16:58.408 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:16:58.408 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:16:58.408 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:16:58.408 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:16:58.408 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:16:58.408 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:16:58.409 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:16:58.409 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:16:58.409 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:16:58.409 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:16:58.409 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:16:58.409 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:16:58.409 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:16:58.409 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:16:58.409 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:16:58.409 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:16:58.409 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:16:58.409 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:16:58.410 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:16:58.410 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:16:58.410 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:16:58.410 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:16:58.410 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:16:58.410 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:16:58.410 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:16:58.410 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:16:58.410 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:16:58.410 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:16:58.410 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:16:58.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:16:58.412 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:16:58.412 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:16:58.412 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:16:58.412 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:16:58.412 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:16:58.412 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:16:58.412 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:16:58.412 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:16:58.412 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:16:58.412 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:16:58.412 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:16:58.412 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:16:58.412 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:16:58.413 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:16:58.413 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:16:58.413 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:16:58.413 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:16:58.413 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:16:58.413 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:16:58.413 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:16:58.413 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:16:58.413 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:16:58.413 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:16:58.413 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:16:58.413 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:16:58.413 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:16:58.414 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:16:58.414 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:16:58.414 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:16:58.414 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:16:58.414 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:16:58.414 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:16:58.414 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:16:58.414 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:16:58.414 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:16:58.414 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:16:58.414 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:16:58.414 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:16:58.414 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:16:58.415 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:16:58.416 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:16:58.539 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:16:58.571 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:16:58.603 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:16:58.673 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:16:58.711 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:16:59.215 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:16:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:16:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:16:59.346 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:16:59.374 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:16:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:16:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:16:59.652 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:16:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:16:59.718 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:16:59.751 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:16:59.788 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:17:00.340 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:17:00.382 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:17:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:17:00.753 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:17:00.780 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:17:00.881 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:17:01.041 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:17:01.065 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:17:01.065 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:17:01.066 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-09-12T01:17:01.066 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:17:01.066 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:17:01.066 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:17:01.066 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:17:01.066 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.066 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.066 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:17:01.066 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:17:01.066 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-12T01:17:01.066 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:17:01.066 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:17:01.067 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:17:01.067 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:17:01.067 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.067 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.067 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.067 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.067 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:01.067 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.067 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.067 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.067 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:01.067 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:01.068 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:01.068 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:01.068 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:01.068 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.068 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.068 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:01.068 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.068 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.068 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.068 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:01.068 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:01.069 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.069 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.069 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:01.069 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:17:01.069 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:17:01.069 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:17:01.069 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:17:01.069 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:17:01.069 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:17:01.069 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:17:01.069 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:17:01.069 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:17:01.070 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:17:01.070 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:17:01.070 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.070 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.070 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.070 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:17:01.070 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:17:01.070 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:17:01.070 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:17:01.070 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:17:01.070 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.070 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.070 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:17:01.071 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.071 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:17:01.071 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:17:01.071 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:17:01.071 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:17:01.071 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:17:01.071 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:17:01.071 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:17:01.071 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:17:01.071 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:17:01.071 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:17:01.071 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:17:01.071 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:17:01.072 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:17:01.072 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:17:01.072 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:17:01.072 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:17:01.072 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:17:01.072 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:17:01.072 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:17:01.072 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:17:01.072 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:17:01.072 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:17:01.072 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:17:01.072 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:17:01.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:17:01.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:17:01.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:17:01.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:17:01.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:17:01.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:17:01.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:17:01.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:17:01.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:17:01.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:17:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:17:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:17:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:17:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:17:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:17:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:17:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:17:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:17:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:17:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:17:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:17:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:17:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:17:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:17:01.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:17:01.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:17:01.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:17:01.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:17:01.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:17:01.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:17:01.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:17:01.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:17:01.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:17:01.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:17:01.077 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:17:01.077 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:17:01.077 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:17:01.077 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:17:01.077 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:17:01.077 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:17:01.077 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:17:01.077 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:17:01.077 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:17:01.077 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:17:01.077 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.077 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.077 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:01.078 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:17:01.078 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:17:01.078 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:17:01.078 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:17:01.078 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:17:01.078 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:17:01.080 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:17:01.080 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:17:01.080 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:17:01.080 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-12T01:17:01.098 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:17:01.098 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:17:01.098 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:17:01.098 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:17:01.098 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:17:01.099 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:17:01.149 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:17:01.161 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:17:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:17:01.260 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:17:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:17:01.306 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:17:01.352 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:17:01.437 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:17:01.474 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:17:01.507 DEBUG:teuthology.parallel:result is None 2024-09-12T01:17:01.508 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:17:01.533 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:17:01.534 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:17:01.618 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:17:01.618 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:17:01.710 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:17:01.736 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:17:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:17:01.742 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:17:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:17:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:17:01.996 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:17:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:17:02.239 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:17:02.277 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:17:02.301 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:17:02.301 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:17:02.301 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:17:02.301 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:17:02.301 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:17:02.301 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:17:02.344 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:17:02.367 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:17:02.367 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:17:02.367 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:17:02.367 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:17:02.411 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:17:02.435 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:17:02.435 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:17:02.435 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:17:02.435 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:17:02.435 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:17:02.435 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:17:02.737 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:17:02.761 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:17:02.761 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:17:02.761 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:17:02.761 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:17:02.761 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:17:02.761 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:17:07.307 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:17:07.349 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:17:07.389 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:17:07.421 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:17:07.449 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:17:07.628 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:17:07.670 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:17:07.700 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:17:07.730 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:17:07.776 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:17:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:17:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:17:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:17:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:17:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:17:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:17:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:17:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:17:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:17:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:17:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:17:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:17:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:17:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:17:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:17:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:17:07.912 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:17:07.912 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:17:07.912 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:17:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:17:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:17:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:17:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:17:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:17:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:17:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:17:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:17:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:17:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:17:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:17:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:17:07.913 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:17:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:17:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:17:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:17:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:17:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:17:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:17:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:17:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:17:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:17:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:17:07.914 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:17:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:17:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:17:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:17:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:17:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:17:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:17:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:17:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:17:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:17:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:17:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:17:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:17:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:17:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:17:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:17:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:17:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:17:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:17:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:17:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:17:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:17:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:17:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:17:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:17:07.916 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:17:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:17:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:17:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:17:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:17:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:17:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:17:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:17:07.917 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:17:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:17:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:17:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:17:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:17:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:17:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:17:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:17:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:17:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:17:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:17:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:17:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:17:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:17:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:17:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:17:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:17:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:17:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:17:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:17:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:17:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:17:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:17:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:17:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:17:07.919 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:17:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:17:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:17:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:17:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:17:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:17:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:17:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:17:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:17:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:17:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:17:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:17:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:17:07.920 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:17:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:17:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:17:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:17:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:17:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:17:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:17:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:17:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:17:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:17:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:17:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:17:07.921 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:17:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:17:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:17:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:17:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:17:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:17:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:17:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:17:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:17:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:17:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:17:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:17:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:17:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:17:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:17:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:17:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:17:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:17:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:17:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:17:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:17:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:17:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:17:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:17:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:17:07.923 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:17:08.356 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:17:08.391 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:17:08.411 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:17:09.233 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:17:09.320 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:17:09.360 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:17:09.450 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:17:09.498 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:17:09.523 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:17:09.549 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:17:09.550 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:17:09.625 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:17:09.625 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:17:09.709 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:17:09.734 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:17:09.739 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:17:09.739 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:17:09.919 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:17:09.919 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:17:10.011 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:17:10.074 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:17:10.457 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:17:10.457 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:17:10.457 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-09-12T01:17:10.457 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:17:10.458 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:17:10.458 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:17:10.458 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:17:10.458 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.458 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.458 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:17:10.458 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:17:10.458 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-12T01:17:10.458 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:17:10.458 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:17:10.458 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:17:10.459 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:17:10.459 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.459 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.459 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.459 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.459 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:10.459 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.459 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.459 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.460 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:17:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:17:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:17:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:17:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:17:10.461 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:17:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:17:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:17:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:17:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:17:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:17:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:17:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:17:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:17:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:17:10.462 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:17:10.463 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.463 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.463 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:17:10.463 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.463 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:17:10.463 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:17:10.463 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:17:10.463 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:17:10.463 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:17:10.463 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:17:10.463 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:17:10.463 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:17:10.463 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:17:10.464 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:17:10.464 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:17:10.464 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:17:10.464 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:17:10.464 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:17:10.464 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:17:10.464 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:17:10.464 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:17:10.464 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:17:10.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:17:10.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:17:10.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:17:10.464 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:17:10.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:17:10.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:17:10.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:17:10.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:17:10.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:17:10.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:17:10.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:17:10.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:17:10.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:17:10.465 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:17:10.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:17:10.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:17:10.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:17:10.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:17:10.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:17:10.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:17:10.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:17:10.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:17:10.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:17:10.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:17:10.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:17:10.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:17:10.466 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:17:10.467 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:17:10.467 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:17:10.467 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:17:10.467 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:17:10.467 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:17:10.467 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:17:10.467 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:17:10.467 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:17:10.467 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:17:10.467 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:17:10.467 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:17:10.467 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:17:10.467 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:17:10.468 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:17:10.468 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:17:10.468 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:17:10.468 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:17:10.468 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:17:10.468 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.468 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.468 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:17:10.468 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:17:10.468 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:17:10.468 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.469 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:17:10.469 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:17:10.469 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:17:10.469 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:17:10.469 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:17:10.469 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:17:10.469 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:17:10.469 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:17:10.469 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:17:10.469 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:17:10.469 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:17:10.470 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:17:10.470 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:17:10.470 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:17:10.470 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:17:10.470 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.470 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.470 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:10.470 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:17:10.470 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:17:10.470 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:17:10.470 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:17:10.470 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:17:10.470 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:17:10.471 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:17:10.471 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:17:10.471 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-12T01:17:10.902 DEBUG:teuthology.parallel:result is None 2024-09-12T01:17:15.640 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:17:15.640 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:17:15.640 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:17:15.640 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:17:15.640 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:17:15.641 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:17:15.641 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:17:15.641 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:17:15.641 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:17:15.641 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:17:15.641 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:17:15.641 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:17:15.641 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:17:15.641 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:17:15.641 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:17:15.641 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:17:15.641 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:17:15.641 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:17:15.642 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:17:15.642 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:17:15.642 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:17:15.642 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:17:15.642 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:17:15.642 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:17:15.642 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:17:15.642 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:17:15.642 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:17:15.642 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:17:15.642 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:17:15.654 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:17:15.654 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:17:15.654 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:17:15.655 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:17:15.655 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:17:15.655 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:17:15.655 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:17:15.655 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:17:15.655 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:17:15.655 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:17:15.655 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:17:15.655 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:17:15.655 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:17:15.655 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:17:15.655 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:17:15.656 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:17:15.656 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:17:15.656 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:17:15.656 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:17:15.656 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:17:15.656 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:17:15.656 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:17:15.656 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:17:15.656 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:17:15.656 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:17:15.656 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:17:15.656 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:17:15.657 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:17:15.657 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:17:15.657 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:17:15.657 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:17:15.657 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:17:15.657 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:17:15.657 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:17:15.657 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:17:15.657 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:17:15.657 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:17:15.657 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:17:15.657 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:17:15.658 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:17:15.658 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:17:15.658 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:17:15.658 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:17:15.658 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:17:15.658 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:17:15.658 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:17:15.658 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:17:15.658 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:17:15.658 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:17:15.658 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:17:15.658 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:17:15.658 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:17:15.659 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:17:15.659 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:17:15.659 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:17:15.659 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:17:15.659 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:17:15.659 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:17:15.659 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:17:15.659 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:17:15.659 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:17:15.659 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:17:15.659 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:17:15.659 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:17:15.659 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:17:15.660 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:17:15.660 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:17:15.660 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:17:15.660 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:17:15.660 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:17:15.660 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:17:15.660 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:17:15.660 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:17:15.660 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:17:15.660 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:17:15.660 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:17:15.660 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:17:15.660 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:17:15.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:17:15.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:17:15.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:17:15.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:17:15.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:17:15.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:17:15.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:17:15.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:17:15.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:17:15.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:17:15.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:17:15.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:17:15.661 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:17:15.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:17:15.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:17:15.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:17:15.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:17:15.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:17:15.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:17:15.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:17:15.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:17:15.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:17:15.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:17:15.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:17:15.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:17:15.662 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:17:15.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:17:15.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:17:15.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:17:15.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:17:15.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:17:15.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:17:15.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:17:15.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:17:15.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:17:15.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:17:15.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:17:15.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:17:15.663 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:17:15.664 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:17:15.664 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:17:15.664 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:17:15.664 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:17:15.664 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:17:15.664 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:17:15.664 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:17:15.664 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:17:15.664 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:17:15.664 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:17:15.664 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:17:15.664 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:17:15.664 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:17:15.665 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:17:15.665 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:17:15.665 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:17:15.665 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:17:15.665 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:17:18.185 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:17:18.186 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:17:18.186 INFO:teuthology.orchestra.run.smithi189.stdout:Upgraded: 2024-09-12T01:17:18.186 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:17:18.186 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:17:18.186 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:17:18.186 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:17:18.186 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.186 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.186 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:17:18.186 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:17:18.186 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2024-09-12T01:17:18.187 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:17:18.187 INFO:teuthology.orchestra.run.smithi189.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:17:18.187 INFO:teuthology.orchestra.run.smithi189.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:17:18.187 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:17:18.187 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.187 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.187 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.187 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.187 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:18.187 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.187 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.187 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.188 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:18.188 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:18.188 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:18.188 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:18.188 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:18.188 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.188 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.188 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:18.188 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.188 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.188 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.189 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:18.189 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:18.189 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.189 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.189 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:17:18.189 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:17:18.189 INFO:teuthology.orchestra.run.smithi189.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:17:18.189 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:17:18.189 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:17:18.189 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:17:18.189 INFO:teuthology.orchestra.run.smithi189.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:17:18.189 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:17:18.189 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:17:18.190 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:17:18.190 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:17:18.190 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:17:18.190 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.190 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.190 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.190 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:17:18.190 INFO:teuthology.orchestra.run.smithi189.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:17:18.190 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:17:18.190 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:17:18.190 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:17:18.190 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.190 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.191 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:17:18.191 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.191 INFO:teuthology.orchestra.run.smithi189.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:17:18.191 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:17:18.191 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:17:18.191 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:17:18.191 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:17:18.191 INFO:teuthology.orchestra.run.smithi189.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:17:18.191 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:17:18.191 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:17:18.191 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:17:18.191 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:17:18.192 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:17:18.192 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:17:18.192 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:17:18.192 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:17:18.192 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:17:18.192 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:17:18.192 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:17:18.192 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:17:18.192 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:17:18.192 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:17:18.192 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:17:18.193 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:17:18.194 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:17:18.194 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:17:18.194 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:17:18.194 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:17:18.194 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:17:18.194 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:17:18.194 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:17:18.194 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:17:18.194 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:17:18.194 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:17:18.194 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:17:18.194 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:17:18.194 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:17:18.195 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:17:18.196 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:17:18.196 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:17:18.196 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:17:18.196 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:17:18.196 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.196 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.196 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:17:18.196 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:17:18.196 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:17:18.196 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.196 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:17:18.196 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:17:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.198 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.198 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:17:18.198 INFO:teuthology.orchestra.run.smithi189.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:17:18.198 INFO:teuthology.orchestra.run.smithi189.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:17:18.198 INFO:teuthology.orchestra.run.smithi189.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:17:18.198 INFO:teuthology.orchestra.run.smithi189.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:17:18.199 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:17:18.199 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:17:18.199 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:17:18.199 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:17:18.199 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-09-12T01:17:18.638 DEBUG:teuthology.parallel:result is None 2024-09-12T01:17:18.638 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:17:18.793 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:17:18.819 INFO:teuthology.orchestra.run.smithi081.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:17:18.820 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:17:18.820 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:17:18.823 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:17:18.971 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:17:18.998 INFO:teuthology.orchestra.run.smithi100.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:17:18.998 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:17:18.999 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:17:19.001 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:17:19.148 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:17:19.172 INFO:teuthology.orchestra.run.smithi189.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:17:19.172 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:17:19.172 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:17:19.175 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T01:17:19.175 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:17:19.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:17:19.208 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:17:19.208 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:17:19.240 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:17:19.240 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:17:19.270 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T01:17:19.270 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:17:19.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:17:19.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:17:19.368 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:17:19.369 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:17:19.399 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:17:19.467 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:17:19.467 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:17:19.495 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:17:19.563 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T01:17:19.563 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:17:19.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:17:19.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:17:19.661 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:17:19.662 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:17:19.687 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:17:19.752 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:17:19.752 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:17:19.780 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:17:19.848 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T01:17:19.849 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:17:19.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:17:19.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:17:19.948 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:17:19.948 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:17:19.973 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:17:20.039 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:17:20.039 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:17:20.068 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:17:20.136 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T01:17:20.235 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T01:17:20.235 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:17:20.236 INFO:tasks.cephadm:Cluster fsid is c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:17:20.236 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T01:17:20.236 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.81', 'mon.b': '172.21.15.100', 'mon.c': '172.21.15.189'} 2024-09-12T01:17:20.236 INFO:tasks.cephadm:First mon is mon.a on smithi081 2024-09-12T01:17:20.236 INFO:tasks.cephadm:First mgr is x 2024-09-12T01:17:20.236 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T01:17:20.237 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname $(hostname -s) 2024-09-12T01:17:20.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname $(hostname -s) 2024-09-12T01:17:20.292 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname $(hostname -s) 2024-09-12T01:17:20.323 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T01:17:20.323 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:17:20.481 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T01:17:20.636 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:17:20.638 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T01:17:20.638 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T01:17:20.639 DEBUG:teuthology.orchestra.run.smithi081:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:17:21.005 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:17 /home/ubuntu/cephtest/cephadm 2024-09-12T01:17:21.006 DEBUG:teuthology.orchestra.run.smithi100:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:17:21.360 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:17 /home/ubuntu/cephtest/cephadm 2024-09-12T01:17:21.360 DEBUG:teuthology.orchestra.run.smithi189:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:17:21.729 INFO:teuthology.orchestra.run.smithi189.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:17 /home/ubuntu/cephtest/cephadm 2024-09-12T01:17:21.730 DEBUG:teuthology.orchestra.run.smithi081:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:17:21.750 DEBUG:teuthology.orchestra.run.smithi100:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:17:21.768 DEBUG:teuthology.orchestra.run.smithi189:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:17:21.813 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T01:17:21.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:17:21.816 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:17:21.819 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:17:23.414 INFO:teuthology.orchestra.run.smithi100.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:17:23.436 INFO:teuthology.orchestra.run.smithi081.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:17:23.492 INFO:teuthology.orchestra.run.smithi189.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:18:02.878 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T01:18:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:18:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:18:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: "repo_digests": [ 2024-09-12T01:18:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:18:02.879 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-12T01:18:02.879 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T01:18:12.991 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:18:12.992 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:18:12.992 INFO:teuthology.orchestra.run.smithi081.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:18:12.992 INFO:teuthology.orchestra.run.smithi081.stdout: "repo_digests": [ 2024-09-12T01:18:12.992 INFO:teuthology.orchestra.run.smithi081.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:18:12.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T01:18:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:18:18.876 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T01:18:18.877 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:18:18.877 INFO:teuthology.orchestra.run.smithi189.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:18:18.877 INFO:teuthology.orchestra.run.smithi189.stdout: "repo_digests": [ 2024-09-12T01:18:18.877 INFO:teuthology.orchestra.run.smithi189.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:18:18.877 INFO:teuthology.orchestra.run.smithi189.stdout: ] 2024-09-12T01:18:18.877 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T01:18:18.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph 2024-09-12T01:18:18.935 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph 2024-09-12T01:18:18.968 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph 2024-09-12T01:18:18.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /etc/ceph 2024-09-12T01:18:19.025 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /etc/ceph 2024-09-12T01:18:19.054 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /etc/ceph 2024-09-12T01:18:19.079 INFO:tasks.cephadm:Writing seed config... 2024-09-12T01:18:19.080 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T01:18:19.080 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T01:18:19.080 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T01:18:19.081 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T01:18:19.081 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T01:18:19.081 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-12T01:18:19.081 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T01:18:19.081 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T01:18:19.081 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T01:18:19.081 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T01:18:19.081 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T01:18:19.081 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T01:18:19.081 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T01:18:19.081 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T01:18:19.081 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T01:18:19.081 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T01:18:19.082 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T01:18:19.083 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T01:18:19.084 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T01:18:19.084 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T01:18:19.084 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T01:18:19.084 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T01:18:19.084 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-12T01:18:19.085 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:18:19.085 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T01:18:19.104 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c1ee9932-70a4-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T01:18:19.105 DEBUG:teuthology.orchestra.run.smithi081:mon.a> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T01:18:19.147 DEBUG:teuthology.orchestra.run.smithi081:mgr.x> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T01:18:19.191 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T01:18:19.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.81 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:18:19.398 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:18:19.398 INFO:teuthology.orchestra.run.smithi081.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', 'c1ee9932-70a4-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.81', '--skip-admin-label'] 2024-09-12T01:18:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T01:18:19.399 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying podman|docker is present... 2024-09-12T01:18:19.422 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 5.2.2 2024-09-12T01:18:19.423 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying lvm2 is present... 2024-09-12T01:18:19.423 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying time synchronization is in place... 2024-09-12T01:18:19.430 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T01:18:19.430 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T01:18:19.437 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T01:18:19.437 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-12T01:18:19.443 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-09-12T01:18:19.450 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-09-12T01:18:19.450 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-09-12T01:18:19.450 INFO:teuthology.orchestra.run.smithi081.stdout:Repeating the final host check... 2024-09-12T01:18:19.472 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 5.2.2 2024-09-12T01:18:19.472 INFO:teuthology.orchestra.run.smithi081.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T01:18:19.472 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl is present 2024-09-12T01:18:19.472 INFO:teuthology.orchestra.run.smithi081.stdout:lvcreate is present 2024-09-12T01:18:19.478 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T01:18:19.478 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T01:18:19.485 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T01:18:19.485 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-12T01:18:19.491 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-09-12T01:18:19.498 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-09-12T01:18:19.499 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-09-12T01:18:19.499 INFO:teuthology.orchestra.run.smithi081.stdout:Host looks OK 2024-09-12T01:18:19.499 INFO:teuthology.orchestra.run.smithi081.stdout:Cluster fsid: c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:18:19.499 INFO:teuthology.orchestra.run.smithi081.stdout:Acquiring lock 140161836557312 on /run/cephadm/c1ee9932-70a4-11ef-bcea-c7b262605968.lock 2024-09-12T01:18:19.499 INFO:teuthology.orchestra.run.smithi081.stdout:Lock 140161836557312 acquired on /run/cephadm/c1ee9932-70a4-11ef-bcea-c7b262605968.lock 2024-09-12T01:18:19.500 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 3300 ... 2024-09-12T01:18:19.501 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 6789 ... 2024-09-12T01:18:19.501 INFO:teuthology.orchestra.run.smithi081.stdout:Base mon IP(s) is [172.21.15.81:3300, 172.21.15.81:6789], mon addrv is [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-09-12T01:18:19.502 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.81 metric 100 2024-09-12T01:18:19.502 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.81 metric 100 2024-09-12T01:18:19.505 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T01:18:19.505 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-12T01:18:19.505 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-12T01:18:19.509 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T01:18:19.509 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T01:18:19.509 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T01:18:19.509 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-12T01:18:19.510 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-12T01:18:19.510 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T01:18:19.510 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-09-12T01:18:19.510 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-09-12T01:18:19.510 INFO:teuthology.orchestra.run.smithi081.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T01:18:19.511 INFO:teuthology.orchestra.run.smithi081.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T01:18:19.511 INFO:teuthology.orchestra.run.smithi081.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T01:18:20.957 INFO:teuthology.orchestra.run.smithi081.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:18:20.957 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:18:20.957 INFO:teuthology.orchestra.run.smithi081.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T01:18:22.088 INFO:teuthology.orchestra.run.smithi081.stdout:stat: stdout 167 167 2024-09-12T01:18:22.088 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial keys... 2024-09-12T01:18:22.985 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQBeQeJmTHEsGRAAz78pK1cEPbW4BQ0vfigbsA== 2024-09-12T01:18:23.933 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQBfQeJm3NmhFBAAmR2FE+cCt2YVSM55Ih4Xsg== 2024-09-12T01:18:24.988 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQBgQeJmQiLuDxAApclgAc5zUIp69+S3aHHpGg== 2024-09-12T01:18:24.989 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial monmap... 2024-09-12T01:18:25.896 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T01:18:25.896 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T01:18:25.896 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:18:25.896 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T01:18:25.896 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool for a [v2:172.21.15.81:3300,v1:172.21.15.81:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T01:18:25.896 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = quincy 2024-09-12T01:18:25.897 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: set fsid to c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:18:25.897 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T01:18:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:18:25.897 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mon... 2024-09-12T01:18:26.976 INFO:teuthology.orchestra.run.smithi081.stdout:create mon.a on 2024-09-12T01:18:27.188 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T01:18:27.333 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T01:18:27.516 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c1ee9932-70a4-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c1ee9932-70a4-11ef-bcea-c7b262605968.target. 2024-09-12T01:18:27.516 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c1ee9932-70a4-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c1ee9932-70a4-11ef-bcea-c7b262605968.target. 2024-09-12T01:18:27.748 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.a 2024-09-12T01:18:27.748 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T01:18:27.907 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c1ee9932-70a4-11ef-bcea-c7b262605968.target.wants/ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@.service. 2024-09-12T01:18:28.444 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:28 smithi081 ceph-mon[30531]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:18:28.461 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:18:28.461 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-12T01:18:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:18:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-12T01:18:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-12T01:18:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T01:18:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon to start... 2024-09-12T01:18:28.470 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon... 2024-09-12T01:18:28.730 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:28 smithi081 bash[30511]: f465107230301599bad9ebb927a9ea6a0f73ecf789bdb1717413eb6466a5b980 2024-09-12T01:18:28.731 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:28 smithi081 systemd[1]: Started Ceph mon.a for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:18:29.576 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:29 smithi081 ceph-mon[30531]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:18:29.576 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:29 smithi081 ceph-mon[30531]: monmap epoch 1 2024-09-12T01:18:29.577 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:29 smithi081 ceph-mon[30531]: fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:18:29.577 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:29 smithi081 ceph-mon[30531]: last_changed 2024-09-12T01:18:25.338837+0000 2024-09-12T01:18:29.577 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:29 smithi081 ceph-mon[30531]: created 2024-09-12T01:18:25.338837+0000 2024-09-12T01:18:29.577 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:29 smithi081 ceph-mon[30531]: min_mon_release 19 (squid) 2024-09-12T01:18:29.577 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:29 smithi081 ceph-mon[30531]: election_strategy: 1 2024-09-12T01:18:29.577 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:29 smithi081 ceph-mon[30531]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T01:18:29.577 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:29 smithi081 ceph-mon[30531]: fsmap 2024-09-12T01:18:29.577 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:29 smithi081 ceph-mon[30531]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T01:18:29.577 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:29 smithi081 ceph-mon[30531]: mgrmap e1: no daemons active 2024-09-12T01:18:29.577 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:29 smithi081 ceph-mon[30531]: from='client.? 172.21.15.81:0/3593270512' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T01:18:29.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T01:18:29.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout id: c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:18:29.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T01:18:29.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T01:18:29.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout services: 2024-09-12T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.592102s) 2024-09-12T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout data: 2024-09-12T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.919+0000 7f01c8f90640 1 Processor -- start 2024-09-12T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.919+0000 7f01c8f90640 1 -- start start 2024-09-12T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.919+0000 7f01c8f90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 0x7f01c4107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.919+0000 7f01c8f90640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f01c41081a0 con 0x7f01c41077d0 2024-09-12T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.920+0000 7f01c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 0x7f01c4107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.920+0000 7f01c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 0x7f01c4107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58680/0 (socket says 172.21.15.81:58680) 2024-09-12T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.920+0000 7f01c259c640 1 -- 172.21.15.81:0/3413964500 learned_addr learned my addr 172.21.15.81:0/3413964500 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.920+0000 7f01c259c640 1 -- 172.21.15.81:0/3413964500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c41089d0 con 0x7f01c41077d0 2024-09-12T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.922+0000 7f01c259c640 1 --2- 172.21.15.81:0/3413964500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 0x7f01c4107bd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009820 tx=0x7f01b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0c142a5dcff442 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.922+0000 7f01c1d9b640 1 -- 172.21.15.81:0/3413964500 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b4037070 con 0x7f01c41077d0 2024-09-12T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.922+0000 7f01c1d9b640 1 -- 172.21.15.81:0/3413964500 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b4032440 con 0x7f01c41077d0 2024-09-12T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.922+0000 7f01c1d9b640 1 -- 172.21.15.81:0/3413964500 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b4032740 con 0x7f01c41077d0 2024-09-12T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.923+0000 7f01c8f90640 1 -- 172.21.15.81:0/3413964500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 msgr2=0x7f01c4107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.923+0000 7f01c8f90640 1 --2- 172.21.15.81:0/3413964500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 0x7f01c4107bd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009820 tx=0x7f01b402a270 comp rx=0 tx=0).stop 2024-09-12T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.923+0000 7f01c8f90640 1 -- 172.21.15.81:0/3413964500 shutdown_connections 2024-09-12T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.923+0000 7f01c8f90640 1 --2- 172.21.15.81:0/3413964500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 0x7f01c4107bd0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.923+0000 7f01c8f90640 1 -- 172.21.15.81:0/3413964500 >> 172.21.15.81:0/3413964500 conn(0x7f01c4102f60 msgr2=0x7f01c41053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.923+0000 7f01c8f90640 1 -- 172.21.15.81:0/3413964500 shutdown_connections 2024-09-12T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.923+0000 7f01c8f90640 1 -- 172.21.15.81:0/3413964500 wait complete. 2024-09-12T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.924+0000 7f01c8f90640 1 Processor -- start 2024-09-12T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.924+0000 7f01c8f90640 1 -- start start 2024-09-12T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.924+0000 7f01c8f90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 0x7f01c419af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.924+0000 7f01c8f90640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f01c4108f00 con 0x7f01c41077d0 2024-09-12T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.924+0000 7f01c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 0x7f01c419af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.924+0000 7f01c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 0x7f01c419af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58684/0 (socket says 172.21.15.81:58684) 2024-09-12T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.924+0000 7f01c259c640 1 -- 172.21.15.81:0/3593270512 learned_addr learned my addr 172.21.15.81:0/3593270512 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.925+0000 7f01c259c640 1 -- 172.21.15.81:0/3593270512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c419b490 con 0x7f01c41077d0 2024-09-12T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.925+0000 7f01c259c640 1 --2- 172.21.15.81:0/3593270512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 0x7f01c419af50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f01b40090b0 tx=0x7f01b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.925+0000 7f01bb7fe640 1 -- 172.21.15.81:0/3593270512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b4041070 con 0x7f01c41077d0 2024-09-12T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.925+0000 7f01bb7fe640 1 -- 172.21.15.81:0/3593270512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b403c7a0 con 0x7f01c41077d0 2024-09-12T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.925+0000 7f01c8f90640 1 -- 172.21.15.81:0/3593270512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c419b720 con 0x7f01c41077d0 2024-09-12T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.925+0000 7f01bb7fe640 1 -- 172.21.15.81:0/3593270512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b4037040 con 0x7f01c41077d0 2024-09-12T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.925+0000 7f01c8f90640 1 -- 172.21.15.81:0/3593270512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c419bb40 con 0x7f01c41077d0 2024-09-12T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.925+0000 7f01bb7fe640 1 -- 172.21.15.81:0/3593270512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f01b4044070 con 0x7f01c41077d0 2024-09-12T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.925+0000 7f01bb7fe640 1 -- 172.21.15.81:0/3593270512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f01b403d730 con 0x7f01c41077d0 2024-09-12T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.926+0000 7f01c8f90640 1 -- 172.21.15.81:0/3593270512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c4109550 con 0x7f01c41077d0 2024-09-12T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.929+0000 7f01bb7fe640 1 -- 172.21.15.81:0/3593270512 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f01b403cc30 con 0x7f01c41077d0 2024-09-12T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.992+0000 7f01c8f90640 1 -- 172.21.15.81:0/3593270512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f01c419e970 con 0x7f01c41077d0 2024-09-12T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.993+0000 7f01bb7fe640 1 -- 172.21.15.81:0/3593270512 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f01b403d930 con 0x7f01c41077d0 2024-09-12T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.993+0000 7f01c8f90640 1 -- 172.21.15.81:0/3593270512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 msgr2=0x7f01c419af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.993+0000 7f01c8f90640 1 --2- 172.21.15.81:0/3593270512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 0x7f01c419af50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f01b40090b0 tx=0x7f01b40046c0 comp rx=0 tx=0).stop 2024-09-12T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.994+0000 7f01c8f90640 1 -- 172.21.15.81:0/3593270512 shutdown_connections 2024-09-12T01:18:29.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.994+0000 7f01c8f90640 1 --2- 172.21.15.81:0/3593270512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01c41077d0 0x7f01c419af50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:29.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.994+0000 7f01c8f90640 1 -- 172.21.15.81:0/3593270512 >> 172.21.15.81:0/3593270512 conn(0x7f01c4102f60 msgr2=0x7f01c418f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:29.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.994+0000 7f01c8f90640 1 -- 172.21.15.81:0/3593270512 shutdown_connections 2024-09-12T01:18:29.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:28.994+0000 7f01c8f90640 1 -- 172.21.15.81:0/3593270512 wait complete. 2024-09-12T01:18:29.589 INFO:teuthology.orchestra.run.smithi081.stdout:mon is available 2024-09-12T01:18:29.589 INFO:teuthology.orchestra.run.smithi081.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T01:18:30.591 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:30 smithi081 ceph-mon[30531]: from='client.? 172.21.15.81:0/1715694633' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T01:18:30.591 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:30 smithi081 ceph-mon[30531]: from='client.? 172.21.15.81:0/1715694633' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T01:18:30.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T01:18:30.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T01:18:30.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:18:30.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-09-12T01:18:30.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T01:18:30.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T01:18:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T01:18:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T01:18:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T01:18:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T01:18:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T01:18:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T01:18:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T01:18:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T01:18:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T01:18:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T01:18:30.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T01:18:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T01:18:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.983+0000 7f33fabde640 1 Processor -- start 2024-09-12T01:18:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.983+0000 7f33fabde640 1 -- start start 2024-09-12T01:18:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.983+0000 7f33fabde640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 0x7f33f4106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.983+0000 7f33fabde640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f33f41070a0 con 0x7f33f41066d0 2024-09-12T01:18:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.984+0000 7f33f897a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 0x7f33f4106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.984+0000 7f33f897a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 0x7f33f4106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58690/0 (socket says 172.21.15.81:58690) 2024-09-12T01:18:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.984+0000 7f33f897a640 1 -- 172.21.15.81:0/458144917 learned_addr learned my addr 172.21.15.81:0/458144917 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.984+0000 7f33f897a640 1 -- 172.21.15.81:0/458144917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f41078d0 con 0x7f33f41066d0 2024-09-12T01:18:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.984+0000 7f33f897a640 1 --2- 172.21.15.81:0/458144917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 0x7f33f4106ad0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009e80 tx=0x7f33e402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2061cf2b697cd1b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.985+0000 7f33f37fe640 1 -- 172.21.15.81:0/458144917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e4036070 con 0x7f33f41066d0 2024-09-12T01:18:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.985+0000 7f33f37fe640 1 -- 172.21.15.81:0/458144917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e4031400 con 0x7f33f41066d0 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.985+0000 7f33f37fe640 1 -- 172.21.15.81:0/458144917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e4031700 con 0x7f33f41066d0 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.985+0000 7f33fabde640 1 -- 172.21.15.81:0/458144917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 msgr2=0x7f33f4106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.985+0000 7f33fabde640 1 --2- 172.21.15.81:0/458144917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 0x7f33f4106ad0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009e80 tx=0x7f33e402a7a0 comp rx=0 tx=0).stop 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.985+0000 7f33fabde640 1 -- 172.21.15.81:0/458144917 shutdown_connections 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.985+0000 7f33fabde640 1 --2- 172.21.15.81:0/458144917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 0x7f33f4106ad0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.985+0000 7f33fabde640 1 -- 172.21.15.81:0/458144917 >> 172.21.15.81:0/458144917 conn(0x7f33f4101e60 msgr2=0x7f33f41042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.985+0000 7f33fabde640 1 -- 172.21.15.81:0/458144917 shutdown_connections 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.985+0000 7f33fabde640 1 -- 172.21.15.81:0/458144917 wait complete. 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.986+0000 7f33fabde640 1 Processor -- start 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.986+0000 7f33fabde640 1 -- start start 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.986+0000 7f33fabde640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 0x7f33f419af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.986+0000 7f33fabde640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4107e00 con 0x7f33f41066d0 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.986+0000 7f33f897a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 0x7f33f419af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.986+0000 7f33f897a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 0x7f33f419af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58704/0 (socket says 172.21.15.81:58704) 2024-09-12T01:18:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.986+0000 7f33f897a640 1 -- 172.21.15.81:0/1715694633 learned_addr learned my addr 172.21.15.81:0/1715694633 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.986+0000 7f33f897a640 1 -- 172.21.15.81:0/1715694633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f419b4c0 con 0x7f33f41066d0 2024-09-12T01:18:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.987+0000 7f33f897a640 1 --2- 172.21.15.81:0/1715694633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 0x7f33f419af80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f33e4034040 tx=0x7f33e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.987+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1715694633 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e4041070 con 0x7f33f41066d0 2024-09-12T01:18:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.987+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1715694633 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e403c650 con 0x7f33f41066d0 2024-09-12T01:18:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.987+0000 7f33fabde640 1 -- 172.21.15.81:0/1715694633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f419b750 con 0x7f33f41066d0 2024-09-12T01:18:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.987+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1715694633 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e4036040 con 0x7f33f41066d0 2024-09-12T01:18:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.987+0000 7f33fabde640 1 -- 172.21.15.81:0/1715694633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f419e440 con 0x7f33f41066d0 2024-09-12T01:18:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.987+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1715694633 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f33e4044070 con 0x7f33f41066d0 2024-09-12T01:18:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.987+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1715694633 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f33e4046c10 con 0x7f33f41066d0 2024-09-12T01:18:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.988+0000 7f33fabde640 1 -- 172.21.15.81:0/1715694633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f4108450 con 0x7f33f41066d0 2024-09-12T01:18:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:29.990+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1715694633 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f33e403c950 con 0x7f33f41066d0 2024-09-12T01:18:30.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:30.046+0000 7f33fabde640 1 -- 172.21.15.81:0/1715694633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f33f419fb20 con 0x7f33f41066d0 2024-09-12T01:18:30.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:30.049+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1715694633 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f33e403cb30 con 0x7f33f41066d0 2024-09-12T01:18:30.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:30.050+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1715694633 <== mon.0 v2:172.21.15.81:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f33e4056070 con 0x7f33f41066d0 2024-09-12T01:18:30.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:30.050+0000 7f33fabde640 1 -- 172.21.15.81:0/1715694633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 msgr2=0x7f33f419af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:30.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:30.050+0000 7f33fabde640 1 --2- 172.21.15.81:0/1715694633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 0x7f33f419af80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f33e4034040 tx=0x7f33e4004a40 comp rx=0 tx=0).stop 2024-09-12T01:18:30.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:30.050+0000 7f33fabde640 1 -- 172.21.15.81:0/1715694633 shutdown_connections 2024-09-12T01:18:30.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:30.051+0000 7f33fabde640 1 --2- 172.21.15.81:0/1715694633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f41066d0 0x7f33f419af80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:30.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:30.051+0000 7f33fabde640 1 -- 172.21.15.81:0/1715694633 >> 172.21.15.81:0/1715694633 conn(0x7f33f4101e60 msgr2=0x7f33f407b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:30.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:30.051+0000 7f33fabde640 1 -- 172.21.15.81:0/1715694633 shutdown_connections 2024-09-12T01:18:30.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:30.051+0000 7f33fabde640 1 -- 172.21.15.81:0/1715694633 wait complete. 2024-09-12T01:18:30.608 INFO:teuthology.orchestra.run.smithi081.stdout:Generating new minimal ceph.conf... 2024-09-12T01:18:31.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:31 smithi081 ceph-mon[30531]: from='client.? 172.21.15.81:0/4064405373' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:18:35.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.012+0000 7fb89cec7640 1 Processor -- start 2024-09-12T01:18:35.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.012+0000 7fb89cec7640 1 -- start start 2024-09-12T01:18:35.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.013+0000 7fb89cec7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 0x7fb89807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:35.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.013+0000 7fb89cec7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb89807c890 con 0x7fb89807de60 2024-09-12T01:18:35.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.013+0000 7fb89659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 0x7fb89807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:35.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.013+0000 7fb89659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 0x7fb89807c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58718/0 (socket says 172.21.15.81:58718) 2024-09-12T01:18:35.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.013+0000 7fb89659c640 1 -- 172.21.15.81:0/389524299 learned_addr learned my addr 172.21.15.81:0/389524299 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:35.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.013+0000 7fb89659c640 1 -- 172.21.15.81:0/389524299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89807ca10 con 0x7fb89807de60 2024-09-12T01:18:35.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.014+0000 7fb89659c640 1 --2- 172.21.15.81:0/389524299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 0x7fb89807c2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb888009820 tx=0x7fb88802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d486c7d7673c7548 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:35.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.014+0000 7fb89559a640 1 -- 172.21.15.81:0/389524299 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb888037070 con 0x7fb89807de60 2024-09-12T01:18:35.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.014+0000 7fb89559a640 1 -- 172.21.15.81:0/389524299 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb888032900 con 0x7fb89807de60 2024-09-12T01:18:35.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.014+0000 7fb89559a640 1 -- 172.21.15.81:0/389524299 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb888030850 con 0x7fb89807de60 2024-09-12T01:18:35.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.014+0000 7fb89cec7640 1 -- 172.21.15.81:0/389524299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 msgr2=0x7fb89807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:35.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.014+0000 7fb89cec7640 1 --2- 172.21.15.81:0/389524299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 0x7fb89807c2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb888009820 tx=0x7fb88802a270 comp rx=0 tx=0).stop 2024-09-12T01:18:35.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.014+0000 7fb89cec7640 1 -- 172.21.15.81:0/389524299 shutdown_connections 2024-09-12T01:18:35.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.014+0000 7fb89cec7640 1 --2- 172.21.15.81:0/389524299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 0x7fb89807c2c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:35.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.014+0000 7fb89cec7640 1 -- 172.21.15.81:0/389524299 >> 172.21.15.81:0/389524299 conn(0x7fb898102fc0 msgr2=0x7fb8981053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:35.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.015+0000 7fb89cec7640 1 -- 172.21.15.81:0/389524299 shutdown_connections 2024-09-12T01:18:35.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.015+0000 7fb89cec7640 1 -- 172.21.15.81:0/389524299 wait complete. 2024-09-12T01:18:35.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.015+0000 7fb89cec7640 1 Processor -- start 2024-09-12T01:18:35.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.015+0000 7fb89cec7640 1 -- start start 2024-09-12T01:18:35.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.015+0000 7fb89cec7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 0x7fb89819d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:35.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.015+0000 7fb89cec7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb89810dda0 con 0x7fb89807de60 2024-09-12T01:18:35.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.015+0000 7fb89659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 0x7fb89819d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:35.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.016+0000 7fb89659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 0x7fb89819d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58726/0 (socket says 172.21.15.81:58726) 2024-09-12T01:18:35.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.016+0000 7fb89659c640 1 -- 172.21.15.81:0/4064405373 learned_addr learned my addr 172.21.15.81:0/4064405373 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:35.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.016+0000 7fb89659c640 1 -- 172.21.15.81:0/4064405373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89819def0 con 0x7fb89807de60 2024-09-12T01:18:35.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.016+0000 7fb89659c640 1 --2- 172.21.15.81:0/4064405373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 0x7fb89819d9b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb888009940 tx=0x7fb888032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:35.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.016+0000 7fb88f7fe640 1 -- 172.21.15.81:0/4064405373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb888042070 con 0x7fb89807de60 2024-09-12T01:18:35.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.016+0000 7fb88f7fe640 1 -- 172.21.15.81:0/4064405373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb8880308c0 con 0x7fb89807de60 2024-09-12T01:18:35.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.016+0000 7fb89cec7640 1 -- 172.21.15.81:0/4064405373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb89819e180 con 0x7fb89807de60 2024-09-12T01:18:35.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.016+0000 7fb88f7fe640 1 -- 172.21.15.81:0/4064405373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb888037040 con 0x7fb89807de60 2024-09-12T01:18:35.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.016+0000 7fb89cec7640 1 -- 172.21.15.81:0/4064405373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8981a0e70 con 0x7fb89807de60 2024-09-12T01:18:35.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.016+0000 7fb88f7fe640 1 -- 172.21.15.81:0/4064405373 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb888045070 con 0x7fb89807de60 2024-09-12T01:18:35.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.016+0000 7fb88f7fe640 1 -- 172.21.15.81:0/4064405373 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb888047bb0 con 0x7fb89807de60 2024-09-12T01:18:35.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.017+0000 7fb89cec7640 1 -- 172.21.15.81:0/4064405373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb89807c340 con 0x7fb89807de60 2024-09-12T01:18:35.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.019+0000 7fb88f7fe640 1 -- 172.21.15.81:0/4064405373 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb8880327b0 con 0x7fb89807de60 2024-09-12T01:18:35.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.076+0000 7fb89cec7640 1 -- 172.21.15.81:0/4064405373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fb8981a1040 con 0x7fb89807de60 2024-09-12T01:18:35.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.077+0000 7fb88f7fe640 1 -- 172.21.15.81:0/4064405373 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fb88803c760 con 0x7fb89807de60 2024-09-12T01:18:35.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.078+0000 7fb89cec7640 1 -- 172.21.15.81:0/4064405373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 msgr2=0x7fb89819d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:35.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.078+0000 7fb89cec7640 1 --2- 172.21.15.81:0/4064405373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 0x7fb89819d9b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb888009940 tx=0x7fb888032ce0 comp rx=0 tx=0).stop 2024-09-12T01:18:35.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.078+0000 7fb89cec7640 1 -- 172.21.15.81:0/4064405373 shutdown_connections 2024-09-12T01:18:35.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.078+0000 7fb89cec7640 1 --2- 172.21.15.81:0/4064405373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb89807de60 0x7fb89819d9b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:35.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.078+0000 7fb89cec7640 1 -- 172.21.15.81:0/4064405373 >> 172.21.15.81:0/4064405373 conn(0x7fb898102fc0 msgr2=0x7fb898103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:35.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.078+0000 7fb89cec7640 1 -- 172.21.15.81:0/4064405373 shutdown_connections 2024-09-12T01:18:35.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:31.078+0000 7fb89cec7640 1 -- 172.21.15.81:0/4064405373 wait complete. 2024-09-12T01:18:35.883 INFO:teuthology.orchestra.run.smithi081.stdout:Restarting the monitor... 2024-09-12T01:18:36.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:35 smithi081 systemd[1]: Stopping Ceph mon.a for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:18:37.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:36 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a[30526]: 2024-09-12T01:18:36.940+0000 7fbd5eb95640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:18:37.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:36 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a[30526]: 2024-09-12T01:18:36.940+0000 7fbd5eb95640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T01:18:37.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:36 smithi081 podman[30784]: 2024-09-12 01:18:36.97109349 +0000 UTC m=+0.925598755 container died f465107230301599bad9ebb927a9ea6a0f73ecf789bdb1717413eb6466a5b980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-12T01:18:40.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:40 smithi081 podman[30784]: 2024-09-12 01:18:40.676766922 +0000 UTC m=+4.631272191 container cleanup f465107230301599bad9ebb927a9ea6a0f73ecf789bdb1717413eb6466a5b980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T01:18:40.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:40 smithi081 bash[30784]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a 2024-09-12T01:18:43.076 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:42 smithi081 podman[30796]: 2024-09-12 01:18:42.781092707 +0000 UTC m=+5.808516163 container remove f465107230301599bad9ebb927a9ea6a0f73ecf789bdb1717413eb6466a5b980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T01:18:43.077 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:42 smithi081 systemd[1]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T01:18:43.077 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:42 smithi081 systemd[1]: Stopped Ceph mon.a for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:18:43.077 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:42 smithi081 systemd[1]: Starting Ceph mon.a for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:18:43.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:43 smithi081 podman[30889]: 2024-09-12 01:18:43.063959987 +0000 UTC m=+0.017708079 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:18:44.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:43 smithi081 podman[30889]: 2024-09-12 01:18:43.916298099 +0000 UTC m=+0.870046171 container create 19c5878e9e2ac72fc952f633078363712621ec6dd71452c00f07ead6bf4af9b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T01:18:44.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 podman[30889]: 2024-09-12 01:18:44.127294526 +0000 UTC m=+1.081042605 container init 19c5878e9e2ac72fc952f633078363712621ec6dd71452c00f07ead6bf4af9b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-12T01:18:44.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 podman[30889]: 2024-09-12 01:18:44.130693717 +0000 UTC m=+1.084441790 container start 19c5878e9e2ac72fc952f633078363712621ec6dd71452c00f07ead6bf4af9b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T01:18:44.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T01:18:44.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T01:18:44.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: pidfile_write: ignore empty --pid-file 2024-09-12T01:18:44.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: load: jerasure load: lrc 2024-09-12T01:18:44.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: RocksDB version: 7.9.2 2024-09-12T01:18:44.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Git sha 0 2024-09-12T01:18:44.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T01:18:44.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: DB SUMMARY 2024-09-12T01:18:44.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: DB Session ID: 7DR9CU4IUA0G37N03FDS 2024-09-12T01:18:44.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: CURRENT file: CURRENT 2024-09-12T01:18:44.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T01:18:44.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T01:18:44.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T01:18:44.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106632 ; 2024-09-12T01:18:44.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.error_if_exists: 0 2024-09-12T01:18:44.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.create_if_missing: 0 2024-09-12T01:18:44.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.paranoid_checks: 1 2024-09-12T01:18:44.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T01:18:44.203 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T01:18:44.203 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T01:18:44.203 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.env: 0x55bad2f47940 2024-09-12T01:18:44.203 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T01:18:44.203 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.info_log: 0x55bad53136e0 2024-09-12T01:18:44.203 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T01:18:44.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.statistics: (nil) 2024-09-12T01:18:44.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.use_fsync: 0 2024-09-12T01:18:44.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_log_file_size: 0 2024-09-12T01:18:44.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T01:18:44.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T01:18:44.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T01:18:44.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T01:18:44.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.allow_fallocate: 1 2024-09-12T01:18:44.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T01:18:44.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T01:18:44.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.use_direct_reads: 0 2024-09-12T01:18:44.204 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T01:18:44.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T01:18:44.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.db_log_dir: 2024-09-12T01:18:44.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.wal_dir: 2024-09-12T01:18:44.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T01:18:44.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T01:18:44.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T01:18:44.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T01:18:44.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T01:18:44.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T01:18:44.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T01:18:44.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T01:18:44.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.write_buffer_manager: 0x55bad5322dc0 2024-09-12T01:18:44.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.unordered_write: 0 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.row_cache: None 2024-09-12T01:18:44.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.wal_filter: None 2024-09-12T01:18:44.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T01:18:44.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T01:18:44.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.two_write_queues: 0 2024-09-12T01:18:44.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T01:18:44.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.wal_compression: 0 2024-09-12T01:18:44.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.atomic_flush: 0 2024-09-12T01:18:44.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T01:18:44.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T01:18:44.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T01:18:44.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.log_readahead_size: 0 2024-09-12T01:18:44.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T01:18:44.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T01:18:44.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T01:18:44.208 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T01:18:44.208 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T01:18:44.208 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T01:18:44.208 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T01:18:44.208 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_background_jobs: 2 2024-09-12T01:18:44.208 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_background_compactions: -1 2024-09-12T01:18:44.208 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_subcompactions: 1 2024-09-12T01:18:44.208 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T01:18:44.208 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T01:18:44.208 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T01:18:44.208 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T01:18:44.208 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T01:18:44.208 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T01:18:44.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T01:18:44.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T01:18:44.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_open_files: -1 2024-09-12T01:18:44.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T01:18:44.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T01:18:44.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T01:18:44.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T01:18:44.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_background_flushes: -1 2024-09-12T01:18:44.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Compression algorithms supported: 2024-09-12T01:18:44.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: kZSTD supported: 0 2024-09-12T01:18:44.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: kXpressCompression supported: 0 2024-09-12T01:18:44.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: kBZip2Compression supported: 0 2024-09-12T01:18:44.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T01:18:44.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: kLZ4Compression supported: 1 2024-09-12T01:18:44.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: kZlibCompression supported: 1 2024-09-12T01:18:44.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T01:18:44.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: kSnappyCompression supported: 1 2024-09-12T01:18:44.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T01:18:44.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T01:18:44.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T01:18:44.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T01:18:44.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T01:18:44.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.merge_operator: 2024-09-12T01:18:44.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compaction_filter: None 2024-09-12T01:18:44.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T01:18:44.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T01:18:44.211 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T01:18:44.211 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T01:18:44.211 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bad5313320) 2024-09-12T01:18:44.211 INFO:journalctl@ceph.mon.a.smithi081.stdout: cache_index_and_filter_blocks: 1 2024-09-12T01:18:44.211 INFO:journalctl@ceph.mon.a.smithi081.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T01:18:44.211 INFO:journalctl@ceph.mon.a.smithi081.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T01:18:44.211 INFO:journalctl@ceph.mon.a.smithi081.stdout: pin_top_level_index_and_filter: 1 2024-09-12T01:18:44.211 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_type: 0 2024-09-12T01:18:44.211 INFO:journalctl@ceph.mon.a.smithi081.stdout: data_block_index_type: 0 2024-09-12T01:18:44.211 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_shortening: 1 2024-09-12T01:18:44.211 INFO:journalctl@ceph.mon.a.smithi081.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T01:18:44.211 INFO:journalctl@ceph.mon.a.smithi081.stdout: checksum: 4 2024-09-12T01:18:44.212 INFO:journalctl@ceph.mon.a.smithi081.stdout: no_block_cache: 0 2024-09-12T01:18:44.212 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache: 0x55bad53071f0 2024-09-12T01:18:44.212 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_name: BinnedLRUCache 2024-09-12T01:18:44.212 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_options: 2024-09-12T01:18:44.212 INFO:journalctl@ceph.mon.a.smithi081.stdout: capacity : 536870912 2024-09-12T01:18:44.212 INFO:journalctl@ceph.mon.a.smithi081.stdout: num_shard_bits : 4 2024-09-12T01:18:44.212 INFO:journalctl@ceph.mon.a.smithi081.stdout: strict_capacity_limit : 0 2024-09-12T01:18:44.212 INFO:journalctl@ceph.mon.a.smithi081.stdout: high_pri_pool_ratio: 0.000 2024-09-12T01:18:44.212 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_compressed: (nil) 2024-09-12T01:18:44.212 INFO:journalctl@ceph.mon.a.smithi081.stdout: persistent_cache: (nil) 2024-09-12T01:18:44.212 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_size: 4096 2024-09-12T01:18:44.212 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_size_deviation: 10 2024-09-12T01:18:44.213 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_restart_interval: 16 2024-09-12T01:18:44.213 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_block_restart_interval: 1 2024-09-12T01:18:44.213 INFO:journalctl@ceph.mon.a.smithi081.stdout: metadata_block_size: 4096 2024-09-12T01:18:44.213 INFO:journalctl@ceph.mon.a.smithi081.stdout: partition_filters: 0 2024-09-12T01:18:44.213 INFO:journalctl@ceph.mon.a.smithi081.stdout: use_delta_encoding: 1 2024-09-12T01:18:44.213 INFO:journalctl@ceph.mon.a.smithi081.stdout: filter_policy: bloomfilter 2024-09-12T01:18:44.213 INFO:journalctl@ceph.mon.a.smithi081.stdout: whole_key_filtering: 1 2024-09-12T01:18:44.213 INFO:journalctl@ceph.mon.a.smithi081.stdout: verify_compression: 0 2024-09-12T01:18:44.213 INFO:journalctl@ceph.mon.a.smithi081.stdout: read_amp_bytes_per_bit: 0 2024-09-12T01:18:44.213 INFO:journalctl@ceph.mon.a.smithi081.stdout: format_version: 5 2024-09-12T01:18:44.213 INFO:journalctl@ceph.mon.a.smithi081.stdout: enable_index_compression: 1 2024-09-12T01:18:44.213 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_align: 0 2024-09-12T01:18:44.213 INFO:journalctl@ceph.mon.a.smithi081.stdout: max_auto_readahead_size: 262144 2024-09-12T01:18:44.214 INFO:journalctl@ceph.mon.a.smithi081.stdout: prepopulate_block_cache: 0 2024-09-12T01:18:44.214 INFO:journalctl@ceph.mon.a.smithi081.stdout: initial_auto_readahead_size: 8192 2024-09-12T01:18:44.214 INFO:journalctl@ceph.mon.a.smithi081.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T01:18:44.214 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T01:18:44.214 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T01:18:44.214 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compression: NoCompression 2024-09-12T01:18:44.214 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T01:18:44.214 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T01:18:44.214 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T01:18:44.214 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.num_levels: 7 2024-09-12T01:18:44.214 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T01:18:44.214 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T01:18:44.214 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T01:18:44.215 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:18:44.216 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:18:44.216 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T01:18:44.216 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T01:18:44.216 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:18:44.216 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T01:18:44.216 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T01:18:44.216 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T01:18:44.217 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T01:18:44.217 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T01:18:44.217 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T01:18:44.217 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T01:18:44.217 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T01:18:44.217 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T01:18:44.217 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T01:18:44.217 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T01:18:44.217 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T01:18:44.217 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T01:18:44.218 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T01:18:44.218 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T01:18:44.218 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T01:18:44.218 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T01:18:44.218 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T01:18:44.218 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T01:18:44.218 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T01:18:44.218 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T01:18:44.218 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T01:18:44.218 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T01:18:44.218 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T01:18:44.218 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T01:18:44.218 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T01:18:44.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T01:18:44.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T01:18:44.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T01:18:44.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T01:18:44.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T01:18:44.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T01:18:44.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T01:18:44.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.inplace_update_support: 0 2024-09-12T01:18:44.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T01:18:44.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T01:18:44.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T01:18:44.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T01:18:44.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.bloom_locality: 0 2024-09-12T01:18:44.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.max_successive_merges: 0 2024-09-12T01:18:44.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T01:18:44.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T01:18:44.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T01:18:44.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T01:18:44.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.ttl: 2592000 2024-09-12T01:18:44.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T01:18:44.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T01:18:44.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T01:18:44.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.enable_blob_files: false 2024-09-12T01:18:44.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.min_blob_size: 0 2024-09-12T01:18:44.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T01:18:44.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T01:18:44.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T01:18:44.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T01:18:44.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T01:18:44.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T01:18:44.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T01:18:44.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T01:18:44.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T01:18:44.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T01:18:44.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8c7da13f-6e46-443a-b647-7636cdef705e 2024-09-12T01:18:44.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726103924156606, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T01:18:44.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T01:18:44.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726103924157572, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101520, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 334, "table_properties": {"data_size": 99405, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14641, "raw_average_key_size": 49, "raw_value_size": 91536, "raw_average_value_size": 312, "num_data_blocks": 12, "num_entries": 293, "num_filter_entries": 293, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726103924, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8c7da13f-6e46-443a-b647-7636cdef705e", "db_session_id": "7DR9CU4IUA0G37N03FDS", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T01:18:44.222 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726103924157666, "job": 1, "event": "recovery_finished"} 2024-09-12T01:18:44.222 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T01:18:44.222 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T01:18:44.222 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55bad5334e00 2024-09-12T01:18:44.222 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: DB pointer 0x55bad5430000 2024-09-12T01:18:44.222 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T01:18:44.222 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T01:18:44.222 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** DB Stats ** 2024-09-12T01:18:44.222 INFO:journalctl@ceph.mon.a.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:18:44.222 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T01:18:44.222 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:18:44.222 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** Compaction Stats [default] ** 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: L0 2/0 101.00 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 163.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: Sum 2/0 101.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 163.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 163.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** Compaction Stats [default] ** 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:18:44.223 INFO:journalctl@ceph.mon.a.smithi081.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:18:44.224 INFO:journalctl@ceph.mon.a.smithi081.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 163.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:18:44.224 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-12T01:18:44.224 INFO:journalctl@ceph.mon.a.smithi081.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T01:18:44.224 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-12T01:18:44.224 INFO:journalctl@ceph.mon.a.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:18:44.224 INFO:journalctl@ceph.mon.a.smithi081.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T01:18:44.224 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:18:44.224 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:18:44.224 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:18:44.224 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:18:44.224 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative compaction: 0.00 GB write, 31.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:18:44.224 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval compaction: 0.00 GB write, 31.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:18:44.224 INFO:journalctl@ceph.mon.a.smithi081.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout: Block cache BinnedLRUCache@0x55bad53071f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: starting mon.a rank 0 at public addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] at bind addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: mon.a@-1(???) e1 preinit fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: mon.a@-1(???).mds e1 new map 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: mon.a@-1(???).mds e1 print_map 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout: e1 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout: btime 2024-09-12T01:18:28:404096+0000 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout: legacy client fscid: -1 2024-09-12T01:18:44.225 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-12T01:18:44.226 INFO:journalctl@ceph.mon.a.smithi081.stdout: No filesystems configured 2024-09-12T01:18:44.226 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T01:18:44.226 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:18:44.226 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:18:44.226 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:18:44.226 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T01:18:44.226 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 bash[30889]: 19c5878e9e2ac72fc952f633078363712621ec6dd71452c00f07ead6bf4af9b2 2024-09-12T01:18:44.226 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 systemd[1]: Started Ceph mon.a for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:18:44.226 INFO:teuthology.orchestra.run.smithi081.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T01:18:44.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:18:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: monmap epoch 1 2024-09-12T01:18:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:18:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: last_changed 2024-09-12T01:18:25.338837+0000 2024-09-12T01:18:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: created 2024-09-12T01:18:25.338837+0000 2024-09-12T01:18:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: min_mon_release 19 (squid) 2024-09-12T01:18:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: election_strategy: 1 2024-09-12T01:18:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T01:18:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: fsmap 2024-09-12T01:18:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T01:18:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:44 smithi081 ceph-mon[30920]: mgrmap e1: no daemons active 2024-09-12T01:18:45.231 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.593+0000 7fc3c812c640 1 Processor -- start 2024-09-12T01:18:45.231 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.594+0000 7fc3c812c640 1 -- start start 2024-09-12T01:18:45.231 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.594+0000 7fc3c812c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 0x7fc3c0106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:45.231 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.594+0000 7fc3c812c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c01070a0 con 0x7fc3c01066d0 2024-09-12T01:18:45.231 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.594+0000 7fc3c5ec8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 0x7fc3c0106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:45.231 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.594+0000 7fc3c5ec8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 0x7fc3c0106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48838/0 (socket says 172.21.15.81:48838) 2024-09-12T01:18:45.231 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.594+0000 7fc3c5ec8640 1 -- 172.21.15.81:0/4137302661 learned_addr learned my addr 172.21.15.81:0/4137302661 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:45.231 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.594+0000 7fc3c5ec8640 1 -- 172.21.15.81:0/4137302661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c01078d0 con 0x7fc3c01066d0 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.596+0000 7fc3c5ec8640 1 --2- 172.21.15.81:0/4137302661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 0x7fc3c0106ad0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009820 tx=0x7fc3b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9abc1c0efce8005 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.596+0000 7fc3c4ec6640 1 -- 172.21.15.81:0/4137302661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b4037070 con 0x7fc3c01066d0 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.596+0000 7fc3c4ec6640 1 -- 172.21.15.81:0/4137302661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc3b4032900 con 0x7fc3c01066d0 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.596+0000 7fc3c4ec6640 1 -- 172.21.15.81:0/4137302661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b4030850 con 0x7fc3c01066d0 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.597+0000 7fc3c812c640 1 -- 172.21.15.81:0/4137302661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 msgr2=0x7fc3c0106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.597+0000 7fc3c812c640 1 --2- 172.21.15.81:0/4137302661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 0x7fc3c0106ad0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009820 tx=0x7fc3b402a270 comp rx=0 tx=0).stop 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.597+0000 7fc3c812c640 1 -- 172.21.15.81:0/4137302661 shutdown_connections 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.597+0000 7fc3c812c640 1 --2- 172.21.15.81:0/4137302661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 0x7fc3c0106ad0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.597+0000 7fc3c812c640 1 -- 172.21.15.81:0/4137302661 >> 172.21.15.81:0/4137302661 conn(0x7fc3c0101e60 msgr2=0x7fc3c01042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.597+0000 7fc3c812c640 1 -- 172.21.15.81:0/4137302661 shutdown_connections 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.597+0000 7fc3c812c640 1 -- 172.21.15.81:0/4137302661 wait complete. 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.598+0000 7fc3c812c640 1 Processor -- start 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.598+0000 7fc3c812c640 1 -- start start 2024-09-12T01:18:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.598+0000 7fc3c812c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 0x7fc3c007ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.598+0000 7fc3c812c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c010ac80 con 0x7fc3c01066d0 2024-09-12T01:18:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.598+0000 7fc3c5ec8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 0x7fc3c007ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.598+0000 7fc3c5ec8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 0x7fc3c007ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48850/0 (socket says 172.21.15.81:48850) 2024-09-12T01:18:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.598+0000 7fc3c5ec8640 1 -- 172.21.15.81:0/1919927860 learned_addr learned my addr 172.21.15.81:0/1919927860 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.598+0000 7fc3c5ec8640 1 -- 172.21.15.81:0/1919927860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c019e4e0 con 0x7fc3c01066d0 2024-09-12T01:18:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.599+0000 7fc3c5ec8640 1 --2- 172.21.15.81:0/1919927860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 0x7fc3c007ba10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009940 tx=0x7fc3b4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.599+0000 7fc3b2ffd640 1 -- 172.21.15.81:0/1919927860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b4042070 con 0x7fc3c01066d0 2024-09-12T01:18:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.599+0000 7fc3b2ffd640 1 -- 172.21.15.81:0/1919927860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc3b40308c0 con 0x7fc3c01066d0 2024-09-12T01:18:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.599+0000 7fc3c812c640 1 -- 172.21.15.81:0/1919927860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c019e6b0 con 0x7fc3c01066d0 2024-09-12T01:18:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.599+0000 7fc3b2ffd640 1 -- 172.21.15.81:0/1919927860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b4037040 con 0x7fc3c01066d0 2024-09-12T01:18:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.599+0000 7fc3c812c640 1 -- 172.21.15.81:0/1919927860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c019ead0 con 0x7fc3c01066d0 2024-09-12T01:18:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.599+0000 7fc3b2ffd640 1 -- 172.21.15.81:0/1919927860 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc3b4045070 con 0x7fc3c01066d0 2024-09-12T01:18:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.599+0000 7fc3b2ffd640 1 -- 172.21.15.81:0/1919927860 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc3b4047b70 con 0x7fc3c01066d0 2024-09-12T01:18:45.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.600+0000 7fc3c812c640 1 -- 172.21.15.81:0/1919927860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c0106b50 con 0x7fc3c01066d0 2024-09-12T01:18:45.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.602+0000 7fc3b2ffd640 1 -- 172.21.15.81:0/1919927860 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc3b40327b0 con 0x7fc3c01066d0 2024-09-12T01:18:45.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.658+0000 7fc3c812c640 1 -- 172.21.15.81:0/1919927860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fc3c019eda0 con 0x7fc3c01066d0 2024-09-12T01:18:45.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.663+0000 7fc3b2ffd640 1 -- 172.21.15.81:0/1919927860 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fc3b403c760 con 0x7fc3c01066d0 2024-09-12T01:18:45.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.663+0000 7fc3c812c640 1 -- 172.21.15.81:0/1919927860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 msgr2=0x7fc3c007ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:45.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.663+0000 7fc3c812c640 1 --2- 172.21.15.81:0/1919927860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 0x7fc3c007ba10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009940 tx=0x7fc3b4032ce0 comp rx=0 tx=0).stop 2024-09-12T01:18:45.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.664+0000 7fc3c812c640 1 -- 172.21.15.81:0/1919927860 shutdown_connections 2024-09-12T01:18:45.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.664+0000 7fc3c812c640 1 --2- 172.21.15.81:0/1919927860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c01066d0 0x7fc3c007ba10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:45.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.664+0000 7fc3c812c640 1 -- 172.21.15.81:0/1919927860 >> 172.21.15.81:0/1919927860 conn(0x7fc3c0101e60 msgr2=0x7fc3c0102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:45.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.664+0000 7fc3c812c640 1 -- 172.21.15.81:0/1919927860 shutdown_connections 2024-09-12T01:18:45.234 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:44.664+0000 7fc3c812c640 1 -- 172.21.15.81:0/1919927860 wait complete. 2024-09-12T01:18:45.234 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T01:18:45.257 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:18:45.257 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mgr... 2024-09-12T01:18:45.257 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T01:18:45.258 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T01:18:45.527 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mgr.x 2024-09-12T01:18:45.527 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T01:18:45.677 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c1ee9932-70a4-11ef-bcea-c7b262605968.target.wants/ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@.service. 2024-09-12T01:18:45.905 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:45 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1919927860' entity='client.admin' 2024-09-12T01:18:45.905 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:45 smithi081 systemd[1]: Starting Ceph mgr.x for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:18:46.237 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:45 smithi081 podman[31129]: 2024-09-12 01:18:45.809101063 +0000 UTC m=+0.016042026 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:18:46.237 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:45 smithi081 podman[31129]: 2024-09-12 01:18:45.911289272 +0000 UTC m=+0.118230284 container create d8813b804726d14ddaae6969867eece9166683e427136ef88c445b7937b8ca50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T01:18:46.237 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:46 smithi081 podman[31129]: 2024-09-12 01:18:46.121692657 +0000 UTC m=+0.328633621 container init d8813b804726d14ddaae6969867eece9166683e427136ef88c445b7937b8ca50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:18:46.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:46 smithi081 podman[31129]: 2024-09-12 01:18:46.124585456 +0000 UTC m=+0.331526426 container start d8813b804726d14ddaae6969867eece9166683e427136ef88c445b7937b8ca50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:18:46.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:46 smithi081 bash[31129]: d8813b804726d14ddaae6969867eece9166683e427136ef88c445b7937b8ca50 2024-09-12T01:18:46.250 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:18:46.251 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-12T01:18:46.258 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:18:46.258 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-12T01:18:46.258 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-12T01:18:46.258 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T01:18:46.267 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:18:46.267 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-12T01:18:46.275 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:18:46.275 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-12T01:18:46.275 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-12T01:18:46.275 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T01:18:46.275 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr to start... 2024-09-12T01:18:46.275 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr... 2024-09-12T01:18:46.488 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:46 smithi081 systemd[1]: Started Ceph mgr.x for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:18:46.488 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:46 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:46.241+0000 7f5efb116040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:18:46.488 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:46 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:46.306+0000 7f5efb116040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:18:46.488 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:46 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:46.457+0000 7f5efb116040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:18:46.779 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:46 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:46.526+0000 7f5efb116040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:18:46.779 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:46 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:46.676+0000 7f5efb116040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:18:47.093 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:46 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2371236808' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:18:47.093 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:46 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:46.826+0000 7f5efb116040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:18:47.388 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:47 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:47.145+0000 7f5efb116040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:18:47.388 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:47 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:47.205+0000 7f5efb116040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:18:47.404 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T01:18:47.407 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:18:47.408 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:18:47.408 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:18:47.408 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:18:47.408 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:18:47.408 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:18:47.408 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:47.408 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:18:47.408 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:18:47.408 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:18:47.408 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:18:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:18:47.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:18:47.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:18:47.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:18:47.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:47.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:18:47.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:18:47.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:18:47.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:18:47.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:18:47.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:18:47.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:18:47.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:18:47.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:18:47.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:47.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:18:47.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:18:47.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:18:28:404096+0000", 2024-09-12T01:18:47.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:18:47.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:18:47.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:47.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:18:47.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T01:18:47.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:18:47.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:18:47.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:18:47.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:18:47.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:18:47.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:18:47.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:18:47.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:47.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:18:47.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:18:47.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:18:28.404739+0000", 2024-09-12T01:18:47.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:18:47.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:47.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:18:47.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:18:47.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.711+0000 7fca83643640 1 Processor -- start 2024-09-12T01:18:47.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.711+0000 7fca83643640 1 -- start start 2024-09-12T01:18:47.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.711+0000 7fca83643640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 0x7fca7c106af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:47.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.711+0000 7fca83643640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c1070c0 con 0x7fca7c1066f0 2024-09-12T01:18:47.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.712+0000 7fca813df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 0x7fca7c106af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:47.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.712+0000 7fca813df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 0x7fca7c106af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48872/0 (socket says 172.21.15.81:48872) 2024-09-12T01:18:47.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.712+0000 7fca813df640 1 -- 172.21.15.81:0/3709572789 learned_addr learned my addr 172.21.15.81:0/3709572789 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:47.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.712+0000 7fca813df640 1 -- 172.21.15.81:0/3709572789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c1078f0 con 0x7fca7c1066f0 2024-09-12T01:18:47.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.713+0000 7fca813df640 1 --2- 172.21.15.81:0/3709572789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 0x7fca7c106af0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fca78009820 tx=0x7fca7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e0c4ee77c2b660 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:47.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.713+0000 7fca73fff640 1 -- 172.21.15.81:0/3709572789 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca78037070 con 0x7fca7c1066f0 2024-09-12T01:18:47.425 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.713+0000 7fca73fff640 1 -- 172.21.15.81:0/3709572789 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca78032900 con 0x7fca7c1066f0 2024-09-12T01:18:47.425 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.713+0000 7fca73fff640 1 -- 172.21.15.81:0/3709572789 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca78030850 con 0x7fca7c1066f0 2024-09-12T01:18:47.425 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.714+0000 7fca83643640 1 -- 172.21.15.81:0/3709572789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 msgr2=0x7fca7c106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:47.425 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.714+0000 7fca83643640 1 --2- 172.21.15.81:0/3709572789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 0x7fca7c106af0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fca78009820 tx=0x7fca7802a270 comp rx=0 tx=0).stop 2024-09-12T01:18:47.425 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.714+0000 7fca83643640 1 -- 172.21.15.81:0/3709572789 shutdown_connections 2024-09-12T01:18:47.425 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.714+0000 7fca83643640 1 --2- 172.21.15.81:0/3709572789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 0x7fca7c106af0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:47.425 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.714+0000 7fca83643640 1 -- 172.21.15.81:0/3709572789 >> 172.21.15.81:0/3709572789 conn(0x7fca7c101e80 msgr2=0x7fca7c1042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:47.425 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.714+0000 7fca83643640 1 -- 172.21.15.81:0/3709572789 shutdown_connections 2024-09-12T01:18:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.714+0000 7fca83643640 1 -- 172.21.15.81:0/3709572789 wait complete. 2024-09-12T01:18:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.714+0000 7fca83643640 1 Processor -- start 2024-09-12T01:18:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.714+0000 7fca83643640 1 -- start start 2024-09-12T01:18:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.715+0000 7fca83643640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 0x7fca7c19d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.715+0000 7fca83643640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c10aca0 con 0x7fca7c1066f0 2024-09-12T01:18:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.715+0000 7fca813df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 0x7fca7c19d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.715+0000 7fca813df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 0x7fca7c19d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48878/0 (socket says 172.21.15.81:48878) 2024-09-12T01:18:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.715+0000 7fca813df640 1 -- 172.21.15.81:0/2371236808 learned_addr learned my addr 172.21.15.81:0/2371236808 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.715+0000 7fca813df640 1 -- 172.21.15.81:0/2371236808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c19def0 con 0x7fca7c1066f0 2024-09-12T01:18:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.715+0000 7fca813df640 1 --2- 172.21.15.81:0/2371236808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 0x7fca7c19d9b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fca780097f0 tx=0x7fca78030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.715+0000 7fca727fc640 1 -- 172.21.15.81:0/2371236808 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca78037040 con 0x7fca7c1066f0 2024-09-12T01:18:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.715+0000 7fca727fc640 1 -- 172.21.15.81:0/2371236808 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca78040070 con 0x7fca7c1066f0 2024-09-12T01:18:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.715+0000 7fca83643640 1 -- 172.21.15.81:0/2371236808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7c19e180 con 0x7fca7c1066f0 2024-09-12T01:18:47.427 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.715+0000 7fca727fc640 1 -- 172.21.15.81:0/2371236808 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca7803a390 con 0x7fca7c1066f0 2024-09-12T01:18:47.427 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.715+0000 7fca83643640 1 -- 172.21.15.81:0/2371236808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7c1a0e70 con 0x7fca7c1066f0 2024-09-12T01:18:47.427 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.716+0000 7fca727fc640 1 -- 172.21.15.81:0/2371236808 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fca7803a5e0 con 0x7fca7c1066f0 2024-09-12T01:18:47.427 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.716+0000 7fca727fc640 1 -- 172.21.15.81:0/2371236808 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fca78045950 con 0x7fca7c1066f0 2024-09-12T01:18:47.427 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.716+0000 7fca83643640 1 -- 172.21.15.81:0/2371236808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca7c106b70 con 0x7fca7c1066f0 2024-09-12T01:18:47.427 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.719+0000 7fca727fc640 1 -- 172.21.15.81:0/2371236808 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fca78045460 con 0x7fca7c1066f0 2024-09-12T01:18:47.427 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.780+0000 7fca83643640 1 -- 172.21.15.81:0/2371236808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fca7c197b50 con 0x7fca7c1066f0 2024-09-12T01:18:47.427 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.780+0000 7fca727fc640 1 -- 172.21.15.81:0/2371236808 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fca7803b430 con 0x7fca7c1066f0 2024-09-12T01:18:47.427 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.781+0000 7fca83643640 1 -- 172.21.15.81:0/2371236808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 msgr2=0x7fca7c19d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:47.427 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.781+0000 7fca83643640 1 --2- 172.21.15.81:0/2371236808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 0x7fca7c19d9b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fca780097f0 tx=0x7fca78030d80 comp rx=0 tx=0).stop 2024-09-12T01:18:47.428 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.781+0000 7fca83643640 1 -- 172.21.15.81:0/2371236808 shutdown_connections 2024-09-12T01:18:47.428 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.781+0000 7fca83643640 1 --2- 172.21.15.81:0/2371236808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7c1066f0 0x7fca7c19d9b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:47.428 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.781+0000 7fca83643640 1 -- 172.21.15.81:0/2371236808 >> 172.21.15.81:0/2371236808 conn(0x7fca7c101e80 msgr2=0x7fca7c102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:47.428 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.781+0000 7fca83643640 1 -- 172.21.15.81:0/2371236808 shutdown_connections 2024-09-12T01:18:47.428 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:46.782+0000 7fca83643640 1 -- 172.21.15.81:0/2371236808 wait complete. 2024-09-12T01:18:47.428 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (1/15)... 2024-09-12T01:18:47.738 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:47 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:47.389+0000 7f5efb116040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:18:48.738 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:48 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:48.258+0000 7f5efb116040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:18:48.738 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:48 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:48.323+0000 7f5efb116040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:18:49.283 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:49.025+0000 7f5efb116040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:18:49.284 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:49.142+0000 7f5efb116040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:18:49.284 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:49.284+0000 7f5efb116040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:18:49.536 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:49.344+0000 7f5efb116040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:18:49.536 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:49.502+0000 7f5efb116040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:18:49.789 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:49.572+0000 7f5efb116040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:18:49.789 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:49.632+0000 7f5efb116040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:18:49.790 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:49.790+0000 7f5efb116040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:18:50.063 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:49.855+0000 7f5efb116040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:18:50.063 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:49.919+0000 7f5efb116040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:18:50.063 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:50 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:50.003+0000 7f5efb116040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:18:50.328 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:50 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:50.064+0000 7f5efb116040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:18:50.328 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:50 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:50.126+0000 7f5efb116040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:18:50.737 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:50 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3359679394' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:18:50.985 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T01:18:50.986 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:18:50.986 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:18:50.986 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:18:50.986 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:18:50.986 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:18:50.986 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:18:50.986 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:50.986 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:18:50.986 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:18:50.987 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:18:50.987 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:18:50.987 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:18:50.987 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:18:50.987 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:18:50.987 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-12T01:18:50.987 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:18:50.987 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:18:50.987 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:18:50.987 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:18:50.987 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:50.988 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:18:50.988 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:18:50.988 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:18:50.988 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:18:50.988 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:18:50.997 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:18:50.998 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:18:50.998 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:18:50.998 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:50.998 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:18:50.998 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:18:50.998 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:18:50.998 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:18:50.998 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:18:50.998 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:18:50.998 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:18:50.998 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:18:28:404096+0000", 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:18:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:18:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:18:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:18:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:18:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:18:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:18:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:18:28.404739+0000", 2024-09-12T01:18:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:18:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:18:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:18:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.329+0000 7f2bbb43b640 1 Processor -- start 2024-09-12T01:18:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.329+0000 7f2bbb43b640 1 -- start start 2024-09-12T01:18:51.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.329+0000 7f2bbb43b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 0x7f2bb4106490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:51.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.329+0000 7f2bbb43b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb407bdd0 con 0x7f2bb4106090 2024-09-12T01:18:51.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.329+0000 7f2bb91d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 0x7f2bb4106490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:51.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.329+0000 7f2bb91d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 0x7f2bb4106490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48884/0 (socket says 172.21.15.81:48884) 2024-09-12T01:18:51.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.329+0000 7f2bb91d7640 1 -- 172.21.15.81:0/3198364960 learned_addr learned my addr 172.21.15.81:0/3198364960 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:51.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.329+0000 7f2bb91d7640 1 -- 172.21.15.81:0/3198364960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb41069d0 con 0x7f2bb4106090 2024-09-12T01:18:51.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.330+0000 7f2bb91d7640 1 --2- 172.21.15.81:0/3198364960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 0x7f2bb4106490 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009820 tx=0x7f2bb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a6d43dacd680bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:51.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.330+0000 7f2babfff640 1 -- 172.21.15.81:0/3198364960 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bb0037070 con 0x7f2bb4106090 2024-09-12T01:18:51.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.331+0000 7f2babfff640 1 -- 172.21.15.81:0/3198364960 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bb0032900 con 0x7f2bb4106090 2024-09-12T01:18:51.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.331+0000 7f2babfff640 1 -- 172.21.15.81:0/3198364960 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bb0030850 con 0x7f2bb4106090 2024-09-12T01:18:51.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.331+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3198364960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 msgr2=0x7f2bb4106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:51.001 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.331+0000 7f2bbb43b640 1 --2- 172.21.15.81:0/3198364960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 0x7f2bb4106490 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009820 tx=0x7f2bb002a270 comp rx=0 tx=0).stop 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.331+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3198364960 shutdown_connections 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.331+0000 7f2bbb43b640 1 --2- 172.21.15.81:0/3198364960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 0x7f2bb4106490 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.331+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3198364960 >> 172.21.15.81:0/3198364960 conn(0x7f2bb4101e60 msgr2=0x7f2bb41042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.331+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3198364960 shutdown_connections 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.331+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3198364960 wait complete. 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.332+0000 7f2bbb43b640 1 Processor -- start 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.332+0000 7f2bbb43b640 1 -- start start 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.332+0000 7f2bbb43b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 0x7f2bb419d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.332+0000 7f2bbb43b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb4107a60 con 0x7f2bb4106090 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.332+0000 7f2bb91d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 0x7f2bb419d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.332+0000 7f2bb91d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 0x7f2bb419d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48896/0 (socket says 172.21.15.81:48896) 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.332+0000 7f2bb91d7640 1 -- 172.21.15.81:0/3359679394 learned_addr learned my addr 172.21.15.81:0/3359679394 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.333+0000 7f2bb91d7640 1 -- 172.21.15.81:0/3359679394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb419dea0 con 0x7f2bb4106090 2024-09-12T01:18:51.002 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.333+0000 7f2bb91d7640 1 --2- 172.21.15.81:0/3359679394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 0x7f2bb419d960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00097f0 tx=0x7f2bb0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:51.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.333+0000 7f2baa7fc640 1 -- 172.21.15.81:0/3359679394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bb0037040 con 0x7f2bb4106090 2024-09-12T01:18:51.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.333+0000 7f2baa7fc640 1 -- 172.21.15.81:0/3359679394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bb0040070 con 0x7f2bb4106090 2024-09-12T01:18:51.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.333+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3359679394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb419e130 con 0x7f2bb4106090 2024-09-12T01:18:51.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.333+0000 7f2baa7fc640 1 -- 172.21.15.81:0/3359679394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bb003a390 con 0x7f2bb4106090 2024-09-12T01:18:51.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.333+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3359679394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb41a0e20 con 0x7f2bb4106090 2024-09-12T01:18:51.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.333+0000 7f2baa7fc640 1 -- 172.21.15.81:0/3359679394 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2bb003a630 con 0x7f2bb4106090 2024-09-12T01:18:51.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.333+0000 7f2baa7fc640 1 -- 172.21.15.81:0/3359679394 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2bb00459a0 con 0x7f2bb4106090 2024-09-12T01:18:51.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.334+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3359679394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb4106490 con 0x7f2bb4106090 2024-09-12T01:18:51.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.336+0000 7f2baa7fc640 1 -- 172.21.15.81:0/3359679394 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2bb0045460 con 0x7f2bb4106090 2024-09-12T01:18:51.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.396+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3359679394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2bb4197470 con 0x7f2bb4106090 2024-09-12T01:18:51.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.396+0000 7f2baa7fc640 1 -- 172.21.15.81:0/3359679394 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f2bb003b430 con 0x7f2bb4106090 2024-09-12T01:18:51.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.397+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3359679394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 msgr2=0x7f2bb419d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:51.003 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.397+0000 7f2bbb43b640 1 --2- 172.21.15.81:0/3359679394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 0x7f2bb419d960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00097f0 tx=0x7f2bb0030d80 comp rx=0 tx=0).stop 2024-09-12T01:18:51.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.397+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3359679394 shutdown_connections 2024-09-12T01:18:51.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.397+0000 7f2bbb43b640 1 --2- 172.21.15.81:0/3359679394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bb4106090 0x7f2bb419d960 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:51.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.397+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3359679394 >> 172.21.15.81:0/3359679394 conn(0x7f2bb4101e60 msgr2=0x7f2bb4194640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:51.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.398+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3359679394 shutdown_connections 2024-09-12T01:18:51.004 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:50.398+0000 7f2bbb43b640 1 -- 172.21.15.81:0/3359679394 wait complete. 2024-09-12T01:18:51.004 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (2/15)... 2024-09-12T01:18:51.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:50 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:50.942+0000 7f5efb116040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:18:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:51 smithi081 ceph-mon[30920]: Activating manager daemon x 2024-09-12T01:18:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:51 smithi081 ceph-mon[30920]: mgrmap e2: x(active, starting, since 0.00309876s) 2024-09-12T01:18:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:51 smithi081 ceph-mon[30920]: from='mgr.14100 172.21.15.81:0/660963497' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:18:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:51 smithi081 ceph-mon[30920]: from='mgr.14100 172.21.15.81:0/660963497' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:18:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:51 smithi081 ceph-mon[30920]: from='mgr.14100 172.21.15.81:0/660963497' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:18:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:51 smithi081 ceph-mon[30920]: from='mgr.14100 172.21.15.81:0/660963497' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:18:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:51 smithi081 ceph-mon[30920]: from='mgr.14100 172.21.15.81:0/660963497' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:18:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:51 smithi081 ceph-mon[30920]: Manager daemon x is now available 2024-09-12T01:18:51.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:51 smithi081 ceph-mon[30920]: from='mgr.14100 172.21.15.81:0/660963497' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:18:51.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:51 smithi081 ceph-mon[30920]: from='mgr.14100 172.21.15.81:0/660963497' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:18:51.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:51 smithi081 ceph-mon[30920]: from='mgr.14100 172.21.15.81:0/660963497' entity='mgr.x' 2024-09-12T01:18:51.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:51 smithi081 ceph-mon[30920]: from='mgr.14100 172.21.15.81:0/660963497' entity='mgr.x' 2024-09-12T01:18:51.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:51 smithi081 ceph-mon[30920]: from='mgr.14100 172.21.15.81:0/660963497' entity='mgr.x' 2024-09-12T01:18:53.206 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:52 smithi081 ceph-mon[30920]: mgrmap e3: x(active, since 1.00707s) 2024-09-12T01:18:54.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:53 smithi081 ceph-mon[30920]: mgrmap e4: x(active, since 2s) 2024-09-12T01:18:54.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:53 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/250760852' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:18:54.237 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T01:18:54.237 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:18:54.237 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:18:54.237 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:18:54.237 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:18:54.237 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:18:54.237 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:18:54.238 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:54.238 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:18:54.238 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:18:54.238 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:18:54.238 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:18:54.238 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:18:54.238 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:18:54.238 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:18:54.238 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-12T01:18:54.238 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:18:54.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:18:54.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:18:54.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:18:54.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:54.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:18:54.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:18:54.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:18:54.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:18:54.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:18:54.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:18:54.239 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:18:54.240 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:18:54.240 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:54.240 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:18:54.240 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:18:54.241 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:18:54.241 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:18:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:18:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:18:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:18:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:18:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:18:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:18:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:18:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:18:28:404096+0000", 2024-09-12T01:18:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:18:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:18:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:18:28.404739+0000", 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:18:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:18:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:18:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:18:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.401+0000 7f4baa5e6640 1 Processor -- start 2024-09-12T01:18:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.401+0000 7f4baa5e6640 1 -- start start 2024-09-12T01:18:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.402+0000 7f4baa5e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 0x7f4ba4107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.402+0000 7f4baa5e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba41081a0 con 0x7f4ba41077d0 2024-09-12T01:18:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.402+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 0x7f4ba4107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.402+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 0x7f4ba4107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36668/0 (socket says 172.21.15.81:36668) 2024-09-12T01:18:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.402+0000 7f4ba3fff640 1 -- 172.21.15.81:0/226452129 learned_addr learned my addr 172.21.15.81:0/226452129 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.402+0000 7f4ba3fff640 1 -- 172.21.15.81:0/226452129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba41089d0 con 0x7f4ba41077d0 2024-09-12T01:18:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.403+0000 7f4ba3fff640 1 --2- 172.21.15.81:0/226452129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 0x7f4ba4107bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009820 tx=0x7f4b9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e31624e5fbbe10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.403+0000 7f4ba37fe640 1 -- 172.21.15.81:0/226452129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b94037070 con 0x7f4ba41077d0 2024-09-12T01:18:54.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.403+0000 7f4ba37fe640 1 -- 172.21.15.81:0/226452129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b94032900 con 0x7f4ba41077d0 2024-09-12T01:18:54.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.403+0000 7f4ba37fe640 1 -- 172.21.15.81:0/226452129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b94030850 con 0x7f4ba41077d0 2024-09-12T01:18:54.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.404+0000 7f4baa5e6640 1 -- 172.21.15.81:0/226452129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 msgr2=0x7f4ba4107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:54.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.404+0000 7f4baa5e6640 1 --2- 172.21.15.81:0/226452129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 0x7f4ba4107bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009820 tx=0x7f4b9402a270 comp rx=0 tx=0).stop 2024-09-12T01:18:54.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.404+0000 7f4baa5e6640 1 -- 172.21.15.81:0/226452129 shutdown_connections 2024-09-12T01:18:54.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.404+0000 7f4baa5e6640 1 --2- 172.21.15.81:0/226452129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 0x7f4ba4107bd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:54.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.404+0000 7f4baa5e6640 1 -- 172.21.15.81:0/226452129 >> 172.21.15.81:0/226452129 conn(0x7f4ba4102f60 msgr2=0x7f4ba41053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:54.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.404+0000 7f4baa5e6640 1 -- 172.21.15.81:0/226452129 shutdown_connections 2024-09-12T01:18:54.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.404+0000 7f4baa5e6640 1 -- 172.21.15.81:0/226452129 wait complete. 2024-09-12T01:18:54.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.404+0000 7f4baa5e6640 1 Processor -- start 2024-09-12T01:18:54.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.404+0000 7f4baa5e6640 1 -- start start 2024-09-12T01:18:54.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.404+0000 7f4baa5e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 0x7f4ba407daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:54.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.405+0000 7f4baa5e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba410bd80 con 0x7f4ba41077d0 2024-09-12T01:18:54.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.405+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 0x7f4ba407daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:54.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.405+0000 7f4ba3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 0x7f4ba407daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36676/0 (socket says 172.21.15.81:36676) 2024-09-12T01:18:54.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.405+0000 7f4ba3fff640 1 -- 172.21.15.81:0/250760852 learned_addr learned my addr 172.21.15.81:0/250760852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:54.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.405+0000 7f4ba3fff640 1 -- 172.21.15.81:0/250760852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba407e030 con 0x7f4ba41077d0 2024-09-12T01:18:54.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.405+0000 7f4ba3fff640 1 --2- 172.21.15.81:0/250760852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 0x7f4ba407daf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009940 tx=0x7f4b94032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:54.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.405+0000 7f4ba1ffb640 1 -- 172.21.15.81:0/250760852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b94042070 con 0x7f4ba41077d0 2024-09-12T01:18:54.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.405+0000 7f4ba1ffb640 1 -- 172.21.15.81:0/250760852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b940308c0 con 0x7f4ba41077d0 2024-09-12T01:18:54.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.405+0000 7f4baa5e6640 1 -- 172.21.15.81:0/250760852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba407c220 con 0x7f4ba41077d0 2024-09-12T01:18:54.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.405+0000 7f4ba1ffb640 1 -- 172.21.15.81:0/250760852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b94037040 con 0x7f4ba41077d0 2024-09-12T01:18:54.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.405+0000 7f4baa5e6640 1 -- 172.21.15.81:0/250760852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba407c760 con 0x7f4ba41077d0 2024-09-12T01:18:54.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.406+0000 7f4ba1ffb640 1 -- 172.21.15.81:0/250760852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f4b94045070 con 0x7f4ba41077d0 2024-09-12T01:18:54.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.406+0000 7f4baa5e6640 1 -- 172.21.15.81:0/250760852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba4107c50 con 0x7f4ba41077d0 2024-09-12T01:18:54.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.407+0000 7f4ba1ffb640 1 --2- 172.21.15.81:0/250760852 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f4b90038f70 0x7f4b9003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:54.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.407+0000 7f4ba1ffb640 1 -- 172.21.15.81:0/250760852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4b9406c010 con 0x7f4ba41077d0 2024-09-12T01:18:54.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.407+0000 7f4b9bfff640 1 --2- 172.21.15.81:0/250760852 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f4b90038f70 0x7f4b9003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:54.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.407+0000 7f4b9bfff640 1 --2- 172.21.15.81:0/250760852 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f4b90038f70 0x7f4b9003b430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0098c0 tx=0x7f4b8c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.412+0000 7f4ba1ffb640 1 -- 172.21.15.81:0/250760852 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b94045360 con 0x7f4ba41077d0 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.664+0000 7f4baa5e6640 1 -- 172.21.15.81:0/250760852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4ba407d040 con 0x7f4ba41077d0 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.664+0000 7f4ba1ffb640 1 -- 172.21.15.81:0/250760852 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f4b9403c760 con 0x7f4ba41077d0 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.666+0000 7f4baa5e6640 1 -- 172.21.15.81:0/250760852 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f4b90038f70 msgr2=0x7f4b9003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.666+0000 7f4baa5e6640 1 --2- 172.21.15.81:0/250760852 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f4b90038f70 0x7f4b9003b430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0098c0 tx=0x7f4b8c006db0 comp rx=0 tx=0).stop 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.666+0000 7f4baa5e6640 1 -- 172.21.15.81:0/250760852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 msgr2=0x7f4ba407daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.666+0000 7f4baa5e6640 1 --2- 172.21.15.81:0/250760852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 0x7f4ba407daf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009940 tx=0x7f4b94032ce0 comp rx=0 tx=0).stop 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.666+0000 7f4baa5e6640 1 -- 172.21.15.81:0/250760852 shutdown_connections 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.666+0000 7f4baa5e6640 1 --2- 172.21.15.81:0/250760852 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f4b90038f70 0x7f4b9003b430 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.666+0000 7f4baa5e6640 1 --2- 172.21.15.81:0/250760852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba41077d0 0x7f4ba407daf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.667+0000 7f4baa5e6640 1 -- 172.21.15.81:0/250760852 >> 172.21.15.81:0/250760852 conn(0x7f4ba4102f60 msgr2=0x7f4ba4103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.667+0000 7f4baa5e6640 1 -- 172.21.15.81:0/250760852 shutdown_connections 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:53.667+0000 7f4baa5e6640 1 -- 172.21.15.81:0/250760852 wait complete. 2024-09-12T01:18:54.249 INFO:teuthology.orchestra.run.smithi081.stdout:mgr is available 2024-09-12T01:18:55.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:54 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/4136619220' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T01:18:55.470 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T01:18:55.470 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T01:18:55.470 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:18:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-09-12T01:18:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T01:18:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T01:18:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T01:18:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T01:18:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T01:18:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T01:18:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T01:18:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T01:18:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T01:18:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T01:18:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T01:18:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T01:18:55.472 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T01:18:55.472 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T01:18:55.472 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.567+0000 7f3881641640 1 Processor -- start 2024-09-12T01:18:55.472 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.567+0000 7f3881641640 1 -- start start 2024-09-12T01:18:55.472 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.567+0000 7f3881641640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 0x7f387c107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:55.472 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.567+0000 7f3881641640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f387c1081a0 con 0x7f387c1077d0 2024-09-12T01:18:55.472 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.568+0000 7f387affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 0x7f387c107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:55.472 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.568+0000 7f387affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 0x7f387c107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36682/0 (socket says 172.21.15.81:36682) 2024-09-12T01:18:55.472 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.568+0000 7f387affd640 1 -- 172.21.15.81:0/2332508854 learned_addr learned my addr 172.21.15.81:0/2332508854 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:55.472 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.568+0000 7f387affd640 1 -- 172.21.15.81:0/2332508854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387c1089d0 con 0x7f387c1077d0 2024-09-12T01:18:55.472 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.568+0000 7f387affd640 1 --2- 172.21.15.81:0/2332508854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 0x7f387c107bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f386c009e80 tx=0x7f386c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ac4d8bd77fda1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:55.472 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.569+0000 7f3879ffb640 1 -- 172.21.15.81:0/2332508854 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386c036070 con 0x7f387c1077d0 2024-09-12T01:18:55.472 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.569+0000 7f3879ffb640 1 -- 172.21.15.81:0/2332508854 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f386c0318c0 con 0x7f387c1077d0 2024-09-12T01:18:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.569+0000 7f3879ffb640 1 -- 172.21.15.81:0/2332508854 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386c007ab0 con 0x7f387c1077d0 2024-09-12T01:18:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.569+0000 7f3881641640 1 -- 172.21.15.81:0/2332508854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 msgr2=0x7f387c107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.569+0000 7f3881641640 1 --2- 172.21.15.81:0/2332508854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 0x7f387c107bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f386c009e80 tx=0x7f386c02a7a0 comp rx=0 tx=0).stop 2024-09-12T01:18:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.569+0000 7f3881641640 1 -- 172.21.15.81:0/2332508854 shutdown_connections 2024-09-12T01:18:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.569+0000 7f3881641640 1 --2- 172.21.15.81:0/2332508854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 0x7f387c107bd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.569+0000 7f3881641640 1 -- 172.21.15.81:0/2332508854 >> 172.21.15.81:0/2332508854 conn(0x7f387c102f20 msgr2=0x7f387c1053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.569+0000 7f3881641640 1 -- 172.21.15.81:0/2332508854 shutdown_connections 2024-09-12T01:18:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.569+0000 7f3881641640 1 -- 172.21.15.81:0/2332508854 wait complete. 2024-09-12T01:18:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.570+0000 7f3881641640 1 Processor -- start 2024-09-12T01:18:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.570+0000 7f3881641640 1 -- start start 2024-09-12T01:18:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.570+0000 7f3881641640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 0x7f387c19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.570+0000 7f3881641640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f387c10bd80 con 0x7f387c1077d0 2024-09-12T01:18:55.473 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.571+0000 7f387affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 0x7f387c19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:55.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.571+0000 7f387affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 0x7f387c19b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36694/0 (socket says 172.21.15.81:36694) 2024-09-12T01:18:55.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.571+0000 7f387affd640 1 -- 172.21.15.81:0/4136619220 learned_addr learned my addr 172.21.15.81:0/4136619220 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:55.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.571+0000 7f387affd640 1 -- 172.21.15.81:0/4136619220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387c19bcd0 con 0x7f387c1077d0 2024-09-12T01:18:55.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.571+0000 7f387affd640 1 --2- 172.21.15.81:0/4136619220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 0x7f387c19b790 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f386c02ad90 tx=0x7f386c031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:55.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.571+0000 7f3863fff640 1 -- 172.21.15.81:0/4136619220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386c036050 con 0x7f387c1077d0 2024-09-12T01:18:55.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.571+0000 7f3863fff640 1 -- 172.21.15.81:0/4136619220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f386c042070 con 0x7f387c1077d0 2024-09-12T01:18:55.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.571+0000 7f3881641640 1 -- 172.21.15.81:0/4136619220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387c19bf60 con 0x7f387c1077d0 2024-09-12T01:18:55.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.571+0000 7f3863fff640 1 -- 172.21.15.81:0/4136619220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386c03d7e0 con 0x7f387c1077d0 2024-09-12T01:18:55.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.571+0000 7f3881641640 1 -- 172.21.15.81:0/4136619220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f387c19ec50 con 0x7f387c1077d0 2024-09-12T01:18:55.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.572+0000 7f3863fff640 1 -- 172.21.15.81:0/4136619220 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f386c03dae0 con 0x7f387c1077d0 2024-09-12T01:18:55.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.572+0000 7f3881641640 1 -- 172.21.15.81:0/4136619220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f387c107c50 con 0x7f387c1077d0 2024-09-12T01:18:55.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.572+0000 7f3863fff640 1 --2- 172.21.15.81:0/4136619220 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f3864038f20 0x7f386403b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:55.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.572+0000 7f3863fff640 1 -- 172.21.15.81:0/4136619220 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f386c007e00 con 0x7f387c1077d0 2024-09-12T01:18:55.475 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.572+0000 7f387a7fc640 1 --2- 172.21.15.81:0/4136619220 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f3864038f20 0x7f386403b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:55.475 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.573+0000 7f387a7fc640 1 --2- 172.21.15.81:0/4136619220 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f3864038f20 0x7f386403b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f38700098c0 tx=0x7f3870006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:55.475 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.577+0000 7f3863fff640 1 -- 172.21.15.81:0/4136619220 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f386c071070 con 0x7f387c1077d0 2024-09-12T01:18:55.475 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.742+0000 7f3881641640 1 -- 172.21.15.81:0/4136619220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f387c1a0450 con 0x7f387c1077d0 2024-09-12T01:18:55.475 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.743+0000 7f3863fff640 1 -- 172.21.15.81:0/4136619220 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f386c03c9c0 con 0x7f387c1077d0 2024-09-12T01:18:55.475 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.745+0000 7f3881641640 1 -- 172.21.15.81:0/4136619220 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f3864038f20 msgr2=0x7f386403b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:55.475 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.745+0000 7f3881641640 1 --2- 172.21.15.81:0/4136619220 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f3864038f20 0x7f386403b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f38700098c0 tx=0x7f3870006db0 comp rx=0 tx=0).stop 2024-09-12T01:18:55.475 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.745+0000 7f3881641640 1 -- 172.21.15.81:0/4136619220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 msgr2=0x7f387c19b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:55.475 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.745+0000 7f3881641640 1 --2- 172.21.15.81:0/4136619220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 0x7f387c19b790 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f386c02ad90 tx=0x7f386c031ca0 comp rx=0 tx=0).stop 2024-09-12T01:18:55.475 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.745+0000 7f3881641640 1 -- 172.21.15.81:0/4136619220 shutdown_connections 2024-09-12T01:18:55.475 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.745+0000 7f3881641640 1 --2- 172.21.15.81:0/4136619220 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f3864038f20 0x7f386403b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:55.475 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.745+0000 7f3881641640 1 --2- 172.21.15.81:0/4136619220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f387c1077d0 0x7f387c19b790 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:55.475 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.745+0000 7f3881641640 1 -- 172.21.15.81:0/4136619220 >> 172.21.15.81:0/4136619220 conn(0x7f387c102f20 msgr2=0x7f387c103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:55.476 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.746+0000 7f3881641640 1 -- 172.21.15.81:0/4136619220 shutdown_connections 2024-09-12T01:18:55.476 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:54.746+0000 7f3881641640 1 -- 172.21.15.81:0/4136619220 wait complete. 2024-09-12T01:18:55.476 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling cephadm module... 2024-09-12T01:18:56.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:56 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2004985401' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T01:18:56.488 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: ignoring --setuser ceph since I am not root 2024-09-12T01:18:56.488 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: ignoring --setgroup ceph since I am not root 2024-09-12T01:18:56.488 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:56.284+0000 7fa3bb3db040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:18:56.488 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:56.341+0000 7fa3bb3db040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:18:56.488 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:56.489+0000 7fa3bb3db040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:18:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.877+0000 7fea28aee640 1 Processor -- start 2024-09-12T01:18:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.877+0000 7fea28aee640 1 -- start start 2024-09-12T01:18:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.877+0000 7fea28aee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 0x7fea24106ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.877+0000 7fea28aee640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea241070b0 con 0x7fea241066e0 2024-09-12T01:18:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.877+0000 7fea2259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 0x7fea24106ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.877+0000 7fea2259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 0x7fea24106ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36704/0 (socket says 172.21.15.81:36704) 2024-09-12T01:18:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.877+0000 7fea2259c640 1 -- 172.21.15.81:0/392707080 learned_addr learned my addr 172.21.15.81:0/392707080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.878+0000 7fea2259c640 1 -- 172.21.15.81:0/392707080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea241078e0 con 0x7fea241066e0 2024-09-12T01:18:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.878+0000 7fea2259c640 1 --2- 172.21.15.81:0/392707080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 0x7fea24106ae0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fea14009820 tx=0x7fea1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4213020553886ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.879+0000 7fea21d9b640 1 -- 172.21.15.81:0/392707080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea14037070 con 0x7fea241066e0 2024-09-12T01:18:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.879+0000 7fea21d9b640 1 -- 172.21.15.81:0/392707080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea14032900 con 0x7fea241066e0 2024-09-12T01:18:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.879+0000 7fea21d9b640 1 -- 172.21.15.81:0/392707080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea14030850 con 0x7fea241066e0 2024-09-12T01:18:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.879+0000 7fea28aee640 1 -- 172.21.15.81:0/392707080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 msgr2=0x7fea24106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.879+0000 7fea28aee640 1 --2- 172.21.15.81:0/392707080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 0x7fea24106ae0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fea14009820 tx=0x7fea1402a270 comp rx=0 tx=0).stop 2024-09-12T01:18:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.879+0000 7fea28aee640 1 -- 172.21.15.81:0/392707080 shutdown_connections 2024-09-12T01:18:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.879+0000 7fea28aee640 1 --2- 172.21.15.81:0/392707080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 0x7fea24106ae0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.879+0000 7fea28aee640 1 -- 172.21.15.81:0/392707080 >> 172.21.15.81:0/392707080 conn(0x7fea24101ed0 msgr2=0x7fea241042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.879+0000 7fea28aee640 1 -- 172.21.15.81:0/392707080 shutdown_connections 2024-09-12T01:18:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.879+0000 7fea28aee640 1 -- 172.21.15.81:0/392707080 wait complete. 2024-09-12T01:18:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.880+0000 7fea28aee640 1 Processor -- start 2024-09-12T01:18:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.880+0000 7fea28aee640 1 -- start start 2024-09-12T01:18:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.880+0000 7fea28aee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 0x7fea241918a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.880+0000 7fea28aee640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea2410ac90 con 0x7fea241066e0 2024-09-12T01:18:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.880+0000 7fea2259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 0x7fea241918a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.880+0000 7fea2259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 0x7fea241918a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36712/0 (socket says 172.21.15.81:36712) 2024-09-12T01:18:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.880+0000 7fea2259c640 1 -- 172.21.15.81:0/2004985401 learned_addr learned my addr 172.21.15.81:0/2004985401 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.881+0000 7fea2259c640 1 -- 172.21.15.81:0/2004985401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea24191de0 con 0x7fea241066e0 2024-09-12T01:18:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.881+0000 7fea2259c640 1 --2- 172.21.15.81:0/2004985401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 0x7fea241918a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fea140097f0 tx=0x7fea14030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.881+0000 7fea1b7fe640 1 -- 172.21.15.81:0/2004985401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea14037040 con 0x7fea241066e0 2024-09-12T01:18:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.881+0000 7fea1b7fe640 1 -- 172.21.15.81:0/2004985401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea14040070 con 0x7fea241066e0 2024-09-12T01:18:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.881+0000 7fea28aee640 1 -- 172.21.15.81:0/2004985401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea2418ffd0 con 0x7fea241066e0 2024-09-12T01:18:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.881+0000 7fea1b7fe640 1 -- 172.21.15.81:0/2004985401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea1403a390 con 0x7fea241066e0 2024-09-12T01:18:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.881+0000 7fea28aee640 1 -- 172.21.15.81:0/2004985401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea241904b0 con 0x7fea241066e0 2024-09-12T01:18:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.882+0000 7fea1b7fe640 1 -- 172.21.15.81:0/2004985401 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fea1403a5e0 con 0x7fea241066e0 2024-09-12T01:18:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.882+0000 7fea1b7fe640 1 --2- 172.21.15.81:0/2004985401 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7fea10038f70 0x7fea1003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.882+0000 7fea1b7fe640 1 -- 172.21.15.81:0/2004985401 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fea1406c0b0 con 0x7fea241066e0 2024-09-12T01:18:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.882+0000 7fea28aee640 1 -- 172.21.15.81:0/2004985401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea24106b60 con 0x7fea241066e0 2024-09-12T01:18:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.882+0000 7fea1bfff640 1 --2- 172.21.15.81:0/2004985401 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7fea10038f70 0x7fea1003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.883+0000 7fea1bfff640 1 --2- 172.21.15.81:0/2004985401 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7fea10038f70 0x7fea1003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0098c0 tx=0x7fea0c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:55.887+0000 7fea1b7fe640 1 -- 172.21.15.81:0/2004985401 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea1406be10 con 0x7fea241066e0 2024-09-12T01:18:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:56.096+0000 7fea28aee640 1 -- 172.21.15.81:0/2004985401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fea24195680 con 0x7fea241066e0 2024-09-12T01:18:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:56.148+0000 7fea1b7fe640 1 -- 172.21.15.81:0/2004985401 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fea1403a8d0 con 0x7fea241066e0 2024-09-12T01:18:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:56.149+0000 7fea1b7fe640 1 -- 172.21.15.81:0/2004985401 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fea1402fd60 con 0x7fea241066e0 2024-09-12T01:18:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:56.151+0000 7fea28aee640 1 -- 172.21.15.81:0/2004985401 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7fea10038f70 msgr2=0x7fea1003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:56.151+0000 7fea28aee640 1 --2- 172.21.15.81:0/2004985401 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7fea10038f70 0x7fea1003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0098c0 tx=0x7fea0c006db0 comp rx=0 tx=0).stop 2024-09-12T01:18:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:56.151+0000 7fea28aee640 1 -- 172.21.15.81:0/2004985401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 msgr2=0x7fea241918a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:56.151+0000 7fea28aee640 1 --2- 172.21.15.81:0/2004985401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 0x7fea241918a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fea140097f0 tx=0x7fea14030d80 comp rx=0 tx=0).stop 2024-09-12T01:18:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:56.151+0000 7fea28aee640 1 -- 172.21.15.81:0/2004985401 shutdown_connections 2024-09-12T01:18:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:56.151+0000 7fea28aee640 1 --2- 172.21.15.81:0/2004985401 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7fea10038f70 0x7fea1003b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:56.151+0000 7fea28aee640 1 --2- 172.21.15.81:0/2004985401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea241066e0 0x7fea241918a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:56.151+0000 7fea28aee640 1 -- 172.21.15.81:0/2004985401 >> 172.21.15.81:0/2004985401 conn(0x7fea24101ed0 msgr2=0x7fea24102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:56.151+0000 7fea28aee640 1 -- 172.21.15.81:0/2004985401 shutdown_connections 2024-09-12T01:18:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:56.151+0000 7fea28aee640 1 -- 172.21.15.81:0/2004985401 wait complete. 2024-09-12T01:18:56.846 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:56.556+0000 7fa3bb3db040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:18:56.846 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:56.702+0000 7fa3bb3db040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:18:56.846 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:56.847+0000 7fa3bb3db040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:18:57.413 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:57 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2004985401' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T01:18:57.413 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:57 smithi081 ceph-mon[30920]: mgrmap e5: x(active, since 5s) 2024-09-12T01:18:57.414 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:57 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:57.164+0000 7fa3bb3db040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:18:57.414 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:57 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:57.227+0000 7fa3bb3db040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:18:57.414 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:57 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:57.414+0000 7fa3bb3db040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:18:57.951 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:18:57.951 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T01:18:57.951 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:18:57.951 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T01:18:57.951 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T01:18:57.951 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:18:57.951 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.166+0000 7f18a892d640 1 Processor -- start 2024-09-12T01:18:57.951 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.166+0000 7f18a892d640 1 -- start start 2024-09-12T01:18:57.951 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.166+0000 7f18a892d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 0x7f18a4106440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:57.951 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.166+0000 7f18a892d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18a407be30 con 0x7f18a4106040 2024-09-12T01:18:57.951 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.166+0000 7f18a259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 0x7f18a4106440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:57.952 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.166+0000 7f18a259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 0x7f18a4106440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36728/0 (socket says 172.21.15.81:36728) 2024-09-12T01:18:57.952 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.166+0000 7f18a259c640 1 -- 172.21.15.81:0/1249477106 learned_addr learned my addr 172.21.15.81:0/1249477106 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:57.952 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.167+0000 7f18a259c640 1 -- 172.21.15.81:0/1249477106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a4106980 con 0x7f18a4106040 2024-09-12T01:18:57.952 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.167+0000 7f18a259c640 1 --2- 172.21.15.81:0/1249477106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 0x7f18a4106440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1894009820 tx=0x7f189402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9dacdd7b098dadd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:57.952 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.167+0000 7f18a159a640 1 -- 172.21.15.81:0/1249477106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1894037070 con 0x7f18a4106040 2024-09-12T01:18:57.952 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.168+0000 7f18a159a640 1 -- 172.21.15.81:0/1249477106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1894032900 con 0x7f18a4106040 2024-09-12T01:18:57.952 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.168+0000 7f18a159a640 1 -- 172.21.15.81:0/1249477106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1894030850 con 0x7f18a4106040 2024-09-12T01:18:57.952 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.168+0000 7f18a892d640 1 -- 172.21.15.81:0/1249477106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 msgr2=0x7f18a4106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:57.952 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.168+0000 7f18a892d640 1 --2- 172.21.15.81:0/1249477106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 0x7f18a4106440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1894009820 tx=0x7f189402a270 comp rx=0 tx=0).stop 2024-09-12T01:18:57.952 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.168+0000 7f18a892d640 1 -- 172.21.15.81:0/1249477106 shutdown_connections 2024-09-12T01:18:57.952 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.168+0000 7f18a892d640 1 --2- 172.21.15.81:0/1249477106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 0x7f18a4106440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:57.952 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.168+0000 7f18a892d640 1 -- 172.21.15.81:0/1249477106 >> 172.21.15.81:0/1249477106 conn(0x7f18a4101ed0 msgr2=0x7f18a41042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.168+0000 7f18a892d640 1 -- 172.21.15.81:0/1249477106 shutdown_connections 2024-09-12T01:18:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.168+0000 7f18a892d640 1 -- 172.21.15.81:0/1249477106 wait complete. 2024-09-12T01:18:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.169+0000 7f18a892d640 1 Processor -- start 2024-09-12T01:18:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.169+0000 7f18a892d640 1 -- start start 2024-09-12T01:18:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.169+0000 7f18a892d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 0x7f18a419d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.169+0000 7f18a892d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4107a10 con 0x7f18a4106040 2024-09-12T01:18:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.169+0000 7f18a259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 0x7f18a419d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:18:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.169+0000 7f18a259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 0x7f18a419d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36742/0 (socket says 172.21.15.81:36742) 2024-09-12T01:18:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.169+0000 7f18a259c640 1 -- 172.21.15.81:0/3743573050 learned_addr learned my addr 172.21.15.81:0/3743573050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:18:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.170+0000 7f18a259c640 1 -- 172.21.15.81:0/3743573050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a419de80 con 0x7f18a4106040 2024-09-12T01:18:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.170+0000 7f18a259c640 1 --2- 172.21.15.81:0/3743573050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 0x7f18a419d940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f18940097f0 tx=0x7f1894030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:18:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.170+0000 7f18937fe640 1 -- 172.21.15.81:0/3743573050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1894037040 con 0x7f18a4106040 2024-09-12T01:18:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.170+0000 7f18937fe640 1 -- 172.21.15.81:0/3743573050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1894040070 con 0x7f18a4106040 2024-09-12T01:18:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.170+0000 7f18a892d640 1 -- 172.21.15.81:0/3743573050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a419e110 con 0x7f18a4106040 2024-09-12T01:18:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.170+0000 7f18937fe640 1 -- 172.21.15.81:0/3743573050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f189403a390 con 0x7f18a4106040 2024-09-12T01:18:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.170+0000 7f18a892d640 1 -- 172.21.15.81:0/3743573050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a41a0e00 con 0x7f18a4106040 2024-09-12T01:18:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.171+0000 7f18937fe640 1 -- 172.21.15.81:0/3743573050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f189403a630 con 0x7f18a4106040 2024-09-12T01:18:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.171+0000 7f18a892d640 1 -- 172.21.15.81:0/3743573050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a4106440 con 0x7f18a4106040 2024-09-12T01:18:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.171+0000 7f18937fe640 1 --2- 172.21.15.81:0/3743573050 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f188c038f70 0x7f188c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:18:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.171+0000 7f18937fe640 1 -- 172.21.15.81:0/3743573050 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f189406c1a0 con 0x7f18a4106040 2024-09-12T01:18:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.171+0000 7f18a1d9b640 1 -- 172.21.15.81:0/3743573050 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f188c038f70 msgr2=0x7f188c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1762827469 2024-09-12T01:18:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.171+0000 7f18a1d9b640 1 --2- 172.21.15.81:0/3743573050 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f188c038f70 0x7f188c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:18:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.176+0000 7f18937fe640 1 -- 172.21.15.81:0/3743573050 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f189404a200 con 0x7f18a4106040 2024-09-12T01:18:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.372+0000 7f18a1d9b640 1 -- 172.21.15.81:0/3743573050 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f188c038f70 msgr2=0x7f188c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1762827469 2024-09-12T01:18:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.372+0000 7f18a1d9b640 1 --2- 172.21.15.81:0/3743573050 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f188c038f70 0x7f188c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:18:57.954 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.390+0000 7f18a892d640 1 -- 172.21.15.81:0/3743573050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f18a41a0fd0 con 0x7f18a4106040 2024-09-12T01:18:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.390+0000 7f18937fe640 1 -- 172.21.15.81:0/3743573050 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f18a41a0fd0 con 0x7f18a4106040 2024-09-12T01:18:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.392+0000 7f18a892d640 1 -- 172.21.15.81:0/3743573050 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f188c038f70 msgr2=0x7f188c03b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:18:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.392+0000 7f18a892d640 1 --2- 172.21.15.81:0/3743573050 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f188c038f70 0x7f188c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.392+0000 7f18a892d640 1 -- 172.21.15.81:0/3743573050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 msgr2=0x7f18a419d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:18:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.392+0000 7f18a892d640 1 --2- 172.21.15.81:0/3743573050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 0x7f18a419d940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f18940097f0 tx=0x7f1894030d80 comp rx=0 tx=0).stop 2024-09-12T01:18:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.392+0000 7f18a892d640 1 -- 172.21.15.81:0/3743573050 shutdown_connections 2024-09-12T01:18:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.392+0000 7f18a892d640 1 --2- 172.21.15.81:0/3743573050 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f188c038f70 0x7f188c03b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.392+0000 7f18a892d640 1 --2- 172.21.15.81:0/3743573050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18a4106040 0x7f18a419d940 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:18:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.392+0000 7f18a892d640 1 -- 172.21.15.81:0/3743573050 >> 172.21.15.81:0/3743573050 conn(0x7f18a4101ed0 msgr2=0x7f18a4191c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:18:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.392+0000 7f18a892d640 1 -- 172.21.15.81:0/3743573050 shutdown_connections 2024-09-12T01:18:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:57.392+0000 7f18a892d640 1 -- 172.21.15.81:0/3743573050 wait complete. 2024-09-12T01:18:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-09-12T01:18:57.955 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 5... 2024-09-12T01:18:58.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:18:58 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3743573050' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T01:18:58.553 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:58.317+0000 7fa3bb3db040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:18:58.553 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:58.388+0000 7fa3bb3db040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:18:59.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:59.083+0000 7fa3bb3db040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:18:59.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:59.198+0000 7fa3bb3db040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:18:59.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:59.338+0000 7fa3bb3db040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:18:59.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:59.398+0000 7fa3bb3db040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:18:59.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:59.545+0000 7fa3bb3db040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:18:59.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:59.612+0000 7fa3bb3db040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:18:59.889 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:59.671+0000 7fa3bb3db040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:18:59.889 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:59.826+0000 7fa3bb3db040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:18:59.889 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:59.889+0000 7fa3bb3db040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:19:00.151 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:18:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:18:59.955+0000 7fa3bb3db040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:19:00.152 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:00.036+0000 7fa3bb3db040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:19:00.152 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:00.094+0000 7fa3bb3db040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:19:00.152 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:00.152+0000 7fa3bb3db040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:19:01.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:00.924+0000 7fa3bb3db040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:19:01.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: Active manager daemon x restarted 2024-09-12T01:19:01.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: Activating manager daemon x 2024-09-12T01:19:01.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T01:19:01.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: mgrmap e6: x(active, starting, since 0.00339683s) 2024-09-12T01:19:01.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:19:01.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:19:01.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:19:01.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:19:01.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:19:01.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: Manager daemon x is now available 2024-09-12T01:19:01.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:01.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:01.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:19:01.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:19:01.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:19:01.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:00 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:19:02.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:01 smithi081 ceph-mon[30920]: Found migration_current of "None". Setting to last migration. 2024-09-12T01:19:02.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:01 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:02.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:01 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:02.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:01 smithi081 ceph-mon[30920]: mgrmap e7: x(active, since 1.0057s) 2024-09-12T01:19:02.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:02.146+0000 7fa322735640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:01:19:02] ENGINE Error in HTTPServer.serve 2024-09-12T01:19:02.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: Traceback (most recent call last): 2024-09-12T01:19:02.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:19:02.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: self._connections.run(self.expiration_interval) 2024-09-12T01:19:02.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:19:02.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: self._run(expiration_interval) 2024-09-12T01:19:02.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:19:02.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:19:02.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:19:02.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:19:02.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:19:02.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: s = self.context.wrap_socket( 2024-09-12T01:19:02.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:19:02.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: return self.sslsocket_class._create( 2024-09-12T01:19:02.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:19:02.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: self.do_handshake() 2024-09-12T01:19:02.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:19:02.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: self._sslobj.do_handshake() 2024-09-12T01:19:02.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:19:02.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:02.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:19:02.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T01:19:02.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T01:19:02.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:19:02.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.348+0000 7f03777e2640 1 Processor -- start 2024-09-12T01:19:02.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.348+0000 7f03777e2640 1 -- start start 2024-09-12T01:19:02.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.348+0000 7f03777e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 0x7f037010a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:02.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.348+0000 7f03777e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f037007bdd0 con 0x7f03701082c0 2024-09-12T01:19:02.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.348+0000 7f037557e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 0x7f037010a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:02.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.348+0000 7f037557e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 0x7f037010a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36748/0 (socket says 172.21.15.81:36748) 2024-09-12T01:19:02.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.348+0000 7f037557e640 1 -- 172.21.15.81:0/2189648189 learned_addr learned my addr 172.21.15.81:0/2189648189 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:02.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.349+0000 7f037557e640 1 -- 172.21.15.81:0/2189648189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037010abf0 con 0x7f03701082c0 2024-09-12T01:19:02.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.349+0000 7f037557e640 1 --2- 172.21.15.81:0/2189648189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 0x7f037010a6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f036c009820 tx=0x7f036c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4ddfc548078def server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:02.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.349+0000 7f0367fff640 1 -- 172.21.15.81:0/2189648189 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c037070 con 0x7f03701082c0 2024-09-12T01:19:02.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.349+0000 7f0367fff640 1 -- 172.21.15.81:0/2189648189 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f036c032900 con 0x7f03701082c0 2024-09-12T01:19:02.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.349+0000 7f0367fff640 1 -- 172.21.15.81:0/2189648189 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c030850 con 0x7f03701082c0 2024-09-12T01:19:02.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.350+0000 7f03777e2640 1 -- 172.21.15.81:0/2189648189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 msgr2=0x7f037010a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:02.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.350+0000 7f03777e2640 1 --2- 172.21.15.81:0/2189648189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 0x7f037010a6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f036c009820 tx=0x7f036c02a270 comp rx=0 tx=0).stop 2024-09-12T01:19:02.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.350+0000 7f03777e2640 1 -- 172.21.15.81:0/2189648189 shutdown_connections 2024-09-12T01:19:02.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.350+0000 7f03777e2640 1 --2- 172.21.15.81:0/2189648189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 0x7f037010a6b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:02.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.350+0000 7f03777e2640 1 -- 172.21.15.81:0/2189648189 >> 172.21.15.81:0/2189648189 conn(0x7f0370101e80 msgr2=0x7f03701042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:02.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.350+0000 7f03777e2640 1 -- 172.21.15.81:0/2189648189 shutdown_connections 2024-09-12T01:19:02.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.350+0000 7f03777e2640 1 -- 172.21.15.81:0/2189648189 wait complete. 2024-09-12T01:19:02.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.351+0000 7f03777e2640 1 Processor -- start 2024-09-12T01:19:02.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.351+0000 7f03777e2640 1 -- start start 2024-09-12T01:19:02.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.351+0000 7f03777e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 0x7f037019b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:02.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.351+0000 7f03777e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f037010bbc0 con 0x7f03701082c0 2024-09-12T01:19:02.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.352+0000 7f037557e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 0x7f037019b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:02.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.352+0000 7f037557e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 0x7f037019b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36762/0 (socket says 172.21.15.81:36762) 2024-09-12T01:19:02.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.352+0000 7f037557e640 1 -- 172.21.15.81:0/494816755 learned_addr learned my addr 172.21.15.81:0/494816755 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:02.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.352+0000 7f037557e640 1 -- 172.21.15.81:0/494816755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037019bcf0 con 0x7f03701082c0 2024-09-12T01:19:02.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.352+0000 7f037557e640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 0x7f037019b7b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f036c0097f0 tx=0x7f036c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:02.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.352+0000 7f03667fc640 1 -- 172.21.15.81:0/494816755 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c037040 con 0x7f03701082c0 2024-09-12T01:19:02.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.352+0000 7f03667fc640 1 -- 172.21.15.81:0/494816755 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f036c040070 con 0x7f03701082c0 2024-09-12T01:19:02.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.352+0000 7f03667fc640 1 -- 172.21.15.81:0/494816755 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c03a390 con 0x7f03701082c0 2024-09-12T01:19:02.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.352+0000 7f03777e2640 1 -- 172.21.15.81:0/494816755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f037019bf80 con 0x7f03701082c0 2024-09-12T01:19:02.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.352+0000 7f03777e2640 1 -- 172.21.15.81:0/494816755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f037019ec70 con 0x7f03701082c0 2024-09-12T01:19:02.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.353+0000 7f03667fc640 1 -- 172.21.15.81:0/494816755 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f036c03a5e0 con 0x7f03701082c0 2024-09-12T01:19:02.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.353+0000 7f03667fc640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f035c038fc0 0x7f035c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:02.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.353+0000 7f03667fc640 1 -- 172.21.15.81:0/494816755 --> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f035c03bb90 con 0x7f035c038fc0 2024-09-12T01:19:02.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.353+0000 7f03667fc640 1 -- 172.21.15.81:0/494816755 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f036c06c100 con 0x7f03701082c0 2024-09-12T01:19:02.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.353+0000 7f0374d7d640 1 -- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f035c038fc0 msgr2=0x7f035c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1762827469 2024-09-12T01:19:02.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.353+0000 7f0374d7d640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f035c038fc0 0x7f035c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:19:02.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.554+0000 7f0374d7d640 1 -- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f035c038fc0 msgr2=0x7f035c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1762827469 2024-09-12T01:19:02.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.554+0000 7f0374d7d640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f035c038fc0 0x7f035c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:19:02.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.955+0000 7f0374d7d640 1 -- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f035c038fc0 msgr2=0x7f035c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1762827469 2024-09-12T01:19:02.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:58.955+0000 7f0374d7d640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f035c038fc0 0x7f035c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:19:02.539 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:59.756+0000 7f0374d7d640 1 -- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f035c038fc0 msgr2=0x7f035c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1762827469 2024-09-12T01:19:02.539 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:18:59.756+0000 7f0374d7d640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f035c038fc0 0x7f035c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:19:02.539 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:00.928+0000 7f03667fc640 1 -- 172.21.15.81:0/494816755 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f036c02fd60 con 0x7f03701082c0 2024-09-12T01:19:02.539 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:00.928+0000 7f03667fc640 1 -- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f035c038fc0 msgr2=0x7f035c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:19:02.539 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:00.928+0000 7f03667fc640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f035c038fc0 0x7f035c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:02.539 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.929+0000 7f03667fc640 1 -- 172.21.15.81:0/494816755 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f036c03aca0 con 0x7f03701082c0 2024-09-12T01:19:02.539 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.929+0000 7f03667fc640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f035c03c8f0 0x7f035c03ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:02.539 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.929+0000 7f03667fc640 1 -- 172.21.15.81:0/494816755 --> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f036c03de70 con 0x7f035c03c8f0 2024-09-12T01:19:02.539 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.929+0000 7f0374d7d640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f035c03c8f0 0x7f035c03ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:02.539 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.930+0000 7f0374d7d640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f035c03c8f0 0x7f035c03ece0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0360003980 tx=0x7f03600092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.930+0000 7f03667fc640 1 -- 172.21.15.81:0/494816755 <== mgr.14118 v2:172.21.15.81:6800/1857307616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f036c03de70 con 0x7f035c03c8f0 2024-09-12T01:19:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.937+0000 7f03777e2640 1 -- 172.21.15.81:0/494816755 --> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f0370108720 con 0x7f035c03c8f0 2024-09-12T01:19:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.938+0000 7f03667fc640 1 -- 172.21.15.81:0/494816755 <== mgr.14118 v2:172.21.15.81:6800/1857307616 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f0370108720 con 0x7f035c03c8f0 2024-09-12T01:19:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.938+0000 7f03777e2640 1 -- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f035c03c8f0 msgr2=0x7f035c03ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.938+0000 7f03777e2640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f035c03c8f0 0x7f035c03ece0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0360003980 tx=0x7f03600092b0 comp rx=0 tx=0).stop 2024-09-12T01:19:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.938+0000 7f03777e2640 1 -- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 msgr2=0x7f037019b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.938+0000 7f03777e2640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 0x7f037019b7b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f036c0097f0 tx=0x7f036c030d80 comp rx=0 tx=0).stop 2024-09-12T01:19:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.938+0000 7f03777e2640 1 -- 172.21.15.81:0/494816755 shutdown_connections 2024-09-12T01:19:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.938+0000 7f03777e2640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f035c03c8f0 0x7f035c03ece0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.938+0000 7f03777e2640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:6800/1762827469,v1:172.21.15.81:6801/1762827469] conn(0x7f035c038fc0 0x7f035c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.938+0000 7f03777e2640 1 --2- 172.21.15.81:0/494816755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701082c0 0x7f037019b7b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:02.541 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.938+0000 7f03777e2640 1 -- 172.21.15.81:0/494816755 >> 172.21.15.81:0/494816755 conn(0x7f0370101e80 msgr2=0x7f0370102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:02.541 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.938+0000 7f03777e2640 1 -- 172.21.15.81:0/494816755 shutdown_connections 2024-09-12T01:19:02.541 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:01.938+0000 7f03777e2640 1 -- 172.21.15.81:0/494816755 wait complete. 2024-09-12T01:19:02.541 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 5 is available 2024-09-12T01:19:02.541 INFO:teuthology.orchestra.run.smithi081.stdout:Setting orchestrator backend to cephadm... 2024-09-12T01:19:03.064 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-mon[30920]: [12/Sep/2024:01:19:01] ENGINE Bus STARTING 2024-09-12T01:19:03.064 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-mon[30920]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T01:19:03.065 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-mon[30920]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T01:19:03.065 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-mon[30920]: [12/Sep/2024:01:19:02] ENGINE Serving on http://172.21.15.81:8765 2024-09-12T01:19:03.065 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-mon[30920]: [12/Sep/2024:01:19:02] ENGINE Serving on https://172.21.15.81:7150 2024-09-12T01:19:03.065 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-mon[30920]: [12/Sep/2024:01:19:02] ENGINE Bus STARTED 2024-09-12T01:19:03.065 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:19:03.065 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:02 smithi081 ceph-mon[30920]: [12/Sep/2024:01:19:02] ENGINE Error in HTTPServer.serve 2024-09-12T01:19:03.065 INFO:journalctl@ceph.mon.a.smithi081.stdout: Traceback (most recent call last): 2024-09-12T01:19:03.066 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:19:03.066 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:19:03.066 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:19:03.066 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._run(expiration_interval) 2024-09-12T01:19:03.066 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:19:03.066 INFO:journalctl@ceph.mon.a.smithi081.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:19:03.066 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:19:03.066 INFO:journalctl@ceph.mon.a.smithi081.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:19:03.066 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:19:03.066 INFO:journalctl@ceph.mon.a.smithi081.stdout: s = self.context.wrap_socket( 2024-09-12T01:19:03.066 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:19:03.066 INFO:journalctl@ceph.mon.a.smithi081.stdout: return self.sslsocket_class._create( 2024-09-12T01:19:03.067 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:19:03.067 INFO:journalctl@ceph.mon.a.smithi081.stdout: self.do_handshake() 2024-09-12T01:19:03.067 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:19:03.067 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._sslobj.do_handshake() 2024-09-12T01:19:03.067 INFO:journalctl@ceph.mon.a.smithi081.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:19:03.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.873+0000 7fae7b4d4640 1 Processor -- start 2024-09-12T01:19:03.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.873+0000 7fae7b4d4640 1 -- start start 2024-09-12T01:19:03.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.873+0000 7fae7b4d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 0x7fae74105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:03.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.873+0000 7fae7b4d4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae74106480 con 0x7fae74105ab0 2024-09-12T01:19:03.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.873+0000 7fae79270640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 0x7fae74105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:03.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.873+0000 7fae79270640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 0x7fae74105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51326/0 (socket says 172.21.15.81:51326) 2024-09-12T01:19:03.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.873+0000 7fae79270640 1 -- 172.21.15.81:0/1828024382 learned_addr learned my addr 172.21.15.81:0/1828024382 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:03.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.873+0000 7fae79270640 1 -- 172.21.15.81:0/1828024382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae74108a90 con 0x7fae74105ab0 2024-09-12T01:19:03.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.874+0000 7fae79270640 1 --2- 172.21.15.81:0/1828024382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 0x7fae74105eb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fae68009820 tx=0x7fae6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bae865e0f67b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:03.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.874+0000 7fae67fff640 1 -- 172.21.15.81:0/1828024382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae68037070 con 0x7fae74105ab0 2024-09-12T01:19:03.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.874+0000 7fae67fff640 1 -- 172.21.15.81:0/1828024382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae68032900 con 0x7fae74105ab0 2024-09-12T01:19:03.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.874+0000 7fae67fff640 1 -- 172.21.15.81:0/1828024382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae68030850 con 0x7fae74105ab0 2024-09-12T01:19:03.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.875+0000 7fae7b4d4640 1 -- 172.21.15.81:0/1828024382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 msgr2=0x7fae74105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:03.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.875+0000 7fae7b4d4640 1 --2- 172.21.15.81:0/1828024382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 0x7fae74105eb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fae68009820 tx=0x7fae6802a270 comp rx=0 tx=0).stop 2024-09-12T01:19:03.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.875+0000 7fae7b4d4640 1 -- 172.21.15.81:0/1828024382 shutdown_connections 2024-09-12T01:19:03.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.875+0000 7fae7b4d4640 1 --2- 172.21.15.81:0/1828024382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 0x7fae74105eb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:03.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.875+0000 7fae7b4d4640 1 -- 172.21.15.81:0/1828024382 >> 172.21.15.81:0/1828024382 conn(0x7fae74101600 msgr2=0x7fae74103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:03.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.875+0000 7fae7b4d4640 1 -- 172.21.15.81:0/1828024382 shutdown_connections 2024-09-12T01:19:03.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.875+0000 7fae7b4d4640 1 -- 172.21.15.81:0/1828024382 wait complete. 2024-09-12T01:19:03.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.876+0000 7fae7b4d4640 1 Processor -- start 2024-09-12T01:19:03.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.876+0000 7fae7b4d4640 1 -- start start 2024-09-12T01:19:03.606 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.876+0000 7fae7b4d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 0x7fae7419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:03.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.876+0000 7fae7b4d4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae7410bcc0 con 0x7fae74105ab0 2024-09-12T01:19:03.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.876+0000 7fae79270640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 0x7fae7419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:03.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.876+0000 7fae79270640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 0x7fae7419b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51332/0 (socket says 172.21.15.81:51332) 2024-09-12T01:19:03.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.876+0000 7fae79270640 1 -- 172.21.15.81:0/3500990740 learned_addr learned my addr 172.21.15.81:0/3500990740 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:03.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.876+0000 7fae79270640 1 -- 172.21.15.81:0/3500990740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7419bd80 con 0x7fae74105ab0 2024-09-12T01:19:03.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.876+0000 7fae79270640 1 --2- 172.21.15.81:0/3500990740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 0x7fae7419b840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fae680097f0 tx=0x7fae68030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:03.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.876+0000 7fae667fc640 1 -- 172.21.15.81:0/3500990740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae68037040 con 0x7fae74105ab0 2024-09-12T01:19:03.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.876+0000 7fae667fc640 1 -- 172.21.15.81:0/3500990740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae68040070 con 0x7fae74105ab0 2024-09-12T01:19:03.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.876+0000 7fae7b4d4640 1 -- 172.21.15.81:0/3500990740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae7419c010 con 0x7fae74105ab0 2024-09-12T01:19:03.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.876+0000 7fae667fc640 1 -- 172.21.15.81:0/3500990740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae6803a390 con 0x7fae74105ab0 2024-09-12T01:19:03.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.877+0000 7fae7b4d4640 1 -- 172.21.15.81:0/3500990740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae7419ed00 con 0x7fae74105ab0 2024-09-12T01:19:03.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.877+0000 7fae667fc640 1 -- 172.21.15.81:0/3500990740 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fae6803b430 con 0x7fae74105ab0 2024-09-12T01:19:03.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.878+0000 7fae7b4d4640 1 -- 172.21.15.81:0/3500990740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae74105f30 con 0x7fae74105ab0 2024-09-12T01:19:03.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.878+0000 7fae667fc640 1 --2- 172.21.15.81:0/3500990740 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fae60038eb0 0x7fae6003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:03.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.878+0000 7fae667fc640 1 -- 172.21.15.81:0/3500990740 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fae6806c260 con 0x7fae74105ab0 2024-09-12T01:19:03.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.878+0000 7fae78a6f640 1 --2- 172.21.15.81:0/3500990740 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fae60038eb0 0x7fae6003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:03.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.878+0000 7fae78a6f640 1 --2- 172.21.15.81:0/3500990740 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fae60038eb0 0x7fae6003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae700098c0 tx=0x7fae70006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:03.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.882+0000 7fae667fc640 1 -- 172.21.15.81:0/3500990740 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae68032900 con 0x7fae74105ab0 2024-09-12T01:19:03.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:02.980+0000 7fae667fc640 1 -- 172.21.15.81:0/3500990740 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fae68040ca0 con 0x7fae74105ab0 2024-09-12T01:19:03.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.065+0000 7fae7b4d4640 1 -- 172.21.15.81:0/3500990740 --> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fae741028e0 con 0x7fae60038eb0 2024-09-12T01:19:03.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.069+0000 7fae667fc640 1 -- 172.21.15.81:0/3500990740 <== mgr.14118 v2:172.21.15.81:6800/1857307616 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fae741028e0 con 0x7fae60038eb0 2024-09-12T01:19:03.608 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.071+0000 7fae7b4d4640 1 -- 172.21.15.81:0/3500990740 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fae60038eb0 msgr2=0x7fae6003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.071+0000 7fae7b4d4640 1 --2- 172.21.15.81:0/3500990740 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fae60038eb0 0x7fae6003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae700098c0 tx=0x7fae70006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.071+0000 7fae7b4d4640 1 -- 172.21.15.81:0/3500990740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 msgr2=0x7fae7419b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.071+0000 7fae7b4d4640 1 --2- 172.21.15.81:0/3500990740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 0x7fae7419b840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fae680097f0 tx=0x7fae68030d80 comp rx=0 tx=0).stop 2024-09-12T01:19:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.071+0000 7fae7b4d4640 1 -- 172.21.15.81:0/3500990740 shutdown_connections 2024-09-12T01:19:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.071+0000 7fae7b4d4640 1 --2- 172.21.15.81:0/3500990740 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fae60038eb0 0x7fae6003b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.071+0000 7fae7b4d4640 1 --2- 172.21.15.81:0/3500990740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae74105ab0 0x7fae7419b840 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.071+0000 7fae7b4d4640 1 -- 172.21.15.81:0/3500990740 >> 172.21.15.81:0/3500990740 conn(0x7fae74101600 msgr2=0x7fae741021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.072+0000 7fae7b4d4640 1 -- 172.21.15.81:0/3500990740 shutdown_connections 2024-09-12T01:19:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.072+0000 7fae7b4d4640 1 -- 172.21.15.81:0/3500990740 wait complete. 2024-09-12T01:19:04.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:03 smithi081 ceph-mon[30920]: mgrmap e8: x(active, since 2s) 2024-09-12T01:19:04.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:03 smithi081 ceph-mon[30920]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:04.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:03 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:04.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:03 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:19:04.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T01:19:04.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.987+0000 7f0943e7b640 1 Processor -- start 2024-09-12T01:19:04.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.987+0000 7f0943e7b640 1 -- start start 2024-09-12T01:19:04.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.987+0000 7f0943e7b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 0x7f093c07c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:04.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.987+0000 7f0943e7b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f093c07c830 con 0x7f093c07de00 2024-09-12T01:19:04.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.987+0000 7f0941c17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 0x7f093c07c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:04.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.987+0000 7f0941c17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 0x7f093c07c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51348/0 (socket says 172.21.15.81:51348) 2024-09-12T01:19:04.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.987+0000 7f0941c17640 1 -- 172.21.15.81:0/788785745 learned_addr learned my addr 172.21.15.81:0/788785745 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:04.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.988+0000 7f0941c17640 1 -- 172.21.15.81:0/788785745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093c07c9b0 con 0x7f093c07de00 2024-09-12T01:19:04.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.988+0000 7f0941c17640 1 --2- 172.21.15.81:0/788785745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 0x7f093c07c260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0938009820 tx=0x7f093802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8c9d37d319deac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:04.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.988+0000 7f0940c15640 1 -- 172.21.15.81:0/788785745 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0938037070 con 0x7f093c07de00 2024-09-12T01:19:04.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.988+0000 7f0940c15640 1 -- 172.21.15.81:0/788785745 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0938032900 con 0x7f093c07de00 2024-09-12T01:19:04.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.988+0000 7f0940c15640 1 -- 172.21.15.81:0/788785745 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0938030850 con 0x7f093c07de00 2024-09-12T01:19:04.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.989+0000 7f0943e7b640 1 -- 172.21.15.81:0/788785745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 msgr2=0x7f093c07c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:04.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.989+0000 7f0943e7b640 1 --2- 172.21.15.81:0/788785745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 0x7f093c07c260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0938009820 tx=0x7f093802a270 comp rx=0 tx=0).stop 2024-09-12T01:19:04.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.989+0000 7f0943e7b640 1 -- 172.21.15.81:0/788785745 shutdown_connections 2024-09-12T01:19:04.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.989+0000 7f0943e7b640 1 --2- 172.21.15.81:0/788785745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 0x7f093c07c260 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:04.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.989+0000 7f0943e7b640 1 -- 172.21.15.81:0/788785745 >> 172.21.15.81:0/788785745 conn(0x7f093c102f80 msgr2=0x7f093c1053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:04.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.989+0000 7f0943e7b640 1 -- 172.21.15.81:0/788785745 shutdown_connections 2024-09-12T01:19:04.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.989+0000 7f0943e7b640 1 -- 172.21.15.81:0/788785745 wait complete. 2024-09-12T01:19:04.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.990+0000 7f0943e7b640 1 Processor -- start 2024-09-12T01:19:04.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.990+0000 7f0943e7b640 1 -- start start 2024-09-12T01:19:04.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.990+0000 7f0943e7b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 0x7f093c19d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:04.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.990+0000 7f0943e7b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f093c10dda0 con 0x7f093c07de00 2024-09-12T01:19:04.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.990+0000 7f0941c17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 0x7f093c19d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:04.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.990+0000 7f0941c17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 0x7f093c19d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51350/0 (socket says 172.21.15.81:51350) 2024-09-12T01:19:04.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.990+0000 7f0941c17640 1 -- 172.21.15.81:0/3135202411 learned_addr learned my addr 172.21.15.81:0/3135202411 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:04.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.990+0000 7f0941c17640 1 -- 172.21.15.81:0/3135202411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093c19dec0 con 0x7f093c07de00 2024-09-12T01:19:04.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.990+0000 7f0941c17640 1 --2- 172.21.15.81:0/3135202411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 0x7f093c19d980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0938032ce0 tx=0x7f0938032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:04.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.990+0000 7f0932ffd640 1 -- 172.21.15.81:0/3135202411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0938042070 con 0x7f093c07de00 2024-09-12T01:19:04.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.991+0000 7f0932ffd640 1 -- 172.21.15.81:0/3135202411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f09380308c0 con 0x7f093c07de00 2024-09-12T01:19:04.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.991+0000 7f0932ffd640 1 -- 172.21.15.81:0/3135202411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0938037040 con 0x7f093c07de00 2024-09-12T01:19:04.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.991+0000 7f0943e7b640 1 -- 172.21.15.81:0/3135202411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f093c19e150 con 0x7f093c07de00 2024-09-12T01:19:04.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.991+0000 7f0943e7b640 1 -- 172.21.15.81:0/3135202411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f093c1a0e40 con 0x7f093c07de00 2024-09-12T01:19:04.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.991+0000 7f0932ffd640 1 -- 172.21.15.81:0/3135202411 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0938045070 con 0x7f093c07de00 2024-09-12T01:19:04.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.992+0000 7f0943e7b640 1 -- 172.21.15.81:0/3135202411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f093c07c2e0 con 0x7f093c07de00 2024-09-12T01:19:04.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.992+0000 7f0932ffd640 1 --2- 172.21.15.81:0/3135202411 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f0928038f70 0x7f092803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:04.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.992+0000 7f0932ffd640 1 -- 172.21.15.81:0/3135202411 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f093806c280 con 0x7f093c07de00 2024-09-12T01:19:04.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.992+0000 7f0941416640 1 --2- 172.21.15.81:0/3135202411 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f0928038f70 0x7f092803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.992+0000 7f0941416640 1 --2- 172.21.15.81:0/3135202411 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f0928038f70 0x7f092803b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f092c0098c0 tx=0x7f092c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:03.996+0000 7f0932ffd640 1 -- 172.21.15.81:0/3135202411 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0938045520 con 0x7f093c07de00 2024-09-12T01:19:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:04.166+0000 7f0943e7b640 1 -- 172.21.15.81:0/3135202411 --> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f093c104260 con 0x7f0928038f70 2024-09-12T01:19:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:04.166+0000 7f0932ffd640 1 -- 172.21.15.81:0/3135202411 <== mgr.14118 v2:172.21.15.81:6800/1857307616 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f093c104260 con 0x7f0928038f70 2024-09-12T01:19:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:04.168+0000 7f0943e7b640 1 -- 172.21.15.81:0/3135202411 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f0928038f70 msgr2=0x7f092803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:04.168+0000 7f0943e7b640 1 --2- 172.21.15.81:0/3135202411 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f0928038f70 0x7f092803b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f092c0098c0 tx=0x7f092c006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:04.168+0000 7f0943e7b640 1 -- 172.21.15.81:0/3135202411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 msgr2=0x7f093c19d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:04.168+0000 7f0943e7b640 1 --2- 172.21.15.81:0/3135202411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 0x7f093c19d980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0938032ce0 tx=0x7f0938032d10 comp rx=0 tx=0).stop 2024-09-12T01:19:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:04.169+0000 7f0943e7b640 1 -- 172.21.15.81:0/3135202411 shutdown_connections 2024-09-12T01:19:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:04.169+0000 7f0943e7b640 1 --2- 172.21.15.81:0/3135202411 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f0928038f70 0x7f092803b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:04.169+0000 7f0943e7b640 1 --2- 172.21.15.81:0/3135202411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c07de00 0x7f093c19d980 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:04.169+0000 7f0943e7b640 1 -- 172.21.15.81:0/3135202411 >> 172.21.15.81:0/3135202411 conn(0x7f093c102f80 msgr2=0x7f093c103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:04.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:04.169+0000 7f0943e7b640 1 -- 172.21.15.81:0/3135202411 shutdown_connections 2024-09-12T01:19:04.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:04.169+0000 7f0943e7b640 1 -- 172.21.15.81:0/3135202411 wait complete. 2024-09-12T01:19:04.725 INFO:teuthology.orchestra.run.smithi081.stdout:Generating ssh key... 2024-09-12T01:19:05.134 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:04 smithi081 ceph-mon[30920]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:05.738 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: Generating public/private rsa key pair. 2024-09-12T01:19:05.738 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: Your identification has been saved in /tmp/tmp9zsjoyrp/key 2024-09-12T01:19:05.739 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: Your public key has been saved in /tmp/tmp9zsjoyrp/key.pub 2024-09-12T01:19:05.739 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: The key fingerprint is: 2024-09-12T01:19:05.739 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: SHA256:riZOU2iMS7s8KaGD79PjPaBGDN/jK+rQ3T5Q+7JxNew ceph-c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:19:05.739 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: The key's randomart image is: 2024-09-12T01:19:05.739 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: +---[RSA 3072]----+ 2024-09-12T01:19:05.739 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: | | 2024-09-12T01:19:05.739 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: | | 2024-09-12T01:19:05.739 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: | | 2024-09-12T01:19:05.739 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: |. o .. . | 2024-09-12T01:19:05.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: | +o.+...S + | 2024-09-12T01:19:05.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: |.o+==o.. o . | 2024-09-12T01:19:05.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: |+o+=++o.o E | 2024-09-12T01:19:05.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: |*.Bo=+=+. | 2024-09-12T01:19:05.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: |oO=*+=== | 2024-09-12T01:19:05.740 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: +----[SHA256]-----+ 2024-09-12T01:19:06.010 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.135+0000 7f646ef55640 1 Processor -- start 2024-09-12T01:19:06.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.135+0000 7f646ef55640 1 -- start start 2024-09-12T01:19:06.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.135+0000 7f646ef55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 0x7f6468107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:06.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.135+0000 7f646ef55640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f64681081a0 con 0x7f64681077d0 2024-09-12T01:19:06.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.135+0000 7f646ccf1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 0x7f6468107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:06.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.135+0000 7f646ccf1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 0x7f6468107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51358/0 (socket says 172.21.15.81:51358) 2024-09-12T01:19:06.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.135+0000 7f646ccf1640 1 -- 172.21.15.81:0/241175959 learned_addr learned my addr 172.21.15.81:0/241175959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:06.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.135+0000 7f646ccf1640 1 -- 172.21.15.81:0/241175959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64681089d0 con 0x7f64681077d0 2024-09-12T01:19:06.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.136+0000 7f646ccf1640 1 --2- 172.21.15.81:0/241175959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 0x7f6468107bd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f645c009820 tx=0x7f645c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8af6a44864e9b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:06.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.136+0000 7f64677fe640 1 -- 172.21.15.81:0/241175959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c037070 con 0x7f64681077d0 2024-09-12T01:19:06.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.136+0000 7f64677fe640 1 -- 172.21.15.81:0/241175959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f645c032900 con 0x7f64681077d0 2024-09-12T01:19:06.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.136+0000 7f64677fe640 1 -- 172.21.15.81:0/241175959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c030850 con 0x7f64681077d0 2024-09-12T01:19:06.011 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.137+0000 7f646ef55640 1 -- 172.21.15.81:0/241175959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 msgr2=0x7f6468107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.137+0000 7f646ef55640 1 --2- 172.21.15.81:0/241175959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 0x7f6468107bd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f645c009820 tx=0x7f645c02a270 comp rx=0 tx=0).stop 2024-09-12T01:19:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.137+0000 7f646ef55640 1 -- 172.21.15.81:0/241175959 shutdown_connections 2024-09-12T01:19:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.137+0000 7f646ef55640 1 --2- 172.21.15.81:0/241175959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 0x7f6468107bd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.137+0000 7f646ef55640 1 -- 172.21.15.81:0/241175959 >> 172.21.15.81:0/241175959 conn(0x7f6468102f60 msgr2=0x7f64681053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.137+0000 7f646ef55640 1 -- 172.21.15.81:0/241175959 shutdown_connections 2024-09-12T01:19:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.137+0000 7f646ef55640 1 -- 172.21.15.81:0/241175959 wait complete. 2024-09-12T01:19:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.138+0000 7f646ef55640 1 Processor -- start 2024-09-12T01:19:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.138+0000 7f646ef55640 1 -- start start 2024-09-12T01:19:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.138+0000 7f646ef55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 0x7f646819b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.138+0000 7f646ef55640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f646810bd80 con 0x7f64681077d0 2024-09-12T01:19:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.138+0000 7f646ccf1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 0x7f646819b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.138+0000 7f646ccf1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 0x7f646819b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51372/0 (socket says 172.21.15.81:51372) 2024-09-12T01:19:06.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.138+0000 7f646ccf1640 1 -- 172.21.15.81:0/2035641137 learned_addr learned my addr 172.21.15.81:0/2035641137 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:06.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.138+0000 7f646ccf1640 1 -- 172.21.15.81:0/2035641137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646819bcd0 con 0x7f64681077d0 2024-09-12T01:19:06.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.138+0000 7f646ccf1640 1 --2- 172.21.15.81:0/2035641137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 0x7f646819b790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f645c009940 tx=0x7f645c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:06.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.138+0000 7f6465ffb640 1 -- 172.21.15.81:0/2035641137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c042070 con 0x7f64681077d0 2024-09-12T01:19:06.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.138+0000 7f6465ffb640 1 -- 172.21.15.81:0/2035641137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f645c0308c0 con 0x7f64681077d0 2024-09-12T01:19:06.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.138+0000 7f6465ffb640 1 -- 172.21.15.81:0/2035641137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c037040 con 0x7f64681077d0 2024-09-12T01:19:06.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.138+0000 7f646ef55640 1 -- 172.21.15.81:0/2035641137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f646819bf60 con 0x7f64681077d0 2024-09-12T01:19:06.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.139+0000 7f646ef55640 1 -- 172.21.15.81:0/2035641137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f646819ec50 con 0x7f64681077d0 2024-09-12T01:19:06.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.139+0000 7f6465ffb640 1 -- 172.21.15.81:0/2035641137 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f645c045070 con 0x7f64681077d0 2024-09-12T01:19:06.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.140+0000 7f6465ffb640 1 --2- 172.21.15.81:0/2035641137 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f6458038fc0 0x7f645803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:06.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.140+0000 7f646ef55640 1 -- 172.21.15.81:0/2035641137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6468107c50 con 0x7f64681077d0 2024-09-12T01:19:06.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.140+0000 7f6465ffb640 1 -- 172.21.15.81:0/2035641137 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f645c06bfd0 con 0x7f64681077d0 2024-09-12T01:19:06.013 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.140+0000 7f6467fff640 1 --2- 172.21.15.81:0/2035641137 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f6458038fc0 0x7f645803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:06.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.140+0000 7f6467fff640 1 --2- 172.21.15.81:0/2035641137 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f6458038fc0 0x7f645803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f64540098c0 tx=0x7f6454006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:06.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.145+0000 7f6465ffb640 1 -- 172.21.15.81:0/2035641137 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f645c04b170 con 0x7f64681077d0 2024-09-12T01:19:06.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.310+0000 7f646ef55640 1 -- 172.21.15.81:0/2035641137 --> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f6468104230 con 0x7f6458038fc0 2024-09-12T01:19:06.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.494+0000 7f6465ffb640 1 -- 172.21.15.81:0/2035641137 <== mgr.14118 v2:172.21.15.81:6800/1857307616 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6468104230 con 0x7f6458038fc0 2024-09-12T01:19:06.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.496+0000 7f646ef55640 1 -- 172.21.15.81:0/2035641137 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f6458038fc0 msgr2=0x7f645803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:06.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.496+0000 7f646ef55640 1 --2- 172.21.15.81:0/2035641137 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f6458038fc0 0x7f645803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f64540098c0 tx=0x7f6454006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:06.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.496+0000 7f646ef55640 1 -- 172.21.15.81:0/2035641137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 msgr2=0x7f646819b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:06.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.496+0000 7f646ef55640 1 --2- 172.21.15.81:0/2035641137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 0x7f646819b790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f645c009940 tx=0x7f645c032ce0 comp rx=0 tx=0).stop 2024-09-12T01:19:06.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.496+0000 7f646ef55640 1 -- 172.21.15.81:0/2035641137 shutdown_connections 2024-09-12T01:19:06.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.496+0000 7f646ef55640 1 --2- 172.21.15.81:0/2035641137 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f6458038fc0 0x7f645803b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:06.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.496+0000 7f646ef55640 1 --2- 172.21.15.81:0/2035641137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64681077d0 0x7f646819b790 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:06.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.496+0000 7f646ef55640 1 -- 172.21.15.81:0/2035641137 >> 172.21.15.81:0/2035641137 conn(0x7f6468102f60 msgr2=0x7f6468103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:06.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.496+0000 7f646ef55640 1 -- 172.21.15.81:0/2035641137 shutdown_connections 2024-09-12T01:19:06.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:05.496+0000 7f646ef55640 1 -- 172.21.15.81:0/2035641137 wait complete. 2024-09-12T01:19:06.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:06 smithi081 ceph-mon[30920]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:06.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:06 smithi081 ceph-mon[30920]: Generating ssh key... 2024-09-12T01:19:06.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:06 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:06.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:06 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:07.150 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqFwz/ACwFlc9WMPva8dQUSBme35kSQAXLa/KXyj0tEnrTPtn+iLJhVoCj7ESaNUTGaEBq0Ir6PJl/GKLdqy1zgEC+nK/rRzmxgeSf1KToutGVDmvz7oD+i2J0LTQnLlBR/f7y/RcNHqj8RBa2hReQTuiOa7V2QZdmuHPoNsiFayuvLCLotJlcVgNAhLyQeYIQlY9A9CPgSfXUp5nOQnzG0kJzjuLlMNkey2KqjlcKJ9GByhCgs8gGPSH58yj8tyE8S6wxd0+a6z2ueNz0++EK8A7uwi0kP8dDHN21uxZOlU6fH/TpBRfy/X0jbIAiLH3skAT1x1kYRubt6uQs1cUtiEnh7yQLMiK7/itVtvZqKo4qkrcjUMHtUNx5C6C9MwAkeH1XG7BkmnaVG/aL1U4H8QQlCohG2bRe/GPjrTdC1NVb8bnaddHv7Lww/C0U/nKzMHdB3kqOstuisfDQ0rJiZmGOujn8BsM6gPOnWjKnGeOJpFqNXkXRfre1rh787ts= ceph-c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:19:07.151 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.405+0000 7ff91e102640 1 Processor -- start 2024-09-12T01:19:07.151 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.406+0000 7ff91e102640 1 -- start start 2024-09-12T01:19:07.151 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.406+0000 7ff91e102640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 0x7ff91807c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:07.151 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.406+0000 7ff91e102640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff91807c870 con 0x7ff91807de40 2024-09-12T01:19:07.151 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.406+0000 7ff9177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 0x7ff91807c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:07.151 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.406+0000 7ff9177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 0x7ff91807c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51376/0 (socket says 172.21.15.81:51376) 2024-09-12T01:19:07.151 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.406+0000 7ff9177fe640 1 -- 172.21.15.81:0/681210450 learned_addr learned my addr 172.21.15.81:0/681210450 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:07.152 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.406+0000 7ff9177fe640 1 -- 172.21.15.81:0/681210450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91807c9f0 con 0x7ff91807de40 2024-09-12T01:19:07.152 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.407+0000 7ff9177fe640 1 --2- 172.21.15.81:0/681210450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 0x7ff91807c2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff908009820 tx=0x7ff90802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2633c40a8848b505 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:07.152 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.407+0000 7ff916ffd640 1 -- 172.21.15.81:0/681210450 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff908037070 con 0x7ff91807de40 2024-09-12T01:19:07.152 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.407+0000 7ff916ffd640 1 -- 172.21.15.81:0/681210450 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff908032900 con 0x7ff91807de40 2024-09-12T01:19:07.152 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.407+0000 7ff916ffd640 1 -- 172.21.15.81:0/681210450 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff908030850 con 0x7ff91807de40 2024-09-12T01:19:07.152 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.408+0000 7ff91e102640 1 -- 172.21.15.81:0/681210450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 msgr2=0x7ff91807c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:07.152 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.408+0000 7ff91e102640 1 --2- 172.21.15.81:0/681210450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 0x7ff91807c2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff908009820 tx=0x7ff90802a270 comp rx=0 tx=0).stop 2024-09-12T01:19:07.152 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.408+0000 7ff91e102640 1 -- 172.21.15.81:0/681210450 shutdown_connections 2024-09-12T01:19:07.152 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.408+0000 7ff91e102640 1 --2- 172.21.15.81:0/681210450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 0x7ff91807c2a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:07.152 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.408+0000 7ff91e102640 1 -- 172.21.15.81:0/681210450 >> 172.21.15.81:0/681210450 conn(0x7ff918102f60 msgr2=0x7ff9181053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:07.152 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.408+0000 7ff91e102640 1 -- 172.21.15.81:0/681210450 shutdown_connections 2024-09-12T01:19:07.152 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.408+0000 7ff91e102640 1 -- 172.21.15.81:0/681210450 wait complete. 2024-09-12T01:19:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.408+0000 7ff91e102640 1 Processor -- start 2024-09-12T01:19:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.408+0000 7ff91e102640 1 -- start start 2024-09-12T01:19:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.409+0000 7ff91e102640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 0x7ff91819d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.409+0000 7ff91e102640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff91810ddc0 con 0x7ff91807de40 2024-09-12T01:19:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.409+0000 7ff9177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 0x7ff91819d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.409+0000 7ff9177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 0x7ff91819d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51378/0 (socket says 172.21.15.81:51378) 2024-09-12T01:19:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.409+0000 7ff9177fe640 1 -- 172.21.15.81:0/461984421 learned_addr learned my addr 172.21.15.81:0/461984421 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.409+0000 7ff9177fe640 1 -- 172.21.15.81:0/461984421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91819ded0 con 0x7ff91807de40 2024-09-12T01:19:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.409+0000 7ff9177fe640 1 --2- 172.21.15.81:0/461984421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 0x7ff91819d990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff908009940 tx=0x7ff908032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.409+0000 7ff9157fa640 1 -- 172.21.15.81:0/461984421 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff908042070 con 0x7ff91807de40 2024-09-12T01:19:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.409+0000 7ff9157fa640 1 -- 172.21.15.81:0/461984421 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9080308c0 con 0x7ff91807de40 2024-09-12T01:19:07.153 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.409+0000 7ff91e102640 1 -- 172.21.15.81:0/461984421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91819e160 con 0x7ff91807de40 2024-09-12T01:19:07.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.409+0000 7ff9157fa640 1 -- 172.21.15.81:0/461984421 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff908037040 con 0x7ff91807de40 2024-09-12T01:19:07.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.409+0000 7ff91e102640 1 -- 172.21.15.81:0/461984421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9181a0e50 con 0x7ff91807de40 2024-09-12T01:19:07.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.410+0000 7ff9157fa640 1 -- 172.21.15.81:0/461984421 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff908045070 con 0x7ff91807de40 2024-09-12T01:19:07.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.410+0000 7ff91e102640 1 -- 172.21.15.81:0/461984421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff91807c320 con 0x7ff91807de40 2024-09-12T01:19:07.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.410+0000 7ff9157fa640 1 --2- 172.21.15.81:0/461984421 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7ff904038fc0 0x7ff90403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:07.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.410+0000 7ff9157fa640 1 -- 172.21.15.81:0/461984421 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff90806c130 con 0x7ff91807de40 2024-09-12T01:19:07.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.410+0000 7ff90effd640 1 --2- 172.21.15.81:0/461984421 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7ff904038fc0 0x7ff90403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:07.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.411+0000 7ff90effd640 1 --2- 172.21.15.81:0/461984421 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7ff904038fc0 0x7ff90403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9000098c0 tx=0x7ff900006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:07.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.417+0000 7ff9157fa640 1 -- 172.21.15.81:0/461984421 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff90803c760 con 0x7ff91807de40 2024-09-12T01:19:07.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.583+0000 7ff91e102640 1 -- 172.21.15.81:0/461984421 --> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7ff918104210 con 0x7ff904038fc0 2024-09-12T01:19:07.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.584+0000 7ff9157fa640 1 -- 172.21.15.81:0/461984421 <== mgr.14118 v2:172.21.15.81:6800/1857307616 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7ff918104210 con 0x7ff904038fc0 2024-09-12T01:19:07.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.585+0000 7ff91e102640 1 -- 172.21.15.81:0/461984421 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7ff904038fc0 msgr2=0x7ff90403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:07.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.585+0000 7ff91e102640 1 --2- 172.21.15.81:0/461984421 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7ff904038fc0 0x7ff90403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9000098c0 tx=0x7ff900006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:07.155 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.585+0000 7ff91e102640 1 -- 172.21.15.81:0/461984421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 msgr2=0x7ff91819d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:07.155 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.585+0000 7ff91e102640 1 --2- 172.21.15.81:0/461984421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 0x7ff91819d990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff908009940 tx=0x7ff908032ce0 comp rx=0 tx=0).stop 2024-09-12T01:19:07.155 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.586+0000 7ff91e102640 1 -- 172.21.15.81:0/461984421 shutdown_connections 2024-09-12T01:19:07.155 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.586+0000 7ff91e102640 1 --2- 172.21.15.81:0/461984421 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7ff904038fc0 0x7ff90403b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:07.155 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.586+0000 7ff91e102640 1 --2- 172.21.15.81:0/461984421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff91807de40 0x7ff91819d990 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:07.155 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.586+0000 7ff91e102640 1 -- 172.21.15.81:0/461984421 >> 172.21.15.81:0/461984421 conn(0x7ff918102f60 msgr2=0x7ff918103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:07.155 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.586+0000 7ff91e102640 1 -- 172.21.15.81:0/461984421 shutdown_connections 2024-09-12T01:19:07.155 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:06.586+0000 7ff91e102640 1 -- 172.21.15.81:0/461984421 wait complete. 2024-09-12T01:19:07.155 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:19:07.155 INFO:teuthology.orchestra.run.smithi081.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T01:19:07.156 INFO:teuthology.orchestra.run.smithi081.stdout:Adding host smithi081... 2024-09-12T01:19:07.734 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:07 smithi081 ceph-mon[30920]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:08.513 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:08 smithi081 ceph-mon[30920]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "addr": "172.21.15.81", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:09.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:09 smithi081 ceph-mon[30920]: Deploying cephadm binary to smithi081 2024-09-12T01:19:11.459 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Added host 'smithi081' with addr '172.21.15.81' 2024-09-12T01:19:11.459 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.557+0000 7faf5f8c2640 1 Processor -- start 2024-09-12T01:19:11.459 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.557+0000 7faf5f8c2640 1 -- start start 2024-09-12T01:19:11.459 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.557+0000 7faf5f8c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 0x7faf58107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:11.459 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.557+0000 7faf5f8c2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faf581081a0 con 0x7faf581077d0 2024-09-12T01:19:11.459 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.557+0000 7faf5d65e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 0x7faf58107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:11.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.557+0000 7faf5d65e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 0x7faf58107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51380/0 (socket says 172.21.15.81:51380) 2024-09-12T01:19:11.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.557+0000 7faf5d65e640 1 -- 172.21.15.81:0/2096785659 learned_addr learned my addr 172.21.15.81:0/2096785659 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:11.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.557+0000 7faf5d65e640 1 -- 172.21.15.81:0/2096785659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf581089d0 con 0x7faf581077d0 2024-09-12T01:19:11.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.558+0000 7faf5d65e640 1 --2- 172.21.15.81:0/2096785659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 0x7faf58107bd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009820 tx=0x7faf4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bd4473dabe2dea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:11.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.558+0000 7faf4bfff640 1 -- 172.21.15.81:0/2096785659 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c037070 con 0x7faf581077d0 2024-09-12T01:19:11.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.558+0000 7faf4bfff640 1 -- 172.21.15.81:0/2096785659 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf4c032900 con 0x7faf581077d0 2024-09-12T01:19:11.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.558+0000 7faf4bfff640 1 -- 172.21.15.81:0/2096785659 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c030850 con 0x7faf581077d0 2024-09-12T01:19:11.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.559+0000 7faf5f8c2640 1 -- 172.21.15.81:0/2096785659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 msgr2=0x7faf58107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:11.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.559+0000 7faf5f8c2640 1 --2- 172.21.15.81:0/2096785659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 0x7faf58107bd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009820 tx=0x7faf4c02a270 comp rx=0 tx=0).stop 2024-09-12T01:19:11.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.559+0000 7faf5f8c2640 1 -- 172.21.15.81:0/2096785659 shutdown_connections 2024-09-12T01:19:11.460 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.559+0000 7faf5f8c2640 1 --2- 172.21.15.81:0/2096785659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 0x7faf58107bd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:11.461 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.559+0000 7faf5f8c2640 1 -- 172.21.15.81:0/2096785659 >> 172.21.15.81:0/2096785659 conn(0x7faf58102f60 msgr2=0x7faf581053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:11.461 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.559+0000 7faf5f8c2640 1 -- 172.21.15.81:0/2096785659 shutdown_connections 2024-09-12T01:19:11.461 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.559+0000 7faf5f8c2640 1 -- 172.21.15.81:0/2096785659 wait complete. 2024-09-12T01:19:11.461 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.559+0000 7faf5f8c2640 1 Processor -- start 2024-09-12T01:19:11.461 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.559+0000 7faf5f8c2640 1 -- start start 2024-09-12T01:19:11.461 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.560+0000 7faf5f8c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 0x7faf5807daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:11.461 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.560+0000 7faf5f8c2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faf5810bd80 con 0x7faf581077d0 2024-09-12T01:19:11.461 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.560+0000 7faf5d65e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 0x7faf5807daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:11.461 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.560+0000 7faf5d65e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 0x7faf5807daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51388/0 (socket says 172.21.15.81:51388) 2024-09-12T01:19:11.461 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.560+0000 7faf5d65e640 1 -- 172.21.15.81:0/329387091 learned_addr learned my addr 172.21.15.81:0/329387091 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:11.461 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.560+0000 7faf5d65e640 1 -- 172.21.15.81:0/329387091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5807e030 con 0x7faf581077d0 2024-09-12T01:19:11.461 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.560+0000 7faf5d65e640 1 --2- 172.21.15.81:0/329387091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 0x7faf5807daf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009940 tx=0x7faf4c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:11.462 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.560+0000 7faf4a7fc640 1 -- 172.21.15.81:0/329387091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c042070 con 0x7faf581077d0 2024-09-12T01:19:11.462 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.560+0000 7faf4a7fc640 1 -- 172.21.15.81:0/329387091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf4c0308c0 con 0x7faf581077d0 2024-09-12T01:19:11.462 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.560+0000 7faf5f8c2640 1 -- 172.21.15.81:0/329387091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5807c220 con 0x7faf581077d0 2024-09-12T01:19:11.462 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.560+0000 7faf4a7fc640 1 -- 172.21.15.81:0/329387091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4c037040 con 0x7faf581077d0 2024-09-12T01:19:11.462 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.560+0000 7faf5f8c2640 1 -- 172.21.15.81:0/329387091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5807c760 con 0x7faf581077d0 2024-09-12T01:19:11.462 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.561+0000 7faf4a7fc640 1 -- 172.21.15.81:0/329387091 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7faf4c045070 con 0x7faf581077d0 2024-09-12T01:19:11.462 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.561+0000 7faf4a7fc640 1 --2- 172.21.15.81:0/329387091 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7faf44038f70 0x7faf4403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:11.462 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.561+0000 7faf4a7fc640 1 -- 172.21.15.81:0/329387091 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faf4c06c080 con 0x7faf581077d0 2024-09-12T01:19:11.463 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.561+0000 7faf5ce5d640 1 --2- 172.21.15.81:0/329387091 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7faf44038f70 0x7faf4403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:11.463 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.561+0000 7faf5f8c2640 1 -- 172.21.15.81:0/329387091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf58107c50 con 0x7faf581077d0 2024-09-12T01:19:11.463 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.562+0000 7faf5ce5d640 1 --2- 172.21.15.81:0/329387091 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7faf44038f70 0x7faf4403b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faf540098c0 tx=0x7faf54006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:11.463 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.566+0000 7faf4a7fc640 1 -- 172.21.15.81:0/329387091 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf4c03cd90 con 0x7faf581077d0 2024-09-12T01:19:11.463 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:07.734+0000 7faf5f8c2640 1 -- 172.21.15.81:0/329387091 --> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi081", "addr": "172.21.15.81", "target": ["mon-mgr", ""]}) -- 0x7faf5807ced0 con 0x7faf44038f70 2024-09-12T01:19:11.463 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:10.884+0000 7faf4a7fc640 1 -- 172.21.15.81:0/329387091 <== mgr.14118 v2:172.21.15.81:6800/1857307616 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7faf5807ced0 con 0x7faf44038f70 2024-09-12T01:19:11.463 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:10.888+0000 7faf5f8c2640 1 -- 172.21.15.81:0/329387091 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7faf44038f70 msgr2=0x7faf4403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:11.463 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:10.888+0000 7faf5f8c2640 1 --2- 172.21.15.81:0/329387091 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7faf44038f70 0x7faf4403b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faf540098c0 tx=0x7faf54006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:11.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:10.888+0000 7faf5f8c2640 1 -- 172.21.15.81:0/329387091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 msgr2=0x7faf5807daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:11.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:10.888+0000 7faf5f8c2640 1 --2- 172.21.15.81:0/329387091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 0x7faf5807daf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009940 tx=0x7faf4c032ce0 comp rx=0 tx=0).stop 2024-09-12T01:19:11.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:10.888+0000 7faf5f8c2640 1 -- 172.21.15.81:0/329387091 shutdown_connections 2024-09-12T01:19:11.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:10.888+0000 7faf5f8c2640 1 --2- 172.21.15.81:0/329387091 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7faf44038f70 0x7faf4403b430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:11.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:10.888+0000 7faf5f8c2640 1 --2- 172.21.15.81:0/329387091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf581077d0 0x7faf5807daf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:11.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:10.888+0000 7faf5f8c2640 1 -- 172.21.15.81:0/329387091 >> 172.21.15.81:0/329387091 conn(0x7faf58102f60 msgr2=0x7faf58103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:11.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:10.888+0000 7faf5f8c2640 1 -- 172.21.15.81:0/329387091 shutdown_connections 2024-09-12T01:19:11.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:10.888+0000 7faf5f8c2640 1 -- 172.21.15.81:0/329387091 wait complete. 2024-09-12T01:19:11.464 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying unmanaged mon service... 2024-09-12T01:19:12.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:11 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:12.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:11 smithi081 ceph-mon[30920]: Added host smithi081 2024-09-12T01:19:12.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:11 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:19:12.877 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T01:19:12.877 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.841+0000 7f26c5c49640 1 Processor -- start 2024-09-12T01:19:12.877 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.841+0000 7f26c5c49640 1 -- start start 2024-09-12T01:19:12.877 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.841+0000 7f26c5c49640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 0x7f26c0106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:12.877 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.841+0000 7f26c5c49640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f26c01070a0 con 0x7f26c01066d0 2024-09-12T01:19:12.877 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.842+0000 7f26bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 0x7f26c0106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:12.877 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.842+0000 7f26bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 0x7f26c0106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51398/0 (socket says 172.21.15.81:51398) 2024-09-12T01:19:12.878 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.842+0000 7f26bf7fe640 1 -- 172.21.15.81:0/3661279244 learned_addr learned my addr 172.21.15.81:0/3661279244 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:12.878 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.842+0000 7f26bf7fe640 1 -- 172.21.15.81:0/3661279244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c01078d0 con 0x7f26c01066d0 2024-09-12T01:19:12.878 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.843+0000 7f26bf7fe640 1 --2- 172.21.15.81:0/3661279244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 0x7f26c0106ad0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009820 tx=0x7f26b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e450647e22ad42c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:12.878 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.843+0000 7f26be7fc640 1 -- 172.21.15.81:0/3661279244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26b0037070 con 0x7f26c01066d0 2024-09-12T01:19:12.878 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.843+0000 7f26be7fc640 1 -- 172.21.15.81:0/3661279244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f26b0032900 con 0x7f26c01066d0 2024-09-12T01:19:12.878 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.843+0000 7f26be7fc640 1 -- 172.21.15.81:0/3661279244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26b0030850 con 0x7f26c01066d0 2024-09-12T01:19:12.878 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.844+0000 7f26c5c49640 1 -- 172.21.15.81:0/3661279244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 msgr2=0x7f26c0106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:12.878 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.844+0000 7f26c5c49640 1 --2- 172.21.15.81:0/3661279244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 0x7f26c0106ad0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009820 tx=0x7f26b002a270 comp rx=0 tx=0).stop 2024-09-12T01:19:12.878 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.844+0000 7f26c5c49640 1 -- 172.21.15.81:0/3661279244 shutdown_connections 2024-09-12T01:19:12.878 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.844+0000 7f26c5c49640 1 --2- 172.21.15.81:0/3661279244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 0x7f26c0106ad0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:12.878 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.844+0000 7f26c5c49640 1 -- 172.21.15.81:0/3661279244 >> 172.21.15.81:0/3661279244 conn(0x7f26c0101e60 msgr2=0x7f26c01042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:12.878 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.844+0000 7f26c5c49640 1 -- 172.21.15.81:0/3661279244 shutdown_connections 2024-09-12T01:19:12.879 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.844+0000 7f26c5c49640 1 -- 172.21.15.81:0/3661279244 wait complete. 2024-09-12T01:19:12.879 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.844+0000 7f26c5c49640 1 Processor -- start 2024-09-12T01:19:12.879 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.844+0000 7f26c5c49640 1 -- start start 2024-09-12T01:19:12.879 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.845+0000 7f26c5c49640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 0x7f26c01995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:12.879 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.845+0000 7f26c5c49640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f26c007af50 con 0x7f26c01066d0 2024-09-12T01:19:12.879 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.845+0000 7f26bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 0x7f26c01995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:12.879 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.845+0000 7f26bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 0x7f26c01995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51400/0 (socket says 172.21.15.81:51400) 2024-09-12T01:19:12.879 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.845+0000 7f26bf7fe640 1 -- 172.21.15.81:0/3923857627 learned_addr learned my addr 172.21.15.81:0/3923857627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:12.879 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.845+0000 7f26bf7fe640 1 -- 172.21.15.81:0/3923857627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c0199af0 con 0x7f26c01066d0 2024-09-12T01:19:12.879 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.845+0000 7f26bf7fe640 1 --2- 172.21.15.81:0/3923857627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 0x7f26c01995b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f26b00097f0 tx=0x7f26b0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:12.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.845+0000 7f26bcff9640 1 -- 172.21.15.81:0/3923857627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26b0037040 con 0x7f26c01066d0 2024-09-12T01:19:12.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.845+0000 7f26c5c49640 1 -- 172.21.15.81:0/3923857627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c0199d80 con 0x7f26c01066d0 2024-09-12T01:19:12.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.845+0000 7f26bcff9640 1 -- 172.21.15.81:0/3923857627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f26b0040070 con 0x7f26c01066d0 2024-09-12T01:19:12.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.846+0000 7f26c5c49640 1 -- 172.21.15.81:0/3923857627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c019ca70 con 0x7f26c01066d0 2024-09-12T01:19:12.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.846+0000 7f26bcff9640 1 -- 172.21.15.81:0/3923857627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26b003a390 con 0x7f26c01066d0 2024-09-12T01:19:12.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.846+0000 7f26bcff9640 1 -- 172.21.15.81:0/3923857627 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f26b003a670 con 0x7f26c01066d0 2024-09-12T01:19:12.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.847+0000 7f26bcff9640 1 --2- 172.21.15.81:0/3923857627 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f26a803ae20 0x7f26a803d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:12.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.847+0000 7f26bcff9640 1 -- 172.21.15.81:0/3923857627 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f26b0072060 con 0x7f26c01066d0 2024-09-12T01:19:12.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.847+0000 7f26beffd640 1 --2- 172.21.15.81:0/3923857627 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f26a803ae20 0x7f26a803d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:12.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.847+0000 7f26beffd640 1 --2- 172.21.15.81:0/3923857627 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f26a803ae20 0x7f26a803d2e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f26b40098c0 tx=0x7f26b4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:12.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.847+0000 7f26c5c49640 1 -- 172.21.15.81:0/3923857627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c0106b50 con 0x7f26c01066d0 2024-09-12T01:19:12.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:11.852+0000 7f26bcff9640 1 -- 172.21.15.81:0/3923857627 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26b00313a0 con 0x7f26c01066d0 2024-09-12T01:19:12.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:12.049+0000 7f26c5c49640 1 -- 172.21.15.81:0/3923857627 --> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f26c0074c70 con 0x7f26a803ae20 2024-09-12T01:19:12.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:12.054+0000 7f26bcff9640 1 -- 172.21.15.81:0/3923857627 <== mgr.14118 v2:172.21.15.81:6800/1857307616 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f26c0074c70 con 0x7f26a803ae20 2024-09-12T01:19:12.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:12.056+0000 7f26c5c49640 1 -- 172.21.15.81:0/3923857627 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f26a803ae20 msgr2=0x7f26a803d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:12.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:12.056+0000 7f26c5c49640 1 --2- 172.21.15.81:0/3923857627 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f26a803ae20 0x7f26a803d2e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f26b40098c0 tx=0x7f26b4006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:12.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:12.056+0000 7f26c5c49640 1 -- 172.21.15.81:0/3923857627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 msgr2=0x7f26c01995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:12.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:12.056+0000 7f26c5c49640 1 --2- 172.21.15.81:0/3923857627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 0x7f26c01995b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f26b00097f0 tx=0x7f26b0030d80 comp rx=0 tx=0).stop 2024-09-12T01:19:12.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:12.056+0000 7f26c5c49640 1 -- 172.21.15.81:0/3923857627 shutdown_connections 2024-09-12T01:19:12.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:12.056+0000 7f26c5c49640 1 --2- 172.21.15.81:0/3923857627 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f26a803ae20 0x7f26a803d2e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:12.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:12.056+0000 7f26c5c49640 1 --2- 172.21.15.81:0/3923857627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26c01066d0 0x7f26c01995b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:12.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:12.056+0000 7f26c5c49640 1 -- 172.21.15.81:0/3923857627 >> 172.21.15.81:0/3923857627 conn(0x7f26c0101e60 msgr2=0x7f26c018fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:12.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:12.056+0000 7f26c5c49640 1 -- 172.21.15.81:0/3923857627 shutdown_connections 2024-09-12T01:19:12.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:12.056+0000 7f26c5c49640 1 -- 172.21.15.81:0/3923857627 wait complete. 2024-09-12T01:19:12.882 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying unmanaged mgr service... 2024-09-12T01:19:13.213 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:13 smithi081 ceph-mon[30920]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:13.213 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:13 smithi081 ceph-mon[30920]: Saving service mon spec with placement count:5 2024-09-12T01:19:13.213 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:13 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:14.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:14 smithi081 ceph-mon[30920]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:14.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:14 smithi081 ceph-mon[30920]: Saving service mgr spec with placement count:2 2024-09-12T01:19:14.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:14 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T01:19:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.296+0000 7f701a1bc640 1 Processor -- start 2024-09-12T01:19:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.296+0000 7f701a1bc640 1 -- start start 2024-09-12T01:19:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.297+0000 7f701a1bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 0x7f701410a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.297+0000 7f701a1bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f701407bd90 con 0x7f70141082e0 2024-09-12T01:19:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.297+0000 7f70137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 0x7f701410a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.297+0000 7f70137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 0x7f701410a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57220/0 (socket says 172.21.15.81:57220) 2024-09-12T01:19:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.297+0000 7f70137fe640 1 -- 172.21.15.81:0/3886942771 learned_addr learned my addr 172.21.15.81:0/3886942771 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.297+0000 7f70137fe640 1 -- 172.21.15.81:0/3886942771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701410ac10 con 0x7f70141082e0 2024-09-12T01:19:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.298+0000 7f70137fe640 1 --2- 172.21.15.81:0/3886942771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 0x7f701410a6d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7004009820 tx=0x7f700402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4da12ee5ec5868 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.298+0000 7f70127fc640 1 -- 172.21.15.81:0/3886942771 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7004037070 con 0x7f70141082e0 2024-09-12T01:19:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.298+0000 7f70127fc640 1 -- 172.21.15.81:0/3886942771 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7004032900 con 0x7f70141082e0 2024-09-12T01:19:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.298+0000 7f70127fc640 1 -- 172.21.15.81:0/3886942771 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7004030850 con 0x7f70141082e0 2024-09-12T01:19:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.298+0000 7f701a1bc640 1 -- 172.21.15.81:0/3886942771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 msgr2=0x7f701410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.298+0000 7f701a1bc640 1 --2- 172.21.15.81:0/3886942771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 0x7f701410a6d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7004009820 tx=0x7f700402a270 comp rx=0 tx=0).stop 2024-09-12T01:19:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.299+0000 7f701a1bc640 1 -- 172.21.15.81:0/3886942771 shutdown_connections 2024-09-12T01:19:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.299+0000 7f701a1bc640 1 --2- 172.21.15.81:0/3886942771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 0x7f701410a6d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.299+0000 7f701a1bc640 1 -- 172.21.15.81:0/3886942771 >> 172.21.15.81:0/3886942771 conn(0x7f7014101e60 msgr2=0x7f70141042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.299+0000 7f701a1bc640 1 -- 172.21.15.81:0/3886942771 shutdown_connections 2024-09-12T01:19:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.299+0000 7f701a1bc640 1 -- 172.21.15.81:0/3886942771 wait complete. 2024-09-12T01:19:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.299+0000 7f701a1bc640 1 Processor -- start 2024-09-12T01:19:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.299+0000 7f701a1bc640 1 -- start start 2024-09-12T01:19:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.299+0000 7f701a1bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 0x7f701419b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.299+0000 7f701a1bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f701410bb80 con 0x7f70141082e0 2024-09-12T01:19:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.300+0000 7f70137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 0x7f701419b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.300+0000 7f70137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 0x7f701419b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57228/0 (socket says 172.21.15.81:57228) 2024-09-12T01:19:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.300+0000 7f70137fe640 1 -- 172.21.15.81:0/3748271864 learned_addr learned my addr 172.21.15.81:0/3748271864 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.300+0000 7f70137fe640 1 -- 172.21.15.81:0/3748271864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701419bce0 con 0x7f70141082e0 2024-09-12T01:19:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.300+0000 7f70137fe640 1 --2- 172.21.15.81:0/3748271864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 0x7f701419b7a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7004032ce0 tx=0x7f7004032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.300+0000 7f7010ff9640 1 -- 172.21.15.81:0/3748271864 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7004042070 con 0x7f70141082e0 2024-09-12T01:19:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.300+0000 7f7010ff9640 1 -- 172.21.15.81:0/3748271864 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f70040308c0 con 0x7f70141082e0 2024-09-12T01:19:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.300+0000 7f7010ff9640 1 -- 172.21.15.81:0/3748271864 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7004037040 con 0x7f70141082e0 2024-09-12T01:19:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.300+0000 7f701a1bc640 1 -- 172.21.15.81:0/3748271864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f701419bf70 con 0x7f70141082e0 2024-09-12T01:19:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.300+0000 7f701a1bc640 1 -- 172.21.15.81:0/3748271864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f701419ec60 con 0x7f70141082e0 2024-09-12T01:19:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.301+0000 7f7010ff9640 1 -- 172.21.15.81:0/3748271864 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7004045070 con 0x7f70141082e0 2024-09-12T01:19:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.301+0000 7f7010ff9640 1 --2- 172.21.15.81:0/3748271864 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f6ffc038fc0 0x7f6ffc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.301+0000 7f701a1bc640 1 -- 172.21.15.81:0/3748271864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7014108740 con 0x7f70141082e0 2024-09-12T01:19:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.301+0000 7f7010ff9640 1 -- 172.21.15.81:0/3748271864 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f700406c010 con 0x7f70141082e0 2024-09-12T01:19:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.301+0000 7f7012ffd640 1 --2- 172.21.15.81:0/3748271864 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f6ffc038fc0 0x7f6ffc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.302+0000 7f7012ffd640 1 --2- 172.21.15.81:0/3748271864 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f6ffc038fc0 0x7f6ffc03b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f70080098c0 tx=0x7f7008006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.306+0000 7f7010ff9640 1 -- 172.21.15.81:0/3748271864 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7004037dc0 con 0x7f70141082e0 2024-09-12T01:19:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.491+0000 7f701a1bc640 1 -- 172.21.15.81:0/3748271864 --> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f70141031c0 con 0x7f6ffc038fc0 2024-09-12T01:19:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.495+0000 7f7010ff9640 1 -- 172.21.15.81:0/3748271864 <== mgr.14118 v2:172.21.15.81:6800/1857307616 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f70141031c0 con 0x7f6ffc038fc0 2024-09-12T01:19:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.497+0000 7f701a1bc640 1 -- 172.21.15.81:0/3748271864 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f6ffc038fc0 msgr2=0x7f6ffc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.497+0000 7f701a1bc640 1 --2- 172.21.15.81:0/3748271864 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f6ffc038fc0 0x7f6ffc03b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f70080098c0 tx=0x7f7008006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.497+0000 7f701a1bc640 1 -- 172.21.15.81:0/3748271864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 msgr2=0x7f701419b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.497+0000 7f701a1bc640 1 --2- 172.21.15.81:0/3748271864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 0x7f701419b7a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7004032ce0 tx=0x7f7004032d10 comp rx=0 tx=0).stop 2024-09-12T01:19:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.498+0000 7f701a1bc640 1 -- 172.21.15.81:0/3748271864 shutdown_connections 2024-09-12T01:19:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.498+0000 7f701a1bc640 1 --2- 172.21.15.81:0/3748271864 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f6ffc038fc0 0x7f6ffc03b480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.498+0000 7f701a1bc640 1 --2- 172.21.15.81:0/3748271864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70141082e0 0x7f701419b7a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.498+0000 7f701a1bc640 1 -- 172.21.15.81:0/3748271864 >> 172.21.15.81:0/3748271864 conn(0x7f7014101e60 msgr2=0x7f7014102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.498+0000 7f701a1bc640 1 -- 172.21.15.81:0/3748271864 shutdown_connections 2024-09-12T01:19:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:13.498+0000 7f701a1bc640 1 -- 172.21.15.81:0/3748271864 wait complete. 2024-09-12T01:19:15.836 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:15 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:15.836 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:15 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:16.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:16 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3651656123' entity='client.admin' 2024-09-12T01:19:16.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:16 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:16.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.310+0000 7ff0f9c80640 1 Processor -- start 2024-09-12T01:19:16.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.310+0000 7ff0f9c80640 1 -- start start 2024-09-12T01:19:16.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.310+0000 7ff0f9c80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f41066d0 0x7ff0f4106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:16.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.310+0000 7ff0f9c80640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f41070a0 con 0x7ff0f41066d0 2024-09-12T01:19:16.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.311+0000 7ff0f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f41066d0 0x7ff0f4106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:16.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.311+0000 7ff0f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f41066d0 0x7ff0f4106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57234/0 (socket says 172.21.15.81:57234) 2024-09-12T01:19:16.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.311+0000 7ff0f37fe640 1 -- 172.21.15.81:0/3520711653 learned_addr learned my addr 172.21.15.81:0/3520711653 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:16.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.311+0000 7ff0f37fe640 1 -- 172.21.15.81:0/3520711653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f41078d0 con 0x7ff0f41066d0 2024-09-12T01:19:16.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.312+0000 7ff0f37fe640 1 --2- 172.21.15.81:0/3520711653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f41066d0 0x7ff0f4106ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009820 tx=0x7ff0e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9460c20fe748ac5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:16.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.312+0000 7ff0f27fc640 1 -- 172.21.15.81:0/3520711653 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e4037070 con 0x7ff0f41066d0 2024-09-12T01:19:16.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.312+0000 7ff0f27fc640 1 -- 172.21.15.81:0/3520711653 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0e4032920 con 0x7ff0f41066d0 2024-09-12T01:19:16.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.312+0000 7ff0f27fc640 1 -- 172.21.15.81:0/3520711653 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e4030810 con 0x7ff0f41066d0 2024-09-12T01:19:16.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.313+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3520711653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f41066d0 msgr2=0x7ff0f4106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:16.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.313+0000 7ff0f9c80640 1 --2- 172.21.15.81:0/3520711653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f41066d0 0x7ff0f4106ad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009820 tx=0x7ff0e402a270 comp rx=0 tx=0).stop 2024-09-12T01:19:16.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.313+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3520711653 shutdown_connections 2024-09-12T01:19:16.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.313+0000 7ff0f9c80640 1 --2- 172.21.15.81:0/3520711653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f41066d0 0x7ff0f4106ad0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:16.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.313+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3520711653 >> 172.21.15.81:0/3520711653 conn(0x7ff0f4101e60 msgr2=0x7ff0f41042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:16.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.313+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3520711653 shutdown_connections 2024-09-12T01:19:16.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.313+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3520711653 wait complete. 2024-09-12T01:19:16.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.314+0000 7ff0f9c80640 1 Processor -- start 2024-09-12T01:19:16.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.314+0000 7ff0f9c80640 1 -- start start 2024-09-12T01:19:16.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.314+0000 7ff0f9c80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f419b9d0 0x7ff0f419bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:16.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.314+0000 7ff0f9c80640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f410ac80 con 0x7ff0f419b9d0 2024-09-12T01:19:16.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.314+0000 7ff0f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f419b9d0 0x7ff0f419bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:16.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.314+0000 7ff0f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f419b9d0 0x7ff0f419bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57238/0 (socket says 172.21.15.81:57238) 2024-09-12T01:19:16.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.314+0000 7ff0f37fe640 1 -- 172.21.15.81:0/3651656123 learned_addr learned my addr 172.21.15.81:0/3651656123 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:16.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.315+0000 7ff0f37fe640 1 -- 172.21.15.81:0/3651656123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f419c330 con 0x7ff0f419b9d0 2024-09-12T01:19:16.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.315+0000 7ff0f37fe640 1 --2- 172.21.15.81:0/3651656123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f419b9d0 0x7ff0f419bdf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff0e402a860 tx=0x7ff0e4030d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:16.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.315+0000 7ff0f0ff9640 1 -- 172.21.15.81:0/3651656123 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e4037040 con 0x7ff0f419b9d0 2024-09-12T01:19:16.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.315+0000 7ff0f0ff9640 1 -- 172.21.15.81:0/3651656123 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0e4042070 con 0x7ff0f419b9d0 2024-09-12T01:19:16.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.315+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3651656123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f419c5c0 con 0x7ff0f419b9d0 2024-09-12T01:19:16.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.315+0000 7ff0f0ff9640 1 -- 172.21.15.81:0/3651656123 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e403b3f0 con 0x7ff0f419b9d0 2024-09-12T01:19:16.885 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.315+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3651656123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f419f0a0 con 0x7ff0f419b9d0 2024-09-12T01:19:16.888 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.316+0000 7ff0f0ff9640 1 -- 172.21.15.81:0/3651656123 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff0e403b6a0 con 0x7ff0f419b9d0 2024-09-12T01:19:16.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.316+0000 7ff0f0ff9640 1 --2- 172.21.15.81:0/3651656123 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7ff0dc038fc0 0x7ff0dc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:16.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.317+0000 7ff0f0ff9640 1 -- 172.21.15.81:0/3651656123 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff0e406c9e0 con 0x7ff0f419b9d0 2024-09-12T01:19:16.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.317+0000 7ff0f2ffd640 1 --2- 172.21.15.81:0/3651656123 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7ff0dc038fc0 0x7ff0dc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:16.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.317+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3651656123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f4106ad0 con 0x7ff0f419b9d0 2024-09-12T01:19:16.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.317+0000 7ff0f2ffd640 1 --2- 172.21.15.81:0/3651656123 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7ff0dc038fc0 0x7ff0dc03b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80098c0 tx=0x7ff0e8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:16.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.322+0000 7ff0f0ff9640 1 -- 172.21.15.81:0/3651656123 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0e4046c70 con 0x7ff0f419b9d0 2024-09-12T01:19:16.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.534+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3651656123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7ff0f41957b0 con 0x7ff0f419b9d0 2024-09-12T01:19:16.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.536+0000 7ff0f0ff9640 1 -- 172.21.15.81:0/3651656123 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7ff0e4031e80 con 0x7ff0f419b9d0 2024-09-12T01:19:16.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.539+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3651656123 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7ff0dc038fc0 msgr2=0x7ff0dc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:16.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.539+0000 7ff0f9c80640 1 --2- 172.21.15.81:0/3651656123 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7ff0dc038fc0 0x7ff0dc03b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80098c0 tx=0x7ff0e8006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:16.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.539+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3651656123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f419b9d0 msgr2=0x7ff0f419bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:16.889 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.539+0000 7ff0f9c80640 1 --2- 172.21.15.81:0/3651656123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f419b9d0 0x7ff0f419bdf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff0e402a860 tx=0x7ff0e4030d40 comp rx=0 tx=0).stop 2024-09-12T01:19:16.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.539+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3651656123 shutdown_connections 2024-09-12T01:19:16.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.539+0000 7ff0f9c80640 1 --2- 172.21.15.81:0/3651656123 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7ff0dc038fc0 0x7ff0dc03b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:16.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.539+0000 7ff0f9c80640 1 --2- 172.21.15.81:0/3651656123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0f419b9d0 0x7ff0f419bdf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:16.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.539+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3651656123 >> 172.21.15.81:0/3651656123 conn(0x7ff0f4101e60 msgr2=0x7ff0f4102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:16.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.539+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3651656123 shutdown_connections 2024-09-12T01:19:16.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:15.539+0000 7ff0f9c80640 1 -- 172.21.15.81:0/3651656123 wait complete. 2024-09-12T01:19:18.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.283+0000 7fbfe2944640 1 Processor -- start 2024-09-12T01:19:18.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.283+0000 7fbfe2944640 1 -- start start 2024-09-12T01:19:18.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.283+0000 7fbfe2944640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 0x7fbfdc107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:18.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.283+0000 7fbfe2944640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbfdc1081a0 con 0x7fbfdc1077d0 2024-09-12T01:19:18.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.284+0000 7fbfdbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 0x7fbfdc107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:18.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.284+0000 7fbfdbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 0x7fbfdc107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57250/0 (socket says 172.21.15.81:57250) 2024-09-12T01:19:18.048 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.284+0000 7fbfdbfff640 1 -- 172.21.15.81:0/456738397 learned_addr learned my addr 172.21.15.81:0/456738397 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:18.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.284+0000 7fbfdbfff640 1 -- 172.21.15.81:0/456738397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfdc1089d0 con 0x7fbfdc1077d0 2024-09-12T01:19:18.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.285+0000 7fbfdbfff640 1 --2- 172.21.15.81:0/456738397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 0x7fbfdc107bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009820 tx=0x7fbfcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22461341c4478f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:18.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.285+0000 7fbfdaffd640 1 -- 172.21.15.81:0/456738397 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc037070 con 0x7fbfdc1077d0 2024-09-12T01:19:18.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.285+0000 7fbfdaffd640 1 -- 172.21.15.81:0/456738397 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfcc032920 con 0x7fbfdc1077d0 2024-09-12T01:19:18.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.285+0000 7fbfdaffd640 1 -- 172.21.15.81:0/456738397 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc030810 con 0x7fbfdc1077d0 2024-09-12T01:19:18.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.285+0000 7fbfe2944640 1 -- 172.21.15.81:0/456738397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 msgr2=0x7fbfdc107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:18.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.285+0000 7fbfe2944640 1 --2- 172.21.15.81:0/456738397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 0x7fbfdc107bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009820 tx=0x7fbfcc02a270 comp rx=0 tx=0).stop 2024-09-12T01:19:18.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.286+0000 7fbfe2944640 1 -- 172.21.15.81:0/456738397 shutdown_connections 2024-09-12T01:19:18.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.286+0000 7fbfe2944640 1 --2- 172.21.15.81:0/456738397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 0x7fbfdc107bd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:18.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.286+0000 7fbfe2944640 1 -- 172.21.15.81:0/456738397 >> 172.21.15.81:0/456738397 conn(0x7fbfdc102fc0 msgr2=0x7fbfdc1053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:18.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.286+0000 7fbfe2944640 1 -- 172.21.15.81:0/456738397 shutdown_connections 2024-09-12T01:19:18.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.286+0000 7fbfe2944640 1 -- 172.21.15.81:0/456738397 wait complete. 2024-09-12T01:19:18.049 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.286+0000 7fbfe2944640 1 Processor -- start 2024-09-12T01:19:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.286+0000 7fbfe2944640 1 -- start start 2024-09-12T01:19:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.287+0000 7fbfe2944640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 0x7fbfdc19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.287+0000 7fbfe2944640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbfdc10bd80 con 0x7fbfdc1077d0 2024-09-12T01:19:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.287+0000 7fbfdbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 0x7fbfdc19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.287+0000 7fbfdbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 0x7fbfdc19b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57252/0 (socket says 172.21.15.81:57252) 2024-09-12T01:19:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.287+0000 7fbfdbfff640 1 -- 172.21.15.81:0/1984743313 learned_addr learned my addr 172.21.15.81:0/1984743313 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.287+0000 7fbfdbfff640 1 -- 172.21.15.81:0/1984743313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfdc19bd40 con 0x7fbfdc1077d0 2024-09-12T01:19:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.287+0000 7fbfdbfff640 1 --2- 172.21.15.81:0/1984743313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 0x7fbfdc19b800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0097f0 tx=0x7fbfcc0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.287+0000 7fbfd97fa640 1 -- 172.21.15.81:0/1984743313 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc037040 con 0x7fbfdc1077d0 2024-09-12T01:19:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.287+0000 7fbfd97fa640 1 -- 172.21.15.81:0/1984743313 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfcc030cc0 con 0x7fbfdc1077d0 2024-09-12T01:19:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.287+0000 7fbfe2944640 1 -- 172.21.15.81:0/1984743313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfdc19bfd0 con 0x7fbfdc1077d0 2024-09-12T01:19:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.287+0000 7fbfd97fa640 1 -- 172.21.15.81:0/1984743313 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc03a640 con 0x7fbfdc1077d0 2024-09-12T01:19:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.287+0000 7fbfe2944640 1 -- 172.21.15.81:0/1984743313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfdc19ecc0 con 0x7fbfdc1077d0 2024-09-12T01:19:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.288+0000 7fbfd97fa640 1 -- 172.21.15.81:0/1984743313 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fbfcc03a8f0 con 0x7fbfdc1077d0 2024-09-12T01:19:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.288+0000 7fbfd97fa640 1 --2- 172.21.15.81:0/1984743313 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fbfc4038fc0 0x7fbfc403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.288+0000 7fbfd97fa640 1 -- 172.21.15.81:0/1984743313 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbfcc06c620 con 0x7fbfdc1077d0 2024-09-12T01:19:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.288+0000 7fbfdb7fe640 1 --2- 172.21.15.81:0/1984743313 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fbfc4038fc0 0x7fbfc403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.288+0000 7fbfe2944640 1 -- 172.21.15.81:0/1984743313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfdc107c50 con 0x7fbfdc1077d0 2024-09-12T01:19:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.289+0000 7fbfdb7fe640 1 --2- 172.21.15.81:0/1984743313 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fbfc4038fc0 0x7fbfc403b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00098c0 tx=0x7fbfd0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.293+0000 7fbfd97fa640 1 -- 172.21.15.81:0/1984743313 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbfcc0328c0 con 0x7fbfdc1077d0 2024-09-12T01:19:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.462+0000 7fbfe2944640 1 -- 172.21.15.81:0/1984743313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fbfdc19f0f0 con 0x7fbfdc1077d0 2024-09-12T01:19:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.465+0000 7fbfd97fa640 1 -- 172.21.15.81:0/1984743313 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fbfcc031c00 con 0x7fbfdc1077d0 2024-09-12T01:19:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.467+0000 7fbfe2944640 1 -- 172.21.15.81:0/1984743313 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fbfc4038fc0 msgr2=0x7fbfc403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.467+0000 7fbfe2944640 1 --2- 172.21.15.81:0/1984743313 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fbfc4038fc0 0x7fbfc403b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00098c0 tx=0x7fbfd0006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.467+0000 7fbfe2944640 1 -- 172.21.15.81:0/1984743313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 msgr2=0x7fbfdc19b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:18.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.467+0000 7fbfe2944640 1 --2- 172.21.15.81:0/1984743313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 0x7fbfdc19b800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0097f0 tx=0x7fbfcc0327b0 comp rx=0 tx=0).stop 2024-09-12T01:19:18.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.467+0000 7fbfe2944640 1 -- 172.21.15.81:0/1984743313 shutdown_connections 2024-09-12T01:19:18.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.467+0000 7fbfe2944640 1 --2- 172.21.15.81:0/1984743313 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fbfc4038fc0 0x7fbfc403b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:18.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.467+0000 7fbfe2944640 1 --2- 172.21.15.81:0/1984743313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfdc1077d0 0x7fbfdc19b800 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:18.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.467+0000 7fbfe2944640 1 -- 172.21.15.81:0/1984743313 >> 172.21.15.81:0/1984743313 conn(0x7fbfdc102fc0 msgr2=0x7fbfdc103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:18.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.467+0000 7fbfe2944640 1 -- 172.21.15.81:0/1984743313 shutdown_connections 2024-09-12T01:19:18.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:17.467+0000 7fbfe2944640 1 -- 172.21.15.81:0/1984743313 wait complete. 2024-09-12T01:19:18.052 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling the dashboard module... 2024-09-12T01:19:18.727 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:18 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1984743313' entity='client.admin' 2024-09-12T01:19:18.728 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:18 smithi081 ceph-mon[30920]: from='mgr.14118 172.21.15.81:0/23500803' entity='mgr.x' 2024-09-12T01:19:19.667 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:19 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/4231625959' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T01:19:19.667 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:19 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: ignoring --setuser ceph since I am not root 2024-09-12T01:19:19.667 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:19 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: ignoring --setgroup ceph since I am not root 2024-09-12T01:19:19.668 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:19 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:19.617+0000 7fb1bba00040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:19:19.961 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:19 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:19.675+0000 7fb1bba00040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:19:19.962 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:19 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:19.826+0000 7fb1bba00040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:19:19.962 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:19 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:19.894+0000 7fb1bba00040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:19:20.237 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:20 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:20.041+0000 7fb1bba00040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:19:20.237 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:20 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:20.183+0000 7fb1bba00040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:19:20.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.509+0000 7f8613e6a640 1 Processor -- start 2024-09-12T01:19:20.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.509+0000 7f8613e6a640 1 -- start start 2024-09-12T01:19:20.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.509+0000 7f8613e6a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 0x7f860c106ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:20.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.509+0000 7f8613e6a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f860c1070b0 con 0x7f860c1066e0 2024-09-12T01:19:20.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.509+0000 7f8611c06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 0x7f860c106ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:20.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.509+0000 7f8611c06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 0x7f860c106ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57256/0 (socket says 172.21.15.81:57256) 2024-09-12T01:19:20.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.509+0000 7f8611c06640 1 -- 172.21.15.81:0/807541278 learned_addr learned my addr 172.21.15.81:0/807541278 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:20.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.510+0000 7f8611c06640 1 -- 172.21.15.81:0/807541278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860c1078e0 con 0x7f860c1066e0 2024-09-12T01:19:20.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.510+0000 7f8611c06640 1 --2- 172.21.15.81:0/807541278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 0x7f860c106ae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8608009820 tx=0x7f860802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a40bacd167b198 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:20.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.510+0000 7f8610c04640 1 -- 172.21.15.81:0/807541278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8608037070 con 0x7f860c1066e0 2024-09-12T01:19:20.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.510+0000 7f8610c04640 1 -- 172.21.15.81:0/807541278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8608032920 con 0x7f860c1066e0 2024-09-12T01:19:20.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.510+0000 7f8610c04640 1 -- 172.21.15.81:0/807541278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8608030810 con 0x7f860c1066e0 2024-09-12T01:19:20.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.511+0000 7f8613e6a640 1 -- 172.21.15.81:0/807541278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 msgr2=0x7f860c106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:20.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.511+0000 7f8613e6a640 1 --2- 172.21.15.81:0/807541278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 0x7f860c106ae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8608009820 tx=0x7f860802a270 comp rx=0 tx=0).stop 2024-09-12T01:19:20.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.511+0000 7f8613e6a640 1 -- 172.21.15.81:0/807541278 shutdown_connections 2024-09-12T01:19:20.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.511+0000 7f8613e6a640 1 --2- 172.21.15.81:0/807541278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 0x7f860c106ae0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:20.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.511+0000 7f8613e6a640 1 -- 172.21.15.81:0/807541278 >> 172.21.15.81:0/807541278 conn(0x7f860c101ed0 msgr2=0x7f860c1042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:20.245 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.511+0000 7f8613e6a640 1 -- 172.21.15.81:0/807541278 shutdown_connections 2024-09-12T01:19:20.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.512+0000 7f8613e6a640 1 -- 172.21.15.81:0/807541278 wait complete. 2024-09-12T01:19:20.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.512+0000 7f8613e6a640 1 Processor -- start 2024-09-12T01:19:20.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.512+0000 7f8613e6a640 1 -- start start 2024-09-12T01:19:20.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.512+0000 7f8613e6a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 0x7f860c1918a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:20.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.512+0000 7f8613e6a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f860c10ac90 con 0x7f860c1066e0 2024-09-12T01:19:20.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.512+0000 7f8611c06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 0x7f860c1918a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:20.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.512+0000 7f8611c06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 0x7f860c1918a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57266/0 (socket says 172.21.15.81:57266) 2024-09-12T01:19:20.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.512+0000 7f8611c06640 1 -- 172.21.15.81:0/4231625959 learned_addr learned my addr 172.21.15.81:0/4231625959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:20.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.513+0000 7f8611c06640 1 -- 172.21.15.81:0/4231625959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860c191de0 con 0x7f860c1066e0 2024-09-12T01:19:20.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.513+0000 7f8611c06640 1 --2- 172.21.15.81:0/4231625959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 0x7f860c1918a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8608030560 tx=0x7f8608032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:20.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.513+0000 7f8602ffd640 1 -- 172.21.15.81:0/4231625959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8608037040 con 0x7f860c1066e0 2024-09-12T01:19:20.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.513+0000 7f8602ffd640 1 -- 172.21.15.81:0/4231625959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8608040070 con 0x7f860c1066e0 2024-09-12T01:19:20.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.513+0000 7f8613e6a640 1 -- 172.21.15.81:0/4231625959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f860c18ffd0 con 0x7f860c1066e0 2024-09-12T01:19:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.513+0000 7f8602ffd640 1 -- 172.21.15.81:0/4231625959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f860803a740 con 0x7f860c1066e0 2024-09-12T01:19:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.513+0000 7f8613e6a640 1 -- 172.21.15.81:0/4231625959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f860c190510 con 0x7f860c1066e0 2024-09-12T01:19:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.514+0000 7f8602ffd640 1 -- 172.21.15.81:0/4231625959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f860803a9b0 con 0x7f860c1066e0 2024-09-12T01:19:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.514+0000 7f8602ffd640 1 --2- 172.21.15.81:0/4231625959 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f85f8038f70 0x7f85f803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.514+0000 7f8602ffd640 1 -- 172.21.15.81:0/4231625959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f860806c670 con 0x7f860c1066e0 2024-09-12T01:19:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.514+0000 7f8613e6a640 1 -- 172.21.15.81:0/4231625959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f860c106b60 con 0x7f860c1066e0 2024-09-12T01:19:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.514+0000 7f8611405640 1 --2- 172.21.15.81:0/4231625959 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f85f8038f70 0x7f85f803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.515+0000 7f8611405640 1 --2- 172.21.15.81:0/4231625959 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f85f8038f70 0x7f85f803b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0098c0 tx=0x7f85fc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.519+0000 7f8602ffd640 1 -- 172.21.15.81:0/4231625959 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8608041270 con 0x7f860c1066e0 2024-09-12T01:19:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:18.747+0000 7f8613e6a640 1 -- 172.21.15.81:0/4231625959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f860c1a1810 con 0x7f860c1066e0 2024-09-12T01:19:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:19.468+0000 7f8602ffd640 1 -- 172.21.15.81:0/4231625959 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f86080328f0 con 0x7f860c1066e0 2024-09-12T01:19:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:19.470+0000 7f8602ffd640 1 -- 172.21.15.81:0/4231625959 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f8608045980 con 0x7f860c1066e0 2024-09-12T01:19:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:19.471+0000 7f8613e6a640 1 -- 172.21.15.81:0/4231625959 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f85f8038f70 msgr2=0x7f85f803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:20.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:19.471+0000 7f8613e6a640 1 --2- 172.21.15.81:0/4231625959 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f85f8038f70 0x7f85f803b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0098c0 tx=0x7f85fc006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:20.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:19.471+0000 7f8613e6a640 1 -- 172.21.15.81:0/4231625959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 msgr2=0x7f860c1918a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:20.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:19.471+0000 7f8613e6a640 1 --2- 172.21.15.81:0/4231625959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 0x7f860c1918a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8608030560 tx=0x7f8608032670 comp rx=0 tx=0).stop 2024-09-12T01:19:20.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:19.471+0000 7f8613e6a640 1 -- 172.21.15.81:0/4231625959 shutdown_connections 2024-09-12T01:19:20.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:19.471+0000 7f8613e6a640 1 --2- 172.21.15.81:0/4231625959 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f85f8038f70 0x7f85f803b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:20.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:19.471+0000 7f8613e6a640 1 --2- 172.21.15.81:0/4231625959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f860c1066e0 0x7f860c1918a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:20.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:19.471+0000 7f8613e6a640 1 -- 172.21.15.81:0/4231625959 >> 172.21.15.81:0/4231625959 conn(0x7f860c101ed0 msgr2=0x7f860c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:20.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:19.472+0000 7f8613e6a640 1 -- 172.21.15.81:0/4231625959 shutdown_connections 2024-09-12T01:19:20.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:19.472+0000 7f8613e6a640 1 -- 172.21.15.81:0/4231625959 wait complete. 2024-09-12T01:19:20.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:20 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/4231625959' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T01:19:20.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:20 smithi081 ceph-mon[30920]: mgrmap e9: x(active, since 18s) 2024-09-12T01:19:20.759 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:20 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:20.505+0000 7fb1bba00040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:19:20.760 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:20 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:20.566+0000 7fb1bba00040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:19:20.760 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:20 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:20.760+0000 7fb1bba00040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:19:21.494 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:19:21.494 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T01:19:21.494 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:19:21.495 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T01:19:21.495 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T01:19:21.495 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:19:21.495 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.637+0000 7fe090965640 1 Processor -- start 2024-09-12T01:19:21.495 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.637+0000 7fe090965640 1 -- start start 2024-09-12T01:19:21.495 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.637+0000 7fe090965640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 0x7fe08c07c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:21.495 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.637+0000 7fe090965640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c07c850 con 0x7fe08c07de20 2024-09-12T01:19:21.495 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.637+0000 7fe08a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 0x7fe08c07c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:21.495 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.638+0000 7fe08a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 0x7fe08c07c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57276/0 (socket says 172.21.15.81:57276) 2024-09-12T01:19:21.495 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.638+0000 7fe08a59c640 1 -- 172.21.15.81:0/3874404211 learned_addr learned my addr 172.21.15.81:0/3874404211 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:21.495 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.638+0000 7fe08a59c640 1 -- 172.21.15.81:0/3874404211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c07c9d0 con 0x7fe08c07de20 2024-09-12T01:19:21.495 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.638+0000 7fe08a59c640 1 --2- 172.21.15.81:0/3874404211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 0x7fe08c07c280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009820 tx=0x7fe07c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e425e27855da9ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:21.495 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.639+0000 7fe08959a640 1 -- 172.21.15.81:0/3874404211 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe07c037070 con 0x7fe08c07de20 2024-09-12T01:19:21.496 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.639+0000 7fe08959a640 1 -- 172.21.15.81:0/3874404211 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe07c032920 con 0x7fe08c07de20 2024-09-12T01:19:21.496 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.639+0000 7fe08959a640 1 -- 172.21.15.81:0/3874404211 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe07c030810 con 0x7fe08c07de20 2024-09-12T01:19:21.496 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.639+0000 7fe090965640 1 -- 172.21.15.81:0/3874404211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 msgr2=0x7fe08c07c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:21.496 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.639+0000 7fe090965640 1 --2- 172.21.15.81:0/3874404211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 0x7fe08c07c280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009820 tx=0x7fe07c02a270 comp rx=0 tx=0).stop 2024-09-12T01:19:21.496 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.639+0000 7fe090965640 1 -- 172.21.15.81:0/3874404211 shutdown_connections 2024-09-12T01:19:21.496 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.639+0000 7fe090965640 1 --2- 172.21.15.81:0/3874404211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 0x7fe08c07c280 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:21.496 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.639+0000 7fe090965640 1 -- 172.21.15.81:0/3874404211 >> 172.21.15.81:0/3874404211 conn(0x7fe08c102f20 msgr2=0x7fe08c1053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:21.496 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.639+0000 7fe090965640 1 -- 172.21.15.81:0/3874404211 shutdown_connections 2024-09-12T01:19:21.496 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.639+0000 7fe090965640 1 -- 172.21.15.81:0/3874404211 wait complete. 2024-09-12T01:19:21.496 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.640+0000 7fe090965640 1 Processor -- start 2024-09-12T01:19:21.496 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.640+0000 7fe090965640 1 -- start start 2024-09-12T01:19:21.496 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.640+0000 7fe090965640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 0x7fe08c19d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:21.496 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.640+0000 7fe090965640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c10de30 con 0x7fe08c07de20 2024-09-12T01:19:21.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.640+0000 7fe08a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 0x7fe08c19d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:21.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.640+0000 7fe08a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 0x7fe08c19d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57292/0 (socket says 172.21.15.81:57292) 2024-09-12T01:19:21.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.640+0000 7fe08a59c640 1 -- 172.21.15.81:0/1407112588 learned_addr learned my addr 172.21.15.81:0/1407112588 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:21.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.641+0000 7fe08a59c640 1 -- 172.21.15.81:0/1407112588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c19dec0 con 0x7fe08c07de20 2024-09-12T01:19:21.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.641+0000 7fe08a59c640 1 --2- 172.21.15.81:0/1407112588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 0x7fe08c19d980 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe07c030380 tx=0x7fe07c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:21.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.641+0000 7fe07b7fe640 1 -- 172.21.15.81:0/1407112588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe07c037040 con 0x7fe08c07de20 2024-09-12T01:19:21.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.641+0000 7fe090965640 1 -- 172.21.15.81:0/1407112588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08c19e150 con 0x7fe08c07de20 2024-09-12T01:19:21.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.641+0000 7fe07b7fe640 1 -- 172.21.15.81:0/1407112588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe07c040070 con 0x7fe08c07de20 2024-09-12T01:19:21.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.641+0000 7fe07b7fe640 1 -- 172.21.15.81:0/1407112588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe07c03a7b0 con 0x7fe08c07de20 2024-09-12T01:19:21.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.641+0000 7fe090965640 1 -- 172.21.15.81:0/1407112588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe08c1a0e40 con 0x7fe08c07de20 2024-09-12T01:19:21.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.642+0000 7fe07b7fe640 1 -- 172.21.15.81:0/1407112588 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fe07c03aa30 con 0x7fe08c07de20 2024-09-12T01:19:21.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.642+0000 7fe07b7fe640 1 --2- 172.21.15.81:0/1407112588 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fe074038fc0 0x7fe07403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:21.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.642+0000 7fe090965640 1 -- 172.21.15.81:0/1407112588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe08c07c300 con 0x7fe08c07de20 2024-09-12T01:19:21.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.642+0000 7fe089d9b640 1 -- 172.21.15.81:0/1407112588 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fe074038fc0 msgr2=0x7fe07403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1857307616 2024-09-12T01:19:21.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.642+0000 7fe07b7fe640 1 -- 172.21.15.81:0/1407112588 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe07c06c7b0 con 0x7fe08c07de20 2024-09-12T01:19:21.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.642+0000 7fe089d9b640 1 --2- 172.21.15.81:0/1407112588 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fe074038fc0 0x7fe07403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:19:21.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.647+0000 7fe07b7fe640 1 -- 172.21.15.81:0/1407112588 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe07c041270 con 0x7fe08c07de20 2024-09-12T01:19:21.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.843+0000 7fe089d9b640 1 -- 172.21.15.81:0/1407112588 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fe074038fc0 msgr2=0x7fe07403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1857307616 2024-09-12T01:19:21.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.843+0000 7fe089d9b640 1 --2- 172.21.15.81:0/1407112588 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fe074038fc0 0x7fe07403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:19:21.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.864+0000 7fe090965640 1 -- 172.21.15.81:0/1407112588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fe08c1a1430 con 0x7fe08c07de20 2024-09-12T01:19:21.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.865+0000 7fe07b7fe640 1 -- 172.21.15.81:0/1407112588 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fe07c045980 con 0x7fe08c07de20 2024-09-12T01:19:21.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.867+0000 7fe090965640 1 -- 172.21.15.81:0/1407112588 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fe074038fc0 msgr2=0x7fe07403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:19:21.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.867+0000 7fe090965640 1 --2- 172.21.15.81:0/1407112588 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fe074038fc0 0x7fe07403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:21.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.867+0000 7fe090965640 1 -- 172.21.15.81:0/1407112588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 msgr2=0x7fe08c19d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:21.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.867+0000 7fe090965640 1 --2- 172.21.15.81:0/1407112588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 0x7fe08c19d980 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe07c030380 tx=0x7fe07c032670 comp rx=0 tx=0).stop 2024-09-12T01:19:21.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.867+0000 7fe090965640 1 -- 172.21.15.81:0/1407112588 shutdown_connections 2024-09-12T01:19:21.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.867+0000 7fe090965640 1 --2- 172.21.15.81:0/1407112588 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7fe074038fc0 0x7fe07403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:21.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.867+0000 7fe090965640 1 --2- 172.21.15.81:0/1407112588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe08c07de20 0x7fe08c19d980 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:21.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.867+0000 7fe090965640 1 -- 172.21.15.81:0/1407112588 >> 172.21.15.81:0/1407112588 conn(0x7fe08c102f20 msgr2=0x7fe08c103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:21.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.867+0000 7fe090965640 1 -- 172.21.15.81:0/1407112588 shutdown_connections 2024-09-12T01:19:21.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:20.867+0000 7fe090965640 1 -- 172.21.15.81:0/1407112588 wait complete. 2024-09-12T01:19:21.499 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-09-12T01:19:21.499 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 9... 2024-09-12T01:19:21.614 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:21 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1407112588' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T01:19:21.865 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:21 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:21.673+0000 7fb1bba00040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:19:21.865 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:21 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:21.745+0000 7fb1bba00040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:19:22.722 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:22.463+0000 7fb1bba00040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:19:22.722 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:22.580+0000 7fb1bba00040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:19:22.988 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:22.723+0000 7fb1bba00040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:19:22.988 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:22.784+0000 7fb1bba00040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:19:22.988 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:22.935+0000 7fb1bba00040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:19:23.283 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:23.002+0000 7fb1bba00040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:19:23.283 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:23.062+0000 7fb1bba00040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:19:23.283 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:23.219+0000 7fb1bba00040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:19:23.283 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:23.284+0000 7fb1bba00040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:19:23.552 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:23.350+0000 7fb1bba00040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:19:23.553 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:23.434+0000 7fb1bba00040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:19:23.553 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:23.493+0000 7fb1bba00040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:19:23.553 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:23.553+0000 7fb1bba00040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:19:24.738 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:24.344+0000 7fb1bba00040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:19:24.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-mon[30920]: Active manager daemon x restarted 2024-09-12T01:19:24.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-mon[30920]: Activating manager daemon x 2024-09-12T01:19:24.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-mon[30920]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T01:19:24.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-mon[30920]: mgrmap e10: x(active, starting, since 0.0035723s) 2024-09-12T01:19:24.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:19:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:19:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:19:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:19:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:19:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-mon[30920]: Manager daemon x is now available 2024-09-12T01:19:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:19:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:19:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:19:26.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:25.819+0000 7fb1214c9640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:01:19:25] ENGINE Error in HTTPServer.serve 2024-09-12T01:19:26.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: Traceback (most recent call last): 2024-09-12T01:19:26.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:19:26.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: self._connections.run(self.expiration_interval) 2024-09-12T01:19:26.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:19:26.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: self._run(expiration_interval) 2024-09-12T01:19:26.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:19:26.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:19:26.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:19:26.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:19:26.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:19:26.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: s = self.context.wrap_socket( 2024-09-12T01:19:26.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:19:26.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: return self.sslsocket_class._create( 2024-09-12T01:19:26.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:19:26.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: self.do_handshake() 2024-09-12T01:19:26.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:19:26.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: self._sslobj.do_handshake() 2024-09-12T01:19:26.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:19:26.240 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:19:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:19:26.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:19:26.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T01:19:26.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T01:19:26.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:19:26.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.941+0000 7f7168798640 1 Processor -- start 2024-09-12T01:19:26.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.941+0000 7f7168798640 1 -- start start 2024-09-12T01:19:26.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.942+0000 7f7168798640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 0x7f7160106af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:26.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.942+0000 7f7168798640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71601070c0 con 0x7f71601066f0 2024-09-12T01:19:26.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.942+0000 7f7166534640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 0x7f7160106af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:26.249 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.942+0000 7f7166534640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 0x7f7160106af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57300/0 (socket says 172.21.15.81:57300) 2024-09-12T01:19:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.942+0000 7f7166534640 1 -- 172.21.15.81:0/2331457178 learned_addr learned my addr 172.21.15.81:0/2331457178 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.942+0000 7f7166534640 1 -- 172.21.15.81:0/2331457178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71601078f0 con 0x7f71601066f0 2024-09-12T01:19:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.943+0000 7f7166534640 1 --2- 172.21.15.81:0/2331457178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 0x7f7160106af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f715c009820 tx=0x7f715c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b0bbde153c4371 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.943+0000 7f7165532640 1 -- 172.21.15.81:0/2331457178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715c037070 con 0x7f71601066f0 2024-09-12T01:19:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.943+0000 7f7165532640 1 -- 172.21.15.81:0/2331457178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f715c032920 con 0x7f71601066f0 2024-09-12T01:19:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.943+0000 7f7165532640 1 -- 172.21.15.81:0/2331457178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715c030810 con 0x7f71601066f0 2024-09-12T01:19:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.944+0000 7f7168798640 1 -- 172.21.15.81:0/2331457178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 msgr2=0x7f7160106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.944+0000 7f7168798640 1 --2- 172.21.15.81:0/2331457178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 0x7f7160106af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f715c009820 tx=0x7f715c02a270 comp rx=0 tx=0).stop 2024-09-12T01:19:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.944+0000 7f7168798640 1 -- 172.21.15.81:0/2331457178 shutdown_connections 2024-09-12T01:19:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.944+0000 7f7168798640 1 --2- 172.21.15.81:0/2331457178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 0x7f7160106af0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.944+0000 7f7168798640 1 -- 172.21.15.81:0/2331457178 >> 172.21.15.81:0/2331457178 conn(0x7f7160101e80 msgr2=0x7f71601042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.944+0000 7f7168798640 1 -- 172.21.15.81:0/2331457178 shutdown_connections 2024-09-12T01:19:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.944+0000 7f7168798640 1 -- 172.21.15.81:0/2331457178 wait complete. 2024-09-12T01:19:26.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.944+0000 7f7168798640 1 Processor -- start 2024-09-12T01:19:26.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.944+0000 7f7168798640 1 -- start start 2024-09-12T01:19:26.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.945+0000 7f7168798640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 0x7f71601918b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:26.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.945+0000 7f7168798640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f716010aca0 con 0x7f71601066f0 2024-09-12T01:19:26.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.945+0000 7f7166534640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 0x7f71601918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:26.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.945+0000 7f7166534640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 0x7f71601918b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57314/0 (socket says 172.21.15.81:57314) 2024-09-12T01:19:26.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.945+0000 7f7166534640 1 -- 172.21.15.81:0/1311166997 learned_addr learned my addr 172.21.15.81:0/1311166997 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:26.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.945+0000 7f7166534640 1 -- 172.21.15.81:0/1311166997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7160191df0 con 0x7f71601066f0 2024-09-12T01:19:26.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.945+0000 7f7166534640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 0x7f71601918b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f715c030560 tx=0x7f715c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:26.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.945+0000 7f71577fe640 1 -- 172.21.15.81:0/1311166997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715c037040 con 0x7f71601066f0 2024-09-12T01:19:26.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.945+0000 7f71577fe640 1 -- 172.21.15.81:0/1311166997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f715c040070 con 0x7f71601066f0 2024-09-12T01:19:26.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.945+0000 7f7168798640 1 -- 172.21.15.81:0/1311166997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716018ffe0 con 0x7f71601066f0 2024-09-12T01:19:26.251 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.945+0000 7f71577fe640 1 -- 172.21.15.81:0/1311166997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715c03a740 con 0x7f71601066f0 2024-09-12T01:19:26.252 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.946+0000 7f7168798640 1 -- 172.21.15.81:0/1311166997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7160190520 con 0x7f71601066f0 2024-09-12T01:19:26.252 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.946+0000 7f71577fe640 1 -- 172.21.15.81:0/1311166997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f715c03a8e0 con 0x7f71601066f0 2024-09-12T01:19:26.252 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.946+0000 7f71577fe640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f714c039020 0x7f714c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:26.252 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.947+0000 7f71577fe640 1 -- 172.21.15.81:0/1311166997 --> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f714c03bbf0 con 0x7f714c039020 2024-09-12T01:19:26.252 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.947+0000 7f71577fe640 1 -- 172.21.15.81:0/1311166997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f715c06c5e0 con 0x7f71601066f0 2024-09-12T01:19:26.252 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.947+0000 7f7165d33640 1 -- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f714c039020 msgr2=0x7f714c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1857307616 2024-09-12T01:19:26.252 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:21.947+0000 7f7165d33640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f714c039020 0x7f714c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:19:26.252 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:22.148+0000 7f7165d33640 1 -- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f714c039020 msgr2=0x7f714c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1857307616 2024-09-12T01:19:26.252 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:22.148+0000 7f7165d33640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f714c039020 0x7f714c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:19:26.252 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:22.549+0000 7f7165d33640 1 -- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f714c039020 msgr2=0x7f714c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1857307616 2024-09-12T01:19:26.252 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:22.549+0000 7f7165d33640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f714c039020 0x7f714c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:19:26.252 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:23.350+0000 7f7165d33640 1 -- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f714c039020 msgr2=0x7f714c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1857307616 2024-09-12T01:19:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:23.350+0000 7f7165d33640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f714c039020 0x7f714c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:19:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:24.347+0000 7f71577fe640 1 -- 172.21.15.81:0/1311166997 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f715c06b090 con 0x7f71601066f0 2024-09-12T01:19:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:24.348+0000 7f71577fe640 1 -- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f714c039020 msgr2=0x7f714c03b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:19:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:24.348+0000 7f71577fe640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f714c039020 0x7f714c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.349+0000 7f71577fe640 1 -- 172.21.15.81:0/1311166997 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f715c06b380 con 0x7f71601066f0 2024-09-12T01:19:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.349+0000 7f71577fe640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f714c03cae0 0x7f714c03eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.350+0000 7f7165d33640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f714c03cae0 0x7f714c03eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.350+0000 7f71577fe640 1 -- 172.21.15.81:0/1311166997 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f715c001b80 con 0x7f714c03cae0 2024-09-12T01:19:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.350+0000 7f7165d33640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f714c03cae0 0x7f714c03eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7150003980 tx=0x7f71500092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.351+0000 7f71577fe640 1 -- 172.21.15.81:0/1311166997 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f715c001b80 con 0x7f714c03cae0 2024-09-12T01:19:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.357+0000 7f7168798640 1 -- 172.21.15.81:0/1311166997 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f7160106b70 con 0x7f714c03cae0 2024-09-12T01:19:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.358+0000 7f71577fe640 1 -- 172.21.15.81:0/1311166997 <== mgr.14150 v2:172.21.15.81:6800/2591597081 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f7160106b70 con 0x7f714c03cae0 2024-09-12T01:19:26.253 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.358+0000 7f7168798640 1 -- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f714c03cae0 msgr2=0x7f714c03eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:26.254 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.358+0000 7f7168798640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f714c03cae0 0x7f714c03eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7150003980 tx=0x7f71500092b0 comp rx=0 tx=0).stop 2024-09-12T01:19:26.254 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.358+0000 7f7168798640 1 -- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 msgr2=0x7f71601918b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:26.254 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.358+0000 7f7168798640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 0x7f71601918b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f715c030560 tx=0x7f715c032670 comp rx=0 tx=0).stop 2024-09-12T01:19:26.254 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.358+0000 7f7168798640 1 -- 172.21.15.81:0/1311166997 shutdown_connections 2024-09-12T01:19:26.254 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.358+0000 7f7168798640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f714c03cae0 0x7f714c03eed0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:26.254 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.358+0000 7f7168798640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:6800/1857307616,v1:172.21.15.81:6801/1857307616] conn(0x7f714c039020 0x7f714c03b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:26.254 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.358+0000 7f7168798640 1 --2- 172.21.15.81:0/1311166997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71601066f0 0x7f71601918b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:26.254 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.358+0000 7f7168798640 1 -- 172.21.15.81:0/1311166997 >> 172.21.15.81:0/1311166997 conn(0x7f7160101e80 msgr2=0x7f7160102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:26.254 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.358+0000 7f7168798640 1 -- 172.21.15.81:0/1311166997 shutdown_connections 2024-09-12T01:19:26.254 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:25.358+0000 7f7168798640 1 -- 172.21.15.81:0/1311166997 wait complete. 2024-09-12T01:19:26.254 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 9 is available 2024-09-12T01:19:26.254 INFO:teuthology.orchestra.run.smithi081.stdout:Generating a dashboard self-signed certificate... 2024-09-12T01:19:26.513 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:26 smithi081 ceph-mon[30920]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T01:19:26.513 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:26 smithi081 ceph-mon[30920]: mgrmap e11: x(active, since 1.00645s) 2024-09-12T01:19:26.513 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:26 smithi081 ceph-mon[30920]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T01:19:26.513 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:26 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:27.707 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:27 smithi081 ceph-mon[30920]: [12/Sep/2024:01:19:25] ENGINE Bus STARTING 2024-09-12T01:19:27.707 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:27 smithi081 ceph-mon[30920]: [12/Sep/2024:01:19:25] ENGINE Serving on http://172.21.15.81:8765 2024-09-12T01:19:27.707 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:27 smithi081 ceph-mon[30920]: [12/Sep/2024:01:19:25] ENGINE Serving on https://172.21.15.81:7150 2024-09-12T01:19:27.707 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:27 smithi081 ceph-mon[30920]: [12/Sep/2024:01:19:25] ENGINE Bus STARTED 2024-09-12T01:19:27.707 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:27 smithi081 ceph-mon[30920]: [12/Sep/2024:01:19:25] ENGINE Error in HTTPServer.serve 2024-09-12T01:19:27.707 INFO:journalctl@ceph.mon.a.smithi081.stdout: Traceback (most recent call last): 2024-09-12T01:19:27.707 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:19:27.708 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:19:27.708 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:19:27.708 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._run(expiration_interval) 2024-09-12T01:19:27.708 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:19:27.708 INFO:journalctl@ceph.mon.a.smithi081.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:19:27.708 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:19:27.708 INFO:journalctl@ceph.mon.a.smithi081.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:19:27.708 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:19:27.708 INFO:journalctl@ceph.mon.a.smithi081.stdout: s = self.context.wrap_socket( 2024-09-12T01:19:27.708 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:19:27.708 INFO:journalctl@ceph.mon.a.smithi081.stdout: return self.sslsocket_class._create( 2024-09-12T01:19:27.708 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:19:27.708 INFO:journalctl@ceph.mon.a.smithi081.stdout: self.do_handshake() 2024-09-12T01:19:27.709 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:19:27.709 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._sslobj.do_handshake() 2024-09-12T01:19:27.709 INFO:journalctl@ceph.mon.a.smithi081.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:19:27.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:27 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:27.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:27 smithi081 ceph-mon[30920]: mgrmap e12: x(active, since 2s) 2024-09-12T01:19:27.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:27 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:27.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:27 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:28.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T01:19:28.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.705+0000 7faafffdb640 1 Processor -- start 2024-09-12T01:19:28.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.705+0000 7faafffdb640 1 -- start start 2024-09-12T01:19:28.014 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.705+0000 7faafffdb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 0x7faaf8106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:28.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.705+0000 7faafffdb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faaf81070a0 con 0x7faaf81066d0 2024-09-12T01:19:28.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.706+0000 7faafdd77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 0x7faaf8106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:28.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.706+0000 7faafdd77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 0x7faaf8106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51536/0 (socket says 172.21.15.81:51536) 2024-09-12T01:19:28.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.706+0000 7faafdd77640 1 -- 172.21.15.81:0/253651098 learned_addr learned my addr 172.21.15.81:0/253651098 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:28.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.706+0000 7faafdd77640 1 -- 172.21.15.81:0/253651098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf81078d0 con 0x7faaf81066d0 2024-09-12T01:19:28.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.707+0000 7faafdd77640 1 --2- 172.21.15.81:0/253651098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 0x7faaf8106ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faaf4009820 tx=0x7faaf402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f22558871b2eaba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:28.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.707+0000 7faafcd75640 1 -- 172.21.15.81:0/253651098 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf4037070 con 0x7faaf81066d0 2024-09-12T01:19:28.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.707+0000 7faafcd75640 1 -- 172.21.15.81:0/253651098 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faaf4032920 con 0x7faaf81066d0 2024-09-12T01:19:28.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.707+0000 7faafcd75640 1 -- 172.21.15.81:0/253651098 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf4030810 con 0x7faaf81066d0 2024-09-12T01:19:28.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.707+0000 7faafffdb640 1 -- 172.21.15.81:0/253651098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 msgr2=0x7faaf8106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:28.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.707+0000 7faafffdb640 1 --2- 172.21.15.81:0/253651098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 0x7faaf8106ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faaf4009820 tx=0x7faaf402a270 comp rx=0 tx=0).stop 2024-09-12T01:19:28.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.707+0000 7faafffdb640 1 -- 172.21.15.81:0/253651098 shutdown_connections 2024-09-12T01:19:28.015 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.707+0000 7faafffdb640 1 --2- 172.21.15.81:0/253651098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 0x7faaf8106ad0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.707+0000 7faafffdb640 1 -- 172.21.15.81:0/253651098 >> 172.21.15.81:0/253651098 conn(0x7faaf8101e60 msgr2=0x7faaf81042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.708+0000 7faafffdb640 1 -- 172.21.15.81:0/253651098 shutdown_connections 2024-09-12T01:19:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.708+0000 7faafffdb640 1 -- 172.21.15.81:0/253651098 wait complete. 2024-09-12T01:19:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.708+0000 7faafffdb640 1 Processor -- start 2024-09-12T01:19:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.708+0000 7faafffdb640 1 -- start start 2024-09-12T01:19:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.708+0000 7faafffdb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 0x7faaf807b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.708+0000 7faafffdb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faaf810ac80 con 0x7faaf81066d0 2024-09-12T01:19:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.708+0000 7faafdd77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 0x7faaf807b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.708+0000 7faafdd77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 0x7faaf807b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51538/0 (socket says 172.21.15.81:51538) 2024-09-12T01:19:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.708+0000 7faafdd77640 1 -- 172.21.15.81:0/3975824035 learned_addr learned my addr 172.21.15.81:0/3975824035 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.709+0000 7faafdd77640 1 -- 172.21.15.81:0/3975824035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf819e520 con 0x7faaf81066d0 2024-09-12T01:19:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.709+0000 7faafdd77640 1 --2- 172.21.15.81:0/3975824035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 0x7faaf807b9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faaf4030560 tx=0x7faaf4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:28.016 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.709+0000 7faaeeffd640 1 -- 172.21.15.81:0/3975824035 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf4037040 con 0x7faaf81066d0 2024-09-12T01:19:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.709+0000 7faaeeffd640 1 -- 172.21.15.81:0/3975824035 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faaf4040070 con 0x7faaf81066d0 2024-09-12T01:19:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.709+0000 7faaeeffd640 1 -- 172.21.15.81:0/3975824035 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf403a740 con 0x7faaf81066d0 2024-09-12T01:19:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.709+0000 7faafffdb640 1 -- 172.21.15.81:0/3975824035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf819e6f0 con 0x7faaf81066d0 2024-09-12T01:19:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.709+0000 7faafffdb640 1 -- 172.21.15.81:0/3975824035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf819ea90 con 0x7faaf81066d0 2024-09-12T01:19:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.710+0000 7faaeeffd640 1 -- 172.21.15.81:0/3975824035 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7faaf403bb90 con 0x7faaf81066d0 2024-09-12T01:19:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.710+0000 7faafffdb640 1 -- 172.21.15.81:0/3975824035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf8106b50 con 0x7faaf81066d0 2024-09-12T01:19:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.710+0000 7faaeeffd640 1 --2- 172.21.15.81:0/3975824035 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7faae4038eb0 0x7faae403b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.710+0000 7faaeeffd640 1 -- 172.21.15.81:0/3975824035 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7faaf406c5b0 con 0x7faaf81066d0 2024-09-12T01:19:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.710+0000 7faafd576640 1 --2- 172.21.15.81:0/3975824035 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7faae4038eb0 0x7faae403b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.711+0000 7faafd576640 1 --2- 172.21.15.81:0/3975824035 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7faae4038eb0 0x7faae403b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faae80098c0 tx=0x7faae8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.715+0000 7faaeeffd640 1 -- 172.21.15.81:0/3975824035 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faaf404a200 con 0x7faaf81066d0 2024-09-12T01:19:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.803+0000 7faaeeffd640 1 -- 172.21.15.81:0/3975824035 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7faaf403b420 con 0x7faaf81066d0 2024-09-12T01:19:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.903+0000 7faafffdb640 1 -- 172.21.15.81:0/3975824035 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7faaf81031c0 con 0x7faae4038eb0 2024-09-12T01:19:28.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.953+0000 7faaeeffd640 1 -- 172.21.15.81:0/3975824035 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7faaf81031c0 con 0x7faae4038eb0 2024-09-12T01:19:28.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.955+0000 7faafffdb640 1 -- 172.21.15.81:0/3975824035 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7faae4038eb0 msgr2=0x7faae403b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:28.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.955+0000 7faafffdb640 1 --2- 172.21.15.81:0/3975824035 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7faae4038eb0 0x7faae403b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faae80098c0 tx=0x7faae8006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:28.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.955+0000 7faafffdb640 1 -- 172.21.15.81:0/3975824035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 msgr2=0x7faaf807b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:28.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.955+0000 7faafffdb640 1 --2- 172.21.15.81:0/3975824035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 0x7faaf807b9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faaf4030560 tx=0x7faaf4032670 comp rx=0 tx=0).stop 2024-09-12T01:19:28.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.955+0000 7faafffdb640 1 -- 172.21.15.81:0/3975824035 shutdown_connections 2024-09-12T01:19:28.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.955+0000 7faafffdb640 1 --2- 172.21.15.81:0/3975824035 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7faae4038eb0 0x7faae403b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:28.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.955+0000 7faafffdb640 1 --2- 172.21.15.81:0/3975824035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf81066d0 0x7faaf807b9d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:28.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.955+0000 7faafffdb640 1 -- 172.21.15.81:0/3975824035 >> 172.21.15.81:0/3975824035 conn(0x7faaf8101e60 msgr2=0x7faaf8102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:28.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.955+0000 7faafffdb640 1 -- 172.21.15.81:0/3975824035 shutdown_connections 2024-09-12T01:19:28.018 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:26.955+0000 7faafffdb640 1 -- 172.21.15.81:0/3975824035 wait complete. 2024-09-12T01:19:28.018 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial admin user... 2024-09-12T01:19:28.562 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:28 smithi081 ceph-mon[30920]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:29.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$S1ilSUrfaLI5W1tzv.YX5eUohqMO87kpP08A5.TEOHg8odhquLyAG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726103968, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T01:19:29.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.385+0000 7f5396d83640 1 Processor -- start 2024-09-12T01:19:29.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.385+0000 7f5396d83640 1 -- start start 2024-09-12T01:19:29.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.385+0000 7f5396d83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 0x7f5390106ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:29.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.385+0000 7f5396d83640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53901070b0 con 0x7f53901066e0 2024-09-12T01:19:29.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.385+0000 7f5394b1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 0x7f5390106ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:29.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.385+0000 7f5394b1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 0x7f5390106ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51542/0 (socket says 172.21.15.81:51542) 2024-09-12T01:19:29.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.385+0000 7f5394b1f640 1 -- 172.21.15.81:0/2875379423 learned_addr learned my addr 172.21.15.81:0/2875379423 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:29.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.386+0000 7f5394b1f640 1 -- 172.21.15.81:0/2875379423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53901078e0 con 0x7f53901066e0 2024-09-12T01:19:29.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.386+0000 7f5394b1f640 1 --2- 172.21.15.81:0/2875379423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 0x7f5390106ae0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5384009820 tx=0x7f538402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f228abdf4fb8d7a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:29.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.386+0000 7f538f7fe640 1 -- 172.21.15.81:0/2875379423 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5384037070 con 0x7f53901066e0 2024-09-12T01:19:29.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.386+0000 7f538f7fe640 1 -- 172.21.15.81:0/2875379423 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5384032920 con 0x7f53901066e0 2024-09-12T01:19:29.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.386+0000 7f538f7fe640 1 -- 172.21.15.81:0/2875379423 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5384030810 con 0x7f53901066e0 2024-09-12T01:19:29.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.387+0000 7f5396d83640 1 -- 172.21.15.81:0/2875379423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 msgr2=0x7f5390106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:29.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.387+0000 7f5396d83640 1 --2- 172.21.15.81:0/2875379423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 0x7f5390106ae0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5384009820 tx=0x7f538402a270 comp rx=0 tx=0).stop 2024-09-12T01:19:29.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.387+0000 7f5396d83640 1 -- 172.21.15.81:0/2875379423 shutdown_connections 2024-09-12T01:19:29.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.387+0000 7f5396d83640 1 --2- 172.21.15.81:0/2875379423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 0x7f5390106ae0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:29.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.387+0000 7f5396d83640 1 -- 172.21.15.81:0/2875379423 >> 172.21.15.81:0/2875379423 conn(0x7f5390101ed0 msgr2=0x7f53901042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:29.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.387+0000 7f5396d83640 1 -- 172.21.15.81:0/2875379423 shutdown_connections 2024-09-12T01:19:29.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.387+0000 7f5396d83640 1 -- 172.21.15.81:0/2875379423 wait complete. 2024-09-12T01:19:29.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.388+0000 7f5396d83640 1 Processor -- start 2024-09-12T01:19:29.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.388+0000 7f5396d83640 1 -- start start 2024-09-12T01:19:29.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.388+0000 7f5396d83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 0x7f539007b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:29.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.388+0000 7f5396d83640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f539010ac90 con 0x7f53901066e0 2024-09-12T01:19:29.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.388+0000 7f5394b1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 0x7f539007b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:29.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.388+0000 7f5394b1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 0x7f539007b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51558/0 (socket says 172.21.15.81:51558) 2024-09-12T01:19:29.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.388+0000 7f5394b1f640 1 -- 172.21.15.81:0/2323722850 learned_addr learned my addr 172.21.15.81:0/2323722850 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:29.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.388+0000 7f5394b1f640 1 -- 172.21.15.81:0/2323722850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539019e510 con 0x7f53901066e0 2024-09-12T01:19:29.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.388+0000 7f5394b1f640 1 --2- 172.21.15.81:0/2323722850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 0x7f539007b9d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5384030560 tx=0x7f5384032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:29.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.388+0000 7f538dffb640 1 -- 172.21.15.81:0/2323722850 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5384037040 con 0x7f53901066e0 2024-09-12T01:19:29.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.388+0000 7f538dffb640 1 -- 172.21.15.81:0/2323722850 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5384040070 con 0x7f53901066e0 2024-09-12T01:19:29.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.388+0000 7f5396d83640 1 -- 172.21.15.81:0/2323722850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f539019e6e0 con 0x7f53901066e0 2024-09-12T01:19:29.422 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.388+0000 7f538dffb640 1 -- 172.21.15.81:0/2323722850 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f538403a740 con 0x7f53901066e0 2024-09-12T01:19:29.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.389+0000 7f5396d83640 1 -- 172.21.15.81:0/2323722850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f539019ea80 con 0x7f53901066e0 2024-09-12T01:19:29.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.389+0000 7f538dffb640 1 -- 172.21.15.81:0/2323722850 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f538403b420 con 0x7f53901066e0 2024-09-12T01:19:29.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.390+0000 7f538dffb640 1 --2- 172.21.15.81:0/2323722850 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5380038fc0 0x7f538003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:29.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.390+0000 7f5396d83640 1 -- 172.21.15.81:0/2323722850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5390106b60 con 0x7f53901066e0 2024-09-12T01:19:29.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.390+0000 7f538dffb640 1 -- 172.21.15.81:0/2323722850 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f538406c6d0 con 0x7f53901066e0 2024-09-12T01:19:29.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.390+0000 7f538ffff640 1 --2- 172.21.15.81:0/2323722850 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5380038fc0 0x7f538003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:29.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.390+0000 7f538ffff640 1 --2- 172.21.15.81:0/2323722850 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5380038fc0 0x7f538003b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f537c0098c0 tx=0x7f537c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:29.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.394+0000 7f538dffb640 1 -- 172.21.15.81:0/2323722850 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f538404a200 con 0x7f53901066e0 2024-09-12T01:19:29.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.577+0000 7f5396d83640 1 -- 172.21.15.81:0/2323722850 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f539019edc0 con 0x7f5380038fc0 2024-09-12T01:19:29.423 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.802+0000 7f538dffb640 1 -- 172.21.15.81:0/2323722850 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f539019edc0 con 0x7f5380038fc0 2024-09-12T01:19:29.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.804+0000 7f5396d83640 1 -- 172.21.15.81:0/2323722850 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5380038fc0 msgr2=0x7f538003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:29.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.804+0000 7f5396d83640 1 --2- 172.21.15.81:0/2323722850 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5380038fc0 0x7f538003b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f537c0098c0 tx=0x7f537c006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:29.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.804+0000 7f5396d83640 1 -- 172.21.15.81:0/2323722850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 msgr2=0x7f539007b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:29.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.804+0000 7f5396d83640 1 --2- 172.21.15.81:0/2323722850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 0x7f539007b9d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5384030560 tx=0x7f5384032670 comp rx=0 tx=0).stop 2024-09-12T01:19:29.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.804+0000 7f5396d83640 1 -- 172.21.15.81:0/2323722850 shutdown_connections 2024-09-12T01:19:29.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.804+0000 7f5396d83640 1 --2- 172.21.15.81:0/2323722850 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5380038fc0 0x7f538003b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:29.424 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.804+0000 7f5396d83640 1 --2- 172.21.15.81:0/2323722850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53901066e0 0x7f539007b9d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:29.425 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.804+0000 7f5396d83640 1 -- 172.21.15.81:0/2323722850 >> 172.21.15.81:0/2323722850 conn(0x7f5390101ed0 msgr2=0x7f5390102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:29.425 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.804+0000 7f5396d83640 1 -- 172.21.15.81:0/2323722850 shutdown_connections 2024-09-12T01:19:29.425 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:28.804+0000 7f5396d83640 1 -- 172.21.15.81:0/2323722850 wait complete. 2024-09-12T01:19:29.425 INFO:teuthology.orchestra.run.smithi081.stdout:Fetching dashboard port number... 2024-09-12T01:19:29.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:29 smithi081 ceph-mon[30920]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:29.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:29 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:30.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T01:19:30.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.842+0000 7f9dc1808640 1 Processor -- start 2024-09-12T01:19:30.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.842+0000 7f9dc1808640 1 -- start start 2024-09-12T01:19:30.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.842+0000 7f9dc1808640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 0x7f9dbc10a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:30.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.842+0000 7f9dc1808640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc07bdd0 con 0x7f9dbc1082a0 2024-09-12T01:19:30.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.843+0000 7f9dbaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 0x7f9dbc10a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:30.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.843+0000 7f9dbaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 0x7f9dbc10a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51574/0 (socket says 172.21.15.81:51574) 2024-09-12T01:19:30.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.843+0000 7f9dbaffd640 1 -- 172.21.15.81:0/558803512 learned_addr learned my addr 172.21.15.81:0/558803512 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:30.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.843+0000 7f9dbaffd640 1 -- 172.21.15.81:0/558803512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dbc10abd0 con 0x7f9dbc1082a0 2024-09-12T01:19:30.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.843+0000 7f9dbaffd640 1 --2- 172.21.15.81:0/558803512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 0x7f9dbc10a690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009820 tx=0x7f9dac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe7f4cd23550be7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:30.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.844+0000 7f9dba7fc640 1 -- 172.21.15.81:0/558803512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dac037070 con 0x7f9dbc1082a0 2024-09-12T01:19:30.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.844+0000 7f9dba7fc640 1 -- 172.21.15.81:0/558803512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dac032920 con 0x7f9dbc1082a0 2024-09-12T01:19:30.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.844+0000 7f9dba7fc640 1 -- 172.21.15.81:0/558803512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dac030810 con 0x7f9dbc1082a0 2024-09-12T01:19:30.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.844+0000 7f9dc1808640 1 -- 172.21.15.81:0/558803512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 msgr2=0x7f9dbc10a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:30.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.844+0000 7f9dc1808640 1 --2- 172.21.15.81:0/558803512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 0x7f9dbc10a690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009820 tx=0x7f9dac02a270 comp rx=0 tx=0).stop 2024-09-12T01:19:30.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.844+0000 7f9dc1808640 1 -- 172.21.15.81:0/558803512 shutdown_connections 2024-09-12T01:19:30.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.844+0000 7f9dc1808640 1 --2- 172.21.15.81:0/558803512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 0x7f9dbc10a690 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:30.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.844+0000 7f9dc1808640 1 -- 172.21.15.81:0/558803512 >> 172.21.15.81:0/558803512 conn(0x7f9dbc101e60 msgr2=0x7f9dbc1042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:30.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.844+0000 7f9dc1808640 1 -- 172.21.15.81:0/558803512 shutdown_connections 2024-09-12T01:19:30.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.844+0000 7f9dc1808640 1 -- 172.21.15.81:0/558803512 wait complete. 2024-09-12T01:19:30.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.845+0000 7f9dc1808640 1 Processor -- start 2024-09-12T01:19:30.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.845+0000 7f9dc1808640 1 -- start start 2024-09-12T01:19:30.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.845+0000 7f9dc1808640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 0x7f9dbc19b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:30.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.845+0000 7f9dc1808640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc10bbe0 con 0x7f9dbc1082a0 2024-09-12T01:19:30.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.845+0000 7f9dbaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 0x7f9dbc19b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:30.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.845+0000 7f9dbaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 0x7f9dbc19b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51578/0 (socket says 172.21.15.81:51578) 2024-09-12T01:19:30.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.845+0000 7f9dbaffd640 1 -- 172.21.15.81:0/2469609644 learned_addr learned my addr 172.21.15.81:0/2469609644 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:30.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.845+0000 7f9dbaffd640 1 -- 172.21.15.81:0/2469609644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dbc19bce0 con 0x7f9dbc1082a0 2024-09-12T01:19:30.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.846+0000 7f9dbaffd640 1 --2- 172.21.15.81:0/2469609644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 0x7f9dbc19b7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9dac030380 tx=0x7f9dac032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:30.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.846+0000 7f9dc0806640 1 -- 172.21.15.81:0/2469609644 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dac037040 con 0x7f9dbc1082a0 2024-09-12T01:19:30.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.846+0000 7f9dc1808640 1 -- 172.21.15.81:0/2469609644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dbc19bf70 con 0x7f9dbc1082a0 2024-09-12T01:19:30.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.846+0000 7f9dc0806640 1 -- 172.21.15.81:0/2469609644 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dac040070 con 0x7f9dbc1082a0 2024-09-12T01:19:30.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.846+0000 7f9dc0806640 1 -- 172.21.15.81:0/2469609644 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dac03a7b0 con 0x7f9dbc1082a0 2024-09-12T01:19:30.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.846+0000 7f9dc1808640 1 -- 172.21.15.81:0/2469609644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dbc19ec60 con 0x7f9dbc1082a0 2024-09-12T01:19:30.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.847+0000 7f9dc0806640 1 -- 172.21.15.81:0/2469609644 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f9dac03aa30 con 0x7f9dbc1082a0 2024-09-12T01:19:30.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.847+0000 7f9dc0806640 1 --2- 172.21.15.81:0/2469609644 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9da8038fc0 0x7f9da803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:30.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.847+0000 7f9dc0806640 1 -- 172.21.15.81:0/2469609644 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9dac06d7a0 con 0x7f9dbc1082a0 2024-09-12T01:19:30.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.847+0000 7f9db27fc640 1 --2- 172.21.15.81:0/2469609644 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9da8038fc0 0x7f9da803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:30.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.847+0000 7f9dc1808640 1 -- 172.21.15.81:0/2469609644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dbc108700 con 0x7f9dbc1082a0 2024-09-12T01:19:30.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.847+0000 7f9db27fc640 1 --2- 172.21.15.81:0/2469609644 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9da8038fc0 0x7f9da803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9da40098c0 tx=0x7f9da4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:30.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:29.852+0000 7f9dc0806640 1 -- 172.21.15.81:0/2469609644 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9dac044c70 con 0x7f9dbc1082a0 2024-09-12T01:19:30.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:30.020+0000 7f9dc1808640 1 -- 172.21.15.81:0/2469609644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f9dbc19f190 con 0x7f9dbc1082a0 2024-09-12T01:19:30.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:30.021+0000 7f9dc0806640 1 -- 172.21.15.81:0/2469609644 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f9dac041270 con 0x7f9dbc1082a0 2024-09-12T01:19:30.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:30.023+0000 7f9dc1808640 1 -- 172.21.15.81:0/2469609644 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9da8038fc0 msgr2=0x7f9da803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:30.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:30.023+0000 7f9dc1808640 1 --2- 172.21.15.81:0/2469609644 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9da8038fc0 0x7f9da803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9da40098c0 tx=0x7f9da4006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:30.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:30.023+0000 7f9dc1808640 1 -- 172.21.15.81:0/2469609644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 msgr2=0x7f9dbc19b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:30.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:30.023+0000 7f9dc1808640 1 --2- 172.21.15.81:0/2469609644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 0x7f9dbc19b7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9dac030380 tx=0x7f9dac032670 comp rx=0 tx=0).stop 2024-09-12T01:19:30.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:30.023+0000 7f9dc1808640 1 -- 172.21.15.81:0/2469609644 shutdown_connections 2024-09-12T01:19:30.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:30.023+0000 7f9dc1808640 1 --2- 172.21.15.81:0/2469609644 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9da8038fc0 0x7f9da803b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:30.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:30.023+0000 7f9dc1808640 1 --2- 172.21.15.81:0/2469609644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dbc1082a0 0x7f9dbc19b7a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:30.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:30.023+0000 7f9dc1808640 1 -- 172.21.15.81:0/2469609644 >> 172.21.15.81:0/2469609644 conn(0x7f9dbc101e60 msgr2=0x7f9dbc102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:30.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:30.023+0000 7f9dc1808640 1 -- 172.21.15.81:0/2469609644 shutdown_connections 2024-09-12T01:19:30.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:30.023+0000 7f9dc1808640 1 -- 172.21.15.81:0/2469609644 wait complete. 2024-09-12T01:19:30.597 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:19:30.597 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-12T01:19:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:19:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-12T01:19:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-12T01:19:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T01:19:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph Dashboard is now available at: 2024-09-12T01:19:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:19:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: URL: https://smithi081.front.sepia.ceph.com:8443/ 2024-09-12T01:19:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: User: admin 2024-09-12T01:19:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: Password: gg9jbxlr1h 2024-09-12T01:19:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:19:30.607 INFO:teuthology.orchestra.run.smithi081.stdout:Saving cluster configuration to /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config directory 2024-09-12T01:19:30.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:30 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2469609644' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T01:19:31.855 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:31 smithi081 ceph-mon[30920]: mgrmap e13: x(active, since 6s) 2024-09-12T01:19:31.856 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:31 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/943283928' entity='client.admin' 2024-09-12T01:19:31.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.007+0000 7ff45b983640 1 Processor -- start 2024-09-12T01:19:31.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.007+0000 7ff45b983640 1 -- start start 2024-09-12T01:19:31.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.007+0000 7ff45b983640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 0x7ff45407c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:31.863 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.007+0000 7ff45b983640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff45407c850 con 0x7ff45407de20 2024-09-12T01:19:31.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.007+0000 7ff45971f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 0x7ff45407c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:31.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.007+0000 7ff45971f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 0x7ff45407c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51594/0 (socket says 172.21.15.81:51594) 2024-09-12T01:19:31.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.007+0000 7ff45971f640 1 -- 172.21.15.81:0/1774003555 learned_addr learned my addr 172.21.15.81:0/1774003555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:31.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.008+0000 7ff45971f640 1 -- 172.21.15.81:0/1774003555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45407c9d0 con 0x7ff45407de20 2024-09-12T01:19:31.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.008+0000 7ff45971f640 1 --2- 172.21.15.81:0/1774003555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 0x7ff45407c280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff450009820 tx=0x7ff45002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40e0dfd5d3bdbb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:31.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.008+0000 7ff44bfff640 1 -- 172.21.15.81:0/1774003555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff450037070 con 0x7ff45407de20 2024-09-12T01:19:31.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.008+0000 7ff44bfff640 1 -- 172.21.15.81:0/1774003555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff450032920 con 0x7ff45407de20 2024-09-12T01:19:31.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.008+0000 7ff44bfff640 1 -- 172.21.15.81:0/1774003555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff450030810 con 0x7ff45407de20 2024-09-12T01:19:31.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.009+0000 7ff45b983640 1 -- 172.21.15.81:0/1774003555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 msgr2=0x7ff45407c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:31.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.009+0000 7ff45b983640 1 --2- 172.21.15.81:0/1774003555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 0x7ff45407c280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff450009820 tx=0x7ff45002a270 comp rx=0 tx=0).stop 2024-09-12T01:19:31.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.009+0000 7ff45b983640 1 -- 172.21.15.81:0/1774003555 shutdown_connections 2024-09-12T01:19:31.864 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.009+0000 7ff45b983640 1 --2- 172.21.15.81:0/1774003555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 0x7ff45407c280 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.009+0000 7ff45b983640 1 -- 172.21.15.81:0/1774003555 >> 172.21.15.81:0/1774003555 conn(0x7ff454102f60 msgr2=0x7ff4541053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.009+0000 7ff45b983640 1 -- 172.21.15.81:0/1774003555 shutdown_connections 2024-09-12T01:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.009+0000 7ff45b983640 1 -- 172.21.15.81:0/1774003555 wait complete. 2024-09-12T01:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff45b983640 1 Processor -- start 2024-09-12T01:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff45b983640 1 -- start start 2024-09-12T01:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff45b983640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 0x7ff45419d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff45b983640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff45410de30 con 0x7ff45407de20 2024-09-12T01:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff45971f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 0x7ff45419d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff45971f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 0x7ff45419d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51610/0 (socket says 172.21.15.81:51610) 2024-09-12T01:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff45971f640 1 -- 172.21.15.81:0/943283928 learned_addr learned my addr 172.21.15.81:0/943283928 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff45971f640 1 -- 172.21.15.81:0/943283928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45419df30 con 0x7ff45407de20 2024-09-12T01:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff45971f640 1 --2- 172.21.15.81:0/943283928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 0x7ff45419d9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff450030380 tx=0x7ff450032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff44a7fc640 1 -- 172.21.15.81:0/943283928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff450037040 con 0x7ff45407de20 2024-09-12T01:19:31.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff44a7fc640 1 -- 172.21.15.81:0/943283928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff450040070 con 0x7ff45407de20 2024-09-12T01:19:31.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff45b983640 1 -- 172.21.15.81:0/943283928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45419e1c0 con 0x7ff45407de20 2024-09-12T01:19:31.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff44a7fc640 1 -- 172.21.15.81:0/943283928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff45003a7b0 con 0x7ff45407de20 2024-09-12T01:19:31.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.010+0000 7ff45b983640 1 -- 172.21.15.81:0/943283928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4541a0eb0 con 0x7ff45407de20 2024-09-12T01:19:31.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.011+0000 7ff44a7fc640 1 -- 172.21.15.81:0/943283928 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff45003a9e0 con 0x7ff45407de20 2024-09-12T01:19:31.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.011+0000 7ff44a7fc640 1 --2- 172.21.15.81:0/943283928 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff4400390c0 0x7ff44003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:31.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.011+0000 7ff44a7fc640 1 -- 172.21.15.81:0/943283928 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff45006c830 con 0x7ff45407de20 2024-09-12T01:19:31.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.011+0000 7ff45b983640 1 -- 172.21.15.81:0/943283928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45407c300 con 0x7ff45407de20 2024-09-12T01:19:31.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.012+0000 7ff458f1e640 1 --2- 172.21.15.81:0/943283928 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff4400390c0 0x7ff44003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:31.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.012+0000 7ff458f1e640 1 --2- 172.21.15.81:0/943283928 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff4400390c0 0x7ff44003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff4440098c0 tx=0x7ff444006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:31.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.016+0000 7ff44a7fc640 1 -- 172.21.15.81:0/943283928 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff4500313a0 con 0x7ff45407de20 2024-09-12T01:19:31.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.268+0000 7ff45b983640 1 -- 172.21.15.81:0/943283928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7ff4541a1080 con 0x7ff45407de20 2024-09-12T01:19:31.866 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.270+0000 7ff44a7fc640 1 -- 172.21.15.81:0/943283928 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7ff45004a200 con 0x7ff45407de20 2024-09-12T01:19:31.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T01:19:31.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.272+0000 7ff45b983640 1 -- 172.21.15.81:0/943283928 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff4400390c0 msgr2=0x7ff44003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:31.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.272+0000 7ff45b983640 1 --2- 172.21.15.81:0/943283928 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff4400390c0 0x7ff44003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff4440098c0 tx=0x7ff444006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:31.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.272+0000 7ff45b983640 1 -- 172.21.15.81:0/943283928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 msgr2=0x7ff45419d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:31.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.272+0000 7ff45b983640 1 --2- 172.21.15.81:0/943283928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 0x7ff45419d9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff450030380 tx=0x7ff450032670 comp rx=0 tx=0).stop 2024-09-12T01:19:31.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.272+0000 7ff45b983640 1 -- 172.21.15.81:0/943283928 shutdown_connections 2024-09-12T01:19:31.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.272+0000 7ff45b983640 1 --2- 172.21.15.81:0/943283928 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff4400390c0 0x7ff44003b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:31.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.272+0000 7ff45b983640 1 --2- 172.21.15.81:0/943283928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff45407de20 0x7ff45419d9f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:31.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.272+0000 7ff45b983640 1 -- 172.21.15.81:0/943283928 >> 172.21.15.81:0/943283928 conn(0x7ff454102f60 msgr2=0x7ff454103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:31.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.272+0000 7ff45b983640 1 -- 172.21.15.81:0/943283928 shutdown_connections 2024-09-12T01:19:31.867 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T01:19:31.272+0000 7ff45b983640 1 -- 172.21.15.81:0/943283928 wait complete. 2024-09-12T01:19:31.867 INFO:teuthology.orchestra.run.smithi081.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T01:19:31.867 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:19:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:19:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:19:31.868 INFO:teuthology.orchestra.run.smithi081.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T01:19:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:19:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T01:19:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:19:31.868 INFO:teuthology.orchestra.run.smithi081.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T01:19:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:19:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: ceph telemetry on 2024-09-12T01:19:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:19:31.868 INFO:teuthology.orchestra.run.smithi081.stdout:For more information see: 2024-09-12T01:19:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:19:31.868 INFO:teuthology.orchestra.run.smithi081.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T01:19:31.869 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:19:31.869 INFO:teuthology.orchestra.run.smithi081.stdout:Bootstrap complete. 2024-09-12T01:19:31.905 INFO:tasks.cephadm:Fetching config... 2024-09-12T01:19:31.905 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:19:31.905 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T01:19:31.922 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T01:19:31.922 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:19:31.922 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T01:19:31.977 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T01:19:31.978 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:19:31.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T01:19:32.042 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T01:19:32.043 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:19:32.043 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T01:19:32.098 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T01:19:32.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqFwz/ACwFlc9WMPva8dQUSBme35kSQAXLa/KXyj0tEnrTPtn+iLJhVoCj7ESaNUTGaEBq0Ir6PJl/GKLdqy1zgEC+nK/rRzmxgeSf1KToutGVDmvz7oD+i2J0LTQnLlBR/f7y/RcNHqj8RBa2hReQTuiOa7V2QZdmuHPoNsiFayuvLCLotJlcVgNAhLyQeYIQlY9A9CPgSfXUp5nOQnzG0kJzjuLlMNkey2KqjlcKJ9GByhCgs8gGPSH58yj8tyE8S6wxd0+a6z2ueNz0++EK8A7uwi0kP8dDHN21uxZOlU6fH/TpBRfy/X0jbIAiLH3skAT1x1kYRubt6uQs1cUtiEnh7yQLMiK7/itVtvZqKo4qkrcjUMHtUNx5C6C9MwAkeH1XG7BkmnaVG/aL1U4H8QQlCohG2bRe/GPjrTdC1NVb8bnaddHv7Lww/C0U/nKzMHdB3kqOstuisfDQ0rJiZmGOujn8BsM6gPOnWjKnGeOJpFqNXkXRfre1rh787ts= ceph-c1ee9932-70a4-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:19:32.174 INFO:teuthology.orchestra.run.smithi081.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqFwz/ACwFlc9WMPva8dQUSBme35kSQAXLa/KXyj0tEnrTPtn+iLJhVoCj7ESaNUTGaEBq0Ir6PJl/GKLdqy1zgEC+nK/rRzmxgeSf1KToutGVDmvz7oD+i2J0LTQnLlBR/f7y/RcNHqj8RBa2hReQTuiOa7V2QZdmuHPoNsiFayuvLCLotJlcVgNAhLyQeYIQlY9A9CPgSfXUp5nOQnzG0kJzjuLlMNkey2KqjlcKJ9GByhCgs8gGPSH58yj8tyE8S6wxd0+a6z2ueNz0++EK8A7uwi0kP8dDHN21uxZOlU6fH/TpBRfy/X0jbIAiLH3skAT1x1kYRubt6uQs1cUtiEnh7yQLMiK7/itVtvZqKo4qkrcjUMHtUNx5C6C9MwAkeH1XG7BkmnaVG/aL1U4H8QQlCohG2bRe/GPjrTdC1NVb8bnaddHv7Lww/C0U/nKzMHdB3kqOstuisfDQ0rJiZmGOujn8BsM6gPOnWjKnGeOJpFqNXkXRfre1rh787ts= ceph-c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:19:32.185 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqFwz/ACwFlc9WMPva8dQUSBme35kSQAXLa/KXyj0tEnrTPtn+iLJhVoCj7ESaNUTGaEBq0Ir6PJl/GKLdqy1zgEC+nK/rRzmxgeSf1KToutGVDmvz7oD+i2J0LTQnLlBR/f7y/RcNHqj8RBa2hReQTuiOa7V2QZdmuHPoNsiFayuvLCLotJlcVgNAhLyQeYIQlY9A9CPgSfXUp5nOQnzG0kJzjuLlMNkey2KqjlcKJ9GByhCgs8gGPSH58yj8tyE8S6wxd0+a6z2ueNz0++EK8A7uwi0kP8dDHN21uxZOlU6fH/TpBRfy/X0jbIAiLH3skAT1x1kYRubt6uQs1cUtiEnh7yQLMiK7/itVtvZqKo4qkrcjUMHtUNx5C6C9MwAkeH1XG7BkmnaVG/aL1U4H8QQlCohG2bRe/GPjrTdC1NVb8bnaddHv7Lww/C0U/nKzMHdB3kqOstuisfDQ0rJiZmGOujn8BsM6gPOnWjKnGeOJpFqNXkXRfre1rh787ts= ceph-c1ee9932-70a4-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:19:32.226 INFO:teuthology.orchestra.run.smithi100.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqFwz/ACwFlc9WMPva8dQUSBme35kSQAXLa/KXyj0tEnrTPtn+iLJhVoCj7ESaNUTGaEBq0Ir6PJl/GKLdqy1zgEC+nK/rRzmxgeSf1KToutGVDmvz7oD+i2J0LTQnLlBR/f7y/RcNHqj8RBa2hReQTuiOa7V2QZdmuHPoNsiFayuvLCLotJlcVgNAhLyQeYIQlY9A9CPgSfXUp5nOQnzG0kJzjuLlMNkey2KqjlcKJ9GByhCgs8gGPSH58yj8tyE8S6wxd0+a6z2ueNz0++EK8A7uwi0kP8dDHN21uxZOlU6fH/TpBRfy/X0jbIAiLH3skAT1x1kYRubt6uQs1cUtiEnh7yQLMiK7/itVtvZqKo4qkrcjUMHtUNx5C6C9MwAkeH1XG7BkmnaVG/aL1U4H8QQlCohG2bRe/GPjrTdC1NVb8bnaddHv7Lww/C0U/nKzMHdB3kqOstuisfDQ0rJiZmGOujn8BsM6gPOnWjKnGeOJpFqNXkXRfre1rh787ts= ceph-c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:19:32.239 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqFwz/ACwFlc9WMPva8dQUSBme35kSQAXLa/KXyj0tEnrTPtn+iLJhVoCj7ESaNUTGaEBq0Ir6PJl/GKLdqy1zgEC+nK/rRzmxgeSf1KToutGVDmvz7oD+i2J0LTQnLlBR/f7y/RcNHqj8RBa2hReQTuiOa7V2QZdmuHPoNsiFayuvLCLotJlcVgNAhLyQeYIQlY9A9CPgSfXUp5nOQnzG0kJzjuLlMNkey2KqjlcKJ9GByhCgs8gGPSH58yj8tyE8S6wxd0+a6z2ueNz0++EK8A7uwi0kP8dDHN21uxZOlU6fH/TpBRfy/X0jbIAiLH3skAT1x1kYRubt6uQs1cUtiEnh7yQLMiK7/itVtvZqKo4qkrcjUMHtUNx5C6C9MwAkeH1XG7BkmnaVG/aL1U4H8QQlCohG2bRe/GPjrTdC1NVb8bnaddHv7Lww/C0U/nKzMHdB3kqOstuisfDQ0rJiZmGOujn8BsM6gPOnWjKnGeOJpFqNXkXRfre1rh787ts= ceph-c1ee9932-70a4-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:19:32.281 INFO:teuthology.orchestra.run.smithi189.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqFwz/ACwFlc9WMPva8dQUSBme35kSQAXLa/KXyj0tEnrTPtn+iLJhVoCj7ESaNUTGaEBq0Ir6PJl/GKLdqy1zgEC+nK/rRzmxgeSf1KToutGVDmvz7oD+i2J0LTQnLlBR/f7y/RcNHqj8RBa2hReQTuiOa7V2QZdmuHPoNsiFayuvLCLotJlcVgNAhLyQeYIQlY9A9CPgSfXUp5nOQnzG0kJzjuLlMNkey2KqjlcKJ9GByhCgs8gGPSH58yj8tyE8S6wxd0+a6z2ueNz0++EK8A7uwi0kP8dDHN21uxZOlU6fH/TpBRfy/X0jbIAiLH3skAT1x1kYRubt6uQs1cUtiEnh7yQLMiK7/itVtvZqKo4qkrcjUMHtUNx5C6C9MwAkeH1XG7BkmnaVG/aL1U4H8QQlCohG2bRe/GPjrTdC1NVb8bnaddHv7Lww/C0U/nKzMHdB3kqOstuisfDQ0rJiZmGOujn8BsM6gPOnWjKnGeOJpFqNXkXRfre1rh787ts= ceph-c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:19:32.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T01:19:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:19:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.023+0000 7f37056c2640 1 -- 172.21.15.81:0/2590741899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3700100510 msgr2=0x7f3700100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.023+0000 7f37056c2640 1 --2- 172.21.15.81:0/2590741899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3700100510 0x7f3700100910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009880 tx=0x7f36f002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:19:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.023+0000 7f37056c2640 1 -- 172.21.15.81:0/2590741899 shutdown_connections 2024-09-12T01:19:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.023+0000 7f37056c2640 1 --2- 172.21.15.81:0/2590741899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3700100510 0x7f3700100910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.023+0000 7f37056c2640 1 -- 172.21.15.81:0/2590741899 >> 172.21.15.81:0/2590741899 conn(0x7f37000fbc80 msgr2=0x7f37000fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.023+0000 7f37056c2640 1 -- 172.21.15.81:0/2590741899 shutdown_connections 2024-09-12T01:19:33.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.023+0000 7f37056c2640 1 -- 172.21.15.81:0/2590741899 wait complete. 2024-09-12T01:19:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.024+0000 7f37056c2640 1 Processor -- start 2024-09-12T01:19:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.024+0000 7f37056c2640 1 -- start start 2024-09-12T01:19:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.024+0000 7f37056c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3700100510 0x7f370006a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.024+0000 7f37056c2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3700106620 con 0x7f3700100510 2024-09-12T01:19:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.024+0000 7f36feffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3700100510 0x7f370006a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.024+0000 7f36feffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3700100510 0x7f370006a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59836/0 (socket says 172.21.15.81:59836) 2024-09-12T01:19:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.024+0000 7f36feffd640 1 -- 172.21.15.81:0/3822274841 learned_addr learned my addr 172.21.15.81:0/3822274841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.024+0000 7f36feffd640 1 -- 172.21.15.81:0/3822274841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3700199ae0 con 0x7f3700100510 2024-09-12T01:19:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.025+0000 7f36feffd640 1 --2- 172.21.15.81:0/3822274841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3700100510 0x7f370006a950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f36f0004f60 tx=0x7f36f00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.025+0000 7f36fcff9640 1 -- 172.21.15.81:0/3822274841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36f003f070 con 0x7f3700100510 2024-09-12T01:19:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.025+0000 7f36fcff9640 1 -- 172.21.15.81:0/3822274841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f0004d40 con 0x7f3700100510 2024-09-12T01:19:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.025+0000 7f37056c2640 1 -- 172.21.15.81:0/3822274841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3700199cb0 con 0x7f3700100510 2024-09-12T01:19:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.025+0000 7f36fcff9640 1 -- 172.21.15.81:0/3822274841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36f0035030 con 0x7f3700100510 2024-09-12T01:19:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.025+0000 7f37056c2640 1 -- 172.21.15.81:0/3822274841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f370019a050 con 0x7f3700100510 2024-09-12T01:19:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.026+0000 7f37056c2640 1 -- 172.21.15.81:0/3822274841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3700106da0 con 0x7f3700100510 2024-09-12T01:19:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.026+0000 7f36fcff9640 1 -- 172.21.15.81:0/3822274841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f36f0042070 con 0x7f3700100510 2024-09-12T01:19:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.026+0000 7f36fcff9640 1 --2- 172.21.15.81:0/3822274841 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f36ec0390c0 0x7f36ec03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.026+0000 7f36fcff9640 1 -- 172.21.15.81:0/3822274841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f36f006ccc0 con 0x7f3700100510 2024-09-12T01:19:33.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.026+0000 7f36f7fff640 1 --2- 172.21.15.81:0/3822274841 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f36ec0390c0 0x7f36ec03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:33.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.027+0000 7f36f7fff640 1 --2- 172.21.15.81:0/3822274841 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f36ec0390c0 0x7f36ec03b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f36e80098c0 tx=0x7f36e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:33.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.031+0000 7f36fcff9640 1 -- 172.21.15.81:0/3822274841 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36f004a260 con 0x7f3700100510 2024-09-12T01:19:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.199+0000 7f37056c2640 1 -- 172.21.15.81:0/3822274841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f370018f3e0 con 0x7f3700100510 2024-09-12T01:19:33.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.201+0000 7f36fcff9640 1 -- 172.21.15.81:0/3822274841 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f36f00035f0 con 0x7f3700100510 2024-09-12T01:19:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.204+0000 7f37056c2640 1 -- 172.21.15.81:0/3822274841 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f36ec0390c0 msgr2=0x7f36ec03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.204+0000 7f37056c2640 1 --2- 172.21.15.81:0/3822274841 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f36ec0390c0 0x7f36ec03b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f36e80098c0 tx=0x7f36e8006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.204+0000 7f37056c2640 1 -- 172.21.15.81:0/3822274841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3700100510 msgr2=0x7f370006a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.204+0000 7f37056c2640 1 --2- 172.21.15.81:0/3822274841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3700100510 0x7f370006a950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f36f0004f60 tx=0x7f36f00048f0 comp rx=0 tx=0).stop 2024-09-12T01:19:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.204+0000 7f37056c2640 1 -- 172.21.15.81:0/3822274841 shutdown_connections 2024-09-12T01:19:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.204+0000 7f37056c2640 1 --2- 172.21.15.81:0/3822274841 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f36ec0390c0 0x7f36ec03b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.204+0000 7f37056c2640 1 --2- 172.21.15.81:0/3822274841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3700100510 0x7f370006a950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.204+0000 7f37056c2640 1 -- 172.21.15.81:0/3822274841 >> 172.21.15.81:0/3822274841 conn(0x7f37000fbc80 msgr2=0x7f37000fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.204+0000 7f37056c2640 1 -- 172.21.15.81:0/3822274841 shutdown_connections 2024-09-12T01:19:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:33.204+0000 7f37056c2640 1 -- 172.21.15.81:0/3822274841 wait complete. 2024-09-12T01:19:34.485 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:34 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3822274841' entity='client.admin' 2024-09-12T01:19:34.485 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:34.485 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:34.485 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:19:34.485 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:34.485 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:19:34.485 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:34.569 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T01:19:34.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T01:19:35.378 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:19:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.824+0000 7feeffccf640 1 -- 172.21.15.81:0/3642316679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feef8100510 msgr2=0x7feef8100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.824+0000 7feeffccf640 1 --2- 172.21.15.81:0/3642316679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feef8100510 0x7feef8100910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feef4009c20 tx=0x7feef402aa90 comp rx=0 tx=0).stop 2024-09-12T01:19:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.824+0000 7feeffccf640 1 -- 172.21.15.81:0/3642316679 shutdown_connections 2024-09-12T01:19:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.824+0000 7feeffccf640 1 --2- 172.21.15.81:0/3642316679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feef8100510 0x7feef8100910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.824+0000 7feeffccf640 1 -- 172.21.15.81:0/3642316679 >> 172.21.15.81:0/3642316679 conn(0x7feef80fbc80 msgr2=0x7feef80fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.824+0000 7feeffccf640 1 -- 172.21.15.81:0/3642316679 shutdown_connections 2024-09-12T01:19:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.824+0000 7feeffccf640 1 -- 172.21.15.81:0/3642316679 wait complete. 2024-09-12T01:19:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.825+0000 7feeffccf640 1 Processor -- start 2024-09-12T01:19:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.825+0000 7feeffccf640 1 -- start start 2024-09-12T01:19:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.825+0000 7feeffccf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feef8100510 0x7feef8196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.825+0000 7feeffccf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feef8106620 con 0x7feef8100510 2024-09-12T01:19:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.825+0000 7feefda6b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feef8100510 0x7feef8196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.825+0000 7feefda6b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feef8100510 0x7feef8196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59850/0 (socket says 172.21.15.81:59850) 2024-09-12T01:19:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.825+0000 7feefda6b640 1 -- 172.21.15.81:0/1037022353 learned_addr learned my addr 172.21.15.81:0/1037022353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.825+0000 7feefda6b640 1 -- 172.21.15.81:0/1037022353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef81972e0 con 0x7feef8100510 2024-09-12T01:19:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.826+0000 7feefda6b640 1 --2- 172.21.15.81:0/1037022353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feef8100510 0x7feef8196da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feef4005cc0 tx=0x7feef402fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:35.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.826+0000 7feeeeffd640 1 -- 172.21.15.81:0/1037022353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef4047070 con 0x7feef8100510 2024-09-12T01:19:35.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.826+0000 7feeeeffd640 1 -- 172.21.15.81:0/1037022353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feef4003e50 con 0x7feef8100510 2024-09-12T01:19:35.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.826+0000 7feeffccf640 1 -- 172.21.15.81:0/1037022353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef8197570 con 0x7feef8100510 2024-09-12T01:19:35.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.826+0000 7feeeeffd640 1 -- 172.21.15.81:0/1037022353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef4033050 con 0x7feef8100510 2024-09-12T01:19:35.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.826+0000 7feeffccf640 1 -- 172.21.15.81:0/1037022353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef819a260 con 0x7feef8100510 2024-09-12T01:19:35.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.827+0000 7feeeeffd640 1 -- 172.21.15.81:0/1037022353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7feef404a070 con 0x7feef8100510 2024-09-12T01:19:35.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.827+0000 7feeffccf640 1 -- 172.21.15.81:0/1037022353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feef8106da0 con 0x7feef8100510 2024-09-12T01:19:35.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.827+0000 7feeeeffd640 1 --2- 172.21.15.81:0/1037022353 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7feee40390c0 0x7feee403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:35.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.827+0000 7feeeeffd640 1 -- 172.21.15.81:0/1037022353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7feef403e030 con 0x7feef8100510 2024-09-12T01:19:35.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.827+0000 7feefd26a640 1 --2- 172.21.15.81:0/1037022353 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7feee40390c0 0x7feee403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:35.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.827+0000 7feefd26a640 1 --2- 172.21.15.81:0/1037022353 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7feee40390c0 0x7feee403b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feee80098c0 tx=0x7feee8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:35.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:35.832+0000 7feeeeffd640 1 -- 172.21.15.81:0/1037022353 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feef4001250 con 0x7feef8100510 2024-09-12T01:19:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:36.000+0000 7feeffccf640 1 -- 172.21.15.81:0/1037022353 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7feef80fd4b0 con 0x7feee40390c0 2024-09-12T01:19:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:36.003+0000 7feeeeffd640 1 -- 172.21.15.81:0/1037022353 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7feef80fd4b0 con 0x7feee40390c0 2024-09-12T01:19:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:36.006+0000 7feeffccf640 1 -- 172.21.15.81:0/1037022353 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7feee40390c0 msgr2=0x7feee403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:36.006+0000 7feeffccf640 1 --2- 172.21.15.81:0/1037022353 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7feee40390c0 0x7feee403b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feee80098c0 tx=0x7feee8006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:36.006+0000 7feeffccf640 1 -- 172.21.15.81:0/1037022353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feef8100510 msgr2=0x7feef8196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:36.006+0000 7feeffccf640 1 --2- 172.21.15.81:0/1037022353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feef8100510 0x7feef8196da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feef4005cc0 tx=0x7feef402fc10 comp rx=0 tx=0).stop 2024-09-12T01:19:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:36.006+0000 7feeffccf640 1 -- 172.21.15.81:0/1037022353 shutdown_connections 2024-09-12T01:19:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:36.006+0000 7feeffccf640 1 --2- 172.21.15.81:0/1037022353 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7feee40390c0 0x7feee403b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:36.006+0000 7feeffccf640 1 --2- 172.21.15.81:0/1037022353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feef8100510 0x7feef8196da0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:36.006+0000 7feeffccf640 1 -- 172.21.15.81:0/1037022353 >> 172.21.15.81:0/1037022353 conn(0x7feef80fbc80 msgr2=0x7feef80fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:36.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:36.006+0000 7feeffccf640 1 -- 172.21.15.81:0/1037022353 shutdown_connections 2024-09-12T01:19:36.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:36.006+0000 7feeffccf640 1 -- 172.21.15.81:0/1037022353 wait complete. 2024-09-12T01:19:36.861 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi100 2024-09-12T01:19:36.861 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:19:36.861 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/etc/ceph/ceph.conf 2024-09-12T01:19:36.880 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:19:36.880 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:19:36.938 INFO:tasks.cephadm:Adding host smithi100 to orchestrator... 2024-09-12T01:19:36.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch host add smithi100 2024-09-12T01:19:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:19:37.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:37 smithi081 ceph-mon[30920]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:37.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:37.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:19:37.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:19:37.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:19:37.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:37 smithi081 ceph-mon[30920]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T01:19:37.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:37 smithi081 ceph-mon[30920]: Updating smithi081:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:19:37.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:37 smithi081 ceph-mon[30920]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:19:37.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:37.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:37.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.607+0000 7efcbddcd640 1 -- 172.21.15.81:0/710200086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb8106540 msgr2=0x7efcb8106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.607+0000 7efcbddcd640 1 --2- 172.21.15.81:0/710200086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb8106540 0x7efcb8106920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efca8009810 tx=0x7efca802a540 comp rx=0 tx=0).stop 2024-09-12T01:19:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.607+0000 7efcbddcd640 1 -- 172.21.15.81:0/710200086 shutdown_connections 2024-09-12T01:19:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.607+0000 7efcbddcd640 1 --2- 172.21.15.81:0/710200086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb8106540 0x7efcb8106920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.607+0000 7efcbddcd640 1 -- 172.21.15.81:0/710200086 >> 172.21.15.81:0/710200086 conn(0x7efcb8077310 msgr2=0x7efcb80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.607+0000 7efcbddcd640 1 -- 172.21.15.81:0/710200086 shutdown_connections 2024-09-12T01:19:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.607+0000 7efcbddcd640 1 -- 172.21.15.81:0/710200086 wait complete. 2024-09-12T01:19:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.607+0000 7efcbddcd640 1 Processor -- start 2024-09-12T01:19:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.607+0000 7efcbddcd640 1 -- start start 2024-09-12T01:19:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.608+0000 7efcbddcd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb8106540 0x7efcb8197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.608+0000 7efcbddcd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efcb810ab70 con 0x7efcb8106540 2024-09-12T01:19:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.608+0000 7efcb77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb8106540 0x7efcb8197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.608+0000 7efcb77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb8106540 0x7efcb8197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59874/0 (socket says 172.21.15.81:59874) 2024-09-12T01:19:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.608+0000 7efcb77fe640 1 -- 172.21.15.81:0/2730178373 learned_addr learned my addr 172.21.15.81:0/2730178373 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.608+0000 7efcb77fe640 1 -- 172.21.15.81:0/2730178373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb8198510 con 0x7efcb8106540 2024-09-12T01:19:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.608+0000 7efcb77fe640 1 --2- 172.21.15.81:0/2730178373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb8106540 0x7efcb8197fd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efca80045e0 tx=0x7efca8004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.608+0000 7efcb57fa640 1 -- 172.21.15.81:0/2730178373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efca8030e70 con 0x7efcb8106540 2024-09-12T01:19:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.608+0000 7efcb57fa640 1 -- 172.21.15.81:0/2730178373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efca80318e0 con 0x7efcb8106540 2024-09-12T01:19:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.608+0000 7efcbddcd640 1 -- 172.21.15.81:0/2730178373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb81987a0 con 0x7efcb8106540 2024-09-12T01:19:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.608+0000 7efcb57fa640 1 -- 172.21.15.81:0/2730178373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efca80049c0 con 0x7efcb8106540 2024-09-12T01:19:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.608+0000 7efcbddcd640 1 -- 172.21.15.81:0/2730178373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb8198c00 con 0x7efcb8106540 2024-09-12T01:19:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.609+0000 7efcb57fa640 1 -- 172.21.15.81:0/2730178373 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7efca8039040 con 0x7efcb8106540 2024-09-12T01:19:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.609+0000 7efcb57fa640 1 --2- 172.21.15.81:0/2730178373 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7efca40390c0 0x7efca403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.609+0000 7efcb57fa640 1 -- 172.21.15.81:0/2730178373 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efca806d2b0 con 0x7efcb8106540 2024-09-12T01:19:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.609+0000 7efcbddcd640 1 -- 172.21.15.81:0/2730178373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb8101bb0 con 0x7efcb8106540 2024-09-12T01:19:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.609+0000 7efcaffff640 1 --2- 172.21.15.81:0/2730178373 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7efca40390c0 0x7efca403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.610+0000 7efcaffff640 1 --2- 172.21.15.81:0/2730178373 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7efca40390c0 0x7efca403b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efca00098c0 tx=0x7efca0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:37.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.614+0000 7efcb57fa640 1 -- 172.21.15.81:0/2730178373 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efca8040030 con 0x7efcb8106540 2024-09-12T01:19:37.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:37.784+0000 7efcbddcd640 1 -- 172.21.15.81:0/2730178373 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}) -- 0x7efcb8198e30 con 0x7efca40390c0 2024-09-12T01:19:38.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:38 smithi081 ceph-mon[30920]: Updating smithi081:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:19:39.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:39 smithi081 ceph-mon[30920]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:40.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:40 smithi081 ceph-mon[30920]: Deploying cephadm binary to smithi100 2024-09-12T01:19:40.879 INFO:teuthology.orchestra.run.smithi081.stdout:Added host 'smithi100' with addr '172.21.15.100' 2024-09-12T01:19:40.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:40.880+0000 7efcb57fa640 1 -- 172.21.15.81:0/2730178373 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7efcb8198e30 con 0x7efca40390c0 2024-09-12T01:19:40.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:40.882+0000 7efcbddcd640 1 -- 172.21.15.81:0/2730178373 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7efca40390c0 msgr2=0x7efca403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:40.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:40.882+0000 7efcbddcd640 1 --2- 172.21.15.81:0/2730178373 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7efca40390c0 0x7efca403b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efca00098c0 tx=0x7efca0006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:40.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:40.882+0000 7efcbddcd640 1 -- 172.21.15.81:0/2730178373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb8106540 msgr2=0x7efcb8197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:40.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:40.882+0000 7efcbddcd640 1 --2- 172.21.15.81:0/2730178373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb8106540 0x7efcb8197fd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efca80045e0 tx=0x7efca8004610 comp rx=0 tx=0).stop 2024-09-12T01:19:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:40.882+0000 7efcbddcd640 1 -- 172.21.15.81:0/2730178373 shutdown_connections 2024-09-12T01:19:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:40.882+0000 7efcbddcd640 1 --2- 172.21.15.81:0/2730178373 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7efca40390c0 0x7efca403b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:40.882+0000 7efcbddcd640 1 --2- 172.21.15.81:0/2730178373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb8106540 0x7efcb8197fd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:40.882+0000 7efcbddcd640 1 -- 172.21.15.81:0/2730178373 >> 172.21.15.81:0/2730178373 conn(0x7efcb8077310 msgr2=0x7efcb80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:40.882+0000 7efcbddcd640 1 -- 172.21.15.81:0/2730178373 shutdown_connections 2024-09-12T01:19:40.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:40.882+0000 7efcbddcd640 1 -- 172.21.15.81:0/2730178373 wait complete. 2024-09-12T01:19:41.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T01:19:41.746 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:19:42.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:42.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:41 smithi081 ceph-mon[30920]: Added host smithi100 2024-09-12T01:19:42.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:19:42.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:42.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.196+0000 7ff735085640 1 -- 172.21.15.81:0/2990333339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730102750 msgr2=0x7ff730102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.196+0000 7ff735085640 1 --2- 172.21.15.81:0/2990333339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730102750 0x7ff730102b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff720009880 tx=0x7ff72002a670 comp rx=0 tx=0).stop 2024-09-12T01:19:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.196+0000 7ff735085640 1 -- 172.21.15.81:0/2990333339 shutdown_connections 2024-09-12T01:19:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.196+0000 7ff735085640 1 --2- 172.21.15.81:0/2990333339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730102750 0x7ff730102b30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.196+0000 7ff735085640 1 -- 172.21.15.81:0/2990333339 >> 172.21.15.81:0/2990333339 conn(0x7ff7300fc1b0 msgr2=0x7ff7300fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.196+0000 7ff735085640 1 -- 172.21.15.81:0/2990333339 shutdown_connections 2024-09-12T01:19:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.196+0000 7ff735085640 1 -- 172.21.15.81:0/2990333339 wait complete. 2024-09-12T01:19:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.197+0000 7ff735085640 1 Processor -- start 2024-09-12T01:19:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.197+0000 7ff735085640 1 -- start start 2024-09-12T01:19:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.197+0000 7ff735085640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730102750 0x7ff7301971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.197+0000 7ff735085640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff73010bcc0 con 0x7ff730102750 2024-09-12T01:19:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.197+0000 7ff72ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730102750 0x7ff7301971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.198+0000 7ff72ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730102750 0x7ff7301971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59466/0 (socket says 172.21.15.81:59466) 2024-09-12T01:19:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.198+0000 7ff72ed9d640 1 -- 172.21.15.81:0/2186955813 learned_addr learned my addr 172.21.15.81:0/2186955813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.198+0000 7ff72ed9d640 1 -- 172.21.15.81:0/2186955813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff730197700 con 0x7ff730102750 2024-09-12T01:19:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.198+0000 7ff72ed9d640 1 --2- 172.21.15.81:0/2186955813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730102750 0x7ff7301971c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff720009230 tx=0x7ff720003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.198+0000 7ff72cd99640 1 -- 172.21.15.81:0/2186955813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff72003f070 con 0x7ff730102750 2024-09-12T01:19:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.198+0000 7ff735085640 1 -- 172.21.15.81:0/2186955813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff730197990 con 0x7ff730102750 2024-09-12T01:19:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.198+0000 7ff72cd99640 1 -- 172.21.15.81:0/2186955813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff72003bc80 con 0x7ff730102750 2024-09-12T01:19:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.198+0000 7ff72cd99640 1 -- 172.21.15.81:0/2186955813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff720035030 con 0x7ff730102750 2024-09-12T01:19:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.198+0000 7ff735085640 1 -- 172.21.15.81:0/2186955813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff730197df0 con 0x7ff730102750 2024-09-12T01:19:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.199+0000 7ff72cd99640 1 -- 172.21.15.81:0/2186955813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff720042070 con 0x7ff730102750 2024-09-12T01:19:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.199+0000 7ff735085640 1 -- 172.21.15.81:0/2186955813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff73006a7b0 con 0x7ff730102750 2024-09-12T01:19:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.199+0000 7ff72cd99640 1 --2- 172.21.15.81:0/2186955813 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff71c039060 0x7ff71c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.199+0000 7ff72cd99640 1 -- 172.21.15.81:0/2186955813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff72006ccf0 con 0x7ff730102750 2024-09-12T01:19:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.199+0000 7ff72659c640 1 --2- 172.21.15.81:0/2186955813 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff71c039060 0x7ff71c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.200+0000 7ff72659c640 1 --2- 172.21.15.81:0/2186955813 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff71c039060 0x7ff71c03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff7180098c0 tx=0x7ff718006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.204+0000 7ff72cd99640 1 -- 172.21.15.81:0/2186955813 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff720071070 con 0x7ff730102750 2024-09-12T01:19:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.376+0000 7ff735085640 1 -- 172.21.15.81:0/2186955813 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff730198580 con 0x7ff71c039060 2024-09-12T01:19:42.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.377+0000 7ff72cd99640 1 -- 172.21.15.81:0/2186955813 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7ff730198580 con 0x7ff71c039060 2024-09-12T01:19:42.377 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:19:42.377 INFO:teuthology.orchestra.run.smithi081.stdout:[{"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}] 2024-09-12T01:19:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.379+0000 7ff735085640 1 -- 172.21.15.81:0/2186955813 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff71c039060 msgr2=0x7ff71c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.379+0000 7ff735085640 1 --2- 172.21.15.81:0/2186955813 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff71c039060 0x7ff71c03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff7180098c0 tx=0x7ff718006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.379+0000 7ff735085640 1 -- 172.21.15.81:0/2186955813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730102750 msgr2=0x7ff7301971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.379+0000 7ff735085640 1 --2- 172.21.15.81:0/2186955813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730102750 0x7ff7301971c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff720009230 tx=0x7ff720003d40 comp rx=0 tx=0).stop 2024-09-12T01:19:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.379+0000 7ff735085640 1 -- 172.21.15.81:0/2186955813 shutdown_connections 2024-09-12T01:19:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.379+0000 7ff735085640 1 --2- 172.21.15.81:0/2186955813 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff71c039060 0x7ff71c03b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.379+0000 7ff735085640 1 --2- 172.21.15.81:0/2186955813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730102750 0x7ff7301971c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.379+0000 7ff735085640 1 -- 172.21.15.81:0/2186955813 >> 172.21.15.81:0/2186955813 conn(0x7ff7300fc1b0 msgr2=0x7ff730103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.380+0000 7ff735085640 1 -- 172.21.15.81:0/2186955813 shutdown_connections 2024-09-12T01:19:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:42.380+0000 7ff735085640 1 -- 172.21.15.81:0/2186955813 wait complete. 2024-09-12T01:19:43.026 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi189 2024-09-12T01:19:43.026 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:19:43.027 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.conf 2024-09-12T01:19:43.046 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:19:43.046 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:19:43.104 INFO:tasks.cephadm:Adding host smithi189 to orchestrator... 2024-09-12T01:19:43.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch host add smithi189 2024-09-12T01:19:43.347 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:19:43.461 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:43 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:43.461 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:43 smithi081 ceph-mon[30920]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:19:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.771+0000 7f44360ed640 1 -- 172.21.15.81:0/3585891494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4430107660 msgr2=0x7f4430107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.771+0000 7f44360ed640 1 --2- 172.21.15.81:0/3585891494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4430107660 0x7f4430107a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4420009c20 tx=0x7f442002aa90 comp rx=0 tx=0).stop 2024-09-12T01:19:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.771+0000 7f44360ed640 1 -- 172.21.15.81:0/3585891494 shutdown_connections 2024-09-12T01:19:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.771+0000 7f44360ed640 1 --2- 172.21.15.81:0/3585891494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4430107660 0x7f4430107a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.771+0000 7f44360ed640 1 -- 172.21.15.81:0/3585891494 >> 172.21.15.81:0/3585891494 conn(0x7f44300fd290 msgr2=0x7f44300ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.771+0000 7f44360ed640 1 -- 172.21.15.81:0/3585891494 shutdown_connections 2024-09-12T01:19:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.771+0000 7f44360ed640 1 -- 172.21.15.81:0/3585891494 wait complete. 2024-09-12T01:19:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.772+0000 7f44360ed640 1 Processor -- start 2024-09-12T01:19:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.772+0000 7f44360ed640 1 -- start start 2024-09-12T01:19:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.772+0000 7f44360ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4430107660 0x7f44300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.772+0000 7f44360ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f443010bc90 con 0x7f4430107660 2024-09-12T01:19:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.772+0000 7f442f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4430107660 0x7f44300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.772+0000 7f442f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4430107660 0x7f44300744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59496/0 (socket says 172.21.15.81:59496) 2024-09-12T01:19:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.772+0000 7f442f7fe640 1 -- 172.21.15.81:0/743500130 learned_addr learned my addr 172.21.15.81:0/743500130 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.773+0000 7f442f7fe640 1 -- 172.21.15.81:0/743500130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44300763e0 con 0x7f4430107660 2024-09-12T01:19:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.773+0000 7f442f7fe640 1 --2- 172.21.15.81:0/743500130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4430107660 0x7f44300744f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4420005e30 tx=0x7f442002fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.773+0000 7f442cff9640 1 -- 172.21.15.81:0/743500130 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4420047070 con 0x7f4430107660 2024-09-12T01:19:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.773+0000 7f442cff9640 1 -- 172.21.15.81:0/743500130 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4420003df0 con 0x7f4430107660 2024-09-12T01:19:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.773+0000 7f44360ed640 1 -- 172.21.15.81:0/743500130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4430074a30 con 0x7f4430107660 2024-09-12T01:19:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.773+0000 7f442cff9640 1 -- 172.21.15.81:0/743500130 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4420033050 con 0x7f4430107660 2024-09-12T01:19:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.773+0000 7f44360ed640 1 -- 172.21.15.81:0/743500130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4430074ef0 con 0x7f4430107660 2024-09-12T01:19:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.774+0000 7f442cff9640 1 -- 172.21.15.81:0/743500130 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f442004a070 con 0x7f4430107660 2024-09-12T01:19:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.774+0000 7f442cff9640 1 --2- 172.21.15.81:0/743500130 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f44180390c0 0x7f441803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.774+0000 7f44360ed640 1 -- 172.21.15.81:0/743500130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4430102cd0 con 0x7f4430107660 2024-09-12T01:19:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.774+0000 7f442cff9640 1 -- 172.21.15.81:0/743500130 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f442003e030 con 0x7f4430107660 2024-09-12T01:19:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.774+0000 7f442effd640 1 --2- 172.21.15.81:0/743500130 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f44180390c0 0x7f441803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.775+0000 7f442effd640 1 --2- 172.21.15.81:0/743500130 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f44180390c0 0x7f441803b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f44240098c0 tx=0x7f4424006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.779+0000 7f442cff9640 1 -- 172.21.15.81:0/743500130 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44200492c0 con 0x7f4430107660 2024-09-12T01:19:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:43.947+0000 7f44360ed640 1 -- 172.21.15.81:0/743500130 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}) -- 0x7f4430075a90 con 0x7f44180390c0 2024-09-12T01:19:45.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:45 smithi081 ceph-mon[30920]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:45.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:45 smithi081 ceph-mon[30920]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:19:45.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:45.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:45.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:45.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:45.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:19:45.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:19:45.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:19:46.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:46 smithi081 ceph-mon[30920]: Deploying cephadm binary to smithi189 2024-09-12T01:19:46.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:46 smithi081 ceph-mon[30920]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T01:19:46.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:46 smithi081 ceph-mon[30920]: Updating smithi100:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:19:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:47.203+0000 7f442cff9640 1 -- 172.21.15.81:0/743500130 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f4430075a90 con 0x7f44180390c0 2024-09-12T01:19:47.203 INFO:teuthology.orchestra.run.smithi081.stdout:Added host 'smithi189' with addr '172.21.15.189' 2024-09-12T01:19:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:47.205+0000 7f44360ed640 1 -- 172.21.15.81:0/743500130 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f44180390c0 msgr2=0x7f441803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:47.205+0000 7f44360ed640 1 --2- 172.21.15.81:0/743500130 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f44180390c0 0x7f441803b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f44240098c0 tx=0x7f4424006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:47.205+0000 7f44360ed640 1 -- 172.21.15.81:0/743500130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4430107660 msgr2=0x7f44300744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:47.205+0000 7f44360ed640 1 --2- 172.21.15.81:0/743500130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4430107660 0x7f44300744f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4420005e30 tx=0x7f442002fc10 comp rx=0 tx=0).stop 2024-09-12T01:19:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:47.205+0000 7f44360ed640 1 -- 172.21.15.81:0/743500130 shutdown_connections 2024-09-12T01:19:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:47.205+0000 7f44360ed640 1 --2- 172.21.15.81:0/743500130 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f44180390c0 0x7f441803b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:47.205+0000 7f44360ed640 1 --2- 172.21.15.81:0/743500130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4430107660 0x7f44300744f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:47.205+0000 7f44360ed640 1 -- 172.21.15.81:0/743500130 >> 172.21.15.81:0/743500130 conn(0x7f44300fd290 msgr2=0x7f44300febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:47.206+0000 7f44360ed640 1 -- 172.21.15.81:0/743500130 shutdown_connections 2024-09-12T01:19:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:47.206+0000 7f44360ed640 1 -- 172.21.15.81:0/743500130 wait complete. 2024-09-12T01:19:47.483 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:47 smithi081 ceph-mon[30920]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:19:47.484 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:47 smithi081 ceph-mon[30920]: Updating smithi100:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:19:47.484 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:47 smithi081 ceph-mon[30920]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:19:47.484 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:47.484 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:47.484 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:47.484 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:47.484 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:19:47.807 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T01:19:48.043 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:19:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.461+0000 7f3d09983640 1 -- 172.21.15.81:0/1728107130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d04107650 msgr2=0x7f3d04107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.461+0000 7f3d09983640 1 --2- 172.21.15.81:0/1728107130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d04107650 0x7f3d04107a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009880 tx=0x7f3cec02a5d0 comp rx=0 tx=0).stop 2024-09-12T01:19:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.461+0000 7f3d09983640 1 -- 172.21.15.81:0/1728107130 shutdown_connections 2024-09-12T01:19:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.461+0000 7f3d09983640 1 --2- 172.21.15.81:0/1728107130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d04107650 0x7f3d04107a30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.461+0000 7f3d09983640 1 -- 172.21.15.81:0/1728107130 >> 172.21.15.81:0/1728107130 conn(0x7f3d040fd260 msgr2=0x7f3d040ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.461+0000 7f3d09983640 1 -- 172.21.15.81:0/1728107130 shutdown_connections 2024-09-12T01:19:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.461+0000 7f3d09983640 1 -- 172.21.15.81:0/1728107130 wait complete. 2024-09-12T01:19:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.461+0000 7f3d09983640 1 Processor -- start 2024-09-12T01:19:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.462+0000 7f3d09983640 1 -- start start 2024-09-12T01:19:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.462+0000 7f3d09983640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d04107650 0x7f3d040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.462+0000 7f3d09983640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0410bc80 con 0x7f3d04107650 2024-09-12T01:19:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.462+0000 7f3d02ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d04107650 0x7f3d040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.462+0000 7f3d02ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d04107650 0x7f3d040744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59504/0 (socket says 172.21.15.81:59504) 2024-09-12T01:19:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.462+0000 7f3d02ffd640 1 -- 172.21.15.81:0/5793581 learned_addr learned my addr 172.21.15.81:0/5793581 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.462+0000 7f3d02ffd640 1 -- 172.21.15.81:0/5793581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d040763e0 con 0x7f3d04107650 2024-09-12T01:19:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.462+0000 7f3d02ffd640 1 --2- 172.21.15.81:0/5793581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d04107650 0x7f3d040744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009230 tx=0x7f3cec003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:48.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.462+0000 7f3d08981640 1 -- 172.21.15.81:0/5793581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cec03f070 con 0x7f3d04107650 2024-09-12T01:19:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.463+0000 7f3d09983640 1 -- 172.21.15.81:0/5793581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d04074a30 con 0x7f3d04107650 2024-09-12T01:19:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.463+0000 7f3d08981640 1 -- 172.21.15.81:0/5793581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cec03bc80 con 0x7f3d04107650 2024-09-12T01:19:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.463+0000 7f3d08981640 1 -- 172.21.15.81:0/5793581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cec035030 con 0x7f3d04107650 2024-09-12T01:19:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.463+0000 7f3d09983640 1 -- 172.21.15.81:0/5793581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d04074ef0 con 0x7f3d04107650 2024-09-12T01:19:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.463+0000 7f3d08981640 1 -- 172.21.15.81:0/5793581 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3cec042070 con 0x7f3d04107650 2024-09-12T01:19:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.463+0000 7f3d09983640 1 -- 172.21.15.81:0/5793581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d04102cc0 con 0x7f3d04107650 2024-09-12T01:19:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.464+0000 7f3d08981640 1 --2- 172.21.15.81:0/5793581 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3cf0039060 0x7f3cf003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.464+0000 7f3d08981640 1 -- 172.21.15.81:0/5793581 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3cec06cca0 con 0x7f3d04107650 2024-09-12T01:19:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.464+0000 7f3d027fc640 1 --2- 172.21.15.81:0/5793581 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3cf0039060 0x7f3cf003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:48.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.464+0000 7f3d027fc640 1 --2- 172.21.15.81:0/5793581 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3cf0039060 0x7f3cf003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40098c0 tx=0x7f3cf4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.468+0000 7f3d08981640 1 -- 172.21.15.81:0/5793581 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3cec04c350 con 0x7f3d04107650 2024-09-12T01:19:48.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.641+0000 7f3d09983640 1 -- 172.21.15.81:0/5793581 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3d04075a20 con 0x7f3cf0039060 2024-09-12T01:19:48.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.642+0000 7f3d08981640 1 -- 172.21.15.81:0/5793581 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f3d04075a20 con 0x7f3cf0039060 2024-09-12T01:19:48.641 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:19:48.641 INFO:teuthology.orchestra.run.smithi081.stdout:[{"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}, {"addr": "172.21.15.189", "hostname": "smithi189", "labels": [], "status": ""}] 2024-09-12T01:19:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.644+0000 7f3d09983640 1 -- 172.21.15.81:0/5793581 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3cf0039060 msgr2=0x7f3cf003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.644+0000 7f3d09983640 1 --2- 172.21.15.81:0/5793581 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3cf0039060 0x7f3cf003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40098c0 tx=0x7f3cf4006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.644+0000 7f3d09983640 1 -- 172.21.15.81:0/5793581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d04107650 msgr2=0x7f3d040744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.644+0000 7f3d09983640 1 --2- 172.21.15.81:0/5793581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d04107650 0x7f3d040744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009230 tx=0x7f3cec003d40 comp rx=0 tx=0).stop 2024-09-12T01:19:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.644+0000 7f3d09983640 1 -- 172.21.15.81:0/5793581 shutdown_connections 2024-09-12T01:19:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.644+0000 7f3d09983640 1 --2- 172.21.15.81:0/5793581 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3cf0039060 0x7f3cf003b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.644+0000 7f3d09983640 1 --2- 172.21.15.81:0/5793581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d04107650 0x7f3d040744f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.644+0000 7f3d09983640 1 -- 172.21.15.81:0/5793581 >> 172.21.15.81:0/5793581 conn(0x7f3d040fd260 msgr2=0x7f3d040feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.644+0000 7f3d09983640 1 -- 172.21.15.81:0/5793581 shutdown_connections 2024-09-12T01:19:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:48.644+0000 7f3d09983640 1 -- 172.21.15.81:0/5793581 wait complete. 2024-09-12T01:19:48.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:48 smithi081 ceph-mon[30920]: Added host smithi189 2024-09-12T01:19:48.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:48.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:49.254 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T01:19:49.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T01:19:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:19:49.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:49 smithi081 ceph-mon[30920]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:19:49.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:49 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.952+0000 7fbd52cb0640 1 -- 172.21.15.81:0/2846766193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c106560 msgr2=0x7fbd4c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.952+0000 7fbd52cb0640 1 --2- 172.21.15.81:0/2846766193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c106560 0x7fbd4c106940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009880 tx=0x7fbd4002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:19:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.952+0000 7fbd52cb0640 1 -- 172.21.15.81:0/2846766193 shutdown_connections 2024-09-12T01:19:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.952+0000 7fbd52cb0640 1 --2- 172.21.15.81:0/2846766193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c106560 0x7fbd4c106940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.952+0000 7fbd52cb0640 1 -- 172.21.15.81:0/2846766193 >> 172.21.15.81:0/2846766193 conn(0x7fbd4c0fc1b0 msgr2=0x7fbd4c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.952+0000 7fbd52cb0640 1 -- 172.21.15.81:0/2846766193 shutdown_connections 2024-09-12T01:19:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.952+0000 7fbd52cb0640 1 -- 172.21.15.81:0/2846766193 wait complete. 2024-09-12T01:19:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.952+0000 7fbd52cb0640 1 Processor -- start 2024-09-12T01:19:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.952+0000 7fbd52cb0640 1 -- start start 2024-09-12T01:19:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.953+0000 7fbd52cb0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c106560 0x7fbd4c195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.953+0000 7fbd52cb0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c10ab90 con 0x7fbd4c106560 2024-09-12T01:19:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.953+0000 7fbd50a4c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c106560 0x7fbd4c195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.953+0000 7fbd50a4c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c106560 0x7fbd4c195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59522/0 (socket says 172.21.15.81:59522) 2024-09-12T01:19:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.953+0000 7fbd50a4c640 1 -- 172.21.15.81:0/3445994925 learned_addr learned my addr 172.21.15.81:0/3445994925 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:19:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.953+0000 7fbd50a4c640 1 -- 172.21.15.81:0/3445994925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4c196520 con 0x7fbd4c106560 2024-09-12T01:19:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.953+0000 7fbd50a4c640 1 --2- 172.21.15.81:0/3445994925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c106560 0x7fbd4c195fe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009230 tx=0x7fbd40003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.953+0000 7fbd49ffb640 1 -- 172.21.15.81:0/3445994925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd4003f070 con 0x7fbd4c106560 2024-09-12T01:19:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.953+0000 7fbd52cb0640 1 -- 172.21.15.81:0/3445994925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4c1967b0 con 0x7fbd4c106560 2024-09-12T01:19:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.953+0000 7fbd49ffb640 1 -- 172.21.15.81:0/3445994925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd4003bc80 con 0x7fbd4c106560 2024-09-12T01:19:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.953+0000 7fbd49ffb640 1 -- 172.21.15.81:0/3445994925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd40035030 con 0x7fbd4c106560 2024-09-12T01:19:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.954+0000 7fbd52cb0640 1 -- 172.21.15.81:0/3445994925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd4c19a8b0 con 0x7fbd4c106560 2024-09-12T01:19:49.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.954+0000 7fbd49ffb640 1 -- 172.21.15.81:0/3445994925 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fbd40042070 con 0x7fbd4c106560 2024-09-12T01:19:49.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.955+0000 7fbd52cb0640 1 -- 172.21.15.81:0/3445994925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd4c101bd0 con 0x7fbd4c106560 2024-09-12T01:19:49.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.955+0000 7fbd49ffb640 1 --2- 172.21.15.81:0/3445994925 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbd3c039060 0x7fbd3c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:49.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.955+0000 7fbd49ffb640 1 -- 172.21.15.81:0/3445994925 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbd4006cdc0 con 0x7fbd4c106560 2024-09-12T01:19:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.955+0000 7fbd4bfff640 1 --2- 172.21.15.81:0/3445994925 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbd3c039060 0x7fbd3c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:49.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.955+0000 7fbd4bfff640 1 --2- 172.21.15.81:0/3445994925 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbd3c039060 0x7fbd3c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbd380098c0 tx=0x7fbd38006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:49.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:49.959+0000 7fbd49ffb640 1 -- 172.21.15.81:0/3445994925 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd400372d0 con 0x7fbd4c106560 2024-09-12T01:19:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:50.128+0000 7fbd52cb0640 1 -- 172.21.15.81:0/3445994925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fbd4c1069c0 con 0x7fbd4c106560 2024-09-12T01:19:50.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:50.482+0000 7fbd49ffb640 1 -- 172.21.15.81:0/3445994925 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fbd40031570 con 0x7fbd4c106560 2024-09-12T01:19:50.481 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-12T01:19:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:50.485+0000 7fbd52cb0640 1 -- 172.21.15.81:0/3445994925 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbd3c039060 msgr2=0x7fbd3c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:50.485+0000 7fbd52cb0640 1 --2- 172.21.15.81:0/3445994925 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbd3c039060 0x7fbd3c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbd380098c0 tx=0x7fbd38006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:50.485+0000 7fbd52cb0640 1 -- 172.21.15.81:0/3445994925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c106560 msgr2=0x7fbd4c195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:50.485+0000 7fbd52cb0640 1 --2- 172.21.15.81:0/3445994925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c106560 0x7fbd4c195fe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009230 tx=0x7fbd40003d40 comp rx=0 tx=0).stop 2024-09-12T01:19:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:50.485+0000 7fbd52cb0640 1 -- 172.21.15.81:0/3445994925 shutdown_connections 2024-09-12T01:19:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:50.485+0000 7fbd52cb0640 1 --2- 172.21.15.81:0/3445994925 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbd3c039060 0x7fbd3c03b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:50.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:50.485+0000 7fbd52cb0640 1 --2- 172.21.15.81:0/3445994925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c106560 0x7fbd4c195fe0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:50.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:50.485+0000 7fbd52cb0640 1 -- 172.21.15.81:0/3445994925 >> 172.21.15.81:0/3445994925 conn(0x7fbd4c0fc1b0 msgr2=0x7fbd4c0fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:50.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:50.485+0000 7fbd52cb0640 1 -- 172.21.15.81:0/3445994925 shutdown_connections 2024-09-12T01:19:50.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:19:50.485+0000 7fbd52cb0640 1 -- 172.21.15.81:0/3445994925 wait complete. 2024-09-12T01:19:50.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:50 smithi081 ceph-mon[30920]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:19:50.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:50 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3445994925' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T01:19:51.065 INFO:tasks.cephadm:Adding mon.a on smithi081 2024-09-12T01:19:51.065 INFO:tasks.cephadm:Adding mon.b on smithi100 2024-09-12T01:19:51.065 INFO:tasks.cephadm:Adding mon.c on smithi189 2024-09-12T01:19:51.066 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi081:172.21.15.81=a;smithi100:172.21.15.100=b;smithi189:172.21.15.189=c' 2024-09-12T01:19:51.408 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:19:51.456 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:19:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:51 smithi081 ceph-mon[30920]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:19:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:51 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3445994925' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T01:19:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:51 smithi081 ceph-mon[30920]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:19:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:19:51.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:19:51.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:19:51.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.975+0000 7f34c4fcd640 1 -- 172.21.15.189:0/2020139243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0100510 msgr2=0x7f34c0100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:51.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.975+0000 7f34c4fcd640 1 --2- 172.21.15.189:0/2020139243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0100510 0x7f34c0100910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009880 tx=0x7f34b002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:19:51.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.976+0000 7f34c4fcd640 1 -- 172.21.15.189:0/2020139243 shutdown_connections 2024-09-12T01:19:51.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.976+0000 7f34c4fcd640 1 --2- 172.21.15.189:0/2020139243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0100510 0x7f34c0100910 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:51.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.976+0000 7f34c4fcd640 1 -- 172.21.15.189:0/2020139243 >> 172.21.15.189:0/2020139243 conn(0x7f34c00fbc80 msgr2=0x7f34c00fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:51.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.976+0000 7f34c4fcd640 1 -- 172.21.15.189:0/2020139243 shutdown_connections 2024-09-12T01:19:51.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.976+0000 7f34c4fcd640 1 -- 172.21.15.189:0/2020139243 wait complete. 2024-09-12T01:19:51.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.976+0000 7f34c4fcd640 1 Processor -- start 2024-09-12T01:19:51.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.977+0000 7f34c4fcd640 1 -- start start 2024-09-12T01:19:51.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.977+0000 7f34c4fcd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0100510 0x7f34c006a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:51.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.977+0000 7f34c4fcd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34c0106620 con 0x7f34c0100510 2024-09-12T01:19:51.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.977+0000 7f34be59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0100510 0x7f34c006a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:51.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.977+0000 7f34be59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0100510 0x7f34c006a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.189:45492/0 (socket says 172.21.15.189:45492) 2024-09-12T01:19:51.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.977+0000 7f34be59c640 1 -- 172.21.15.189:0/636961403 learned_addr learned my addr 172.21.15.189:0/636961403 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:19:51.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.977+0000 7f34be59c640 1 -- 172.21.15.189:0/636961403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c01978d0 con 0x7f34c0100510 2024-09-12T01:19:51.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.977+0000 7f34be59c640 1 --2- 172.21.15.189:0/636961403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0100510 0x7f34c006a950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34b0004f60 tx=0x7f34b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:51.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.978+0000 7f34af7fe640 1 -- 172.21.15.189:0/636961403 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b003f070 con 0x7f34c0100510 2024-09-12T01:19:51.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.978+0000 7f34c4fcd640 1 -- 172.21.15.189:0/636961403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c019bee0 con 0x7f34c0100510 2024-09-12T01:19:51.998 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.978+0000 7f34af7fe640 1 -- 172.21.15.189:0/636961403 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34b0004cc0 con 0x7f34c0100510 2024-09-12T01:19:51.998 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.978+0000 7f34af7fe640 1 -- 172.21.15.189:0/636961403 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b0035030 con 0x7f34c0100510 2024-09-12T01:19:51.998 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.978+0000 7f34c4fcd640 1 -- 172.21.15.189:0/636961403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c019c280 con 0x7f34c0100510 2024-09-12T01:19:51.998 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.979+0000 7f34af7fe640 1 -- 172.21.15.189:0/636961403 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f34b0042070 con 0x7f34c0100510 2024-09-12T01:19:51.998 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.979+0000 7f34af7fe640 1 --2- 172.21.15.189:0/636961403 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f34a8039060 0x7f34a803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:51.998 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.979+0000 7f34c4fcd640 1 -- 172.21.15.189:0/636961403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c0106da0 con 0x7f34c0100510 2024-09-12T01:19:51.998 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.979+0000 7f34af7fe640 1 -- 172.21.15.189:0/636961403 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f34b006cec0 con 0x7f34c0100510 2024-09-12T01:19:51.998 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.979+0000 7f34bdd9b640 1 --2- 172.21.15.189:0/636961403 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f34a8039060 0x7f34a803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:51.998 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.980+0000 7f34bdd9b640 1 --2- 172.21.15.189:0/636961403 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f34a8039060 0x7f34a803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f34b40098c0 tx=0x7f34b4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:51.999 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:51.984+0000 7f34af7fe640 1 -- 172.21.15.189:0/636961403 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34b00433b0 con 0x7f34c0100510 2024-09-12T01:19:52.173 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:52.174+0000 7f34c4fcd640 1 -- 172.21.15.189:0/636961403 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi100:172.21.15.100=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}) -- 0x7f34c002d960 con 0x7f34a8039060 2024-09-12T01:19:52.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:52.180+0000 7f34af7fe640 1 -- 172.21.15.189:0/636961403 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f34c002d960 con 0x7f34a8039060 2024-09-12T01:19:52.179 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mon update... 2024-09-12T01:19:52.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:52.182+0000 7f34c4fcd640 1 -- 172.21.15.189:0/636961403 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f34a8039060 msgr2=0x7f34a803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:52.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:52.182+0000 7f34c4fcd640 1 --2- 172.21.15.189:0/636961403 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f34a8039060 0x7f34a803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f34b40098c0 tx=0x7f34b4006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:52.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:52.182+0000 7f34c4fcd640 1 -- 172.21.15.189:0/636961403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0100510 msgr2=0x7f34c006a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:52.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:52.182+0000 7f34c4fcd640 1 --2- 172.21.15.189:0/636961403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0100510 0x7f34c006a950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34b0004f60 tx=0x7f34b00048f0 comp rx=0 tx=0).stop 2024-09-12T01:19:52.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:52.182+0000 7f34c4fcd640 1 -- 172.21.15.189:0/636961403 shutdown_connections 2024-09-12T01:19:52.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:52.182+0000 7f34c4fcd640 1 --2- 172.21.15.189:0/636961403 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f34a8039060 0x7f34a803b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:52.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:52.182+0000 7f34c4fcd640 1 --2- 172.21.15.189:0/636961403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c0100510 0x7f34c006a950 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:52.182 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:52.182+0000 7f34c4fcd640 1 -- 172.21.15.189:0/636961403 >> 172.21.15.189:0/636961403 conn(0x7f34c00fbc80 msgr2=0x7f34c00fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:52.182 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:52.182+0000 7f34c4fcd640 1 -- 172.21.15.189:0/636961403 shutdown_connections 2024-09-12T01:19:52.182 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:52.182+0000 7f34c4fcd640 1 -- 172.21.15.189:0/636961403 wait complete. 2024-09-12T01:19:52.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:52 smithi081 ceph-mon[30920]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T01:19:52.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:52 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:52.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:52 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:52.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:52 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:52.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:52 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:52.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:52 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:19:52.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:52 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:19:52.820 DEBUG:teuthology.orchestra.run.smithi100:mon.b> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T01:19:52.823 DEBUG:teuthology.orchestra.run.smithi189:mon.c> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T01:19:52.825 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:19:52.826 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:19:53.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:53 smithi081 ceph-mon[30920]: Updating smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:19:53.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:53 smithi081 ceph-mon[30920]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:19:53.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:53 smithi081 ceph-mon[30920]: Updating smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:19:53.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:53 smithi081 ceph-mon[30920]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi100:172.21.15.100=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:53.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:53 smithi081 ceph-mon[30920]: Saving service mon spec with placement smithi081:172.21.15.81=a;smithi100:172.21.15.100=b;smithi189:172.21.15.189=c;count:3 2024-09-12T01:19:53.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:53 smithi081 ceph-mon[30920]: Deploying daemon mon.c on smithi189 2024-09-12T01:19:53.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:53 smithi081 ceph-mon[30920]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:19:53.748 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:19:54.174 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.170+0000 7f9265ee0640 1 -- 172.21.15.189:0/608217388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260106560 msgr2=0x7f9260106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:54.174 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.171+0000 7f9265ee0640 1 --2- 172.21.15.189:0/608217388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260106560 0x7f9260106940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9250009880 tx=0x7f925002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:19:54.174 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.171+0000 7f9265ee0640 1 -- 172.21.15.189:0/608217388 shutdown_connections 2024-09-12T01:19:54.174 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.171+0000 7f9265ee0640 1 --2- 172.21.15.189:0/608217388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260106560 0x7f9260106940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:54.174 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.171+0000 7f9265ee0640 1 -- 172.21.15.189:0/608217388 >> 172.21.15.189:0/608217388 conn(0x7f92600fc1b0 msgr2=0x7f92600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:54.174 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.171+0000 7f9265ee0640 1 -- 172.21.15.189:0/608217388 shutdown_connections 2024-09-12T01:19:54.174 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.171+0000 7f9265ee0640 1 -- 172.21.15.189:0/608217388 wait complete. 2024-09-12T01:19:54.174 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.171+0000 7f9265ee0640 1 Processor -- start 2024-09-12T01:19:54.174 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.172+0000 7f9265ee0640 1 -- start start 2024-09-12T01:19:54.174 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.172+0000 7f9265ee0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260106560 0x7f9260197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:54.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.172+0000 7f9265ee0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f926010ab90 con 0x7f9260106560 2024-09-12T01:19:54.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.172+0000 7f925f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260106560 0x7f9260197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:54.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.172+0000 7f925f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260106560 0x7f9260197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.189:45524/0 (socket says 172.21.15.189:45524) 2024-09-12T01:19:54.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.172+0000 7f925f7fe640 1 -- 172.21.15.189:0/242027842 learned_addr learned my addr 172.21.15.189:0/242027842 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:19:54.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.172+0000 7f925f7fe640 1 -- 172.21.15.189:0/242027842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9260198490 con 0x7f9260106560 2024-09-12T01:19:54.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.173+0000 7f925f7fe640 1 --2- 172.21.15.189:0/242027842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260106560 0x7f9260197f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9250009230 tx=0x7f9250003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:54.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.173+0000 7f925cff9640 1 -- 172.21.15.189:0/242027842 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f925003f070 con 0x7f9260106560 2024-09-12T01:19:54.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.173+0000 7f9265ee0640 1 -- 172.21.15.189:0/242027842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9260198720 con 0x7f9260106560 2024-09-12T01:19:54.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.173+0000 7f925cff9640 1 -- 172.21.15.189:0/242027842 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f925003bd40 con 0x7f9260106560 2024-09-12T01:19:54.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.173+0000 7f925cff9640 1 -- 172.21.15.189:0/242027842 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9250035030 con 0x7f9260106560 2024-09-12T01:19:54.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.173+0000 7f9265ee0640 1 -- 172.21.15.189:0/242027842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9260198b80 con 0x7f9260106560 2024-09-12T01:19:54.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.174+0000 7f925cff9640 1 -- 172.21.15.189:0/242027842 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f9250042070 con 0x7f9260106560 2024-09-12T01:19:54.176 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.174+0000 7f9265ee0640 1 -- 172.21.15.189:0/242027842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9260101bd0 con 0x7f9260106560 2024-09-12T01:19:54.176 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.174+0000 7f925cff9640 1 --2- 172.21.15.189:0/242027842 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9248039060 0x7f924803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:54.176 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.174+0000 7f925cff9640 1 -- 172.21.15.189:0/242027842 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f925006cd00 con 0x7f9260106560 2024-09-12T01:19:54.176 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.174+0000 7f925effd640 1 --2- 172.21.15.189:0/242027842 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9248039060 0x7f924803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:54.176 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.175+0000 7f925effd640 1 --2- 172.21.15.189:0/242027842 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9248039060 0x7f924803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f92540098c0 tx=0x7f9254006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:54.178 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.180+0000 7f925cff9640 1 -- 172.21.15.189:0/242027842 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9250036df0 con 0x7f9260106560 2024-09-12T01:19:54.414 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.415+0000 7f9265ee0640 1 -- 172.21.15.189:0/242027842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f92601069c0 con 0x7f9260106560 2024-09-12T01:19:54.414 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.415+0000 7f925cff9640 1 -- 172.21.15.189:0/242027842 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f925003b860 con 0x7f9260106560 2024-09-12T01:19:54.415 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:19:54.415 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":1,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","modified":"2024-09-12T01:18:25.338837Z","created":"2024-09-12T01:18:25.338837Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:19:54.415 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 1 2024-09-12T01:19:54.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.417+0000 7f9265ee0640 1 -- 172.21.15.189:0/242027842 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9248039060 msgr2=0x7f924803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:54.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.417+0000 7f9265ee0640 1 --2- 172.21.15.189:0/242027842 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9248039060 0x7f924803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f92540098c0 tx=0x7f9254006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:54.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.417+0000 7f9265ee0640 1 -- 172.21.15.189:0/242027842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260106560 msgr2=0x7f9260197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:54.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.417+0000 7f9265ee0640 1 --2- 172.21.15.189:0/242027842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260106560 0x7f9260197f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9250009230 tx=0x7f9250003d80 comp rx=0 tx=0).stop 2024-09-12T01:19:54.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.417+0000 7f9265ee0640 1 -- 172.21.15.189:0/242027842 shutdown_connections 2024-09-12T01:19:54.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.417+0000 7f9265ee0640 1 --2- 172.21.15.189:0/242027842 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9248039060 0x7f924803b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:54.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.417+0000 7f9265ee0640 1 --2- 172.21.15.189:0/242027842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9260106560 0x7f9260197f50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:54.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.418+0000 7f9265ee0640 1 -- 172.21.15.189:0/242027842 >> 172.21.15.189:0/242027842 conn(0x7f92600fc1b0 msgr2=0x7f92600fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:54.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.418+0000 7f9265ee0640 1 -- 172.21.15.189:0/242027842 shutdown_connections 2024-09-12T01:19:54.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:54.418+0000 7f9265ee0640 1 -- 172.21.15.189:0/242027842 wait complete. 2024-09-12T01:19:54.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:54 smithi081 ceph-mon[30920]: from='client.? 172.21.15.189:0/242027842' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:19:55.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:55 smithi081 ceph-mon[30920]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:19:56.016 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:19:56.016 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:19:56.272 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:19:56.931 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.931+0000 7f8b73e7c640 1 -- 172.21.15.189:0/3408870772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6c106650 msgr2=0x7f8b6c106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:56.931 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.931+0000 7f8b73e7c640 1 --2- 172.21.15.189:0/3408870772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6c106650 0x7f8b6c106a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009880 tx=0x7f8b6802a5d0 comp rx=0 tx=0).stop 2024-09-12T01:19:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.931+0000 7f8b73e7c640 1 -- 172.21.15.189:0/3408870772 shutdown_connections 2024-09-12T01:19:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.931+0000 7f8b73e7c640 1 --2- 172.21.15.189:0/3408870772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6c106650 0x7f8b6c106a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.931+0000 7f8b73e7c640 1 -- 172.21.15.189:0/3408870772 >> 172.21.15.189:0/3408870772 conn(0x7f8b6c0fc280 msgr2=0x7f8b6c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.931+0000 7f8b73e7c640 1 -- 172.21.15.189:0/3408870772 shutdown_connections 2024-09-12T01:19:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.931+0000 7f8b73e7c640 1 -- 172.21.15.189:0/3408870772 wait complete. 2024-09-12T01:19:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.931+0000 7f8b73e7c640 1 Processor -- start 2024-09-12T01:19:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.932+0000 7f8b73e7c640 1 -- start start 2024-09-12T01:19:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.932+0000 7f8b73e7c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6c106650 0x7f8b6c0fc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.932+0000 7f8b73e7c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c10ac80 con 0x7f8b6c106650 2024-09-12T01:19:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.932+0000 7f8b71c18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6c106650 0x7f8b6c0fc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.932+0000 7f8b71c18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6c106650 0x7f8b6c0fc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.189:45548/0 (socket says 172.21.15.189:45548) 2024-09-12T01:19:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.932+0000 7f8b71c18640 1 -- 172.21.15.189:0/949699805 learned_addr learned my addr 172.21.15.189:0/949699805 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:19:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.932+0000 7f8b71c18640 1 -- 172.21.15.189:0/949699805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6c0fe620 con 0x7f8b6c106650 2024-09-12T01:19:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.933+0000 7f8b71c18640 1 --2- 172.21.15.189:0/949699805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6c106650 0x7f8b6c0fc730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009230 tx=0x7f8b68003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.933+0000 7f8b62ffd640 1 -- 172.21.15.189:0/949699805 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b6803f070 con 0x7f8b6c106650 2024-09-12T01:19:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.933+0000 7f8b73e7c640 1 -- 172.21.15.189:0/949699805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6c0fcc70 con 0x7f8b6c106650 2024-09-12T01:19:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.933+0000 7f8b73e7c640 1 -- 172.21.15.189:0/949699805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6c0fd130 con 0x7f8b6c106650 2024-09-12T01:19:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.933+0000 7f8b62ffd640 1 -- 172.21.15.189:0/949699805 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b6803bc80 con 0x7f8b6c106650 2024-09-12T01:19:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.933+0000 7f8b62ffd640 1 -- 172.21.15.189:0/949699805 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b68049060 con 0x7f8b6c106650 2024-09-12T01:19:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.934+0000 7f8b73e7c640 1 -- 172.21.15.189:0/949699805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b50005290 con 0x7f8b6c106650 2024-09-12T01:19:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.934+0000 7f8b62ffd640 1 -- 172.21.15.189:0/949699805 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8b68042070 con 0x7f8b6c106650 2024-09-12T01:19:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.934+0000 7f8b62ffd640 1 --2- 172.21.15.189:0/949699805 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8b58039060 0x7f8b5803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:19:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.934+0000 7f8b62ffd640 1 -- 172.21.15.189:0/949699805 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8b6806cd90 con 0x7f8b6c106650 2024-09-12T01:19:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.934+0000 7f8b71417640 1 --2- 172.21.15.189:0/949699805 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8b58039060 0x7f8b5803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:19:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.935+0000 7f8b71417640 1 --2- 172.21.15.189:0/949699805 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8b58039060 0x7f8b5803b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0098c0 tx=0x7f8b5c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:19:56.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:56.940+0000 7f8b62ffd640 1 -- 172.21.15.189:0/949699805 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b68043ce0 con 0x7f8b6c106650 2024-09-12T01:19:57.189 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:57.190+0000 7f8b73e7c640 1 -- 172.21.15.189:0/949699805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f8b50005580 con 0x7f8b6c106650 2024-09-12T01:19:57.190 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:57.191+0000 7f8b62ffd640 1 -- 172.21.15.189:0/949699805 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f8b6804c350 con 0x7f8b6c106650 2024-09-12T01:19:57.190 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:19:57.190 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":1,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","modified":"2024-09-12T01:18:25.338837Z","created":"2024-09-12T01:18:25.338837Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:19:57.190 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 1 2024-09-12T01:19:57.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:57.194+0000 7f8b73e7c640 1 -- 172.21.15.189:0/949699805 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8b58039060 msgr2=0x7f8b5803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:57.193 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:57.194+0000 7f8b73e7c640 1 --2- 172.21.15.189:0/949699805 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8b58039060 0x7f8b5803b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0098c0 tx=0x7f8b5c006db0 comp rx=0 tx=0).stop 2024-09-12T01:19:57.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:57.194+0000 7f8b73e7c640 1 -- 172.21.15.189:0/949699805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6c106650 msgr2=0x7f8b6c0fc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:19:57.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:57.194+0000 7f8b73e7c640 1 --2- 172.21.15.189:0/949699805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6c106650 0x7f8b6c0fc730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009230 tx=0x7f8b68003d40 comp rx=0 tx=0).stop 2024-09-12T01:19:57.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:57.194+0000 7f8b73e7c640 1 -- 172.21.15.189:0/949699805 shutdown_connections 2024-09-12T01:19:57.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:57.194+0000 7f8b73e7c640 1 --2- 172.21.15.189:0/949699805 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8b58039060 0x7f8b5803b520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:57.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:57.194+0000 7f8b73e7c640 1 --2- 172.21.15.189:0/949699805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6c106650 0x7f8b6c0fc730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:19:57.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:57.194+0000 7f8b73e7c640 1 -- 172.21.15.189:0/949699805 >> 172.21.15.189:0/949699805 conn(0x7f8b6c0fc280 msgr2=0x7f8b6c069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:19:57.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:57.194+0000 7f8b73e7c640 1 -- 172.21.15.189:0/949699805 shutdown_connections 2024-09-12T01:19:57.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:19:57.194+0000 7f8b73e7c640 1 -- 172.21.15.189:0/949699805 wait complete. 2024-09-12T01:19:57.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:57 smithi189 systemd[1]: Starting Ceph mon.c for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:19:57.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:57 smithi081 ceph-mon[30920]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:19:57.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:19:57 smithi081 ceph-mon[30920]: from='client.? 172.21.15.189:0/949699805' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:19:58.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:57 smithi189 podman[35337]: 2024-09-12 01:19:57.955313028 +0000 UTC m=+0.106020547 container create 5934253a917bc2f5ecc54e9aef6d0b8aa14fdcb0eb9a23c09bcb9e4917244082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-c, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T01:19:58.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:57 smithi189 podman[35337]: 2024-09-12 01:19:57.865896594 +0000 UTC m=+0.016604081 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:19:58.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 podman[35337]: 2024-09-12 01:19:58.157725969 +0000 UTC m=+0.308433456 container init 5934253a917bc2f5ecc54e9aef6d0b8aa14fdcb0eb9a23c09bcb9e4917244082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-09-12T01:19:58.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 podman[35337]: 2024-09-12 01:19:58.160737686 +0000 UTC m=+0.311445166 container start 5934253a917bc2f5ecc54e9aef6d0b8aa14fdcb0eb9a23c09bcb9e4917244082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-12T01:19:58.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T01:19:58.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T01:19:58.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: pidfile_write: ignore empty --pid-file 2024-09-12T01:19:58.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: load: jerasure load: lrc 2024-09-12T01:19:58.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: RocksDB version: 7.9.2 2024-09-12T01:19:58.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Git sha 0 2024-09-12T01:19:58.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T01:19:58.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: DB SUMMARY 2024-09-12T01:19:58.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: DB Session ID: WRFBNS5VFKVG3NHF3QST 2024-09-12T01:19:58.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: CURRENT file: CURRENT 2024-09-12T01:19:58.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T01:19:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-12T01:19:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-12T01:19:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-12T01:19:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.error_if_exists: 0 2024-09-12T01:19:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.create_if_missing: 0 2024-09-12T01:19:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.paranoid_checks: 1 2024-09-12T01:19:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T01:19:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T01:19:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T01:19:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.env: 0x5578a6cc2940 2024-09-12T01:19:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T01:19:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.info_log: 0x5578a8d336e0 2024-09-12T01:19:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T01:19:58.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.statistics: (nil) 2024-09-12T01:19:58.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.use_fsync: 0 2024-09-12T01:19:58.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_log_file_size: 0 2024-09-12T01:19:58.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T01:19:58.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T01:19:58.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T01:19:58.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T01:19:58.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.allow_fallocate: 1 2024-09-12T01:19:58.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T01:19:58.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T01:19:58.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.use_direct_reads: 0 2024-09-12T01:19:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T01:19:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T01:19:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.db_log_dir: 2024-09-12T01:19:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.wal_dir: 2024-09-12T01:19:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T01:19:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T01:19:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T01:19:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T01:19:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T01:19:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T01:19:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T01:19:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T01:19:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.write_buffer_manager: 0x5578a8d42dc0 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.unordered_write: 0 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T01:19:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.row_cache: None 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.wal_filter: None 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.two_write_queues: 0 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.wal_compression: 0 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.atomic_flush: 0 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.log_readahead_size: 0 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T01:19:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T01:19:58.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T01:19:58.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T01:19:58.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T01:19:58.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T01:19:58.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_background_jobs: 2 2024-09-12T01:19:58.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_background_compactions: -1 2024-09-12T01:19:58.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_subcompactions: 1 2024-09-12T01:19:58.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T01:19:58.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T01:19:58.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T01:19:58.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T01:19:58.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T01:19:58.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T01:19:58.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T01:19:58.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T01:19:58.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_open_files: -1 2024-09-12T01:19:58.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T01:19:58.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T01:19:58.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T01:19:58.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T01:19:58.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_background_flushes: -1 2024-09-12T01:19:58.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Compression algorithms supported: 2024-09-12T01:19:58.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: kZSTD supported: 0 2024-09-12T01:19:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: kXpressCompression supported: 0 2024-09-12T01:19:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: kBZip2Compression supported: 0 2024-09-12T01:19:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T01:19:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: kLZ4Compression supported: 1 2024-09-12T01:19:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: kZlibCompression supported: 1 2024-09-12T01:19:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T01:19:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: kSnappyCompression supported: 1 2024-09-12T01:19:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T01:19:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T01:19:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-12T01:19:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T01:19:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T01:19:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.merge_operator: 2024-09-12T01:19:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compaction_filter: None 2024-09-12T01:19:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T01:19:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T01:19:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T01:19:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T01:19:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5578a8d33320) 2024-09-12T01:19:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout: cache_index_and_filter_blocks: 1 2024-09-12T01:19:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T01:19:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T01:19:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout: pin_top_level_index_and_filter: 1 2024-09-12T01:19:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout: index_type: 0 2024-09-12T01:19:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout: data_block_index_type: 0 2024-09-12T01:19:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout: index_shortening: 1 2024-09-12T01:19:58.544 INFO:journalctl@ceph.mon.c.smithi189.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T01:19:58.544 INFO:journalctl@ceph.mon.c.smithi189.stdout: checksum: 4 2024-09-12T01:19:58.544 INFO:journalctl@ceph.mon.c.smithi189.stdout: no_block_cache: 0 2024-09-12T01:19:58.544 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache: 0x5578a8d271f0 2024-09-12T01:19:58.544 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache_name: BinnedLRUCache 2024-09-12T01:19:58.544 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache_options: 2024-09-12T01:19:58.544 INFO:journalctl@ceph.mon.c.smithi189.stdout: capacity : 536870912 2024-09-12T01:19:58.544 INFO:journalctl@ceph.mon.c.smithi189.stdout: num_shard_bits : 4 2024-09-12T01:19:58.544 INFO:journalctl@ceph.mon.c.smithi189.stdout: strict_capacity_limit : 0 2024-09-12T01:19:58.544 INFO:journalctl@ceph.mon.c.smithi189.stdout: high_pri_pool_ratio: 0.000 2024-09-12T01:19:58.544 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache_compressed: (nil) 2024-09-12T01:19:58.544 INFO:journalctl@ceph.mon.c.smithi189.stdout: persistent_cache: (nil) 2024-09-12T01:19:58.544 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_size: 4096 2024-09-12T01:19:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_size_deviation: 10 2024-09-12T01:19:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_restart_interval: 16 2024-09-12T01:19:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout: index_block_restart_interval: 1 2024-09-12T01:19:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout: metadata_block_size: 4096 2024-09-12T01:19:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout: partition_filters: 0 2024-09-12T01:19:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout: use_delta_encoding: 1 2024-09-12T01:19:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout: filter_policy: bloomfilter 2024-09-12T01:19:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout: whole_key_filtering: 1 2024-09-12T01:19:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout: verify_compression: 0 2024-09-12T01:19:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout: read_amp_bytes_per_bit: 0 2024-09-12T01:19:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout: format_version: 5 2024-09-12T01:19:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout: enable_index_compression: 1 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_align: 0 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout: max_auto_readahead_size: 262144 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout: prepopulate_block_cache: 0 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout: initial_auto_readahead_size: 8192 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compression: NoCompression 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.num_levels: 7 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T01:19:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T01:19:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T01:19:58.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:19:58.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:19:58.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T01:19:58.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T01:19:58.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:19:58.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T01:19:58.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T01:19:58.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T01:19:58.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T01:19:58.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T01:19:58.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T01:19:58.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T01:19:58.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T01:19:58.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T01:19:58.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T01:19:58.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T01:19:58.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T01:19:58.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T01:19:58.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T01:19:58.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T01:19:58.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T01:19:58.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T01:19:58.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T01:19:58.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T01:19:58.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T01:19:58.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.inplace_update_support: 0 2024-09-12T01:19:58.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.bloom_locality: 0 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.max_successive_merges: 0 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.ttl: 2592000 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T01:19:58.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.enable_blob_files: false 2024-09-12T01:19:58.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.min_blob_size: 0 2024-09-12T01:19:58.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T01:19:58.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T01:19:58.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T01:19:58.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T01:19:58.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T01:19:58.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T01:19:58.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T01:19:58.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T01:19:58.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T01:19:58.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-12T01:19:58.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e75c6402-d111-496c-9461-0b9f6929d87f 2024-09-12T01:19:58.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726103998188406, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726103998189017, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726103998, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e75c6402-d111-496c-9461-0b9f6929d87f", "db_session_id": "WRFBNS5VFKVG3NHF3QST", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726103998189144, "job": 1, "event": "recovery_finished"} 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5578a8d54e00 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: DB pointer 0x5578a8e50000 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** DB Stats ** 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:19:58.553 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:19:58.554 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T01:19:58.554 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:19:58.554 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:19:58.554 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T01:19:58.554 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** Compaction Stats [default] ** 2024-09-12T01:19:58.554 INFO:journalctl@ceph.mon.c.smithi189.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:19:58.554 INFO:journalctl@ceph.mon.c.smithi189.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T01:19:58.554 INFO:journalctl@ceph.mon.c.smithi189.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:19:58.554 INFO:journalctl@ceph.mon.c.smithi189.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:19:58.554 INFO:journalctl@ceph.mon.c.smithi189.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:19:58.554 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T01:19:58.554 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** Compaction Stats [default] ** 2024-09-12T01:19:58.554 INFO:journalctl@ceph.mon.c.smithi189.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:19:58.555 INFO:journalctl@ceph.mon.c.smithi189.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:19:58.555 INFO:journalctl@ceph.mon.c.smithi189.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:19:58.555 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T01:19:58.555 INFO:journalctl@ceph.mon.c.smithi189.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T01:19:58.555 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T01:19:58.555 INFO:journalctl@ceph.mon.c.smithi189.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:19:58.555 INFO:journalctl@ceph.mon.c.smithi189.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T01:19:58.555 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:19:58.555 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:19:58.555 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:19:58.555 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:19:58.555 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:19:58.556 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:19:58.556 INFO:journalctl@ceph.mon.c.smithi189.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:19:58.556 INFO:journalctl@ceph.mon.c.smithi189.stdout: Block cache BinnedLRUCache@0x5578a8d271f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-12T01:19:58.556 INFO:journalctl@ceph.mon.c.smithi189.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-12T01:19:58.556 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T01:19:58.556 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:19:58.557 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-12T01:19:58.557 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: using public_addr v2:172.21.15.189:0/0 -> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-12T01:19:58.557 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: starting mon.c rank -1 at public addrs [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] at bind addrs [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:19:58.557 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(???) e0 preinit fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:19:58.557 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(synchronizing).mds e1 new map 2024-09-12T01:19:58.557 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-12T01:19:58.557 INFO:journalctl@ceph.mon.c.smithi189.stdout: e1 2024-09-12T01:19:58.557 INFO:journalctl@ceph.mon.c.smithi189.stdout: btime 2024-09-12T01:18:28:404096+0000 2024-09-12T01:19:58.557 INFO:journalctl@ceph.mon.c.smithi189.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:19:58.557 INFO:journalctl@ceph.mon.c.smithi189.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:19:58.557 INFO:journalctl@ceph.mon.c.smithi189.stdout: legacy client fscid: -1 2024-09-12T01:19:58.557 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-09-12T01:19:58.557 INFO:journalctl@ceph.mon.c.smithi189.stdout: No filesystems configured 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: Added host smithi189 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:58.558 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3445994925' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3445994925' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:19:58.559 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: Updating smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: Updating smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi100:172.21.15.100=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: Saving service mon spec with placement smithi081:172.21.15.81=a;smithi100:172.21.15.100=b;smithi189:172.21.15.189=c;count:3 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: Deploying daemon mon.c on smithi189 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:19:58.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='client.? 172.21.15.189:0/242027842' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:19:58.561 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:19:58.561 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:19:58.561 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: from='client.? 172.21.15.189:0/949699805' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:19:58.561 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 ceph-mon[35357]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T01:19:58.561 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 bash[35337]: 5934253a917bc2f5ecc54e9aef6d0b8aa14fdcb0eb9a23c09bcb9e4917244082 2024-09-12T01:19:58.561 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:19:58 smithi189 systemd[1]: Started Ceph mon.c for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:19:58.806 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:19:58.807 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:19:59.057 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:20:03.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:20:03.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: mon.a calling monitor election 2024-09-12T01:20:03.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:03.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:03.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:03.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:03.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: mon.c calling monitor election 2024-09-12T01:20:03.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:03.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:03.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:03.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:03.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:03.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:20:03.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: monmap epoch 2 2024-09-12T01:20:03.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:20:03.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: last_changed 2024-09-12T01:19:58.216388+0000 2024-09-12T01:20:03.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: created 2024-09-12T01:18:25.338837+0000 2024-09-12T01:20:03.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: min_mon_release 19 (squid) 2024-09-12T01:20:03.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: election_strategy: 1 2024-09-12T01:20:03.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T01:20:03.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:20:03.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: fsmap 2024-09-12T01:20:03.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:20:03.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: mgrmap e13: x(active, since 38s) 2024-09-12T01:20:03.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: overall HEALTH_OK 2024-09-12T01:20:03.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:03.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:03.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:03.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:20:03.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:03.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:20:03.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: mon.a calling monitor election 2024-09-12T01:20:03.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:03.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:03.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:03.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: mon.c calling monitor election 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: monmap epoch 2 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: last_changed 2024-09-12T01:19:58.216388+0000 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: created 2024-09-12T01:18:25.338837+0000 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: min_mon_release 19 (squid) 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: election_strategy: 1 2024-09-12T01:20:03.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T01:20:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:20:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: fsmap 2024-09-12T01:20:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:20:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: mgrmap e13: x(active, since 38s) 2024-09-12T01:20:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: overall HEALTH_OK 2024-09-12T01:20:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:20:03.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:03.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.895+0000 7f3437590640 1 -- 172.21.15.189:0/3804506966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34301076e0 msgr2=0x7f341c005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:03.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.895+0000 7f3437590640 1 --2- 172.21.15.189:0/3804506966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34301076e0 0x7f341c005580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f342c012c60 tx=0x7f342c02c620 comp rx=0 tx=0).stop 2024-09-12T01:20:03.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.895+0000 7f3437590640 1 -- 172.21.15.189:0/3804506966 shutdown_connections 2024-09-12T01:20:03.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.895+0000 7f3437590640 1 --2- 172.21.15.189:0/3804506966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34301076e0 0x7f341c005580 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:03.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.895+0000 7f3437590640 1 -- 172.21.15.189:0/3804506966 >> 172.21.15.189:0/3804506966 conn(0x7f34300fb9a0 msgr2=0x7f34300fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:20:03.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.895+0000 7f3437590640 1 -- 172.21.15.189:0/3804506966 shutdown_connections 2024-09-12T01:20:03.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.895+0000 7f3437590640 1 -- 172.21.15.189:0/3804506966 wait complete. 2024-09-12T01:20:03.897 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.896+0000 7f3437590640 1 Processor -- start 2024-09-12T01:20:03.897 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.896+0000 7f3437590640 1 -- start start 2024-09-12T01:20:03.897 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f3437590640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34301076e0 0x7f3430100c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:03.897 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f3437590640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34301011d0 0x7f3430101630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:03.897 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f3437590640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3430109760 con 0x7f34301011d0 2024-09-12T01:20:03.897 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f3437590640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f34301095e0 con 0x7f34301076e0 2024-09-12T01:20:03.897 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f343532c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34301076e0 0x7f3430100c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:03.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f343532c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34301076e0 0x7f3430100c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:35124/0 (socket says 172.21.15.189:35124) 2024-09-12T01:20:03.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f343532c640 1 -- 172.21.15.189:0/3850085461 learned_addr learned my addr 172.21.15.189:0/3850085461 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:20:03.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f3434b2b640 1 --2- 172.21.15.189:0/3850085461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34301011d0 0x7f3430101630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:03.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f343532c640 1 -- 172.21.15.189:0/3850085461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34301076e0 msgr2=0x7f3430100c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T01:20:03.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f343532c640 1 -- 172.21.15.189:0/3850085461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34301076e0 msgr2=0x7f3430100c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:20:03.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f343532c640 1 --2- 172.21.15.189:0/3850085461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34301076e0 0x7f3430100c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:20:03.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f343532c640 1 --2- 172.21.15.189:0/3850085461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34301076e0 0x7f3430100c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:20:03.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f3434b2b640 1 -- 172.21.15.189:0/3850085461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34301076e0 msgr2=0x7f3430100c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:20:03.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f3434b2b640 1 --2- 172.21.15.189:0/3850085461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34301076e0 0x7f3430100c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:03.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.897+0000 7f3434b2b640 1 -- 172.21.15.189:0/3850085461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3430102b80 con 0x7f34301011d0 2024-09-12T01:20:03.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.898+0000 7f3434b2b640 1 --2- 172.21.15.189:0/3850085461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34301011d0 0x7f3430101630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f342000b400 tx=0x7f342000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:03.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.898+0000 7f34267fc640 1 -- 172.21.15.189:0/3850085461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3420011630 con 0x7f34301011d0 2024-09-12T01:20:03.899 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.898+0000 7f34267fc640 1 -- 172.21.15.189:0/3850085461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3420011cb0 con 0x7f34301011d0 2024-09-12T01:20:03.899 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.898+0000 7f3437590640 1 -- 172.21.15.189:0/3850085461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34301a3470 con 0x7f34301011d0 2024-09-12T01:20:03.899 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.898+0000 7f34267fc640 1 -- 172.21.15.189:0/3850085461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3420010d80 con 0x7f34301011d0 2024-09-12T01:20:03.899 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.898+0000 7f3437590640 1 -- 172.21.15.189:0/3850085461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34301a3a00 con 0x7f34301011d0 2024-09-12T01:20:03.900 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.899+0000 7f34267fc640 1 -- 172.21.15.189:0/3850085461 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3420018020 con 0x7f34301011d0 2024-09-12T01:20:03.900 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.899+0000 7f3437590640 1 -- 172.21.15.189:0/3850085461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343010a890 con 0x7f34301011d0 2024-09-12T01:20:03.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.899+0000 7f34267fc640 1 --2- 172.21.15.189:0/3850085461 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3414038df0 0x7f341403b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:03.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.899+0000 7f34267fc640 1 -- 172.21.15.189:0/3850085461 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f342004bd80 con 0x7f34301011d0 2024-09-12T01:20:03.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.900+0000 7f343532c640 1 --2- 172.21.15.189:0/3850085461 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3414038df0 0x7f341403b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:03.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.900+0000 7f343532c640 1 --2- 172.21.15.189:0/3850085461 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3414038df0 0x7f341403b2b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f342c035040 tx=0x7f342c033660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:03.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:03.905+0000 7f34267fc640 1 -- 172.21.15.189:0/3850085461 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f342001f020 con 0x7f34301011d0 2024-09-12T01:20:04.135 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:04.136+0000 7f3437590640 1 -- 172.21.15.189:0/3850085461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f34301021c0 con 0x7f34301011d0 2024-09-12T01:20:04.136 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:04.137+0000 7f34267fc640 1 -- 172.21.15.189:0/3850085461 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f3420018310 con 0x7f34301011d0 2024-09-12T01:20:04.136 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:20:04.136 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":2,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","modified":"2024-09-12T01:19:58.216388Z","created":"2024-09-12T01:18:25.338837Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:20:04.137 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 2 2024-09-12T01:20:04.138 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:04.139+0000 7f3437590640 1 -- 172.21.15.189:0/3850085461 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3414038df0 msgr2=0x7f341403b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:04.138 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:04.139+0000 7f3437590640 1 --2- 172.21.15.189:0/3850085461 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3414038df0 0x7f341403b2b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f342c035040 tx=0x7f342c033660 comp rx=0 tx=0).stop 2024-09-12T01:20:04.138 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:04.139+0000 7f3437590640 1 -- 172.21.15.189:0/3850085461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34301011d0 msgr2=0x7f3430101630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:04.138 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:04.139+0000 7f3437590640 1 --2- 172.21.15.189:0/3850085461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34301011d0 0x7f3430101630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f342000b400 tx=0x7f342000b8c0 comp rx=0 tx=0).stop 2024-09-12T01:20:04.139 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:04.139+0000 7f3437590640 1 -- 172.21.15.189:0/3850085461 shutdown_connections 2024-09-12T01:20:04.139 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:04.139+0000 7f3437590640 1 --2- 172.21.15.189:0/3850085461 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3414038df0 0x7f341403b2b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:04.139 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:04.139+0000 7f3437590640 1 --2- 172.21.15.189:0/3850085461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34301011d0 0x7f3430101630 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:04.139 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:04.139+0000 7f3437590640 1 --2- 172.21.15.189:0/3850085461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f34301076e0 0x7f3430100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:04.139 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:04.139+0000 7f3437590640 1 -- 172.21.15.189:0/3850085461 >> 172.21.15.189:0/3850085461 conn(0x7f34300fb9a0 msgr2=0x7f34300fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:20:04.139 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:04.139+0000 7f3437590640 1 -- 172.21.15.189:0/3850085461 shutdown_connections 2024-09-12T01:20:04.139 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:04.139+0000 7f3437590640 1 -- 172.21.15.189:0/3850085461 wait complete. 2024-09-12T01:20:04.445 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:04 smithi189 ceph-mon[35357]: Deploying daemon mon.b on smithi100 2024-09-12T01:20:04.445 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:04 smithi189 ceph-mon[35357]: from='client.? 172.21.15.189:0/3850085461' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:20:04.445 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:04 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:04.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:04 smithi081 ceph-mon[30920]: Deploying daemon mon.b on smithi100 2024-09-12T01:20:04.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:04 smithi081 ceph-mon[30920]: from='client.? 172.21.15.189:0/3850085461' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:20:04.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:04 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:05.723 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:20:05.724 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:20:05.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:05 smithi081 ceph-mon[30920]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:05.753 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:05 smithi189 ceph-mon[35357]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:05.978 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:20:06.432 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.431+0000 7ff9202dd640 1 -- 172.21.15.189:0/3168144903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918106630 msgr2=0x7ff918106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:06.432 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.431+0000 7ff9202dd640 1 --2- 172.21.15.189:0/3168144903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918106630 0x7ff918106a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff914009880 tx=0x7ff91402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:20:06.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.431+0000 7ff9202dd640 1 -- 172.21.15.189:0/3168144903 shutdown_connections 2024-09-12T01:20:06.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.431+0000 7ff9202dd640 1 --2- 172.21.15.189:0/3168144903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918106630 0x7ff918106a10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:06.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.431+0000 7ff9202dd640 1 -- 172.21.15.189:0/3168144903 >> 172.21.15.189:0/3168144903 conn(0x7ff9180fc220 msgr2=0x7ff9180fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:20:06.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.431+0000 7ff9202dd640 1 -- 172.21.15.189:0/3168144903 shutdown_connections 2024-09-12T01:20:06.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.431+0000 7ff9202dd640 1 -- 172.21.15.189:0/3168144903 wait complete. 2024-09-12T01:20:06.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff9202dd640 1 Processor -- start 2024-09-12T01:20:06.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff9202dd640 1 -- start start 2024-09-12T01:20:06.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff9202dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918106630 0x7ff9180fc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:06.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff9202dd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9180fcc10 0x7ff9180fd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:06.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff9202dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff91810ac60 con 0x7ff918106630 2024-09-12T01:20:06.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff9202dd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff91810aae0 con 0x7ff9180fcc10 2024-09-12T01:20:06.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff91d878640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9180fcc10 0x7ff9180fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:06.434 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff91d878640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9180fcc10 0x7ff9180fd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:35128/0 (socket says 172.21.15.189:35128) 2024-09-12T01:20:06.434 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff91d878640 1 -- 172.21.15.189:0/4085866902 learned_addr learned my addr 172.21.15.189:0/4085866902 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:20:06.434 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff91d878640 1 -- 172.21.15.189:0/4085866902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9180fcc10 msgr2=0x7ff9180fd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T01:20:06.434 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff91d878640 1 -- 172.21.15.189:0/4085866902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9180fcc10 msgr2=0x7ff9180fd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:20:06.434 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff91d878640 1 --2- 172.21.15.189:0/4085866902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9180fcc10 0x7ff9180fd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:20:06.434 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff91e079640 1 --2- 172.21.15.189:0/4085866902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918106630 0x7ff9180fc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:06.434 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.432+0000 7ff91d878640 1 --2- 172.21.15.189:0/4085866902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9180fcc10 0x7ff9180fd070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:20:06.434 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.433+0000 7ff91e079640 1 -- 172.21.15.189:0/4085866902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9180fcc10 msgr2=0x7ff9180fd070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:20:06.434 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.433+0000 7ff91e079640 1 --2- 172.21.15.189:0/4085866902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9180fcc10 0x7ff9180fd070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:06.434 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.433+0000 7ff91e079640 1 -- 172.21.15.189:0/4085866902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9180fe5c0 con 0x7ff918106630 2024-09-12T01:20:06.434 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.433+0000 7ff91e079640 1 --2- 172.21.15.189:0/4085866902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918106630 0x7ff9180fc6d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff914000c00 tx=0x7ff914032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:06.434 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.433+0000 7ff90f7fe640 1 -- 172.21.15.189:0/4085866902 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ff914035070 con 0x7ff918106630 2024-09-12T01:20:06.434 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.433+0000 7ff90f7fe640 1 -- 172.21.15.189:0/4085866902 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff914032e40 con 0x7ff918106630 2024-09-12T01:20:06.435 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.433+0000 7ff9202dd640 1 -- 172.21.15.189:0/4085866902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9181a3650 con 0x7ff918106630 2024-09-12T01:20:06.435 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.433+0000 7ff90f7fe640 1 -- 172.21.15.189:0/4085866902 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ff91403bc30 con 0x7ff918106630 2024-09-12T01:20:06.435 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.433+0000 7ff9202dd640 1 -- 172.21.15.189:0/4085866902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9181a3b80 con 0x7ff918106630 2024-09-12T01:20:06.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.434+0000 7ff90f7fe640 1 -- 172.21.15.189:0/4085866902 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff914042030 con 0x7ff918106630 2024-09-12T01:20:06.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.434+0000 7ff9202dd640 1 -- 172.21.15.189:0/4085866902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff918101ca0 con 0x7ff918106630 2024-09-12T01:20:06.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.434+0000 7ff90f7fe640 1 --2- 172.21.15.189:0/4085866902 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff904038e00 0x7ff90403b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:06.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.434+0000 7ff90f7fe640 1 -- 172.21.15.189:0/4085866902 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff914040070 con 0x7ff918106630 2024-09-12T01:20:06.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.434+0000 7ff91d878640 1 --2- 172.21.15.189:0/4085866902 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff904038e00 0x7ff90403b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:06.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.435+0000 7ff91d878640 1 --2- 172.21.15.189:0/4085866902 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff904038e00 0x7ff90403b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff908009100 tx=0x7ff908008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:06.438 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.439+0000 7ff90f7fe640 1 -- 172.21.15.189:0/4085866902 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff91403bdd0 con 0x7ff918106630 2024-09-12T01:20:06.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.666+0000 7ff9202dd640 1 -- 172.21.15.189:0/4085866902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff9181a3e30 con 0x7ff918106630 2024-09-12T01:20:06.665 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.667+0000 7ff90f7fe640 1 -- 172.21.15.189:0/4085866902 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7ff91403b510 con 0x7ff918106630 2024-09-12T01:20:06.666 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:20:06.666 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":2,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","modified":"2024-09-12T01:19:58.216388Z","created":"2024-09-12T01:18:25.338837Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:20:06.666 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 2 2024-09-12T01:20:06.670 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.670+0000 7ff9202dd640 1 -- 172.21.15.189:0/4085866902 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff904038e00 msgr2=0x7ff90403b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:06.670 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.670+0000 7ff9202dd640 1 --2- 172.21.15.189:0/4085866902 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff904038e00 0x7ff90403b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff908009100 tx=0x7ff908008040 comp rx=0 tx=0).stop 2024-09-12T01:20:06.670 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.670+0000 7ff9202dd640 1 -- 172.21.15.189:0/4085866902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918106630 msgr2=0x7ff9180fc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:06.670 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.670+0000 7ff9202dd640 1 --2- 172.21.15.189:0/4085866902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918106630 0x7ff9180fc6d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff914000c00 tx=0x7ff914032c50 comp rx=0 tx=0).stop 2024-09-12T01:20:06.670 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.670+0000 7ff9202dd640 1 -- 172.21.15.189:0/4085866902 shutdown_connections 2024-09-12T01:20:06.670 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.670+0000 7ff9202dd640 1 --2- 172.21.15.189:0/4085866902 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff904038e00 0x7ff90403b2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:06.670 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.670+0000 7ff9202dd640 1 --2- 172.21.15.189:0/4085866902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9180fcc10 0x7ff9180fd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:06.671 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.670+0000 7ff9202dd640 1 --2- 172.21.15.189:0/4085866902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918106630 0x7ff9180fc6d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:06.671 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.670+0000 7ff9202dd640 1 -- 172.21.15.189:0/4085866902 >> 172.21.15.189:0/4085866902 conn(0x7ff9180fc220 msgr2=0x7ff9181900f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:20:06.671 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.670+0000 7ff9202dd640 1 -- 172.21.15.189:0/4085866902 shutdown_connections 2024-09-12T01:20:06.671 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:06.670+0000 7ff9202dd640 1 -- 172.21.15.189:0/4085866902 wait complete. 2024-09-12T01:20:07.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:06 smithi100 systemd[1]: Started Ceph mon.b for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:20:08.223 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:20:08.223 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:20:08.474 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:20:12.122 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.121+0000 7f6e78dd8640 1 -- 172.21.15.189:0/1386420237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c003530 msgr2=0x7f6e5c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:12.122 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.121+0000 7f6e78dd8640 1 --2- 172.21.15.189:0/1386420237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c003530 0x7f6e5c0059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e741016c0 tx=0x7f6e6402c150 comp rx=0 tx=0).stop 2024-09-12T01:20:12.122 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.121+0000 7f6e78dd8640 1 -- 172.21.15.189:0/1386420237 shutdown_connections 2024-09-12T01:20:12.122 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.121+0000 7f6e78dd8640 1 --2- 172.21.15.189:0/1386420237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5c003530 0x7f6e5c0059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:12.122 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.121+0000 7f6e78dd8640 1 -- 172.21.15.189:0/1386420237 >> 172.21.15.189:0/1386420237 conn(0x7f6e740fc280 msgr2=0x7f6e740fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:20:12.122 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.121+0000 7f6e78dd8640 1 -- 172.21.15.189:0/1386420237 shutdown_connections 2024-09-12T01:20:12.123 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.121+0000 7f6e78dd8640 1 -- 172.21.15.189:0/1386420237 wait complete. 2024-09-12T01:20:12.124 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e78dd8640 1 Processor -- start 2024-09-12T01:20:12.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e78dd8640 1 -- start start 2024-09-12T01:20:12.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e78dd8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c003530 0x7f6e74197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:12.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e78dd8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e74197890 0x7f6e7419bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:12.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e78dd8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e7419c160 0x7f6e7419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:12.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e78dd8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6e74108690 con 0x7f6e74197890 2024-09-12T01:20:12.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e78dd8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6e74108510 con 0x7f6e7419c160 2024-09-12T01:20:12.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e78dd8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e74108810 con 0x7f6e5c003530 2024-09-12T01:20:12.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e7259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c003530 0x7f6e74197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:12.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e7259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c003530 0x7f6e74197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:51550/0 (socket says 172.21.15.189:51550) 2024-09-12T01:20:12.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e71d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e74197890 0x7f6e7419bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:12.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e7259c640 1 -- 172.21.15.189:0/2834777431 learned_addr learned my addr 172.21.15.189:0/2834777431 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:20:12.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e72d9d640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e7419c160 0x7f6e7419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:12.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e7259c640 1 -- 172.21.15.189:0/2834777431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c003530 msgr2=0x7f6e74197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T01:20:12.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e7259c640 1 -- 172.21.15.189:0/2834777431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c003530 msgr2=0x7f6e74197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:20:12.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e7259c640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c003530 0x7f6e74197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:20:12.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e7259c640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c003530 0x7f6e74197350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:20:12.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e72d9d640 1 -- 172.21.15.189:0/2834777431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e7419c160 msgr2=0x7f6e7419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-12T01:20:12.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e72d9d640 1 -- 172.21.15.189:0/2834777431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e7419c160 msgr2=0x7f6e7419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:20:12.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.123+0000 7f6e72d9d640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e7419c160 0x7f6e7419c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:20:12.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.124+0000 7f6e72d9d640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e7419c160 0x7f6e7419c610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:20:12.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.124+0000 7f6e71d9b640 1 -- 172.21.15.189:0/2834777431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c003530 msgr2=0x7f6e74197350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:20:12.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.124+0000 7f6e71d9b640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c003530 0x7f6e74197350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:12.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.124+0000 7f6e71d9b640 1 -- 172.21.15.189:0/2834777431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e7419c160 msgr2=0x7f6e7419c610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:20:12.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.124+0000 7f6e71d9b640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e7419c160 0x7f6e7419c610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:12.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.124+0000 7f6e71d9b640 1 -- 172.21.15.189:0/2834777431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e741a3ed0 con 0x7f6e74197890 2024-09-12T01:20:12.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.124+0000 7f6e71d9b640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e74197890 0x7f6e7419bc20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009980 tx=0x7f6e68009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:12.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.124+0000 7f6e637fe640 1 -- 172.21.15.189:0/2834777431 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6800f460 con 0x7f6e74197890 2024-09-12T01:20:12.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.124+0000 7f6e637fe640 1 -- 172.21.15.189:0/2834777431 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e68014070 con 0x7f6e74197890 2024-09-12T01:20:12.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.124+0000 7f6e78dd8640 1 -- 172.21.15.189:0/2834777431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e741028f0 con 0x7f6e74197890 2024-09-12T01:20:12.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.124+0000 7f6e637fe640 1 -- 172.21.15.189:0/2834777431 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68010810 con 0x7f6e74197890 2024-09-12T01:20:12.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.124+0000 7f6e78dd8640 1 -- 172.21.15.189:0/2834777431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e74102e80 con 0x7f6e74197890 2024-09-12T01:20:12.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.125+0000 7f6e637fe640 1 -- 172.21.15.189:0/2834777431 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6e68016070 con 0x7f6e74197890 2024-09-12T01:20:12.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.125+0000 7f6e78dd8640 1 -- 172.21.15.189:0/2834777431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e741097c0 con 0x7f6e74197890 2024-09-12T01:20:12.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.126+0000 7f6e637fe640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6e54039690 0x7f6e5403bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:12.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.126+0000 7f6e637fe640 1 -- 172.21.15.189:0/2834777431 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6e6804f2e0 con 0x7f6e74197890 2024-09-12T01:20:12.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.126+0000 7f6e7259c640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6e54039690 0x7f6e5403bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:12.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.126+0000 7f6e7259c640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6e54039690 0x7f6e5403bb50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6e64005fd0 tx=0x7f6e64005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:12.134 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.130+0000 7f6e637fe640 1 -- 172.21.15.189:0/2834777431 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e6801fbe0 con 0x7f6e74197890 2024-09-12T01:20:12.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:20:12.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: mon.c calling monitor election 2024-09-12T01:20:12.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: mon.a calling monitor election 2024-09-12T01:20:12.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:20:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: monmap epoch 3 2024-09-12T01:20:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:20:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: last_changed 2024-09-12T01:20:06.916992+0000 2024-09-12T01:20:12.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: created 2024-09-12T01:18:25.338837+0000 2024-09-12T01:20:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: min_mon_release 19 (squid) 2024-09-12T01:20:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: election_strategy: 1 2024-09-12T01:20:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T01:20:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:20:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-12T01:20:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: fsmap 2024-09-12T01:20:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:20:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: mgrmap e13: x(active, since 47s) 2024-09-12T01:20:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: overall HEALTH_OK 2024-09-12T01:20:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:12.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:12.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:20:12.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: mon.c calling monitor election 2024-09-12T01:20:12.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: mon.a calling monitor election 2024-09-12T01:20:12.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:12.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:12.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:12.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:12.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:12.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:12.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:12.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:12.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:12.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:20:12.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: monmap epoch 3 2024-09-12T01:20:12.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:20:12.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: last_changed 2024-09-12T01:20:06.916992+0000 2024-09-12T01:20:12.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: created 2024-09-12T01:18:25.338837+0000 2024-09-12T01:20:12.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: min_mon_release 19 (squid) 2024-09-12T01:20:12.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: election_strategy: 1 2024-09-12T01:20:12.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T01:20:12.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:20:12.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-12T01:20:12.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: fsmap 2024-09-12T01:20:12.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:20:12.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: mgrmap e13: x(active, since 47s) 2024-09-12T01:20:12.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: overall HEALTH_OK 2024-09-12T01:20:12.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:12.285 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:12.285 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:12.285 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:12.377 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.377+0000 7f6e78dd8640 1 -- 172.21.15.189:0/2834777431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6e74103210 con 0x7f6e74197890 2024-09-12T01:20:12.378 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.377+0000 7f6e637fe640 1 -- 172.21.15.189:0/2834777431 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7f6e68003610 con 0x7f6e74197890 2024-09-12T01:20:12.378 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:20:12.378 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":3,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","modified":"2024-09-12T01:20:06.916992Z","created":"2024-09-12T01:18:25.338837Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:20:12.378 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 3 2024-09-12T01:20:12.380 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.379+0000 7f6e78dd8640 1 -- 172.21.15.189:0/2834777431 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6e54039690 msgr2=0x7f6e5403bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:12.380 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.380+0000 7f6e78dd8640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6e54039690 0x7f6e5403bb50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6e64005fd0 tx=0x7f6e64005d50 comp rx=0 tx=0).stop 2024-09-12T01:20:12.380 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.380+0000 7f6e78dd8640 1 -- 172.21.15.189:0/2834777431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e74197890 msgr2=0x7f6e7419bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:12.380 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.380+0000 7f6e78dd8640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e74197890 0x7f6e7419bc20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009980 tx=0x7f6e68009e40 comp rx=0 tx=0).stop 2024-09-12T01:20:12.380 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.380+0000 7f6e78dd8640 1 -- 172.21.15.189:0/2834777431 shutdown_connections 2024-09-12T01:20:12.380 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.380+0000 7f6e78dd8640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6e54039690 0x7f6e5403bb50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:12.380 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.380+0000 7f6e78dd8640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e7419c160 0x7f6e7419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:12.380 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.380+0000 7f6e78dd8640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e74197890 0x7f6e7419bc20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:12.380 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.380+0000 7f6e78dd8640 1 --2- 172.21.15.189:0/2834777431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e5c003530 0x7f6e74197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:12.380 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.380+0000 7f6e78dd8640 1 -- 172.21.15.189:0/2834777431 >> 172.21.15.189:0/2834777431 conn(0x7f6e740fc280 msgr2=0x7f6e74105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:20:12.380 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.380+0000 7f6e78dd8640 1 -- 172.21.15.189:0/2834777431 shutdown_connections 2024-09-12T01:20:12.381 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:12.380+0000 7f6e78dd8640 1 -- 172.21.15.189:0/2834777431 wait complete. 2024-09-12T01:20:12.928 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T01:20:12.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T01:20:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:20:13.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:12 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:13.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:12 smithi081 ceph-mon[30920]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:13.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:12 smithi081 ceph-mon[30920]: from='client.? 172.21.15.189:0/2834777431' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:20:13.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:12 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:13.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:12 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:13.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:12 smithi189 ceph-mon[35357]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:13.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:12 smithi189 ceph-mon[35357]: from='client.? 172.21.15.189:0/2834777431' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:20:13.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:12 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:13.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.642+0000 7f340fdbd640 1 -- 172.21.15.81:0/3041376739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3408102750 msgr2=0x7f3408102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:13.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.642+0000 7f340fdbd640 1 --2- 172.21.15.81:0/3041376739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3408102750 0x7f3408102b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3404009880 tx=0x7f340402a670 comp rx=0 tx=0).stop 2024-09-12T01:20:13.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.642+0000 7f340fdbd640 1 -- 172.21.15.81:0/3041376739 shutdown_connections 2024-09-12T01:20:13.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.642+0000 7f340fdbd640 1 --2- 172.21.15.81:0/3041376739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3408102750 0x7f3408102b30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:13.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.642+0000 7f340fdbd640 1 -- 172.21.15.81:0/3041376739 >> 172.21.15.81:0/3041376739 conn(0x7f34080fc1b0 msgr2=0x7f34080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:20:13.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.642+0000 7f340fdbd640 1 -- 172.21.15.81:0/3041376739 shutdown_connections 2024-09-12T01:20:13.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.642+0000 7f340fdbd640 1 -- 172.21.15.81:0/3041376739 wait complete. 2024-09-12T01:20:13.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.643+0000 7f340fdbd640 1 Processor -- start 2024-09-12T01:20:13.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.643+0000 7f340fdbd640 1 -- start start 2024-09-12T01:20:13.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.643+0000 7f340fdbd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3408102750 0x7f3408197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:13.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.643+0000 7f340fdbd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3408197960 0x7f340819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:13.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.643+0000 7f340fdbd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f340819c230 0x7f340819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:13.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.643+0000 7f340fdbd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f340810bc70 con 0x7f340819c230 2024-09-12T01:20:13.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.643+0000 7f340fdbd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f340810baf0 con 0x7f3408102750 2024-09-12T01:20:13.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.643+0000 7f340fdbd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f340810bdf0 con 0x7f3408197960 2024-09-12T01:20:13.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.643+0000 7f340e35a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f340819c230 0x7f340819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:13.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.643+0000 7f340db59640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3408102750 0x7f3408197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:13.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.643+0000 7f340e35a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f340819c230 0x7f340819c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55788/0 (socket says 172.21.15.81:55788) 2024-09-12T01:20:13.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.643+0000 7f340e35a640 1 -- 172.21.15.81:0/3267951533 learned_addr learned my addr 172.21.15.81:0/3267951533 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:20:13.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f340d358640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3408197960 0x7f340819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:13.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f340db59640 1 -- 172.21.15.81:0/3267951533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3408102750 msgr2=0x7f3408197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T01:20:13.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f340db59640 1 -- 172.21.15.81:0/3267951533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3408102750 msgr2=0x7f3408197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:20:13.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f340db59640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3408102750 0x7f3408197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:20:13.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f340db59640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3408102750 0x7f3408197420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:20:13.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f340e35a640 1 -- 172.21.15.81:0/3267951533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3408197960 msgr2=0x7f340819bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:13.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f340e35a640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3408197960 0x7f340819bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:13.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f340e35a640 1 -- 172.21.15.81:0/3267951533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3408102750 msgr2=0x7f3408197420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:20:13.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f340e35a640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3408102750 0x7f3408197420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:13.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f340e35a640 1 -- 172.21.15.81:0/3267951533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34081a3fa0 con 0x7f340819c230 2024-09-12T01:20:13.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f340e35a640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f340819c230 0x7f340819c6e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f340000ba50 tx=0x7f340000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:13.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f33feffd640 1 -- 172.21.15.81:0/3267951533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400019070 con 0x7f340819c230 2024-09-12T01:20:13.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f33feffd640 1 -- 172.21.15.81:0/3267951533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f340000cbe0 con 0x7f340819c230 2024-09-12T01:20:13.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f33feffd640 1 -- 172.21.15.81:0/3267951533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34000076a0 con 0x7f340819c230 2024-09-12T01:20:13.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f340fdbd640 1 -- 172.21.15.81:0/3267951533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34081a41d0 con 0x7f340819c230 2024-09-12T01:20:13.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.644+0000 7f340fdbd640 1 -- 172.21.15.81:0/3267951533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34081a4690 con 0x7f340819c230 2024-09-12T01:20:13.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.645+0000 7f340fdbd640 1 -- 172.21.15.81:0/3267951533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3408102bb0 con 0x7f340819c230 2024-09-12T01:20:13.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.645+0000 7f33feffd640 1 -- 172.21.15.81:0/3267951533 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f340001c070 con 0x7f340819c230 2024-09-12T01:20:13.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.646+0000 7f33feffd640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f33f40394f0 0x7f33f403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:13.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.646+0000 7f33feffd640 1 -- 172.21.15.81:0/3267951533 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f340004bbd0 con 0x7f340819c230 2024-09-12T01:20:13.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.646+0000 7f340db59640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f33f40394f0 0x7f33f403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:13.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.646+0000 7f340db59640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f33f40394f0 0x7f33f403b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3404031550 tx=0x7f34040058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:13.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.650+0000 7f33feffd640 1 -- 172.21.15.81:0/3267951533 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34000112a0 con 0x7f340819c230 2024-09-12T01:20:13.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.855+0000 7f340fdbd640 1 -- 172.21.15.81:0/3267951533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f34081a4a30 con 0x7f340819c230 2024-09-12T01:20:13.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.856+0000 7f33feffd640 1 -- 172.21.15.81:0/3267951533 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f340000ce00 con 0x7f340819c230 2024-09-12T01:20:13.855 INFO:teuthology.orchestra.run.smithi081.stdout:# minimal ceph.conf for c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:20:13.855 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-12T01:20:13.855 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:20:13.855 INFO:teuthology.orchestra.run.smithi081.stdout: mon_host = [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-12T01:20:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.859+0000 7f340fdbd640 1 -- 172.21.15.81:0/3267951533 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f33f40394f0 msgr2=0x7f33f403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.859+0000 7f340fdbd640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f33f40394f0 0x7f33f403b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3404031550 tx=0x7f34040058b0 comp rx=0 tx=0).stop 2024-09-12T01:20:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.859+0000 7f340fdbd640 1 -- 172.21.15.81:0/3267951533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f340819c230 msgr2=0x7f340819c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.859+0000 7f340fdbd640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f340819c230 0x7f340819c6e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f340000ba50 tx=0x7f340000bf10 comp rx=0 tx=0).stop 2024-09-12T01:20:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.859+0000 7f340fdbd640 1 -- 172.21.15.81:0/3267951533 shutdown_connections 2024-09-12T01:20:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.859+0000 7f340fdbd640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f33f40394f0 0x7f33f403b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.859+0000 7f340fdbd640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f340819c230 0x7f340819c6e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:13.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.859+0000 7f340fdbd640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3408197960 0x7f340819bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.859+0000 7f340fdbd640 1 --2- 172.21.15.81:0/3267951533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3408102750 0x7f3408197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.859+0000 7f340fdbd640 1 -- 172.21.15.81:0/3267951533 >> 172.21.15.81:0/3267951533 conn(0x7f34080fc1b0 msgr2=0x7f3408105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:20:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.859+0000 7f340fdbd640 1 -- 172.21.15.81:0/3267951533 shutdown_connections 2024-09-12T01:20:13.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:13.859+0000 7f340fdbd640 1 -- 172.21.15.81:0/3267951533 wait complete. 2024-09-12T01:20:14.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:20:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: mon.c calling monitor election 2024-09-12T01:20:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: mon.a calling monitor election 2024-09-12T01:20:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:20:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:20:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: monmap epoch 3 2024-09-12T01:20:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:20:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: last_changed 2024-09-12T01:20:06.916992+0000 2024-09-12T01:20:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: created 2024-09-12T01:18:25.338837+0000 2024-09-12T01:20:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: min_mon_release 19 (squid) 2024-09-12T01:20:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: election_strategy: 1 2024-09-12T01:20:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T01:20:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:20:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-12T01:20:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: fsmap 2024-09-12T01:20:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:20:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: mgrmap e13: x(active, since 47s) 2024-09-12T01:20:14.271 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: overall HEALTH_OK 2024-09-12T01:20:14.271 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.271 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.271 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.271 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.271 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:14.271 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:14.271 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='client.? 172.21.15.189:0/2834777431' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:20:14.271 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:14.564 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T01:20:14.564 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:20:14.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:20:14.592 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:20:14.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:20:14.658 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:20:14.658 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:20:14.686 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:20:14.686 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:20:14.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: mon.b calling monitor election 2024-09-12T01:20:14.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T01:20:14.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T01:20:14.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T01:20:14.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: Updating smithi081:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:20:14.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: Updating smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:20:14.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: Updating smithi100:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:20:14.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: mon.b calling monitor election 2024-09-12T01:20:14.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: mon.c calling monitor election 2024-09-12T01:20:14.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: mon.a calling monitor election 2024-09-12T01:20:14.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:20:14.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: monmap epoch 3 2024-09-12T01:20:14.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:20:14.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: last_changed 2024-09-12T01:20:06.916992+0000 2024-09-12T01:20:14.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: created 2024-09-12T01:18:25.338837+0000 2024-09-12T01:20:14.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: min_mon_release 19 (squid) 2024-09-12T01:20:14.751 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: election_strategy: 1 2024-09-12T01:20:14.751 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T01:20:14.751 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:20:14.751 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-12T01:20:14.751 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: fsmap 2024-09-12T01:20:14.751 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:20:14.751 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: mgrmap e13: x(active, since 49s) 2024-09-12T01:20:14.751 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: overall HEALTH_OK 2024-09-12T01:20:14.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:20:14.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:20:14.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:20:14.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:14.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: Reconfiguring daemon mon.a on smithi081 2024-09-12T01:20:14.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:14.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.755 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:20:14.755 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:20:14.786 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:20:14.787 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:20:14.848 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: mon.b calling monitor election 2024-09-12T01:20:14.849 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T01:20:14.849 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T01:20:14.849 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T01:20:14.849 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: Updating smithi081:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:20:14.849 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: Updating smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:20:14.849 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: Updating smithi100:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:20:14.849 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: mon.b calling monitor election 2024-09-12T01:20:14.849 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: mon.c calling monitor election 2024-09-12T01:20:14.849 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: mon.a calling monitor election 2024-09-12T01:20:14.849 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:20:14.849 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: monmap epoch 3 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: last_changed 2024-09-12T01:20:06.916992+0000 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: created 2024-09-12T01:18:25.338837+0000 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: min_mon_release 19 (squid) 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: election_strategy: 1 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: fsmap 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: mgrmap e13: x(active, since 49s) 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: overall HEALTH_OK 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.850 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:14.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: Reconfiguring daemon mon.a on smithi081 2024-09-12T01:20:14.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:14.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.853 INFO:tasks.cephadm:Adding mgr.x on smithi081 2024-09-12T01:20:14.853 INFO:tasks.cephadm:Adding mgr.y on smithi100 2024-09-12T01:20:14.853 INFO:tasks.cephadm:Adding mgr.z on smithi189 2024-09-12T01:20:14.853 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi081=x;smithi100=y;smithi189=z' 2024-09-12T01:20:14.914 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: mon.b calling monitor election 2024-09-12T01:20:14.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T01:20:14.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T01:20:14.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T01:20:14.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: Updating smithi081:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:20:14.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: Updating smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:20:14.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: Updating smithi100:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:20:14.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: mon.b calling monitor election 2024-09-12T01:20:14.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: mon.c calling monitor election 2024-09-12T01:20:14.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: mon.a calling monitor election 2024-09-12T01:20:14.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:20:14.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: monmap epoch 3 2024-09-12T01:20:14.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:20:14.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: last_changed 2024-09-12T01:20:06.916992+0000 2024-09-12T01:20:14.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: created 2024-09-12T01:18:25.338837+0000 2024-09-12T01:20:14.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: min_mon_release 19 (squid) 2024-09-12T01:20:14.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: election_strategy: 1 2024-09-12T01:20:14.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T01:20:14.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-12T01:20:14.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-12T01:20:14.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: fsmap 2024-09-12T01:20:14.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:20:14.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: mgrmap e13: x(active, since 49s) 2024-09-12T01:20:14.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: overall HEALTH_OK 2024-09-12T01:20:14.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:14.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:20:14.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:20:14.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:20:14.918 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:14.918 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: Reconfiguring daemon mon.a on smithi081 2024-09-12T01:20:14.918 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:14.918 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:15.130 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:20:15.616 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.614+0000 7f68c578a640 1 -- 172.21.15.189:0/2909652257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c01005f0 msgr2=0x7f68c01009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:15.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.614+0000 7f68c578a640 1 --2- 172.21.15.189:0/2909652257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c01005f0 0x7f68c01009f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009880 tx=0x7f68b002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:20:15.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.614+0000 7f68c578a640 1 -- 172.21.15.189:0/2909652257 shutdown_connections 2024-09-12T01:20:15.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.614+0000 7f68c578a640 1 --2- 172.21.15.189:0/2909652257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c01005f0 0x7f68c01009f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:15.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.614+0000 7f68c578a640 1 -- 172.21.15.189:0/2909652257 >> 172.21.15.189:0/2909652257 conn(0x7f68c00fbda0 msgr2=0x7f68c00fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:20:15.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.614+0000 7f68c578a640 1 -- 172.21.15.189:0/2909652257 shutdown_connections 2024-09-12T01:20:15.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.614+0000 7f68c578a640 1 -- 172.21.15.189:0/2909652257 wait complete. 2024-09-12T01:20:15.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.614+0000 7f68c578a640 1 Processor -- start 2024-09-12T01:20:15.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.614+0000 7f68c578a640 1 -- start start 2024-09-12T01:20:15.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68c578a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c01005f0 0x7f68c006af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:15.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68c578a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c019c130 0x7f68c019e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:15.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68c578a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c019ea60 0x7f68c01a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:15.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68c578a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68c01066e0 con 0x7f68c019ea60 2024-09-12T01:20:15.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68c578a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0106560 con 0x7f68c019c130 2024-09-12T01:20:15.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68c578a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0106860 con 0x7f68c01005f0 2024-09-12T01:20:15.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68beffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c01005f0 0x7f68c006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:15.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68beffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c01005f0 0x7f68c006af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:51564/0 (socket says 172.21.15.189:51564) 2024-09-12T01:20:15.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68beffd640 1 -- 172.21.15.189:0/222413468 learned_addr learned my addr 172.21.15.189:0/222413468 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:20:15.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68bf7fe640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c019ea60 0x7f68c01a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:15.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68b7fff640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c019c130 0x7f68c019e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:15.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68beffd640 1 -- 172.21.15.189:0/222413468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c019c130 msgr2=0x7f68c019e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:15.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68beffd640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c019c130 0x7f68c019e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:15.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68beffd640 1 -- 172.21.15.189:0/222413468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c019ea60 msgr2=0x7f68c01a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:15.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68beffd640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c019ea60 0x7f68c01a0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:15.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68beffd640 1 -- 172.21.15.189:0/222413468 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c01a1640 con 0x7f68c01005f0 2024-09-12T01:20:15.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68beffd640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c01005f0 0x7f68c006af90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f68b0031610 tx=0x7f68b00043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:15.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.615+0000 7f68bcff9640 1 -- 172.21.15.189:0/222413468 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b003f030 con 0x7f68c01005f0 2024-09-12T01:20:15.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.616+0000 7f68c578a640 1 -- 172.21.15.189:0/222413468 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c01a1870 con 0x7f68c01005f0 2024-09-12T01:20:15.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.616+0000 7f68bcff9640 1 -- 172.21.15.189:0/222413468 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68b0003ce0 con 0x7f68c01005f0 2024-09-12T01:20:15.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.616+0000 7f68bcff9640 1 -- 172.21.15.189:0/222413468 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b0035070 con 0x7f68c01005f0 2024-09-12T01:20:15.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.616+0000 7f68c578a640 1 -- 172.21.15.189:0/222413468 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c01a1e20 con 0x7f68c01005f0 2024-09-12T01:20:15.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.617+0000 7f68bcff9640 1 -- 172.21.15.189:0/222413468 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f68b0042030 con 0x7f68c01005f0 2024-09-12T01:20:15.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.617+0000 7f68c578a640 1 -- 172.21.15.189:0/222413468 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c0100a70 con 0x7f68c01005f0 2024-09-12T01:20:15.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.617+0000 7f68bcff9640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f68ac039520 0x7f68ac03b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:15.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.617+0000 7f68bcff9640 1 -- 172.21.15.189:0/222413468 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f68b006ccd0 con 0x7f68c01005f0 2024-09-12T01:20:15.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.617+0000 7f68b7fff640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f68ac039520 0x7f68ac03b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:15.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.618+0000 7f68b7fff640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f68ac039520 0x7f68ac03b9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f68c006b510 tx=0x7f68a8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:15.622 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.622+0000 7f68bcff9640 1 -- 172.21.15.189:0/222413468 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68b004c350 con 0x7f68c01005f0 2024-09-12T01:20:15.806 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.801+0000 7f68c578a640 1 -- 172.21.15.189:0/222413468 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi100=y;smithi189=z", "target": ["mon-mgr", ""]}) -- 0x7f68c0062780 con 0x7f68ac039520 2024-09-12T01:20:15.806 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:15 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:15.806 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.806+0000 7f68bcff9640 1 -- 172.21.15.189:0/222413468 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f68c0062780 con 0x7f68ac039520 2024-09-12T01:20:15.807 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mgr update... 2024-09-12T01:20:15.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.809+0000 7f68c578a640 1 -- 172.21.15.189:0/222413468 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f68ac039520 msgr2=0x7f68ac03b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:15.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.809+0000 7f68c578a640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f68ac039520 0x7f68ac03b9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f68c006b510 tx=0x7f68a8008040 comp rx=0 tx=0).stop 2024-09-12T01:20:15.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.809+0000 7f68c578a640 1 -- 172.21.15.189:0/222413468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c01005f0 msgr2=0x7f68c006af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:15.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.809+0000 7f68c578a640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c01005f0 0x7f68c006af90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f68b0031610 tx=0x7f68b00043c0 comp rx=0 tx=0).stop 2024-09-12T01:20:15.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.809+0000 7f68c578a640 1 -- 172.21.15.189:0/222413468 shutdown_connections 2024-09-12T01:20:15.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.809+0000 7f68c578a640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f68ac039520 0x7f68ac03b9e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:15.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.809+0000 7f68c578a640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c019ea60 0x7f68c01a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:15.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.809+0000 7f68c578a640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c019c130 0x7f68c019e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:15.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.809+0000 7f68c578a640 1 --2- 172.21.15.189:0/222413468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68c01005f0 0x7f68c006af90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:15.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.809+0000 7f68c578a640 1 -- 172.21.15.189:0/222413468 >> 172.21.15.189:0/222413468 conn(0x7f68c00fbda0 msgr2=0x7f68c00fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:20:15.811 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.809+0000 7f68c578a640 1 -- 172.21.15.189:0/222413468 shutdown_connections 2024-09-12T01:20:15.811 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:20:15.809+0000 7f68c578a640 1 -- 172.21.15.189:0/222413468 wait complete. 2024-09-12T01:20:15.916 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:15 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:15.993 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:15 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:20:16.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:20:15 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:20:15.917+0000 7fb15a709640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T01:20:16.425 DEBUG:teuthology.orchestra.run.smithi100:mgr.y> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T01:20:16.428 DEBUG:teuthology.orchestra.run.smithi189:mgr.z> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T01:20:16.468 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T01:20:16.468 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:20:16.468 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:20:16.486 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:20:16.487 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-12T01:20:16.543 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:20:16.544 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:20:16.544 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T01:20:16.544 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:20:16.544 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:20:16.544 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-12 01:19:34.516430249 +0000 2024-09-12T01:20:16.544 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-12 01:14:40.198848362 +0000 2024-09-12T01:20:16.544 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-12 01:14:40.198848362 +0000 2024-09-12T01:20:16.544 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-12 01:14:40.198848362 +0000 2024-09-12T01:20:16.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:20:16.610 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-12T01:20:16.610 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-12T01:20:16.610 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000226073 s, 2.3 MB/s 2024-09-12T01:20:16.611 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:20:16.669 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-12T01:20:16.726 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:20:16.726 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:20:16.726 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T01:20:16.726 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:20:16.726 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:20:16.726 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-12 01:19:34.551429542 +0000 2024-09-12T01:20:16.727 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-12 01:14:40.516841973 +0000 2024-09-12T01:20:16.727 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-12 01:14:40.516841973 +0000 2024-09-12T01:20:16.727 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-12 01:14:40.516841973 +0000 2024-09-12T01:20:16.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:20:16.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:16 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:16.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:16 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:16.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:16 smithi100 ceph-mon[35275]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:20:16.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:16 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:20:16.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:16 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:20:16.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:16 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:16.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:16 smithi100 ceph-mon[35275]: Reconfiguring daemon mon.b on smithi100 2024-09-12T01:20:16.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:16 smithi100 ceph-mon[35275]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi100=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:20:16.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:16 smithi100 ceph-mon[35275]: Saving service mgr spec with placement smithi081=x;smithi100=y;smithi189=z;count:3 2024-09-12T01:20:16.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:16 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:16.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:16 smithi100 ceph-mon[35275]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-12T01:20:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-12T01:20:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000190682 s, 2.7 MB/s 2024-09-12T01:20:16.790 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:20:16.847 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-12T01:20:16.902 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:20:16.902 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:20:16.902 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T01:20:16.902 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:20:16.902 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:20:16.902 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-12 01:19:34.588428795 +0000 2024-09-12T01:20:16.902 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-12 01:14:40.843835401 +0000 2024-09-12T01:20:16.903 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-12 01:14:40.843835401 +0000 2024-09-12T01:20:16.903 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-12 01:14:40.843835401 +0000 2024-09-12T01:20:16.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:20:16.964 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:16 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:16.964 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:16 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:16.964 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:16 smithi081 ceph-mon[30920]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:20:16.964 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:16 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:20:16.964 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:16 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:20:16.964 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:16 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:16.964 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:16 smithi081 ceph-mon[30920]: Reconfiguring daemon mon.b on smithi100 2024-09-12T01:20:16.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:16 smithi081 ceph-mon[30920]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi100=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:20:16.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:16 smithi081 ceph-mon[30920]: Saving service mgr spec with placement smithi081=x;smithi100=y;smithi189=z;count:3 2024-09-12T01:20:16.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:16 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:16.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:16 smithi081 ceph-mon[30920]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:16.966 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-12T01:20:16.966 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-12T01:20:16.966 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000259888 s, 2.0 MB/s 2024-09-12T01:20:16.967 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:20:17.024 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-12T01:20:17.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:16 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:17.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:16 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:17.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:16 smithi189 ceph-mon[35357]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:20:17.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:16 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:20:17.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:16 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:20:17.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:16 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:17.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:16 smithi189 ceph-mon[35357]: Reconfiguring daemon mon.b on smithi100 2024-09-12T01:20:17.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:16 smithi189 ceph-mon[35357]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi100=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:20:17.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:16 smithi189 ceph-mon[35357]: Saving service mgr spec with placement smithi081=x;smithi100=y;smithi189=z;count:3 2024-09-12T01:20:17.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:16 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:17.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:16 smithi189 ceph-mon[35357]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:17.079 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:20:17.079 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:20:17.079 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T01:20:17.079 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:20:17.079 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:20:17.079 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-12 01:19:34.622428109 +0000 2024-09-12T01:20:17.080 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-12 01:14:41.157829090 +0000 2024-09-12T01:20:17.080 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-12 01:14:41.157829090 +0000 2024-09-12T01:20:17.080 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-12 01:14:41.157829090 +0000 2024-09-12T01:20:17.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:20:17.142 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-12T01:20:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-12T01:20:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000201415 s, 2.5 MB/s 2024-09-12T01:20:17.144 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:20:17.199 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-12T01:20:17.200 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:20:17.216 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:20:17.216 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-09-12T01:20:17.272 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:20:17.272 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:20:17.272 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T01:20:17.272 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:20:17.272 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:20:17.272 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-12 01:20:06.380088074 +0000 2024-09-12T01:20:17.272 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-12 01:15:02.059730384 +0000 2024-09-12T01:20:17.272 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-12 01:15:02.059730384 +0000 2024-09-12T01:20:17.272 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-12 01:15:02.059730384 +0000 2024-09-12T01:20:17.273 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:20:17.335 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-12T01:20:17.336 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-12T01:20:17.336 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000264089 s, 1.9 MB/s 2024-09-12T01:20:17.337 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:20:17.393 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-09-12T01:20:17.449 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:20:17.449 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:20:17.449 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T01:20:17.450 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:20:17.450 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:20:17.450 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-12 01:20:06.381088049 +0000 2024-09-12T01:20:17.450 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-12 01:15:02.393721711 +0000 2024-09-12T01:20:17.450 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-12 01:15:02.393721711 +0000 2024-09-12T01:20:17.450 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-12 01:15:02.393721711 +0000 2024-09-12T01:20:17.451 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:20:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-12T01:20:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-12T01:20:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000199618 s, 2.6 MB/s 2024-09-12T01:20:17.514 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:20:17.571 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-09-12T01:20:17.626 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:20:17.626 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:20:17.626 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-12T01:20:17.626 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:20:17.626 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:20:17.627 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-12 01:20:06.381088049 +0000 2024-09-12T01:20:17.627 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-12 01:15:02.734712856 +0000 2024-09-12T01:20:17.627 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-12 01:15:02.734712856 +0000 2024-09-12T01:20:17.627 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-12 01:15:02.734712856 +0000 2024-09-12T01:20:17.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:20:17.689 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-12T01:20:17.689 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-12T01:20:17.689 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000214863 s, 2.4 MB/s 2024-09-12T01:20:17.690 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:20:17.747 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-09-12T01:20:17.804 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:20:17.804 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:20:17.804 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T01:20:17.804 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:20:17.804 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:20:17.804 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-12 01:20:06.382088024 +0000 2024-09-12T01:20:17.804 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-12 01:15:03.064704287 +0000 2024-09-12T01:20:17.804 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-12 01:15:03.064704287 +0000 2024-09-12T01:20:17.804 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-12 01:15:03.064704287 +0000 2024-09-12T01:20:17.805 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:20:17.868 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-12T01:20:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-12T01:20:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000222862 s, 2.3 MB/s 2024-09-12T01:20:17.870 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:20:17.927 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-12T01:20:17.927 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:20:17.944 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:20:17.944 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-09-12T01:20:17.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:17 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:17.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:17 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:17.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:17 smithi081 ceph-mon[30920]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:20:17.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:17 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:20:17.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:17 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:20:17.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:17 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:17.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:17 smithi081 ceph-mon[30920]: Reconfiguring daemon mon.c on smithi189 2024-09-12T01:20:18.000 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:20:18.000 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:20:18.000 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-09-12T01:20:18.001 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:20:18.001 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:20:18.001 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-12 01:19:57.142275134 +0000 2024-09-12T01:20:18.001 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-12 01:15:09.667347753 +0000 2024-09-12T01:20:18.001 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-12 01:15:09.667347753 +0000 2024-09-12T01:20:18.001 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-12 01:15:09.667347753 +0000 2024-09-12T01:20:18.001 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:20:18.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:17 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:18.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:17 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:18.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:17 smithi100 ceph-mon[35275]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:20:18.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:17 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:20:18.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:17 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:20:18.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:17 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:18.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:17 smithi100 ceph-mon[35275]: Reconfiguring daemon mon.c on smithi189 2024-09-12T01:20:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:17 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:17 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:17 smithi189 ceph-mon[35357]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:20:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:17 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:20:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:17 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:20:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:17 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:17 smithi189 ceph-mon[35357]: Reconfiguring daemon mon.c on smithi189 2024-09-12T01:20:18.059 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-12T01:20:18.059 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-12T01:20:18.059 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000253688 s, 2.0 MB/s 2024-09-12T01:20:18.060 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:20:18.117 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-09-12T01:20:18.172 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:20:18.173 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:20:18.173 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-12T01:20:18.173 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:20:18.173 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:20:18.173 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-12 01:19:57.143275114 +0000 2024-09-12T01:20:18.173 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-12 01:15:10.015340246 +0000 2024-09-12T01:20:18.173 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-12 01:15:10.015340246 +0000 2024-09-12T01:20:18.173 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-12 01:15:10.015340246 +0000 2024-09-12T01:20:18.173 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:20:18.236 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-12T01:20:18.237 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-12T01:20:18.237 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000181962 s, 2.8 MB/s 2024-09-12T01:20:18.238 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:20:18.294 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-09-12T01:20:18.351 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:20:18.351 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:20:18.351 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-12T01:20:18.351 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:20:18.351 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:20:18.351 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-12 01:19:57.143275114 +0000 2024-09-12T01:20:18.351 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-12 01:15:10.362332760 +0000 2024-09-12T01:20:18.351 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-12 01:15:10.362332760 +0000 2024-09-12T01:20:18.351 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-12 01:15:10.362332760 +0000 2024-09-12T01:20:18.352 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:20:18.416 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-12T01:20:18.416 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-12T01:20:18.417 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000193066 s, 2.7 MB/s 2024-09-12T01:20:18.418 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:20:18.475 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-09-12T01:20:18.530 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:20:18.531 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:20:18.531 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T01:20:18.531 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:20:18.531 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:20:18.531 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-12 01:19:57.143275114 +0000 2024-09-12T01:20:18.531 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-12 01:15:10.694325598 +0000 2024-09-12T01:20:18.531 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-12 01:15:10.694325598 +0000 2024-09-12T01:20:18.531 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-12 01:15:10.694325598 +0000 2024-09-12T01:20:18.532 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:20:18.595 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-12T01:20:18.595 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-12T01:20:18.595 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000169672 s, 3.0 MB/s 2024-09-12T01:20:18.596 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:20:18.653 INFO:tasks.cephadm:Deploying osd.0 on smithi081 with /dev/vg_nvme/lv_4... 2024-09-12T01:20:18.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:20:18.896 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:20:19.284 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:19.284 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:19.284 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:19.284 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:19.284 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:19.284 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:19.284 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:20:19.284 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:20:19.284 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:20:19.284 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:19.285 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:19 smithi081 ceph-mon[30920]: Deploying daemon mgr.z on smithi189 2024-09-12T01:20:19.285 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:19 smithi081 ceph-mon[30920]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:19.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:19.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:19.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:19.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:19.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:19.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:19.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:20:19.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:20:19.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:20:19.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:19.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:19 smithi189 ceph-mon[35357]: Deploying daemon mgr.z on smithi189 2024-09-12T01:20:19.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:19 smithi189 ceph-mon[35357]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:19.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:19.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:19.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:19.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:19.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:19.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:19.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:20:19.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:20:19.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:20:19.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:19.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:19 smithi100 ceph-mon[35275]: Deploying daemon mgr.z on smithi189 2024-09-12T01:20:19.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:19 smithi100 ceph-mon[35275]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:20.032 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:19 smithi189 systemd[1]: Starting Ceph mgr.z for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:20:20.321 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:20 smithi189 podman[37151]: 2024-09-12 01:20:20.036939363 +0000 UTC m=+0.110276391 container create 7c617f0adcf85372ae7e3596aa91d9ec432e94c290762d70797f8c860340f895 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T01:20:20.321 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:20 smithi189 podman[37151]: 2024-09-12 01:20:19.942658139 +0000 UTC m=+0.015995178 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:20:20.322 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:20 smithi189 podman[37151]: 2024-09-12 01:20:20.231033902 +0000 UTC m=+0.304370931 container init 7c617f0adcf85372ae7e3596aa91d9ec432e94c290762d70797f8c860340f895 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T01:20:20.322 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:20 smithi189 podman[37151]: 2024-09-12 01:20:20.233936094 +0000 UTC m=+0.307273130 container start 7c617f0adcf85372ae7e3596aa91d9ec432e94c290762d70797f8c860340f895 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T01:20:20.322 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:20 smithi189 ceph-mgr[37171]: -- 172.21.15.189:0/1057212886 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e0dff030e0 con 0x55e0dfee1400 2024-09-12T01:20:20.322 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:20 smithi189 bash[37151]: 7c617f0adcf85372ae7e3596aa91d9ec432e94c290762d70797f8c860340f895 2024-09-12T01:20:20.636 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:20 smithi189 systemd[1]: Started Ceph mgr.z for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:20:20.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:20 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:20.357+0000 7f8840513040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:20:20.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:20 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:20.421+0000 7f8840513040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:20:20.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:20 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:20.569+0000 7f8840513040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:20:20.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:20 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:20.634+0000 7f8840513040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:20:20.920 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:20 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:20.781+0000 7f8840513040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:20:20.920 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:20 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:20.919+0000 7f8840513040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:20:21.247 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:20:21.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_4 2024-09-12T01:20:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:20:21.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:21 smithi100 ceph-mon[35275]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:21.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:21 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:21.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:21 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:21.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:21 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:21.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:21 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:20:21.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:21 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:20:21.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:21 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:20:21.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:21 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:21.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:21 smithi100 ceph-mon[35275]: Deploying daemon mgr.y on smithi100 2024-09-12T01:20:21.532 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:21 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:21.235+0000 7f8840513040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:20:21.532 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:21 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:21.296+0000 7f8840513040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:20:21.532 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:21 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:21.480+0000 7f8840513040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:20:21.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:21 smithi189 ceph-mon[35357]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:21.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:21 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:21.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:21 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:21.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:21 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:21.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:21 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:20:21.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:21 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:20:21.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:21 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:20:21.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:21 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:21.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:21 smithi189 ceph-mon[35357]: Deploying daemon mgr.y on smithi100 2024-09-12T01:20:21.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:21 smithi081 ceph-mon[30920]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:21.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:21 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:21.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:21 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:21.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:21 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:21.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:21 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:20:21.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:21 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:20:21.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:21 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:20:21.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:21 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:21.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:21 smithi081 ceph-mon[30920]: Deploying daemon mgr.y on smithi100 2024-09-12T01:20:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.908+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/770570362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a88102e00 msgr2=0x7f9a88103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.908+0000 7f9a8ddf6640 1 --2- 172.21.15.81:0/770570362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a88102e00 0x7f9a88103280 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9a70009900 tx=0x7f9a7002a410 comp rx=0 tx=0).stop 2024-09-12T01:20:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.908+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/770570362 shutdown_connections 2024-09-12T01:20:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.908+0000 7f9a8ddf6640 1 --2- 172.21.15.81:0/770570362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a881037c0 0x7f9a8810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:21.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.908+0000 7f9a8ddf6640 1 --2- 172.21.15.81:0/770570362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a88102e00 0x7f9a88103280 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.908+0000 7f9a8ddf6640 1 --2- 172.21.15.81:0/770570362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a88101c00 0x7f9a88102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.908+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/770570362 >> 172.21.15.81:0/770570362 conn(0x7f9a880fd390 msgr2=0x7f9a880ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:20:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.908+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/770570362 shutdown_connections 2024-09-12T01:20:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.908+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/770570362 wait complete. 2024-09-12T01:20:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a8ddf6640 1 Processor -- start 2024-09-12T01:20:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a8ddf6640 1 -- start start 2024-09-12T01:20:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a8ddf6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a88101c00 0x7f9a88197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a8ddf6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a88102e00 0x7f9a881983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a8ddf6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a881037c0 0x7f9a8819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a8ddf6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8810d860 con 0x7f9a88101c00 2024-09-12T01:20:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a8ddf6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8810d6e0 con 0x7f9a881037c0 2024-09-12T01:20:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a8ddf6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8810d9e0 con 0x7f9a88102e00 2024-09-12T01:20:21.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a88101c00 0x7f9a88197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a88101c00 0x7f9a88197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55796/0 (socket says 172.21.15.81:55796) 2024-09-12T01:20:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a877fe640 1 -- 172.21.15.81:0/2451873883 learned_addr learned my addr 172.21.15.81:0/2451873883 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:20:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a87fff640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a881037c0 0x7f9a8819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a7ffff640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a88102e00 0x7f9a881983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a877fe640 1 -- 172.21.15.81:0/2451873883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a88102e00 msgr2=0x7f9a881983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a877fe640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a88102e00 0x7f9a881983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a877fe640 1 -- 172.21.15.81:0/2451873883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a881037c0 msgr2=0x7f9a8819f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a877fe640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a881037c0 0x7f9a8819f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a877fe640 1 -- 172.21.15.81:0/2451873883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8819fae0 con 0x7f9a88101c00 2024-09-12T01:20:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.909+0000 7f9a87fff640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a881037c0 0x7f9a8819f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:20:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.910+0000 7f9a877fe640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a88101c00 0x7f9a88197eb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800e9c0 tx=0x7f9a7800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:21.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.910+0000 7f9a857fa640 1 -- 172.21.15.81:0/2451873883 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800cd80 con 0x7f9a88101c00 2024-09-12T01:20:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.910+0000 7f9a857fa640 1 -- 172.21.15.81:0/2451873883 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a780035f0 con 0x7f9a88101c00 2024-09-12T01:20:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.910+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/2451873883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8819fdd0 con 0x7f9a88101c00 2024-09-12T01:20:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.910+0000 7f9a857fa640 1 -- 172.21.15.81:0/2451873883 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78010690 con 0x7f9a88101c00 2024-09-12T01:20:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.910+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/2451873883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a881a0220 con 0x7f9a88101c00 2024-09-12T01:20:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.911+0000 7f9a857fa640 1 -- 172.21.15.81:0/2451873883 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f9a78010830 con 0x7f9a88101c00 2024-09-12T01:20:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.911+0000 7f9a857fa640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9a740392c0 0x7f9a7403b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.911+0000 7f9a857fa640 1 -- 172.21.15.81:0/2451873883 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9a7804c7e0 con 0x7f9a88101c00 2024-09-12T01:20:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.911+0000 7f9a7ffff640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9a740392c0 0x7f9a7403b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.911+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/2451873883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a88109050 con 0x7f9a88101c00 2024-09-12T01:20:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.911+0000 7f9a7ffff640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9a740392c0 0x7f9a7403b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a70000c00 tx=0x7f9a700315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:21.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:21.916+0000 7f9a857fa640 1 -- 172.21.15.81:0/2451873883 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a7801fbe0 con 0x7f9a88101c00 2024-09-12T01:20:22.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:22.091+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/2451873883 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9a88062630 con 0x7f9a740392c0 2024-09-12T01:20:22.268 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:22 smithi100 systemd[1]: Starting Ceph mgr.y for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:20:22.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:22 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:20:22.646 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:22 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:20:22.646 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:22 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:22.646 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:22 smithi100 podman[36625]: 2024-09-12 01:20:22.280564177 +0000 UTC m=+0.018600640 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:20:22.646 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:22 smithi100 podman[36625]: 2024-09-12 01:20:22.38409329 +0000 UTC m=+0.122129789 container create 857d8ffb590f39a11814fe121bd294c02c3c472f1e14bd660146b21ae67d50f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T01:20:22.646 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:22 smithi100 podman[36625]: 2024-09-12 01:20:22.619751735 +0000 UTC m=+0.357788193 container init 857d8ffb590f39a11814fe121bd294c02c3c472f1e14bd660146b21ae67d50f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T01:20:22.646 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:22 smithi100 podman[36625]: 2024-09-12 01:20:22.622358336 +0000 UTC m=+0.360394794 container start 857d8ffb590f39a11814fe121bd294c02c3c472f1e14bd660146b21ae67d50f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T01:20:22.646 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:22 smithi100 ceph-mgr[36644]: -- 172.21.15.100:0/4076087970 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ad424910e0 con 0x55ad4246f400 2024-09-12T01:20:22.684 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:22 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:20:22.684 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:22 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:20:22.684 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:22 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:22.782 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:22 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:22.359+0000 7f8840513040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:20:22.782 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:22 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:22.427+0000 7f8840513040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:20:22.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:22 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:20:22.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:22 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:20:22.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:22 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:22.962 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:22 smithi100 bash[36625]: 857d8ffb590f39a11814fe121bd294c02c3c472f1e14bd660146b21ae67d50f1 2024-09-12T01:20:22.962 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:22 smithi100 systemd[1]: Started Ceph mgr.y for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:20:22.962 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:22 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:22.747+0000 7f0ebecf0040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:20:22.962 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:22 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:22.807+0000 7f0ebecf0040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:20:22.962 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:22 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:22.962+0000 7f0ebecf0040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:20:23.268 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:23 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:23.030+0000 7f0ebecf0040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:20:23.268 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:23 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:23.192+0000 7f0ebecf0040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:20:23.460 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:23.188+0000 7f8840513040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:20:23.460 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:23.318+0000 7f8840513040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:20:23.460 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-mon[35357]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:20:23.460 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-mon[35357]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:23.460 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:23.460 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:23.461 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:23.461 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:23.461 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:23.610 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:23 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:23.347+0000 7f0ebecf0040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:20:23.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:23 smithi100 ceph-mon[35275]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:20:23.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:23 smithi100 ceph-mon[35275]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:23.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:23 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:23.611 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:23 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:23.611 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:23 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:23.611 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:23 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:23.611 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:23 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:23.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:23 smithi081 ceph-mon[30920]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:20:23.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:23 smithi081 ceph-mon[30920]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:23.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:23 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:23.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:23 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:23.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:23 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:23.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:23 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:23.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:23 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:23.754 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:23.464+0000 7f8840513040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:20:23.755 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:23.529+0000 7f8840513040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:20:23.755 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:23.684+0000 7f8840513040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:20:23.755 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:23.754+0000 7f8840513040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:20:23.927 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:23 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:23.672+0000 7f0ebecf0040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:20:23.927 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:23 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:23.735+0000 7f0ebecf0040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:20:24.032 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:23.814+0000 7f8840513040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:20:24.032 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:23 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:23.989+0000 7f8840513040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:20:24.268 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:23 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:23.927+0000 7f0ebecf0040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:20:24.328 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:24.057+0000 7f8840513040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:20:24.328 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:24.127+0000 7f8840513040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:20:24.328 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:24.209+0000 7f8840513040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:20:24.328 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:24.269+0000 7f8840513040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:20:24.328 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:24.327+0000 7f8840513040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:20:25.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:25.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:25.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:20:25.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:20:25.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:20:25.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:25.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: Reconfiguring daemon mgr.x on smithi081 2024-09-12T01:20:25.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:25.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1161158102' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc857dd4-eedc-4c48-89a0-4e69662e8e6d"}]: dispatch 2024-09-12T01:20:25.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1161158102' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc857dd4-eedc-4c48-89a0-4e69662e8e6d"}]': finished 2024-09-12T01:20:25.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:20:25.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:25.268 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:24.811+0000 7f0ebecf0040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:20:25.268 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:24.878+0000 7f0ebecf0040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:20:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:20:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:20:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:20:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: Reconfiguring daemon mgr.x on smithi081 2024-09-12T01:20:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:25.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1161158102' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc857dd4-eedc-4c48-89a0-4e69662e8e6d"}]: dispatch 2024-09-12T01:20:25.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1161158102' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc857dd4-eedc-4c48-89a0-4e69662e8e6d"}]': finished 2024-09-12T01:20:25.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:20:25.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:25.282 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:20:25 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:20:25.117+0000 7f8840513040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:20:25.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:25.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:25.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:20:25.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:20:25.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:20:25.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:25.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: Reconfiguring daemon mgr.x on smithi081 2024-09-12T01:20:25.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:25.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:25.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1161158102' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc857dd4-eedc-4c48-89a0-4e69662e8e6d"}]: dispatch 2024-09-12T01:20:25.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1161158102' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc857dd4-eedc-4c48-89a0-4e69662e8e6d"}]': finished 2024-09-12T01:20:25.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:20:25.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:25.846 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:25.592+0000 7f0ebecf0040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:20:25.846 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:25.706+0000 7f0ebecf0040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:20:25.846 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:25.846+0000 7f0ebecf0040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:20:25.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:25.994+0000 7f9a857fa640 1 -- 172.21.15.81:0/2451873883 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f9a78018ce0 con 0x7f9a88101c00 2024-09-12T01:20:26.124 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:25 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/4227767498' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:20:26.124 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:25 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.189:0/3801748247' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:20:26.124 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:25 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.189:0/3801748247' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:20:26.125 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:25 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.189:0/3801748247' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:20:26.125 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:25 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.189:0/3801748247' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:20:26.125 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:25 smithi100 ceph-mon[35275]: Standby manager daemon z started 2024-09-12T01:20:26.125 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:25.907+0000 7f0ebecf0040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:20:26.125 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:26.058+0000 7f0ebecf0040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:20:26.125 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:26.125+0000 7f0ebecf0040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:20:26.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:25 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/4227767498' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:20:26.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:25 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.189:0/3801748247' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:20:26.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:25 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.189:0/3801748247' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:20:26.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:25 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.189:0/3801748247' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:20:26.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:25 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.189:0/3801748247' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:20:26.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:25 smithi081 ceph-mon[30920]: Standby manager daemon z started 2024-09-12T01:20:26.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:25 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/4227767498' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:20:26.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:25 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.189:0/3801748247' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:20:26.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:25 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.189:0/3801748247' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:20:26.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:25 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.189:0/3801748247' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:20:26.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:25 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.189:0/3801748247' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:20:26.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:25 smithi189 ceph-mon[35357]: Standby manager daemon z started 2024-09-12T01:20:26.406 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:26.185+0000 7f0ebecf0040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:20:26.406 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:26.342+0000 7f0ebecf0040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:20:26.406 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:26.406+0000 7f0ebecf0040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:20:26.671 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:26.472+0000 7f0ebecf0040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:20:26.671 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:26.554+0000 7f0ebecf0040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:20:26.672 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:26.613+0000 7f0ebecf0040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:20:26.672 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:26.672+0000 7f0ebecf0040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:20:27.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:26 smithi100 ceph-mon[35275]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-12T01:20:27.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:26 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:20:27.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:26 smithi100 ceph-mon[35275]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:27.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:26 smithi189 ceph-mon[35357]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-12T01:20:27.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:26 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:20:27.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:26 smithi189 ceph-mon[35357]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:27.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:26 smithi081 ceph-mon[30920]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-12T01:20:27.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:26 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:20:27.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:26 smithi081 ceph-mon[30920]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:27.768 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:20:27 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:20:27.453+0000 7f0ebecf0040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:20:28.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:28.005+0000 7f9a857fa640 1 -- 172.21.15.81:0/2451873883 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f9a7801dd20 con 0x7f9a88101c00 2024-09-12T01:20:28.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:27 smithi100 ceph-mon[35275]: Standby manager daemon y started 2024-09-12T01:20:28.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:27 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.100:0/1765889458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:20:28.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:27 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.100:0/1765889458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:20:28.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:27 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.100:0/1765889458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:20:28.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:27 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.100:0/1765889458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:20:28.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:27 smithi189 ceph-mon[35357]: Standby manager daemon y started 2024-09-12T01:20:28.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:27 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.100:0/1765889458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:20:28.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:27 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.100:0/1765889458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:20:28.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:27 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.100:0/1765889458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:20:28.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:27 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.100:0/1765889458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:20:28.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:27 smithi081 ceph-mon[30920]: Standby manager daemon y started 2024-09-12T01:20:28.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:27 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.100:0/1765889458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:20:28.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:27 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.100:0/1765889458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:20:28.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:27 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.100:0/1765889458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:20:28.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:27 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.100:0/1765889458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:20:29.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:29 smithi100 ceph-mon[35275]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-12T01:20:29.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:29 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:20:29.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:29 smithi100 ceph-mon[35275]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:29.281 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:29 smithi189 ceph-mon[35357]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-12T01:20:29.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:29 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:20:29.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:29 smithi189 ceph-mon[35357]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:29.449 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:29 smithi081 ceph-mon[30920]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-12T01:20:29.449 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:29 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:20:29.449 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:29 smithi081 ceph-mon[30920]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:31.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:31 smithi081 ceph-mon[30920]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:31.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:31 smithi100 ceph-mon[35275]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:31.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:31 smithi189 ceph-mon[35357]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:33.476 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:33 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:33.477 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:33 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:33.477 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:33 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:33.477 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:33 smithi081 ceph-mon[30920]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:33.477 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:33 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:33.477 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:33 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:33.477 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:33 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:33.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:33 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:33.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:33 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:33.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:33 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:33.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:33 smithi100 ceph-mon[35275]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:33.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:33 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:33.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:33 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:33.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:33 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:33.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:33 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:33.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:33 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:33.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:33 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:33.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:33 smithi189 ceph-mon[35357]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:33.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:33 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:33.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:33 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:33.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:33 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:34.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:20:34.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:34.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:20:34.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:34.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:20:34.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:35.396 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:35 smithi081 ceph-mon[30920]: Deploying daemon osd.0 on smithi081 2024-09-12T01:20:35.396 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:35 smithi081 ceph-mon[30920]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:35.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:35 smithi100 ceph-mon[35275]: Deploying daemon osd.0 on smithi081 2024-09-12T01:20:35.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:35 smithi100 ceph-mon[35275]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:35.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:35 smithi189 ceph-mon[35357]: Deploying daemon osd.0 on smithi081 2024-09-12T01:20:35.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:35 smithi189 ceph-mon[35357]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:37 smithi081 ceph-mon[30920]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:37 smithi100 ceph-mon[35275]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:37.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:37 smithi189 ceph-mon[35357]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:39.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:39 smithi081 ceph-mon[30920]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:39.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:39 smithi100 ceph-mon[35275]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:39.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:39 smithi189 ceph-mon[35357]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:40.678 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:40 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:40.678 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:40 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:40.678 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:40 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:40.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:40 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:40.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:40 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:40.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:40 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:40.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:40 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:40.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:40 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:40.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:40 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:41.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:41 smithi081 ceph-mon[30920]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:41.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:41 smithi100 ceph-mon[35275]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:41.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:41 smithi189 ceph-mon[35357]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:43.714 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:43 smithi081 ceph-mon[30920]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:43.714 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:43 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:43.714 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:43 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:43.714 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:43 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:43.714 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:43 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:43.714 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:43 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:43.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:43 smithi100 ceph-mon[35275]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:43.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:43 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:43.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:43 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:43.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:43 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:43.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:43 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:43.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:43 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:43.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:43 smithi189 ceph-mon[35357]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:43.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:43 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:43.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:43 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:43.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:43 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:43.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:43 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:43.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:43 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 0 on host 'smithi081' 2024-09-12T01:20:44.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:44.309+0000 7f9a857fa640 1 -- 172.21.15.81:0/2451873883 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9a88062630 con 0x7f9a740392c0 2024-09-12T01:20:44.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:44.311+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/2451873883 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9a740392c0 msgr2=0x7f9a7403b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:44.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:44.311+0000 7f9a8ddf6640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9a740392c0 0x7f9a7403b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a70000c00 tx=0x7f9a700315d0 comp rx=0 tx=0).stop 2024-09-12T01:20:44.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:44.311+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/2451873883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a88101c00 msgr2=0x7f9a88197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:44.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:44.311+0000 7f9a8ddf6640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a88101c00 0x7f9a88197eb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800e9c0 tx=0x7f9a7800ee80 comp rx=0 tx=0).stop 2024-09-12T01:20:44.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:44.311+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/2451873883 shutdown_connections 2024-09-12T01:20:44.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:44.311+0000 7f9a8ddf6640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9a740392c0 0x7f9a7403b780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:44.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:44.311+0000 7f9a8ddf6640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a881037c0 0x7f9a8819f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:44.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:44.311+0000 7f9a8ddf6640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a88102e00 0x7f9a881983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:44.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:44.311+0000 7f9a8ddf6640 1 --2- 172.21.15.81:0/2451873883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a88101c00 0x7f9a88197eb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:44.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:44.311+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/2451873883 >> 172.21.15.81:0/2451873883 conn(0x7f9a880fd390 msgr2=0x7f9a88106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:20:44.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:44.311+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/2451873883 shutdown_connections 2024-09-12T01:20:44.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:20:44.312+0000 7f9a8ddf6640 1 -- 172.21.15.81:0/2451873883 wait complete. 2024-09-12T01:20:44.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:44.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:44.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:44.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:44.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:44.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:44.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:20:44.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:44.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:45.051 DEBUG:teuthology.orchestra.run.smithi081:osd.0> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T01:20:45.053 INFO:tasks.cephadm:Deploying osd.1 on smithi100 with /dev/vg_nvme/lv_4... 2024-09-12T01:20:45.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:20:45.290 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:20:45.527 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:45 smithi081 ceph-mon[30920]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:45.706 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:45 smithi100 ceph-mon[35275]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:45.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:45 smithi189 ceph-mon[35357]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:46.492 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:46 smithi100 ceph-mon[35275]: from='osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:20:46.573 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:46 smithi081 ceph-mon[30920]: from='osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:20:46.573 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:20:46 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0[45200]: 2024-09-12T01:20:46.408+0000 7fd83a733640 -1 osd.0 0 log_to_monitors true 2024-09-12T01:20:46.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:46 smithi189 ceph-mon[35357]: from='osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:20:47.561 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:20:47.562 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:20:47 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0[45200]: 2024-09-12T01:20:47.468+0000 7fd835e93640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T01:20:47.562 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:20:47 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0[45200]: 2024-09-12T01:20:47.470+0000 7fd8324cd640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:20:47.562 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:47 smithi081 ceph-mon[30920]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:47.562 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:47 smithi081 ceph-mon[30920]: from='osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:20:47.562 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:47 smithi081 ceph-mon[30920]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:20:47.562 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:47 smithi081 ceph-mon[30920]: from='osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T01:20:47.562 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:47.585 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_4 2024-09-12T01:20:47.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:47 smithi100 ceph-mon[35275]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:47.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:47 smithi100 ceph-mon[35275]: from='osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:20:47.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:47 smithi100 ceph-mon[35275]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:20:47.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:47 smithi100 ceph-mon[35275]: from='osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T01:20:47.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:47 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:47 smithi189 ceph-mon[35357]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:47 smithi189 ceph-mon[35357]: from='osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:20:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:47 smithi189 ceph-mon[35357]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:20:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:47 smithi189 ceph-mon[35357]: from='osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T01:20:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:47 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:47.831 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:20:48.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.271+0000 7ff284463640 1 -- 172.21.15.100:0/933251355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c104ff0 msgr2=0x7ff27c1073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:48.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.271+0000 7ff284463640 1 --2- 172.21.15.100:0/933251355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c104ff0 0x7ff27c1073e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff278009900 tx=0x7ff27802a410 comp rx=0 tx=0).stop 2024-09-12T01:20:48.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.271+0000 7ff284463640 1 -- 172.21.15.100:0/933251355 shutdown_connections 2024-09-12T01:20:48.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.271+0000 7ff284463640 1 --2- 172.21.15.100:0/933251355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff27c107920 0x7ff27c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.271+0000 7ff284463640 1 --2- 172.21.15.100:0/933251355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c104ff0 0x7ff27c1073e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.271+0000 7ff284463640 1 --2- 172.21.15.100:0/933251355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c1026c0 0x7ff27c104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.271+0000 7ff284463640 1 -- 172.21.15.100:0/933251355 >> 172.21.15.100:0/933251355 conn(0x7ff27c0fc280 msgr2=0x7ff27c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:20:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.271+0000 7ff284463640 1 -- 172.21.15.100:0/933251355 shutdown_connections 2024-09-12T01:20:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.271+0000 7ff284463640 1 -- 172.21.15.100:0/933251355 wait complete. 2024-09-12T01:20:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff284463640 1 Processor -- start 2024-09-12T01:20:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff284463640 1 -- start start 2024-09-12T01:20:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff284463640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff27c1026c0 0x7ff27c102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff284463640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c104ff0 0x7ff27c100670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff284463640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c107920 0x7ff27c100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:48.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff284463640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c10d850 con 0x7ff27c107920 2024-09-12T01:20:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff284463640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c10d6d0 con 0x7ff27c104ff0 2024-09-12T01:20:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff284463640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c10d9d0 con 0x7ff27c1026c0 2024-09-12T01:20:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff2819fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c104ff0 0x7ff27c100670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff2819fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c104ff0 0x7ff27c100670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46580/0 (socket says 172.21.15.100:46580) 2024-09-12T01:20:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff2819fe640 1 -- 172.21.15.100:0/537073642 learned_addr learned my addr 172.21.15.100:0/537073642 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:20:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff282a00640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c107920 0x7ff27c100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff2821ff640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff27c1026c0 0x7ff27c102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff2819fe640 1 -- 172.21.15.100:0/537073642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff27c1026c0 msgr2=0x7ff27c102020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff2819fe640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff27c1026c0 0x7ff27c102020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff2819fe640 1 -- 172.21.15.100:0/537073642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c107920 msgr2=0x7ff27c100bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:20:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff2819fe640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c107920 0x7ff27c100bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff2819fe640 1 -- 172.21.15.100:0/537073642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c101470 con 0x7ff27c104ff0 2024-09-12T01:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.272+0000 7ff282a00640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c107920 0x7ff27c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.273+0000 7ff2819fe640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c104ff0 0x7ff27c100670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff278031610 tx=0x7ff2780043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.273+0000 7ff2737fe640 1 -- 172.21.15.100:0/537073642 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27803f030 con 0x7ff27c104ff0 2024-09-12T01:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.273+0000 7ff2737fe640 1 -- 172.21.15.100:0/537073642 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff278003ce0 con 0x7ff27c104ff0 2024-09-12T01:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.273+0000 7ff284463640 1 -- 172.21.15.100:0/537073642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27c1a2090 con 0x7ff27c104ff0 2024-09-12T01:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.273+0000 7ff2737fe640 1 -- 172.21.15.100:0/537073642 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278035070 con 0x7ff27c104ff0 2024-09-12T01:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.273+0000 7ff284463640 1 -- 172.21.15.100:0/537073642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27c1a2540 con 0x7ff27c104ff0 2024-09-12T01:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.274+0000 7ff284463640 1 -- 172.21.15.100:0/537073642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff27c0fdd70 con 0x7ff27c104ff0 2024-09-12T01:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.275+0000 7ff2737fe640 1 -- 172.21.15.100:0/537073642 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7ff278042030 con 0x7ff27c104ff0 2024-09-12T01:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.276+0000 7ff2737fe640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff2680a2af0 0x7ff2680a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:20:48.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.276+0000 7ff2737fe640 1 -- 172.21.15.100:0/537073642 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7ff2780edaf0 con 0x7ff27c104ff0 2024-09-12T01:20:48.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.276+0000 7ff2821ff640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff2680a2af0 0x7ff2680a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:20:48.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.277+0000 7ff2821ff640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff2680a2af0 0x7ff2680a4fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff26c005fd0 tx=0x7ff26c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:20:48.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.281+0000 7ff2737fe640 1 -- 172.21.15.100:0/537073642 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2780bc5e0 con 0x7ff27c104ff0 2024-09-12T01:20:48.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:20:48.459+0000 7ff284463640 1 -- 172.21.15.100:0/537073642 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff27c062630 con 0x7ff2680a2af0 2024-09-12T01:20:48.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:48 smithi081 ceph-mon[30920]: from='osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T01:20:48.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:48 smithi081 ceph-mon[30920]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:20:48.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:48.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:48.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:48.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:48.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:20:48.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:48.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:48.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:48.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:48.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:20:48.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:20:48.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:48 smithi100 ceph-mon[35275]: from='osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T01:20:48.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:48 smithi100 ceph-mon[35275]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:20:48.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:48 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:48.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:48 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:48.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:48 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:48.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:48 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:48.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:48 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:20:48.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:48 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:48.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:48 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:48.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:48 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:48.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:48 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:48.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:48 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:20:48.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:48 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:20:48.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:48 smithi189 ceph-mon[35357]: from='osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T01:20:48.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:48 smithi189 ceph-mon[35357]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:20:48.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:48 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:48.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:48 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:48.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:48 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:48.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:48 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:48.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:48 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:20:48.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:48 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:48.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:48 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:48.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:48 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:20:48.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:48 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:20:48.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:48 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:20:48.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:48 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:20:49.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:49 smithi081 ceph-mon[30920]: purged_snaps scrub starts 2024-09-12T01:20:49.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:49 smithi081 ceph-mon[30920]: purged_snaps scrub ok 2024-09-12T01:20:49.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:49 smithi081 ceph-mon[30920]: Detected new or changed devices on smithi081 2024-09-12T01:20:49.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:49 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-12T01:20:49.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:49 smithi081 ceph-mon[30920]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:49.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:49 smithi081 ceph-mon[30920]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:20:49.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:49 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:49.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:49 smithi081 ceph-mon[30920]: osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528] boot 2024-09-12T01:20:49.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:49 smithi081 ceph-mon[30920]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:20:49.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:49 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:49.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:49 smithi100 ceph-mon[35275]: purged_snaps scrub starts 2024-09-12T01:20:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:49 smithi100 ceph-mon[35275]: purged_snaps scrub ok 2024-09-12T01:20:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:49 smithi100 ceph-mon[35275]: Detected new or changed devices on smithi081 2024-09-12T01:20:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:49 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-12T01:20:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:49 smithi100 ceph-mon[35275]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:49 smithi100 ceph-mon[35275]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:20:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:49 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:49 smithi100 ceph-mon[35275]: osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528] boot 2024-09-12T01:20:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:49 smithi100 ceph-mon[35275]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:20:49.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:49 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:49 smithi189 ceph-mon[35357]: purged_snaps scrub starts 2024-09-12T01:20:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:49 smithi189 ceph-mon[35357]: purged_snaps scrub ok 2024-09-12T01:20:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:49 smithi189 ceph-mon[35357]: Detected new or changed devices on smithi081 2024-09-12T01:20:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:49 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-12T01:20:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:49 smithi189 ceph-mon[35357]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:20:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:49 smithi189 ceph-mon[35357]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:20:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:49 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:49.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:49 smithi189 ceph-mon[35357]: osd.0 [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528] boot 2024-09-12T01:20:49.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:49 smithi189 ceph-mon[35357]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:20:49.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:49 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:20:51.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:50 smithi081 ceph-mon[30920]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:20:51.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:50 smithi081 ceph-mon[30920]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:51.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:50 smithi081 ceph-mon[30920]: from='client.? 172.21.15.100:0/3849160234' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b8111b-d677-4fc8-8285-90683621ccf3"}]: dispatch 2024-09-12T01:20:51.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:50 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b8111b-d677-4fc8-8285-90683621ccf3"}]: dispatch 2024-09-12T01:20:51.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:50 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b8111b-d677-4fc8-8285-90683621ccf3"}]': finished 2024-09-12T01:20:51.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:50 smithi081 ceph-mon[30920]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:20:51.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:50 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:20:51.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:50 smithi100 ceph-mon[35275]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:20:51.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:50 smithi100 ceph-mon[35275]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:51.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:50 smithi100 ceph-mon[35275]: from='client.? 172.21.15.100:0/3849160234' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b8111b-d677-4fc8-8285-90683621ccf3"}]: dispatch 2024-09-12T01:20:51.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:50 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b8111b-d677-4fc8-8285-90683621ccf3"}]: dispatch 2024-09-12T01:20:51.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:50 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b8111b-d677-4fc8-8285-90683621ccf3"}]': finished 2024-09-12T01:20:51.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:50 smithi100 ceph-mon[35275]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:20:51.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:50 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:20:51.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:50 smithi189 ceph-mon[35357]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:20:51.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:50 smithi189 ceph-mon[35357]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:51.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:50 smithi189 ceph-mon[35357]: from='client.? 172.21.15.100:0/3849160234' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b8111b-d677-4fc8-8285-90683621ccf3"}]: dispatch 2024-09-12T01:20:51.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:50 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b8111b-d677-4fc8-8285-90683621ccf3"}]: dispatch 2024-09-12T01:20:51.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:50 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b8111b-d677-4fc8-8285-90683621ccf3"}]': finished 2024-09-12T01:20:51.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:50 smithi189 ceph-mon[35357]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:20:51.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:50 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:20:52.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:51 smithi081 ceph-mon[30920]: from='client.? 172.21.15.100:0/1379733860' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:20:52.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:51 smithi100 ceph-mon[35275]: from='client.? 172.21.15.100:0/1379733860' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:20:52.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:51 smithi189 ceph-mon[35357]: from='client.? 172.21.15.100:0/1379733860' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:20:53.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:52 smithi081 ceph-mon[30920]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:53.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:52 smithi100 ceph-mon[35275]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:53.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:52 smithi189 ceph-mon[35357]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:55.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:55 smithi081 ceph-mon[30920]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:55.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:55 smithi100 ceph-mon[35275]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:55.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:55 smithi189 ceph-mon[35357]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:57.512 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:57 smithi100 ceph-mon[35275]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:57.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:57 smithi081 ceph-mon[30920]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:57 smithi189 ceph-mon[35357]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:59.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:59 smithi081 ceph-mon[30920]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:59.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:20:59.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:20:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:59.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:59 smithi100 ceph-mon[35275]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:59.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:20:59.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:20:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:20:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:59 smithi189 ceph-mon[35357]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:20:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:20:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:20:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:00.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:00 smithi081 ceph-mon[30920]: Deploying daemon osd.1 on smithi100 2024-09-12T01:21:00.767 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:00 smithi100 ceph-mon[35275]: Deploying daemon osd.1 on smithi100 2024-09-12T01:21:00.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:00 smithi189 ceph-mon[35357]: Deploying daemon osd.1 on smithi100 2024-09-12T01:21:01.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:01 smithi081 ceph-mon[30920]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:01.767 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:01 smithi100 ceph-mon[35275]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:01.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:01 smithi189 ceph-mon[35357]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:03.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:03 smithi081 ceph-mon[30920]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:03.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:03 smithi100 ceph-mon[35275]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:03 smithi189 ceph-mon[35357]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:05.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:05 smithi081 ceph-mon[30920]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:05.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:05 smithi100 ceph-mon[35275]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:05.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:05 smithi189 ceph-mon[35357]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:06.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:06 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:06.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:06 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:06.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:06 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:06.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:06 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:06.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:06 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:06.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:06 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:06 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:06 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:06 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:07.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:07 smithi081 ceph-mon[30920]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:07.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:07 smithi100 ceph-mon[35275]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:07.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:07 smithi189 ceph-mon[35357]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:09.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:09.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:09.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:09.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:09.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:09.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:09 smithi189 ceph-mon[35357]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:09.487 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:09.487 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:09.487 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:09.487 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:09.488 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:09.488 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:09 smithi100 ceph-mon[35275]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:09.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:09.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:09.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:09.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:09.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:09.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:09 smithi081 ceph-mon[30920]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:09.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:21:09.769+0000 7ff2737fe640 1 -- 172.21.15.100:0/537073642 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff27c062630 con 0x7ff2680a2af0 2024-09-12T01:21:09.770 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 1 on host 'smithi100' 2024-09-12T01:21:09.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:21:09.771+0000 7ff284463640 1 -- 172.21.15.100:0/537073642 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff2680a2af0 msgr2=0x7ff2680a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:21:09.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:21:09.771+0000 7ff284463640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff2680a2af0 0x7ff2680a4fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff26c005fd0 tx=0x7ff26c005850 comp rx=0 tx=0).stop 2024-09-12T01:21:09.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:21:09.771+0000 7ff284463640 1 -- 172.21.15.100:0/537073642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c104ff0 msgr2=0x7ff27c100670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:21:09.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:21:09.771+0000 7ff284463640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c104ff0 0x7ff27c100670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff278031610 tx=0x7ff2780043b0 comp rx=0 tx=0).stop 2024-09-12T01:21:09.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:21:09.771+0000 7ff284463640 1 -- 172.21.15.100:0/537073642 shutdown_connections 2024-09-12T01:21:09.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:21:09.771+0000 7ff284463640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff2680a2af0 0x7ff2680a4fb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:09.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:21:09.771+0000 7ff284463640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff27c107920 0x7ff27c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:09.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:21:09.771+0000 7ff284463640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff27c104ff0 0x7ff27c100670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:09.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:21:09.771+0000 7ff284463640 1 --2- 172.21.15.100:0/537073642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff27c1026c0 0x7ff27c102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:09.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:21:09.771+0000 7ff284463640 1 -- 172.21.15.100:0/537073642 >> 172.21.15.100:0/537073642 conn(0x7ff27c0fc280 msgr2=0x7ff27c103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:21:09.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:21:09.772+0000 7ff284463640 1 -- 172.21.15.100:0/537073642 shutdown_connections 2024-09-12T01:21:09.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:21:09.772+0000 7ff284463640 1 -- 172.21.15.100:0/537073642 wait complete. 2024-09-12T01:21:10.349 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:10.350 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:10.350 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:10.375 DEBUG:teuthology.orchestra.run.smithi100:osd.1> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T01:21:10.378 INFO:tasks.cephadm:Deploying osd.2 on smithi189 with /dev/vg_nvme/lv_4... 2024-09-12T01:21:10.378 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:21:10.406 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:10.406 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:10.406 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:10.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:10.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:10.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:10.633 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:21:11.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:11 smithi100 ceph-mon[35275]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:11.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:11 smithi081 ceph-mon[30920]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:11.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:11 smithi189 ceph-mon[35357]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:12.009 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:21:11 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1[39769]: 2024-09-12T01:21:11.778+0000 7fa823966640 -1 osd.1 0 log_to_monitors true 2024-09-12T01:21:12.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:12 smithi100 ceph-mon[35275]: from='osd.1 [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:21:12.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:12 smithi100 ceph-mon[35275]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:21:12.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:12 smithi189 ceph-mon[35357]: from='osd.1 [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:21:12.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:12 smithi189 ceph-mon[35357]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:21:12.389 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:12 smithi081 ceph-mon[30920]: from='osd.1 [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:21:12.390 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:12 smithi081 ceph-mon[30920]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:21:13.014 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:21:13.047 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_4 2024-09-12T01:21:13.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:13 smithi189 ceph-mon[35357]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:21:13.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:13 smithi189 ceph-mon[35357]: from='osd.1 [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:21:13.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:13 smithi189 ceph-mon[35357]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:21:13.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:13 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:13.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:13 smithi189 ceph-mon[35357]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:21:13.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:13 smithi189 ceph-mon[35357]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:13.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:13 smithi189 ceph-mon[35357]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:21:13.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:13 smithi189 ceph-mon[35357]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:21:13.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:13 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:13.342 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:21:13.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:13 smithi081 ceph-mon[30920]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:21:13.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:13 smithi081 ceph-mon[30920]: from='osd.1 [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:21:13.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:13 smithi081 ceph-mon[30920]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:21:13.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:13 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:13.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:13 smithi081 ceph-mon[30920]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:21:13.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:13 smithi081 ceph-mon[30920]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:13.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:13 smithi081 ceph-mon[30920]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:21:13.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:13 smithi081 ceph-mon[30920]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:21:13.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:13 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:13.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:13 smithi100 ceph-mon[35275]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:21:13.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:13 smithi100 ceph-mon[35275]: from='osd.1 [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:21:13.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:13 smithi100 ceph-mon[35275]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:21:13.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:13.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:13 smithi100 ceph-mon[35275]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:21:13.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:13 smithi100 ceph-mon[35275]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:13.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:13 smithi100 ceph-mon[35275]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:21:13.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:13 smithi100 ceph-mon[35275]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:21:13.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:13 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:13.805 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.799+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/3651305951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6bc1026d0 msgr2=0x7fe6bc108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:21:13.806 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.799+0000 7fe6c0cdc640 1 --2- 172.21.15.189:0/3651305951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6bc1026d0 0x7fe6bc108f60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009ca0 tx=0x7fe6b402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:21:13.806 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.799+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/3651305951 shutdown_connections 2024-09-12T01:21:13.806 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.799+0000 7fe6c0cdc640 1 --2- 172.21.15.189:0/3651305951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6bc1026d0 0x7fe6bc108f60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:13.806 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.799+0000 7fe6c0cdc640 1 --2- 172.21.15.189:0/3651305951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6bc101d10 0x7fe6bc102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:13.806 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.799+0000 7fe6c0cdc640 1 --2- 172.21.15.189:0/3651305951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6bc100b10 0x7fe6bc100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:13.806 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.799+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/3651305951 >> 172.21.15.189:0/3651305951 conn(0x7fe6bc0fc2a0 msgr2=0x7fe6bc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:21:13.806 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.799+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/3651305951 shutdown_connections 2024-09-12T01:21:13.806 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.799+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/3651305951 wait complete. 2024-09-12T01:21:13.807 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.800+0000 7fe6c0cdc640 1 Processor -- start 2024-09-12T01:21:13.807 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.800+0000 7fe6c0cdc640 1 -- start start 2024-09-12T01:21:13.807 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.800+0000 7fe6c0cdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6bc100b10 0x7fe6bc197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:21:13.807 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.800+0000 7fe6c0cdc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6bc101d10 0x7fe6bc1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:21:13.807 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.800+0000 7fe6c0cdc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6bc1026d0 0x7fe6bc19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:21:13.807 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.800+0000 7fe6c0cdc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc10d8c0 con 0x7fe6bc100b10 2024-09-12T01:21:13.807 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.800+0000 7fe6c0cdc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc10d740 con 0x7fe6bc1026d0 2024-09-12T01:21:13.807 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.800+0000 7fe6c0cdc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc10da40 con 0x7fe6bc101d10 2024-09-12T01:21:13.807 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.800+0000 7fe6b9d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6bc101d10 0x7fe6bc1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:21:13.807 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.800+0000 7fe6b9d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6bc101d10 0x7fe6bc1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:36110/0 (socket says 172.21.15.189:36110) 2024-09-12T01:21:13.808 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.800+0000 7fe6b9d9b640 1 -- 172.21.15.189:0/534207937 learned_addr learned my addr 172.21.15.189:0/534207937 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:21:13.808 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.801+0000 7fe6bad9d640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6bc1026d0 0x7fe6bc19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:21:13.808 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.801+0000 7fe6ba59c640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6bc100b10 0x7fe6bc197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:21:13.808 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.801+0000 7fe6b9d9b640 1 -- 172.21.15.189:0/534207937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6bc1026d0 msgr2=0x7fe6bc19f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:21:13.808 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.801+0000 7fe6b9d9b640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6bc1026d0 0x7fe6bc19f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:13.808 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.801+0000 7fe6b9d9b640 1 -- 172.21.15.189:0/534207937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6bc100b10 msgr2=0x7fe6bc197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:21:13.808 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.801+0000 7fe6b9d9b640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6bc100b10 0x7fe6bc197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:13.808 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.801+0000 7fe6b9d9b640 1 -- 172.21.15.189:0/534207937 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc19faa0 con 0x7fe6bc101d10 2024-09-12T01:21:13.808 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.801+0000 7fe6b9d9b640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6bc101d10 0x7fe6bc1983b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000d950 tx=0x7fe6b000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:21:13.809 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.801+0000 7fe6ab7fe640 1 -- 172.21.15.189:0/534207937 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0017070 con 0x7fe6bc101d10 2024-09-12T01:21:13.809 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.801+0000 7fe6ab7fe640 1 -- 172.21.15.189:0/534207937 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6b0009c30 con 0x7fe6bc101d10 2024-09-12T01:21:13.809 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.801+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/534207937 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6bc19fd90 con 0x7fe6bc101d10 2024-09-12T01:21:13.809 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.801+0000 7fe6ab7fe640 1 -- 172.21.15.189:0/534207937 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b000f6b0 con 0x7fe6bc101d10 2024-09-12T01:21:13.809 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.801+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/534207937 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6bc1a0270 con 0x7fe6bc101d10 2024-09-12T01:21:13.809 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.802+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/534207937 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6bc107ec0 con 0x7fe6bc101d10 2024-09-12T01:21:13.809 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.803+0000 7fe6ab7fe640 1 -- 172.21.15.189:0/534207937 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fe6b00109d0 con 0x7fe6bc101d10 2024-09-12T01:21:13.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.804+0000 7fe6ab7fe640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe6a40a2b20 0x7fe6a40a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:21:13.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.804+0000 7fe6ab7fe640 1 -- 172.21.15.189:0/534207937 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7fe6b00cd530 con 0x7fe6bc101d10 2024-09-12T01:21:13.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.804+0000 7fe6ba59c640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe6a40a2b20 0x7fe6a40a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:21:13.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.804+0000 7fe6ba59c640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe6a40a2b20 0x7fe6a40a4fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac005fd0 tx=0x7fe6ac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:21:13.810 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.808+0000 7fe6ab7fe640 1 -- 172.21.15.189:0/534207937 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe6b009b7b0 con 0x7fe6bc101d10 2024-09-12T01:21:13.983 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:13.984+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/534207937 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe6bc062630 con 0x7fe6a40a2b20 2024-09-12T01:21:14.268 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:21:13 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1[39769]: 2024-09-12T01:21:13.833+0000 7fa81f0c6640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T01:21:14.268 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:21:13 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1[39769]: 2024-09-12T01:21:13.842+0000 7fa8176f8640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:21:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: Detected new or changed devices on smithi100 2024-09-12T01:21:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:21:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-12T01:21:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: from='osd.1 ' entity='osd.1' 2024-09-12T01:21:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:21:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:21:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:14.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: Detected new or changed devices on smithi100 2024-09-12T01:21:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:21:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-12T01:21:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:14.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: from='osd.1 ' entity='osd.1' 2024-09-12T01:21:14.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:21:14.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:21:14.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:14.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:14.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:14.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: Detected new or changed devices on smithi100 2024-09-12T01:21:14.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:14.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:14.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:21:14.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-12T01:21:14.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:14.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:14.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:14.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:14.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: from='osd.1 ' entity='osd.1' 2024-09-12T01:21:14.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:21:14.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:21:14.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:14.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:15.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:15 smithi189 ceph-mon[35357]: purged_snaps scrub starts 2024-09-12T01:21:15.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:15 smithi189 ceph-mon[35357]: purged_snaps scrub ok 2024-09-12T01:21:15.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:15 smithi189 ceph-mon[35357]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:21:15.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:15 smithi189 ceph-mon[35357]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:15.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:15 smithi189 ceph-mon[35357]: osd.1 [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652] boot 2024-09-12T01:21:15.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:15 smithi189 ceph-mon[35357]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T01:21:15.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:15 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:15.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:15 smithi081 ceph-mon[30920]: purged_snaps scrub starts 2024-09-12T01:21:15.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:15 smithi081 ceph-mon[30920]: purged_snaps scrub ok 2024-09-12T01:21:15.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:15 smithi081 ceph-mon[30920]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:21:15.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:15 smithi081 ceph-mon[30920]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:15.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:15 smithi081 ceph-mon[30920]: osd.1 [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652] boot 2024-09-12T01:21:15.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:15 smithi081 ceph-mon[30920]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T01:21:15.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:15 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:15.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:15 smithi100 ceph-mon[35275]: purged_snaps scrub starts 2024-09-12T01:21:15.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:15 smithi100 ceph-mon[35275]: purged_snaps scrub ok 2024-09-12T01:21:15.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:15 smithi100 ceph-mon[35275]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:21:15.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:15 smithi100 ceph-mon[35275]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:21:15.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:15 smithi100 ceph-mon[35275]: osd.1 [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652] boot 2024-09-12T01:21:15.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:15 smithi100 ceph-mon[35275]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T01:21:15.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:15 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:21:17.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:17 smithi081 ceph-mon[30920]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T01:21:17.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:17 smithi081 ceph-mon[30920]: from='client.? 172.21.15.189:0/4245211076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "763e357e-5a04-45ff-95e8-bc1abfeac056"}]: dispatch 2024-09-12T01:21:17.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:17 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "763e357e-5a04-45ff-95e8-bc1abfeac056"}]: dispatch 2024-09-12T01:21:17.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:17 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "763e357e-5a04-45ff-95e8-bc1abfeac056"}]': finished 2024-09-12T01:21:17.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:17 smithi081 ceph-mon[30920]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T01:21:17.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:17 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:17.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:17 smithi081 ceph-mon[30920]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:17.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:17 smithi081 ceph-mon[30920]: from='client.? 172.21.15.189:0/2401277652' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:21:17.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:17 smithi100 ceph-mon[35275]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T01:21:17.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:17 smithi100 ceph-mon[35275]: from='client.? 172.21.15.189:0/4245211076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "763e357e-5a04-45ff-95e8-bc1abfeac056"}]: dispatch 2024-09-12T01:21:17.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:17 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "763e357e-5a04-45ff-95e8-bc1abfeac056"}]: dispatch 2024-09-12T01:21:17.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:17 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "763e357e-5a04-45ff-95e8-bc1abfeac056"}]': finished 2024-09-12T01:21:17.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:17 smithi100 ceph-mon[35275]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T01:21:17.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:17 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:17.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:17 smithi100 ceph-mon[35275]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:17.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:17 smithi100 ceph-mon[35275]: from='client.? 172.21.15.189:0/2401277652' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:21:17.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:17 smithi189 ceph-mon[35357]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T01:21:17.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:17 smithi189 ceph-mon[35357]: from='client.? 172.21.15.189:0/4245211076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "763e357e-5a04-45ff-95e8-bc1abfeac056"}]: dispatch 2024-09-12T01:21:17.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:17 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "763e357e-5a04-45ff-95e8-bc1abfeac056"}]: dispatch 2024-09-12T01:21:17.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:17 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "763e357e-5a04-45ff-95e8-bc1abfeac056"}]': finished 2024-09-12T01:21:17.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:17 smithi189 ceph-mon[35357]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T01:21:17.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:17 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:17.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:17 smithi189 ceph-mon[35357]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:17.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:17 smithi189 ceph-mon[35357]: from='client.? 172.21.15.189:0/2401277652' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:21:19.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:19 smithi081 ceph-mon[30920]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:19.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:19 smithi100 ceph-mon[35275]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:19 smithi189 ceph-mon[35357]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:21.735 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:21 smithi189 ceph-mon[35357]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:21.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:21 smithi081 ceph-mon[30920]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:21.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:21 smithi100 ceph-mon[35275]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:23.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:23 smithi081 ceph-mon[30920]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:23.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:23 smithi189 ceph-mon[35357]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:23.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:23 smithi100 ceph-mon[35275]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:24.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:21:24.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:24.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:21:24.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:21:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:25.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:25 smithi081 ceph-mon[30920]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:25.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:25 smithi081 ceph-mon[30920]: Deploying daemon osd.2 on smithi189 2024-09-12T01:21:25.750 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:25 smithi189 ceph-mon[35357]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:25.750 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:25 smithi189 ceph-mon[35357]: Deploying daemon osd.2 on smithi189 2024-09-12T01:21:25.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:25 smithi100 ceph-mon[35275]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:25.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:25 smithi100 ceph-mon[35275]: Deploying daemon osd.2 on smithi189 2024-09-12T01:21:27.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:27 smithi081 ceph-mon[30920]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:27.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:27 smithi100 ceph-mon[35275]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:27 smithi189 ceph-mon[35357]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:29.727 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:29 smithi189 ceph-mon[35357]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:29.737 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:29 smithi081 ceph-mon[30920]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:29.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:29 smithi100 ceph-mon[35275]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:31.654 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:31 smithi189 ceph-mon[35357]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:31.654 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:31 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:31.654 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:31 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:31.654 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:31 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:31.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:31 smithi081 ceph-mon[30920]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:31.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:31 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:31.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:31 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:31.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:31 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:31.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:31 smithi100 ceph-mon[35275]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:31.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:31 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:31.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:31 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:31.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:31 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:33 smithi081 ceph-mon[30920]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:33 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:33 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:33 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:33 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:33 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:33.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:33 smithi100 ceph-mon[35275]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:33.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:33 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:33.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:33 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:33.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:33 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:33.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:33 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:33.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:33 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:33 smithi189 ceph-mon[35357]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:33 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:33 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:33 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:33 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:33 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:35.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:35.065+0000 7fe6ab7fe640 1 -- 172.21.15.189:0/534207937 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe6bc062630 con 0x7fe6a40a2b20 2024-09-12T01:21:35.066 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 2 on host 'smithi189' 2024-09-12T01:21:35.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:35.068+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/534207937 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe6a40a2b20 msgr2=0x7fe6a40a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:21:35.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:35.068+0000 7fe6c0cdc640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe6a40a2b20 0x7fe6a40a4fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac005fd0 tx=0x7fe6ac00b390 comp rx=0 tx=0).stop 2024-09-12T01:21:35.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:35.068+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/534207937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6bc101d10 msgr2=0x7fe6bc1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:21:35.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:35.068+0000 7fe6c0cdc640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6bc101d10 0x7fe6bc1983b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000d950 tx=0x7fe6b000de10 comp rx=0 tx=0).stop 2024-09-12T01:21:35.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:35.068+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/534207937 shutdown_connections 2024-09-12T01:21:35.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:35.068+0000 7fe6c0cdc640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe6a40a2b20 0x7fe6a40a4fe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:35.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:35.068+0000 7fe6c0cdc640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6bc1026d0 0x7fe6bc19f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:35.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:35.068+0000 7fe6c0cdc640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6bc101d10 0x7fe6bc1983b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:35.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:35.068+0000 7fe6c0cdc640 1 --2- 172.21.15.189:0/534207937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6bc100b10 0x7fe6bc197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:35.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:35.068+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/534207937 >> 172.21.15.189:0/534207937 conn(0x7fe6bc0fc2a0 msgr2=0x7fe6bc105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:21:35.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:35.068+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/534207937 shutdown_connections 2024-09-12T01:21:35.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:21:35.068+0000 7fe6c0cdc640 1 -- 172.21.15.189:0/534207937 wait complete. 2024-09-12T01:21:35.670 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:35 smithi189 ceph-mon[35357]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:35.671 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:35.671 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:35.671 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:35.672 DEBUG:teuthology.orchestra.run.smithi189:osd.2> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T01:21:35.674 INFO:tasks.cephadm:Deploying osd.3 on smithi081 with /dev/vg_nvme/lv_3... 2024-09-12T01:21:35.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:21:35.697 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:35 smithi081 ceph-mon[30920]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:35.697 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:35.698 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:35.698 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:35 smithi100 ceph-mon[35275]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:35.916 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:21:37.132 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:21:36 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2[40368]: 2024-09-12T01:21:36.940+0000 7f1308aa0640 -1 osd.2 0 log_to_monitors true 2024-09-12T01:21:37.724 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:37 smithi081 ceph-mon[30920]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:37.724 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:37 smithi081 ceph-mon[30920]: from='osd.2 [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:21:37.724 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:37 smithi081 ceph-mon[30920]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:21:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:37 smithi100 ceph-mon[35275]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:37 smithi100 ceph-mon[35275]: from='osd.2 [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:21:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:37 smithi100 ceph-mon[35275]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:21:37.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:37 smithi189 ceph-mon[35357]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:37 smithi189 ceph-mon[35357]: from='osd.2 [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:21:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:37 smithi189 ceph-mon[35357]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:21:38.477 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:21:38.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_3 2024-09-12T01:21:38.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:38 smithi081 ceph-mon[30920]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:21:38.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:38 smithi081 ceph-mon[30920]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:21:38.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:38 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:38.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:38 smithi081 ceph-mon[30920]: from='osd.2 [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:21:38.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:38 smithi081 ceph-mon[30920]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:21:38.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:38 smithi100 ceph-mon[35275]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:21:38.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:38 smithi100 ceph-mon[35275]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:21:38.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:38 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:38.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:38 smithi100 ceph-mon[35275]: from='osd.2 [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:21:38.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:38 smithi100 ceph-mon[35275]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:21:38.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:38 smithi189 ceph-mon[35357]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:21:38.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:38 smithi189 ceph-mon[35357]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:21:38.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:38 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:38.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:38 smithi189 ceph-mon[35357]: from='osd.2 [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:21:38.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:38 smithi189 ceph-mon[35357]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:21:38.799 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:21:39.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.289+0000 7f32f96bf640 1 -- 172.21.15.81:0/3347268297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32f4101cd0 msgr2=0x7f32f4102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:21:39.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.289+0000 7f32f96bf640 1 --2- 172.21.15.81:0/3347268297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32f4101cd0 0x7f32f4102150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009900 tx=0x7f32e802a410 comp rx=0 tx=0).stop 2024-09-12T01:21:39.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.289+0000 7f32f96bf640 1 -- 172.21.15.81:0/3347268297 shutdown_connections 2024-09-12T01:21:39.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.289+0000 7f32f96bf640 1 --2- 172.21.15.81:0/3347268297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32f4102690 0x7f32f4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:39.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.289+0000 7f32f96bf640 1 --2- 172.21.15.81:0/3347268297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32f4101cd0 0x7f32f4102150 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:39.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.289+0000 7f32f96bf640 1 --2- 172.21.15.81:0/3347268297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32f4100ad0 0x7f32f4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:39.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.289+0000 7f32f96bf640 1 -- 172.21.15.81:0/3347268297 >> 172.21.15.81:0/3347268297 conn(0x7f32f40fc280 msgr2=0x7f32f40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:21:39.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.289+0000 7f32f96bf640 1 -- 172.21.15.81:0/3347268297 shutdown_connections 2024-09-12T01:21:39.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.289+0000 7f32f96bf640 1 -- 172.21.15.81:0/3347268297 wait complete. 2024-09-12T01:21:39.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.290+0000 7f32f96bf640 1 Processor -- start 2024-09-12T01:21:39.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.290+0000 7f32f96bf640 1 -- start start 2024-09-12T01:21:39.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.290+0000 7f32f96bf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32f4100ad0 0x7f32f4197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:21:39.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.290+0000 7f32f96bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32f4101cd0 0x7f32f4198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:21:39.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.290+0000 7f32f96bf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32f4102690 0x7f32f419f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:21:39.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.290+0000 7f32f96bf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32f410c7b0 con 0x7f32f4101cd0 2024-09-12T01:21:39.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.290+0000 7f32f96bf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f32f410c630 con 0x7f32f4102690 2024-09-12T01:21:39.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.290+0000 7f32f96bf640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f32f410c930 con 0x7f32f4100ad0 2024-09-12T01:21:39.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.290+0000 7f32f27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32f4101cd0 0x7f32f4198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:21:39.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.290+0000 7f32f27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32f4101cd0 0x7f32f4198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40366/0 (socket says 172.21.15.81:40366) 2024-09-12T01:21:39.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.290+0000 7f32f27fc640 1 -- 172.21.15.81:0/727905485 learned_addr learned my addr 172.21.15.81:0/727905485 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:21:39.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.290+0000 7f32f2ffd640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32f4100ad0 0x7f32f4197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:21:39.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.291+0000 7f32f37fe640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32f4102690 0x7f32f419f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:21:39.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.291+0000 7f32f27fc640 1 -- 172.21.15.81:0/727905485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32f4100ad0 msgr2=0x7f32f4197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:21:39.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.291+0000 7f32f27fc640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32f4100ad0 0x7f32f4197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:39.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.291+0000 7f32f27fc640 1 -- 172.21.15.81:0/727905485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32f4102690 msgr2=0x7f32f419f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:21:39.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.291+0000 7f32f27fc640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32f4102690 0x7f32f419f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:21:39.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.291+0000 7f32f27fc640 1 -- 172.21.15.81:0/727905485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f419fc20 con 0x7f32f4101cd0 2024-09-12T01:21:39.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.291+0000 7f32f27fc640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32f4101cd0 0x7f32f4198530 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f32e8006010 tx=0x7f32e8004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:21:39.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.291+0000 7f32dbfff640 1 -- 172.21.15.81:0/727905485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e803f030 con 0x7f32f4101cd0 2024-09-12T01:21:39.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.291+0000 7f32f96bf640 1 -- 172.21.15.81:0/727905485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f419feb0 con 0x7f32f4101cd0 2024-09-12T01:21:39.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.291+0000 7f32dbfff640 1 -- 172.21.15.81:0/727905485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32e8003ce0 con 0x7f32f4101cd0 2024-09-12T01:21:39.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.291+0000 7f32dbfff640 1 -- 172.21.15.81:0/727905485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8035070 con 0x7f32f4101cd0 2024-09-12T01:21:39.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.291+0000 7f32f96bf640 1 -- 172.21.15.81:0/727905485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f41a0300 con 0x7f32f4101cd0 2024-09-12T01:21:39.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.292+0000 7f32f96bf640 1 -- 172.21.15.81:0/727905485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f41a05f0 con 0x7f32f4101cd0 2024-09-12T01:21:39.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.293+0000 7f32dbfff640 1 -- 172.21.15.81:0/727905485 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f32e8042030 con 0x7f32f4101cd0 2024-09-12T01:21:39.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.294+0000 7f32dbfff640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f32dc0a2b20 0x7f32dc0a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:21:39.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.294+0000 7f32f2ffd640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f32dc0a2b20 0x7f32dc0a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:21:39.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.294+0000 7f32dbfff640 1 -- 172.21.15.81:0/727905485 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f32e80ede10 con 0x7f32f4101cd0 2024-09-12T01:21:39.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.294+0000 7f32f2ffd640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f32dc0a2b20 0x7f32dc0a4fe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f32e4005fd0 tx=0x7f32e400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:21:39.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.298+0000 7f32dbfff640 1 -- 172.21.15.81:0/727905485 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32e80bc4c0 con 0x7f32f4101cd0 2024-09-12T01:21:39.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:39.478+0000 7f32f96bf640 1 -- 172.21.15.81:0/727905485 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f32f406a710 con 0x7f32dc0a2b20 2024-09-12T01:21:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T01:21:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T01:21:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: Detected new or changed devices on smithi189 2024-09-12T01:21:39.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:39.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:39.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:21:39.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:39.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:39.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:39.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:39.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: from='osd.2 ' entity='osd.2' 2024-09-12T01:21:39.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:39.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:39.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T01:21:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T01:21:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: Detected new or changed devices on smithi189 2024-09-12T01:21:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:21:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: from='osd.2 ' entity='osd.2' 2024-09-12T01:21:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:39.782 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2[40368]: 2024-09-12T01:21:39.341+0000 7f1304200640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T01:21:39.782 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2[40368]: 2024-09-12T01:21:39.348+0000 7f12fc832640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:21:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T01:21:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T01:21:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: Detected new or changed devices on smithi189 2024-09-12T01:21:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:21:39.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:39.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:39.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:39.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:39.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: from='osd.2 ' entity='osd.2' 2024-09-12T01:21:39.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:40.986 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:40 smithi081 ceph-mon[30920]: purged_snaps scrub starts 2024-09-12T01:21:40.986 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:40 smithi081 ceph-mon[30920]: purged_snaps scrub ok 2024-09-12T01:21:40.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:40 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-12T01:21:40.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:40 smithi081 ceph-mon[30920]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:21:40.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:40 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:21:40.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:40 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:21:40.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:40 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:40.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:40 smithi081 ceph-mon[30920]: osd.2 [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110] boot 2024-09-12T01:21:40.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:40 smithi081 ceph-mon[30920]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T01:21:40.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:40 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:40.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:40 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:21:41.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:40 smithi100 ceph-mon[35275]: purged_snaps scrub starts 2024-09-12T01:21:41.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:40 smithi100 ceph-mon[35275]: purged_snaps scrub ok 2024-09-12T01:21:41.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:40 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-12T01:21:41.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:40 smithi100 ceph-mon[35275]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:21:41.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:40 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:21:41.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:40 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:21:41.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:40 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:41.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:40 smithi100 ceph-mon[35275]: osd.2 [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110] boot 2024-09-12T01:21:41.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:40 smithi100 ceph-mon[35275]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T01:21:41.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:40 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:41.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:40 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:21:41.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:40 smithi189 ceph-mon[35357]: purged_snaps scrub starts 2024-09-12T01:21:41.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:40 smithi189 ceph-mon[35357]: purged_snaps scrub ok 2024-09-12T01:21:41.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:40 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-12T01:21:41.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:40 smithi189 ceph-mon[35357]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:21:41.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:40 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:21:41.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:40 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:21:41.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:40 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:41.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:40 smithi189 ceph-mon[35357]: osd.2 [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110] boot 2024-09-12T01:21:41.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:40 smithi189 ceph-mon[35357]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T01:21:41.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:40 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:21:41.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:40 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:21:41.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:41 smithi081 ceph-mon[30920]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:41.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T01:21:41.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:41 smithi081 ceph-mon[30920]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T01:21:41.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:21:42.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:41 smithi100 ceph-mon[35275]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:42.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:41 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T01:21:42.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:41 smithi100 ceph-mon[35275]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T01:21:42.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:41 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:21:42.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:41 smithi189 ceph-mon[35357]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:21:42.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:41 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T01:21:42.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:41 smithi189 ceph-mon[35357]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T01:21:42.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:41 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:21:42.394 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:21:42 smithi081 sudo[49654]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:21:42.394 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:21:42 smithi081 sudo[49654]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:21:42.394 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:21:42 smithi081 sudo[49654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:21:42.394 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:21:42 smithi081 sudo[49654]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:21:42.654 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:21:42 smithi081 sudo[49662]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:21:42.654 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:21:42 smithi081 sudo[49662]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:21:42.654 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:21:42 smithi081 sudo[49662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:21:42.654 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:21:42 smithi081 sudo[49662]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:21:42.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:21:42.928+0000 7f32dbfff640 1 -- 172.21.15.81:0/727905485 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f32e80b8430 con 0x7f32f4101cd0 2024-09-12T01:21:42.929 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:42 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/693085119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99843578-1b9e-4ee0-91f1-ba419d07897e"}]: dispatch 2024-09-12T01:21:42.929 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:42 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:21:42.929 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:42 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/693085119' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99843578-1b9e-4ee0-91f1-ba419d07897e"}]': finished 2024-09-12T01:21:42.929 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:42 smithi081 ceph-mon[30920]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T01:21:42.929 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:42 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:21:42.929 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:42 smithi081 ceph-mon[30920]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:21:42.929 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:42 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/311488749' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:21:42.929 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:42 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:42.962 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:21:42 smithi100 sudo[43500]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:21:42.962 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:21:42 smithi100 sudo[43500]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:21:42.962 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:21:42 smithi100 sudo[43500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:21:42.963 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:21:42 smithi100 sudo[43500]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:21:42.963 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:42 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/693085119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99843578-1b9e-4ee0-91f1-ba419d07897e"}]: dispatch 2024-09-12T01:21:42.963 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:42 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:21:42.963 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:42 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/693085119' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99843578-1b9e-4ee0-91f1-ba419d07897e"}]': finished 2024-09-12T01:21:42.963 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:42 smithi100 ceph-mon[35275]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T01:21:42.963 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:42 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:21:42.963 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:42 smithi100 ceph-mon[35275]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:21:42.963 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:42 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/311488749' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:21:42.964 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:42 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:43.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:42 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/693085119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99843578-1b9e-4ee0-91f1-ba419d07897e"}]: dispatch 2024-09-12T01:21:43.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:42 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:21:43.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:42 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/693085119' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99843578-1b9e-4ee0-91f1-ba419d07897e"}]': finished 2024-09-12T01:21:43.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:42 smithi189 ceph-mon[35357]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T01:21:43.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:42 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:21:43.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:42 smithi189 ceph-mon[35357]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:21:43.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:42 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/311488749' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:21:43.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:42 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:43.268 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:21:42 smithi100 sudo[43503]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:21:43.268 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:21:42 smithi100 sudo[43503]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:21:43.269 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:21:42 smithi100 sudo[43503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:21:43.269 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:21:42 smithi100 sudo[43503]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:21:43.580 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:21:43 smithi189 sudo[44324]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:21:43.580 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:21:43 smithi189 sudo[44324]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:21:43.580 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:21:43 smithi189 sudo[44324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:21:43.580 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:21:43 smithi189 sudo[44324]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:21:43.914 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:21:43 smithi189 sudo[44327]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:21:43.914 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:21:43 smithi189 sudo[44327]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:21:43.914 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:21:43 smithi189 sudo[44327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:21:43.914 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:21:43 smithi189 sudo[44327]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:21:44.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:43 smithi081 sudo[49899]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:21:44.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:43 smithi081 sudo[49899]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:21:44.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:43 smithi081 sudo[49899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:21:44.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:43 smithi081 sudo[49899]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:21:44.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:44 smithi081 sudo[50086]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:21:44.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:44 smithi081 sudo[50086]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:21:44.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:44 smithi081 sudo[50086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:21:44.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:44 smithi081 sudo[50086]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:21:44.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:44 smithi081 ceph-mon[30920]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T01:21:44.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:44 smithi081 ceph-mon[30920]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T01:21:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:21:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:44.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:44.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:44 smithi100 ceph-mon[35275]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T01:21:44.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:44 smithi100 ceph-mon[35275]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T01:21:44.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:21:44.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:44.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:44.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:44 smithi189 sudo[44330]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:21:44.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:44 smithi189 sudo[44330]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:21:44.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:44 smithi189 sudo[44330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:21:44.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:44 smithi189 sudo[44330]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:21:45.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:44 smithi189 sudo[44333]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:21:45.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:44 smithi189 sudo[44333]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:21:45.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:44 smithi189 sudo[44333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:21:45.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:44 smithi189 sudo[44333]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:21:45.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:44 smithi189 ceph-mon[35357]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T01:21:45.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:44 smithi189 ceph-mon[35357]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T01:21:45.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:21:45.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:45.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:45.126 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:44 smithi100 sudo[43506]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:21:45.126 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:44 smithi100 sudo[43506]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:21:45.126 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:44 smithi100 sudo[43506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:21:45.126 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:44 smithi100 sudo[43506]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:21:45.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:21:45.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:21:45.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:21:45.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:21:45.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:21:45.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:21:45.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:21:45.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:21:45.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:21:45.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:21:45.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:21:45.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:21:45.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:21:45.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:21:45.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:21:45.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:45 smithi081 ceph-mon[30920]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:21:45.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 sudo[43509]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:21:45.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 sudo[43509]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:21:45.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 sudo[43509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:21:45.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 sudo[43509]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:21:45.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:21:45.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:21:45.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:21:45.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:21:45.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:21:45.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:21:45.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:21:45.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:21:45.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:21:45.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:21:45.520 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:21:45.520 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:21:45.520 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:21:45.520 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:21:45.520 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:21:45.520 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:45 smithi100 ceph-mon[35275]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:21:45.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:21:45.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:21:45.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:21:45.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:21:45.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:21:45.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:21:45.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:21:45.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:21:45.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:21:45.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:21:45.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:21:45.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:21:45.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:21:45.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:21:45.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:21:45.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:45 smithi189 ceph-mon[35357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:21:47.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:47 smithi081 ceph-mon[30920]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:21:47.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:47 smithi100 ceph-mon[35275]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:21:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:47 smithi189 ceph-mon[35357]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:21:49.528 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:49 smithi081 ceph-mon[30920]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:21:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:49 smithi100 ceph-mon[35275]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:21:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:49 smithi189 ceph-mon[35357]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:21:50.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:50 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:21:50.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:50 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:50.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:50 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:21:50.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:50 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:50.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:50 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:21:50.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:50 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:51.688 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:51 smithi081 ceph-mon[30920]: Deploying daemon osd.3 on smithi081 2024-09-12T01:21:51.689 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:51 smithi081 ceph-mon[30920]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-12T01:21:51.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:51 smithi100 ceph-mon[35275]: Deploying daemon osd.3 on smithi081 2024-09-12T01:21:51.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:51 smithi100 ceph-mon[35275]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-12T01:21:51.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:51 smithi189 ceph-mon[35357]: Deploying daemon osd.3 on smithi081 2024-09-12T01:21:51.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:51 smithi189 ceph-mon[35357]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-12T01:21:53.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:53 smithi081 ceph-mon[30920]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-12T01:21:53.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:53 smithi100 ceph-mon[35275]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-12T01:21:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:53 smithi189 ceph-mon[35357]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-12T01:21:55.670 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:55 smithi081 ceph-mon[30920]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-12T01:21:55.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:55 smithi100 ceph-mon[35275]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-12T01:21:55.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:55 smithi189 ceph-mon[35357]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-12T01:21:57.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:57 smithi081 ceph-mon[30920]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T01:21:57.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:57 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:57.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:57 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:57.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:57 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:57.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:57 smithi100 ceph-mon[35275]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T01:21:57.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:57 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:57 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:57 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:57 smithi189 ceph-mon[35357]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T01:21:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:57 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:21:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:57 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:57 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:59.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:59 smithi081 ceph-mon[30920]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T01:21:59.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:59.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:59.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:59.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:59.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:21:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:59.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:59 smithi100 ceph-mon[35275]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T01:21:59.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:59.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:59.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:59.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:59.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:21:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:59 smithi189 ceph-mon[35357]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T01:21:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:21:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:21:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:21:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:21:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:00.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:00.597+0000 7f32dbfff640 1 -- 172.21.15.81:0/727905485 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f32f406a710 con 0x7f32dc0a2b20 2024-09-12T01:22:00.596 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 3 on host 'smithi081' 2024-09-12T01:22:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:00.600+0000 7f32f96bf640 1 -- 172.21.15.81:0/727905485 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f32dc0a2b20 msgr2=0x7f32dc0a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:00.600+0000 7f32f96bf640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f32dc0a2b20 0x7f32dc0a4fe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f32e4005fd0 tx=0x7f32e400b410 comp rx=0 tx=0).stop 2024-09-12T01:22:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:00.600+0000 7f32f96bf640 1 -- 172.21.15.81:0/727905485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32f4101cd0 msgr2=0x7f32f4198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:00.600+0000 7f32f96bf640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32f4101cd0 0x7f32f4198530 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f32e8006010 tx=0x7f32e8004360 comp rx=0 tx=0).stop 2024-09-12T01:22:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:00.600+0000 7f32f96bf640 1 -- 172.21.15.81:0/727905485 shutdown_connections 2024-09-12T01:22:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:00.600+0000 7f32f96bf640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f32dc0a2b20 0x7f32dc0a4fe0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:00.600+0000 7f32f96bf640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32f4102690 0x7f32f419f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:00.600+0000 7f32f96bf640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32f4101cd0 0x7f32f4198530 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:00.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:00.600+0000 7f32f96bf640 1 --2- 172.21.15.81:0/727905485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32f4100ad0 0x7f32f4197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:00.600+0000 7f32f96bf640 1 -- 172.21.15.81:0/727905485 >> 172.21.15.81:0/727905485 conn(0x7f32f40fc280 msgr2=0x7f32f406a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:22:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:00.600+0000 7f32f96bf640 1 -- 172.21.15.81:0/727905485 shutdown_connections 2024-09-12T01:22:00.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:00.600+0000 7f32f96bf640 1 -- 172.21.15.81:0/727905485 wait complete. 2024-09-12T01:22:01.216 DEBUG:teuthology.orchestra.run.smithi081:osd.3> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T01:22:01.219 INFO:tasks.cephadm:Deploying osd.4 on smithi100 with /dev/vg_nvme/lv_3... 2024-09-12T01:22:01.219 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:22:01.470 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:22:01.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:01 smithi100 ceph-mon[35275]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T01:22:01.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:01 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:01.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:01 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:01.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:01 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:01.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:01 smithi081 ceph-mon[30920]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T01:22:01.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:01 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:01.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:01 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:01.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:01 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:01 smithi189 ceph-mon[35357]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T01:22:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:01 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:01 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:01 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:03.238 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:22:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3[51660]: 2024-09-12T01:22:02.961+0000 7f8037565640 -1 osd.3 0 log_to_monitors true 2024-09-12T01:22:03.676 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:03 smithi081 ceph-mon[30920]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:22:03.676 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:03 smithi081 ceph-mon[30920]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:22:03.728 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:03 smithi100 ceph-mon[35275]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:22:03.728 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:03 smithi100 ceph-mon[35275]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:22:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:03 smithi189 ceph-mon[35357]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:22:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:03 smithi189 ceph-mon[35357]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:22:03.983 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:22:04.003 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_3 2024-09-12T01:22:04.258 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:22:04.644 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:22:04.644 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T01:22:04.644 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T01:22:04.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:22:04.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:04.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:04.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:04.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:04.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:04.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:04.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:04.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:04.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T01:22:04.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T01:22:04.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:04 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:22:04.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.728+0000 7f5601d75640 1 -- 172.21.15.100:0/2597684687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55fc1037c0 msgr2=0x7f55fc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.728+0000 7f5601d75640 1 --2- 172.21.15.100:0/2597684687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55fc1037c0 0x7f55fc10a050 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009ca0 tx=0x7f55f402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:22:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.728+0000 7f5601d75640 1 -- 172.21.15.100:0/2597684687 shutdown_connections 2024-09-12T01:22:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.728+0000 7f5601d75640 1 --2- 172.21.15.100:0/2597684687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55fc1037c0 0x7f55fc10a050 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.728+0000 7f5601d75640 1 --2- 172.21.15.100:0/2597684687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55fc102e00 0x7f55fc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.728+0000 7f5601d75640 1 --2- 172.21.15.100:0/2597684687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55fc101c00 0x7f55fc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.728+0000 7f5601d75640 1 -- 172.21.15.100:0/2597684687 >> 172.21.15.100:0/2597684687 conn(0x7f55fc0fd390 msgr2=0x7f55fc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:22:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.728+0000 7f5601d75640 1 -- 172.21.15.100:0/2597684687 shutdown_connections 2024-09-12T01:22:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.728+0000 7f5601d75640 1 -- 172.21.15.100:0/2597684687 wait complete. 2024-09-12T01:22:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f5601d75640 1 Processor -- start 2024-09-12T01:22:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f5601d75640 1 -- start start 2024-09-12T01:22:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f5601d75640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55fc101c00 0x7f55fc197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:22:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f5601d75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55fc102e00 0x7f55fc198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:22:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f5601d75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55fc1037c0 0x7f55fc19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:22:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f5601d75640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc10d880 con 0x7f55fc1037c0 2024-09-12T01:22:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f5601d75640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc10d700 con 0x7f55fc102e00 2024-09-12T01:22:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f5601d75640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc10da00 con 0x7f55fc101c00 2024-09-12T01:22:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f55faffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55fc102e00 0x7f55fc198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:22:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f55faffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55fc102e00 0x7f55fc198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42860/0 (socket says 172.21.15.100:42860) 2024-09-12T01:22:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f55faffd640 1 -- 172.21.15.100:0/3503651420 learned_addr learned my addr 172.21.15.100:0/3503651420 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:22:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f55fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55fc1037c0 0x7f55fc19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:22:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f55fb7fe640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55fc101c00 0x7f55fc197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:22:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f55faffd640 1 -- 172.21.15.100:0/3503651420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55fc101c00 msgr2=0x7f55fc197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f55faffd640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55fc101c00 0x7f55fc197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f55faffd640 1 -- 172.21.15.100:0/3503651420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55fc1037c0 msgr2=0x7f55fc19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f55faffd640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55fc1037c0 0x7f55fc19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f55faffd640 1 -- 172.21.15.100:0/3503651420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc19fb00 con 0x7f55fc102e00 2024-09-12T01:22:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.729+0000 7f55fbfff640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55fc1037c0 0x7f55fc19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:22:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.730+0000 7f55faffd640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55fc102e00 0x7f55fc198410 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f55f000e9f0 tx=0x7f55f000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:22:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.730+0000 7f55f8ff9640 1 -- 172.21.15.100:0/3503651420 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f000cd80 con 0x7f55fc102e00 2024-09-12T01:22:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.730+0000 7f55f8ff9640 1 -- 172.21.15.100:0/3503651420 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55f0010910 con 0x7f55fc102e00 2024-09-12T01:22:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.730+0000 7f5601d75640 1 -- 172.21.15.100:0/3503651420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55fc19fdf0 con 0x7f55fc102e00 2024-09-12T01:22:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.730+0000 7f55f8ff9640 1 -- 172.21.15.100:0/3503651420 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0018990 con 0x7f55fc102e00 2024-09-12T01:22:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.730+0000 7f5601d75640 1 -- 172.21.15.100:0/3503651420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55fc1a02a0 con 0x7f55fc102e00 2024-09-12T01:22:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.731+0000 7f5601d75640 1 -- 172.21.15.100:0/3503651420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55fc109050 con 0x7f55fc102e00 2024-09-12T01:22:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.732+0000 7f55f8ff9640 1 -- 172.21.15.100:0/3503651420 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f55f0010ac0 con 0x7f55fc102e00 2024-09-12T01:22:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.733+0000 7f55f8ff9640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f55e40a2bb0 0x7f55e40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:22:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.733+0000 7f55fb7fe640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f55e40a2bb0 0x7f55e40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:22:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.733+0000 7f55f8ff9640 1 -- 172.21.15.100:0/3503651420 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7f55f00ce390 con 0x7f55fc102e00 2024-09-12T01:22:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.733+0000 7f55fb7fe640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f55e40a2bb0 0x7f55e40a5070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f55ec005fd0 tx=0x7f55ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:22:04.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:22:04.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T01:22:04.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T01:22:04.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:22:04.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:04.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:04.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:04.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:04.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:04.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:04.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:04.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:04.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T01:22:04.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T01:22:04.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:04 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:22:04.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.736+0000 7f55f8ff9640 1 -- 172.21.15.100:0/3503651420 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f55f009bfe0 con 0x7f55fc102e00 2024-09-12T01:22:04.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:22:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T01:22:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T01:22:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:22:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T01:22:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T01:22:04.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:04 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:22:04.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:04.910+0000 7f5601d75640 1 -- 172.21.15.100:0/3503651420 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f55fc062630 con 0x7f55e40a2bb0 2024-09-12T01:22:05.639 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:05 smithi100 ceph-mon[35275]: Detected new or changed devices on smithi081 2024-09-12T01:22:05.639 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:05 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-12T01:22:05.639 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:05 smithi100 ceph-mon[35275]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:22:05.639 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:22:05.639 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:22:05.639 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:22:05.639 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:05.639 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:05 smithi100 ceph-mon[35275]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' 2024-09-12T01:22:05.639 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:05 smithi100 ceph-mon[35275]: osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637] boot 2024-09-12T01:22:05.639 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:05 smithi100 ceph-mon[35275]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T01:22:05.639 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:22:05.738 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:22:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3[51660]: 2024-09-12T01:22:05.308+0000 7f8032cc5640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T01:22:05.738 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:22:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3[51660]: 2024-09-12T01:22:05.315+0000 7f802b2f7640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:22:05.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:05 smithi081 ceph-mon[30920]: Detected new or changed devices on smithi081 2024-09-12T01:22:05.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:05 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-12T01:22:05.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:05 smithi081 ceph-mon[30920]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:22:05.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:22:05.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:22:05.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:22:05.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:05.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:05 smithi081 ceph-mon[30920]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' 2024-09-12T01:22:05.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:05 smithi081 ceph-mon[30920]: osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637] boot 2024-09-12T01:22:05.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:05 smithi081 ceph-mon[30920]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T01:22:05.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:22:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:05 smithi189 ceph-mon[35357]: Detected new or changed devices on smithi081 2024-09-12T01:22:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:05 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-12T01:22:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:05 smithi189 ceph-mon[35357]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:22:05.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:22:05.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:22:05.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:22:05.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:05.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:05 smithi189 ceph-mon[35357]: from='osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637]' entity='osd.3' 2024-09-12T01:22:05.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:05 smithi189 ceph-mon[35357]: osd.3 [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637] boot 2024-09-12T01:22:05.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:05 smithi189 ceph-mon[35357]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T01:22:05.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:22:06.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:06 smithi100 ceph-mon[35275]: purged_snaps scrub starts 2024-09-12T01:22:06.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:06 smithi100 ceph-mon[35275]: purged_snaps scrub ok 2024-09-12T01:22:06.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:06 smithi100 ceph-mon[35275]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:22:06.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:06 smithi100 ceph-mon[35275]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T01:22:06.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:06 smithi081 ceph-mon[30920]: purged_snaps scrub starts 2024-09-12T01:22:06.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:06 smithi081 ceph-mon[30920]: purged_snaps scrub ok 2024-09-12T01:22:06.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:06 smithi081 ceph-mon[30920]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:22:06.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:06 smithi081 ceph-mon[30920]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T01:22:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:06 smithi189 ceph-mon[35357]: purged_snaps scrub starts 2024-09-12T01:22:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:06 smithi189 ceph-mon[35357]: purged_snaps scrub ok 2024-09-12T01:22:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:06 smithi189 ceph-mon[35357]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:22:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:06 smithi189 ceph-mon[35357]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T01:22:07.718 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:07 smithi100 ceph-mon[35275]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:07.718 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:07 smithi100 ceph-mon[35275]: from='client.? 172.21.15.100:0/1092972864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5787415-0905-420e-9ce8-eb6902727561"}]: dispatch 2024-09-12T01:22:07.718 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:07 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5787415-0905-420e-9ce8-eb6902727561"}]: dispatch 2024-09-12T01:22:07.718 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:07 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5787415-0905-420e-9ce8-eb6902727561"}]': finished 2024-09-12T01:22:07.718 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:07 smithi100 ceph-mon[35275]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T01:22:07.718 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:07 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:07.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:07 smithi081 ceph-mon[30920]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:07.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:07 smithi081 ceph-mon[30920]: from='client.? 172.21.15.100:0/1092972864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5787415-0905-420e-9ce8-eb6902727561"}]: dispatch 2024-09-12T01:22:07.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:07 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5787415-0905-420e-9ce8-eb6902727561"}]: dispatch 2024-09-12T01:22:07.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:07 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5787415-0905-420e-9ce8-eb6902727561"}]': finished 2024-09-12T01:22:07.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:07 smithi081 ceph-mon[30920]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T01:22:07.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:07 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:07.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:07 smithi189 ceph-mon[35357]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:07.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:07 smithi189 ceph-mon[35357]: from='client.? 172.21.15.100:0/1092972864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5787415-0905-420e-9ce8-eb6902727561"}]: dispatch 2024-09-12T01:22:07.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:07 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5787415-0905-420e-9ce8-eb6902727561"}]: dispatch 2024-09-12T01:22:07.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:07 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5787415-0905-420e-9ce8-eb6902727561"}]': finished 2024-09-12T01:22:07.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:07 smithi189 ceph-mon[35357]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T01:22:07.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:07 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:08.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:08 smithi081 ceph-mon[30920]: from='client.? 172.21.15.100:0/2336599354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:22:08.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:08 smithi100 ceph-mon[35275]: from='client.? 172.21.15.100:0/2336599354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:22:08.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:08 smithi189 ceph-mon[35357]: from='client.? 172.21.15.100:0/2336599354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:22:09.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:09 smithi081 ceph-mon[30920]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:09.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:09 smithi081 ceph-mon[30920]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T01:22:09.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:09.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:09 smithi100 ceph-mon[35275]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:09.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:09 smithi100 ceph-mon[35275]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T01:22:09.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:09.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:09 smithi189 ceph-mon[35357]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:09.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:09 smithi189 ceph-mon[35357]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T01:22:09.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:10.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:10 smithi100 ceph-mon[35275]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T01:22:10.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:10.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:10 smithi189 ceph-mon[35357]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T01:22:10.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:10.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:10 smithi081 ceph-mon[30920]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T01:22:10.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:11.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:11 smithi100 ceph-mon[35275]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:22:11.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:11 smithi189 ceph-mon[35357]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:22:11.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:11 smithi081 ceph-mon[30920]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 516 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:22:13.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:13 smithi081 ceph-mon[30920]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-12T01:22:13.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:13 smithi100 ceph-mon[35275]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-12T01:22:13.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:13 smithi189 ceph-mon[35357]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-12T01:22:15.689 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:15 smithi100 ceph-mon[35275]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-12T01:22:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:15 smithi189 ceph-mon[35357]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-12T01:22:15.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:15 smithi081 ceph-mon[30920]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-12T01:22:16.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:16 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:22:16.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:16 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:16.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:16 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:22:16.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:16 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:16.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:16 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:22:16.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:16 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:17.596 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:17 smithi100 ceph-mon[35275]: Deploying daemon osd.4 on smithi100 2024-09-12T01:22:17.597 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:17 smithi100 ceph-mon[35275]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:22:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:17 smithi189 ceph-mon[35357]: Deploying daemon osd.4 on smithi100 2024-09-12T01:22:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:17 smithi189 ceph-mon[35357]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:22:17.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:17 smithi081 ceph-mon[30920]: Deploying daemon osd.4 on smithi100 2024-09-12T01:22:17.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:17 smithi081 ceph-mon[30920]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:22:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:19 smithi189 ceph-mon[35357]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:22:19.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:19 smithi081 ceph-mon[30920]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:22:20.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:19 smithi100 ceph-mon[35275]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:22:21.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:21 smithi189 ceph-mon[35357]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T01:22:21.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:21 smithi081 ceph-mon[30920]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T01:22:22.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:21 smithi100 ceph-mon[35275]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T01:22:22.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:22 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:22.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:22 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:22.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:22 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:22.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:22 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:22.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:22 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:22.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:22 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:22.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:22 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:22.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:22 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:22.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:22 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:23.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:23 smithi100 ceph-mon[35275]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:23 smithi189 ceph-mon[35357]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:23.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:23 smithi081 ceph-mon[30920]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:25.337+0000 7f55f8ff9640 1 -- 172.21.15.100:0/3503651420 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f55fc062630 con 0x7f55e40a2bb0 2024-09-12T01:22:25.337 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 4 on host 'smithi100' 2024-09-12T01:22:25.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:25.340+0000 7f5601d75640 1 -- 172.21.15.100:0/3503651420 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f55e40a2bb0 msgr2=0x7f55e40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:25.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:25.340+0000 7f5601d75640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f55e40a2bb0 0x7f55e40a5070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f55ec005fd0 tx=0x7f55ec00b390 comp rx=0 tx=0).stop 2024-09-12T01:22:25.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:25.340+0000 7f5601d75640 1 -- 172.21.15.100:0/3503651420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55fc102e00 msgr2=0x7f55fc198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:25.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:25.340+0000 7f5601d75640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55fc102e00 0x7f55fc198410 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f55f000e9f0 tx=0x7f55f000eeb0 comp rx=0 tx=0).stop 2024-09-12T01:22:25.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:25.340+0000 7f5601d75640 1 -- 172.21.15.100:0/3503651420 shutdown_connections 2024-09-12T01:22:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:25.340+0000 7f5601d75640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f55e40a2bb0 0x7f55e40a5070 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:25.340+0000 7f5601d75640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55fc1037c0 0x7f55fc19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:25.340+0000 7f5601d75640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55fc102e00 0x7f55fc198410 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:25.340+0000 7f5601d75640 1 --2- 172.21.15.100:0/3503651420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55fc101c00 0x7f55fc197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:25.340+0000 7f5601d75640 1 -- 172.21.15.100:0/3503651420 >> 172.21.15.100:0/3503651420 conn(0x7f55fc0fd390 msgr2=0x7f55fc106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:22:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:25.340+0000 7f5601d75640 1 -- 172.21.15.100:0/3503651420 shutdown_connections 2024-09-12T01:22:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:22:25.340+0000 7f5601d75640 1 -- 172.21.15.100:0/3503651420 wait complete. 2024-09-12T01:22:25.625 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:25 smithi100 ceph-mon[35275]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:25.625 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.625 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.625 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:25.625 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:25.625 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.625 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:25.625 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.625 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:25 smithi081 ceph-mon[30920]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:25.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:25.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:25.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:25.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:25 smithi189 ceph-mon[35357]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:25.956 DEBUG:teuthology.orchestra.run.smithi100:osd.4> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T01:22:25.959 INFO:tasks.cephadm:Deploying osd.5 on smithi189 with /dev/vg_nvme/lv_3... 2024-09-12T01:22:25.959 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:22:26.213 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:22:27.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:27 smithi100 ceph-mon[35275]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:27.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:27 smithi189 ceph-mon[35357]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:27.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:27 smithi081 ceph-mon[30920]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:28.269 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:22:27 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4[46251]: 2024-09-12T01:22:27.871+0000 7f8880964640 -1 osd.4 0 log_to_monitors true 2024-09-12T01:22:28.647 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:28 smithi100 ceph-mon[35275]: from='osd.4 [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:22:28.647 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:28 smithi100 ceph-mon[35275]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:22:28.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:28 smithi189 ceph-mon[35357]: from='osd.4 [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:22:28.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:28 smithi189 ceph-mon[35357]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:22:28.697 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:22:28.724 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_3 2024-09-12T01:22:28.737 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:28 smithi081 ceph-mon[30920]: from='osd.4 [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:22:28.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:28 smithi081 ceph-mon[30920]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:22:28.989 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:22:29.573 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.565+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1574976122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb4107900 msgr2=0x7f1fb4109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:29.573 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.565+0000 7f1fba8e9640 1 --2- 172.21.15.189:0/1574976122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb4107900 0x7f1fb4109d50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009ca0 tx=0x7f1fac02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:22:29.573 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.565+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1574976122 shutdown_connections 2024-09-12T01:22:29.573 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.565+0000 7f1fba8e9640 1 --2- 172.21.15.189:0/1574976122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb4107900 0x7f1fb4109d50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:29.573 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.565+0000 7f1fba8e9640 1 --2- 172.21.15.189:0/1574976122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fb4104fd0 0x7f1fb41073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:29.573 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.565+0000 7f1fba8e9640 1 --2- 172.21.15.189:0/1574976122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb41026a0 0x7f1fb4104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:29.573 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.565+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1574976122 >> 172.21.15.189:0/1574976122 conn(0x7f1fb40fc2a0 msgr2=0x7f1fb40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:22:29.573 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.565+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1574976122 shutdown_connections 2024-09-12T01:22:29.573 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.565+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1574976122 wait complete. 2024-09-12T01:22:29.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.566+0000 7f1fba8e9640 1 Processor -- start 2024-09-12T01:22:29.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.566+0000 7f1fba8e9640 1 -- start start 2024-09-12T01:22:29.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.566+0000 7f1fba8e9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb41026a0 0x7f1fb4197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:22:29.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.566+0000 7f1fba8e9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fb4104fd0 0x7f1fb4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:22:29.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.566+0000 7f1fba8e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb4107900 0x7f1fb419f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:22:29.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.566+0000 7f1fba8e9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb410d8a0 con 0x7f1fb4107900 2024-09-12T01:22:29.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.566+0000 7f1fba8e9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb410d720 con 0x7f1fb4104fd0 2024-09-12T01:22:29.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.566+0000 7f1fba8e9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb410da20 con 0x7f1fb41026a0 2024-09-12T01:22:29.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.566+0000 7f1fb3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb41026a0 0x7f1fb4197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:22:29.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.566+0000 7f1fb3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb41026a0 0x7f1fb4197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:52010/0 (socket says 172.21.15.189:52010) 2024-09-12T01:22:29.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.566+0000 7f1fb3fff640 1 -- 172.21.15.189:0/1817797663 learned_addr learned my addr 172.21.15.189:0/1817797663 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:22:29.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.566+0000 7f1fb37fe640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fb4104fd0 0x7f1fb4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:22:29.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.567+0000 7f1fb8e86640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb4107900 0x7f1fb419f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:22:29.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.567+0000 7f1fb3fff640 1 -- 172.21.15.189:0/1817797663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fb4104fd0 msgr2=0x7f1fb4198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:29.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.567+0000 7f1fb3fff640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fb4104fd0 0x7f1fb4198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:29.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.567+0000 7f1fb3fff640 1 -- 172.21.15.189:0/1817797663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb4107900 msgr2=0x7f1fb419f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:29.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.567+0000 7f1fb3fff640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb4107900 0x7f1fb419f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:29.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.567+0000 7f1fb3fff640 1 -- 172.21.15.189:0/1817797663 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb419fb00 con 0x7f1fb41026a0 2024-09-12T01:22:29.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.567+0000 7f1fb8e86640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb4107900 0x7f1fb419f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:22:29.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.567+0000 7f1fb3fff640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb41026a0 0x7f1fb4197ed0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400d950 tx=0x7f1fa400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:22:29.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.567+0000 7f1fb17fa640 1 -- 172.21.15.189:0/1817797663 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4017070 con 0x7f1fb41026a0 2024-09-12T01:22:29.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.567+0000 7f1fb17fa640 1 -- 172.21.15.189:0/1817797663 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fa4009c30 con 0x7f1fb41026a0 2024-09-12T01:22:29.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.567+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1817797663 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb419fdf0 con 0x7f1fb41026a0 2024-09-12T01:22:29.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.567+0000 7f1fb17fa640 1 -- 172.21.15.189:0/1817797663 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa400f6b0 con 0x7f1fb41026a0 2024-09-12T01:22:29.576 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.567+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1817797663 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb41a0250 con 0x7f1fb41026a0 2024-09-12T01:22:29.576 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.568+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1817797663 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb40fdd90 con 0x7f1fb41026a0 2024-09-12T01:22:29.576 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.569+0000 7f1fb17fa640 1 -- 172.21.15.189:0/1817797663 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1fa40109d0 con 0x7f1fb41026a0 2024-09-12T01:22:29.576 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.570+0000 7f1fb17fa640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1f9c0a2bb0 0x7f1f9c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:22:29.576 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.570+0000 7f1fb17fa640 1 -- 172.21.15.189:0/1817797663 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7f1fa40cdb70 con 0x7f1fb41026a0 2024-09-12T01:22:29.576 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.570+0000 7f1fb37fe640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1f9c0a2bb0 0x7f1f9c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:22:29.576 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.570+0000 7f1fb37fe640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1f9c0a2bb0 0x7f1f9c0a5070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1fb41993f0 tx=0x7f1fa800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:22:29.576 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.574+0000 7f1fb17fa640 1 -- 172.21.15.189:0/1817797663 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1fa4009de0 con 0x7f1fb41026a0 2024-09-12T01:22:29.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:29.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:22:29.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:22:29.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: from='osd.4 [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:22:29.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:29.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:22:29.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:29.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:29.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:29.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:29.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:29.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:29.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:29.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:29 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:29.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:29.747+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1817797663 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1fb4062630 con 0x7f1f9c0a2bb0 2024-09-12T01:22:29.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:29.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:22:29.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:22:29.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: from='osd.4 [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:22:29.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:29.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:22:29.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:29.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:29.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:29.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:29.748 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:29.748 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:29.748 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:29.748 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:29 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:29.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:22:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:22:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: from='osd.4 [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:22:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:22:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:29.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:29 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:30.518 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:22:30 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4[46251]: 2024-09-12T01:22:30.187+0000 7f887c0c4640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T01:22:30.518 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:22:30 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4[46251]: 2024-09-12T01:22:30.193+0000 7f88746f6640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:22:30.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:30 smithi100 ceph-mon[35275]: Detected new or changed devices on smithi100 2024-09-12T01:22:30.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:30 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-12T01:22:30.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:30 smithi100 ceph-mon[35275]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:22:30.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:30 smithi100 ceph-mon[35275]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T01:22:30.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:30 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:30.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:30 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:30.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:30 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:22:30.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:30 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:22:30.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:30 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:30.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:30 smithi100 ceph-mon[35275]: from='osd.4 ' entity='osd.4' 2024-09-12T01:22:30.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:30 smithi081 ceph-mon[30920]: Detected new or changed devices on smithi100 2024-09-12T01:22:30.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:30 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-12T01:22:30.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:30 smithi081 ceph-mon[30920]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:22:30.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:30 smithi081 ceph-mon[30920]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T01:22:30.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:30 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:30.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:30 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:30.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:30 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:22:30.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:30 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:22:30.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:30 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:30.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:30 smithi081 ceph-mon[30920]: from='osd.4 ' entity='osd.4' 2024-09-12T01:22:30.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:30 smithi189 ceph-mon[35357]: Detected new or changed devices on smithi100 2024-09-12T01:22:30.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:30 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-12T01:22:30.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:30 smithi189 ceph-mon[35357]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:22:30.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:30 smithi189 ceph-mon[35357]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T01:22:30.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:30 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:30.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:30 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:30.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:30 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:22:30.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:30 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:22:30.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:30 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:30.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:30 smithi189 ceph-mon[35357]: from='osd.4 ' entity='osd.4' 2024-09-12T01:22:31.722 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:31 smithi189 ceph-mon[35357]: purged_snaps scrub starts 2024-09-12T01:22:31.722 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:31 smithi189 ceph-mon[35357]: purged_snaps scrub ok 2024-09-12T01:22:31.722 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:31 smithi189 ceph-mon[35357]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:22:31.722 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:31 smithi189 ceph-mon[35357]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:31.722 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:31 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:31.722 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:31 smithi189 ceph-mon[35357]: osd.4 [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282] boot 2024-09-12T01:22:31.722 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:31 smithi189 ceph-mon[35357]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T01:22:31.723 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:31 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:31.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:31 smithi081 ceph-mon[30920]: purged_snaps scrub starts 2024-09-12T01:22:31.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:31 smithi081 ceph-mon[30920]: purged_snaps scrub ok 2024-09-12T01:22:31.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:31 smithi081 ceph-mon[30920]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:22:31.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:31 smithi081 ceph-mon[30920]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:31.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:31 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:31.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:31 smithi081 ceph-mon[30920]: osd.4 [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282] boot 2024-09-12T01:22:31.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:31 smithi081 ceph-mon[30920]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T01:22:31.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:31 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:31.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:31 smithi100 ceph-mon[35275]: purged_snaps scrub starts 2024-09-12T01:22:31.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:31 smithi100 ceph-mon[35275]: purged_snaps scrub ok 2024-09-12T01:22:31.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:31 smithi100 ceph-mon[35275]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:22:31.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:31 smithi100 ceph-mon[35275]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:22:31.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:31 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:31.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:31 smithi100 ceph-mon[35275]: osd.4 [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282] boot 2024-09-12T01:22:31.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:31 smithi100 ceph-mon[35275]: osdmap e31: 5 total, 5 up, 5 in 2024-09-12T01:22:31.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:31 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:22:32.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:32 smithi189 ceph-mon[35357]: from='client.? 172.21.15.189:0/791538499' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "879548b5-5516-407c-8517-bbdbf356c0e5"}]: dispatch 2024-09-12T01:22:32.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:32 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "879548b5-5516-407c-8517-bbdbf356c0e5"}]: dispatch 2024-09-12T01:22:32.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:32 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "879548b5-5516-407c-8517-bbdbf356c0e5"}]': finished 2024-09-12T01:22:32.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:32 smithi189 ceph-mon[35357]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T01:22:32.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:32 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:32.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:32 smithi081 ceph-mon[30920]: from='client.? 172.21.15.189:0/791538499' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "879548b5-5516-407c-8517-bbdbf356c0e5"}]: dispatch 2024-09-12T01:22:32.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:32 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "879548b5-5516-407c-8517-bbdbf356c0e5"}]: dispatch 2024-09-12T01:22:32.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:32 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "879548b5-5516-407c-8517-bbdbf356c0e5"}]': finished 2024-09-12T01:22:32.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:32 smithi081 ceph-mon[30920]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T01:22:32.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:32 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:32.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:32 smithi100 ceph-mon[35275]: from='client.? 172.21.15.189:0/791538499' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "879548b5-5516-407c-8517-bbdbf356c0e5"}]: dispatch 2024-09-12T01:22:32.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:32 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "879548b5-5516-407c-8517-bbdbf356c0e5"}]: dispatch 2024-09-12T01:22:32.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:32 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "879548b5-5516-407c-8517-bbdbf356c0e5"}]': finished 2024-09-12T01:22:32.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:32 smithi100 ceph-mon[35275]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T01:22:32.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:32 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:33.689 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:33 smithi100 ceph-mon[35275]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:33.693 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:33 smithi100 ceph-mon[35275]: from='client.? 172.21.15.189:0/835129047' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:22:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:33 smithi081 ceph-mon[30920]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:33 smithi081 ceph-mon[30920]: from='client.? 172.21.15.189:0/835129047' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:22:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:33 smithi189 ceph-mon[35357]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:33 smithi189 ceph-mon[35357]: from='client.? 172.21.15.189:0/835129047' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:22:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:35 smithi081 ceph-mon[30920]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:35 smithi100 ceph-mon[35275]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:35.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:35 smithi189 ceph-mon[35357]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:37 smithi081 ceph-mon[30920]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:37 smithi100 ceph-mon[35275]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:37.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:37 smithi189 ceph-mon[35357]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:39.527 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:39 smithi189 ceph-mon[35357]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:39 smithi081 ceph-mon[30920]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:39.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:39 smithi100 ceph-mon[35275]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:41.495 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:41 smithi189 ceph-mon[35357]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:41.495 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:41 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:22:41.495 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:41 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:41.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:41 smithi081 ceph-mon[30920]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:41.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:22:41.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:41.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:41 smithi100 ceph-mon[35275]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:41.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:41 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:22:41.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:41 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:42 smithi189 ceph-mon[35357]: Deploying daemon osd.5 on smithi189 2024-09-12T01:22:42.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:42 smithi081 ceph-mon[30920]: Deploying daemon osd.5 on smithi189 2024-09-12T01:22:42.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:42 smithi100 ceph-mon[35275]: Deploying daemon osd.5 on smithi189 2024-09-12T01:22:43.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:43 smithi081 ceph-mon[30920]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:43.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:43 smithi100 ceph-mon[35275]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:43.772 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:43 smithi189 ceph-mon[35357]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:45.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:45 smithi081 ceph-mon[30920]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:45.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:45 smithi100 ceph-mon[35275]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:45.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:45 smithi189 ceph-mon[35357]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:47.735 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:47 smithi189 ceph-mon[35357]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:47.736 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:47 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:47.736 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:47 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:47.736 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:47 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:47.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:47 smithi081 ceph-mon[30920]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:47.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:47.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:47.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:47.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:47 smithi100 ceph-mon[35275]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:47.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:47 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:47.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:47 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:47.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:47 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:49.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:49 smithi189 ceph-mon[35357]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:49.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:49 smithi081 ceph-mon[30920]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:49.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:49 smithi100 ceph-mon[35275]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:50.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:50 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:50.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:50 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:50.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:50 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:50.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:50 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:50.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:50 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:50.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:50 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:50.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:50 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:50.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:50 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:50.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:50 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:50.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:50 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:50.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:50 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:50.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:50 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:50.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:50 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:50.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:50 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:50.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:50 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:51.106 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 5 on host 'smithi189' 2024-09-12T01:22:51.107 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:51.107+0000 7f1fb17fa640 1 -- 172.21.15.189:0/1817797663 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1fb4062630 con 0x7f1f9c0a2bb0 2024-09-12T01:22:51.109 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:51.109+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1817797663 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1f9c0a2bb0 msgr2=0x7f1f9c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:51.109 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:51.109+0000 7f1fba8e9640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1f9c0a2bb0 0x7f1f9c0a5070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1fb41993f0 tx=0x7f1fa800b390 comp rx=0 tx=0).stop 2024-09-12T01:22:51.109 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:51.109+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1817797663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb41026a0 msgr2=0x7f1fb4197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:51.109 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:51.109+0000 7f1fba8e9640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb41026a0 0x7f1fb4197ed0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400d950 tx=0x7f1fa400de10 comp rx=0 tx=0).stop 2024-09-12T01:22:51.109 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:51.109+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1817797663 shutdown_connections 2024-09-12T01:22:51.109 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:51.109+0000 7f1fba8e9640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1f9c0a2bb0 0x7f1f9c0a5070 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:51.109 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:51.109+0000 7f1fba8e9640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fb4107900 0x7f1fb419f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:51.109 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:51.109+0000 7f1fba8e9640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fb4104fd0 0x7f1fb4198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:51.109 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:51.109+0000 7f1fba8e9640 1 --2- 172.21.15.189:0/1817797663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fb41026a0 0x7f1fb4197ed0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:51.109 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:51.109+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1817797663 >> 172.21.15.189:0/1817797663 conn(0x7f1fb40fc2a0 msgr2=0x7f1fb4102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:22:51.110 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:51.110+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1817797663 shutdown_connections 2024-09-12T01:22:51.110 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:22:51.110+0000 7f1fba8e9640 1 -- 172.21.15.189:0/1817797663 wait complete. 2024-09-12T01:22:51.703 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:51 smithi189 ceph-mon[35357]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:51.703 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:51 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:51.704 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:51 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:51.704 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:51 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:51.730 DEBUG:teuthology.orchestra.run.smithi189:osd.5> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T01:22:51.733 INFO:tasks.cephadm:Deploying osd.6 on smithi081 with /dev/vg_nvme/lv_2... 2024-09-12T01:22:51.733 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:22:51.985 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:22:51.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:51 smithi081 ceph-mon[30920]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:51.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:51.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:51.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:52.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:51 smithi100 ceph-mon[35275]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:52.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:51 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:22:52.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:51 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:52.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:51 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:53.525 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:22:53 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:22:53.260+0000 7f5d03973640 -1 osd.5 0 log_to_monitors true 2024-09-12T01:22:53.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:53 smithi081 ceph-mon[30920]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:53.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:53 smithi081 ceph-mon[30920]: from='osd.5 [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:22:53.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:53 smithi081 ceph-mon[30920]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:22:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:53 smithi189 ceph-mon[35357]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:53 smithi189 ceph-mon[35357]: from='osd.5 [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:22:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:53 smithi189 ceph-mon[35357]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:22:54.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:53 smithi100 ceph-mon[35275]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:54.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:53 smithi100 ceph-mon[35275]: from='osd.5 [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:22:54.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:53 smithi100 ceph-mon[35275]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:22:54.359 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:22:54.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_2 2024-09-12T01:22:54.609 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:22:54 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:22:54.546+0000 7f5cff0d3640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T01:22:54.609 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:22:54 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:22:54.553+0000 7f5cfb70d640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:22:54.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:54 smithi189 ceph-mon[35357]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:22:54.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:54 smithi189 ceph-mon[35357]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T01:22:54.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:54 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:54.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:54 smithi189 ceph-mon[35357]: from='osd.5 [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:22:54.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:54 smithi189 ceph-mon[35357]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:22:54.650 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:22:54.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:54 smithi081 ceph-mon[30920]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:22:54.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:54 smithi081 ceph-mon[30920]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T01:22:54.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:54 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:54.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:54 smithi081 ceph-mon[30920]: from='osd.5 [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:22:54.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:54 smithi081 ceph-mon[30920]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:22:55.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:54 smithi100 ceph-mon[35275]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:22:55.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:54 smithi100 ceph-mon[35275]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T01:22:55.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:54 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:55.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:54 smithi100 ceph-mon[35275]: from='osd.5 [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:22:55.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:54 smithi100 ceph-mon[35275]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:22:55.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.145+0000 7f47d5a53640 1 -- 172.21.15.81:0/3563919834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0101d10 msgr2=0x7f47d0102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.145+0000 7f47d5a53640 1 --2- 172.21.15.81:0/3563919834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0101d10 0x7f47d0102190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009900 tx=0x7f47c402a410 comp rx=0 tx=0).stop 2024-09-12T01:22:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.145+0000 7f47d5a53640 1 -- 172.21.15.81:0/3563919834 shutdown_connections 2024-09-12T01:22:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.145+0000 7f47d5a53640 1 --2- 172.21.15.81:0/3563919834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47d01026d0 0x7f47d0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.145+0000 7f47d5a53640 1 --2- 172.21.15.81:0/3563919834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0101d10 0x7f47d0102190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.145+0000 7f47d5a53640 1 --2- 172.21.15.81:0/3563919834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47d0100b10 0x7f47d0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.145+0000 7f47d5a53640 1 -- 172.21.15.81:0/3563919834 >> 172.21.15.81:0/3563919834 conn(0x7f47d00fc2a0 msgr2=0x7f47d00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:22:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.145+0000 7f47d5a53640 1 -- 172.21.15.81:0/3563919834 shutdown_connections 2024-09-12T01:22:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.145+0000 7f47d5a53640 1 -- 172.21.15.81:0/3563919834 wait complete. 2024-09-12T01:22:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.146+0000 7f47d5a53640 1 Processor -- start 2024-09-12T01:22:55.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.146+0000 7f47d5a53640 1 -- start start 2024-09-12T01:22:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.146+0000 7f47d5a53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0100b10 0x7f47d0104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:22:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.146+0000 7f47d5a53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47d0101d10 0x7f47d01030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:22:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.146+0000 7f47d5a53640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47d01026d0 0x7f47d0103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:22:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.146+0000 7f47d5a53640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f47d010c790 con 0x7f47d0100b10 2024-09-12T01:22:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.146+0000 7f47d5a53640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f47d010c610 con 0x7f47d0101d10 2024-09-12T01:22:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.146+0000 7f47d5a53640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47d010c910 con 0x7f47d01026d0 2024-09-12T01:22:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.146+0000 7f47ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0100b10 0x7f47d0104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:22:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.146+0000 7f47ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0100b10 0x7f47d0104aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40772/0 (socket says 172.21.15.81:40772) 2024-09-12T01:22:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.146+0000 7f47ceffd640 1 -- 172.21.15.81:0/338447894 learned_addr learned my addr 172.21.15.81:0/338447894 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:22:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.147+0000 7f47ce7fc640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47d0101d10 0x7f47d01030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:22:55.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.147+0000 7f47cf7fe640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47d01026d0 0x7f47d0103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.147+0000 7f47ceffd640 1 -- 172.21.15.81:0/338447894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47d01026d0 msgr2=0x7f47d0103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.147+0000 7f47ceffd640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47d01026d0 0x7f47d0103630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.147+0000 7f47ceffd640 1 -- 172.21.15.81:0/338447894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47d0101d10 msgr2=0x7f47d01030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.147+0000 7f47ceffd640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47d0101d10 0x7f47d01030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.147+0000 7f47ceffd640 1 -- 172.21.15.81:0/338447894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d0103ef0 con 0x7f47d0100b10 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.147+0000 7f47ceffd640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0100b10 0x7f47d0104aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47c000d950 tx=0x7f47c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.147+0000 7f47d4a51640 1 -- 172.21.15.81:0/338447894 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0017070 con 0x7f47d0100b10 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.147+0000 7f47d4a51640 1 -- 172.21.15.81:0/338447894 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47c0009c30 con 0x7f47d0100b10 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.147+0000 7f47d5a53640 1 -- 172.21.15.81:0/338447894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d01a2100 con 0x7f47d0100b10 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.147+0000 7f47d4a51640 1 -- 172.21.15.81:0/338447894 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c000f600 con 0x7f47d0100b10 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.147+0000 7f47d5a53640 1 -- 172.21.15.81:0/338447894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d01a25c0 con 0x7f47d0100b10 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.148+0000 7f47d5a53640 1 -- 172.21.15.81:0/338447894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d01a27f0 con 0x7f47d0100b10 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.149+0000 7f47d4a51640 1 -- 172.21.15.81:0/338447894 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f47c001a070 con 0x7f47d0100b10 2024-09-12T01:22:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.150+0000 7f47d4a51640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f47b80a2b80 0x7f47b80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:22:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.150+0000 7f47ce7fc640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f47b80a2b80 0x7f47b80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:22:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.150+0000 7f47d4a51640 1 -- 172.21.15.81:0/338447894 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4253+0+0 (secure 0 0 0) 0x7f47c00cda80 con 0x7f47d0100b10 2024-09-12T01:22:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.151+0000 7f47ce7fc640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f47b80a2b80 0x7f47b80a5040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f47c40314e0 tx=0x7f47c4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:22:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.154+0000 7f47d4a51640 1 -- 172.21.15.81:0/338447894 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47c0009de0 con 0x7f47d0100b10 2024-09-12T01:22:55.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:22:55.333+0000 7f47d5a53640 1 -- 172.21.15.81:0/338447894 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f47d006af50 con 0x7f47b80a2b80 2024-09-12T01:22:55.728 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:55.728 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T01:22:55.728 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T01:22:55.728 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:55.728 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:55.728 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:55.728 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:55.728 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:55.728 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:55.728 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:55.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:55.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:55.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:55.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:22:55.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:22:55.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:55.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: osd.5 [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396] boot 2024-09-12T01:22:55.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T01:22:55.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:56.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:56.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T01:22:56.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T01:22:56.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:56.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:56.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:56.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:56.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:56.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:56.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:56.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:56.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:56.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:56.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:22:56.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:22:56.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:56.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: osd.5 [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396] boot 2024-09-12T01:22:56.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T01:22:56.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:22:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T01:22:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T01:22:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:22:56.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:56.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:56.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:22:56.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:22:56.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:22:56.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:22:56.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:22:56.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: osd.5 [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396] boot 2024-09-12T01:22:56.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T01:22:56.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:22:56.829 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:56 smithi081 ceph-mon[30920]: purged_snaps scrub starts 2024-09-12T01:22:56.829 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:56 smithi081 ceph-mon[30920]: purged_snaps scrub ok 2024-09-12T01:22:56.829 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:56 smithi081 ceph-mon[30920]: Detected new or changed devices on smithi189 2024-09-12T01:22:56.830 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:56 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-12T01:22:56.830 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:56 smithi081 ceph-mon[30920]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:22:56.830 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:56 smithi081 ceph-mon[30920]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T01:22:57.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:56 smithi100 ceph-mon[35275]: purged_snaps scrub starts 2024-09-12T01:22:57.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:56 smithi100 ceph-mon[35275]: purged_snaps scrub ok 2024-09-12T01:22:57.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:56 smithi100 ceph-mon[35275]: Detected new or changed devices on smithi189 2024-09-12T01:22:57.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:56 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-12T01:22:57.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:56 smithi100 ceph-mon[35275]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:22:57.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:56 smithi100 ceph-mon[35275]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T01:22:57.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:56 smithi189 ceph-mon[35357]: purged_snaps scrub starts 2024-09-12T01:22:57.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:56 smithi189 ceph-mon[35357]: purged_snaps scrub ok 2024-09-12T01:22:57.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:56 smithi189 ceph-mon[35357]: Detected new or changed devices on smithi189 2024-09-12T01:22:57.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:56 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-12T01:22:57.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:56 smithi189 ceph-mon[35357]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:22:57.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:56 smithi189 ceph-mon[35357]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T01:22:57.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:57 smithi081 ceph-mon[30920]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:22:58.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:57 smithi100 ceph-mon[35275]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:22:58.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:57 smithi189 ceph-mon[35357]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:22:58.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:58 smithi081 ceph-mon[30920]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T01:22:58.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:58 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/60028463' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b665b97c-a9d3-475f-93f3-8a920cbb37d3"}]: dispatch 2024-09-12T01:22:58.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:58 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/60028463' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b665b97c-a9d3-475f-93f3-8a920cbb37d3"}]': finished 2024-09-12T01:22:58.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:58 smithi081 ceph-mon[30920]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T01:22:58.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:58 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:22:58.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:58 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3185037391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:22:59.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:58 smithi100 ceph-mon[35275]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T01:22:59.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:58 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/60028463' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b665b97c-a9d3-475f-93f3-8a920cbb37d3"}]: dispatch 2024-09-12T01:22:59.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:58 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/60028463' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b665b97c-a9d3-475f-93f3-8a920cbb37d3"}]': finished 2024-09-12T01:22:59.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:58 smithi100 ceph-mon[35275]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T01:22:59.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:58 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:22:59.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:58 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3185037391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:22:59.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:58 smithi189 ceph-mon[35357]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T01:22:59.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:58 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/60028463' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b665b97c-a9d3-475f-93f3-8a920cbb37d3"}]: dispatch 2024-09-12T01:22:59.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:58 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/60028463' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b665b97c-a9d3-475f-93f3-8a920cbb37d3"}]': finished 2024-09-12T01:22:59.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:58 smithi189 ceph-mon[35357]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T01:22:59.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:58 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:22:59.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:58 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3185037391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:22:59.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:59 smithi081 ceph-mon[30920]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:22:59.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:59 smithi081 ceph-mon[30920]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T01:22:59.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:22:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:00.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:59 smithi100 ceph-mon[35275]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:00.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:59 smithi100 ceph-mon[35275]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T01:23:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:22:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:59 smithi189 ceph-mon[35357]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:59 smithi189 ceph-mon[35357]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T01:23:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:22:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:00.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:00 smithi081 ceph-mon[30920]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:23:01.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:00 smithi100 ceph-mon[35275]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:23:01.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:00 smithi189 ceph-mon[35357]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:23:03.722 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:03 smithi100 ceph-mon[35275]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-12T01:23:03.736 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:03 smithi189 ceph-mon[35357]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-12T01:23:03.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:03 smithi081 ceph-mon[30920]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-12T01:23:05.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:05 smithi081 ceph-mon[30920]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T01:23:05.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:05 smithi100 ceph-mon[35275]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T01:23:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:05 smithi189 ceph-mon[35357]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T01:23:06.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:06 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T01:23:06.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:06 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:06.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:06 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T01:23:06.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:06 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:06.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:06 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T01:23:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:06 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:07.685 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:07 smithi081 ceph-mon[30920]: Deploying daemon osd.6 on smithi081 2024-09-12T01:23:07.685 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:07 smithi081 ceph-mon[30920]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-12T01:23:07.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:07 smithi100 ceph-mon[35275]: Deploying daemon osd.6 on smithi081 2024-09-12T01:23:07.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:07 smithi100 ceph-mon[35275]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-12T01:23:07.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:07 smithi189 ceph-mon[35357]: Deploying daemon osd.6 on smithi081 2024-09-12T01:23:07.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:07 smithi189 ceph-mon[35357]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-12T01:23:09.631 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:09 smithi081 ceph-mon[30920]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:23:09.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:09 smithi100 ceph-mon[35275]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:23:09.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:09 smithi189 ceph-mon[35357]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:23:11.586 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:11 smithi081 ceph-mon[30920]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T01:23:11.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:11 smithi100 ceph-mon[35275]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T01:23:11.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:11 smithi189 ceph-mon[35357]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T01:23:12.518 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:12 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:23:12.518 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:12 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:12.518 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:12 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:12.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:12 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:23:12.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:12 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:12.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:12 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:12 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:23:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:12 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:12 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:13.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:13 smithi081 ceph-mon[30920]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:13.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:13 smithi100 ceph-mon[35275]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:13 smithi189 ceph-mon[35357]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:15.505 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 6 on host 'smithi081' 2024-09-12T01:23:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:23:15.505+0000 7f47d4a51640 1 -- 172.21.15.81:0/338447894 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f47d006af50 con 0x7f47b80a2b80 2024-09-12T01:23:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:23:15.507+0000 7f47d5a53640 1 -- 172.21.15.81:0/338447894 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f47b80a2b80 msgr2=0x7f47b80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:23:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:23:15.507+0000 7f47d5a53640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f47b80a2b80 0x7f47b80a5040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f47c40314e0 tx=0x7f47c4000bc0 comp rx=0 tx=0).stop 2024-09-12T01:23:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:23:15.507+0000 7f47d5a53640 1 -- 172.21.15.81:0/338447894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0100b10 msgr2=0x7f47d0104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:23:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:23:15.507+0000 7f47d5a53640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0100b10 0x7f47d0104aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47c000d950 tx=0x7f47c000de10 comp rx=0 tx=0).stop 2024-09-12T01:23:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:23:15.508+0000 7f47d5a53640 1 -- 172.21.15.81:0/338447894 shutdown_connections 2024-09-12T01:23:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:23:15.508+0000 7f47d5a53640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f47b80a2b80 0x7f47b80a5040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:23:15.508+0000 7f47d5a53640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47d01026d0 0x7f47d0103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:23:15.508+0000 7f47d5a53640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47d0101d10 0x7f47d01030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:23:15.508+0000 7f47d5a53640 1 --2- 172.21.15.81:0/338447894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0100b10 0x7f47d0104aa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:23:15.508+0000 7f47d5a53640 1 -- 172.21.15.81:0/338447894 >> 172.21.15.81:0/338447894 conn(0x7f47d00fc2a0 msgr2=0x7f47d006a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:23:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:23:15.508+0000 7f47d5a53640 1 -- 172.21.15.81:0/338447894 shutdown_connections 2024-09-12T01:23:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:23:15.508+0000 7f47d5a53640 1 -- 172.21.15.81:0/338447894 wait complete. 2024-09-12T01:23:15.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:15 smithi081 ceph-mon[30920]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:15.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:15 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:15.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:15 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:15.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:15 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:15.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:15 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:23:15.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:15 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:15.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:15 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:23:15.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:15 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:15.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:15 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:16.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:15 smithi100 ceph-mon[35275]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:16.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:15 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:15 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:15 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:15 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:23:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:15 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:15 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:23:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:15 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:15 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:16.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:15 smithi189 ceph-mon[35357]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:16.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:15 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:16.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:15 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:16.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:15 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:16.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:15 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:23:16.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:15 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:16.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:15 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:23:16.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:15 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:16.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:15 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:16.125 DEBUG:teuthology.orchestra.run.smithi081:osd.6> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T01:23:16.128 INFO:tasks.cephadm:Deploying osd.7 on smithi100 with /dev/vg_nvme/lv_2... 2024-09-12T01:23:16.128 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:23:16.379 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:23:17.733 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:17 smithi081 ceph-mon[30920]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:17.733 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:17 smithi081 ceph-mon[30920]: from='osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:23:17.734 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:23:17 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:23:17.421+0000 7f10eb4fb640 -1 osd.6 0 log_to_monitors true 2024-09-12T01:23:17.813 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:17 smithi100 ceph-mon[35275]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:17.814 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:17 smithi100 ceph-mon[35275]: from='osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:23:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:17 smithi189 ceph-mon[35357]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:17 smithi189 ceph-mon[35357]: from='osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:23:18.874 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:18 smithi100 ceph-mon[35275]: from='osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T01:23:18.875 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:18 smithi100 ceph-mon[35275]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T01:23:18.875 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:18 smithi100 ceph-mon[35275]: from='osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T01:23:18.875 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:18 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:18.875 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:18 smithi100 ceph-mon[35275]: from='osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T01:23:18.875 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:18 smithi100 ceph-mon[35275]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T01:23:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:23:18.896 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:23:18 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:23:18.547+0000 7f10e6c5b640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T01:23:18.896 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:23:18 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:23:18.557+0000 7f10e3295640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:23:18.896 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:18 smithi081 ceph-mon[30920]: from='osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T01:23:18.896 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:18 smithi081 ceph-mon[30920]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T01:23:18.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:18 smithi081 ceph-mon[30920]: from='osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T01:23:18.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:18 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:18.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:18 smithi081 ceph-mon[30920]: from='osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T01:23:18.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:18 smithi081 ceph-mon[30920]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T01:23:18.902 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_2 2024-09-12T01:23:19.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:18 smithi189 ceph-mon[35357]: from='osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T01:23:19.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:18 smithi189 ceph-mon[35357]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T01:23:19.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:18 smithi189 ceph-mon[35357]: from='osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T01:23:19.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:18 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:19.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:18 smithi189 ceph-mon[35357]: from='osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T01:23:19.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:18 smithi189 ceph-mon[35357]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T01:23:19.153 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:23:19.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.597+0000 7f29e0141640 1 -- 172.21.15.100:0/1054997258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d8102690 msgr2=0x7f29d8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:23:19.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.597+0000 7f29e0141640 1 --2- 172.21.15.100:0/1054997258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d8102690 0x7f29d8108f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009ca0 tx=0x7f29d002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:23:19.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.597+0000 7f29e0141640 1 -- 172.21.15.100:0/1054997258 shutdown_connections 2024-09-12T01:23:19.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.597+0000 7f29e0141640 1 --2- 172.21.15.100:0/1054997258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d8102690 0x7f29d8108f20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:19.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.597+0000 7f29e0141640 1 --2- 172.21.15.100:0/1054997258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29d8101cd0 0x7f29d8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:19.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.597+0000 7f29e0141640 1 --2- 172.21.15.100:0/1054997258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d8100ad0 0x7f29d8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:19.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.597+0000 7f29e0141640 1 -- 172.21.15.100:0/1054997258 >> 172.21.15.100:0/1054997258 conn(0x7f29d80fc280 msgr2=0x7f29d80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:23:19.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.597+0000 7f29e0141640 1 -- 172.21.15.100:0/1054997258 shutdown_connections 2024-09-12T01:23:19.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.597+0000 7f29e0141640 1 -- 172.21.15.100:0/1054997258 wait complete. 2024-09-12T01:23:19.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.597+0000 7f29e0141640 1 Processor -- start 2024-09-12T01:23:19.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.597+0000 7f29e0141640 1 -- start start 2024-09-12T01:23:19.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29e0141640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d8100ad0 0x7f29d806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:23:19.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29e0141640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29d8101cd0 0x7f29d819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:23:19.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29e0141640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d8102690 0x7f29d819f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:23:19.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29e0141640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29d810c7d0 con 0x7f29d8101cd0 2024-09-12T01:23:19.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29e0141640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f29d810c650 con 0x7f29d8102690 2024-09-12T01:23:19.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29e0141640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f29d810c950 con 0x7f29d8100ad0 2024-09-12T01:23:19.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29de6de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d8102690 0x7f29d819f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:23:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29de6de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d8102690 0x7f29d819f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42588/0 (socket says 172.21.15.100:42588) 2024-09-12T01:23:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29de6de640 1 -- 172.21.15.100:0/3151415270 learned_addr learned my addr 172.21.15.100:0/3151415270 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:23:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29dd6dc640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29d8101cd0 0x7f29d819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:23:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29ddedd640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d8100ad0 0x7f29d806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:23:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29de6de640 1 -- 172.21.15.100:0/3151415270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d8100ad0 msgr2=0x7f29d806aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:23:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29de6de640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d8100ad0 0x7f29d806aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29de6de640 1 -- 172.21.15.100:0/3151415270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29d8101cd0 msgr2=0x7f29d819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:23:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29de6de640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29d8101cd0 0x7f29d819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29de6de640 1 -- 172.21.15.100:0/3151415270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d819fbb0 con 0x7f29d8102690 2024-09-12T01:23:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29ddedd640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d8100ad0 0x7f29d806aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:23:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29de6de640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d8102690 0x7f29d819f2a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f29d0005e30 tx=0x7f29d0031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:23:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29ceffd640 1 -- 172.21.15.100:0/3151415270 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0003c30 con 0x7f29d8102690 2024-09-12T01:23:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29ceffd640 1 -- 172.21.15.100:0/3151415270 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29d0003dd0 con 0x7f29d8102690 2024-09-12T01:23:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29ceffd640 1 -- 172.21.15.100:0/3151415270 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d002fde0 con 0x7f29d8102690 2024-09-12T01:23:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29e0141640 1 -- 172.21.15.100:0/3151415270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d819fde0 con 0x7f29d8102690 2024-09-12T01:23:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.598+0000 7f29e0141640 1 -- 172.21.15.100:0/3151415270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d81a0340 con 0x7f29d8102690 2024-09-12T01:23:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.599+0000 7f29e0141640 1 -- 172.21.15.100:0/3151415270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d8107e70 con 0x7f29d8102690 2024-09-12T01:23:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.600+0000 7f29ceffd640 1 -- 172.21.15.100:0/3151415270 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f29d0004050 con 0x7f29d8102690 2024-09-12T01:23:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.601+0000 7f29ceffd640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f29c40a2c00 0x7f29c40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:23:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.601+0000 7f29ceffd640 1 -- 172.21.15.100:0/3151415270 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4965+0+0 (secure 0 0 0) 0x7f29d00ef5b0 con 0x7f29d8102690 2024-09-12T01:23:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.601+0000 7f29ddedd640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f29c40a2c00 0x7f29c40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:23:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.602+0000 7f29ddedd640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f29c40a2c00 0x7f29c40a50c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29d4006fd0 tx=0x7f29d4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:23:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.605+0000 7f29ceffd640 1 -- 172.21.15.100:0/3151415270 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29d00bd220 con 0x7f29d8102690 2024-09-12T01:23:19.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:19.779+0000 7f29e0141640 1 -- 172.21.15.100:0/3151415270 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f29d8062630 con 0x7f29c40a2c00 2024-09-12T01:23:19.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:19 smithi081 ceph-mon[30920]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:19.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:19.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:19.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:19.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:19.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:19.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:19.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:19.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:19.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:19.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:23:19.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:19.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:20.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:19 smithi100 ceph-mon[35275]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:20.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:20.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:20.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:20.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:23:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:19 smithi189 ceph-mon[35357]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:23:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:20.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:20 smithi100 ceph-mon[35275]: purged_snaps scrub starts 2024-09-12T01:23:20.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:20 smithi100 ceph-mon[35275]: purged_snaps scrub ok 2024-09-12T01:23:20.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:20 smithi100 ceph-mon[35275]: Detected new or changed devices on smithi081 2024-09-12T01:23:20.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:20 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-12T01:23:20.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:20 smithi100 ceph-mon[35275]: osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005] boot 2024-09-12T01:23:20.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:20 smithi100 ceph-mon[35275]: osdmap e42: 7 total, 7 up, 7 in 2024-09-12T01:23:20.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:20 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:20.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:20 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:23:20.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:20 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:23:20.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:20 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:20.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:20 smithi081 ceph-mon[30920]: purged_snaps scrub starts 2024-09-12T01:23:20.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:20 smithi081 ceph-mon[30920]: purged_snaps scrub ok 2024-09-12T01:23:20.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:20 smithi081 ceph-mon[30920]: Detected new or changed devices on smithi081 2024-09-12T01:23:20.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:20 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-12T01:23:20.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:20 smithi081 ceph-mon[30920]: osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005] boot 2024-09-12T01:23:20.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:20 smithi081 ceph-mon[30920]: osdmap e42: 7 total, 7 up, 7 in 2024-09-12T01:23:20.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:20 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:20.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:20 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:23:20.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:20 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:23:20.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:20 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:21.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:20 smithi189 ceph-mon[35357]: purged_snaps scrub starts 2024-09-12T01:23:21.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:20 smithi189 ceph-mon[35357]: purged_snaps scrub ok 2024-09-12T01:23:21.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:20 smithi189 ceph-mon[35357]: Detected new or changed devices on smithi081 2024-09-12T01:23:21.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:20 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-12T01:23:21.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:20 smithi189 ceph-mon[35357]: osd.6 [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005] boot 2024-09-12T01:23:21.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:20 smithi189 ceph-mon[35357]: osdmap e42: 7 total, 7 up, 7 in 2024-09-12T01:23:21.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:20 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:23:21.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:20 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:23:21.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:20 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:23:21.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:20 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:21.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:21 smithi100 ceph-mon[35275]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:23:21.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:21 smithi100 ceph-mon[35275]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:21.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:21 smithi100 ceph-mon[35275]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T01:23:21.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:21 smithi081 ceph-mon[30920]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:23:21.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:21 smithi081 ceph-mon[30920]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:21.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:21 smithi081 ceph-mon[30920]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T01:23:22.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:21 smithi189 ceph-mon[35357]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:23:22.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:21 smithi189 ceph-mon[35357]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:23:22.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:21 smithi189 ceph-mon[35357]: osdmap e43: 7 total, 7 up, 7 in 2024-09-12T01:23:22.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:22 smithi081 ceph-mon[30920]: from='client.? 172.21.15.100:0/2849806792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46e082c8-d071-471a-8c86-ce5b5700cec5"}]: dispatch 2024-09-12T01:23:22.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:22 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46e082c8-d071-471a-8c86-ce5b5700cec5"}]: dispatch 2024-09-12T01:23:22.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:22 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46e082c8-d071-471a-8c86-ce5b5700cec5"}]': finished 2024-09-12T01:23:22.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:22 smithi081 ceph-mon[30920]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T01:23:22.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:22 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:22.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:22 smithi081 ceph-mon[30920]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:23.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:22 smithi100 ceph-mon[35275]: from='client.? 172.21.15.100:0/2849806792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46e082c8-d071-471a-8c86-ce5b5700cec5"}]: dispatch 2024-09-12T01:23:23.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:22 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46e082c8-d071-471a-8c86-ce5b5700cec5"}]: dispatch 2024-09-12T01:23:23.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:22 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46e082c8-d071-471a-8c86-ce5b5700cec5"}]': finished 2024-09-12T01:23:23.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:22 smithi100 ceph-mon[35275]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T01:23:23.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:22 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:23.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:22 smithi100 ceph-mon[35275]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:23.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:22 smithi189 ceph-mon[35357]: from='client.? 172.21.15.100:0/2849806792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46e082c8-d071-471a-8c86-ce5b5700cec5"}]: dispatch 2024-09-12T01:23:23.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:22 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46e082c8-d071-471a-8c86-ce5b5700cec5"}]: dispatch 2024-09-12T01:23:23.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:22 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46e082c8-d071-471a-8c86-ce5b5700cec5"}]': finished 2024-09-12T01:23:23.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:22 smithi189 ceph-mon[35357]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T01:23:23.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:22 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:23.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:22 smithi189 ceph-mon[35357]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:23.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:23 smithi081 ceph-mon[30920]: from='client.? 172.21.15.100:0/3344704297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:23:24.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:23 smithi100 ceph-mon[35275]: from='client.? 172.21.15.100:0/3344704297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:23:24.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:23 smithi189 ceph-mon[35357]: from='client.? 172.21.15.100:0/3344704297' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:23:24.920 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:24 smithi081 ceph-mon[30920]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:25.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:24 smithi100 ceph-mon[35275]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:25.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:24 smithi189 ceph-mon[35357]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:27.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:27 smithi081 ceph-mon[30920]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:27.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:27 smithi100 ceph-mon[35275]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:27 smithi189 ceph-mon[35357]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:29.706 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:29 smithi100 ceph-mon[35275]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:29.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:29 smithi081 ceph-mon[30920]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:29.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:29 smithi189 ceph-mon[35357]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:31.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:31 smithi081 ceph-mon[30920]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:31.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:31 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T01:23:31.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:31 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:31.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:31 smithi100 ceph-mon[35275]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:31.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:31 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T01:23:31.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:31 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:31.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:31 smithi189 ceph-mon[35357]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:31.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:31 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T01:23:31.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:31 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:32.613 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:32 smithi100 ceph-mon[35275]: Deploying daemon osd.7 on smithi100 2024-09-12T01:23:32.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:32 smithi081 ceph-mon[30920]: Deploying daemon osd.7 on smithi100 2024-09-12T01:23:32.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:32 smithi189 ceph-mon[35357]: Deploying daemon osd.7 on smithi100 2024-09-12T01:23:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:33 smithi081 ceph-mon[30920]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:33.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:33 smithi100 ceph-mon[35275]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:33 smithi189 ceph-mon[35357]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:35 smithi081 ceph-mon[30920]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:35.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:35 smithi100 ceph-mon[35275]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:35 smithi189 ceph-mon[35357]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:37 smithi081 ceph-mon[30920]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:23:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:37 smithi100 ceph-mon[35275]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:37 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:23:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:37 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:37 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:37 smithi189 ceph-mon[35357]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:37 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:23:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:37 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:37 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:39 smithi081 ceph-mon[30920]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:39.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:23:39.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:39 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:39.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:39 smithi100 ceph-mon[35275]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:39.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:39.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:39.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:23:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:39 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:39 smithi189 ceph-mon[35357]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:23:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:39 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:40.315+0000 7f29ceffd640 1 -- 172.21.15.100:0/3151415270 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f29d8062630 con 0x7f29c40a2c00 2024-09-12T01:23:40.315 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 7 on host 'smithi100' 2024-09-12T01:23:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:40.318+0000 7f29e0141640 1 -- 172.21.15.100:0/3151415270 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f29c40a2c00 msgr2=0x7f29c40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:23:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:40.318+0000 7f29e0141640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f29c40a2c00 0x7f29c40a50c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29d4006fd0 tx=0x7f29d4008040 comp rx=0 tx=0).stop 2024-09-12T01:23:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:40.318+0000 7f29e0141640 1 -- 172.21.15.100:0/3151415270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d8102690 msgr2=0x7f29d819f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:23:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:40.318+0000 7f29e0141640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d8102690 0x7f29d819f2a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f29d0005e30 tx=0x7f29d0031ee0 comp rx=0 tx=0).stop 2024-09-12T01:23:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:40.318+0000 7f29e0141640 1 -- 172.21.15.100:0/3151415270 shutdown_connections 2024-09-12T01:23:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:40.318+0000 7f29e0141640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f29c40a2c00 0x7f29c40a50c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:40.318+0000 7f29e0141640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d8102690 0x7f29d819f2a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:40.318+0000 7f29e0141640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29d8101cd0 0x7f29d819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:40.318+0000 7f29e0141640 1 --2- 172.21.15.100:0/3151415270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29d8100ad0 0x7f29d806aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:40.318+0000 7f29e0141640 1 -- 172.21.15.100:0/3151415270 >> 172.21.15.100:0/3151415270 conn(0x7f29d80fc280 msgr2=0x7f29d8105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:23:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:40.318+0000 7f29e0141640 1 -- 172.21.15.100:0/3151415270 shutdown_connections 2024-09-12T01:23:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:23:40.318+0000 7f29e0141640 1 -- 172.21.15.100:0/3151415270 wait complete. 2024-09-12T01:23:40.659 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:40 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:23:40.659 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:40 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:40.659 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:40 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:40.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:40 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:23:40.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:40 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:40.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:40 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:40.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:40 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:23:40.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:40 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:40.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:40 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:40.928 DEBUG:teuthology.orchestra.run.smithi100:osd.7> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T01:23:40.931 INFO:tasks.cephadm:Deploying osd.8 on smithi189 with /dev/vg_nvme/lv_2... 2024-09-12T01:23:40.931 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:23:41.191 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:23:41.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:41 smithi189 ceph-mon[35357]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:41.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:41 smithi081 ceph-mon[30920]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:41.757 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:41 smithi100 ceph-mon[35275]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:43.268 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:23:42 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:23:42.942+0000 7f3ac83fd640 -1 osd.7 0 log_to_monitors true 2024-09-12T01:23:43.640 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:43 smithi100 ceph-mon[35275]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:43.640 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:43 smithi100 ceph-mon[35275]: from='osd.7 [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:23:43.640 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:43 smithi100 ceph-mon[35275]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:23:43.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:43 smithi189 ceph-mon[35357]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:43.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:43 smithi189 ceph-mon[35357]: from='osd.7 [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:23:43.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:43 smithi189 ceph-mon[35357]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:23:43.698 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:23:43.725 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_2 2024-09-12T01:23:43.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:43 smithi081 ceph-mon[30920]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:43.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:43 smithi081 ceph-mon[30920]: from='osd.7 [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:23:43.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:43 smithi081 ceph-mon[30920]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:23:43.979 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:23:44.542 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.457+0000 7f72af337640 1 -- 172.21.15.189:0/840691266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72a81026d0 msgr2=0x7f72a8108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:23:44.543 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.457+0000 7f72af337640 1 --2- 172.21.15.189:0/840691266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72a81026d0 0x7f72a8108f60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009ca0 tx=0x7f72a002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:23:44.543 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.457+0000 7f72af337640 1 -- 172.21.15.189:0/840691266 shutdown_connections 2024-09-12T01:23:44.543 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.457+0000 7f72af337640 1 --2- 172.21.15.189:0/840691266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72a81026d0 0x7f72a8108f60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:44.543 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.457+0000 7f72af337640 1 --2- 172.21.15.189:0/840691266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72a8101d10 0x7f72a8102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:44.543 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.457+0000 7f72af337640 1 --2- 172.21.15.189:0/840691266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72a8100b10 0x7f72a8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:44.543 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.457+0000 7f72af337640 1 -- 172.21.15.189:0/840691266 >> 172.21.15.189:0/840691266 conn(0x7f72a80fc2a0 msgr2=0x7f72a80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:23:44.543 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.457+0000 7f72af337640 1 -- 172.21.15.189:0/840691266 shutdown_connections 2024-09-12T01:23:44.543 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.457+0000 7f72af337640 1 -- 172.21.15.189:0/840691266 wait complete. 2024-09-12T01:23:44.543 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.458+0000 7f72af337640 1 Processor -- start 2024-09-12T01:23:44.543 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.458+0000 7f72af337640 1 -- start start 2024-09-12T01:23:44.543 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.458+0000 7f72af337640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72a8100b10 0x7f72a819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:23:44.544 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.458+0000 7f72af337640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72a8101d10 0x7f72a819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:23:44.544 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.458+0000 7f72af337640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72a81026d0 0x7f72a81a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:23:44.544 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.458+0000 7f72af337640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72a810c790 con 0x7f72a8100b10 2024-09-12T01:23:44.544 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.458+0000 7f72af337640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f72a810c610 con 0x7f72a81026d0 2024-09-12T01:23:44.544 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.458+0000 7f72af337640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f72a810c910 con 0x7f72a8101d10 2024-09-12T01:23:44.544 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.458+0000 7f72ac8d2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72a8101d10 0x7f72a819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:23:44.544 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.458+0000 7f72ac8d2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72a8101d10 0x7f72a819a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:47376/0 (socket says 172.21.15.189:47376) 2024-09-12T01:23:44.544 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.458+0000 7f72ac8d2640 1 -- 172.21.15.189:0/192438585 learned_addr learned my addr 172.21.15.189:0/192438585 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:23:44.544 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.458+0000 7f72ad0d3640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72a8100b10 0x7f72a819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:23:44.544 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.459+0000 7f72ad8d4640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72a81026d0 0x7f72a81a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:23:44.544 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.459+0000 7f72ac8d2640 1 -- 172.21.15.189:0/192438585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72a81026d0 msgr2=0x7f72a81a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:23:44.544 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.459+0000 7f72ac8d2640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72a81026d0 0x7f72a81a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:44.545 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.459+0000 7f72ac8d2640 1 -- 172.21.15.189:0/192438585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72a8100b10 msgr2=0x7f72a819a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:23:44.545 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.459+0000 7f72ac8d2640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72a8100b10 0x7f72a819a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:23:44.545 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.459+0000 7f72ac8d2640 1 -- 172.21.15.189:0/192438585 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a81a1cd0 con 0x7f72a8101d10 2024-09-12T01:23:44.545 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.459+0000 7f72ad0d3640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72a8100b10 0x7f72a819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:23:44.545 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.459+0000 7f72ac8d2640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72a8101d10 0x7f72a819a5e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f72a400e9f0 tx=0x7f72a400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:23:44.545 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.459+0000 7f729a7fc640 1 -- 172.21.15.189:0/192438585 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a400cd80 con 0x7f72a8101d10 2024-09-12T01:23:44.545 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.459+0000 7f729a7fc640 1 -- 172.21.15.189:0/192438585 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a4010910 con 0x7f72a8101d10 2024-09-12T01:23:44.545 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.459+0000 7f72af337640 1 -- 172.21.15.189:0/192438585 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a81a1fc0 con 0x7f72a8101d10 2024-09-12T01:23:44.545 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.459+0000 7f729a7fc640 1 -- 172.21.15.189:0/192438585 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a4018990 con 0x7f72a8101d10 2024-09-12T01:23:44.545 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.459+0000 7f72af337640 1 -- 172.21.15.189:0/192438585 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a81a2470 con 0x7f72a8101d10 2024-09-12T01:23:44.545 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.460+0000 7f72af337640 1 -- 172.21.15.189:0/192438585 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a81a26a0 con 0x7f72a8101d10 2024-09-12T01:23:44.545 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.461+0000 7f729a7fc640 1 -- 172.21.15.189:0/192438585 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f72a4010ac0 con 0x7f72a8101d10 2024-09-12T01:23:44.546 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.462+0000 7f729a7fc640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f72940a2bb0 0x7f72940a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:23:44.546 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.462+0000 7f729a7fc640 1 -- 172.21.15.189:0/192438585 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5101+0+0 (secure 0 0 0) 0x7f72a40ce650 con 0x7f72a8101d10 2024-09-12T01:23:44.546 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.462+0000 7f72ad0d3640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f72940a2bb0 0x7f72940a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:23:44.546 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.463+0000 7f72ad0d3640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f72940a2bb0 0x7f72940a5070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f729c005fd0 tx=0x7f729c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:23:44.546 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.466+0000 7f729a7fc640 1 -- 172.21.15.189:0/192438585 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72a409bbf0 con 0x7f72a8101d10 2024-09-12T01:23:44.647 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:23:44.648+0000 7f72af337640 1 -- 172.21.15.189:0/192438585 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f72a80fe4b0 con 0x7f72940a2bb0 2024-09-12T01:23:44.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T01:23:44.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T01:23:44.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:44.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: from='osd.7 [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:23:44.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:23:44.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:44.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:44.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:44.741 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:44.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:44.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:44.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:44.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:23:44.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:44.768 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:23:44.491+0000 7f3ac3b5d640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T01:23:44.769 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:23:44.502+0000 7f3ac0197640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:23:44.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T01:23:44.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T01:23:44.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:44.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: from='osd.7 [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:23:44.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:23:44.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:44.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:44.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:44.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:44.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:44.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:44.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:44.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:23:44.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T01:23:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T01:23:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: from='osd.7 [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:23:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:23:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:44.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:44.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:44.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:23:44.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:44.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:44.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:23:44.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:23:45.754 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:45 smithi189 ceph-mon[35357]: Detected new or changed devices on smithi100 2024-09-12T01:23:45.755 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:45 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-12T01:23:45.755 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:45 smithi189 ceph-mon[35357]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:45.755 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:45 smithi189 ceph-mon[35357]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:23:45.755 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:45 smithi189 ceph-mon[35357]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T01:23:45.755 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:45.755 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:45.755 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:23:45.755 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:23:45.755 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:45 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:45.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:45 smithi100 ceph-mon[35275]: Detected new or changed devices on smithi100 2024-09-12T01:23:45.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:45 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-12T01:23:45.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:45 smithi100 ceph-mon[35275]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:45.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:45 smithi100 ceph-mon[35275]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:23:45.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:45 smithi100 ceph-mon[35275]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T01:23:45.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:45.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:45.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:23:45.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:23:45.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:45 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:45.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:45 smithi081 ceph-mon[30920]: Detected new or changed devices on smithi100 2024-09-12T01:23:45.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:45 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-12T01:23:45.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:45 smithi081 ceph-mon[30920]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:45.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:45 smithi081 ceph-mon[30920]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:23:45.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:45 smithi081 ceph-mon[30920]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T01:23:45.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:45.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:45.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:23:45.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:23:45.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:45 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:46.697 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:46 smithi189 ceph-mon[35357]: purged_snaps scrub starts 2024-09-12T01:23:46.697 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:46 smithi189 ceph-mon[35357]: purged_snaps scrub ok 2024-09-12T01:23:46.698 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:46 smithi189 ceph-mon[35357]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:23:46.698 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:46 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:46.698 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:46 smithi189 ceph-mon[35357]: osd.7 [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541] boot 2024-09-12T01:23:46.698 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:46 smithi189 ceph-mon[35357]: osdmap e47: 8 total, 8 up, 8 in 2024-09-12T01:23:46.698 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:46 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:46.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:46 smithi100 ceph-mon[35275]: purged_snaps scrub starts 2024-09-12T01:23:46.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:46 smithi100 ceph-mon[35275]: purged_snaps scrub ok 2024-09-12T01:23:46.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:46 smithi100 ceph-mon[35275]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:23:46.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:46 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:46.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:46 smithi100 ceph-mon[35275]: osd.7 [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541] boot 2024-09-12T01:23:46.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:46 smithi100 ceph-mon[35275]: osdmap e47: 8 total, 8 up, 8 in 2024-09-12T01:23:46.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:46 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:46.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:46 smithi081 ceph-mon[30920]: purged_snaps scrub starts 2024-09-12T01:23:46.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:46 smithi081 ceph-mon[30920]: purged_snaps scrub ok 2024-09-12T01:23:46.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:46 smithi081 ceph-mon[30920]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:23:46.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:46 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:46.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:46 smithi081 ceph-mon[30920]: osd.7 [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541] boot 2024-09-12T01:23:46.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:46 smithi081 ceph-mon[30920]: osdmap e47: 8 total, 8 up, 8 in 2024-09-12T01:23:46.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:46 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:23:47.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:47 smithi100 ceph-mon[35275]: pgmap v168: 1 pgs: 1 remapped; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:47.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:47 smithi100 ceph-mon[35275]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T01:23:47.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:47 smithi100 ceph-mon[35275]: from='client.? 172.21.15.189:0/3646518115' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb9b93ef-5a33-4ffc-926e-a78c101bbbbe"}]: dispatch 2024-09-12T01:23:47.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:47 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb9b93ef-5a33-4ffc-926e-a78c101bbbbe"}]: dispatch 2024-09-12T01:23:47.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:47 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb9b93ef-5a33-4ffc-926e-a78c101bbbbe"}]': finished 2024-09-12T01:23:47.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:47 smithi100 ceph-mon[35275]: osdmap e49: 9 total, 8 up, 9 in 2024-09-12T01:23:47.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:47 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:23:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:47 smithi189 ceph-mon[35357]: pgmap v168: 1 pgs: 1 remapped; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:47 smithi189 ceph-mon[35357]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T01:23:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:47 smithi189 ceph-mon[35357]: from='client.? 172.21.15.189:0/3646518115' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb9b93ef-5a33-4ffc-926e-a78c101bbbbe"}]: dispatch 2024-09-12T01:23:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:47 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb9b93ef-5a33-4ffc-926e-a78c101bbbbe"}]: dispatch 2024-09-12T01:23:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:47 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb9b93ef-5a33-4ffc-926e-a78c101bbbbe"}]': finished 2024-09-12T01:23:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:47 smithi189 ceph-mon[35357]: osdmap e49: 9 total, 8 up, 9 in 2024-09-12T01:23:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:47 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:23:47.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:47 smithi081 ceph-mon[30920]: pgmap v168: 1 pgs: 1 remapped; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:23:47.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:47 smithi081 ceph-mon[30920]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T01:23:47.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:47 smithi081 ceph-mon[30920]: from='client.? 172.21.15.189:0/3646518115' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb9b93ef-5a33-4ffc-926e-a78c101bbbbe"}]: dispatch 2024-09-12T01:23:47.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:47 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb9b93ef-5a33-4ffc-926e-a78c101bbbbe"}]: dispatch 2024-09-12T01:23:47.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:47 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb9b93ef-5a33-4ffc-926e-a78c101bbbbe"}]': finished 2024-09-12T01:23:47.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:47 smithi081 ceph-mon[30920]: osdmap e49: 9 total, 8 up, 9 in 2024-09-12T01:23:47.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:23:48.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:48 smithi100 ceph-mon[35275]: from='client.? 172.21.15.189:0/1902157931' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:23:48.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:48 smithi100 ceph-mon[35275]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T01:23:48.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:48 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:23:48.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:48 smithi189 ceph-mon[35357]: from='client.? 172.21.15.189:0/1902157931' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:23:48.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:48 smithi189 ceph-mon[35357]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T01:23:48.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:48 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:23:48.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:48 smithi081 ceph-mon[30920]: from='client.? 172.21.15.189:0/1902157931' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:23:48.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:48 smithi081 ceph-mon[30920]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T01:23:48.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:48 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:23:49.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:49 smithi100 ceph-mon[35275]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:49.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:49 smithi100 ceph-mon[35275]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T01:23:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:49 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:23:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:49 smithi189 ceph-mon[35357]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:49 smithi189 ceph-mon[35357]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T01:23:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:49 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:23:49.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:49 smithi081 ceph-mon[30920]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:49.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:49 smithi081 ceph-mon[30920]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T01:23:49.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:49 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:23:51.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:51 smithi100 ceph-mon[35275]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:51.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:51 smithi189 ceph-mon[35357]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:51.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:51 smithi081 ceph-mon[30920]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:53.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:53 smithi189 ceph-mon[35357]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:53.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:53 smithi100 ceph-mon[35275]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:53.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:53 smithi081 ceph-mon[30920]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:55.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:55 smithi100 ceph-mon[35275]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:55.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:55 smithi189 ceph-mon[35357]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:55.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:55 smithi081 ceph-mon[30920]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:56.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:56 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T01:23:56.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:56 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:56.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:56 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T01:23:56.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:56 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:57.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:56 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T01:23:57.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:56 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:23:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:57 smithi189 ceph-mon[35357]: Deploying daemon osd.8 on smithi189 2024-09-12T01:23:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:57 smithi189 ceph-mon[35357]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:57.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:57 smithi081 ceph-mon[30920]: Deploying daemon osd.8 on smithi189 2024-09-12T01:23:57.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:57 smithi081 ceph-mon[30920]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:58.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:57 smithi100 ceph-mon[35275]: Deploying daemon osd.8 on smithi189 2024-09-12T01:23:58.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:57 smithi100 ceph-mon[35275]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:23:59 smithi189 ceph-mon[35357]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:23:59.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:23:59 smithi081 ceph-mon[30920]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:00.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:23:59 smithi100 ceph-mon[35275]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:01.527 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:01 smithi189 ceph-mon[35357]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:01.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:01 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:01 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:01 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:01.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:01 smithi081 ceph-mon[30920]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:01.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:01 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:01.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:01 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:01.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:01 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:02.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:01 smithi100 ceph-mon[35275]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:02.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:01 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:02.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:01 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:02.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:01 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:03 smithi189 ceph-mon[35357]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:03.820 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:03 smithi100 ceph-mon[35275]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:03.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:03 smithi081 ceph-mon[30920]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:05.204 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 8 on host 'smithi189' 2024-09-12T01:24:05.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:05.205+0000 7f729a7fc640 1 -- 172.21.15.189:0/192438585 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f72a80fe4b0 con 0x7f72940a2bb0 2024-09-12T01:24:05.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:05.207+0000 7f72af337640 1 -- 172.21.15.189:0/192438585 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f72940a2bb0 msgr2=0x7f72940a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:05.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:05.207+0000 7f72af337640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f72940a2bb0 0x7f72940a5070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f729c005fd0 tx=0x7f729c00b390 comp rx=0 tx=0).stop 2024-09-12T01:24:05.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:05.207+0000 7f72af337640 1 -- 172.21.15.189:0/192438585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72a8101d10 msgr2=0x7f72a819a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:05.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:05.207+0000 7f72af337640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72a8101d10 0x7f72a819a5e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f72a400e9f0 tx=0x7f72a400eeb0 comp rx=0 tx=0).stop 2024-09-12T01:24:05.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:05.208+0000 7f72af337640 1 -- 172.21.15.189:0/192438585 shutdown_connections 2024-09-12T01:24:05.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:05.208+0000 7f72af337640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f72940a2bb0 0x7f72940a5070 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:05.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:05.208+0000 7f72af337640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72a81026d0 0x7f72a81a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:05.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:05.208+0000 7f72af337640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72a8101d10 0x7f72a819a5e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:05.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:05.208+0000 7f72af337640 1 --2- 172.21.15.189:0/192438585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72a8100b10 0x7f72a819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:05.208 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:05.208+0000 7f72af337640 1 -- 172.21.15.189:0/192438585 >> 172.21.15.189:0/192438585 conn(0x7f72a80fc2a0 msgr2=0x7f72a80fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:24:05.208 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:05.208+0000 7f72af337640 1 -- 172.21.15.189:0/192438585 shutdown_connections 2024-09-12T01:24:05.208 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:05.208+0000 7f72af337640 1 -- 172.21.15.189:0/192438585 wait complete. 2024-09-12T01:24:05.446 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:05.446 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:05.446 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:05.446 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:05.446 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:05.446 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:05 smithi189 ceph-mon[35357]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:05.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:05.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:05.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:05.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:05.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:05.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:05 smithi081 ceph-mon[30920]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:05.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:05.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:05.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:05.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:05.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:05.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:05 smithi100 ceph-mon[35275]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:05.852 DEBUG:teuthology.orchestra.run.smithi189:osd.8> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T01:24:05.854 INFO:tasks.cephadm:Deploying osd.9 on smithi081 with /dev/vg_nvme/lv_1... 2024-09-12T01:24:05.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T01:24:06.111 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:24:06.442 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:06 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:06.443 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:06 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:06.443 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:06 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:06.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:06 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:06.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:06 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:06.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:06 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:06.531 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:06 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:06.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:06 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:06.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:06 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:07.341 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:07 smithi189 ceph-mon[35357]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:07.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:07 smithi081 ceph-mon[30920]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:07.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:07 smithi100 ceph-mon[35275]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:08.198 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:24:07 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:24:07.816+0000 7fcb305dc640 -1 osd.8 0 log_to_monitors true 2024-09-12T01:24:08.439 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:08 smithi081 ceph-mon[30920]: from='osd.8 [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:24:08.440 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:08 smithi081 ceph-mon[30920]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:24:08.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:08 smithi100 ceph-mon[35275]: from='osd.8 [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:24:08.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:08 smithi100 ceph-mon[35275]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:24:08.531 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:08 smithi189 ceph-mon[35357]: from='osd.8 [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:24:08.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:08 smithi189 ceph-mon[35357]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:24:08.756 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:24:08.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_1 2024-09-12T01:24:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:24:09.448 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T01:24:09.448 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T01:24:09.448 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: from='osd.8 [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:24:09.448 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:09.448 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:24:09.448 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:09.448 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:09.448 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:09.448 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:09.448 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:09.448 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:09.449 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:09.449 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:09.449 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:09.449 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:09.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T01:24:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T01:24:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: from='osd.8 [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:24:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:24:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:09.520 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:09.520 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T01:24:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T01:24:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: from='osd.8 [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:24:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:24:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:09.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:09.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:09.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:09.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.531+0000 7f126f48a640 1 -- 172.21.15.81:0/1249951735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1268100ad0 msgr2=0x7f1268100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.531+0000 7f126f48a640 1 --2- 172.21.15.81:0/1249951735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1268100ad0 0x7f1268100ed0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1258009ca0 tx=0x7f125802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:24:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.531+0000 7f126f48a640 1 -- 172.21.15.81:0/1249951735 shutdown_connections 2024-09-12T01:24:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.531+0000 7f126f48a640 1 --2- 172.21.15.81:0/1249951735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1268102690 0x7f1268108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.531+0000 7f126f48a640 1 --2- 172.21.15.81:0/1249951735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1268101cd0 0x7f1268102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.531+0000 7f126f48a640 1 --2- 172.21.15.81:0/1249951735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1268100ad0 0x7f1268100ed0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.531+0000 7f126f48a640 1 -- 172.21.15.81:0/1249951735 >> 172.21.15.81:0/1249951735 conn(0x7f12680fc280 msgr2=0x7f12680fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:24:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.531+0000 7f126f48a640 1 -- 172.21.15.81:0/1249951735 shutdown_connections 2024-09-12T01:24:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.531+0000 7f126f48a640 1 -- 172.21.15.81:0/1249951735 wait complete. 2024-09-12T01:24:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.531+0000 7f126f48a640 1 Processor -- start 2024-09-12T01:24:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.531+0000 7f126f48a640 1 -- start start 2024-09-12T01:24:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126f48a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1268100ad0 0x7f1268197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:24:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126f48a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1268101cd0 0x7f1268198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:24:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126f48a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1268102690 0x7f126819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:24:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126f48a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f126810c730 con 0x7f1268101cd0 2024-09-12T01:24:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126f48a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f126810c5b0 con 0x7f1268102690 2024-09-12T01:24:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126f48a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f126810c8b0 con 0x7f1268100ad0 2024-09-12T01:24:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126ca25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1268101cd0 0x7f1268198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:24:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126ca25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1268101cd0 0x7f1268198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40514/0 (socket says 172.21.15.81:40514) 2024-09-12T01:24:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126ca25640 1 -- 172.21.15.81:0/806253651 learned_addr learned my addr 172.21.15.81:0/806253651 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:24:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126d226640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1268100ad0 0x7f1268197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:24:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126da27640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1268102690 0x7f126819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:24:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126ca25640 1 -- 172.21.15.81:0/806253651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1268100ad0 msgr2=0x7f1268197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126ca25640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1268100ad0 0x7f1268197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126ca25640 1 -- 172.21.15.81:0/806253651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1268102690 msgr2=0x7f126819f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126ca25640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1268102690 0x7f126819f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126ca25640 1 -- 172.21.15.81:0/806253651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126819fb30 con 0x7f1268101cd0 2024-09-12T01:24:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126ca25640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1268101cd0 0x7f1268198440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f125c00e9f0 tx=0x7f125c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:24:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f12667fc640 1 -- 172.21.15.81:0/806253651 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c00cd80 con 0x7f1268101cd0 2024-09-12T01:24:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126f48a640 1 -- 172.21.15.81:0/806253651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126819fe20 con 0x7f1268101cd0 2024-09-12T01:24:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f12667fc640 1 -- 172.21.15.81:0/806253651 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f125c010910 con 0x7f1268101cd0 2024-09-12T01:24:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f12667fc640 1 -- 172.21.15.81:0/806253651 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c0188f0 con 0x7f1268101cd0 2024-09-12T01:24:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.532+0000 7f126f48a640 1 -- 172.21.15.81:0/806253651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12681a02d0 con 0x7f1268101cd0 2024-09-12T01:24:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.533+0000 7f126f48a640 1 -- 172.21.15.81:0/806253651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12681a05c0 con 0x7f1268101cd0 2024-09-12T01:24:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.535+0000 7f12667fc640 1 -- 172.21.15.81:0/806253651 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f125c010ac0 con 0x7f1268101cd0 2024-09-12T01:24:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.535+0000 7f12667fc640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f12500a2bb0 0x7f12500a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:24:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.535+0000 7f126d226640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f12500a2bb0 0x7f12500a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:24:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.535+0000 7f12667fc640 1 -- 172.21.15.81:0/806253651 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5582+0+0 (secure 0 0 0) 0x7f125c0ced00 con 0x7f1268101cd0 2024-09-12T01:24:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.536+0000 7f126d226640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f12500a2bb0 0x7f12500a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1258006010 tx=0x7f1258000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:24:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.538+0000 7f12667fc640 1 -- 172.21.15.81:0/806253651 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f125c09c710 con 0x7f1268101cd0 2024-09-12T01:24:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:09.714+0000 7f126f48a640 1 -- 172.21.15.81:0/806253651 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f126806a680 con 0x7f12500a2bb0 2024-09-12T01:24:10.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:24:09.980+0000 7fcb2cd73640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T01:24:10.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:24:09 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:24:09.995+0000 7fcb2436e640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:24:10.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:10 smithi189 ceph-mon[35357]: Detected new or changed devices on smithi189 2024-09-12T01:24:10.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:10 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-12T01:24:10.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:10 smithi189 ceph-mon[35357]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T01:24:10.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:10 smithi189 ceph-mon[35357]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T01:24:10.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:10.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:10.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:10 smithi189 ceph-mon[35357]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T01:24:10.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:10.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:24:10.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:24:10.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:10.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:10 smithi189 ceph-mon[35357]: from='osd.8 ' entity='osd.8' 2024-09-12T01:24:10.375 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:10 smithi081 ceph-mon[30920]: Detected new or changed devices on smithi189 2024-09-12T01:24:10.375 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:10 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-12T01:24:10.376 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:10 smithi081 ceph-mon[30920]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T01:24:10.376 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:10 smithi081 ceph-mon[30920]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T01:24:10.376 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:10.376 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:10.376 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:10 smithi081 ceph-mon[30920]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T01:24:10.376 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:10.376 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:24:10.376 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:24:10.376 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:10.376 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:10 smithi081 ceph-mon[30920]: from='osd.8 ' entity='osd.8' 2024-09-12T01:24:10.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:10 smithi100 ceph-mon[35275]: Detected new or changed devices on smithi189 2024-09-12T01:24:10.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:10 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-12T01:24:10.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:10 smithi100 ceph-mon[35275]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T01:24:10.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:10 smithi100 ceph-mon[35275]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T01:24:10.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:10.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:10.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:10 smithi100 ceph-mon[35275]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T01:24:10.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:10.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:24:10.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:24:10.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:10.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:10 smithi100 ceph-mon[35275]: from='osd.8 ' entity='osd.8' 2024-09-12T01:24:11.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:11 smithi081 ceph-mon[30920]: purged_snaps scrub starts 2024-09-12T01:24:11.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:11 smithi081 ceph-mon[30920]: purged_snaps scrub ok 2024-09-12T01:24:11.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:11 smithi081 ceph-mon[30920]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:24:11.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:11.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:11 smithi081 ceph-mon[30920]: osd.8 [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860] boot 2024-09-12T01:24:11.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:11 smithi081 ceph-mon[30920]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T01:24:11.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:11.457 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:11 smithi081 ceph-mon[30920]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:11.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:11 smithi100 ceph-mon[35275]: purged_snaps scrub starts 2024-09-12T01:24:11.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:11 smithi100 ceph-mon[35275]: purged_snaps scrub ok 2024-09-12T01:24:11.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:11 smithi100 ceph-mon[35275]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:24:11.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:11 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:11.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:11 smithi100 ceph-mon[35275]: osd.8 [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860] boot 2024-09-12T01:24:11.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:11 smithi100 ceph-mon[35275]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T01:24:11.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:11 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:11.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:11 smithi100 ceph-mon[35275]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:11.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:11 smithi189 ceph-mon[35357]: purged_snaps scrub starts 2024-09-12T01:24:11.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:11 smithi189 ceph-mon[35357]: purged_snaps scrub ok 2024-09-12T01:24:11.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:11 smithi189 ceph-mon[35357]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:24:11.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:11.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:11 smithi189 ceph-mon[35357]: osd.8 [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860] boot 2024-09-12T01:24:11.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:11 smithi189 ceph-mon[35357]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T01:24:11.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:24:11.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:11 smithi189 ceph-mon[35357]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:24:12.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:12 smithi081 ceph-mon[30920]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T01:24:12.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:12 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3476370327' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b7ec1a1-5ab9-4075-acfb-e0d82f018656"}]: dispatch 2024-09-12T01:24:12.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:12 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3476370327' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b7ec1a1-5ab9-4075-acfb-e0d82f018656"}]': finished 2024-09-12T01:24:12.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:12 smithi081 ceph-mon[30920]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T01:24:12.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:12 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:12.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:12 smithi100 ceph-mon[35275]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T01:24:12.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:12 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3476370327' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b7ec1a1-5ab9-4075-acfb-e0d82f018656"}]: dispatch 2024-09-12T01:24:12.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:12 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3476370327' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b7ec1a1-5ab9-4075-acfb-e0d82f018656"}]': finished 2024-09-12T01:24:12.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:12 smithi100 ceph-mon[35275]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T01:24:12.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:12 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:12.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:12 smithi189 ceph-mon[35357]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T01:24:12.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:12 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3476370327' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b7ec1a1-5ab9-4075-acfb-e0d82f018656"}]: dispatch 2024-09-12T01:24:12.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:12 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3476370327' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b7ec1a1-5ab9-4075-acfb-e0d82f018656"}]': finished 2024-09-12T01:24:12.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:12 smithi189 ceph-mon[35357]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T01:24:12.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:12 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:13.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:13 smithi081 ceph-mon[30920]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:13.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:13 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3520388562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:24:13.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:13 smithi100 ceph-mon[35275]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:13.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:13 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3520388562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:24:13.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:13 smithi189 ceph-mon[35357]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:13 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3520388562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:24:14.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:14 smithi081 ceph-mon[30920]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T01:24:14.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:14 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:14.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:14 smithi100 ceph-mon[35275]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T01:24:14.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:14 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:14.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:14 smithi189 ceph-mon[35357]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T01:24:14.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:14 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:15.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:15 smithi081 ceph-mon[30920]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T01:24:15.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:15 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:15.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:15 smithi081 ceph-mon[30920]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:15.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:15 smithi100 ceph-mon[35275]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T01:24:15.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:15 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:15.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:15 smithi100 ceph-mon[35275]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:15 smithi189 ceph-mon[35357]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T01:24:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:15 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:15 smithi189 ceph-mon[35357]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:17.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:17 smithi081 ceph-mon[30920]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:17.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:17 smithi100 ceph-mon[35275]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:17 smithi189 ceph-mon[35357]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:19.722 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:19 smithi081 ceph-mon[30920]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-12T01:24:19.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:19 smithi100 ceph-mon[35275]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-12T01:24:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:19 smithi189 ceph-mon[35357]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-12T01:24:21.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:21 smithi081 ceph-mon[30920]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:24:21.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:21 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T01:24:21.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:21 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:21.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:21 smithi100 ceph-mon[35275]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:24:21.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:21 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T01:24:21.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:21 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:21.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:21 smithi189 ceph-mon[35357]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:24:21.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:21 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T01:24:21.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:21 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:22.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:22 smithi081 ceph-mon[30920]: Deploying daemon osd.9 on smithi081 2024-09-12T01:24:22.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:22 smithi100 ceph-mon[35275]: Deploying daemon osd.9 on smithi081 2024-09-12T01:24:22.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:22 smithi189 ceph-mon[35357]: Deploying daemon osd.9 on smithi081 2024-09-12T01:24:23.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:23 smithi081 ceph-mon[30920]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-12T01:24:23.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:23 smithi100 ceph-mon[35275]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-12T01:24:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:23 smithi189 ceph-mon[35357]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-12T01:24:25.650 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:25 smithi081 ceph-mon[30920]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-12T01:24:25.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:25 smithi100 ceph-mon[35275]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-12T01:24:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:25 smithi189 ceph-mon[35357]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-12T01:24:27.711 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:27 smithi081 ceph-mon[30920]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:24:27.711 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:27 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:27.712 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:27 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:27.712 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:27 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:27.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:27 smithi100 ceph-mon[35275]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:24:27.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:27 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:27.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:27 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:27.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:27 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:27 smithi189 ceph-mon[35357]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:24:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:27 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:27 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:27 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:29.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:29 smithi081 ceph-mon[30920]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:24:29.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:29 smithi100 ceph-mon[35275]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:24:29.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:29 smithi189 ceph-mon[35357]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:24:30.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:30.561+0000 7f12667fc640 1 -- 172.21.15.81:0/806253651 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f126806a680 con 0x7f12500a2bb0 2024-09-12T01:24:30.560 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 9 on host 'smithi081' 2024-09-12T01:24:30.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:30.564+0000 7f126f48a640 1 -- 172.21.15.81:0/806253651 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f12500a2bb0 msgr2=0x7f12500a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:30.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:30.564+0000 7f126f48a640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f12500a2bb0 0x7f12500a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1258006010 tx=0x7f1258000f40 comp rx=0 tx=0).stop 2024-09-12T01:24:30.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:30.564+0000 7f126f48a640 1 -- 172.21.15.81:0/806253651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1268101cd0 msgr2=0x7f1268198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:30.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:30.564+0000 7f126f48a640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1268101cd0 0x7f1268198440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f125c00e9f0 tx=0x7f125c00eeb0 comp rx=0 tx=0).stop 2024-09-12T01:24:30.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:30.564+0000 7f126f48a640 1 -- 172.21.15.81:0/806253651 shutdown_connections 2024-09-12T01:24:30.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:30.564+0000 7f126f48a640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f12500a2bb0 0x7f12500a5070 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:30.564+0000 7f126f48a640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1268102690 0x7f126819f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:30.564+0000 7f126f48a640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1268101cd0 0x7f1268198440 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:30.564+0000 7f126f48a640 1 --2- 172.21.15.81:0/806253651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1268100ad0 0x7f1268197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:30.564+0000 7f126f48a640 1 -- 172.21.15.81:0/806253651 >> 172.21.15.81:0/806253651 conn(0x7f12680fc280 msgr2=0x7f1268069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:24:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:30.564+0000 7f126f48a640 1 -- 172.21.15.81:0/806253651 shutdown_connections 2024-09-12T01:24:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:24:30.564+0000 7f126f48a640 1 -- 172.21.15.81:0/806253651 wait complete. 2024-09-12T01:24:31.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:30 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:30 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:30 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:31.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:30 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:31.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:30 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:30 smithi189 ceph-mon[35357]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:31.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:30 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:31.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:30 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:30 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:30 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:30 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:30 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:31.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:30 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:31.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:30 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:30 smithi081 ceph-mon[30920]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:31.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:30 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:31.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:30 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:30 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:30 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:30 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:30 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:31.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:30 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:31.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:30 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:30 smithi100 ceph-mon[35275]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:31.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:30 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:31.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:30 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:30 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:31.317 DEBUG:teuthology.orchestra.run.smithi081:osd.9> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T01:24:31.320 INFO:tasks.cephadm:Deploying osd.10 on smithi100 with /dev/vg_nvme/lv_1... 2024-09-12T01:24:31.320 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T01:24:31.575 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:24:33.549 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:33 smithi100 ceph-mon[35275]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:33.549 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:33 smithi100 ceph-mon[35275]: from='osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:24:33.735 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:33 smithi189 ceph-mon[35357]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:33.735 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:33 smithi189 ceph-mon[35357]: from='osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:24:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:33 smithi081 ceph-mon[30920]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:33 smithi081 ceph-mon[30920]: from='osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:24:33.738 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:24:33 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:24:33.303+0000 7f4decce7640 -1 osd.9 0 log_to_monitors true 2024-09-12T01:24:34.011 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-12T01:24:34.037 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_1 2024-09-12T01:24:34.286 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:24:34.527 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T01:24:34.527 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T01:24:34.527 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T01:24:34.527 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:34.527 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:34.527 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:34.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:34.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:34.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:34.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:34.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:34.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:34.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:34.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:34.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T01:24:34.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T01:24:34.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:34 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:34.689 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T01:24:34.690 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T01:24:34.690 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T01:24:34.690 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:34.690 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:34.690 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:34.690 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:34.690 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:34.690 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:34.690 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:34.690 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:34.690 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:34.690 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:34.691 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:34.691 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T01:24:34.691 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T01:24:34.691 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:34 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:34.738 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:24:34.465+0000 7f4de8447640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T01:24:34.738 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:24:34.479+0000 7f4de4a81640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:24:34.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T01:24:34.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T01:24:34.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T01:24:34.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:34.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:34.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:34.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:34.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:34.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:34.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:34.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:34.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:34.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:34.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:34.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T01:24:34.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T01:24:34.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:34 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.773+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3958197479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ed0101d10 msgr2=0x7f6ed0102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.773+0000 7f6ed7c23640 1 --2- 172.21.15.100:0/3958197479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ed0101d10 0x7f6ed0102190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009900 tx=0x7f6ecc02a410 comp rx=0 tx=0).stop 2024-09-12T01:24:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.773+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3958197479 shutdown_connections 2024-09-12T01:24:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.773+0000 7f6ed7c23640 1 --2- 172.21.15.100:0/3958197479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed01026d0 0x7f6ed0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.773+0000 7f6ed7c23640 1 --2- 172.21.15.100:0/3958197479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ed0101d10 0x7f6ed0102190 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.773+0000 7f6ed7c23640 1 --2- 172.21.15.100:0/3958197479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed0100b10 0x7f6ed0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.773+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3958197479 >> 172.21.15.100:0/3958197479 conn(0x7f6ed00fc2a0 msgr2=0x7f6ed00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:24:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.773+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3958197479 shutdown_connections 2024-09-12T01:24:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.773+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3958197479 wait complete. 2024-09-12T01:24:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed7c23640 1 Processor -- start 2024-09-12T01:24:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed7c23640 1 -- start start 2024-09-12T01:24:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed7c23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed0100b10 0x7f6ed006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:24:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed7c23640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ed0101d10 0x7f6ed019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:24:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed7c23640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed01026d0 0x7f6ed019f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:24:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed7c23640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed010c770 con 0x7f6ed0100b10 2024-09-12T01:24:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed7c23640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed010c5f0 con 0x7f6ed0101d10 2024-09-12T01:24:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed7c23640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed010c8f0 con 0x7f6ed01026d0 2024-09-12T01:24:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed51be640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ed0101d10 0x7f6ed019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:24:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed51be640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ed0101d10 0x7f6ed019cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54318/0 (socket says 172.21.15.100:54318) 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed51be640 1 -- 172.21.15.100:0/3979048306 learned_addr learned my addr 172.21.15.100:0/3979048306 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed59bf640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed0100b10 0x7f6ed006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed61c0640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed01026d0 0x7f6ed019f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed51be640 1 -- 172.21.15.100:0/3979048306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed01026d0 msgr2=0x7f6ed019f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed51be640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed01026d0 0x7f6ed019f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed51be640 1 -- 172.21.15.100:0/3979048306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed0100b10 msgr2=0x7f6ed006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed51be640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed0100b10 0x7f6ed006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed51be640 1 -- 172.21.15.100:0/3979048306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed019fb30 con 0x7f6ed0101d10 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.774+0000 7f6ed51be640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ed0101d10 0x7f6ed019cc00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009230 tx=0x7f6ecc004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.775+0000 7f6ec6ffd640 1 -- 172.21.15.100:0/3979048306 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc03f030 con 0x7f6ed0101d10 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.775+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3979048306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed019fd60 con 0x7f6ed0101d10 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.775+0000 7f6ec6ffd640 1 -- 172.21.15.100:0/3979048306 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ecc003ce0 con 0x7f6ed0101d10 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.775+0000 7f6ec6ffd640 1 -- 172.21.15.100:0/3979048306 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc035070 con 0x7f6ed0101d10 2024-09-12T01:24:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.775+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3979048306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed01a01e0 con 0x7f6ed0101d10 2024-09-12T01:24:34.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.776+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3979048306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed0107f10 con 0x7f6ed0101d10 2024-09-12T01:24:34.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.777+0000 7f6ec6ffd640 1 -- 172.21.15.100:0/3979048306 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6ecc042030 con 0x7f6ed0101d10 2024-09-12T01:24:34.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.777+0000 7f6ec6ffd640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6ebc0a2b80 0x7f6ebc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:24:34.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.778+0000 7f6ec6ffd640 1 -- 172.21.15.100:0/3979048306 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5981+0+0 (secure 0 0 0) 0x7f6ecc0ef040 con 0x7f6ed0101d10 2024-09-12T01:24:34.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.778+0000 7f6ed59bf640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6ebc0a2b80 0x7f6ebc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:24:34.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.778+0000 7f6ed59bf640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6ebc0a2b80 0x7f6ebc0a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0101b70 tx=0x7f6ec000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:24:34.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.781+0000 7f6ec6ffd640 1 -- 172.21.15.100:0/3979048306 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6ecc0bc270 con 0x7f6ed0101d10 2024-09-12T01:24:34.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:34.957+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3979048306 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6ed0062630 con 0x7f6ebc0a2b80 2024-09-12T01:24:35.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:35 smithi100 ceph-mon[35275]: Detected new or changed devices on smithi081 2024-09-12T01:24:35.676 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:35 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-12T01:24:35.676 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:35 smithi100 ceph-mon[35275]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:35.676 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:35.676 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:24:35.676 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:24:35.676 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:35.676 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:35 smithi081 ceph-mon[30920]: Detected new or changed devices on smithi081 2024-09-12T01:24:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:35 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-12T01:24:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:35 smithi081 ceph-mon[30920]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:24:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:24:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:35.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:35 smithi189 ceph-mon[35357]: Detected new or changed devices on smithi081 2024-09-12T01:24:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:35 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-12T01:24:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:35 smithi189 ceph-mon[35357]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:24:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:24:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:36.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:36.694 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:36 smithi100 ceph-mon[35275]: purged_snaps scrub starts 2024-09-12T01:24:36.694 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:36 smithi100 ceph-mon[35275]: purged_snaps scrub ok 2024-09-12T01:24:36.694 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:36 smithi100 ceph-mon[35275]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:24:36.694 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:36 smithi100 ceph-mon[35275]: osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782] boot 2024-09-12T01:24:36.694 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:36 smithi100 ceph-mon[35275]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T01:24:36.694 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:36 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:36.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:36 smithi081 ceph-mon[30920]: purged_snaps scrub starts 2024-09-12T01:24:36.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:36 smithi081 ceph-mon[30920]: purged_snaps scrub ok 2024-09-12T01:24:36.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:36 smithi081 ceph-mon[30920]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:24:36.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:36 smithi081 ceph-mon[30920]: osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782] boot 2024-09-12T01:24:36.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:36 smithi081 ceph-mon[30920]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T01:24:36.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:36 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:36.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:36 smithi189 ceph-mon[35357]: purged_snaps scrub starts 2024-09-12T01:24:36.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:36 smithi189 ceph-mon[35357]: purged_snaps scrub ok 2024-09-12T01:24:36.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:36 smithi189 ceph-mon[35357]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:24:36.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:36 smithi189 ceph-mon[35357]: osd.9 [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782] boot 2024-09-12T01:24:36.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:36 smithi189 ceph-mon[35357]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T01:24:36.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:36 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:24:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:37 smithi081 ceph-mon[30920]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:37 smithi081 ceph-mon[30920]: osdmap e63: 10 total, 10 up, 10 in 2024-09-12T01:24:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:37 smithi081 ceph-mon[30920]: from='client.? 172.21.15.100:0/309995277' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8"}]: dispatch 2024-09-12T01:24:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:37 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8"}]: dispatch 2024-09-12T01:24:37.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:37 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8"}]': finished 2024-09-12T01:24:37.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:37 smithi081 ceph-mon[30920]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T01:24:37.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:24:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:37 smithi100 ceph-mon[35275]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:37 smithi100 ceph-mon[35275]: osdmap e63: 10 total, 10 up, 10 in 2024-09-12T01:24:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:37 smithi100 ceph-mon[35275]: from='client.? 172.21.15.100:0/309995277' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8"}]: dispatch 2024-09-12T01:24:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:37 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8"}]: dispatch 2024-09-12T01:24:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:37 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8"}]': finished 2024-09-12T01:24:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:37 smithi100 ceph-mon[35275]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T01:24:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:37 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:24:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:37 smithi189 ceph-mon[35357]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:24:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:37 smithi189 ceph-mon[35357]: osdmap e63: 10 total, 10 up, 10 in 2024-09-12T01:24:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:37 smithi189 ceph-mon[35357]: from='client.? 172.21.15.100:0/309995277' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8"}]: dispatch 2024-09-12T01:24:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:37 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8"}]: dispatch 2024-09-12T01:24:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:37 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8"}]': finished 2024-09-12T01:24:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:37 smithi189 ceph-mon[35357]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T01:24:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:37 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:24:38.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:38 smithi100 ceph-mon[35275]: from='client.? 172.21.15.100:0/1448960553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:24:38.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:38 smithi189 ceph-mon[35357]: from='client.? 172.21.15.100:0/1448960553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:24:38.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:38 smithi081 ceph-mon[30920]: from='client.? 172.21.15.100:0/1448960553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:24:39.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:39 smithi100 ceph-mon[35275]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:39.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:39 smithi189 ceph-mon[35357]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:39.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:39 smithi081 ceph-mon[30920]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:41.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:41 smithi100 ceph-mon[35275]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:41.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:41 smithi189 ceph-mon[35357]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:41.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:41 smithi081 ceph-mon[30920]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:43.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:43 smithi100 ceph-mon[35275]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:43.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:43 smithi189 ceph-mon[35357]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:43.790 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:43 smithi081 ceph-mon[30920]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:45.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:45 smithi100 ceph-mon[35275]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:45.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:45 smithi189 ceph-mon[35357]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:45.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:45 smithi081 ceph-mon[30920]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:46.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:46 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T01:24:46.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:46 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:46.820 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:46 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T01:24:46.821 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:46 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:46.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:46 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T01:24:46.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:46 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:47.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:47 smithi100 ceph-mon[35275]: Deploying daemon osd.10 on smithi100 2024-09-12T01:24:47.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:47 smithi100 ceph-mon[35275]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:47 smithi189 ceph-mon[35357]: Deploying daemon osd.10 on smithi100 2024-09-12T01:24:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:47 smithi189 ceph-mon[35357]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:47.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:47 smithi081 ceph-mon[30920]: Deploying daemon osd.10 on smithi100 2024-09-12T01:24:47.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:47 smithi081 ceph-mon[30920]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:49.728 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:49 smithi100 ceph-mon[35275]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:49 smithi189 ceph-mon[35357]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:49.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:49 smithi081 ceph-mon[30920]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:51.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:51 smithi189 ceph-mon[35357]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:51.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:51 smithi081 ceph-mon[30920]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:52.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:51 smithi100 ceph-mon[35275]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:52.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:52 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:52.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:52 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:52.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:52 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:52.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:52 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:52.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:52 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:52.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:52 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:52.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:52 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:52.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:52 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:52.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:52 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:53.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:53 smithi100 ceph-mon[35275]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:53 smithi189 ceph-mon[35357]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:53.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:53 smithi081 ceph-mon[30920]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:55.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:55.141+0000 7f6ec6ffd640 1 -- 172.21.15.100:0/3979048306 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f6ed0062630 con 0x7f6ebc0a2b80 2024-09-12T01:24:55.141 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 10 on host 'smithi100' 2024-09-12T01:24:55.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:55.143+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3979048306 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6ebc0a2b80 msgr2=0x7f6ebc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:55.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:55.143+0000 7f6ed7c23640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6ebc0a2b80 0x7f6ebc0a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0101b70 tx=0x7f6ec000b390 comp rx=0 tx=0).stop 2024-09-12T01:24:55.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:55.143+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3979048306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ed0101d10 msgr2=0x7f6ed019cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:55.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:55.143+0000 7f6ed7c23640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ed0101d10 0x7f6ed019cc00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009230 tx=0x7f6ecc004360 comp rx=0 tx=0).stop 2024-09-12T01:24:55.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:55.144+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3979048306 shutdown_connections 2024-09-12T01:24:55.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:55.144+0000 7f6ed7c23640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6ebc0a2b80 0x7f6ebc0a5040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:55.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:55.144+0000 7f6ed7c23640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ed01026d0 0x7f6ed019f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:55.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:55.144+0000 7f6ed7c23640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ed0101d10 0x7f6ed019cc00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:55.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:55.144+0000 7f6ed7c23640 1 --2- 172.21.15.100:0/3979048306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed0100b10 0x7f6ed006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:55.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:55.144+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3979048306 >> 172.21.15.100:0/3979048306 conn(0x7f6ed00fc2a0 msgr2=0x7f6ed01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:24:55.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:55.144+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3979048306 shutdown_connections 2024-09-12T01:24:55.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-12T01:24:55.144+0000 7f6ed7c23640 1 -- 172.21.15.100:0/3979048306 wait complete. 2024-09-12T01:24:55.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:55 smithi100 ceph-mon[35275]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:55.756 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:55.756 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:55.756 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:55.756 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:55 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:55.786 DEBUG:teuthology.orchestra.run.smithi100:osd.10> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T01:24:55.789 INFO:tasks.cephadm:Deploying osd.11 on smithi189 with /dev/vg_nvme/lv_1... 2024-09-12T01:24:55.789 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T01:24:55.817 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:55 smithi189 ceph-mon[35357]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:55.817 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:55.817 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:55.817 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:55.817 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:55 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:55.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:55 smithi081 ceph-mon[30920]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:55.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:55.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:55.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:55.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:55 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:56.047 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:24:57.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:57 smithi189 ceph-mon[35357]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:57.956 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:57 smithi100 ceph-mon[35275]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:57.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:57 smithi081 ceph-mon[30920]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:58.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:24:58 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:24:58.047+0000 7f464d37e640 -1 osd.10 0 log_to_monitors true 2024-09-12T01:24:58.627 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:58 smithi100 ceph-mon[35275]: from='osd.10 [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:24:58.628 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:58 smithi100 ceph-mon[35275]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:24:58.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:58 smithi189 ceph-mon[35357]: from='osd.10 [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:24:58.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:58 smithi189 ceph-mon[35357]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:24:58.804 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-12T01:24:58.830 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_1 2024-09-12T01:24:58.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:58 smithi081 ceph-mon[30920]: from='osd.10 [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:24:58.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:58 smithi081 ceph-mon[30920]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:24:59.137 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:24:59.588 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.581+0000 7f35523ad640 1 -- 172.21.15.189:0/1533947518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f354c102e00 msgr2=0x7f354c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:59.588 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.581+0000 7f35523ad640 1 --2- 172.21.15.189:0/1533947518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f354c102e00 0x7f354c103280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3540009900 tx=0x7f354002a410 comp rx=0 tx=0).stop 2024-09-12T01:24:59.588 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 -- 172.21.15.189:0/1533947518 shutdown_connections 2024-09-12T01:24:59.588 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 --2- 172.21.15.189:0/1533947518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c1037c0 0x7f354c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:59.588 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 --2- 172.21.15.189:0/1533947518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f354c102e00 0x7f354c103280 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:59.589 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 --2- 172.21.15.189:0/1533947518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354c101c00 0x7f354c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:59.589 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 -- 172.21.15.189:0/1533947518 >> 172.21.15.189:0/1533947518 conn(0x7f354c0fd390 msgr2=0x7f354c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:24:59.589 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 -- 172.21.15.189:0/1533947518 shutdown_connections 2024-09-12T01:24:59.589 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 -- 172.21.15.189:0/1533947518 wait complete. 2024-09-12T01:24:59.589 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 Processor -- start 2024-09-12T01:24:59.589 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 -- start start 2024-09-12T01:24:59.589 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c101c00 0x7f354c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:24:59.589 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f354c102e00 0x7f354c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:24:59.589 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354c1037c0 0x7f354c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:24:59.589 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f354c10d860 con 0x7f354c101c00 2024-09-12T01:24:59.589 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f354c10d6e0 con 0x7f354c1037c0 2024-09-12T01:24:59.590 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.582+0000 7f35523ad640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f354c10d9e0 con 0x7f354c102e00 2024-09-12T01:24:59.590 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f354b7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f354c102e00 0x7f354c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:24:59.590 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f354b7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f354c102e00 0x7f354c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:37474/0 (socket says 172.21.15.189:37474) 2024-09-12T01:24:59.590 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f354b7fe640 1 -- 172.21.15.189:0/2795692071 learned_addr learned my addr 172.21.15.189:0/2795692071 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:24:59.590 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f354bfff640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c101c00 0x7f354c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:24:59.590 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f355094a640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354c1037c0 0x7f354c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:24:59.590 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f354b7fe640 1 -- 172.21.15.189:0/2795692071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354c1037c0 msgr2=0x7f354c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:59.590 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f354b7fe640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354c1037c0 0x7f354c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:59.590 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f354b7fe640 1 -- 172.21.15.189:0/2795692071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c101c00 msgr2=0x7f354c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:24:59.590 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f354b7fe640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c101c00 0x7f354c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:24:59.590 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f354b7fe640 1 -- 172.21.15.189:0/2795692071 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354c0753e0 con 0x7f354c102e00 2024-09-12T01:24:59.590 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f354b7fe640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f354c102e00 0x7f354c0745e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3540009230 tx=0x7f3540031b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:24:59.591 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f35497fa640 1 -- 172.21.15.189:0/2795692071 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354003f030 con 0x7f354c102e00 2024-09-12T01:24:59.591 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f35497fa640 1 -- 172.21.15.189:0/2795692071 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3540003ad0 con 0x7f354c102e00 2024-09-12T01:24:59.591 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f35523ad640 1 -- 172.21.15.189:0/2795692071 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f354c1a2010 con 0x7f354c102e00 2024-09-12T01:24:59.591 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f35497fa640 1 -- 172.21.15.189:0/2795692071 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540035070 con 0x7f354c102e00 2024-09-12T01:24:59.591 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.583+0000 7f35523ad640 1 -- 172.21.15.189:0/2795692071 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f354c1a24c0 con 0x7f354c102e00 2024-09-12T01:24:59.591 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.584+0000 7f35523ad640 1 -- 172.21.15.189:0/2795692071 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f354c109050 con 0x7f354c102e00 2024-09-12T01:24:59.591 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.586+0000 7f35497fa640 1 -- 172.21.15.189:0/2795692071 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3540042030 con 0x7f354c102e00 2024-09-12T01:24:59.591 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.586+0000 7f35497fa640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f35340a2b80 0x7f35340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:24:59.591 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.586+0000 7f35497fa640 1 -- 172.21.15.189:0/2795692071 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6414+0+0 (secure 0 0 0) 0x7f35400ef150 con 0x7f354c102e00 2024-09-12T01:24:59.591 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.587+0000 7f354bfff640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f35340a2b80 0x7f35340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:24:59.591 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.587+0000 7f354bfff640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f35340a2b80 0x7f35340a5040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f354c102c60 tx=0x7f353c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:24:59.592 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.590+0000 7f35497fa640 1 -- 172.21.15.189:0/2795692071 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35400bc1d0 con 0x7f354c102e00 2024-09-12T01:24:59.765 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:24:59.765+0000 7f35523ad640 1 -- 172.21.15.189:0/2795692071 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f354c062630 con 0x7f35340a2b80 2024-09-12T01:24:59.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:24:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T01:24:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='osd.10 [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:24:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T01:24:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:24:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:24:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:24:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:24:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:24:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:24:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:24:59.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:24:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:00.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:25:00.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T01:25:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='osd.10 [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:25:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T01:25:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:25:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:25:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:25:00.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:00.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:25:00.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:00.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:25:00.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:24:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:25:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T01:25:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='osd.10 [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:25:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T01:25:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:25:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-12T01:25:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:00.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:00.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:00.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:00.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:00.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:00.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:00.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:25:00.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:00.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:25:00.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:00.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:25:00.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:24:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:00.768 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:25:00 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:25:00.444+0000 7f4648ade640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T01:25:00.769 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:25:00 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:25:00.466+0000 7f4641110640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:25:00.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:00 smithi100 ceph-mon[35275]: Detected new or changed devices on smithi100 2024-09-12T01:25:00.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:00 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-12T01:25:00.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:00 smithi100 ceph-mon[35275]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:25:00.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:00 smithi100 ceph-mon[35275]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T01:25:00.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:00 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:25:00.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:00 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:25:00.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:00 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:25:00.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:00 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:25:00.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:00 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:00.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:00 smithi100 ceph-mon[35275]: from='osd.10 ' entity='osd.10' 2024-09-12T01:25:00.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:00 smithi189 ceph-mon[35357]: Detected new or changed devices on smithi100 2024-09-12T01:25:00.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:00 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-12T01:25:00.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:00 smithi189 ceph-mon[35357]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:25:00.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:00 smithi189 ceph-mon[35357]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T01:25:00.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:00 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:25:00.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:00 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:25:00.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:00 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:25:00.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:00 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:25:00.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:00 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:00.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:00 smithi189 ceph-mon[35357]: from='osd.10 ' entity='osd.10' 2024-09-12T01:25:00.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:00 smithi081 ceph-mon[30920]: Detected new or changed devices on smithi100 2024-09-12T01:25:00.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:00 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-12T01:25:00.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:00 smithi081 ceph-mon[30920]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-12T01:25:00.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:00 smithi081 ceph-mon[30920]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T01:25:00.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:00 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:25:00.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:00 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:25:00.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:00 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:25:00.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:00 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:25:00.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:00 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:00.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:00 smithi081 ceph-mon[30920]: from='osd.10 ' entity='osd.10' 2024-09-12T01:25:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:01 smithi189 ceph-mon[35357]: purged_snaps scrub starts 2024-09-12T01:25:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:01 smithi189 ceph-mon[35357]: purged_snaps scrub ok 2024-09-12T01:25:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:01 smithi189 ceph-mon[35357]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:25:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:01 smithi189 ceph-mon[35357]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:25:01.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:01 smithi189 ceph-mon[35357]: osd.10 [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568] boot 2024-09-12T01:25:01.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:01 smithi189 ceph-mon[35357]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T01:25:01.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:01 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:25:01.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:01 smithi081 ceph-mon[30920]: purged_snaps scrub starts 2024-09-12T01:25:01.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:01 smithi081 ceph-mon[30920]: purged_snaps scrub ok 2024-09-12T01:25:01.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:01 smithi081 ceph-mon[30920]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:25:01.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:01 smithi081 ceph-mon[30920]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:25:01.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:01 smithi081 ceph-mon[30920]: osd.10 [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568] boot 2024-09-12T01:25:01.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:01 smithi081 ceph-mon[30920]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T01:25:01.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:01 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:25:02.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:01 smithi100 ceph-mon[35275]: purged_snaps scrub starts 2024-09-12T01:25:02.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:01 smithi100 ceph-mon[35275]: purged_snaps scrub ok 2024-09-12T01:25:02.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:01 smithi100 ceph-mon[35275]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:25:02.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:01 smithi100 ceph-mon[35275]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:25:02.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:01 smithi100 ceph-mon[35275]: osd.10 [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568] boot 2024-09-12T01:25:02.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:01 smithi100 ceph-mon[35275]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T01:25:02.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:01 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:25:02.713 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:02 smithi189 ceph-mon[35357]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T01:25:02.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:02 smithi189 ceph-mon[35357]: from='client.? 172.21.15.189:0/2301054064' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f051e2b2-fc58-489a-ab7c-8c1ff5448553"}]: dispatch 2024-09-12T01:25:02.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:02 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f051e2b2-fc58-489a-ab7c-8c1ff5448553"}]: dispatch 2024-09-12T01:25:02.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:02 smithi189 ceph-mon[35357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f051e2b2-fc58-489a-ab7c-8c1ff5448553"}]': finished 2024-09-12T01:25:02.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:02 smithi189 ceph-mon[35357]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T01:25:02.714 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:02 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:02.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:02 smithi081 ceph-mon[30920]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T01:25:02.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:02 smithi081 ceph-mon[30920]: from='client.? 172.21.15.189:0/2301054064' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f051e2b2-fc58-489a-ab7c-8c1ff5448553"}]: dispatch 2024-09-12T01:25:02.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:02 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f051e2b2-fc58-489a-ab7c-8c1ff5448553"}]: dispatch 2024-09-12T01:25:02.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:02 smithi081 ceph-mon[30920]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f051e2b2-fc58-489a-ab7c-8c1ff5448553"}]': finished 2024-09-12T01:25:02.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:02 smithi081 ceph-mon[30920]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T01:25:02.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:02 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:03.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:02 smithi100 ceph-mon[35275]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T01:25:03.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:02 smithi100 ceph-mon[35275]: from='client.? 172.21.15.189:0/2301054064' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f051e2b2-fc58-489a-ab7c-8c1ff5448553"}]: dispatch 2024-09-12T01:25:03.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:02 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f051e2b2-fc58-489a-ab7c-8c1ff5448553"}]: dispatch 2024-09-12T01:25:03.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:02 smithi100 ceph-mon[35275]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f051e2b2-fc58-489a-ab7c-8c1ff5448553"}]': finished 2024-09-12T01:25:03.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:02 smithi100 ceph-mon[35275]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T01:25:03.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:02 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:03.920 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:03 smithi100 ceph-mon[35275]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 723 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:03.920 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:03 smithi100 ceph-mon[35275]: from='client.? 172.21.15.189:0/3802913170' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:25:03.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:03 smithi081 ceph-mon[30920]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 723 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:03.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:03 smithi081 ceph-mon[30920]: from='client.? 172.21.15.189:0/3802913170' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:25:04.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:03 smithi189 ceph-mon[35357]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 723 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:04.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:03 smithi189 ceph-mon[35357]: from='client.? 172.21.15.189:0/3802913170' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:25:04.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:04 smithi081 ceph-mon[30920]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T01:25:04.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:04 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:05.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:04 smithi100 ceph-mon[35275]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T01:25:05.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:04 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:05.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:04 smithi189 ceph-mon[35357]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T01:25:05.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:04 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:05 smithi081 ceph-mon[30920]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 723 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:05 smithi081 ceph-mon[30920]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T01:25:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:06.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:05 smithi100 ceph-mon[35275]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 723 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:06.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:05 smithi100 ceph-mon[35275]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T01:25:06.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:05 smithi189 ceph-mon[35357]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 723 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:05 smithi189 ceph-mon[35357]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T01:25:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:06.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:06 smithi081 ceph-mon[30920]: pgmap v232: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:07.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:06 smithi100 ceph-mon[35275]: pgmap v232: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:07.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:06 smithi189 ceph-mon[35357]: pgmap v232: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:09.596 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:09 smithi189 ceph-mon[35357]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-12T01:25:09.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:09 smithi081 ceph-mon[30920]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-12T01:25:09.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:09 smithi100 ceph-mon[35275]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-12T01:25:11.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:11 smithi189 ceph-mon[35357]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:25:11.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T01:25:11.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:11.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:11 smithi189 ceph-mon[35357]: Deploying daemon osd.11 on smithi189 2024-09-12T01:25:11.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:11 smithi081 ceph-mon[30920]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:25:11.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T01:25:11.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:11.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:11 smithi081 ceph-mon[30920]: Deploying daemon osd.11 on smithi189 2024-09-12T01:25:11.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:11 smithi100 ceph-mon[35275]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:25:11.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:11 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T01:25:11.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:11 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:11.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:11 smithi100 ceph-mon[35275]: Deploying daemon osd.11 on smithi189 2024-09-12T01:25:13.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:13 smithi081 ceph-mon[30920]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-12T01:25:13.755 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:13 smithi189 ceph-mon[35357]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-12T01:25:13.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:13 smithi100 ceph-mon[35275]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-12T01:25:15.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:15 smithi081 ceph-mon[30920]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:25:15.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:15 smithi100 ceph-mon[35275]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:25:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:15 smithi189 ceph-mon[35357]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:25:16.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:16 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:25:16.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:16 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:16.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:16 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:16.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:16 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:25:16.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:16 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:16.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:16 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:16.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:16 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:25:16.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:16 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:16.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:16 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:17.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:17 smithi081 ceph-mon[30920]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-12T01:25:17.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:17 smithi100 ceph-mon[35275]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-12T01:25:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:17 smithi189 ceph-mon[35357]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-12T01:25:19.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:19 smithi189 ceph-mon[35357]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:25:19.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:19.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:19.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:19.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:25:19.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:19.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:19 smithi100 ceph-mon[35275]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:25:19.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:19.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:19.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:19.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:25:19.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:19.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:19 smithi081 ceph-mon[30920]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:25:19.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:19.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:19.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:19.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:25:19.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:20.177 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 11 on host 'smithi189' 2024-09-12T01:25:20.177 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:20.177+0000 7f35497fa640 1 -- 172.21.15.189:0/2795692071 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f354c062630 con 0x7f35340a2b80 2024-09-12T01:25:20.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:20.180+0000 7f35523ad640 1 -- 172.21.15.189:0/2795692071 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f35340a2b80 msgr2=0x7f35340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:20.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:20.180+0000 7f35523ad640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f35340a2b80 0x7f35340a5040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f354c102c60 tx=0x7f353c00b390 comp rx=0 tx=0).stop 2024-09-12T01:25:20.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:20.180+0000 7f35523ad640 1 -- 172.21.15.189:0/2795692071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f354c102e00 msgr2=0x7f354c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:20.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:20.180+0000 7f35523ad640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f354c102e00 0x7f354c0745e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3540009230 tx=0x7f3540031b60 comp rx=0 tx=0).stop 2024-09-12T01:25:20.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:20.180+0000 7f35523ad640 1 -- 172.21.15.189:0/2795692071 shutdown_connections 2024-09-12T01:25:20.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:20.180+0000 7f35523ad640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f35340a2b80 0x7f35340a5040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:20.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:20.180+0000 7f35523ad640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354c1037c0 0x7f354c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:20.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:20.180+0000 7f35523ad640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f354c102e00 0x7f354c0745e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:20.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:20.180+0000 7f35523ad640 1 --2- 172.21.15.189:0/2795692071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354c101c00 0x7f354c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:20.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:20.180+0000 7f35523ad640 1 -- 172.21.15.189:0/2795692071 >> 172.21.15.189:0/2795692071 conn(0x7f354c0fd390 msgr2=0x7f354c106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:20.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:20.180+0000 7f35523ad640 1 -- 172.21.15.189:0/2795692071 shutdown_connections 2024-09-12T01:25:20.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:20.180+0000 7f35523ad640 1 -- 172.21.15.189:0/2795692071 wait complete. 2024-09-12T01:25:20.768 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:20 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:25:20.769 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:20 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:20.769 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:20 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:20.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:20 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:25:20.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:20 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:20.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:20 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:20.795 DEBUG:teuthology.orchestra.run.smithi189:osd.11> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T01:25:20.798 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T01:25:20.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T01:25:20.827 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:20 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:25:20.827 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:20 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:20.827 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:20 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:25:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.499+0000 7fe04b3a9640 1 -- 172.21.15.81:0/1844277732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe044100ad0 msgr2=0x7fe044100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.499+0000 7fe04b3a9640 1 --2- 172.21.15.81:0/1844277732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe044100ad0 0x7fe044100ed0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe040009900 tx=0x7fe04002a410 comp rx=0 tx=0).stop 2024-09-12T01:25:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.499+0000 7fe04b3a9640 1 -- 172.21.15.81:0/1844277732 shutdown_connections 2024-09-12T01:25:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.499+0000 7fe04b3a9640 1 --2- 172.21.15.81:0/1844277732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe044102690 0x7fe044108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.499+0000 7fe04b3a9640 1 --2- 172.21.15.81:0/1844277732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe044101cd0 0x7fe044102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.499+0000 7fe04b3a9640 1 --2- 172.21.15.81:0/1844277732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe044100ad0 0x7fe044100ed0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.499+0000 7fe04b3a9640 1 -- 172.21.15.81:0/1844277732 >> 172.21.15.81:0/1844277732 conn(0x7fe0440fc280 msgr2=0x7fe0440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.499+0000 7fe04b3a9640 1 -- 172.21.15.81:0/1844277732 shutdown_connections 2024-09-12T01:25:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.499+0000 7fe04b3a9640 1 -- 172.21.15.81:0/1844277732 wait complete. 2024-09-12T01:25:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe04b3a9640 1 Processor -- start 2024-09-12T01:25:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe04b3a9640 1 -- start start 2024-09-12T01:25:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe04b3a9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe044100ad0 0x7fe044197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe04b3a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe044101cd0 0x7fe044198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe04b3a9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe044102690 0x7fe04419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe04b3a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe04410c750 con 0x7fe044101cd0 2024-09-12T01:25:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe04b3a9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe04410c5d0 con 0x7fe044102690 2024-09-12T01:25:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe04b3a9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe04410c8d0 con 0x7fe044100ad0 2024-09-12T01:25:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe048944640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe044101cd0 0x7fe044198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe048944640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe044101cd0 0x7fe044198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40442/0 (socket says 172.21.15.81:40442) 2024-09-12T01:25:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe048944640 1 -- 172.21.15.81:0/2993107944 learned_addr learned my addr 172.21.15.81:0/2993107944 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:25:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe049145640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe044100ad0 0x7fe044197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe049946640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe044102690 0x7fe04419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe048944640 1 -- 172.21.15.81:0/2993107944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe044100ad0 msgr2=0x7fe044197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe048944640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe044100ad0 0x7fe044197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe048944640 1 -- 172.21.15.81:0/2993107944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe044102690 msgr2=0x7fe04419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe048944640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe044102690 0x7fe04419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe048944640 1 -- 172.21.15.81:0/2993107944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04419fb60 con 0x7fe044101cd0 2024-09-12T01:25:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.500+0000 7fe048944640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe044101cd0 0x7fe044198470 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe03400e9f0 tx=0x7fe03400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.501+0000 7fe03a7fc640 1 -- 172.21.15.81:0/2993107944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03400cd80 con 0x7fe044101cd0 2024-09-12T01:25:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.501+0000 7fe04b3a9640 1 -- 172.21.15.81:0/2993107944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04419fe50 con 0x7fe044101cd0 2024-09-12T01:25:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.501+0000 7fe03a7fc640 1 -- 172.21.15.81:0/2993107944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe034005500 con 0x7fe044101cd0 2024-09-12T01:25:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.501+0000 7fe03a7fc640 1 -- 172.21.15.81:0/2993107944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034010690 con 0x7fe044101cd0 2024-09-12T01:25:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.501+0000 7fe04b3a9640 1 -- 172.21.15.81:0/2993107944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0441a0300 con 0x7fe044101cd0 2024-09-12T01:25:21.504 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:21 smithi081 ceph-mon[30920]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.502+0000 7fe04b3a9640 1 -- 172.21.15.81:0/2993107944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0441a05f0 con 0x7fe044101cd0 2024-09-12T01:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.503+0000 7fe03a7fc640 1 -- 172.21.15.81:0/2993107944 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe0340046c0 con 0x7fe044101cd0 2024-09-12T01:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.504+0000 7fe03a7fc640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe0300a2bb0 0x7fe0300a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.504+0000 7fe049145640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe0300a2bb0 0x7fe0300a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.504+0000 7fe03a7fc640 1 -- 172.21.15.81:0/2993107944 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7fe0340ceeb0 con 0x7fe044101cd0 2024-09-12T01:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.504+0000 7fe049145640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe0300a2bb0 0x7fe0300a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe040005ab0 tx=0x7fe040000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:21.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.508+0000 7fe03a7fc640 1 -- 172.21.15.81:0/2993107944 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe03409c3f0 con 0x7fe044101cd0 2024-09-12T01:25:21.666 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:21 smithi189 ceph-mon[35357]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.675+0000 7fe04b3a9640 1 -- 172.21.15.81:0/2993107944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe0441a07c0 con 0x7fe044101cd0 2024-09-12T01:25:21.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.676+0000 7fe03a7fc640 1 -- 172.21.15.81:0/2993107944 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fe03409bcf0 con 0x7fe044101cd0 2024-09-12T01:25:21.675 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:25:21.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.678+0000 7fe04b3a9640 1 -- 172.21.15.81:0/2993107944 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe0300a2bb0 msgr2=0x7fe0300a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:21.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.678+0000 7fe04b3a9640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe0300a2bb0 0x7fe0300a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe040005ab0 tx=0x7fe040000bc0 comp rx=0 tx=0).stop 2024-09-12T01:25:21.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.678+0000 7fe04b3a9640 1 -- 172.21.15.81:0/2993107944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe044101cd0 msgr2=0x7fe044198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:21.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.678+0000 7fe04b3a9640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe044101cd0 0x7fe044198470 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe03400e9f0 tx=0x7fe03400edf0 comp rx=0 tx=0).stop 2024-09-12T01:25:21.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.678+0000 7fe04b3a9640 1 -- 172.21.15.81:0/2993107944 shutdown_connections 2024-09-12T01:25:21.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.678+0000 7fe04b3a9640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe0300a2bb0 0x7fe0300a5070 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:21.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.678+0000 7fe04b3a9640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe044102690 0x7fe04419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:21.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.678+0000 7fe04b3a9640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe044101cd0 0x7fe044198470 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:21.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.678+0000 7fe04b3a9640 1 --2- 172.21.15.81:0/2993107944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe044100ad0 0x7fe044197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:21.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.678+0000 7fe04b3a9640 1 -- 172.21.15.81:0/2993107944 >> 172.21.15.81:0/2993107944 conn(0x7fe0440fc280 msgr2=0x7fe044069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:21.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.678+0000 7fe04b3a9640 1 -- 172.21.15.81:0/2993107944 shutdown_connections 2024-09-12T01:25:21.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:21.678+0000 7fe04b3a9640 1 -- 172.21.15.81:0/2993107944 wait complete. 2024-09-12T01:25:21.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:21 smithi100 ceph-mon[35275]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:22.384 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726104300,"num_in_osds":12,"osd_in_since":1726104302,"num_remapped_pgs":0} 2024-09-12T01:25:22.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:22 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2993107944' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:25:22.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:22 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2993107944' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:25:22.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:22 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2993107944' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:25:23.282 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:25:22 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:25:22.791+0000 7f16adfe9640 -1 osd.11 0 log_to_monitors true 2024-09-12T01:25:23.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T01:25:23.591 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:23 smithi189 ceph-mon[35357]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:23.591 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:23 smithi189 ceph-mon[35357]: from='osd.11 [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:25:23.591 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:23 smithi189 ceph-mon[35357]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:25:23.652 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:25:23.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:23 smithi081 ceph-mon[30920]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:23.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:23 smithi081 ceph-mon[30920]: from='osd.11 [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:25:23.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:23 smithi081 ceph-mon[30920]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:25:23.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:23 smithi100 ceph-mon[35275]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:23.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:23 smithi100 ceph-mon[35275]: from='osd.11 [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:25:23.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:23 smithi100 ceph-mon[35275]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:25:24.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.071+0000 7f7a21708640 1 -- 172.21.15.81:0/3226260354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a1c100b00 msgr2=0x7f7a1c100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:24.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.071+0000 7f7a21708640 1 --2- 172.21.15.81:0/3226260354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a1c100b00 0x7f7a1c100f00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009900 tx=0x7f7a0c02a410 comp rx=0 tx=0).stop 2024-09-12T01:25:24.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.071+0000 7f7a21708640 1 -- 172.21.15.81:0/3226260354 shutdown_connections 2024-09-12T01:25:24.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.071+0000 7f7a21708640 1 --2- 172.21.15.81:0/3226260354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a1c1026c0 0x7f7a1c108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:24.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.071+0000 7f7a21708640 1 --2- 172.21.15.81:0/3226260354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a1c101d00 0x7f7a1c102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.071+0000 7f7a21708640 1 --2- 172.21.15.81:0/3226260354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a1c100b00 0x7f7a1c100f00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.071+0000 7f7a21708640 1 -- 172.21.15.81:0/3226260354 >> 172.21.15.81:0/3226260354 conn(0x7f7a1c0fc270 msgr2=0x7f7a1c0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.071+0000 7f7a21708640 1 -- 172.21.15.81:0/3226260354 shutdown_connections 2024-09-12T01:25:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.071+0000 7f7a21708640 1 -- 172.21.15.81:0/3226260354 wait complete. 2024-09-12T01:25:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.071+0000 7f7a21708640 1 Processor -- start 2024-09-12T01:25:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a21708640 1 -- start start 2024-09-12T01:25:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a21708640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a1c100b00 0x7f7a1c06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a21708640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a1c101d00 0x7f7a1c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a21708640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a1c1026c0 0x7f7a1c19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a21708640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c10c800 con 0x7f7a1c100b00 2024-09-12T01:25:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a21708640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c10c680 con 0x7f7a1c101d00 2024-09-12T01:25:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a21708640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c10c980 con 0x7f7a1c1026c0 2024-09-12T01:25:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a1affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a1c100b00 0x7f7a1c06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a1affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a1c100b00 0x7f7a1c06b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37480/0 (socket says 172.21.15.81:37480) 2024-09-12T01:25:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a1affd640 1 -- 172.21.15.81:0/2104522609 learned_addr learned my addr 172.21.15.81:0/2104522609 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:25:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a1a7fc640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a1c101d00 0x7f7a1c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a1b7fe640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a1c1026c0 0x7f7a1c19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a1affd640 1 -- 172.21.15.81:0/2104522609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a1c1026c0 msgr2=0x7f7a1c19f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a1affd640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a1c1026c0 0x7f7a1c19f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a1affd640 1 -- 172.21.15.81:0/2104522609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a1c101d00 msgr2=0x7f7a1c19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a1affd640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a1c101d00 0x7f7a1c19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a1affd640 1 -- 172.21.15.81:0/2104522609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1c19fca0 con 0x7f7a1c100b00 2024-09-12T01:25:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.072+0000 7f7a1b7fe640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a1c1026c0 0x7f7a1c19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:25:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.073+0000 7f7a1affd640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a1c100b00 0x7f7a1c06b2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c006010 tx=0x7f7a0c031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.073+0000 7f7a03fff640 1 -- 172.21.15.81:0/2104522609 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c03f030 con 0x7f7a1c100b00 2024-09-12T01:25:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.073+0000 7f7a21708640 1 -- 172.21.15.81:0/2104522609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1c196b40 con 0x7f7a1c100b00 2024-09-12T01:25:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.073+0000 7f7a03fff640 1 -- 172.21.15.81:0/2104522609 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a0c0044a0 con 0x7f7a1c100b00 2024-09-12T01:25:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.073+0000 7f7a03fff640 1 -- 172.21.15.81:0/2104522609 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c035070 con 0x7f7a1c100b00 2024-09-12T01:25:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.073+0000 7f7a21708640 1 -- 172.21.15.81:0/2104522609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1c1970a0 con 0x7f7a1c100b00 2024-09-12T01:25:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.074+0000 7f7a21708640 1 -- 172.21.15.81:0/2104522609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a1c107fc0 con 0x7f7a1c100b00 2024-09-12T01:25:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.075+0000 7f7a03fff640 1 -- 172.21.15.81:0/2104522609 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7a0c042030 con 0x7f7a1c100b00 2024-09-12T01:25:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.075+0000 7f7a03fff640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f7a040a2b80 0x7f7a040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.076+0000 7f7a03fff640 1 -- 172.21.15.81:0/2104522609 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6831+0+0 (secure 0 0 0) 0x7f7a0c0ef040 con 0x7f7a1c100b00 2024-09-12T01:25:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.076+0000 7f7a1a7fc640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f7a040a2b80 0x7f7a040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.076+0000 7f7a1a7fc640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f7a040a2b80 0x7f7a040a5040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c06b870 tx=0x7f7a1000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.080+0000 7f7a03fff640 1 -- 172.21.15.81:0/2104522609 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a0c0bc570 con 0x7f7a1c100b00 2024-09-12T01:25:24.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.244+0000 7f7a21708640 1 -- 172.21.15.81:0/2104522609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7a1c02da10 con 0x7f7a1c100b00 2024-09-12T01:25:24.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.245+0000 7f7a03fff640 1 -- 172.21.15.81:0/2104522609 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f7a0c0bbe70 con 0x7f7a1c100b00 2024-09-12T01:25:24.244 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:25:24.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.247+0000 7f7a21708640 1 -- 172.21.15.81:0/2104522609 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f7a040a2b80 msgr2=0x7f7a040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:24.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.247+0000 7f7a21708640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f7a040a2b80 0x7f7a040a5040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c06b870 tx=0x7f7a1000b390 comp rx=0 tx=0).stop 2024-09-12T01:25:24.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.247+0000 7f7a21708640 1 -- 172.21.15.81:0/2104522609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a1c100b00 msgr2=0x7f7a1c06b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:24.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.247+0000 7f7a21708640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a1c100b00 0x7f7a1c06b2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c006010 tx=0x7f7a0c031b60 comp rx=0 tx=0).stop 2024-09-12T01:25:24.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.247+0000 7f7a21708640 1 -- 172.21.15.81:0/2104522609 shutdown_connections 2024-09-12T01:25:24.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.247+0000 7f7a21708640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f7a040a2b80 0x7f7a040a5040 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:24.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.247+0000 7f7a21708640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a1c1026c0 0x7f7a1c19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:24.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.247+0000 7f7a21708640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a1c101d00 0x7f7a1c19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:24.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.247+0000 7f7a21708640 1 --2- 172.21.15.81:0/2104522609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a1c100b00 0x7f7a1c06b2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:24.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.247+0000 7f7a21708640 1 -- 172.21.15.81:0/2104522609 >> 172.21.15.81:0/2104522609 conn(0x7f7a1c0fc270 msgr2=0x7f7a1c105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:24.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.247+0000 7f7a21708640 1 -- 172.21.15.81:0/2104522609 shutdown_connections 2024-09-12T01:25:24.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:24.247+0000 7f7a21708640 1 -- 172.21.15.81:0/2104522609 wait complete. 2024-09-12T01:25:24.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T01:25:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='osd.11 [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:25:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T01:25:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:25:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:25:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2104522609' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:25:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T01:25:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:24 smithi100 ceph-mon[35275]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T01:25:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T01:25:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='osd.11 [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:25:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T01:25:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:25:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:25:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2104522609' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:25:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T01:25:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:24 smithi189 ceph-mon[35357]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T01:25:24.792 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T01:25:24.792 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='osd.11 [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:25:24.792 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T01:25:24.792 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:24.792 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-12T01:25:24.792 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:24.792 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:24.792 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:24.793 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:24.793 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:24.793 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:25:24.793 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:24.793 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:24.793 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:25:24.793 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:24.793 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2104522609' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:25:24.793 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-12T01:25:24.793 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:24 smithi081 ceph-mon[30920]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T01:25:24.925 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726104300,"num_in_osds":12,"osd_in_since":1726104302,"num_remapped_pgs":0} 2024-09-12T01:25:25.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:25 smithi100 ceph-mon[35275]: Detected new or changed devices on smithi189 2024-09-12T01:25:25.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:25 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-12T01:25:25.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:25 smithi100 ceph-mon[35275]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:25.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:25.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:25.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:25 smithi100 ceph-mon[35275]: from='osd.11 ' entity='osd.11' 2024-09-12T01:25:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:25 smithi189 ceph-mon[35357]: Detected new or changed devices on smithi189 2024-09-12T01:25:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:25 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-12T01:25:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:25 smithi189 ceph-mon[35357]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:25 smithi189 ceph-mon[35357]: from='osd.11 ' entity='osd.11' 2024-09-12T01:25:25.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:25:25 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:25:25.323+0000 7f16a9749640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T01:25:25.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:25:25 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:25:25.338+0000 7f16a1d7b640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:25:25.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T01:25:25.954 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:25 smithi081 ceph-mon[30920]: Detected new or changed devices on smithi189 2024-09-12T01:25:25.954 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:25 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-12T01:25:25.954 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:25 smithi081 ceph-mon[30920]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:25.954 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:25.954 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:25.954 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:25 smithi081 ceph-mon[30920]: from='osd.11 ' entity='osd.11' 2024-09-12T01:25:26.181 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:25:26.567 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:26 smithi081 ceph-mon[30920]: purged_snaps scrub starts 2024-09-12T01:25:26.567 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:26 smithi081 ceph-mon[30920]: purged_snaps scrub ok 2024-09-12T01:25:26.567 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:26 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:26.567 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:26 smithi081 ceph-mon[30920]: osd.11 [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978] boot 2024-09-12T01:25:26.567 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:26 smithi081 ceph-mon[30920]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T01:25:26.567 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:26 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:26.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.648+0000 7f6bc8568640 1 -- 172.21.15.81:0/1304488576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0101cd0 msgr2=0x7f6bc0102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.648+0000 7f6bc8568640 1 --2- 172.21.15.81:0/1304488576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0101cd0 0x7f6bc0102150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009900 tx=0x7f6bb002a410 comp rx=0 tx=0).stop 2024-09-12T01:25:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.648+0000 7f6bc8568640 1 -- 172.21.15.81:0/1304488576 shutdown_connections 2024-09-12T01:25:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.648+0000 7f6bc8568640 1 --2- 172.21.15.81:0/1304488576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc0102690 0x7f6bc0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.648+0000 7f6bc8568640 1 --2- 172.21.15.81:0/1304488576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0101cd0 0x7f6bc0102150 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.648+0000 7f6bc8568640 1 --2- 172.21.15.81:0/1304488576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc0100ad0 0x7f6bc0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.648+0000 7f6bc8568640 1 -- 172.21.15.81:0/1304488576 >> 172.21.15.81:0/1304488576 conn(0x7f6bc00fc280 msgr2=0x7f6bc00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.648+0000 7f6bc8568640 1 -- 172.21.15.81:0/1304488576 shutdown_connections 2024-09-12T01:25:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.648+0000 7f6bc8568640 1 -- 172.21.15.81:0/1304488576 wait complete. 2024-09-12T01:25:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.648+0000 7f6bc8568640 1 Processor -- start 2024-09-12T01:25:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.648+0000 7f6bc8568640 1 -- start start 2024-09-12T01:25:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.648+0000 7f6bc8568640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0100ad0 0x7f6bc0196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc8568640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc0101cd0 0x7f6bc01972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc8568640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc0102690 0x7f6bc019e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc8568640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc010c750 con 0x7f6bc0100ad0 2024-09-12T01:25:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc8568640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc010c5d0 con 0x7f6bc0102690 2024-09-12T01:25:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc8568640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc010c8d0 con 0x7f6bc0101cd0 2024-09-12T01:25:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc6304640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0100ad0 0x7f6bc0196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc6304640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0100ad0 0x7f6bc0196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37502/0 (socket says 172.21.15.81:37502) 2024-09-12T01:25:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc6304640 1 -- 172.21.15.81:0/23224909 learned_addr learned my addr 172.21.15.81:0/23224909 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:25:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc5b03640 1 --2- 172.21.15.81:0/23224909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc0101cd0 0x7f6bc01972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc6304640 1 -- 172.21.15.81:0/23224909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc0101cd0 msgr2=0x7f6bc01972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc6304640 1 --2- 172.21.15.81:0/23224909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc0101cd0 0x7f6bc01972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc6304640 1 -- 172.21.15.81:0/23224909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc0102690 msgr2=0x7f6bc019e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc6304640 1 --2- 172.21.15.81:0/23224909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc0102690 0x7f6bc019e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc6304640 1 -- 172.21.15.81:0/23224909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc019e9d0 con 0x7f6bc0100ad0 2024-09-12T01:25:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc6304640 1 --2- 172.21.15.81:0/23224909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0100ad0 0x7f6bc0196da0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc007920 tx=0x7f6bbc007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bb77fe640 1 -- 172.21.15.81:0/23224909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc019070 con 0x7f6bc0100ad0 2024-09-12T01:25:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bb77fe640 1 -- 172.21.15.81:0/23224909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bbc005020 con 0x7f6bc0100ad0 2024-09-12T01:25:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc8568640 1 -- 172.21.15.81:0/23224909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc0069fd0 con 0x7f6bc0100ad0 2024-09-12T01:25:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bb77fe640 1 -- 172.21.15.81:0/23224909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc004ad0 con 0x7f6bc0100ad0 2024-09-12T01:25:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.649+0000 7f6bc8568640 1 -- 172.21.15.81:0/23224909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc006a4e0 con 0x7f6bc0100ad0 2024-09-12T01:25:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.650+0000 7f6bc8568640 1 -- 172.21.15.81:0/23224909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc0100ed0 con 0x7f6bc0100ad0 2024-09-12T01:25:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.651+0000 7f6bb77fe640 1 -- 172.21.15.81:0/23224909 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6bbc01c070 con 0x7f6bc0100ad0 2024-09-12T01:25:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.652+0000 7f6bb77fe640 1 --2- 172.21.15.81:0/23224909 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6bac0a2c30 0x7f6bac0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.653+0000 7f6bc5b03640 1 --2- 172.21.15.81:0/23224909 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6bac0a2c30 0x7f6bac0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.653+0000 7f6bb77fe640 1 -- 172.21.15.81:0/23224909 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f6bbc0cfc80 con 0x7f6bc0100ad0 2024-09-12T01:25:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.653+0000 7f6bc5b03640 1 --2- 172.21.15.81:0/23224909 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6bac0a2c30 0x7f6bac0a50f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0000c00 tx=0x7f6bb0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.656+0000 7f6bb77fe640 1 -- 172.21.15.81:0/23224909 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6bbc09d080 con 0x7f6bc0100ad0 2024-09-12T01:25:26.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:26 smithi100 ceph-mon[35275]: purged_snaps scrub starts 2024-09-12T01:25:26.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:26 smithi100 ceph-mon[35275]: purged_snaps scrub ok 2024-09-12T01:25:26.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:26 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:26.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:26 smithi100 ceph-mon[35275]: osd.11 [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978] boot 2024-09-12T01:25:26.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:26 smithi100 ceph-mon[35275]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T01:25:26.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:26 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:26.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:26 smithi189 ceph-mon[35357]: purged_snaps scrub starts 2024-09-12T01:25:26.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:26 smithi189 ceph-mon[35357]: purged_snaps scrub ok 2024-09-12T01:25:26.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:26 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:26.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:26 smithi189 ceph-mon[35357]: osd.11 [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978] boot 2024-09-12T01:25:26.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:26 smithi189 ceph-mon[35357]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T01:25:26.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:26 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:25:26.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.822+0000 7f6bc8568640 1 -- 172.21.15.81:0/23224909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6bc019ec60 con 0x7f6bc0100ad0 2024-09-12T01:25:26.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.823+0000 7f6bb77fe640 1 -- 172.21.15.81:0/23224909 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f6bbc09c980 con 0x7f6bc0100ad0 2024-09-12T01:25:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:25:26.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.824+0000 7f6bc8568640 1 -- 172.21.15.81:0/23224909 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6bac0a2c30 msgr2=0x7f6bac0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:26.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.824+0000 7f6bc8568640 1 --2- 172.21.15.81:0/23224909 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6bac0a2c30 0x7f6bac0a50f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0000c00 tx=0x7f6bb0031400 comp rx=0 tx=0).stop 2024-09-12T01:25:26.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.824+0000 7f6bc8568640 1 -- 172.21.15.81:0/23224909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0100ad0 msgr2=0x7f6bc0196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:26.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.824+0000 7f6bc8568640 1 --2- 172.21.15.81:0/23224909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0100ad0 0x7f6bc0196da0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc007920 tx=0x7f6bbc007de0 comp rx=0 tx=0).stop 2024-09-12T01:25:26.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.825+0000 7f6bc8568640 1 -- 172.21.15.81:0/23224909 shutdown_connections 2024-09-12T01:25:26.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.825+0000 7f6bc8568640 1 --2- 172.21.15.81:0/23224909 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6bac0a2c30 0x7f6bac0a50f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:26.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.825+0000 7f6bc8568640 1 --2- 172.21.15.81:0/23224909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc0102690 0x7f6bc019e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:26.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.825+0000 7f6bc8568640 1 --2- 172.21.15.81:0/23224909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc0101cd0 0x7f6bc01972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:26.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.825+0000 7f6bc8568640 1 --2- 172.21.15.81:0/23224909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc0100ad0 0x7f6bc0196da0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:26.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.825+0000 7f6bc8568640 1 -- 172.21.15.81:0/23224909 >> 172.21.15.81:0/23224909 conn(0x7f6bc00fc280 msgr2=0x7f6bc01050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:26.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.825+0000 7f6bc8568640 1 -- 172.21.15.81:0/23224909 shutdown_connections 2024-09-12T01:25:26.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:26.825+0000 7f6bc8568640 1 -- 172.21.15.81:0/23224909 wait complete. 2024-09-12T01:25:27.450 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1726104326,"num_in_osds":12,"osd_in_since":1726104302,"num_remapped_pgs":0} 2024-09-12T01:25:27.451 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:25:27.735 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:25:27.737 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:27 smithi081 ceph-mon[30920]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:27.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:27 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/23224909' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:25:27.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:27 smithi100 ceph-mon[35275]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:27.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:27 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/23224909' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:25:27.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:27 smithi189 ceph-mon[35357]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:25:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:27 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/23224909' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:25:28.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.188+0000 7f38084ff640 1 -- 172.21.15.81:0/3754715458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3800102ef0 msgr2=0x7f380010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:28.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.188+0000 7f38084ff640 1 --2- 172.21.15.81:0/3754715458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3800102ef0 0x7f380010da40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009ca0 tx=0x7f37f002a950 comp rx=0 tx=0).stop 2024-09-12T01:25:28.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.188+0000 7f38084ff640 1 -- 172.21.15.81:0/3754715458 shutdown_connections 2024-09-12T01:25:28.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.188+0000 7f38084ff640 1 --2- 172.21.15.81:0/3754715458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3800102ef0 0x7f380010da40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:28.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.188+0000 7f38084ff640 1 --2- 172.21.15.81:0/3754715458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3800102570 0x7f38001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:28.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.188+0000 7f38084ff640 1 --2- 172.21.15.81:0/3754715458 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3800100e20 0x7f3800101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:28.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.188+0000 7f38084ff640 1 -- 172.21.15.81:0/3754715458 >> 172.21.15.81:0/3754715458 conn(0x7f38000fc7d0 msgr2=0x7f38000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:28.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.188+0000 7f38084ff640 1 -- 172.21.15.81:0/3754715458 shutdown_connections 2024-09-12T01:25:28.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.188+0000 7f38084ff640 1 -- 172.21.15.81:0/3754715458 wait complete. 2024-09-12T01:25:28.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.188+0000 7f38084ff640 1 Processor -- start 2024-09-12T01:25:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.188+0000 7f38084ff640 1 -- start start 2024-09-12T01:25:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f38084ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3800100e20 0x7f38001993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f38084ff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3800102570 0x7f3800199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f38084ff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3800102ef0 0x7f3800199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f38084ff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3800110f80 con 0x7f3800100e20 2024-09-12T01:25:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f38084ff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3800110e00 con 0x7f3800102570 2024-09-12T01:25:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f38084ff640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3800111100 con 0x7f3800102ef0 2024-09-12T01:25:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f380629b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3800100e20 0x7f38001993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f380629b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3800100e20 0x7f38001993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37518/0 (socket says 172.21.15.81:37518) 2024-09-12T01:25:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f380629b640 1 -- 172.21.15.81:0/2273502112 learned_addr learned my addr 172.21.15.81:0/2273502112 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:25:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f3805a9a640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3800102570 0x7f3800199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f3806a9c640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3800102ef0 0x7f3800199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f380629b640 1 -- 172.21.15.81:0/2273502112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3800102ef0 msgr2=0x7f3800199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f380629b640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3800102ef0 0x7f3800199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f380629b640 1 -- 172.21.15.81:0/2273502112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3800102570 msgr2=0x7f3800199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f380629b640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3800102570 0x7f3800199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f380629b640 1 -- 172.21.15.81:0/2273502112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38001a47d0 con 0x7f3800100e20 2024-09-12T01:25:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f3805a9a640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3800102570 0x7f3800199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:25:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f3806a9c640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3800102ef0 0x7f3800199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:25:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f380629b640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3800100e20 0x7f38001993d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f37f800d770 tx=0x7f37f800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f37ff7fe640 1 -- 172.21.15.81:0/2273502112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f8017070 con 0x7f3800100e20 2024-09-12T01:25:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f38084ff640 1 -- 172.21.15.81:0/2273502112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38001a4ac0 con 0x7f3800100e20 2024-09-12T01:25:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f37ff7fe640 1 -- 172.21.15.81:0/2273502112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37f8005500 con 0x7f3800100e20 2024-09-12T01:25:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f37ff7fe640 1 -- 172.21.15.81:0/2273502112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f8004e00 con 0x7f3800100e20 2024-09-12T01:25:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.189+0000 7f38084ff640 1 -- 172.21.15.81:0/2273502112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38001a4fb0 con 0x7f3800100e20 2024-09-12T01:25:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.190+0000 7f38084ff640 1 -- 172.21.15.81:0/2273502112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3800101200 con 0x7f3800100e20 2024-09-12T01:25:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.191+0000 7f37ff7fe640 1 -- 172.21.15.81:0/2273502112 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f37f8004fa0 con 0x7f3800100e20 2024-09-12T01:25:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.192+0000 7f37ff7fe640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f37e80a2b80 0x7f37e80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.192+0000 7f3805a9a640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f37e80a2b80 0x7f37e80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.192+0000 7f37ff7fe640 1 -- 172.21.15.81:0/2273502112 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f37f80ce6d0 con 0x7f3800100e20 2024-09-12T01:25:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.192+0000 7f3805a9a640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f37e80a2b80 0x7f37e80a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37f4005fd0 tx=0x7f37f40094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.196+0000 7f37ff7fe640 1 -- 172.21.15.81:0/2273502112 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f37f809bad0 con 0x7f3800100e20 2024-09-12T01:25:28.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.364+0000 7f38084ff640 1 -- 172.21.15.81:0/2273502112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3800109090 con 0x7f3800100e20 2024-09-12T01:25:28.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.364+0000 7f37ff7fe640 1 -- 172.21.15.81:0/2273502112 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18470 (secure 0 0 0) 0x7f37f809b3d0 con 0x7f3800100e20 2024-09-12T01:25:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:25:28.364 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","created":"2024-09-12T01:18:28.404285+0000","modified":"2024-09-12T01:25:27.510107+0000","last_up_change":"2024-09-12T01:25:26.326110+0000","last_in_change":"2024-09-12T01:25:02.138698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:21:40.649584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc857dd4-eedc-4c48-89a0-4e69662e8e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6803","nonce":3870994528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6805","nonce":3870994528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6809","nonce":3870994528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6807","nonce":3870994528}]},"public_addr":"172.21.15.81:6803/3870994528","cluster_addr":"172.21.15.81:6805/3870994528","heartbeat_back_addr":"172.21.15.81:6809/3870994528","heartbeat_front_addr":"172.21.15.81:6807/3870994528","state":["exists","up"]},{"osd":1,"uuid":"04b8111b-d677-4fc8-8285-90683621ccf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6801","nonce":2098299652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6803","nonce":2098299652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6807","nonce":2098299652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6805","nonce":2098299652}]},"public_addr":"172.21.15.100:6801/2098299652","cluster_addr":"172.21.15.100:6803/2098299652","heartbeat_back_addr":"172.21.15.100:6807/2098299652","heartbeat_front_addr":"172.21.15.100:6805/2098299652","state":["exists","up"]},{"osd":2,"uuid":"763e357e-5a04-45ff-95e8-bc1abfeac056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6801","nonce":1353548110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6803","nonce":1353548110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6807","nonce":1353548110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6805","nonce":1353548110}]},"public_addr":"172.21.15.189:6801/1353548110","cluster_addr":"172.21.15.189:6803/1353548110","heartbeat_back_addr":"172.21.15.189:6807/1353548110","heartbeat_front_addr":"172.21.15.189:6805/1353548110","state":["exists","up"]},{"osd":3,"uuid":"99843578-1b9e-4ee0-91f1-ba419d07897e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6811","nonce":1064869637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6813","nonce":1064869637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6817","nonce":1064869637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6815","nonce":1064869637}]},"public_addr":"172.21.15.81:6811/1064869637","cluster_addr":"172.21.15.81:6813/1064869637","heartbeat_back_addr":"172.21.15.81:6817/1064869637","heartbeat_front_addr":"172.21.15.81:6815/1064869637","state":["exists","up"]},{"osd":4,"uuid":"a5787415-0905-420e-9ce8-eb6902727561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6809","nonce":1687792282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6811","nonce":1687792282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6815","nonce":1687792282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6813","nonce":1687792282}]},"public_addr":"172.21.15.100:6809/1687792282","cluster_addr":"172.21.15.100:6811/1687792282","heartbeat_back_addr":"172.21.15.100:6815/1687792282","heartbeat_front_addr":"172.21.15.100:6813/1687792282","state":["exists","up"]},{"osd":5,"uuid":"879548b5-5516-407c-8517-bbdbf356c0e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6809","nonce":823474396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6811","nonce":823474396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6815","nonce":823474396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6813","nonce":823474396}]},"public_addr":"172.21.15.189:6809/823474396","cluster_addr":"172.21.15.189:6811/823474396","heartbeat_back_addr":"172.21.15.189:6815/823474396","heartbeat_front_addr":"172.21.15.189:6813/823474396","state":["exists","up"]},{"osd":6,"uuid":"b665b97c-a9d3-475f-93f3-8a920cbb37d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6819","nonce":1522854005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6821","nonce":1522854005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6825","nonce":1522854005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6823","nonce":1522854005}]},"public_addr":"172.21.15.81:6819/1522854005","cluster_addr":"172.21.15.81:6821/1522854005","heartbeat_back_addr":"172.21.15.81:6825/1522854005","heartbeat_front_addr":"172.21.15.81:6823/1522854005","state":["exists","up"]},{"osd":7,"uuid":"46e082c8-d071-471a-8c86-ce5b5700cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6817","nonce":41478541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6819","nonce":41478541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6823","nonce":41478541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6821","nonce":41478541}]},"public_addr":"172.21.15.100:6817/41478541","cluster_addr":"172.21.15.100:6819/41478541","heartbeat_back_addr":"172.21.15.100:6823/41478541","heartbeat_front_addr":"172.21.15.100:6821/41478541","state":["exists","up"]},{"osd":8,"uuid":"fb9b93ef-5a33-4ffc-926e-a78c101bbbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6817","nonce":180766860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6819","nonce":180766860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6823","nonce":180766860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6821","nonce":180766860}]},"public_addr":"172.21.15.189:6817/180766860","cluster_addr":"172.21.15.189:6819/180766860","heartbeat_back_addr":"172.21.15.189:6823/180766860","heartbeat_front_addr":"172.21.15.189:6821/180766860","state":["exists","up"]},{"osd":9,"uuid":"0b7ec1a1-5ab9-4075-acfb-e0d82f018656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6827","nonce":1651232782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6829","nonce":1651232782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6833","nonce":1651232782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6831","nonce":1651232782}]},"public_addr":"172.21.15.81:6827/1651232782","cluster_addr":"172.21.15.81:6829/1651232782","heartbeat_back_addr":"172.21.15.81:6833/1651232782","heartbeat_front_addr":"172.21.15.81:6831/1651232782","state":["exists","up"]},{"osd":10,"uuid":"996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6825","nonce":3295868568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6827","nonce":3295868568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6831","nonce":3295868568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6829","nonce":3295868568}]},"public_addr":"172.21.15.100:6825/3295868568","cluster_addr":"172.21.15.100:6827/3295868568","heartbeat_back_addr":"172.21.15.100:6831/3295868568","heartbeat_front_addr":"172.21.15.100:6829/3295868568","state":["exists","up"]},{"osd":11,"uuid":"f051e2b2-fc58-489a-ab7c-8c1ff5448553","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6825","nonce":3852230978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6827","nonce":3852230978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6831","nonce":3852230978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6829","nonce":3852230978}]},"public_addr":"172.21.15.189:6825/3852230978","cluster_addr":"172.21.15.189:6827/3852230978","heartbeat_back_addr":"172.21.15.189:6831/3852230978","heartbeat_front_addr":"172.21.15.189:6829/3852230978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:20:47.371696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:12.762376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:37.936648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:03.950352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:28.922754+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:54.252149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:18.421479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:43.989505+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:08.789671+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:34.336367+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:59.089601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:25:23.761934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/4128337402":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/1460332159":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2577694203":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2393807982":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/2162789959":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/4219073331":"2024-09-13T01:19:00.926419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:25:28.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.367+0000 7f38084ff640 1 -- 172.21.15.81:0/2273502112 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f37e80a2b80 msgr2=0x7f37e80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:28.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.367+0000 7f38084ff640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f37e80a2b80 0x7f37e80a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37f4005fd0 tx=0x7f37f40094d0 comp rx=0 tx=0).stop 2024-09-12T01:25:28.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.367+0000 7f38084ff640 1 -- 172.21.15.81:0/2273502112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3800100e20 msgr2=0x7f38001993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:28.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.367+0000 7f38084ff640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3800100e20 0x7f38001993d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f37f800d770 tx=0x7f37f800dc30 comp rx=0 tx=0).stop 2024-09-12T01:25:28.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.367+0000 7f38084ff640 1 -- 172.21.15.81:0/2273502112 shutdown_connections 2024-09-12T01:25:28.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.367+0000 7f38084ff640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f37e80a2b80 0x7f37e80a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:28.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.367+0000 7f38084ff640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3800102ef0 0x7f3800199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:28.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.367+0000 7f38084ff640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3800102570 0x7f3800199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:28.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.367+0000 7f38084ff640 1 --2- 172.21.15.81:0/2273502112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3800100e20 0x7f38001993d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:28.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.367+0000 7f38084ff640 1 -- 172.21.15.81:0/2273502112 >> 172.21.15.81:0/2273502112 conn(0x7f38000fc7d0 msgr2=0x7f38001068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:28.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.367+0000 7f38084ff640 1 -- 172.21.15.81:0/2273502112 shutdown_connections 2024-09-12T01:25:28.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:28.367+0000 7f38084ff640 1 -- 172.21.15.81:0/2273502112 wait complete. 2024-09-12T01:25:28.669 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:28 smithi081 ceph-mon[30920]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T01:25:28.669 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:28 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2273502112' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:25:28.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:28 smithi189 ceph-mon[35357]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T01:25:28.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:28 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2273502112' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:25:28.975 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:21:40.649584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:25:28.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T01:25:29.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:28 smithi100 ceph-mon[35275]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T01:25:29.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:28 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2273502112' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:25:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:25:29.640 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:29 smithi081 ceph-mon[30920]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.723+0000 7f5f0f57e640 1 -- 172.21.15.81:0/886782833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f08106ed0 msgr2=0x7f5f0810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.723+0000 7f5f0f57e640 1 --2- 172.21.15.81:0/886782833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f08106ed0 0x7f5f0810eaa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009ca0 tx=0x7f5f0002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:25:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.723+0000 7f5f0f57e640 1 -- 172.21.15.81:0/886782833 shutdown_connections 2024-09-12T01:25:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.723+0000 7f5f0f57e640 1 --2- 172.21.15.81:0/886782833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f08106ed0 0x7f5f0810eaa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.723+0000 7f5f0f57e640 1 --2- 172.21.15.81:0/886782833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f08100eb0 0x7f5f081067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.723+0000 7f5f0f57e640 1 --2- 172.21.15.81:0/886782833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f08100500 0x7f5f081008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.723+0000 7f5f0f57e640 1 -- 172.21.15.81:0/886782833 >> 172.21.15.81:0/886782833 conn(0x7f5f080fc5c0 msgr2=0x7f5f080fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.723+0000 7f5f0f57e640 1 -- 172.21.15.81:0/886782833 shutdown_connections 2024-09-12T01:25:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.723+0000 7f5f0f57e640 1 -- 172.21.15.81:0/886782833 wait complete. 2024-09-12T01:25:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0f57e640 1 Processor -- start 2024-09-12T01:25:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0f57e640 1 -- start start 2024-09-12T01:25:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0f57e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f08100500 0x7f5f08101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0f57e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f08100eb0 0x7f5f081019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0f57e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f08106ed0 0x7f5f08101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0f57e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5f08111fa0 con 0x7f5f08100eb0 2024-09-12T01:25:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0f57e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5f08111e20 con 0x7f5f08106ed0 2024-09-12T01:25:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0f57e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5f08112120 con 0x7f5f08100500 2024-09-12T01:25:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0cb19640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f08100eb0 0x7f5f081019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0cb19640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f08100eb0 0x7f5f081019c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37536/0 (socket says 172.21.15.81:37536) 2024-09-12T01:25:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0cb19640 1 -- 172.21.15.81:0/3104276619 learned_addr learned my addr 172.21.15.81:0/3104276619 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:25:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0db1b640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f08106ed0 0x7f5f08101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0cb19640 1 -- 172.21.15.81:0/3104276619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f08100500 msgr2=0x7f5f08101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0d31a640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f08100500 0x7f5f08101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0cb19640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f08100500 0x7f5f08101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0cb19640 1 -- 172.21.15.81:0/3104276619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f08106ed0 msgr2=0x7f5f08101f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0cb19640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f08106ed0 0x7f5f08101f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0cb19640 1 -- 172.21.15.81:0/3104276619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f081a6960 con 0x7f5f08100eb0 2024-09-12T01:25:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.724+0000 7f5f0db1b640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f08106ed0 0x7f5f08101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:25:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.725+0000 7f5f0cb19640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f08100eb0 0x7f5f081019c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400c890 tx=0x7f5f0400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.725+0000 7f5efa7fc640 1 -- 172.21.15.81:0/3104276619 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f04004220 con 0x7f5f08100eb0 2024-09-12T01:25:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.725+0000 7f5efa7fc640 1 -- 172.21.15.81:0/3104276619 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f040043c0 con 0x7f5f08100eb0 2024-09-12T01:25:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.725+0000 7f5f0f57e640 1 -- 172.21.15.81:0/3104276619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f081a6c50 con 0x7f5f08100eb0 2024-09-12T01:25:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.725+0000 7f5efa7fc640 1 -- 172.21.15.81:0/3104276619 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f040049e0 con 0x7f5f08100eb0 2024-09-12T01:25:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.725+0000 7f5f0f57e640 1 -- 172.21.15.81:0/3104276619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f081a7190 con 0x7f5f08100eb0 2024-09-12T01:25:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.726+0000 7f5f0f57e640 1 -- 172.21.15.81:0/3104276619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f081008e0 con 0x7f5f08100eb0 2024-09-12T01:25:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.727+0000 7f5efa7fc640 1 -- 172.21.15.81:0/3104276619 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5f040079b0 con 0x7f5f08100eb0 2024-09-12T01:25:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.728+0000 7f5efa7fc640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5ef40a2c00 0x7f5ef40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.728+0000 7f5f0d31a640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5ef40a2c00 0x7f5ef40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.728+0000 7f5efa7fc640 1 -- 172.21.15.81:0/3104276619 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f5f040cecd0 con 0x7f5f08100eb0 2024-09-12T01:25:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.728+0000 7f5f0d31a640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5ef40a2c00 0x7f5ef40a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00a810 tx=0x7f5efc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.732+0000 7f5efa7fc640 1 -- 172.21.15.81:0/3104276619 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f04014030 con 0x7f5f08100eb0 2024-09-12T01:25:29.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:29 smithi189 ceph-mon[35357]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:29.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.899+0000 7f5f0f57e640 1 -- 172.21.15.81:0/3104276619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5f0810a170 con 0x7f5f08100eb0 2024-09-12T01:25:29.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.900+0000 7f5efa7fc640 1 -- 172.21.15.81:0/3104276619 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f5f0409c030 con 0x7f5f08100eb0 2024-09-12T01:25:29.899 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-12T01:25:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.902+0000 7f5f0f57e640 1 -- 172.21.15.81:0/3104276619 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5ef40a2c00 msgr2=0x7f5ef40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.902+0000 7f5f0f57e640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5ef40a2c00 0x7f5ef40a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00a810 tx=0x7f5efc008040 comp rx=0 tx=0).stop 2024-09-12T01:25:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.902+0000 7f5f0f57e640 1 -- 172.21.15.81:0/3104276619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f08100eb0 msgr2=0x7f5f081019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.902+0000 7f5f0f57e640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f08100eb0 0x7f5f081019c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400c890 tx=0x7f5f0400cd50 comp rx=0 tx=0).stop 2024-09-12T01:25:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.902+0000 7f5f0f57e640 1 -- 172.21.15.81:0/3104276619 shutdown_connections 2024-09-12T01:25:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.902+0000 7f5f0f57e640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5ef40a2c00 0x7f5ef40a50c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.902+0000 7f5f0f57e640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f08106ed0 0x7f5f08101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.902+0000 7f5f0f57e640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f08100eb0 0x7f5f081019c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.902+0000 7f5f0f57e640 1 --2- 172.21.15.81:0/3104276619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f08100500 0x7f5f08101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.902+0000 7f5f0f57e640 1 -- 172.21.15.81:0/3104276619 >> 172.21.15.81:0/3104276619 conn(0x7f5f080fc5c0 msgr2=0x7f5f081056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.902+0000 7f5f0f57e640 1 -- 172.21.15.81:0/3104276619 shutdown_connections 2024-09-12T01:25:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:29.902+0000 7f5f0f57e640 1 -- 172.21.15.81:0/3104276619 wait complete. 2024-09-12T01:25:30.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:29 smithi100 ceph-mon[35275]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:30.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:30 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3104276619' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:25:30.733 INFO:tasks.cephadm:Adding mds.a on smithi081 2024-09-12T01:25:30.734 INFO:tasks.cephadm:Adding mds.d on smithi081 2024-09-12T01:25:30.734 INFO:tasks.cephadm:Adding mds.g on smithi081 2024-09-12T01:25:30.734 INFO:tasks.cephadm:Adding mds.j on smithi081 2024-09-12T01:25:30.734 INFO:tasks.cephadm:Adding mds.b on smithi100 2024-09-12T01:25:30.734 INFO:tasks.cephadm:Adding mds.e on smithi100 2024-09-12T01:25:30.734 INFO:tasks.cephadm:Adding mds.h on smithi100 2024-09-12T01:25:30.734 INFO:tasks.cephadm:Adding mds.k on smithi100 2024-09-12T01:25:30.734 INFO:tasks.cephadm:Adding mds.c on smithi189 2024-09-12T01:25:30.734 INFO:tasks.cephadm:Adding mds.f on smithi189 2024-09-12T01:25:30.734 INFO:tasks.cephadm:Adding mds.i on smithi189 2024-09-12T01:25:30.734 INFO:tasks.cephadm:Adding mds.l on smithi189 2024-09-12T01:25:30.735 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l' 2024-09-12T01:25:30.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:30 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3104276619' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:25:30.996 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:25:31.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:30 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3104276619' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:25:31.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.447+0000 7f3924dd9640 1 -- 172.21.15.189:0/2046429079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3920100ad0 msgr2=0x7f3920100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:31.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.447+0000 7f3924dd9640 1 --2- 172.21.15.189:0/2046429079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3920100ad0 0x7f3920100ed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3910009900 tx=0x7f391002a410 comp rx=0 tx=0).stop 2024-09-12T01:25:31.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.447+0000 7f3924dd9640 1 -- 172.21.15.189:0/2046429079 shutdown_connections 2024-09-12T01:25:31.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.447+0000 7f3924dd9640 1 --2- 172.21.15.189:0/2046429079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3920102690 0x7f3920108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:31.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.447+0000 7f3924dd9640 1 --2- 172.21.15.189:0/2046429079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3920101cd0 0x7f3920102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:31.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.447+0000 7f3924dd9640 1 --2- 172.21.15.189:0/2046429079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3920100ad0 0x7f3920100ed0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:31.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.447+0000 7f3924dd9640 1 -- 172.21.15.189:0/2046429079 >> 172.21.15.189:0/2046429079 conn(0x7f39200fc280 msgr2=0x7f39200fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:31.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.447+0000 7f3924dd9640 1 -- 172.21.15.189:0/2046429079 shutdown_connections 2024-09-12T01:25:31.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.447+0000 7f3924dd9640 1 -- 172.21.15.189:0/2046429079 wait complete. 2024-09-12T01:25:31.448 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f3924dd9640 1 Processor -- start 2024-09-12T01:25:31.448 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f3924dd9640 1 -- start start 2024-09-12T01:25:31.448 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f3924dd9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3920100ad0 0x7f3920197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:31.449 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f3924dd9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3920101cd0 0x7f3920198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:31.449 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f3924dd9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3920102690 0x7f392019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:31.449 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f3924dd9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f392010c750 con 0x7f3920100ad0 2024-09-12T01:25:31.449 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f3924dd9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f392010c5d0 con 0x7f3920101cd0 2024-09-12T01:25:31.449 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f3924dd9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f392010c8d0 con 0x7f3920102690 2024-09-12T01:25:31.449 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f391ed9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3920102690 0x7f392019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:31.449 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f391dd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3920101cd0 0x7f3920198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:31.449 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f391ed9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3920102690 0x7f392019f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:38360/0 (socket says 172.21.15.189:38360) 2024-09-12T01:25:31.449 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f391ed9d640 1 -- 172.21.15.189:0/2835245650 learned_addr learned my addr 172.21.15.189:0/2835245650 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-12T01:25:31.449 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f391e59c640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3920100ad0 0x7f3920197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:31.449 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f391ed9d640 1 -- 172.21.15.189:0/2835245650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3920101cd0 msgr2=0x7f3920198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:31.449 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f391ed9d640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3920101cd0 0x7f3920198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:31.450 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f391ed9d640 1 -- 172.21.15.189:0/2835245650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3920100ad0 msgr2=0x7f3920197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:31.450 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f391ed9d640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3920100ad0 0x7f3920197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:31.450 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.448+0000 7f391ed9d640 1 -- 172.21.15.189:0/2835245650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392019fb30 con 0x7f3920102690 2024-09-12T01:25:31.450 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.449+0000 7f391dd9b640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3920101cd0 0x7f3920198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:25:31.450 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.449+0000 7f391e59c640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3920100ad0 0x7f3920197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:25:31.450 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.449+0000 7f391ed9d640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3920102690 0x7f392019f4c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f391800eb10 tx=0x7f391800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:31.450 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.449+0000 7f390f7fe640 1 -- 172.21.15.189:0/2835245650 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918004b20 con 0x7f3920102690 2024-09-12T01:25:31.450 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.449+0000 7f3924dd9640 1 -- 172.21.15.189:0/2835245650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3920102f50 con 0x7f3920102690 2024-09-12T01:25:31.450 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.449+0000 7f390f7fe640 1 -- 172.21.15.189:0/2835245650 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3918004cc0 con 0x7f3920102690 2024-09-12T01:25:31.450 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.449+0000 7f390f7fe640 1 -- 172.21.15.189:0/2835245650 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918010760 con 0x7f3920102690 2024-09-12T01:25:31.450 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.449+0000 7f3924dd9640 1 -- 172.21.15.189:0/2835245650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3920103490 con 0x7f3920102690 2024-09-12T01:25:31.451 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.450+0000 7f3924dd9640 1 -- 172.21.15.189:0/2835245650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3920103750 con 0x7f3920102690 2024-09-12T01:25:31.451 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.451+0000 7f390f7fe640 1 -- 172.21.15.189:0/2835245650 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3918005020 con 0x7f3920102690 2024-09-12T01:25:31.451 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.452+0000 7f390f7fe640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f39080a2bb0 0x7f39080a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:31.451 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.452+0000 7f390f7fe640 1 -- 172.21.15.189:0/2835245650 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f39180cf1d0 con 0x7f3920102690 2024-09-12T01:25:31.451 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.452+0000 7f391e59c640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f39080a2bb0 0x7f39080a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:31.452 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.453+0000 7f391e59c640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f39080a2bb0 0x7f39080a5070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3910006010 tx=0x7f3910032cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:31.455 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.456+0000 7f390f7fe640 1 -- 172.21.15.189:0/2835245650 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f391809c5d0 con 0x7f3920102690 2024-09-12T01:25:31.638 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.639+0000 7f3924dd9640 1 -- 172.21.15.189:0/2835245650 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}) -- 0x7f392006a6b0 con 0x7f39080a2bb0 2024-09-12T01:25:31.645 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.646+0000 7f390f7fe640 1 -- 172.21.15.189:0/2835245650 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f392006a6b0 con 0x7f39080a2bb0 2024-09-12T01:25:31.646 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mds.all update... 2024-09-12T01:25:31.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.649+0000 7f3924dd9640 1 -- 172.21.15.189:0/2835245650 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f39080a2bb0 msgr2=0x7f39080a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:31.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.649+0000 7f3924dd9640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f39080a2bb0 0x7f39080a5070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3910006010 tx=0x7f3910032cf0 comp rx=0 tx=0).stop 2024-09-12T01:25:31.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.649+0000 7f3924dd9640 1 -- 172.21.15.189:0/2835245650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3920102690 msgr2=0x7f392019f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:31.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.649+0000 7f3924dd9640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3920102690 0x7f392019f4c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f391800eb10 tx=0x7f391800c2d0 comp rx=0 tx=0).stop 2024-09-12T01:25:31.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.649+0000 7f3924dd9640 1 -- 172.21.15.189:0/2835245650 shutdown_connections 2024-09-12T01:25:31.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.649+0000 7f3924dd9640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f39080a2bb0 0x7f39080a5070 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:31.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.649+0000 7f3924dd9640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3920102690 0x7f392019f4c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:31.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.649+0000 7f3924dd9640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3920101cd0 0x7f3920198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:31.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.649+0000 7f3924dd9640 1 --2- 172.21.15.189:0/2835245650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3920100ad0 0x7f3920197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:31.649 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.649+0000 7f3924dd9640 1 -- 172.21.15.189:0/2835245650 >> 172.21.15.189:0/2835245650 conn(0x7f39200fc280 msgr2=0x7f3920069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:31.649 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.649+0000 7f3924dd9640 1 -- 172.21.15.189:0/2835245650 shutdown_connections 2024-09-12T01:25:31.649 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-12T01:25:31.649+0000 7f3924dd9640 1 -- 172.21.15.189:0/2835245650 wait complete. 2024-09-12T01:25:31.715 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:31 smithi189 ceph-mon[35357]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:31.786 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:31 smithi081 ceph-mon[30920]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:32.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:31 smithi100 ceph-mon[35275]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:32.299 DEBUG:teuthology.orchestra.run.smithi081:mds.a> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T01:25:32.302 DEBUG:teuthology.orchestra.run.smithi081:mds.d> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T01:25:32.345 DEBUG:teuthology.orchestra.run.smithi081:mds.g> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T01:25:32.389 DEBUG:teuthology.orchestra.run.smithi081:mds.j> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T01:25:32.432 DEBUG:teuthology.orchestra.run.smithi100:mds.b> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T01:25:32.434 DEBUG:teuthology.orchestra.run.smithi100:mds.e> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T01:25:32.477 DEBUG:teuthology.orchestra.run.smithi100:mds.h> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T01:25:32.521 DEBUG:teuthology.orchestra.run.smithi100:mds.k> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T01:25:32.565 DEBUG:teuthology.orchestra.run.smithi189:mds.c> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T01:25:32.568 DEBUG:teuthology.orchestra.run.smithi189:mds.f> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T01:25:32.611 DEBUG:teuthology.orchestra.run.smithi189:mds.i> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T01:25:32.654 DEBUG:teuthology.orchestra.run.smithi189:mds.l> sudo journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T01:25:32.697 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T01:25:32.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:25:32.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:32 smithi100 ceph-mon[35275]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:25:32.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:32 smithi100 ceph-mon[35275]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-12T01:25:32.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:32 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:32.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:32 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:25:32.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:32 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:32.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:32 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:25:32.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:32 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:32.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:32 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:32.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:32 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:32.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:32 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:32.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:32 smithi100 ceph-mon[35275]: Deploying daemon mds.l on smithi189 2024-09-12T01:25:32.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:32 smithi100 ceph-mon[35275]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:32.936 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:25:32.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:32 smithi081 ceph-mon[30920]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:25:32.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:32 smithi081 ceph-mon[30920]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-12T01:25:32.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:32 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:32.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:32 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:25:32.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:32 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:32.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:32 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:25:32.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:32 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:32.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:32 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:32.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:32 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:32.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:32 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:32.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:32 smithi081 ceph-mon[30920]: Deploying daemon mds.l on smithi189 2024-09-12T01:25:32.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:32 smithi081 ceph-mon[30920]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:33.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:32 smithi189 ceph-mon[35357]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:25:33.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:32 smithi189 ceph-mon[35357]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-12T01:25:33.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:32 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:33.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:32 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:25:33.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:32 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:33.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:32 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:25:33.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:32 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:33.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:32 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:33.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:32 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:33.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:32 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:33.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:32 smithi189 ceph-mon[35357]: Deploying daemon mds.l on smithi189 2024-09-12T01:25:33.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:32 smithi189 ceph-mon[35357]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.413+0000 7fbf3166d640 1 -- 172.21.15.81:0/3018111381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2c1002f0 msgr2=0x7fbf2c1006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.413+0000 7fbf3166d640 1 --2- 172.21.15.81:0/3018111381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2c1002f0 0x7fbf2c1006d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009930 tx=0x7fbf1c02a420 comp rx=0 tx=0).stop 2024-09-12T01:25:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.413+0000 7fbf3166d640 1 -- 172.21.15.81:0/3018111381 shutdown_connections 2024-09-12T01:25:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.413+0000 7fbf3166d640 1 --2- 172.21.15.81:0/3018111381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf2c106f50 0x7fbf2c10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.413+0000 7fbf3166d640 1 --2- 172.21.15.81:0/3018111381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf2c100ca0 0x7fbf2c106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.413+0000 7fbf3166d640 1 --2- 172.21.15.81:0/3018111381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2c1002f0 0x7fbf2c1006d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.413+0000 7fbf3166d640 1 -- 172.21.15.81:0/3018111381 >> 172.21.15.81:0/3018111381 conn(0x7fbf2c077210 msgr2=0x7fbf2c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.413+0000 7fbf3166d640 1 -- 172.21.15.81:0/3018111381 shutdown_connections 2024-09-12T01:25:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.414+0000 7fbf3166d640 1 -- 172.21.15.81:0/3018111381 wait complete. 2024-09-12T01:25:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.414+0000 7fbf3166d640 1 Processor -- start 2024-09-12T01:25:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.414+0000 7fbf3166d640 1 -- start start 2024-09-12T01:25:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.414+0000 7fbf3166d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf2c1002f0 0x7fbf2c101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.414+0000 7fbf3166d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2c100ca0 0x7fbf2c1017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.414+0000 7fbf3166d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf2c106f50 0x7fbf2c101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.414+0000 7fbf3166d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c111fa0 con 0x7fbf2c100ca0 2024-09-12T01:25:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.414+0000 7fbf3166d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c111e20 con 0x7fbf2c1002f0 2024-09-12T01:25:33.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.414+0000 7fbf3166d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c112120 con 0x7fbf2c106f50 2024-09-12T01:25:33.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.414+0000 7fbf23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2c100ca0 0x7fbf2c1017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:33.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.414+0000 7fbf23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2c100ca0 0x7fbf2c1017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53778/0 (socket says 172.21.15.81:53778) 2024-09-12T01:25:33.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.414+0000 7fbf23fff640 1 -- 172.21.15.81:0/2564494311 learned_addr learned my addr 172.21.15.81:0/2564494311 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:25:33.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.414+0000 7fbf2affd640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf2c1002f0 0x7fbf2c101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:33.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.415+0000 7fbf2b7fe640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf2c106f50 0x7fbf2c101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:33.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.415+0000 7fbf23fff640 1 -- 172.21.15.81:0/2564494311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf2c106f50 msgr2=0x7fbf2c101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:33.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.415+0000 7fbf23fff640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf2c106f50 0x7fbf2c101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:33.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.415+0000 7fbf23fff640 1 -- 172.21.15.81:0/2564494311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf2c1002f0 msgr2=0x7fbf2c101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:33.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.415+0000 7fbf23fff640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf2c1002f0 0x7fbf2c101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:33.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.415+0000 7fbf23fff640 1 -- 172.21.15.81:0/2564494311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c1a69a0 con 0x7fbf2c100ca0 2024-09-12T01:25:33.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.415+0000 7fbf23fff640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2c100ca0 0x7fbf2c1017b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf14005fd0 tx=0x7fbf1400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:33.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.415+0000 7fbf28ff9640 1 -- 172.21.15.81:0/2564494311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14017070 con 0x7fbf2c100ca0 2024-09-12T01:25:33.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.415+0000 7fbf3166d640 1 -- 172.21.15.81:0/2564494311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2c1a6c90 con 0x7fbf2c100ca0 2024-09-12T01:25:33.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.415+0000 7fbf28ff9640 1 -- 172.21.15.81:0/2564494311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf14009c30 con 0x7fbf2c100ca0 2024-09-12T01:25:33.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.415+0000 7fbf28ff9640 1 -- 172.21.15.81:0/2564494311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14010460 con 0x7fbf2c100ca0 2024-09-12T01:25:33.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.415+0000 7fbf3166d640 1 -- 172.21.15.81:0/2564494311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf2c1a71c0 con 0x7fbf2c100ca0 2024-09-12T01:25:33.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.416+0000 7fbf3166d640 1 -- 172.21.15.81:0/2564494311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf2c1006d0 con 0x7fbf2c100ca0 2024-09-12T01:25:33.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.417+0000 7fbf28ff9640 1 -- 172.21.15.81:0/2564494311 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbf14003e70 con 0x7fbf2c100ca0 2024-09-12T01:25:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.418+0000 7fbf28ff9640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbf180a2b80 0x7fbf180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.418+0000 7fbf2affd640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbf180a2b80 0x7fbf180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.418+0000 7fbf28ff9640 1 -- 172.21.15.81:0/2564494311 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fbf140ce800 con 0x7fbf2c100ca0 2024-09-12T01:25:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.418+0000 7fbf2affd640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbf180a2b80 0x7fbf180a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009900 tx=0x7fbf1c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.422+0000 7fbf28ff9640 1 -- 172.21.15.81:0/2564494311 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf14020030 con 0x7fbf2c100ca0 2024-09-12T01:25:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.623+0000 7fbf3166d640 1 -- 172.21.15.81:0/2564494311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf2c10a140 con 0x7fbf2c100ca0 2024-09-12T01:25:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.624+0000 7fbf28ff9640 1 -- 172.21.15.81:0/2564494311 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fbf1409bc00 con 0x7fbf2c100ca0 2024-09-12T01:25:33.624 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:25:33.624 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":1,"btime":"2024-09-12T01:18:28:404096+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T01:25:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 1 2024-09-12T01:25:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.626+0000 7fbf3166d640 1 -- 172.21.15.81:0/2564494311 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbf180a2b80 msgr2=0x7fbf180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.626+0000 7fbf3166d640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbf180a2b80 0x7fbf180a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009900 tx=0x7fbf1c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:25:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.626+0000 7fbf3166d640 1 -- 172.21.15.81:0/2564494311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2c100ca0 msgr2=0x7fbf2c1017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.626+0000 7fbf3166d640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2c100ca0 0x7fbf2c1017b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf14005fd0 tx=0x7fbf1400dde0 comp rx=0 tx=0).stop 2024-09-12T01:25:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.626+0000 7fbf3166d640 1 -- 172.21.15.81:0/2564494311 shutdown_connections 2024-09-12T01:25:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.626+0000 7fbf3166d640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbf180a2b80 0x7fbf180a5040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.626+0000 7fbf3166d640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf2c106f50 0x7fbf2c101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.626+0000 7fbf3166d640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2c100ca0 0x7fbf2c1017b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.626+0000 7fbf3166d640 1 --2- 172.21.15.81:0/2564494311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf2c1002f0 0x7fbf2c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.626+0000 7fbf3166d640 1 -- 172.21.15.81:0/2564494311 >> 172.21.15.81:0/2564494311 conn(0x7fbf2c077210 msgr2=0x7fbf2c1052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.626+0000 7fbf3166d640 1 -- 172.21.15.81:0/2564494311 shutdown_connections 2024-09-12T01:25:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:33.626+0000 7fbf3166d640 1 -- 172.21.15.81:0/2564494311 wait complete. 2024-09-12T01:25:34.217 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:34 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2564494311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:34.304 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:34 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2564494311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:34.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:34 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2564494311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:34.519 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 01:25:34 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-l[64729]: starting mds.l at 2024-09-12T01:25:34.782 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 01:25:34 smithi189 bash[64714]: 88eddc80e55045deb34c8f68585974a714414c8ff3b0784363110fa1ef2cf5b7 2024-09-12T01:25:34.782 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 01:25:34 smithi189 systemd[1]: Started Ceph mds.l for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:25:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:35 smithi081 ceph-mon[30920]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:35 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] up:boot 2024-09-12T01:25:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:35 smithi081 ceph-mon[30920]: fsmap 1 up:standby 2024-09-12T01:25:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:25:35.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:35.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:35.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:35.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:35.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:35.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:35 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:35.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:35 smithi100 ceph-mon[35275]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:35 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] up:boot 2024-09-12T01:25:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:35 smithi100 ceph-mon[35275]: fsmap 1 up:standby 2024-09-12T01:25:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:25:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:35 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:35 smithi189 ceph-mon[35357]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:35 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] up:boot 2024-09-12T01:25:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:35 smithi189 ceph-mon[35357]: fsmap 1 up:standby 2024-09-12T01:25:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:25:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:35 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:36.331 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:25:36.589 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:25:36.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:36 smithi081 ceph-mon[30920]: Deploying daemon mds.k on smithi100 2024-09-12T01:25:36.711 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:36 smithi100 ceph-mon[35275]: Deploying daemon mds.k on smithi100 2024-09-12T01:25:36.711 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:25:36 smithi100 systemd[1]: Starting Ceph mds.k for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:25:36.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:36 smithi189 ceph-mon[35357]: Deploying daemon mds.k on smithi100 2024-09-12T01:25:36.973 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:25:36 smithi100 podman[64680]: 2024-09-12 01:25:36.614768397 +0000 UTC m=+0.016058483 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:25:36.973 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:25:36 smithi100 podman[64680]: 2024-09-12 01:25:36.728641529 +0000 UTC m=+0.129931618 container create 2382889f003835b64a77213c418e812da45389a586cc07c3ef2be34d82ca11d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T01:25:36.973 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:25:36 smithi100 podman[64680]: 2024-09-12 01:25:36.94775102 +0000 UTC m=+0.349041106 container init 2382889f003835b64a77213c418e812da45389a586cc07c3ef2be34d82ca11d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T01:25:36.973 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:25:36 smithi100 podman[64680]: 2024-09-12 01:25:36.950434944 +0000 UTC m=+0.351725030 container start 2382889f003835b64a77213c418e812da45389a586cc07c3ef2be34d82ca11d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-k, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T01:25:36.973 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:25:36 smithi100 ceph-mds[64699]: -- 172.21.15.100:0/2435091425 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563fc30f5860 con 0x563fc30d2800 2024-09-12T01:25:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.030+0000 7f68b7f93640 1 -- 172.21.15.81:0/350763853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0100b30 msgr2=0x7f68b0100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.030+0000 7f68b7f93640 1 --2- 172.21.15.81:0/350763853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0100b30 0x7f68b0100f10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009900 tx=0x7f68ac02a470 comp rx=0 tx=0).stop 2024-09-12T01:25:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.030+0000 7f68b7f93640 1 -- 172.21.15.81:0/350763853 shutdown_connections 2024-09-12T01:25:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.030+0000 7f68b7f93640 1 --2- 172.21.15.81:0/350763853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68b0105f40 0x7f68b01063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.030+0000 7f68b7f93640 1 --2- 172.21.15.81:0/350763853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68b0101450 0x7f68b0105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.030+0000 7f68b7f93640 1 --2- 172.21.15.81:0/350763853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0100b30 0x7f68b0100f10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.030+0000 7f68b7f93640 1 -- 172.21.15.81:0/350763853 >> 172.21.15.81:0/350763853 conn(0x7f68b00fc7a0 msgr2=0x7f68b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.031+0000 7f68b7f93640 1 -- 172.21.15.81:0/350763853 shutdown_connections 2024-09-12T01:25:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.031+0000 7f68b7f93640 1 -- 172.21.15.81:0/350763853 wait complete. 2024-09-12T01:25:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.031+0000 7f68b7f93640 1 Processor -- start 2024-09-12T01:25:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.031+0000 7f68b7f93640 1 -- start start 2024-09-12T01:25:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.031+0000 7f68b7f93640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68b0100b30 0x7f68b01a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.031+0000 7f68b7f93640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68b0101450 0x7f68b01a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.031+0000 7f68b7f93640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0105f40 0x7f68b019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.031+0000 7f68b7f93640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0118570 con 0x7f68b0105f40 2024-09-12T01:25:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.031+0000 7f68b7f93640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f68b01183f0 con 0x7f68b0100b30 2024-09-12T01:25:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.031+0000 7f68b7f93640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f68b01186f0 con 0x7f68b0101450 2024-09-12T01:25:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.031+0000 7f68b6530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0105f40 0x7f68b019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68b6530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0105f40 0x7f68b019e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53798/0 (socket says 172.21.15.81:53798) 2024-09-12T01:25:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68b6530640 1 -- 172.21.15.81:0/1394201428 learned_addr learned my addr 172.21.15.81:0/1394201428 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:25:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68b5d2f640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68b0100b30 0x7f68b01a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68b552e640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68b0101450 0x7f68b01a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68b6530640 1 -- 172.21.15.81:0/1394201428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68b0101450 msgr2=0x7f68b01a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68b6530640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68b0101450 0x7f68b01a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68b6530640 1 -- 172.21.15.81:0/1394201428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68b0100b30 msgr2=0x7f68b01a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68b6530640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68b0100b30 0x7f68b01a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68b6530640 1 -- 172.21.15.81:0/1394201428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b019eff0 con 0x7f68b0105f40 2024-09-12T01:25:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68b6530640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0105f40 0x7f68b019e8c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f68a800eb10 tx=0x7f68a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68a6ffd640 1 -- 172.21.15.81:0/1394201428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8004b20 con 0x7f68b0105f40 2024-09-12T01:25:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68a6ffd640 1 -- 172.21.15.81:0/1394201428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68a8004cc0 con 0x7f68b0105f40 2024-09-12T01:25:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68a6ffd640 1 -- 172.21.15.81:0/1394201428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8010760 con 0x7f68b0105f40 2024-09-12T01:25:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68b7f93640 1 -- 172.21.15.81:0/1394201428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b019f2e0 con 0x7f68b0105f40 2024-09-12T01:25:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.032+0000 7f68b7f93640 1 -- 172.21.15.81:0/1394201428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b01ab5d0 con 0x7f68b0105f40 2024-09-12T01:25:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.033+0000 7f68b7f93640 1 -- 172.21.15.81:0/1394201428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b0105920 con 0x7f68b0105f40 2024-09-12T01:25:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.034+0000 7f68a6ffd640 1 -- 172.21.15.81:0/1394201428 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f68a8005000 con 0x7f68b0105f40 2024-09-12T01:25:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.035+0000 7f68a6ffd640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f689c0a2b80 0x7f689c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.035+0000 7f68b5d2f640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f689c0a2b80 0x7f689c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.035+0000 7f68a6ffd640 1 -- 172.21.15.81:0/1394201428 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f68a80cf620 con 0x7f68b0105f40 2024-09-12T01:25:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.036+0000 7f68b5d2f640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f689c0a2b80 0x7f689c0a5040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68b019fa00 tx=0x7f68ac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.038+0000 7f68a6ffd640 1 -- 172.21.15.81:0/1394201428 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68a809ca20 con 0x7f68b0105f40 2024-09-12T01:25:37.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.248+0000 7f68b7f93640 1 -- 172.21.15.81:0/1394201428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68b019fdf0 con 0x7f68b0105f40 2024-09-12T01:25:37.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.249+0000 7f68a6ffd640 1 -- 172.21.15.81:0/1394201428 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f68a809c320 con 0x7f68b0105f40 2024-09-12T01:25:37.248 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:25:37.249 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"btime":"2024-09-12T01:25:34:451865+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T01:25:37.249 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2024-09-12T01:25:37.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.251+0000 7f68b7f93640 1 -- 172.21.15.81:0/1394201428 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f689c0a2b80 msgr2=0x7f689c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.251+0000 7f68b7f93640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f689c0a2b80 0x7f689c0a5040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68b019fa00 tx=0x7f68ac0058d0 comp rx=0 tx=0).stop 2024-09-12T01:25:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.251+0000 7f68b7f93640 1 -- 172.21.15.81:0/1394201428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0105f40 msgr2=0x7f68b019e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.251+0000 7f68b7f93640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0105f40 0x7f68b019e8c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f68a800eb10 tx=0x7f68a800c2d0 comp rx=0 tx=0).stop 2024-09-12T01:25:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.251+0000 7f68b7f93640 1 -- 172.21.15.81:0/1394201428 shutdown_connections 2024-09-12T01:25:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.251+0000 7f68b7f93640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f689c0a2b80 0x7f689c0a5040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.251+0000 7f68b7f93640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0105f40 0x7f68b019e8c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.251+0000 7f68b7f93640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f68b0101450 0x7f68b01a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.251+0000 7f68b7f93640 1 --2- 172.21.15.81:0/1394201428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68b0100b30 0x7f68b01a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.251+0000 7f68b7f93640 1 -- 172.21.15.81:0/1394201428 >> 172.21.15.81:0/1394201428 conn(0x7f68b00fc7a0 msgr2=0x7f68b010f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.252+0000 7f68b7f93640 1 -- 172.21.15.81:0/1394201428 shutdown_connections 2024-09-12T01:25:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:37.252+0000 7f68b7f93640 1 -- 172.21.15.81:0/1394201428 wait complete. 2024-09-12T01:25:37.268 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:25:36 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-k[64695]: starting mds.k at 2024-09-12T01:25:37.268 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:25:37 smithi100 bash[64680]: 2382889f003835b64a77213c418e812da45389a586cc07c3ef2be34d82ca11d8 2024-09-12T01:25:37.268 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:25:37 smithi100 systemd[1]: Started Ceph mds.k for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:25:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:37 smithi081 ceph-mon[30920]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:37.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:37.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:37 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:37.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:37 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1394201428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:37 smithi100 ceph-mon[35275]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:37 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:37 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:37 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:37 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:37 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:37 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:37.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:37 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1394201428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:37 smithi189 ceph-mon[35357]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:37 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:37 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:37 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:37 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:37 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:37 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:37 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1394201428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:38.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:38 smithi081 ceph-mon[30920]: Deploying daemon mds.j on smithi081 2024-09-12T01:25:38.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:38 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] up:boot 2024-09-12T01:25:38.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:38 smithi081 ceph-mon[30920]: fsmap 2 up:standby 2024-09-12T01:25:38.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:38 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:25:38.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:38 smithi100 ceph-mon[35275]: Deploying daemon mds.j on smithi081 2024-09-12T01:25:38.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:38 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] up:boot 2024-09-12T01:25:38.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:38 smithi100 ceph-mon[35275]: fsmap 2 up:standby 2024-09-12T01:25:38.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:38 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:25:38.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:38 smithi189 ceph-mon[35357]: Deploying daemon mds.j on smithi081 2024-09-12T01:25:38.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:38 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] up:boot 2024-09-12T01:25:38.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:38 smithi189 ceph-mon[35357]: fsmap 2 up:standby 2024-09-12T01:25:38.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:38 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:25:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:39 smithi081 ceph-mon[30920]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:39.738 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:25:39 smithi081 systemd[1]: Starting Ceph mds.j for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:25:39.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:39 smithi100 ceph-mon[35275]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:39 smithi189 ceph-mon[35357]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:39.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:25:40.032 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:25:39 smithi081 podman[70315]: 2024-09-12 01:25:39.781546374 +0000 UTC m=+0.112529863 container create 2bfd40f1b6ab7d5ee3ef8d02a2d150be0c8d36bd7a6e5ddfb3e5723706af46f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-12T01:25:40.033 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:25:39 smithi081 podman[70315]: 2024-09-12 01:25:39.685172001 +0000 UTC m=+0.016155498 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:25:40.033 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:25:39 smithi081 podman[70315]: 2024-09-12 01:25:39.975602123 +0000 UTC m=+0.306585614 container init 2bfd40f1b6ab7d5ee3ef8d02a2d150be0c8d36bd7a6e5ddfb3e5723706af46f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-j, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T01:25:40.033 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:25:39 smithi081 podman[70315]: 2024-09-12 01:25:39.978568247 +0000 UTC m=+0.309551737 container start 2bfd40f1b6ab7d5ee3ef8d02a2d150be0c8d36bd7a6e5ddfb3e5723706af46f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:25:40.033 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:25:40 smithi081 ceph-mds[70352]: -- 172.21.15.81:0/71297613 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55592dafb860 con 0x55592dad8800 2024-09-12T01:25:40.034 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:25:40 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-j[70330]: starting mds.j at 2024-09-12T01:25:40.034 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:25:40 smithi081 bash[70315]: 2bfd40f1b6ab7d5ee3ef8d02a2d150be0c8d36bd7a6e5ddfb3e5723706af46f6 2024-09-12T01:25:40.198 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:25:40.319 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:25:40 smithi081 systemd[1]: Started Ceph mds.j for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:25:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.658+0000 7f1a608f2640 1 -- 172.21.15.81:0/461163829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a5c1000d0 msgr2=0x7f1a5c100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.658+0000 7f1a608f2640 1 --2- 172.21.15.81:0/461163829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a5c1000d0 0x7f1a5c100530 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1a50009900 tx=0x7f1a5002a410 comp rx=0 tx=0).stop 2024-09-12T01:25:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.658+0000 7f1a608f2640 1 -- 172.21.15.81:0/461163829 shutdown_connections 2024-09-12T01:25:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.658+0000 7f1a608f2640 1 --2- 172.21.15.81:0/461163829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a5c100a70 0x7f1a5c10ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.658+0000 7f1a608f2640 1 --2- 172.21.15.81:0/461163829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a5c1000d0 0x7f1a5c100530 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.658+0000 7f1a608f2640 1 --2- 172.21.15.81:0/461163829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a5c106ba0 0x7f1a5c106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.658+0000 7f1a608f2640 1 -- 172.21.15.81:0/461163829 >> 172.21.15.81:0/461163829 conn(0x7f1a5c077210 msgr2=0x7f1a5c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:40.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.658+0000 7f1a608f2640 1 -- 172.21.15.81:0/461163829 shutdown_connections 2024-09-12T01:25:40.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.658+0000 7f1a608f2640 1 -- 172.21.15.81:0/461163829 wait complete. 2024-09-12T01:25:40.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.659+0000 7f1a608f2640 1 Processor -- start 2024-09-12T01:25:40.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.659+0000 7f1a608f2640 1 -- start start 2024-09-12T01:25:40.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.659+0000 7f1a608f2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a5c1000d0 0x7f1a5c1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:40.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a608f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a5c100a70 0x7f1a5c198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:40.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a608f2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a5c106ba0 0x7f1a5c19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:40.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a608f2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c112130 con 0x7f1a5c100a70 2024-09-12T01:25:40.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a608f2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c111fb0 con 0x7f1a5c1000d0 2024-09-12T01:25:40.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a608f2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c1122b0 con 0x7f1a5c106ba0 2024-09-12T01:25:40.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a59d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a5c100a70 0x7f1a5c198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:40.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a59d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a5c100a70 0x7f1a5c198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53830/0 (socket says 172.21.15.81:53830) 2024-09-12T01:25:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a59d9b640 1 -- 172.21.15.81:0/2330083258 learned_addr learned my addr 172.21.15.81:0/2330083258 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:25:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a5ad9d640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a5c106ba0 0x7f1a5c19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a5a59c640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a5c1000d0 0x7f1a5c1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a59d9b640 1 -- 172.21.15.81:0/2330083258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a5c106ba0 msgr2=0x7f1a5c19cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a59d9b640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a5c106ba0 0x7f1a5c19cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a59d9b640 1 -- 172.21.15.81:0/2330083258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a5c1000d0 msgr2=0x7f1a5c1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a59d9b640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a5c1000d0 0x7f1a5c1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a59d9b640 1 -- 172.21.15.81:0/2330083258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5c19d580 con 0x7f1a5c100a70 2024-09-12T01:25:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a5a59c640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a5c1000d0 0x7f1a5c1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:25:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a59d9b640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a5c100a70 0x7f1a5c198b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1a50006010 tx=0x7f1a50003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:40.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a4b7fe640 1 -- 172.21.15.81:0/2330083258 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5003f070 con 0x7f1a5c100a70 2024-09-12T01:25:40.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a608f2640 1 -- 172.21.15.81:0/2330083258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a5c19d810 con 0x7f1a5c100a70 2024-09-12T01:25:40.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a4b7fe640 1 -- 172.21.15.81:0/2330083258 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a50031e30 con 0x7f1a5c100a70 2024-09-12T01:25:40.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a4b7fe640 1 -- 172.21.15.81:0/2330083258 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50035030 con 0x7f1a5c100a70 2024-09-12T01:25:40.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.660+0000 7f1a608f2640 1 -- 172.21.15.81:0/2330083258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a5c1a5150 con 0x7f1a5c100a70 2024-09-12T01:25:40.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.661+0000 7f1a608f2640 1 -- 172.21.15.81:0/2330083258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a5c100530 con 0x7f1a5c100a70 2024-09-12T01:25:40.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.663+0000 7f1a4b7fe640 1 -- 172.21.15.81:0/2330083258 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1a50042070 con 0x7f1a5c100a70 2024-09-12T01:25:40.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.664+0000 7f1a4b7fe640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1a440a2b80 0x7f1a440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:40.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.664+0000 7f1a5a59c640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1a440a2b80 0x7f1a440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:40.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.664+0000 7f1a4b7fe640 1 -- 172.21.15.81:0/2330083258 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f1a500ef5a0 con 0x7f1a5c100a70 2024-09-12T01:25:40.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.664+0000 7f1a5a59c640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1a440a2b80 0x7f1a440a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c006fd0 tx=0x7f1a4c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:40.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.668+0000 7f1a4b7fe640 1 -- 172.21.15.81:0/2330083258 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a500bc9a0 con 0x7f1a5c100a70 2024-09-12T01:25:40.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.876+0000 7f1a608f2640 1 -- 172.21.15.81:0/2330083258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a5c02d7c0 con 0x7f1a5c100a70 2024-09-12T01:25:40.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.877+0000 7f1a4b7fe640 1 -- 172.21.15.81:0/2330083258 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f1a500bc2a0 con 0x7f1a5c100a70 2024-09-12T01:25:40.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:25:40.877 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":4,"btime":"2024-09-12T01:25:40:481251+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T01:25:40.878 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 4 2024-09-12T01:25:40.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.879+0000 7f1a608f2640 1 -- 172.21.15.81:0/2330083258 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1a440a2b80 msgr2=0x7f1a440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:40.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.879+0000 7f1a608f2640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1a440a2b80 0x7f1a440a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c006fd0 tx=0x7f1a4c008040 comp rx=0 tx=0).stop 2024-09-12T01:25:40.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.879+0000 7f1a608f2640 1 -- 172.21.15.81:0/2330083258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a5c100a70 msgr2=0x7f1a5c198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:40.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.879+0000 7f1a608f2640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a5c100a70 0x7f1a5c198b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1a50006010 tx=0x7f1a50003c80 comp rx=0 tx=0).stop 2024-09-12T01:25:40.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.879+0000 7f1a608f2640 1 -- 172.21.15.81:0/2330083258 shutdown_connections 2024-09-12T01:25:40.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.879+0000 7f1a608f2640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1a440a2b80 0x7f1a440a5040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:40.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.879+0000 7f1a608f2640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a5c106ba0 0x7f1a5c19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:40.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.879+0000 7f1a608f2640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a5c100a70 0x7f1a5c198b10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:40.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.879+0000 7f1a608f2640 1 --2- 172.21.15.81:0/2330083258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a5c1000d0 0x7f1a5c1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:40.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.879+0000 7f1a608f2640 1 -- 172.21.15.81:0/2330083258 >> 172.21.15.81:0/2330083258 conn(0x7f1a5c077210 msgr2=0x7f1a5c104c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:40.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.879+0000 7f1a608f2640 1 -- 172.21.15.81:0/2330083258 shutdown_connections 2024-09-12T01:25:40.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:40.879+0000 7f1a608f2640 1 -- 172.21.15.81:0/2330083258 wait complete. 2024-09-12T01:25:41.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:41.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:41.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:41.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:41.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:41.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:41.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:41 smithi081 ceph-mon[30920]: Deploying daemon mds.d on smithi081 2024-09-12T01:25:41.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:41 smithi081 ceph-mon[30920]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:41.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:41 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.81:6834/248009752,v1:172.21.15.81:6835/248009752] up:boot 2024-09-12T01:25:41.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:41 smithi081 ceph-mon[30920]: fsmap 3 up:standby 2024-09-12T01:25:41.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:41 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:25:41.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:41 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2330083258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:41.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:41 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:41.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:41 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:41.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:41 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:41.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:41 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:41.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:41 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:41.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:41 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:41.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:41 smithi100 ceph-mon[35275]: Deploying daemon mds.d on smithi081 2024-09-12T01:25:41.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:41 smithi100 ceph-mon[35275]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:41.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:41 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.81:6834/248009752,v1:172.21.15.81:6835/248009752] up:boot 2024-09-12T01:25:41.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:41 smithi100 ceph-mon[35275]: fsmap 3 up:standby 2024-09-12T01:25:41.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:41 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:25:41.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:41 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2330083258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:41.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:41 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:41.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:41 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:41.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:41 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:41.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:41 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:41.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:41 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:41.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:41 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:41.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:41 smithi189 ceph-mon[35357]: Deploying daemon mds.d on smithi081 2024-09-12T01:25:41.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:41 smithi189 ceph-mon[35357]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:41.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:41 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.81:6834/248009752,v1:172.21.15.81:6835/248009752] up:boot 2024-09-12T01:25:41.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:41 smithi189 ceph-mon[35357]: fsmap 3 up:standby 2024-09-12T01:25:41.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:41 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:25:41.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:41 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2330083258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:43.185 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:25:42 smithi081 systemd[1]: Starting Ceph mds.d for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:25:43.455 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:25:43 smithi081 podman[70725]: 2024-09-12 01:25:43.088431045 +0000 UTC m=+0.015526382 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:25:43.456 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:25:43 smithi081 podman[70725]: 2024-09-12 01:25:43.19355836 +0000 UTC m=+0.120653682 container create cdacb5c32c75ab0be3d141557d9e7090557441fc6e98964ff81ff2ee098dc5be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-d, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T01:25:43.456 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:25:43 smithi081 podman[70725]: 2024-09-12 01:25:43.430020827 +0000 UTC m=+0.357116166 container init cdacb5c32c75ab0be3d141557d9e7090557441fc6e98964ff81ff2ee098dc5be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:25:43.456 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:25:43 smithi081 podman[70725]: 2024-09-12 01:25:43.432914959 +0000 UTC m=+0.360010293 container start cdacb5c32c75ab0be3d141557d9e7090557441fc6e98964ff81ff2ee098dc5be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-d, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:25:43.651 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:25:43.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:43 smithi081 ceph-mon[30920]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:43.738 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:25:43 smithi081 ceph-mds[70744]: -- 172.21.15.81:0/2214963546 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5643c54bf860 con 0x5643c549d000 2024-09-12T01:25:43.738 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:25:43 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-d[70740]: starting mds.d at 2024-09-12T01:25:43.738 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:25:43 smithi081 bash[70725]: cdacb5c32c75ab0be3d141557d9e7090557441fc6e98964ff81ff2ee098dc5be 2024-09-12T01:25:43.738 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:25:43 smithi081 systemd[1]: Started Ceph mds.d for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:25:43.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:43 smithi100 ceph-mon[35275]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:43.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:43 smithi189 ceph-mon[35357]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:43.898 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:25:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.332+0000 7fbaa927a640 1 -- 172.21.15.81:0/1439596972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa410c180 msgr2=0x7fbaa410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.332+0000 7fbaa927a640 1 --2- 172.21.15.81:0/1439596972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa410c180 0x7fbaa410e610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009ca0 tx=0x7fba9c02a950 comp rx=0 tx=0).stop 2024-09-12T01:25:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.333+0000 7fbaa927a640 1 -- 172.21.15.81:0/1439596972 shutdown_connections 2024-09-12T01:25:44.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.333+0000 7fbaa927a640 1 --2- 172.21.15.81:0/1439596972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa410c180 0x7fbaa410e610 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.333+0000 7fbaa927a640 1 --2- 172.21.15.81:0/1439596972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa4103700 0x7fbaa410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.333+0000 7fbaa927a640 1 --2- 172.21.15.81:0/1439596972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa4102de0 0x7fbaa41031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.333+0000 7fbaa927a640 1 -- 172.21.15.81:0/1439596972 >> 172.21.15.81:0/1439596972 conn(0x7fbaa40fc7a0 msgr2=0x7fbaa40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.333+0000 7fbaa927a640 1 -- 172.21.15.81:0/1439596972 shutdown_connections 2024-09-12T01:25:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.333+0000 7fbaa927a640 1 -- 172.21.15.81:0/1439596972 wait complete. 2024-09-12T01:25:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.333+0000 7fbaa927a640 1 Processor -- start 2024-09-12T01:25:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.333+0000 7fbaa927a640 1 -- start start 2024-09-12T01:25:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa927a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa4102de0 0x7fbaa4100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa927a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa4103700 0x7fbaa4100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa927a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa410c180 0x7fbaa41014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa927a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4111f50 con 0x7fbaa410c180 2024-09-12T01:25:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa927a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4111dd0 con 0x7fbaa4102de0 2024-09-12T01:25:44.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa927a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa41120d0 con 0x7fbaa4103700 2024-09-12T01:25:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa410c180 0x7fbaa41014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa410c180 0x7fbaa41014c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54758/0 (socket says 172.21.15.81:54758) 2024-09-12T01:25:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa37fe640 1 -- 172.21.15.81:0/1648956841 learned_addr learned my addr 172.21.15.81:0/1648956841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:25:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa2ffd640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa4102de0 0x7fbaa4100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fba9bfff640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa4103700 0x7fbaa4100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa37fe640 1 -- 172.21.15.81:0/1648956841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa4103700 msgr2=0x7fbaa4100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa37fe640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa4103700 0x7fbaa4100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa37fe640 1 -- 172.21.15.81:0/1648956841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa4102de0 msgr2=0x7fbaa4100a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa37fe640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa4102de0 0x7fbaa4100a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa37fe640 1 -- 172.21.15.81:0/1648956841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa41a68d0 con 0x7fbaa410c180 2024-09-12T01:25:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa37fe640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa410c180 0x7fbaa41014c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fba9c004af0 tx=0x7fba9c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa0ff9640 1 -- 172.21.15.81:0/1648956841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c034040 con 0x7fbaa410c180 2024-09-12T01:25:44.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa927a640 1 -- 172.21.15.81:0/1648956841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa41a6b60 con 0x7fbaa410c180 2024-09-12T01:25:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa0ff9640 1 -- 172.21.15.81:0/1648956841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba9c030920 con 0x7fbaa410c180 2024-09-12T01:25:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.334+0000 7fbaa0ff9640 1 -- 172.21.15.81:0/1648956841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0047b0 con 0x7fbaa410c180 2024-09-12T01:25:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.335+0000 7fbaa927a640 1 -- 172.21.15.81:0/1648956841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa41a7040 con 0x7fbaa410c180 2024-09-12T01:25:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.336+0000 7fbaa927a640 1 -- 172.21.15.81:0/1648956841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa41031c0 con 0x7fbaa410c180 2024-09-12T01:25:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.337+0000 7fbaa0ff9640 1 -- 172.21.15.81:0/1648956841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fba9c037020 con 0x7fbaa410c180 2024-09-12T01:25:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.337+0000 7fbaa0ff9640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fba900a2b80 0x7fba900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.337+0000 7fbaa2ffd640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fba900a2b80 0x7fba900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.337+0000 7fbaa0ff9640 1 -- 172.21.15.81:0/1648956841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fba9c0ef960 con 0x7fbaa410c180 2024-09-12T01:25:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.338+0000 7fbaa2ffd640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fba900a2b80 0x7fba900a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fba9400bbe0 tx=0x7fba9400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.341+0000 7fbaa0ff9640 1 -- 172.21.15.81:0/1648956841 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba9c0bcd60 con 0x7fbaa410c180 2024-09-12T01:25:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.550+0000 7fbaa927a640 1 -- 172.21.15.81:0/1648956841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbaa4107260 con 0x7fbaa410c180 2024-09-12T01:25:44.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.551+0000 7fbaa0ff9640 1 -- 172.21.15.81:0/1648956841 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7fba9c0bc660 con 0x7fbaa410c180 2024-09-12T01:25:44.551 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:25:44.551 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"btime":"2024-09-12T01:25:43:472106+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T01:25:44.552 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 5 2024-09-12T01:25:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.554+0000 7fbaa927a640 1 -- 172.21.15.81:0/1648956841 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fba900a2b80 msgr2=0x7fba900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.554+0000 7fbaa927a640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fba900a2b80 0x7fba900a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fba9400bbe0 tx=0x7fba9400b390 comp rx=0 tx=0).stop 2024-09-12T01:25:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.554+0000 7fbaa927a640 1 -- 172.21.15.81:0/1648956841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa410c180 msgr2=0x7fbaa41014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.554+0000 7fbaa927a640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa410c180 0x7fbaa41014c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fba9c004af0 tx=0x7fba9c02f5b0 comp rx=0 tx=0).stop 2024-09-12T01:25:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.554+0000 7fbaa927a640 1 -- 172.21.15.81:0/1648956841 shutdown_connections 2024-09-12T01:25:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.554+0000 7fbaa927a640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fba900a2b80 0x7fba900a5040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:44.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.554+0000 7fbaa927a640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaa410c180 0x7fbaa41014c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.554+0000 7fbaa927a640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbaa4103700 0x7fbaa4100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.554+0000 7fbaa927a640 1 --2- 172.21.15.81:0/1648956841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa4102de0 0x7fbaa4100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.554+0000 7fbaa927a640 1 -- 172.21.15.81:0/1648956841 >> 172.21.15.81:0/1648956841 conn(0x7fbaa40fc7a0 msgr2=0x7fbaa40fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.554+0000 7fbaa927a640 1 -- 172.21.15.81:0/1648956841 shutdown_connections 2024-09-12T01:25:44.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:44.554+0000 7fbaa927a640 1 -- 172.21.15.81:0/1648956841 wait complete. 2024-09-12T01:25:44.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:44 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.81:6836/530662098,v1:172.21.15.81:6837/530662098] up:boot 2024-09-12T01:25:44.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:44 smithi081 ceph-mon[30920]: fsmap 4 up:standby 2024-09-12T01:25:44.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:25:44.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:44.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:44.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:44.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:44.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:44.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:44 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:44.736 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:44 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.81:6836/530662098,v1:172.21.15.81:6837/530662098] up:boot 2024-09-12T01:25:44.736 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:44 smithi100 ceph-mon[35275]: fsmap 4 up:standby 2024-09-12T01:25:44.736 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:25:44.736 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:44.736 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:44.736 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:44.736 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:44.736 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:44.736 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:44 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:44 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.81:6836/530662098,v1:172.21.15.81:6837/530662098] up:boot 2024-09-12T01:25:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:44 smithi189 ceph-mon[35357]: fsmap 4 up:standby 2024-09-12T01:25:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:25:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:44.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:44.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:44.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:44 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:45.684 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:45 smithi100 ceph-mon[35275]: Deploying daemon mds.e on smithi100 2024-09-12T01:25:45.684 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:45 smithi100 ceph-mon[35275]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:45.685 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:45 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1648956841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:45.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:45 smithi081 ceph-mon[30920]: Deploying daemon mds.e on smithi100 2024-09-12T01:25:45.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:45 smithi081 ceph-mon[30920]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:45.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:45 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1648956841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:45.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:45 smithi189 ceph-mon[35357]: Deploying daemon mds.e on smithi100 2024-09-12T01:25:45.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:45 smithi189 ceph-mon[35357]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:45.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:45 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1648956841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:45.950 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:25:45 smithi100 podman[64992]: 2024-09-12 01:25:45.929053872 +0000 UTC m=+0.356904615 container start 4d4271f81e88699962c67ac744b84d61c5b615b4d6bf2282ffaa1ceb7e2f20b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-e, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:25:46.277 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:25:45 smithi100 ceph-mds[65011]: -- 172.21.15.100:0/4087968245 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f5c149860 con 0x563f5c127400 2024-09-12T01:25:46.277 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:25:45 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-e[65007]: starting mds.e at 2024-09-12T01:25:46.277 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:25:46 smithi100 bash[64992]: 4d4271f81e88699962c67ac744b84d61c5b615b4d6bf2282ffaa1ceb7e2f20b4 2024-09-12T01:25:46.277 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:25:46 smithi100 systemd[1]: Started Ceph mds.e for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:25:47.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:25:47.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:47 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:47.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:47 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:47.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:47 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:47 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:47 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:47 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:47 smithi189 ceph-mon[35357]: Deploying daemon mds.f on smithi189 2024-09-12T01:25:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:47 smithi189 ceph-mon[35357]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:47 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.100:6834/3858178529,v1:172.21.15.100:6835/3858178529] up:boot 2024-09-12T01:25:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:47 smithi189 ceph-mon[35357]: fsmap 5 up:standby 2024-09-12T01:25:47.343 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:47 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:25:47.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:47.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:47.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:47.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:47.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:47.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:47.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:47 smithi081 ceph-mon[30920]: Deploying daemon mds.f on smithi189 2024-09-12T01:25:47.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:47 smithi081 ceph-mon[30920]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:47.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:47 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.100:6834/3858178529,v1:172.21.15.100:6835/3858178529] up:boot 2024-09-12T01:25:47.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:47 smithi081 ceph-mon[30920]: fsmap 5 up:standby 2024-09-12T01:25:47.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:47 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:25:47.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:47 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:47.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:47 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:47.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:47 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:47.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:47 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:47.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:47 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:47.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:47 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:47.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:47 smithi100 ceph-mon[35275]: Deploying daemon mds.f on smithi189 2024-09-12T01:25:47.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:47 smithi100 ceph-mon[35275]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:47.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:47 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.100:6834/3858178529,v1:172.21.15.100:6835/3858178529] up:boot 2024-09-12T01:25:47.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:47 smithi100 ceph-mon[35275]: fsmap 5 up:standby 2024-09-12T01:25:47.520 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:47 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:25:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:25:48.011 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:25:47 smithi189 systemd[1]: Starting Ceph mds.f for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:25:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.033+0000 7fc35e949640 1 -- 172.21.15.81:0/1271468946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc358101de0 msgr2=0x7fc3581021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.033+0000 7fc35e949640 1 --2- 172.21.15.81:0/1271468946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc358101de0 0x7fc3581021c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc348009900 tx=0x7fc34802a410 comp rx=0 tx=0).stop 2024-09-12T01:25:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.033+0000 7fc35e949640 1 -- 172.21.15.81:0/1271468946 shutdown_connections 2024-09-12T01:25:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.033+0000 7fc35e949640 1 --2- 172.21.15.81:0/1271468946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc358106f10 0x7fc35810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.033+0000 7fc35e949640 1 --2- 172.21.15.81:0/1271468946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc358102790 0x7fc3581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.033+0000 7fc35e949640 1 --2- 172.21.15.81:0/1271468946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc358101de0 0x7fc3581021c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.033+0000 7fc35e949640 1 -- 172.21.15.81:0/1271468946 >> 172.21.15.81:0/1271468946 conn(0x7fc3580fd8c0 msgr2=0x7fc3580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.033+0000 7fc35e949640 1 -- 172.21.15.81:0/1271468946 shutdown_connections 2024-09-12T01:25:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.033+0000 7fc35e949640 1 -- 172.21.15.81:0/1271468946 wait complete. 2024-09-12T01:25:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.034+0000 7fc35e949640 1 Processor -- start 2024-09-12T01:25:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.034+0000 7fc35e949640 1 -- start start 2024-09-12T01:25:48.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35e949640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc358101de0 0x7fc3581984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:48.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35e949640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc358102790 0x7fc358198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:48.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35e949640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc358106f10 0x7fc35819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:48.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35e949640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc358111f80 con 0x7fc358106f10 2024-09-12T01:25:48.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35e949640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc358111e00 con 0x7fc358101de0 2024-09-12T01:25:48.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35e949640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc358112100 con 0x7fc358102790 2024-09-12T01:25:48.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35cee6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc358106f10 0x7fc35819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:48.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35cee6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc358106f10 0x7fc35819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54776/0 (socket says 172.21.15.81:54776) 2024-09-12T01:25:48.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35cee6640 1 -- 172.21.15.81:0/3823466040 learned_addr learned my addr 172.21.15.81:0/3823466040 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:25:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc3577fe640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc358102790 0x7fc358198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc357fff640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc358101de0 0x7fc3581984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35cee6640 1 -- 172.21.15.81:0/3823466040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc358102790 msgr2=0x7fc358198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35cee6640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc358102790 0x7fc358198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35cee6640 1 -- 172.21.15.81:0/3823466040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc358101de0 msgr2=0x7fc3581984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35cee6640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc358101de0 0x7fc3581984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35cee6640 1 -- 172.21.15.81:0/3823466040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35819d490 con 0x7fc358106f10 2024-09-12T01:25:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc35cee6640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc358106f10 0x7fc35819cdb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc35000cad0 tx=0x7fc35000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.035+0000 7fc3557fa640 1 -- 172.21.15.81:0/3823466040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35000ae20 con 0x7fc358106f10 2024-09-12T01:25:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.036+0000 7fc3557fa640 1 -- 172.21.15.81:0/3823466040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc350005020 con 0x7fc358106f10 2024-09-12T01:25:48.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.036+0000 7fc35e949640 1 -- 172.21.15.81:0/3823466040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35819d780 con 0x7fc358106f10 2024-09-12T01:25:48.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.036+0000 7fc3557fa640 1 -- 172.21.15.81:0/3823466040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35000f6f0 con 0x7fc358106f10 2024-09-12T01:25:48.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.036+0000 7fc35e949640 1 -- 172.21.15.81:0/3823466040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3581a5060 con 0x7fc358106f10 2024-09-12T01:25:48.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.037+0000 7fc35e949640 1 -- 172.21.15.81:0/3823466040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3581021c0 con 0x7fc358106f10 2024-09-12T01:25:48.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.038+0000 7fc3557fa640 1 -- 172.21.15.81:0/3823466040 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc3500051d0 con 0x7fc358106f10 2024-09-12T01:25:48.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.038+0000 7fc3557fa640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc3400a2b80 0x7fc3400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:48.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.038+0000 7fc357fff640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc3400a2b80 0x7fc3400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:48.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.039+0000 7fc3557fa640 1 -- 172.21.15.81:0/3823466040 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fc3500ceb20 con 0x7fc358106f10 2024-09-12T01:25:48.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.039+0000 7fc357fff640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc3400a2b80 0x7fc3400a5040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc348000c00 tx=0x7fc348005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:48.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.043+0000 7fc3557fa640 1 -- 172.21.15.81:0/3823466040 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc350014030 con 0x7fc358106f10 2024-09-12T01:25:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.242+0000 7fc35e949640 1 -- 172.21.15.81:0/3823466040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc35802d7c0 con 0x7fc358106f10 2024-09-12T01:25:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.242+0000 7fc3557fa640 1 -- 172.21.15.81:0/3823466040 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7fc35009b8d0 con 0x7fc358106f10 2024-09-12T01:25:48.243 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:25:48.243 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":6,"btime":"2024-09-12T01:25:46:479889+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-12T01:25:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 6 2024-09-12T01:25:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.244+0000 7fc35e949640 1 -- 172.21.15.81:0/3823466040 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc3400a2b80 msgr2=0x7fc3400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.244+0000 7fc35e949640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc3400a2b80 0x7fc3400a5040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc348000c00 tx=0x7fc348005df0 comp rx=0 tx=0).stop 2024-09-12T01:25:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.244+0000 7fc35e949640 1 -- 172.21.15.81:0/3823466040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc358106f10 msgr2=0x7fc35819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.244+0000 7fc35e949640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc358106f10 0x7fc35819cdb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc35000cad0 tx=0x7fc35000cf90 comp rx=0 tx=0).stop 2024-09-12T01:25:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.245+0000 7fc35e949640 1 -- 172.21.15.81:0/3823466040 shutdown_connections 2024-09-12T01:25:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.245+0000 7fc35e949640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc3400a2b80 0x7fc3400a5040 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.245+0000 7fc35e949640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc358106f10 0x7fc35819cdb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.245+0000 7fc35e949640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc358102790 0x7fc358198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.245+0000 7fc35e949640 1 --2- 172.21.15.81:0/3823466040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc358101de0 0x7fc3581984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.245+0000 7fc35e949640 1 -- 172.21.15.81:0/3823466040 >> 172.21.15.81:0/3823466040 conn(0x7fc3580fd8c0 msgr2=0x7fc3580fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.245+0000 7fc35e949640 1 -- 172.21.15.81:0/3823466040 shutdown_connections 2024-09-12T01:25:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:48.245+0000 7fc35e949640 1 -- 172.21.15.81:0/3823466040 wait complete. 2024-09-12T01:25:48.282 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:25:48 smithi189 podman[65014]: 2024-09-12 01:25:48.012551832 +0000 UTC m=+0.100167710 container create 81899e089eec6abe8465fdfa3db19debd580c4cdc71dd204ec1eea683d165cf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T01:25:48.282 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:25:48 smithi189 podman[65014]: 2024-09-12 01:25:47.928362604 +0000 UTC m=+0.015978497 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:25:48.282 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:25:48 smithi189 podman[65014]: 2024-09-12 01:25:48.257068769 +0000 UTC m=+0.344684650 container init 81899e089eec6abe8465fdfa3db19debd580c4cdc71dd204ec1eea683d165cf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:25:48.282 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:25:48 smithi189 podman[65014]: 2024-09-12 01:25:48.259879278 +0000 UTC m=+0.347495158 container start 81899e089eec6abe8465fdfa3db19debd580c4cdc71dd204ec1eea683d165cf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T01:25:48.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:48 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3823466040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:48.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:48 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3823466040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:48.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:48 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3823466040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:48.782 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:25:48 smithi189 ceph-mds[65034]: -- 172.21.15.189:0/2027527357 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d72af7860 con 0x562d72ad5000 2024-09-12T01:25:48.782 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:25:48 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-f[65030]: starting mds.f at 2024-09-12T01:25:48.782 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:25:48 smithi189 bash[65014]: 81899e089eec6abe8465fdfa3db19debd580c4cdc71dd204ec1eea683d165cf4 2024-09-12T01:25:48.782 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:25:48 smithi189 systemd[1]: Started Ceph mds.f for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:25:49.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:49 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.189:6834/79706687,v1:172.21.15.189:6835/79706687] up:boot 2024-09-12T01:25:49.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:49 smithi189 ceph-mon[35357]: fsmap 6 up:standby 2024-09-12T01:25:49.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:49 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:25:49.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:49 smithi189 ceph-mon[35357]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:49.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:49 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:49.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:49 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:49.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:49 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:49.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:49 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:49.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:49 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:49.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:49 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:49.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:49 smithi189 ceph-mon[35357]: Deploying daemon mds.c on smithi189 2024-09-12T01:25:49.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:49 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.189:6834/79706687,v1:172.21.15.189:6835/79706687] up:boot 2024-09-12T01:25:49.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:49 smithi081 ceph-mon[30920]: fsmap 6 up:standby 2024-09-12T01:25:49.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:49 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:25:49.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:49 smithi081 ceph-mon[30920]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:49.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:49 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:49.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:49 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:49.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:49 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:49.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:49 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:49.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:49 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:49.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:49 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:49.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:49 smithi081 ceph-mon[30920]: Deploying daemon mds.c on smithi189 2024-09-12T01:25:49.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:49 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.189:6834/79706687,v1:172.21.15.189:6835/79706687] up:boot 2024-09-12T01:25:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:49 smithi100 ceph-mon[35275]: fsmap 6 up:standby 2024-09-12T01:25:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:49 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:25:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:49 smithi100 ceph-mon[35275]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:49 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:49 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:49 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:49 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:49 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:49 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:49.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:49 smithi100 ceph-mon[35275]: Deploying daemon mds.c on smithi189 2024-09-12T01:25:50.492 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:25:50 smithi189 systemd[1]: Starting Ceph mds.c for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:25:50.783 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:25:50 smithi189 podman[65317]: 2024-09-12 01:25:50.396068101 +0000 UTC m=+0.015993227 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:25:50.783 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:25:50 smithi189 podman[65317]: 2024-09-12 01:25:50.499116094 +0000 UTC m=+0.119041252 container create f0c12febf156b93b3fad4f69d2080b6852cfe2de50b99b8b199292260d8b9c28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-c, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:25:50.783 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:25:50 smithi189 podman[65317]: 2024-09-12 01:25:50.7016154 +0000 UTC m=+0.321540520 container init f0c12febf156b93b3fad4f69d2080b6852cfe2de50b99b8b199292260d8b9c28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:25:50.783 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:25:50 smithi189 podman[65317]: 2024-09-12 01:25:50.704443525 +0000 UTC m=+0.324368659 container start f0c12febf156b93b3fad4f69d2080b6852cfe2de50b99b8b199292260d8b9c28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T01:25:50.783 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:25:50 smithi189 ceph-mds[65336]: -- 172.21.15.189:0/1494583858 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e3302b1860 con 0x55e33028f400 2024-09-12T01:25:50.783 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:25:50 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-c[65332]: starting mds.c at 2024-09-12T01:25:50.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:25:51.250 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:25:51.282 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:25:50 smithi189 bash[65317]: f0c12febf156b93b3fad4f69d2080b6852cfe2de50b99b8b199292260d8b9c28 2024-09-12T01:25:51.282 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:25:50 smithi189 systemd[1]: Started Ceph mds.c for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:25:51.561 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:51 smithi100 ceph-mon[35275]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:51.561 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:51 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:51.562 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:51 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:51.562 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:51 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:51.562 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:51 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:51.562 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:51 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:51.562 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:51 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:51.675 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:51 smithi081 ceph-mon[30920]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:51.675 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:51.675 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:51.675 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:51.675 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:51.676 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:51.676 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:51 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.756+0000 7f80a0886640 1 -- 172.21.15.81:0/360319170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c102d40 msgr2=0x7f809c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.756+0000 7f80a0886640 1 --2- 172.21.15.81:0/360319170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c102d40 0x7f809c103120 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f808c009900 tx=0x7f808c02a480 comp rx=0 tx=0).stop 2024-09-12T01:25:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.756+0000 7f80a0886640 1 -- 172.21.15.81:0/360319170 shutdown_connections 2024-09-12T01:25:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.756+0000 7f80a0886640 1 --2- 172.21.15.81:0/360319170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f809c10c170 0x7f809c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.756+0000 7f80a0886640 1 --2- 172.21.15.81:0/360319170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f809c103660 0x7f809c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.756+0000 7f80a0886640 1 --2- 172.21.15.81:0/360319170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c102d40 0x7f809c103120 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.756+0000 7f80a0886640 1 -- 172.21.15.81:0/360319170 >> 172.21.15.81:0/360319170 conn(0x7f809c0fc7a0 msgr2=0x7f809c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.756+0000 7f80a0886640 1 -- 172.21.15.81:0/360319170 shutdown_connections 2024-09-12T01:25:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.756+0000 7f80a0886640 1 -- 172.21.15.81:0/360319170 wait complete. 2024-09-12T01:25:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.757+0000 7f80a0886640 1 Processor -- start 2024-09-12T01:25:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.757+0000 7f80a0886640 1 -- start start 2024-09-12T01:25:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f80a0886640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f809c102d40 0x7f809c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f80a0886640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c103660 0x7f809c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f80a0886640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f809c10c170 0x7f809c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f80a0886640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f809c111f70 con 0x7f809c103660 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f80a0886640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f809c111df0 con 0x7f809c102d40 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f80a0886640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f809c1120f0 con 0x7f809c10c170 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f8091d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c103660 0x7f809c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f8091d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c103660 0x7f809c198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54790/0 (socket says 172.21.15.81:54790) 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f8091d9b640 1 -- 172.21.15.81:0/2131679520 learned_addr learned my addr 172.21.15.81:0/2131679520 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f809a59c640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f809c102d40 0x7f809c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f809ad9d640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f809c10c170 0x7f809c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f8091d9b640 1 -- 172.21.15.81:0/2131679520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f809c10c170 msgr2=0x7f809c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f8091d9b640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f809c10c170 0x7f809c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f8091d9b640 1 -- 172.21.15.81:0/2131679520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f809c102d40 msgr2=0x7f809c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f8091d9b640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f809c102d40 0x7f809c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f8091d9b640 1 -- 172.21.15.81:0/2131679520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c19d3e0 con 0x7f809c103660 2024-09-12T01:25:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f8091d9b640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c103660 0x7f809c198970 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f808400d740 tx=0x7f808400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f8093fff640 1 -- 172.21.15.81:0/2131679520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084017070 con 0x7f809c103660 2024-09-12T01:25:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f8093fff640 1 -- 172.21.15.81:0/2131679520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f808400de50 con 0x7f809c103660 2024-09-12T01:25:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f80a0886640 1 -- 172.21.15.81:0/2131679520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809c19d6d0 con 0x7f809c103660 2024-09-12T01:25:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f8093fff640 1 -- 172.21.15.81:0/2131679520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808400f620 con 0x7f809c103660 2024-09-12T01:25:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.758+0000 7f80a0886640 1 -- 172.21.15.81:0/2131679520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809c1a4fb0 con 0x7f809c103660 2024-09-12T01:25:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.760+0000 7f80a0886640 1 -- 172.21.15.81:0/2131679520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809c103120 con 0x7f809c103660 2024-09-12T01:25:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.761+0000 7f8093fff640 1 -- 172.21.15.81:0/2131679520 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8084009c30 con 0x7f809c103660 2024-09-12T01:25:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.762+0000 7f8093fff640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f80880a2b80 0x7f80880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.762+0000 7f8093fff640 1 -- 172.21.15.81:0/2131679520 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f80840ce6f0 con 0x7f809c103660 2024-09-12T01:25:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.762+0000 7f809a59c640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f80880a2b80 0x7f80880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.762+0000 7f809a59c640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f80880a2b80 0x7f80880a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f808c009230 tx=0x7f808c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.765+0000 7f8093fff640 1 -- 172.21.15.81:0/2131679520 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f808409b4a0 con 0x7f809c103660 2024-09-12T01:25:51.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:51 smithi189 ceph-mon[35357]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:51.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:51 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:51.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:51 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:51.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:51 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:51.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:51 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:51.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:51 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:51.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:51 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:51.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.964+0000 7f80a0886640 1 -- 172.21.15.81:0/2131679520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f809c107240 con 0x7f809c103660 2024-09-12T01:25:51.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.965+0000 7f8093fff640 1 -- 172.21.15.81:0/2131679520 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6385 (secure 0 0 0) 0x7f808409f7a0 con 0x7f809c103660 2024-09-12T01:25:51.964 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:25:51.964 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"btime":"2024-09-12T01:25:51:473436+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-12T01:25:51.964 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2024-09-12T01:25:51.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.967+0000 7f80a0886640 1 -- 172.21.15.81:0/2131679520 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f80880a2b80 msgr2=0x7f80880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:51.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.967+0000 7f80a0886640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f80880a2b80 0x7f80880a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f808c009230 tx=0x7f808c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:25:51.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.967+0000 7f80a0886640 1 -- 172.21.15.81:0/2131679520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c103660 msgr2=0x7f809c198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:51.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.967+0000 7f80a0886640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c103660 0x7f809c198970 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f808400d740 tx=0x7f808400dc00 comp rx=0 tx=0).stop 2024-09-12T01:25:51.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.967+0000 7f80a0886640 1 -- 172.21.15.81:0/2131679520 shutdown_connections 2024-09-12T01:25:51.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.967+0000 7f80a0886640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f80880a2b80 0x7f80880a5040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:51.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.967+0000 7f80a0886640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f809c10c170 0x7f809c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:51.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.967+0000 7f80a0886640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f809c103660 0x7f809c198970 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:51.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.967+0000 7f80a0886640 1 --2- 172.21.15.81:0/2131679520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f809c102d40 0x7f809c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:51.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.967+0000 7f80a0886640 1 -- 172.21.15.81:0/2131679520 >> 172.21.15.81:0/2131679520 conn(0x7f809c0fc7a0 msgr2=0x7f809c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:51.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.967+0000 7f80a0886640 1 -- 172.21.15.81:0/2131679520 shutdown_connections 2024-09-12T01:25:51.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:51.967+0000 7f80a0886640 1 -- 172.21.15.81:0/2131679520 wait complete. 2024-09-12T01:25:52.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:52 smithi081 ceph-mon[30920]: Deploying daemon mds.h on smithi100 2024-09-12T01:25:52.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:52 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.189:6836/129654641,v1:172.21.15.189:6837/129654641] up:boot 2024-09-12T01:25:52.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:52 smithi081 ceph-mon[30920]: fsmap 7 up:standby 2024-09-12T01:25:52.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:52 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:25:52.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:52 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2131679520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:52.669 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:52 smithi100 ceph-mon[35275]: Deploying daemon mds.h on smithi100 2024-09-12T01:25:52.669 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:52 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.189:6836/129654641,v1:172.21.15.189:6837/129654641] up:boot 2024-09-12T01:25:52.669 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:52 smithi100 ceph-mon[35275]: fsmap 7 up:standby 2024-09-12T01:25:52.669 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:52 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:25:52.669 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:52 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2131679520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:52.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:52 smithi189 ceph-mon[35357]: Deploying daemon mds.h on smithi100 2024-09-12T01:25:52.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:52 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.189:6836/129654641,v1:172.21.15.189:6837/129654641] up:boot 2024-09-12T01:25:52.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:52 smithi189 ceph-mon[35357]: fsmap 7 up:standby 2024-09-12T01:25:52.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:52 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:25:52.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:52 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2131679520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:53.018 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:25:52 smithi100 systemd[1]: Starting Ceph mds.h for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:25:53.336 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:25:53 smithi100 podman[65293]: 2024-09-12 01:25:52.964305528 +0000 UTC m=+0.016055838 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:25:53.337 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:25:53 smithi100 podman[65293]: 2024-09-12 01:25:53.093807642 +0000 UTC m=+0.145557992 container create a15bb8afa819c0d162ad2c771902ba4fac22b72fbc3bbd73384645a3f3d7b422 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-h, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T01:25:53.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:53 smithi100 ceph-mon[35275]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:53.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:53 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:53.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:53 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:53.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:53 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:53.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:53 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:53.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:53 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:53.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:53 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:53.769 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:25:53 smithi100 podman[65293]: 2024-09-12 01:25:53.337765358 +0000 UTC m=+0.389515662 container init a15bb8afa819c0d162ad2c771902ba4fac22b72fbc3bbd73384645a3f3d7b422 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-h, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T01:25:53.769 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:25:53 smithi100 podman[65293]: 2024-09-12 01:25:53.340897683 +0000 UTC m=+0.392647990 container start a15bb8afa819c0d162ad2c771902ba4fac22b72fbc3bbd73384645a3f3d7b422 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T01:25:53.769 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:25:53 smithi100 ceph-mds[65312]: -- 172.21.15.100:0/3042323484 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5652cefb7860 con 0x5652cef95000 2024-09-12T01:25:53.769 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:25:53 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-h[65308]: starting mds.h at 2024-09-12T01:25:53.769 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:25:53 smithi100 bash[65293]: a15bb8afa819c0d162ad2c771902ba4fac22b72fbc3bbd73384645a3f3d7b422 2024-09-12T01:25:53.770 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:25:53 smithi100 systemd[1]: Started Ceph mds.h for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:25:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:53 smithi189 ceph-mon[35357]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:53 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:53 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:53 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:53 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:53 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:53 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:53.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:53 smithi081 ceph-mon[30920]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:53.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:53 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:53.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:53 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:53.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:53 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:53.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:53 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:53.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:53 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:53.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:53 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:54.583 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:25:54.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:54 smithi100 ceph-mon[35275]: Deploying daemon mds.i on smithi189 2024-09-12T01:25:54.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:54 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] up:boot 2024-09-12T01:25:54.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:54 smithi100 ceph-mon[35275]: fsmap 8 up:standby 2024-09-12T01:25:54.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:54 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:25:54.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:54 smithi189 ceph-mon[35357]: Deploying daemon mds.i on smithi189 2024-09-12T01:25:54.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:54 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] up:boot 2024-09-12T01:25:54.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:54 smithi189 ceph-mon[35357]: fsmap 8 up:standby 2024-09-12T01:25:54.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:54 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:25:54.844 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:25:54.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:54 smithi081 ceph-mon[30920]: Deploying daemon mds.i on smithi189 2024-09-12T01:25:54.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:54 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] up:boot 2024-09-12T01:25:54.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:54 smithi081 ceph-mon[30920]: fsmap 8 up:standby 2024-09-12T01:25:54.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:54 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:25:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.345+0000 7fea252c9640 1 -- 172.21.15.81:0/1835623909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea20102de0 msgr2=0x7fea201031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.345+0000 7fea252c9640 1 --2- 172.21.15.81:0/1835623909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea20102de0 0x7fea201031c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fea10009900 tx=0x7fea1002a480 comp rx=0 tx=0).stop 2024-09-12T01:25:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.345+0000 7fea252c9640 1 -- 172.21.15.81:0/1835623909 shutdown_connections 2024-09-12T01:25:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.345+0000 7fea252c9640 1 --2- 172.21.15.81:0/1835623909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea2010c180 0x7fea2010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.345+0000 7fea252c9640 1 --2- 172.21.15.81:0/1835623909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea20103700 0x7fea2010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.345+0000 7fea252c9640 1 --2- 172.21.15.81:0/1835623909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea20102de0 0x7fea201031c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.345+0000 7fea252c9640 1 -- 172.21.15.81:0/1835623909 >> 172.21.15.81:0/1835623909 conn(0x7fea200fc7a0 msgr2=0x7fea200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.345+0000 7fea252c9640 1 -- 172.21.15.81:0/1835623909 shutdown_connections 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.345+0000 7fea252c9640 1 -- 172.21.15.81:0/1835623909 wait complete. 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.346+0000 7fea252c9640 1 Processor -- start 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.346+0000 7fea252c9640 1 -- start start 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.346+0000 7fea252c9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea20102de0 0x7fea20198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.346+0000 7fea252c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea20103700 0x7fea201989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.346+0000 7fea252c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2010c180 0x7fea2019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.346+0000 7fea252c9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea20111f70 con 0x7fea2010c180 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.346+0000 7fea252c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fea20111df0 con 0x7fea20103700 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.346+0000 7fea252c9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fea201120f0 con 0x7fea20102de0 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.346+0000 7fea1f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2010c180 0x7fea2019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.346+0000 7fea1f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2010c180 0x7fea2019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43164/0 (socket says 172.21.15.81:43164) 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.346+0000 7fea1f7fe640 1 -- 172.21.15.81:0/1835607872 learned_addr learned my addr 172.21.15.81:0/1835607872 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:25:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.346+0000 7fea1effd640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea20102de0 0x7fea20198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.346+0000 7fea1e7fc640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea20103700 0x7fea201989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.347+0000 7fea1f7fe640 1 -- 172.21.15.81:0/1835607872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea20102de0 msgr2=0x7fea20198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.347+0000 7fea1f7fe640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea20102de0 0x7fea20198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.347+0000 7fea1f7fe640 1 -- 172.21.15.81:0/1835607872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea20103700 msgr2=0x7fea201989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.347+0000 7fea1f7fe640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea20103700 0x7fea201989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.347+0000 7fea1f7fe640 1 -- 172.21.15.81:0/1835607872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2019d420 con 0x7fea2010c180 2024-09-12T01:25:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.347+0000 7fea1f7fe640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2010c180 0x7fea2019cd40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fea1800eaa0 tx=0x7fea1800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.347+0000 7fea07fff640 1 -- 172.21.15.81:0/1835607872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1800cdb0 con 0x7fea2010c180 2024-09-12T01:25:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.347+0000 7fea07fff640 1 -- 172.21.15.81:0/1835607872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea18005020 con 0x7fea2010c180 2024-09-12T01:25:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.347+0000 7fea252c9640 1 -- 172.21.15.81:0/1835607872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea2019d710 con 0x7fea2010c180 2024-09-12T01:25:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.347+0000 7fea07fff640 1 -- 172.21.15.81:0/1835607872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea180116b0 con 0x7fea2010c180 2024-09-12T01:25:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.347+0000 7fea252c9640 1 -- 172.21.15.81:0/1835607872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea201a4ff0 con 0x7fea2010c180 2024-09-12T01:25:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.348+0000 7fea252c9640 1 -- 172.21.15.81:0/1835607872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea201031c0 con 0x7fea2010c180 2024-09-12T01:25:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.349+0000 7fea07fff640 1 -- 172.21.15.81:0/1835607872 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fea18005560 con 0x7fea2010c180 2024-09-12T01:25:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.350+0000 7fea07fff640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fea080a2b80 0x7fea080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.350+0000 7fea1effd640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fea080a2b80 0x7fea080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.350+0000 7fea07fff640 1 -- 172.21.15.81:0/1835607872 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fea180cece0 con 0x7fea2010c180 2024-09-12T01:25:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.350+0000 7fea1effd640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fea080a2b80 0x7fea080a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fea10009230 tx=0x7fea100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.354+0000 7fea07fff640 1 -- 172.21.15.81:0/1835607872 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea18016030 con 0x7fea2010c180 2024-09-12T01:25:55.497 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:25:55 smithi189 systemd[1]: Starting Ceph mds.i for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:25:55.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.556+0000 7fea252c9640 1 -- 172.21.15.81:0/1835607872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea201072c0 con 0x7fea2010c180 2024-09-12T01:25:55.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:55 smithi081 ceph-mon[30920]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:55.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.556+0000 7fea07fff640 1 -- 172.21.15.81:0/1835607872 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7213 (secure 0 0 0) 0x7fea1809ba90 con 0x7fea2010c180 2024-09-12T01:25:55.556 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:25:55.556 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-12T01:25:53:485035+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-12T01:25:55.556 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-12T01:25:55.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.558+0000 7fea252c9640 1 -- 172.21.15.81:0/1835607872 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fea080a2b80 msgr2=0x7fea080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:55.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.558+0000 7fea252c9640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fea080a2b80 0x7fea080a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fea10009230 tx=0x7fea100058d0 comp rx=0 tx=0).stop 2024-09-12T01:25:55.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.558+0000 7fea252c9640 1 -- 172.21.15.81:0/1835607872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2010c180 msgr2=0x7fea2019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:55.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.558+0000 7fea252c9640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2010c180 0x7fea2019cd40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fea1800eaa0 tx=0x7fea1800ef60 comp rx=0 tx=0).stop 2024-09-12T01:25:55.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.558+0000 7fea252c9640 1 -- 172.21.15.81:0/1835607872 shutdown_connections 2024-09-12T01:25:55.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.558+0000 7fea252c9640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fea080a2b80 0x7fea080a5040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:55.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.558+0000 7fea252c9640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2010c180 0x7fea2019cd40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:55.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.558+0000 7fea252c9640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea20103700 0x7fea201989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:55.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.558+0000 7fea252c9640 1 --2- 172.21.15.81:0/1835607872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea20102de0 0x7fea20198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.558+0000 7fea252c9640 1 -- 172.21.15.81:0/1835607872 >> 172.21.15.81:0/1835607872 conn(0x7fea200fc7a0 msgr2=0x7fea200fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.559+0000 7fea252c9640 1 -- 172.21.15.81:0/1835607872 shutdown_connections 2024-09-12T01:25:55.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:55.559+0000 7fea252c9640 1 -- 172.21.15.81:0/1835607872 wait complete. 2024-09-12T01:25:55.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:55 smithi100 ceph-mon[35275]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:55.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:55 smithi189 ceph-mon[35357]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:55.782 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:25:55 smithi189 podman[65615]: 2024-09-12 01:25:55.447516703 +0000 UTC m=+0.016292410 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:25:55.782 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:25:55 smithi189 podman[65615]: 2024-09-12 01:25:55.577364993 +0000 UTC m=+0.146140726 container create 1ca6ae8cab529c007e07534fd0dd1a04a03d8e2779761f7c66fba9633f7838f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-i, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T01:25:56.282 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:25:55 smithi189 podman[65615]: 2024-09-12 01:25:55.787746014 +0000 UTC m=+0.356521699 container init 1ca6ae8cab529c007e07534fd0dd1a04a03d8e2779761f7c66fba9633f7838f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-i, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True) 2024-09-12T01:25:56.282 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:25:55 smithi189 podman[65615]: 2024-09-12 01:25:55.790531511 +0000 UTC m=+0.359307205 container start 1ca6ae8cab529c007e07534fd0dd1a04a03d8e2779761f7c66fba9633f7838f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-i, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T01:25:56.282 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:25:55 smithi189 ceph-mds[65634]: -- 172.21.15.189:0/1353801559 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555a84907860 con 0x555a848e5000 2024-09-12T01:25:56.282 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:25:55 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-i[65630]: starting mds.i at 2024-09-12T01:25:56.282 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:25:55 smithi189 bash[65615]: 1ca6ae8cab529c007e07534fd0dd1a04a03d8e2779761f7c66fba9633f7838f0 2024-09-12T01:25:56.282 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:25:55 smithi189 systemd[1]: Started Ceph mds.i for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:25:56.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:56 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1835607872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:56.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:56 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:56.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:56 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:56.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:56 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:56.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:56 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:56.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:56 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:56.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:56 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:56.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:56 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1835607872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:56.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:56 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:56.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:56 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:56.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:56 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:56.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:56 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:56.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:56 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:56.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:56 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:56.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:56 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1835607872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:56.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:56 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:56.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:56 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:56.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:56 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:56.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:56 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:56.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:56 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:56.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:56 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:57.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:57 smithi081 ceph-mon[30920]: Deploying daemon mds.g on smithi081 2024-09-12T01:25:57.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:57 smithi081 ceph-mon[30920]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:57.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:57 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] up:boot 2024-09-12T01:25:57.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:57 smithi081 ceph-mon[30920]: fsmap 9 up:standby 2024-09-12T01:25:57.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:57 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:25:57.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:57 smithi100 ceph-mon[35275]: Deploying daemon mds.g on smithi081 2024-09-12T01:25:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:57 smithi100 ceph-mon[35275]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:57 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] up:boot 2024-09-12T01:25:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:57 smithi100 ceph-mon[35275]: fsmap 9 up:standby 2024-09-12T01:25:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:57 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:25:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:57 smithi189 ceph-mon[35357]: Deploying daemon mds.g on smithi081 2024-09-12T01:25:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:57 smithi189 ceph-mon[35357]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:57 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] up:boot 2024-09-12T01:25:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:57 smithi189 ceph-mon[35357]: fsmap 9 up:standby 2024-09-12T01:25:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:57 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:25:58.144 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:25:57 smithi081 systemd[1]: Starting Ceph mds.g for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:25:58.300 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:25:58.415 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:25:58 smithi081 podman[71492]: 2024-09-12 01:25:58.048297317 +0000 UTC m=+0.015657269 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:25:58.415 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:25:58 smithi081 podman[71492]: 2024-09-12 01:25:58.171696829 +0000 UTC m=+0.139056767 container create 67bcc15999e4a84d5970e8fca40b507dc4efcd35f230aa928693ad2f4fbc7ba8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T01:25:58.415 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:25:58 smithi081 podman[71492]: 2024-09-12 01:25:58.416510116 +0000 UTC m=+0.383870074 container init 67bcc15999e4a84d5970e8fca40b507dc4efcd35f230aa928693ad2f4fbc7ba8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True) 2024-09-12T01:25:58.580 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:25:58.702 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:25:58 smithi081 podman[71492]: 2024-09-12 01:25:58.420527722 +0000 UTC m=+0.387887671 container start 67bcc15999e4a84d5970e8fca40b507dc4efcd35f230aa928693ad2f4fbc7ba8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T01:25:58.702 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:25:58 smithi081 ceph-mds[71529]: -- 172.21.15.81:0/2797865982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55df08805860 con 0x55df087e3400 2024-09-12T01:25:58.702 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:25:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-g[71507]: starting mds.g at 2024-09-12T01:25:58.702 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:25:58 smithi081 bash[71492]: 67bcc15999e4a84d5970e8fca40b507dc4efcd35f230aa928693ad2f4fbc7ba8 2024-09-12T01:25:58.702 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:25:58 smithi081 systemd[1]: Started Ceph mds.g for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:25:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.033+0000 7f4d0e369640 1 -- 172.21.15.81:0/3657584020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d08102790 msgr2=0x7f4d081067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.033+0000 7f4d0e369640 1 --2- 172.21.15.81:0/3657584020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d08102790 0x7f4d081067e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009900 tx=0x7f4cf002a410 comp rx=0 tx=0).stop 2024-09-12T01:25:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.033+0000 7f4d0e369640 1 -- 172.21.15.81:0/3657584020 shutdown_connections 2024-09-12T01:25:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.033+0000 7f4d0e369640 1 --2- 172.21.15.81:0/3657584020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d08106f10 0x7f4d0810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.033+0000 7f4d0e369640 1 --2- 172.21.15.81:0/3657584020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d08102790 0x7f4d081067e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.033+0000 7f4d0e369640 1 --2- 172.21.15.81:0/3657584020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d08101de0 0x7f4d081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.033+0000 7f4d0e369640 1 -- 172.21.15.81:0/3657584020 >> 172.21.15.81:0/3657584020 conn(0x7f4d080fd8c0 msgr2=0x7f4d080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.034+0000 7f4d0e369640 1 -- 172.21.15.81:0/3657584020 shutdown_connections 2024-09-12T01:25:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.034+0000 7f4d0e369640 1 -- 172.21.15.81:0/3657584020 wait complete. 2024-09-12T01:25:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.034+0000 7f4d0e369640 1 Processor -- start 2024-09-12T01:25:59.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.034+0000 7f4d0e369640 1 -- start start 2024-09-12T01:25:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.034+0000 7f4d0e369640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d08101de0 0x7f4d080744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.034+0000 7f4d0e369640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d08102790 0x7f4d08074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.034+0000 7f4d0e369640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d08106f10 0x7f4d08074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.034+0000 7f4d0e369640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d08111fb0 con 0x7f4d08102790 2024-09-12T01:25:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.034+0000 7f4d0e369640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d08111e30 con 0x7f4d08101de0 2024-09-12T01:25:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.034+0000 7f4d0e369640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d08112130 con 0x7f4d08106f10 2024-09-12T01:25:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.034+0000 7f4cfffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d08102790 0x7f4d08074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4cfffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d08102790 0x7f4d08074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43190/0 (socket says 172.21.15.81:43190) 2024-09-12T01:25:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4cfffff640 1 -- 172.21.15.81:0/3860788418 learned_addr learned my addr 172.21.15.81:0/3860788418 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:25:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4d0c906640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d08106f10 0x7f4d08074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4d07fff640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d08101de0 0x7f4d080744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4cfffff640 1 -- 172.21.15.81:0/3860788418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d08106f10 msgr2=0x7f4d08074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4cfffff640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d08106f10 0x7f4d08074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4cfffff640 1 -- 172.21.15.81:0/3860788418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d08101de0 msgr2=0x7f4d080744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4cfffff640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d08101de0 0x7f4d080744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4cfffff640 1 -- 172.21.15.81:0/3860788418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d081a6970 con 0x7f4d08102790 2024-09-12T01:25:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4cfffff640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d08102790 0x7f4d08074a30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0006010 tx=0x7f4cf00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4d05ffb640 1 -- 172.21.15.81:0/3860788418 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf003f030 con 0x7f4d08102790 2024-09-12T01:25:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4d05ffb640 1 -- 172.21.15.81:0/3860788418 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cf0003ce0 con 0x7f4d08102790 2024-09-12T01:25:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4d0e369640 1 -- 172.21.15.81:0/3860788418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d081a6c00 con 0x7f4d08102790 2024-09-12T01:25:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4d05ffb640 1 -- 172.21.15.81:0/3860788418 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0035070 con 0x7f4d08102790 2024-09-12T01:25:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.035+0000 7f4d0e369640 1 -- 172.21.15.81:0/3860788418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d081a70e0 con 0x7f4d08102790 2024-09-12T01:25:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.036+0000 7f4d0e369640 1 -- 172.21.15.81:0/3860788418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d081021c0 con 0x7f4d08102790 2024-09-12T01:25:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.037+0000 7f4d05ffb640 1 -- 172.21.15.81:0/3860788418 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4cf0042030 con 0x7f4d08102790 2024-09-12T01:25:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.038+0000 7f4d05ffb640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4cf40a2b80 0x7f4cf40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:25:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.038+0000 7f4d07fff640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4cf40a2b80 0x7f4cf40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:25:59.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.038+0000 7f4d05ffb640 1 -- 172.21.15.81:0/3860788418 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f4cf00ef400 con 0x7f4d08102790 2024-09-12T01:25:59.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.038+0000 7f4d07fff640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4cf40a2b80 0x7f4cf40a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8005fd0 tx=0x7f4cf8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:25:59.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.041+0000 7f4d05ffb640 1 -- 172.21.15.81:0/3860788418 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4cf00bc8c0 con 0x7f4d08102790 2024-09-12T01:25:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.258+0000 7f4d0e369640 1 -- 172.21.15.81:0/3860788418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d0802d7c0 con 0x7f4d08102790 2024-09-12T01:25:59.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.259+0000 7f4d05ffb640 1 -- 172.21.15.81:0/3860788418 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8869 (secure 0 0 0) 0x7f4cf00bc1c0 con 0x7f4d08102790 2024-09-12T01:25:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:25:59.258 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":11,"btime":"2024-09-12T01:25:58:504684+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24448,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T01:25:59.258 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 11 2024-09-12T01:25:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.261+0000 7f4d0e369640 1 -- 172.21.15.81:0/3860788418 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4cf40a2b80 msgr2=0x7f4cf40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.261+0000 7f4d0e369640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4cf40a2b80 0x7f4cf40a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8005fd0 tx=0x7f4cf8005850 comp rx=0 tx=0).stop 2024-09-12T01:25:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.261+0000 7f4d0e369640 1 -- 172.21.15.81:0/3860788418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d08102790 msgr2=0x7f4d08074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:25:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.261+0000 7f4d0e369640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d08102790 0x7f4d08074a30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0006010 tx=0x7f4cf00042f0 comp rx=0 tx=0).stop 2024-09-12T01:25:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.261+0000 7f4d0e369640 1 -- 172.21.15.81:0/3860788418 shutdown_connections 2024-09-12T01:25:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.261+0000 7f4d0e369640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4cf40a2b80 0x7f4cf40a5040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.261+0000 7f4d0e369640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d08106f10 0x7f4d08074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.261+0000 7f4d0e369640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d08102790 0x7f4d08074a30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.261+0000 7f4d0e369640 1 --2- 172.21.15.81:0/3860788418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d08101de0 0x7f4d080744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:25:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.261+0000 7f4d0e369640 1 -- 172.21.15.81:0/3860788418 >> 172.21.15.81:0/3860788418 conn(0x7f4d080fd8c0 msgr2=0x7f4d080fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:25:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.261+0000 7f4d0e369640 1 -- 172.21.15.81:0/3860788418 shutdown_connections 2024-09-12T01:25:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:25:59.261+0000 7f4d0e369640 1 -- 172.21.15.81:0/3860788418 wait complete. 2024-09-12T01:25:59.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:59 smithi100 ceph-mon[35275]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:59.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:59 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.81:6838/1118446149,v1:172.21.15.81:6839/1118446149] up:boot 2024-09-12T01:25:59.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:59 smithi100 ceph-mon[35275]: fsmap 10 up:standby 2024-09-12T01:25:59.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:25:59.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:59.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:59.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:59.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:59.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:59.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:59 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:59.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:59 smithi100 ceph-mon[35275]: Deploying daemon mds.a on smithi081 2024-09-12T01:25:59.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:25:59 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3860788418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:59 smithi189 ceph-mon[35357]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:59 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.81:6838/1118446149,v1:172.21.15.81:6839/1118446149] up:boot 2024-09-12T01:25:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:59 smithi189 ceph-mon[35357]: fsmap 10 up:standby 2024-09-12T01:25:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:25:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:59.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:59.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:59 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:59.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:59 smithi189 ceph-mon[35357]: Deploying daemon mds.a on smithi081 2024-09-12T01:25:59.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:25:59 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3860788418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:25:59.907 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:59 smithi081 ceph-mon[30920]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:25:59.907 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:59 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.81:6838/1118446149,v1:172.21.15.81:6839/1118446149] up:boot 2024-09-12T01:25:59.907 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:59 smithi081 ceph-mon[30920]: fsmap 10 up:standby 2024-09-12T01:25:59.907 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:25:59.907 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:59.907 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:59.907 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:25:59.907 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:25:59.907 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:25:59.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:59 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:25:59.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:59 smithi081 ceph-mon[30920]: Deploying daemon mds.a on smithi081 2024-09-12T01:25:59.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:25:59 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3860788418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:26:01.489 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:26:01 smithi081 systemd[1]: Starting Ceph mds.a for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:26:01.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:01 smithi100 ceph-mon[35275]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:01 smithi189 ceph-mon[35357]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:01.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:01 smithi081 ceph-mon[30920]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:01.852 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:26:01 smithi081 podman[71907]: 2024-09-12 01:26:01.497002268 +0000 UTC m=+0.015836714 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:26:01.852 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:26:01 smithi081 podman[71907]: 2024-09-12 01:26:01.616587558 +0000 UTC m=+0.135422003 container create 1d50f334aaba8fd4d706d37e15cad46a19199ed9295830436ec94726ee25b0ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T01:26:01.852 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:26:01 smithi081 podman[71907]: 2024-09-12 01:26:01.852446192 +0000 UTC m=+0.371280638 container init 1d50f334aaba8fd4d706d37e15cad46a19199ed9295830436ec94726ee25b0ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T01:26:01.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:26:02.198 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:02.238 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:26:01 smithi081 podman[71907]: 2024-09-12 01:26:01.855225403 +0000 UTC m=+0.374059857 container start 1d50f334aaba8fd4d706d37e15cad46a19199ed9295830436ec94726ee25b0ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T01:26:02.238 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:26:01 smithi081 ceph-mds[71926]: -- 172.21.15.81:0/520408326 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c58b819860 con 0x55c58b7f7000 2024-09-12T01:26:02.239 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:26:01 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-a[71922]: starting mds.a at 2024-09-12T01:26:02.239 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:26:01 smithi081 bash[71907]: 1d50f334aaba8fd4d706d37e15cad46a19199ed9295830436ec94726ee25b0ab 2024-09-12T01:26:02.239 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:26:01 smithi081 systemd[1]: Started Ceph mds.a for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:26:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.661+0000 7fd4d21d9640 1 -- 172.21.15.81:0/3898783612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4cc10c170 msgr2=0x7fd4cc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.661+0000 7fd4d21d9640 1 --2- 172.21.15.81:0/3898783612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4cc10c170 0x7fd4cc10e610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009ca0 tx=0x7fd4c402a950 comp rx=0 tx=0).stop 2024-09-12T01:26:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.661+0000 7fd4d21d9640 1 -- 172.21.15.81:0/3898783612 shutdown_connections 2024-09-12T01:26:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.661+0000 7fd4d21d9640 1 --2- 172.21.15.81:0/3898783612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4cc10c170 0x7fd4cc10e610 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.661+0000 7fd4d21d9640 1 --2- 172.21.15.81:0/3898783612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4cc103660 0x7fd4cc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.661+0000 7fd4d21d9640 1 --2- 172.21.15.81:0/3898783612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4cc102d40 0x7fd4cc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.661+0000 7fd4d21d9640 1 -- 172.21.15.81:0/3898783612 >> 172.21.15.81:0/3898783612 conn(0x7fd4cc0fc7a0 msgr2=0x7fd4cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.661+0000 7fd4d21d9640 1 -- 172.21.15.81:0/3898783612 shutdown_connections 2024-09-12T01:26:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.661+0000 7fd4d21d9640 1 -- 172.21.15.81:0/3898783612 wait complete. 2024-09-12T01:26:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.662+0000 7fd4d21d9640 1 Processor -- start 2024-09-12T01:26:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.662+0000 7fd4d21d9640 1 -- start start 2024-09-12T01:26:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.662+0000 7fd4d21d9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4cc102d40 0x7fd4cc198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.662+0000 7fd4d21d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4cc103660 0x7fd4cc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.662+0000 7fd4d21d9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4cc10c170 0x7fd4cc19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.662+0000 7fd4d21d9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc111f50 con 0x7fd4cc103660 2024-09-12T01:26:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.662+0000 7fd4d21d9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc111dd0 con 0x7fd4cc102d40 2024-09-12T01:26:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.662+0000 7fd4d21d9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc1120d0 con 0x7fd4cc10c170 2024-09-12T01:26:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.662+0000 7fd4caffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4cc103660 0x7fd4cc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.662+0000 7fd4caffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4cc103660 0x7fd4cc1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58472/0 (socket says 172.21.15.81:58472) 2024-09-12T01:26:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.662+0000 7fd4caffd640 1 -- 172.21.15.81:0/4975442 learned_addr learned my addr 172.21.15.81:0/4975442 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.662+0000 7fd4cb7fe640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4cc102d40 0x7fd4cc198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.662+0000 7fd4cbfff640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4cc10c170 0x7fd4cc19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.663+0000 7fd4caffd640 1 -- 172.21.15.81:0/4975442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4cc10c170 msgr2=0x7fd4cc19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.663+0000 7fd4caffd640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4cc10c170 0x7fd4cc19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.663+0000 7fd4caffd640 1 -- 172.21.15.81:0/4975442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4cc102d40 msgr2=0x7fd4cc198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.663+0000 7fd4caffd640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4cc102d40 0x7fd4cc198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.663+0000 7fd4caffd640 1 -- 172.21.15.81:0/4975442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4cc19d410 con 0x7fd4cc103660 2024-09-12T01:26:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.663+0000 7fd4caffd640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4cc103660 0x7fd4cc1989a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00d750 tx=0x7fd4bc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:02.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.663+0000 7fd4c8ff9640 1 -- 172.21.15.81:0/4975442 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc017070 con 0x7fd4cc103660 2024-09-12T01:26:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.663+0000 7fd4d21d9640 1 -- 172.21.15.81:0/4975442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4cc19d700 con 0x7fd4cc103660 2024-09-12T01:26:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.663+0000 7fd4c8ff9640 1 -- 172.21.15.81:0/4975442 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4bc005020 con 0x7fd4cc103660 2024-09-12T01:26:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.663+0000 7fd4c8ff9640 1 -- 172.21.15.81:0/4975442 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc004d00 con 0x7fd4cc103660 2024-09-12T01:26:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.663+0000 7fd4d21d9640 1 -- 172.21.15.81:0/4975442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4cc1a4fe0 con 0x7fd4cc103660 2024-09-12T01:26:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.664+0000 7fd4d21d9640 1 -- 172.21.15.81:0/4975442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4cc103120 con 0x7fd4cc103660 2024-09-12T01:26:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.665+0000 7fd4c8ff9640 1 -- 172.21.15.81:0/4975442 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd4bc009a30 con 0x7fd4cc103660 2024-09-12T01:26:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.666+0000 7fd4c8ff9640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fd4b80a2b80 0x7fd4b80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.667+0000 7fd4cb7fe640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fd4b80a2b80 0x7fd4b80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.667+0000 7fd4c8ff9640 1 -- 172.21.15.81:0/4975442 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fd4bc0ce4b0 con 0x7fd4cc103660 2024-09-12T01:26:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.667+0000 7fd4cb7fe640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fd4b80a2b80 0x7fd4b80a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400bbc0 tx=0x7fd4b400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.671+0000 7fd4c8ff9640 1 -- 172.21.15.81:0/4975442 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4bc09b260 con 0x7fd4cc103660 2024-09-12T01:26:02.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.871+0000 7fd4d21d9640 1 -- 172.21.15.81:0/4975442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4cc107240 con 0x7fd4cc103660 2024-09-12T01:26:02.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.871+0000 7fd4c8ff9640 1 -- 172.21.15.81:0/4975442 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9695 (secure 0 0 0) 0x7fd4bc09f560 con 0x7fd4cc103660 2024-09-12T01:26:02.871 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:26:02.871 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"btime":"2024-09-12T01:26:02:513964+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24448,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T01:26:02.872 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-09-12T01:26:02.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.874+0000 7fd4d21d9640 1 -- 172.21.15.81:0/4975442 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fd4b80a2b80 msgr2=0x7fd4b80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:02.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.874+0000 7fd4d21d9640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fd4b80a2b80 0x7fd4b80a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400bbc0 tx=0x7fd4b400b390 comp rx=0 tx=0).stop 2024-09-12T01:26:02.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.874+0000 7fd4d21d9640 1 -- 172.21.15.81:0/4975442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4cc103660 msgr2=0x7fd4cc1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:02.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.874+0000 7fd4d21d9640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4cc103660 0x7fd4cc1989a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00d750 tx=0x7fd4bc00dc10 comp rx=0 tx=0).stop 2024-09-12T01:26:02.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.874+0000 7fd4d21d9640 1 -- 172.21.15.81:0/4975442 shutdown_connections 2024-09-12T01:26:02.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.874+0000 7fd4d21d9640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fd4b80a2b80 0x7fd4b80a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:02.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.874+0000 7fd4d21d9640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4cc10c170 0x7fd4cc19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:02.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.874+0000 7fd4d21d9640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4cc103660 0x7fd4cc1989a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:02.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.874+0000 7fd4d21d9640 1 --2- 172.21.15.81:0/4975442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4cc102d40 0x7fd4cc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:02.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.874+0000 7fd4d21d9640 1 -- 172.21.15.81:0/4975442 >> 172.21.15.81:0/4975442 conn(0x7fd4cc0fc7a0 msgr2=0x7fd4cc0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:02.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.874+0000 7fd4d21d9640 1 -- 172.21.15.81:0/4975442 shutdown_connections 2024-09-12T01:26:02.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:02.874+0000 7fd4d21d9640 1 -- 172.21.15.81:0/4975442 wait complete. 2024-09-12T01:26:03.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:03.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:03.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:03.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:26:03.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:26:03.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:26:03.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:03 smithi081 ceph-mon[30920]: Deploying daemon mds.b on smithi100 2024-09-12T01:26:03.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:03 smithi081 ceph-mon[30920]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:03.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:03 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.81:6840/3373717964,v1:172.21.15.81:6841/3373717964] up:boot 2024-09-12T01:26:03.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:03 smithi081 ceph-mon[30920]: fsmap 11 up:standby 2024-09-12T01:26:03.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:03 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:26:03.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:03 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/4975442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:26:03.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:03 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:03.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:03 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:03.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:03 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:03.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:03 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:26:03.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:03 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:26:03.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:03 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:26:03.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:03 smithi100 ceph-mon[35275]: Deploying daemon mds.b on smithi100 2024-09-12T01:26:03.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:03 smithi100 ceph-mon[35275]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:03.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:03 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.81:6840/3373717964,v1:172.21.15.81:6841/3373717964] up:boot 2024-09-12T01:26:03.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:03 smithi100 ceph-mon[35275]: fsmap 11 up:standby 2024-09-12T01:26:03.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:03 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:26:03.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:03 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/4975442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:26:03.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:03.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:03.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:03.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:26:03.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:26:03.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:26:03.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:03 smithi189 ceph-mon[35357]: Deploying daemon mds.b on smithi100 2024-09-12T01:26:03.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:03 smithi189 ceph-mon[35357]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:03.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:03 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.81:6840/3373717964,v1:172.21.15.81:6841/3373717964] up:boot 2024-09-12T01:26:03.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:03 smithi189 ceph-mon[35357]: fsmap 11 up:standby 2024-09-12T01:26:03.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:03 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:26:03.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:03 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/4975442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:26:04.210 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:04 smithi100 systemd[1]: Starting Ceph mds.b for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:26:04.518 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:04 smithi100 podman[65592]: 2024-09-12 01:26:04.114201702 +0000 UTC m=+0.015887483 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:26:04.519 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:04 smithi100 podman[65592]: 2024-09-12 01:26:04.263953304 +0000 UTC m=+0.165639073 container create bb4c616ba02606c3b06fbe03c2a0e2f3bd93a21e8e11362a8741628422b5348d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T01:26:05.018 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:04 smithi100 podman[65592]: 2024-09-12 01:26:04.52495812 +0000 UTC m=+0.426643892 container init bb4c616ba02606c3b06fbe03c2a0e2f3bd93a21e8e11362a8741628422b5348d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:26:05.019 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:04 smithi100 podman[65592]: 2024-09-12 01:26:04.527803614 +0000 UTC m=+0.429489384 container start bb4c616ba02606c3b06fbe03c2a0e2f3bd93a21e8e11362a8741628422b5348d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:26:05.019 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:04 smithi100 ceph-mds[65611]: -- 172.21.15.100:0/2462369154 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56382ece3860 con 0x56382ecc1000 2024-09-12T01:26:05.019 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:04 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b[65607]: starting mds.b at 2024-09-12T01:26:05.019 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:04 smithi100 bash[65592]: bb4c616ba02606c3b06fbe03c2a0e2f3bd93a21e8e11362a8741628422b5348d 2024-09-12T01:26:05.019 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:04 smithi100 systemd[1]: Started Ceph mds.b for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:26:05.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:26:05.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:05 smithi081 ceph-mon[30920]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:05.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:05 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:26:05.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:05 smithi100 ceph-mon[35275]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:05.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:05 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:26:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:05 smithi189 ceph-mon[35357]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:05 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:26:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:06.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.347+0000 7fce89534640 1 -- 172.21.15.81:0/1736248308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce84102d30 msgr2=0x7fce84103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:06.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.347+0000 7fce89534640 1 --2- 172.21.15.81:0/1736248308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce84102d30 0x7fce84103110 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fce74009cd0 tx=0x7fce7402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:26:06.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.347+0000 7fce89534640 1 -- 172.21.15.81:0/1736248308 shutdown_connections 2024-09-12T01:26:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.347+0000 7fce89534640 1 --2- 172.21.15.81:0/1736248308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce841082a0 0x7fce8410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.347+0000 7fce89534640 1 --2- 172.21.15.81:0/1736248308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce841036e0 0x7fce84107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.347+0000 7fce89534640 1 --2- 172.21.15.81:0/1736248308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce84102d30 0x7fce84103110 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.347+0000 7fce89534640 1 -- 172.21.15.81:0/1736248308 >> 172.21.15.81:0/1736248308 conn(0x7fce840fc7d0 msgr2=0x7fce840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.347+0000 7fce89534640 1 -- 172.21.15.81:0/1736248308 shutdown_connections 2024-09-12T01:26:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.347+0000 7fce89534640 1 -- 172.21.15.81:0/1736248308 wait complete. 2024-09-12T01:26:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.348+0000 7fce89534640 1 Processor -- start 2024-09-12T01:26:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.348+0000 7fce89534640 1 -- start start 2024-09-12T01:26:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.348+0000 7fce89534640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce84102d30 0x7fce84100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.348+0000 7fce89534640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce841036e0 0x7fce84100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce89534640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce841082a0 0x7fce84101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:06.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce89534640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fce841120a0 con 0x7fce84102d30 2024-09-12T01:26:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce89534640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce84111f20 con 0x7fce841036e0 2024-09-12T01:26:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce89534640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce84112220 con 0x7fce841082a0 2024-09-12T01:26:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce82ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce84102d30 0x7fce84100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce82ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce84102d30 0x7fce84100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58492/0 (socket says 172.21.15.81:58492) 2024-09-12T01:26:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce82ffd640 1 -- 172.21.15.81:0/4053770599 learned_addr learned my addr 172.21.15.81:0/4053770599 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce827fc640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce841036e0 0x7fce84100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce837fe640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce841082a0 0x7fce84101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce82ffd640 1 -- 172.21.15.81:0/4053770599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce841082a0 msgr2=0x7fce84101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce82ffd640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce841082a0 0x7fce84101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce82ffd640 1 -- 172.21.15.81:0/4053770599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce841036e0 msgr2=0x7fce84100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce82ffd640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce841036e0 0x7fce84100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:06.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce82ffd640 1 -- 172.21.15.81:0/4053770599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce841a6a80 con 0x7fce84102d30 2024-09-12T01:26:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce82ffd640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce84102d30 0x7fce84100990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fce7402ae00 tx=0x7fce74003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce6bfff640 1 -- 172.21.15.81:0/4053770599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74004040 con 0x7fce84102d30 2024-09-12T01:26:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce89534640 1 -- 172.21.15.81:0/4053770599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce841a6d10 con 0x7fce84102d30 2024-09-12T01:26:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce6bfff640 1 -- 172.21.15.81:0/4053770599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce740046c0 con 0x7fce84102d30 2024-09-12T01:26:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce6bfff640 1 -- 172.21.15.81:0/4053770599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74046480 con 0x7fce84102d30 2024-09-12T01:26:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.349+0000 7fce89534640 1 -- 172.21.15.81:0/4053770599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce841a71f0 con 0x7fce84102d30 2024-09-12T01:26:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.350+0000 7fce89534640 1 -- 172.21.15.81:0/4053770599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce84103110 con 0x7fce84102d30 2024-09-12T01:26:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.351+0000 7fce6bfff640 1 -- 172.21.15.81:0/4053770599 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fce740305a0 con 0x7fce84102d30 2024-09-12T01:26:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.352+0000 7fce6bfff640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fce6c0a2b80 0x7fce6c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.352+0000 7fce827fc640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fce6c0a2b80 0x7fce6c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.352+0000 7fce6bfff640 1 -- 172.21.15.81:0/4053770599 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fce7402e030 con 0x7fce84102d30 2024-09-12T01:26:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.353+0000 7fce827fc640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fce6c0a2b80 0x7fce6c0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fce84102420 tx=0x7fce7800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:06.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.355+0000 7fce6bfff640 1 -- 172.21.15.81:0/4053770599 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce7404b060 con 0x7fce84102d30 2024-09-12T01:26:06.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.606+0000 7fce89534640 1 -- 172.21.15.81:0/4053770599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce8410a2b0 con 0x7fce84102d30 2024-09-12T01:26:06.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:06 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] up:boot 2024-09-12T01:26:06.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:06 smithi081 ceph-mon[30920]: fsmap 12 up:standby 2024-09-12T01:26:06.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:06 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:26:06.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:06 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:06.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:06 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:06.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:06 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:06.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:06 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:06.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.607+0000 7fce6bfff640 1 -- 172.21.15.81:0/4053770599 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10524 (secure 0 0 0) 0x7fce74030890 con 0x7fce84102d30 2024-09-12T01:26:06.607 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:26:06.607 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":13,"btime":"2024-09-12T01:26:05:476353+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24448,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-12T01:26:06.607 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 13 2024-09-12T01:26:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.610+0000 7fce89534640 1 -- 172.21.15.81:0/4053770599 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fce6c0a2b80 msgr2=0x7fce6c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.610+0000 7fce89534640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fce6c0a2b80 0x7fce6c0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fce84102420 tx=0x7fce7800b390 comp rx=0 tx=0).stop 2024-09-12T01:26:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.610+0000 7fce89534640 1 -- 172.21.15.81:0/4053770599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce84102d30 msgr2=0x7fce84100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.610+0000 7fce89534640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce84102d30 0x7fce84100990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fce7402ae00 tx=0x7fce74003970 comp rx=0 tx=0).stop 2024-09-12T01:26:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.610+0000 7fce89534640 1 -- 172.21.15.81:0/4053770599 shutdown_connections 2024-09-12T01:26:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.610+0000 7fce89534640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fce6c0a2b80 0x7fce6c0a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.610+0000 7fce89534640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce841082a0 0x7fce84101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.610+0000 7fce89534640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce841036e0 0x7fce84100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.610+0000 7fce89534640 1 --2- 172.21.15.81:0/4053770599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce84102d30 0x7fce84100990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.610+0000 7fce89534640 1 -- 172.21.15.81:0/4053770599 >> 172.21.15.81:0/4053770599 conn(0x7fce840fc7d0 msgr2=0x7fce84105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.610+0000 7fce89534640 1 -- 172.21.15.81:0/4053770599 shutdown_connections 2024-09-12T01:26:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:06.610+0000 7fce89534640 1 -- 172.21.15.81:0/4053770599 wait complete. 2024-09-12T01:26:06.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:06 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] up:boot 2024-09-12T01:26:06.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:06 smithi100 ceph-mon[35275]: fsmap 12 up:standby 2024-09-12T01:26:06.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:06 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:26:06.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:06 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:06.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:06 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:06.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:06 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:06.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:06 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:06 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] up:boot 2024-09-12T01:26:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:06 smithi189 ceph-mon[35357]: fsmap 12 up:standby 2024-09-12T01:26:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:06 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:26:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:06 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:06 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:06 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:06.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:06 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:07.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T01:26:07.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:07 smithi081 ceph-mon[30920]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:07.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:07 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/4053770599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:26:07.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:07 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:07.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:07 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:07.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:07 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:26:07.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:07 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:26:07.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:07 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:07.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:07 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:26:07.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:07 smithi100 ceph-mon[35275]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:07.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:07 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/4053770599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:26:07.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:07 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:07.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:07 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:07.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:07 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:26:07.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:07 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:26:07.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:07 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:07.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:07 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:26:07.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:07 smithi189 ceph-mon[35357]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:07.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:07 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/4053770599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:26:07.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:07 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:07.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:07 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:07.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:07 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:26:07.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:07 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:26:07.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:07 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:07.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:07 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:26:08.216 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.749+0000 7f6e93f3c640 1 -- 172.21.15.81:0/443753614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e8c102790 msgr2=0x7f6e8c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.749+0000 7f6e93f3c640 1 --2- 172.21.15.81:0/443753614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e8c102790 0x7f6e8c1067e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009900 tx=0x7f6e8002a410 comp rx=0 tx=0).stop 2024-09-12T01:26:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.749+0000 7f6e93f3c640 1 -- 172.21.15.81:0/443753614 shutdown_connections 2024-09-12T01:26:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.749+0000 7f6e93f3c640 1 --2- 172.21.15.81:0/443753614 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e8c106f10 0x7f6e8c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.749+0000 7f6e93f3c640 1 --2- 172.21.15.81:0/443753614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e8c102790 0x7f6e8c1067e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.749+0000 7f6e93f3c640 1 --2- 172.21.15.81:0/443753614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e8c101de0 0x7f6e8c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.749+0000 7f6e93f3c640 1 -- 172.21.15.81:0/443753614 >> 172.21.15.81:0/443753614 conn(0x7f6e8c0fd8c0 msgr2=0x7f6e8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.749+0000 7f6e93f3c640 1 -- 172.21.15.81:0/443753614 shutdown_connections 2024-09-12T01:26:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.749+0000 7f6e93f3c640 1 -- 172.21.15.81:0/443753614 wait complete. 2024-09-12T01:26:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e93f3c640 1 Processor -- start 2024-09-12T01:26:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e93f3c640 1 -- start start 2024-09-12T01:26:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e93f3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e8c101de0 0x7f6e8c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e93f3c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e8c102790 0x7f6e8c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e93f3c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e8c106f10 0x7f6e8c19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e93f3c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c111f90 con 0x7f6e8c106f10 2024-09-12T01:26:08.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e93f3c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c111e10 con 0x7f6e8c101de0 2024-09-12T01:26:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e93f3c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c112110 con 0x7f6e8c102790 2024-09-12T01:26:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e924d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e8c106f10 0x7f6e8c19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e91cd8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e8c101de0 0x7f6e8c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e91cd8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e8c101de0 0x7f6e8c198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:36774/0 (socket says 172.21.15.81:36774) 2024-09-12T01:26:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e924d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e8c106f10 0x7f6e8c19ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58502/0 (socket says 172.21.15.81:58502) 2024-09-12T01:26:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e91cd8640 1 -- 172.21.15.81:0/1559234378 learned_addr learned my addr 172.21.15.81:0/1559234378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e914d7640 1 --2- 172.21.15.81:0/1559234378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e8c102790 0x7f6e8c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e924d9640 1 -- 172.21.15.81:0/1559234378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e8c102790 msgr2=0x7f6e8c198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e924d9640 1 --2- 172.21.15.81:0/1559234378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e8c102790 0x7f6e8c198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e924d9640 1 -- 172.21.15.81:0/1559234378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e8c101de0 msgr2=0x7f6e8c198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e924d9640 1 --2- 172.21.15.81:0/1559234378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e8c101de0 0x7f6e8c198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:08.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e924d9640 1 -- 172.21.15.81:0/1559234378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8c19d520 con 0x7f6e8c106f10 2024-09-12T01:26:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e924d9640 1 --2- 172.21.15.81:0/1559234378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e8c106f10 0x7f6e8c19ce40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00be20 tx=0x7f6e7c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.750+0000 7f6e8affd640 1 -- 172.21.15.81:0/1559234378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c019070 con 0x7f6e8c106f10 2024-09-12T01:26:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.751+0000 7f6e93f3c640 1 -- 172.21.15.81:0/1559234378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8c19d810 con 0x7f6e8c106f10 2024-09-12T01:26:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.751+0000 7f6e8affd640 1 -- 172.21.15.81:0/1559234378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e7c014920 con 0x7f6e8c106f10 2024-09-12T01:26:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.751+0000 7f6e8affd640 1 -- 172.21.15.81:0/1559234378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c012920 con 0x7f6e8c106f10 2024-09-12T01:26:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.751+0000 7f6e93f3c640 1 -- 172.21.15.81:0/1559234378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e8c1a50f0 con 0x7f6e8c106f10 2024-09-12T01:26:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.752+0000 7f6e93f3c640 1 -- 172.21.15.81:0/1559234378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e8c1021c0 con 0x7f6e8c106f10 2024-09-12T01:26:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.753+0000 7f6e8affd640 1 -- 172.21.15.81:0/1559234378 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6e7c01c070 con 0x7f6e8c106f10 2024-09-12T01:26:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.753+0000 7f6e8affd640 1 --2- 172.21.15.81:0/1559234378 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6e740a2b80 0x7f6e740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.753+0000 7f6e91cd8640 1 --2- 172.21.15.81:0/1559234378 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6e740a2b80 0x7f6e740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.753+0000 7f6e8affd640 1 -- 172.21.15.81:0/1559234378 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f6e7c0ce400 con 0x7f6e8c106f10 2024-09-12T01:26:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.754+0000 7f6e91cd8640 1 --2- 172.21.15.81:0/1559234378 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6e740a2b80 0x7f6e740a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6e840058c0 tx=0x7f6e8400a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.757+0000 7f6e8affd640 1 -- 172.21.15.81:0/1559234378 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e7c09b1b0 con 0x7f6e8c106f10 2024-09-12T01:26:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.971+0000 7f6e93f3c640 1 -- 172.21.15.81:0/1559234378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6e8c10a150 con 0x7f6e8c106f10 2024-09-12T01:26:08.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.971+0000 7f6e8affd640 1 -- 172.21.15.81:0/1559234378 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f6e7c09f4b0 con 0x7f6e8c106f10 2024-09-12T01:26:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:26:08.971 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-12T01:26:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:26:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-12T01:26:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-12T01:26:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:26:08.971 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-12T01:26:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.974+0000 7f6e93f3c640 1 -- 172.21.15.81:0/1559234378 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6e740a2b80 msgr2=0x7f6e740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.974+0000 7f6e93f3c640 1 --2- 172.21.15.81:0/1559234378 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6e740a2b80 0x7f6e740a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6e840058c0 tx=0x7f6e8400a380 comp rx=0 tx=0).stop 2024-09-12T01:26:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.974+0000 7f6e93f3c640 1 -- 172.21.15.81:0/1559234378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e8c106f10 msgr2=0x7f6e8c19ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.974+0000 7f6e93f3c640 1 --2- 172.21.15.81:0/1559234378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e8c106f10 0x7f6e8c19ce40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00be20 tx=0x7f6e7c00bf10 comp rx=0 tx=0).stop 2024-09-12T01:26:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.974+0000 7f6e93f3c640 1 -- 172.21.15.81:0/1559234378 shutdown_connections 2024-09-12T01:26:08.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.974+0000 7f6e93f3c640 1 --2- 172.21.15.81:0/1559234378 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6e740a2b80 0x7f6e740a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.974+0000 7f6e93f3c640 1 --2- 172.21.15.81:0/1559234378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e8c106f10 0x7f6e8c19ce40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.974+0000 7f6e93f3c640 1 --2- 172.21.15.81:0/1559234378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e8c102790 0x7f6e8c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.974+0000 7f6e93f3c640 1 --2- 172.21.15.81:0/1559234378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e8c101de0 0x7f6e8c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.974+0000 7f6e93f3c640 1 -- 172.21.15.81:0/1559234378 >> 172.21.15.81:0/1559234378 conn(0x7f6e8c0fd8c0 msgr2=0x7f6e8c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.974+0000 7f6e93f3c640 1 -- 172.21.15.81:0/1559234378 shutdown_connections 2024-09-12T01:26:08.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:08.974+0000 7f6e93f3c640 1 -- 172.21.15.81:0/1559234378 wait complete. 2024-09-12T01:26:09.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:09.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:09.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:09.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:09 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:09.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:09 smithi081 ceph-mon[30920]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:09.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:09 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1559234378' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T01:26:09.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:09.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:09.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:09 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:09 smithi100 ceph-mon[35275]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:09.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:09 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1559234378' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T01:26:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:09 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:09 smithi189 ceph-mon[35357]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:09 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1559234378' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T01:26:09.635 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:26:09.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:26:09.892 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.344+0000 7f6fbca70640 1 -- 172.21.15.81:0/1016941282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb8101420 msgr2=0x7f6fb810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.344+0000 7f6fbca70640 1 --2- 172.21.15.81:0/1016941282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb8101420 0x7f6fb810d950 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009cd0 tx=0x7f6fb002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:26:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.344+0000 7f6fbca70640 1 -- 172.21.15.81:0/1016941282 shutdown_connections 2024-09-12T01:26:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.344+0000 7f6fbca70640 1 --2- 172.21.15.81:0/1016941282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb8101420 0x7f6fb810d950 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.344+0000 7f6fbca70640 1 --2- 172.21.15.81:0/1016941282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8100a80 0x7f6fb8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.344+0000 7f6fbca70640 1 --2- 172.21.15.81:0/1016941282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8106a80 0x7f6fb8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.344+0000 7f6fbca70640 1 -- 172.21.15.81:0/1016941282 >> 172.21.15.81:0/1016941282 conn(0x7f6fb80fc7a0 msgr2=0x7f6fb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.344+0000 7f6fbca70640 1 -- 172.21.15.81:0/1016941282 shutdown_connections 2024-09-12T01:26:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.344+0000 7f6fbca70640 1 -- 172.21.15.81:0/1016941282 wait complete. 2024-09-12T01:26:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.344+0000 7f6fbca70640 1 Processor -- start 2024-09-12T01:26:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fbca70640 1 -- start start 2024-09-12T01:26:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fbca70640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8100a80 0x7f6fb8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fbca70640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8101420 0x7f6fb81988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fbca70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb8106a80 0x7f6fb819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fbca70640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8110e80 con 0x7f6fb8106a80 2024-09-12T01:26:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fbca70640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8110d00 con 0x7f6fb8101420 2024-09-12T01:26:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fbca70640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8111000 con 0x7f6fb8100a80 2024-09-12T01:26:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fb6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb8106a80 0x7f6fb819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fb6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb8106a80 0x7f6fb819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58512/0 (socket says 172.21.15.81:58512) 2024-09-12T01:26:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fb6d9d640 1 -- 172.21.15.81:0/483025564 learned_addr learned my addr 172.21.15.81:0/483025564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fb5d9b640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8101420 0x7f6fb81988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fb659c640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8100a80 0x7f6fb8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fb6d9d640 1 -- 172.21.15.81:0/483025564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8100a80 msgr2=0x7f6fb8198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fb6d9d640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8100a80 0x7f6fb8198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fb6d9d640 1 -- 172.21.15.81:0/483025564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8101420 msgr2=0x7f6fb81988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fb6d9d640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8101420 0x7f6fb81988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fb6d9d640 1 -- 172.21.15.81:0/483025564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb819d330 con 0x7f6fb8106a80 2024-09-12T01:26:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fb659c640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8100a80 0x7f6fb8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.345+0000 7f6fb6d9d640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb8106a80 0x7f6fb819cc50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0006010 tx=0x7f6fb0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.346+0000 7f6faf7fe640 1 -- 172.21.15.81:0/483025564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0004450 con 0x7f6fb8106a80 2024-09-12T01:26:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.346+0000 7f6faf7fe640 1 -- 172.21.15.81:0/483025564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fb0003e10 con 0x7f6fb8106a80 2024-09-12T01:26:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.346+0000 7f6fbca70640 1 -- 172.21.15.81:0/483025564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb819d5c0 con 0x7f6fb8106a80 2024-09-12T01:26:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.346+0000 7f6faf7fe640 1 -- 172.21.15.81:0/483025564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00466e0 con 0x7f6fb8106a80 2024-09-12T01:26:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.346+0000 7f6fbca70640 1 -- 172.21.15.81:0/483025564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb81a4f00 con 0x7f6fb8106a80 2024-09-12T01:26:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.347+0000 7f6fbca70640 1 -- 172.21.15.81:0/483025564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb8100ee0 con 0x7f6fb8106a80 2024-09-12T01:26:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.348+0000 7f6faf7fe640 1 -- 172.21.15.81:0/483025564 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6fb00305a0 con 0x7f6fb8106a80 2024-09-12T01:26:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.349+0000 7f6faf7fe640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6fa40a2b80 0x7f6fa40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.349+0000 7f6fb659c640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6fa40a2b80 0x7f6fa40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.349+0000 7f6faf7fe640 1 -- 172.21.15.81:0/483025564 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f6fb002e030 con 0x7f6fb8106a80 2024-09-12T01:26:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.349+0000 7f6fb659c640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6fa40a2b80 0x7f6fa40a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0005e10 tx=0x7f6fa0005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.352+0000 7f6faf7fe640 1 -- 172.21.15.81:0/483025564 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6fb004b060 con 0x7f6fb8106a80 2024-09-12T01:26:10.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:10.522+0000 7f6fbca70640 1 -- 172.21.15.81:0/483025564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6fb81a5130 con 0x7f6fb8106a80 2024-09-12T01:26:10.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:10.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:10.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:10.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:26:10.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:26:10.522 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:10.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:10.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:10.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:10.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:26:10.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:26:10.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:10.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:10.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:10.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:10.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:26:10.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:26:10.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:26:11.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:11.404+0000 7f6faf7fe640 1 -- 172.21.15.81:0/483025564 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7f6fb00bdab0 con 0x7f6fb8106a80 2024-09-12T01:26:11.404 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-12T01:26:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:11.408+0000 7f6fbca70640 1 -- 172.21.15.81:0/483025564 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6fa40a2b80 msgr2=0x7f6fa40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:11.408+0000 7f6fbca70640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6fa40a2b80 0x7f6fa40a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0005e10 tx=0x7f6fa0005da0 comp rx=0 tx=0).stop 2024-09-12T01:26:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:11.408+0000 7f6fbca70640 1 -- 172.21.15.81:0/483025564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb8106a80 msgr2=0x7f6fb819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:11.408+0000 7f6fbca70640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb8106a80 0x7f6fb819cc50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0006010 tx=0x7f6fb0003c20 comp rx=0 tx=0).stop 2024-09-12T01:26:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:11.408+0000 7f6fbca70640 1 -- 172.21.15.81:0/483025564 shutdown_connections 2024-09-12T01:26:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:11.408+0000 7f6fbca70640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f6fa40a2b80 0x7f6fa40a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:11.408+0000 7f6fbca70640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fb8106a80 0x7f6fb819cc50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:11.408+0000 7f6fbca70640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fb8101420 0x7f6fb81988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:11.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:11.408+0000 7f6fbca70640 1 --2- 172.21.15.81:0/483025564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8100a80 0x7f6fb8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:11.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:11.408+0000 7f6fbca70640 1 -- 172.21.15.81:0/483025564 >> 172.21.15.81:0/483025564 conn(0x7f6fb80fc7a0 msgr2=0x7f6fb8104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:11.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:11.408+0000 7f6fbca70640 1 -- 172.21.15.81:0/483025564 shutdown_connections 2024-09-12T01:26:11.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:11.408+0000 7f6fbca70640 1 -- 172.21.15.81:0/483025564 wait complete. 2024-09-12T01:26:11.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:11 smithi081 ceph-mon[30920]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:11.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:11 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/483025564' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:26:11.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:11 smithi100 ceph-mon[35275]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:11.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:11 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/483025564' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:26:11.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:11 smithi189 ceph-mon[35357]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:11.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:11 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/483025564' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:26:12.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:26:12.374 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:12.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:12 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/483025564' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T01:26:12.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:12 smithi081 ceph-mon[30920]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T01:26:12.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:12 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/483025564' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T01:26:12.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:12 smithi100 ceph-mon[35275]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T01:26:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:12 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/483025564' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T01:26:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:12 smithi189 ceph-mon[35357]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T01:26:12.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.831+0000 7f1916d03640 1 -- 172.21.15.81:0/1637371071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910106fc0 msgr2=0x7f191010eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:12.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.831+0000 7f1916d03640 1 --2- 172.21.15.81:0/1637371071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910106fc0 0x7f191010eaf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1908009cd0 tx=0x7f190802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:26:12.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.831+0000 7f1916d03640 1 -- 172.21.15.81:0/1637371071 shutdown_connections 2024-09-12T01:26:12.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.831+0000 7f1916d03640 1 --2- 172.21.15.81:0/1637371071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910106fc0 0x7f191010eaf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:12.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.831+0000 7f1916d03640 1 --2- 172.21.15.81:0/1637371071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1910100d20 0x7f1910106860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:12.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.831+0000 7f1916d03640 1 --2- 172.21.15.81:0/1637371071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1910100370 0x7f1910100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:12.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.831+0000 7f1916d03640 1 -- 172.21.15.81:0/1637371071 >> 172.21.15.81:0/1637371071 conn(0x7f1910077210 msgr2=0x7f19100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:12.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.831+0000 7f1916d03640 1 -- 172.21.15.81:0/1637371071 shutdown_connections 2024-09-12T01:26:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.831+0000 7f1916d03640 1 -- 172.21.15.81:0/1637371071 wait complete. 2024-09-12T01:26:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f1916d03640 1 Processor -- start 2024-09-12T01:26:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f1916d03640 1 -- start start 2024-09-12T01:26:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f1916d03640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1910100370 0x7f1910198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f1916d03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910100d20 0x7f1910198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f1916d03640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1910106fc0 0x7f191019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f1916d03640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1910111fa0 con 0x7f1910100d20 2024-09-12T01:26:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f1916d03640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1910111e20 con 0x7f1910106fc0 2024-09-12T01:26:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f1916d03640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1910112120 con 0x7f1910100370 2024-09-12T01:26:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f190ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910100d20 0x7f1910198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f190ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910100d20 0x7f1910198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53636/0 (socket says 172.21.15.81:53636) 2024-09-12T01:26:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f190ffff640 1 -- 172.21.15.81:0/2906897051 learned_addr learned my addr 172.21.15.81:0/2906897051 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f1914a9f640 1 --2- 172.21.15.81:0/2906897051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1910100370 0x7f1910198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f190ffff640 1 -- 172.21.15.81:0/2906897051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1910100370 msgr2=0x7f1910198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f190ffff640 1 --2- 172.21.15.81:0/2906897051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1910100370 0x7f1910198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f190ffff640 1 -- 172.21.15.81:0/2906897051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1910106fc0 msgr2=0x7f191019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f190ffff640 1 --2- 172.21.15.81:0/2906897051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1910106fc0 0x7f191019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f190ffff640 1 -- 172.21.15.81:0/2906897051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191019d3b0 con 0x7f1910100d20 2024-09-12T01:26:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.832+0000 7f190ffff640 1 --2- 172.21.15.81:0/2906897051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910100d20 0x7f1910198940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00c970 tx=0x7f18fc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.833+0000 7f190dffb640 1 -- 172.21.15.81:0/2906897051 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc007bb0 con 0x7f1910100d20 2024-09-12T01:26:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.833+0000 7f190dffb640 1 -- 172.21.15.81:0/2906897051 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18fc007d50 con 0x7f1910100d20 2024-09-12T01:26:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.833+0000 7f1916d03640 1 -- 172.21.15.81:0/2906897051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191019d6a0 con 0x7f1910100d20 2024-09-12T01:26:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.833+0000 7f190dffb640 1 -- 172.21.15.81:0/2906897051 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc00f450 con 0x7f1910100d20 2024-09-12T01:26:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.833+0000 7f1916d03640 1 -- 172.21.15.81:0/2906897051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19101a4f80 con 0x7f1910100d20 2024-09-12T01:26:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.834+0000 7f1916d03640 1 -- 172.21.15.81:0/2906897051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1910100750 con 0x7f1910100d20 2024-09-12T01:26:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.835+0000 7f190dffb640 1 -- 172.21.15.81:0/2906897051 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f18fc0046c0 con 0x7f1910100d20 2024-09-12T01:26:12.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.836+0000 7f190dffb640 1 --2- 172.21.15.81:0/2906897051 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f19000a2b80 0x7f19000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:12.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.836+0000 7f1914a9f640 1 --2- 172.21.15.81:0/2906897051 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f19000a2b80 0x7f19000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:12.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.836+0000 7f190dffb640 1 -- 172.21.15.81:0/2906897051 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7f18fc0cedf0 con 0x7f1910100d20 2024-09-12T01:26:12.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.836+0000 7f1914a9f640 1 --2- 172.21.15.81:0/2906897051 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f19000a2b80 0x7f19000a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f19040058c0 tx=0x7f190400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:12.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:12.839+0000 7f190dffb640 1 -- 172.21.15.81:0/2906897051 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18fc014030 con 0x7f1910100d20 2024-09-12T01:26:13.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.008+0000 7f1916d03640 1 -- 172.21.15.81:0/2906897051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f191002d7c0 con 0x7f1910100d20 2024-09-12T01:26:13.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.409+0000 7f190dffb640 1 -- 172.21.15.81:0/2906897051 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7f18fc09c080 con 0x7f1910100d20 2024-09-12T01:26:13.409 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-12T01:26:13.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.411+0000 7f1916d03640 1 -- 172.21.15.81:0/2906897051 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f19000a2b80 msgr2=0x7f19000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:13.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.411+0000 7f1916d03640 1 --2- 172.21.15.81:0/2906897051 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f19000a2b80 0x7f19000a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f19040058c0 tx=0x7f190400a4c0 comp rx=0 tx=0).stop 2024-09-12T01:26:13.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.411+0000 7f1916d03640 1 -- 172.21.15.81:0/2906897051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910100d20 msgr2=0x7f1910198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:13.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.411+0000 7f1916d03640 1 --2- 172.21.15.81:0/2906897051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910100d20 0x7f1910198940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00c970 tx=0x7f18fc00ce30 comp rx=0 tx=0).stop 2024-09-12T01:26:13.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.411+0000 7f1916d03640 1 -- 172.21.15.81:0/2906897051 shutdown_connections 2024-09-12T01:26:13.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.411+0000 7f1916d03640 1 --2- 172.21.15.81:0/2906897051 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f19000a2b80 0x7f19000a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:13.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.411+0000 7f1916d03640 1 --2- 172.21.15.81:0/2906897051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1910106fc0 0x7f191019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:13.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.411+0000 7f1916d03640 1 --2- 172.21.15.81:0/2906897051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1910100d20 0x7f1910198940 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:13.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.411+0000 7f1916d03640 1 --2- 172.21.15.81:0/2906897051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1910100370 0x7f1910198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:13.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.411+0000 7f1916d03640 1 -- 172.21.15.81:0/2906897051 >> 172.21.15.81:0/2906897051 conn(0x7f1910077210 msgr2=0x7f1910105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:13.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.411+0000 7f1916d03640 1 -- 172.21.15.81:0/2906897051 shutdown_connections 2024-09-12T01:26:13.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:13.412+0000 7f1916d03640 1 -- 172.21.15.81:0/2906897051 wait complete. 2024-09-12T01:26:13.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:13 smithi081 ceph-mon[30920]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T01:26:13.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:13 smithi081 ceph-mon[30920]: pgmap v271: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:13.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:13 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2906897051' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:26:13.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:13 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2906897051' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T01:26:13.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:13 smithi100 ceph-mon[35275]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T01:26:13.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:13 smithi100 ceph-mon[35275]: pgmap v271: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:13.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:13 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2906897051' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:26:13.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:13 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2906897051' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T01:26:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:13 smithi189 ceph-mon[35357]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T01:26:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:13 smithi189 ceph-mon[35357]: pgmap v271: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:13 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2906897051' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:26:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:13 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2906897051' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T01:26:14.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:26:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:14.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:14 smithi081 ceph-mon[30920]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T01:26:14.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:14 smithi081 ceph-mon[30920]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:26:14.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:14 smithi081 ceph-mon[30920]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T01:26:14.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:14 smithi100 ceph-mon[35275]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T01:26:14.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:14 smithi100 ceph-mon[35275]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:26:14.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:14 smithi100 ceph-mon[35275]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T01:26:14.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:14 smithi189 ceph-mon[35357]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T01:26:14.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:14 smithi189 ceph-mon[35357]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:26:14.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:14 smithi189 ceph-mon[35357]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T01:26:14.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.794+0000 7f10c8a14640 1 -- 172.21.15.81:0/1161760237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c4102570 msgr2=0x7f10c41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:14.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.794+0000 7f10c8a14640 1 --2- 172.21.15.81:0/1161760237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c4102570 0x7f10c41029b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f10b8009900 tx=0x7f10b802a480 comp rx=0 tx=0).stop 2024-09-12T01:26:14.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.794+0000 7f10c8a14640 1 -- 172.21.15.81:0/1161760237 shutdown_connections 2024-09-12T01:26:14.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.794+0000 7f10c8a14640 1 --2- 172.21.15.81:0/1161760237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10c4102ef0 0x7f10c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:14.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.794+0000 7f10c8a14640 1 --2- 172.21.15.81:0/1161760237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c4102570 0x7f10c41029b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.794+0000 7f10c8a14640 1 --2- 172.21.15.81:0/1161760237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10c4100e20 0x7f10c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.794+0000 7f10c8a14640 1 -- 172.21.15.81:0/1161760237 >> 172.21.15.81:0/1161760237 conn(0x7f10c40fc7d0 msgr2=0x7f10c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.794+0000 7f10c8a14640 1 -- 172.21.15.81:0/1161760237 shutdown_connections 2024-09-12T01:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.794+0000 7f10c8a14640 1 -- 172.21.15.81:0/1161760237 wait complete. 2024-09-12T01:26:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c8a14640 1 Processor -- start 2024-09-12T01:26:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c8a14640 1 -- start start 2024-09-12T01:26:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c8a14640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c4100e20 0x7f10c4198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c8a14640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10c4102570 0x7f10c4198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c8a14640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10c4102ef0 0x7f10c419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c8a14640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41120a0 con 0x7f10c4100e20 2024-09-12T01:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c8a14640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f10c4111f20 con 0x7f10c4102570 2024-09-12T01:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c8a14640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10c4112220 con 0x7f10c4102ef0 2024-09-12T01:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c4100e20 0x7f10c4198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c4100e20 0x7f10c4198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53650/0 (socket says 172.21.15.81:53650) 2024-09-12T01:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c259c640 1 -- 172.21.15.81:0/1447671571 learned_addr learned my addr 172.21.15.81:0/1447671571 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c1d9b640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10c4102570 0x7f10c4198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c259c640 1 -- 172.21.15.81:0/1447671571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10c4102ef0 msgr2=0x7f10c419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c259c640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10c4102ef0 0x7f10c419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c259c640 1 -- 172.21.15.81:0/1447671571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10c4102570 msgr2=0x7f10c4198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:14.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c259c640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10c4102570 0x7f10c4198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:14.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c259c640 1 -- 172.21.15.81:0/1447671571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c419d4b0 con 0x7f10c4100e20 2024-09-12T01:26:14.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c1d9b640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10c4102570 0x7f10c4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:26:14.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10c259c640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c4100e20 0x7f10c4198500 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f10b400b4a0 tx=0x7f10b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:14.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.795+0000 7f10b37fe640 1 -- 172.21.15.81:0/1447671571 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4014070 con 0x7f10c4100e20 2024-09-12T01:26:14.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.796+0000 7f10b37fe640 1 -- 172.21.15.81:0/1447671571 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10b4010af0 con 0x7f10c4100e20 2024-09-12T01:26:14.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.796+0000 7f10b37fe640 1 -- 172.21.15.81:0/1447671571 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4017d10 con 0x7f10c4100e20 2024-09-12T01:26:14.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.796+0000 7f10c8a14640 1 -- 172.21.15.81:0/1447671571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c419d7a0 con 0x7f10c4100e20 2024-09-12T01:26:14.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.796+0000 7f10c8a14640 1 -- 172.21.15.81:0/1447671571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c41a5080 con 0x7f10c4100e20 2024-09-12T01:26:14.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.797+0000 7f10c8a14640 1 -- 172.21.15.81:0/1447671571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c4101200 con 0x7f10c4100e20 2024-09-12T01:26:14.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.799+0000 7f10b37fe640 1 -- 172.21.15.81:0/1447671571 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f10b4017070 con 0x7f10c4100e20 2024-09-12T01:26:14.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.799+0000 7f10b37fe640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f10ac0a2c00 0x7f10ac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:14.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.799+0000 7f10c1d9b640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f10ac0a2c00 0x7f10ac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:14.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.799+0000 7f10b37fe640 1 -- 172.21.15.81:0/1447671571 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f10b40ce6a0 con 0x7f10c4100e20 2024-09-12T01:26:14.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.800+0000 7f10c1d9b640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f10ac0a2c00 0x7f10ac0a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f10b8000c00 tx=0x7f10b80041e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:14.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:14.803+0000 7f10b37fe640 1 -- 172.21.15.81:0/1447671571 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f10b409b7b0 con 0x7f10c4100e20 2024-09-12T01:26:15.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.003+0000 7f10c8a14640 1 -- 172.21.15.81:0/1447671571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f10c4199860 con 0x7f10c4100e20 2024-09-12T01:26:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.432+0000 7f10b37fe640 1 -- 172.21.15.81:0/1447671571 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f10b409b0b0 con 0x7f10c4100e20 2024-09-12T01:26:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T01:26:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.435+0000 7f10c8a14640 1 -- 172.21.15.81:0/1447671571 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f10ac0a2c00 msgr2=0x7f10ac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.435+0000 7f10c8a14640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f10ac0a2c00 0x7f10ac0a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f10b8000c00 tx=0x7f10b80041e0 comp rx=0 tx=0).stop 2024-09-12T01:26:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.435+0000 7f10c8a14640 1 -- 172.21.15.81:0/1447671571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c4100e20 msgr2=0x7f10c4198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.435+0000 7f10c8a14640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c4100e20 0x7f10c4198500 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f10b400b4a0 tx=0x7f10b400b960 comp rx=0 tx=0).stop 2024-09-12T01:26:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.435+0000 7f10c8a14640 1 -- 172.21.15.81:0/1447671571 shutdown_connections 2024-09-12T01:26:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.435+0000 7f10c8a14640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f10ac0a2c00 0x7f10ac0a50c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.435+0000 7f10c8a14640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10c4102ef0 0x7f10c419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.435+0000 7f10c8a14640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10c4102570 0x7f10c4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.435+0000 7f10c8a14640 1 --2- 172.21.15.81:0/1447671571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10c4100e20 0x7f10c4198500 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.435+0000 7f10c8a14640 1 -- 172.21.15.81:0/1447671571 >> 172.21.15.81:0/1447671571 conn(0x7f10c40fc7d0 msgr2=0x7f10c41068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.435+0000 7f10c8a14640 1 -- 172.21.15.81:0/1447671571 shutdown_connections 2024-09-12T01:26:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:15.435+0000 7f10c8a14640 1 -- 172.21.15.81:0/1447671571 wait complete. 2024-09-12T01:26:15.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:15 smithi081 ceph-mon[30920]: pgmap v274: 97 pgs: 9 creating+peering, 1 active+clean, 87 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:15.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:15 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1447671571' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T01:26:15.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:15 smithi081 ceph-mon[30920]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T01:26:15.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:15 smithi081 ceph-mon[30920]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T01:26:15.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:15 smithi100 ceph-mon[35275]: pgmap v274: 97 pgs: 9 creating+peering, 1 active+clean, 87 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:15.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:15 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1447671571' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T01:26:15.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:15 smithi100 ceph-mon[35275]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T01:26:15.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:15 smithi100 ceph-mon[35275]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T01:26:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:15 smithi189 ceph-mon[35357]: pgmap v274: 97 pgs: 9 creating+peering, 1 active+clean, 87 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:26:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:15 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1447671571' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T01:26:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:15 smithi189 ceph-mon[35357]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T01:26:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:15 smithi189 ceph-mon[35357]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T01:26:16.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:26:16.350 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:16.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:16 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1447671571' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T01:26:16.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:16 smithi081 ceph-mon[30920]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T01:26:16.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:16 smithi081 ceph-mon[30920]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T01:26:16.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:16 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1447671571' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T01:26:16.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:16 smithi100 ceph-mon[35275]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T01:26:16.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:16 smithi100 ceph-mon[35275]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T01:26:16.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:16 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1447671571' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T01:26:16.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:16 smithi189 ceph-mon[35357]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T01:26:16.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:16 smithi189 ceph-mon[35357]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T01:26:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.821+0000 7f2b060fb640 1 -- 172.21.15.81:0/730159424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b00102570 msgr2=0x7f2b001029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.821+0000 7f2b060fb640 1 --2- 172.21.15.81:0/730159424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b00102570 0x7f2b001029b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009900 tx=0x7f2ae802a480 comp rx=0 tx=0).stop 2024-09-12T01:26:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.821+0000 7f2b060fb640 1 -- 172.21.15.81:0/730159424 shutdown_connections 2024-09-12T01:26:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.821+0000 7f2b060fb640 1 --2- 172.21.15.81:0/730159424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b00102ef0 0x7f2b0010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.821+0000 7f2b060fb640 1 --2- 172.21.15.81:0/730159424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b00102570 0x7f2b001029b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.821+0000 7f2b060fb640 1 --2- 172.21.15.81:0/730159424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b00100e20 0x7f2b00101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.821+0000 7f2b060fb640 1 -- 172.21.15.81:0/730159424 >> 172.21.15.81:0/730159424 conn(0x7f2b000fc7d0 msgr2=0x7f2b000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.821+0000 7f2b060fb640 1 -- 172.21.15.81:0/730159424 shutdown_connections 2024-09-12T01:26:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.821+0000 7f2b060fb640 1 -- 172.21.15.81:0/730159424 wait complete. 2024-09-12T01:26:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.821+0000 7f2b060fb640 1 Processor -- start 2024-09-12T01:26:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.821+0000 7f2b060fb640 1 -- start start 2024-09-12T01:26:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2b060fb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b00100e20 0x7f2b00198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2b060fb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b00102570 0x7f2b00198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2b060fb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b00102ef0 0x7f2b0019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2b060fb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2b00110fa0 con 0x7f2b00100e20 2024-09-12T01:26:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2b060fb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2b00110e20 con 0x7f2b00102570 2024-09-12T01:26:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2b060fb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2b00111120 con 0x7f2b00102ef0 2024-09-12T01:26:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2aff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b00100e20 0x7f2b00198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2aff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b00100e20 0x7f2b00198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53660/0 (socket says 172.21.15.81:53660) 2024-09-12T01:26:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2aff7fe640 1 -- 172.21.15.81:0/529967551 learned_addr learned my addr 172.21.15.81:0/529967551 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2afffff640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b00102ef0 0x7f2b0019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2af6ffd640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b00102570 0x7f2b00198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2aff7fe640 1 -- 172.21.15.81:0/529967551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b00102ef0 msgr2=0x7f2b0019ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2aff7fe640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b00102ef0 0x7f2b0019ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2aff7fe640 1 -- 172.21.15.81:0/529967551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b00102570 msgr2=0x7f2b00198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2aff7fe640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b00102570 0x7f2b00198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2aff7fe640 1 -- 172.21.15.81:0/529967551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0019d520 con 0x7f2b00100e20 2024-09-12T01:26:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2afffff640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b00102ef0 0x7f2b0019ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2af6ffd640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b00102570 0x7f2b00198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2aff7fe640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b00100e20 0x7f2b00198570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2af000b4a0 tx=0x7f2af000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2afd7fa640 1 -- 172.21.15.81:0/529967551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0014070 con 0x7f2b00100e20 2024-09-12T01:26:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2afd7fa640 1 -- 172.21.15.81:0/529967551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af0010af0 con 0x7f2b00100e20 2024-09-12T01:26:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2b060fb640 1 -- 172.21.15.81:0/529967551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0019d810 con 0x7f2b00100e20 2024-09-12T01:26:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2afd7fa640 1 -- 172.21.15.81:0/529967551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0017d10 con 0x7f2b00100e20 2024-09-12T01:26:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.822+0000 7f2b060fb640 1 -- 172.21.15.81:0/529967551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b001a50f0 con 0x7f2b00100e20 2024-09-12T01:26:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.823+0000 7f2b060fb640 1 -- 172.21.15.81:0/529967551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b00101200 con 0x7f2b00100e20 2024-09-12T01:26:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.825+0000 7f2afd7fa640 1 -- 172.21.15.81:0/529967551 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2af0017070 con 0x7f2b00100e20 2024-09-12T01:26:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.826+0000 7f2afd7fa640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f2aec0a2c00 0x7f2aec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.826+0000 7f2af6ffd640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f2aec0a2c00 0x7f2aec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.826+0000 7f2afd7fa640 1 -- 172.21.15.81:0/529967551 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f2af00ce700 con 0x7f2b00100e20 2024-09-12T01:26:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.826+0000 7f2af6ffd640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f2aec0a2c00 0x7f2aec0a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2b000feee0 tx=0x7f2ae8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.829+0000 7f2afd7fa640 1 -- 172.21.15.81:0/529967551 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2af009b7b0 con 0x7f2b00100e20 2024-09-12T01:26:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.996+0000 7f2b060fb640 1 -- 172.21.15.81:0/529967551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b001a5380 con 0x7f2b00100e20 2024-09-12T01:26:16.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:16.997+0000 7f2afd7fa640 1 -- 172.21.15.81:0/529967551 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22281 (secure 0 0 0) 0x7f2af009b0b0 con 0x7f2b00100e20 2024-09-12T01:26:16.996 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:26:16.997 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","created":"2024-09-12T01:18:28.404285+0000","modified":"2024-09-12T01:26:15.004214+0000","last_up_change":"2024-09-12T01:25:26.326110+0000","last_in_change":"2024-09-12T01:25:02.138698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:21:40.649584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:26:10.753723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:26:13.254837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc857dd4-eedc-4c48-89a0-4e69662e8e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6803","nonce":3870994528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6805","nonce":3870994528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6809","nonce":3870994528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6807","nonce":3870994528}]},"public_addr":"172.21.15.81:6803/3870994528","cluster_addr":"172.21.15.81:6805/3870994528","heartbeat_back_addr":"172.21.15.81:6809/3870994528","heartbeat_front_addr":"172.21.15.81:6807/3870994528","state":["exists","up"]},{"osd":1,"uuid":"04b8111b-d677-4fc8-8285-90683621ccf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6801","nonce":2098299652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6803","nonce":2098299652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6807","nonce":2098299652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6805","nonce":2098299652}]},"public_addr":"172.21.15.100:6801/2098299652","cluster_addr":"172.21.15.100:6803/2098299652","heartbeat_back_addr":"172.21.15.100:6807/2098299652","heartbeat_front_addr":"172.21.15.100:6805/2098299652","state":["exists","up"]},{"osd":2,"uuid":"763e357e-5a04-45ff-95e8-bc1abfeac056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6801","nonce":1353548110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6803","nonce":1353548110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6807","nonce":1353548110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6805","nonce":1353548110}]},"public_addr":"172.21.15.189:6801/1353548110","cluster_addr":"172.21.15.189:6803/1353548110","heartbeat_back_addr":"172.21.15.189:6807/1353548110","heartbeat_front_addr":"172.21.15.189:6805/1353548110","state":["exists","up"]},{"osd":3,"uuid":"99843578-1b9e-4ee0-91f1-ba419d07897e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6811","nonce":1064869637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6813","nonce":1064869637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6817","nonce":1064869637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6815","nonce":1064869637}]},"public_addr":"172.21.15.81:6811/1064869637","cluster_addr":"172.21.15.81:6813/1064869637","heartbeat_back_addr":"172.21.15.81:6817/1064869637","heartbeat_front_addr":"172.21.15.81:6815/1064869637","state":["exists","up"]},{"osd":4,"uuid":"a5787415-0905-420e-9ce8-eb6902727561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6809","nonce":1687792282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6811","nonce":1687792282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6815","nonce":1687792282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6813","nonce":1687792282}]},"public_addr":"172.21.15.100:6809/1687792282","cluster_addr":"172.21.15.100:6811/1687792282","heartbeat_back_addr":"172.21.15.100:6815/1687792282","heartbeat_front_addr":"172.21.15.100:6813/1687792282","state":["exists","up"]},{"osd":5,"uuid":"879548b5-5516-407c-8517-bbdbf356c0e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6809","nonce":823474396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6811","nonce":823474396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6815","nonce":823474396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6813","nonce":823474396}]},"public_addr":"172.21.15.189:6809/823474396","cluster_addr":"172.21.15.189:6811/823474396","heartbeat_back_addr":"172.21.15.189:6815/823474396","heartbeat_front_addr":"172.21.15.189:6813/823474396","state":["exists","up"]},{"osd":6,"uuid":"b665b97c-a9d3-475f-93f3-8a920cbb37d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6819","nonce":1522854005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6821","nonce":1522854005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6825","nonce":1522854005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6823","nonce":1522854005}]},"public_addr":"172.21.15.81:6819/1522854005","cluster_addr":"172.21.15.81:6821/1522854005","heartbeat_back_addr":"172.21.15.81:6825/1522854005","heartbeat_front_addr":"172.21.15.81:6823/1522854005","state":["exists","up"]},{"osd":7,"uuid":"46e082c8-d071-471a-8c86-ce5b5700cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6817","nonce":41478541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6819","nonce":41478541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6823","nonce":41478541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6821","nonce":41478541}]},"public_addr":"172.21.15.100:6817/41478541","cluster_addr":"172.21.15.100:6819/41478541","heartbeat_back_addr":"172.21.15.100:6823/41478541","heartbeat_front_addr":"172.21.15.100:6821/41478541","state":["exists","up"]},{"osd":8,"uuid":"fb9b93ef-5a33-4ffc-926e-a78c101bbbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6817","nonce":180766860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6819","nonce":180766860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6823","nonce":180766860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6821","nonce":180766860}]},"public_addr":"172.21.15.189:6817/180766860","cluster_addr":"172.21.15.189:6819/180766860","heartbeat_back_addr":"172.21.15.189:6823/180766860","heartbeat_front_addr":"172.21.15.189:6821/180766860","state":["exists","up"]},{"osd":9,"uuid":"0b7ec1a1-5ab9-4075-acfb-e0d82f018656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6827","nonce":1651232782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6829","nonce":1651232782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6833","nonce":1651232782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6831","nonce":1651232782}]},"public_addr":"172.21.15.81:6827/1651232782","cluster_addr":"172.21.15.81:6829/1651232782","heartbeat_back_addr":"172.21.15.81:6833/1651232782","heartbeat_front_addr":"172.21.15.81:6831/1651232782","state":["exists","up"]},{"osd":10,"uuid":"996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6825","nonce":3295868568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6827","nonce":3295868568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6831","nonce":3295868568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6829","nonce":3295868568}]},"public_addr":"172.21.15.100:6825/3295868568","cluster_addr":"172.21.15.100:6827/3295868568","heartbeat_back_addr":"172.21.15.100:6831/3295868568","heartbeat_front_addr":"172.21.15.100:6829/3295868568","state":["exists","up"]},{"osd":11,"uuid":"f051e2b2-fc58-489a-ab7c-8c1ff5448553","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6825","nonce":3852230978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6827","nonce":3852230978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6831","nonce":3852230978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6829","nonce":3852230978}]},"public_addr":"172.21.15.189:6825/3852230978","cluster_addr":"172.21.15.189:6827/3852230978","heartbeat_back_addr":"172.21.15.189:6831/3852230978","heartbeat_front_addr":"172.21.15.189:6829/3852230978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:20:47.371696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:12.762376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:37.936648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:03.950352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:28.922754+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:54.252149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:18.421479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:43.989505+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:08.789671+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:34.336367+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:59.089601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:25:23.761934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/4128337402":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/1460332159":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2577694203":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2393807982":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/2162789959":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/4219073331":"2024-09-13T01:19:00.926419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:26:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:17.000+0000 7f2b060fb640 1 -- 172.21.15.81:0/529967551 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f2aec0a2c00 msgr2=0x7f2aec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:17.000+0000 7f2b060fb640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f2aec0a2c00 0x7f2aec0a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2b000feee0 tx=0x7f2ae8005a20 comp rx=0 tx=0).stop 2024-09-12T01:26:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:17.000+0000 7f2b060fb640 1 -- 172.21.15.81:0/529967551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b00100e20 msgr2=0x7f2b00198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:17.000+0000 7f2b060fb640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b00100e20 0x7f2b00198570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2af000b4a0 tx=0x7f2af000b960 comp rx=0 tx=0).stop 2024-09-12T01:26:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:17.000+0000 7f2b060fb640 1 -- 172.21.15.81:0/529967551 shutdown_connections 2024-09-12T01:26:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:17.000+0000 7f2b060fb640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f2aec0a2c00 0x7f2aec0a50c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:17.000+0000 7f2b060fb640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b00102ef0 0x7f2b0019ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:17.000+0000 7f2b060fb640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b00102570 0x7f2b00198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:17.000+0000 7f2b060fb640 1 --2- 172.21.15.81:0/529967551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b00100e20 0x7f2b00198570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:17.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:17.000+0000 7f2b060fb640 1 -- 172.21.15.81:0/529967551 >> 172.21.15.81:0/529967551 conn(0x7f2b000fc7d0 msgr2=0x7f2b00069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:17.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:17.000+0000 7f2b060fb640 1 -- 172.21.15.81:0/529967551 shutdown_connections 2024-09-12T01:26:17.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:17.000+0000 7f2b060fb640 1 -- 172.21.15.81:0/529967551 wait complete. 2024-09-12T01:26:17.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:17 smithi100 ceph-mon[35275]: pgmap v276: 97 pgs: 9 creating+peering, 69 active+clean, 19 unknown; 578 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 9 op/s 2024-09-12T01:26:17.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:17 smithi100 ceph-mon[35275]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T01:26:17.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:17 smithi100 ceph-mon[35275]: Cluster is now healthy 2024-09-12T01:26:17.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:17 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] up:active 2024-09-12T01:26:17.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:17 smithi100 ceph-mon[35275]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:26:17.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:17 smithi100 ceph-mon[35275]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:26:17.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:17 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/529967551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:17.661 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:17 smithi081 ceph-mon[30920]: pgmap v276: 97 pgs: 9 creating+peering, 69 active+clean, 19 unknown; 578 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 9 op/s 2024-09-12T01:26:17.661 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:17 smithi081 ceph-mon[30920]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T01:26:17.661 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:17 smithi081 ceph-mon[30920]: Cluster is now healthy 2024-09-12T01:26:17.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:17 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] up:active 2024-09-12T01:26:17.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:17 smithi081 ceph-mon[30920]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:26:17.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:17 smithi081 ceph-mon[30920]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:26:17.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:17 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/529967551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:17.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:26:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:17 smithi189 ceph-mon[35357]: pgmap v276: 97 pgs: 9 creating+peering, 69 active+clean, 19 unknown; 578 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 9 op/s 2024-09-12T01:26:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:17 smithi189 ceph-mon[35357]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T01:26:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:17 smithi189 ceph-mon[35357]: Cluster is now healthy 2024-09-12T01:26:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:17 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] up:active 2024-09-12T01:26:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:17 smithi189 ceph-mon[35357]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:26:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:17 smithi189 ceph-mon[35357]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:26:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:17 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/529967551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:17.935 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.453+0000 7ff986bce640 1 -- 172.21.15.81:0/1372676831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff980100e20 msgr2=0x7ff980101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.453+0000 7ff986bce640 1 --2- 172.21.15.81:0/1372676831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff980100e20 0x7ff980101200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff978009900 tx=0x7ff97802a480 comp rx=0 tx=0).stop 2024-09-12T01:26:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.453+0000 7ff986bce640 1 -- 172.21.15.81:0/1372676831 shutdown_connections 2024-09-12T01:26:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.453+0000 7ff986bce640 1 --2- 172.21.15.81:0/1372676831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff980102ef0 0x7ff98010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.453+0000 7ff986bce640 1 --2- 172.21.15.81:0/1372676831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff980102570 0x7ff9801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.453+0000 7ff986bce640 1 --2- 172.21.15.81:0/1372676831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff980100e20 0x7ff980101200 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.453+0000 7ff986bce640 1 -- 172.21.15.81:0/1372676831 >> 172.21.15.81:0/1372676831 conn(0x7ff9800fc7d0 msgr2=0x7ff9800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.453+0000 7ff986bce640 1 -- 172.21.15.81:0/1372676831 shutdown_connections 2024-09-12T01:26:18.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.453+0000 7ff986bce640 1 -- 172.21.15.81:0/1372676831 wait complete. 2024-09-12T01:26:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff986bce640 1 Processor -- start 2024-09-12T01:26:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff986bce640 1 -- start start 2024-09-12T01:26:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff986bce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff980100e20 0x7ff9801974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff986bce640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff980102570 0x7ff980197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff986bce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff980102ef0 0x7ff98019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff986bce640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff980110fa0 con 0x7ff980100e20 2024-09-12T01:26:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff986bce640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff980110e20 con 0x7ff980102ef0 2024-09-12T01:26:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff986bce640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff980111120 con 0x7ff980102570 2024-09-12T01:26:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff98496a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff980100e20 0x7ff9801974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff98496a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff980100e20 0x7ff9801974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53668/0 (socket says 172.21.15.81:53668) 2024-09-12T01:26:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff98496a640 1 -- 172.21.15.81:0/3438892178 learned_addr learned my addr 172.21.15.81:0/3438892178 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff98516b640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff980102ef0 0x7ff98019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff97ffff640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff980102570 0x7ff980197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff98496a640 1 -- 172.21.15.81:0/3438892178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff980102570 msgr2=0x7ff980197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff98496a640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff980102570 0x7ff980197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff98496a640 1 -- 172.21.15.81:0/3438892178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff980102ef0 msgr2=0x7ff98019bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff98496a640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff980102ef0 0x7ff98019bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff98496a640 1 -- 172.21.15.81:0/3438892178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98019c470 con 0x7ff980100e20 2024-09-12T01:26:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.454+0000 7ff98516b640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff980102ef0 0x7ff98019bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.455+0000 7ff98496a640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff980100e20 0x7ff9801974c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff978006010 tx=0x7ff978003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.455+0000 7ff97dffb640 1 -- 172.21.15.81:0/3438892178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97803f070 con 0x7ff980100e20 2024-09-12T01:26:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.455+0000 7ff986bce640 1 -- 172.21.15.81:0/3438892178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98019c700 con 0x7ff980100e20 2024-09-12T01:26:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.455+0000 7ff97dffb640 1 -- 172.21.15.81:0/3438892178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff978031c30 con 0x7ff980100e20 2024-09-12T01:26:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.455+0000 7ff97dffb640 1 -- 172.21.15.81:0/3438892178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978035030 con 0x7ff980100e20 2024-09-12T01:26:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.455+0000 7ff986bce640 1 -- 172.21.15.81:0/3438892178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9801a4040 con 0x7ff980100e20 2024-09-12T01:26:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.456+0000 7ff986bce640 1 -- 172.21.15.81:0/3438892178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff980101200 con 0x7ff980100e20 2024-09-12T01:26:18.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.457+0000 7ff97dffb640 1 -- 172.21.15.81:0/3438892178 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff978042070 con 0x7ff980100e20 2024-09-12T01:26:18.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.458+0000 7ff97dffb640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff96c0a2b80 0x7ff96c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:18.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.458+0000 7ff97ffff640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff96c0a2b80 0x7ff96c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:18.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.458+0000 7ff97dffb640 1 -- 172.21.15.81:0/3438892178 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ff9780efd00 con 0x7ff980100e20 2024-09-12T01:26:18.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.458+0000 7ff97ffff640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff96c0a2b80 0x7ff96c0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9800ffde0 tx=0x7ff9700094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:18.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.461+0000 7ff97dffb640 1 -- 172.21.15.81:0/3438892178 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff978031de0 con 0x7ff980100e20 2024-09-12T01:26:18.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.629+0000 7ff986bce640 1 -- 172.21.15.81:0/3438892178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff980109090 con 0x7ff980100e20 2024-09-12T01:26:18.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.631+0000 7ff97dffb640 1 -- 172.21.15.81:0/3438892178 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22281 (secure 0 0 0) 0x7ff9780bcdd0 con 0x7ff980100e20 2024-09-12T01:26:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:26:18.630 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","created":"2024-09-12T01:18:28.404285+0000","modified":"2024-09-12T01:26:15.004214+0000","last_up_change":"2024-09-12T01:25:26.326110+0000","last_in_change":"2024-09-12T01:25:02.138698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:21:40.649584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:26:10.753723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:26:13.254837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc857dd4-eedc-4c48-89a0-4e69662e8e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6803","nonce":3870994528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6805","nonce":3870994528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6809","nonce":3870994528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6807","nonce":3870994528}]},"public_addr":"172.21.15.81:6803/3870994528","cluster_addr":"172.21.15.81:6805/3870994528","heartbeat_back_addr":"172.21.15.81:6809/3870994528","heartbeat_front_addr":"172.21.15.81:6807/3870994528","state":["exists","up"]},{"osd":1,"uuid":"04b8111b-d677-4fc8-8285-90683621ccf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6801","nonce":2098299652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6803","nonce":2098299652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6807","nonce":2098299652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6805","nonce":2098299652}]},"public_addr":"172.21.15.100:6801/2098299652","cluster_addr":"172.21.15.100:6803/2098299652","heartbeat_back_addr":"172.21.15.100:6807/2098299652","heartbeat_front_addr":"172.21.15.100:6805/2098299652","state":["exists","up"]},{"osd":2,"uuid":"763e357e-5a04-45ff-95e8-bc1abfeac056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6801","nonce":1353548110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6803","nonce":1353548110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6807","nonce":1353548110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6805","nonce":1353548110}]},"public_addr":"172.21.15.189:6801/1353548110","cluster_addr":"172.21.15.189:6803/1353548110","heartbeat_back_addr":"172.21.15.189:6807/1353548110","heartbeat_front_addr":"172.21.15.189:6805/1353548110","state":["exists","up"]},{"osd":3,"uuid":"99843578-1b9e-4ee0-91f1-ba419d07897e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6811","nonce":1064869637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6813","nonce":1064869637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6817","nonce":1064869637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6815","nonce":1064869637}]},"public_addr":"172.21.15.81:6811/1064869637","cluster_addr":"172.21.15.81:6813/1064869637","heartbeat_back_addr":"172.21.15.81:6817/1064869637","heartbeat_front_addr":"172.21.15.81:6815/1064869637","state":["exists","up"]},{"osd":4,"uuid":"a5787415-0905-420e-9ce8-eb6902727561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6809","nonce":1687792282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6811","nonce":1687792282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6815","nonce":1687792282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6813","nonce":1687792282}]},"public_addr":"172.21.15.100:6809/1687792282","cluster_addr":"172.21.15.100:6811/1687792282","heartbeat_back_addr":"172.21.15.100:6815/1687792282","heartbeat_front_addr":"172.21.15.100:6813/1687792282","state":["exists","up"]},{"osd":5,"uuid":"879548b5-5516-407c-8517-bbdbf356c0e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6809","nonce":823474396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6811","nonce":823474396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6815","nonce":823474396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6813","nonce":823474396}]},"public_addr":"172.21.15.189:6809/823474396","cluster_addr":"172.21.15.189:6811/823474396","heartbeat_back_addr":"172.21.15.189:6815/823474396","heartbeat_front_addr":"172.21.15.189:6813/823474396","state":["exists","up"]},{"osd":6,"uuid":"b665b97c-a9d3-475f-93f3-8a920cbb37d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6819","nonce":1522854005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6821","nonce":1522854005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6825","nonce":1522854005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6823","nonce":1522854005}]},"public_addr":"172.21.15.81:6819/1522854005","cluster_addr":"172.21.15.81:6821/1522854005","heartbeat_back_addr":"172.21.15.81:6825/1522854005","heartbeat_front_addr":"172.21.15.81:6823/1522854005","state":["exists","up"]},{"osd":7,"uuid":"46e082c8-d071-471a-8c86-ce5b5700cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6817","nonce":41478541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6819","nonce":41478541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6823","nonce":41478541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6821","nonce":41478541}]},"public_addr":"172.21.15.100:6817/41478541","cluster_addr":"172.21.15.100:6819/41478541","heartbeat_back_addr":"172.21.15.100:6823/41478541","heartbeat_front_addr":"172.21.15.100:6821/41478541","state":["exists","up"]},{"osd":8,"uuid":"fb9b93ef-5a33-4ffc-926e-a78c101bbbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6817","nonce":180766860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6819","nonce":180766860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6823","nonce":180766860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6821","nonce":180766860}]},"public_addr":"172.21.15.189:6817/180766860","cluster_addr":"172.21.15.189:6819/180766860","heartbeat_back_addr":"172.21.15.189:6823/180766860","heartbeat_front_addr":"172.21.15.189:6821/180766860","state":["exists","up"]},{"osd":9,"uuid":"0b7ec1a1-5ab9-4075-acfb-e0d82f018656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6827","nonce":1651232782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6829","nonce":1651232782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6833","nonce":1651232782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6831","nonce":1651232782}]},"public_addr":"172.21.15.81:6827/1651232782","cluster_addr":"172.21.15.81:6829/1651232782","heartbeat_back_addr":"172.21.15.81:6833/1651232782","heartbeat_front_addr":"172.21.15.81:6831/1651232782","state":["exists","up"]},{"osd":10,"uuid":"996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6825","nonce":3295868568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6827","nonce":3295868568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6831","nonce":3295868568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6829","nonce":3295868568}]},"public_addr":"172.21.15.100:6825/3295868568","cluster_addr":"172.21.15.100:6827/3295868568","heartbeat_back_addr":"172.21.15.100:6831/3295868568","heartbeat_front_addr":"172.21.15.100:6829/3295868568","state":["exists","up"]},{"osd":11,"uuid":"f051e2b2-fc58-489a-ab7c-8c1ff5448553","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6825","nonce":3852230978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6827","nonce":3852230978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6831","nonce":3852230978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6829","nonce":3852230978}]},"public_addr":"172.21.15.189:6825/3852230978","cluster_addr":"172.21.15.189:6827/3852230978","heartbeat_back_addr":"172.21.15.189:6831/3852230978","heartbeat_front_addr":"172.21.15.189:6829/3852230978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:20:47.371696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:12.762376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:37.936648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:03.950352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:28.922754+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:54.252149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:18.421479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:43.989505+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:08.789671+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:34.336367+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:59.089601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:25:23.761934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/4128337402":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/1460332159":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2577694203":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2393807982":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/2162789959":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/4219073331":"2024-09-13T01:19:00.926419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:26:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.633+0000 7ff986bce640 1 -- 172.21.15.81:0/3438892178 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff96c0a2b80 msgr2=0x7ff96c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.633+0000 7ff986bce640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff96c0a2b80 0x7ff96c0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9800ffde0 tx=0x7ff9700094f0 comp rx=0 tx=0).stop 2024-09-12T01:26:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.633+0000 7ff986bce640 1 -- 172.21.15.81:0/3438892178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff980100e20 msgr2=0x7ff9801974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.633+0000 7ff986bce640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff980100e20 0x7ff9801974c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff978006010 tx=0x7ff978003c10 comp rx=0 tx=0).stop 2024-09-12T01:26:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.633+0000 7ff986bce640 1 -- 172.21.15.81:0/3438892178 shutdown_connections 2024-09-12T01:26:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.633+0000 7ff986bce640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ff96c0a2b80 0x7ff96c0a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.633+0000 7ff986bce640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff980102ef0 0x7ff98019bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.633+0000 7ff986bce640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff980102570 0x7ff980197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.633+0000 7ff986bce640 1 --2- 172.21.15.81:0/3438892178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff980100e20 0x7ff9801974c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.633+0000 7ff986bce640 1 -- 172.21.15.81:0/3438892178 >> 172.21.15.81:0/3438892178 conn(0x7ff9800fc7d0 msgr2=0x7ff9800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.633+0000 7ff986bce640 1 -- 172.21.15.81:0/3438892178 shutdown_connections 2024-09-12T01:26:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:18.633+0000 7ff986bce640 1 -- 172.21.15.81:0/3438892178 wait complete. 2024-09-12T01:26:19.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:26:19.508 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:19.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:19 smithi081 ceph-mon[30920]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T01:26:19.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:19 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3438892178' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:19.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:19 smithi100 ceph-mon[35275]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T01:26:19.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:19 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3438892178' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:19 smithi189 ceph-mon[35357]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T01:26:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:19 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3438892178' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:20.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.996+0000 7fa5393e2640 1 -- 172.21.15.81:0/982977323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa534100a80 msgr2=0x7fa534100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:20.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.996+0000 7fa5393e2640 1 --2- 172.21.15.81:0/982977323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa534100a80 0x7fa534100ee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009930 tx=0x7fa51c02a420 comp rx=0 tx=0).stop 2024-09-12T01:26:20.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.996+0000 7fa5393e2640 1 -- 172.21.15.81:0/982977323 shutdown_connections 2024-09-12T01:26:20.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.996+0000 7fa5393e2640 1 --2- 172.21.15.81:0/982977323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534101420 0x7fa53410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:20.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.996+0000 7fa5393e2640 1 --2- 172.21.15.81:0/982977323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa534100a80 0x7fa534100ee0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:20.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.996+0000 7fa5393e2640 1 --2- 172.21.15.81:0/982977323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa534106a80 0x7fa534106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:20.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.996+0000 7fa5393e2640 1 -- 172.21.15.81:0/982977323 >> 172.21.15.81:0/982977323 conn(0x7fa5340fc7a0 msgr2=0x7fa5340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:20.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.996+0000 7fa5393e2640 1 -- 172.21.15.81:0/982977323 shutdown_connections 2024-09-12T01:26:20.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.996+0000 7fa5393e2640 1 -- 172.21.15.81:0/982977323 wait complete. 2024-09-12T01:26:20.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.997+0000 7fa5393e2640 1 Processor -- start 2024-09-12T01:26:20.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.997+0000 7fa5393e2640 1 -- start start 2024-09-12T01:26:20.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.997+0000 7fa5393e2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534100a80 0x7fa534199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:20.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.997+0000 7fa5393e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa534101420 0x7fa534199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:20.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.997+0000 7fa5393e2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa534106a80 0x7fa5341a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:20.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.997+0000 7fa5393e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa534110ea0 con 0x7fa534101420 2024-09-12T01:26:20.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.997+0000 7fa5393e2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa534110d20 con 0x7fa534106a80 2024-09-12T01:26:20.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.997+0000 7fa5393e2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa534111020 con 0x7fa534100a80 2024-09-12T01:26:20.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.997+0000 7fa52a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa534101420 0x7fa534199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:20.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.997+0000 7fa52a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa534101420 0x7fa534199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53696/0 (socket says 172.21.15.81:53696) 2024-09-12T01:26:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.997+0000 7fa52a7fc640 1 -- 172.21.15.81:0/167073449 learned_addr learned my addr 172.21.15.81:0/167073449 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.997+0000 7fa5337fe640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa534106a80 0x7fa5341a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa52a7fc640 1 -- 172.21.15.81:0/167073449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534100a80 msgr2=0x7fa534199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa532ffd640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534100a80 0x7fa534199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa52a7fc640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534100a80 0x7fa534199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa52a7fc640 1 -- 172.21.15.81:0/167073449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa534106a80 msgr2=0x7fa5341a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa52a7fc640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa534106a80 0x7fa5341a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa52a7fc640 1 -- 172.21.15.81:0/167073449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5341a48f0 con 0x7fa534101420 2024-09-12T01:26:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa5337fe640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa534106a80 0x7fa5341a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa532ffd640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534100a80 0x7fa534199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:26:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa52a7fc640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa534101420 0x7fa534199870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009a50 tx=0x7fa51c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa530ff9640 1 -- 172.21.15.81:0/167073449 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c03f030 con 0x7fa534101420 2024-09-12T01:26:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa5393e2640 1 -- 172.21.15.81:0/167073449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5341a4ac0 con 0x7fa534101420 2024-09-12T01:26:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa530ff9640 1 -- 172.21.15.81:0/167073449 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa51c003ce0 con 0x7fa534101420 2024-09-12T01:26:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa530ff9640 1 -- 172.21.15.81:0/167073449 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c035070 con 0x7fa534101420 2024-09-12T01:26:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.998+0000 7fa5393e2640 1 -- 172.21.15.81:0/167073449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5341a4f20 con 0x7fa534101420 2024-09-12T01:26:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:19.999+0000 7fa5393e2640 1 -- 172.21.15.81:0/167073449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa534100ee0 con 0x7fa534101420 2024-09-12T01:26:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.000+0000 7fa530ff9640 1 -- 172.21.15.81:0/167073449 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa51c042030 con 0x7fa534101420 2024-09-12T01:26:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.001+0000 7fa530ff9640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa5200a2b80 0x7fa5200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.001+0000 7fa530ff9640 1 -- 172.21.15.81:0/167073449 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fa51c0ef990 con 0x7fa534101420 2024-09-12T01:26:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.001+0000 7fa532ffd640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa5200a2b80 0x7fa5200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.001+0000 7fa532ffd640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa5200a2b80 0x7fa5200a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa5240058c0 tx=0x7fa524005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.004+0000 7fa530ff9640 1 -- 172.21.15.81:0/167073449 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa51c0bca40 con 0x7fa534101420 2024-09-12T01:26:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.207+0000 7fa5393e2640 1 -- 172.21.15.81:0/167073449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa53402d7c0 con 0x7fa534101420 2024-09-12T01:26:20.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.452+0000 7fa530ff9640 1 -- 172.21.15.81:0/167073449 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fa51c0bc340 con 0x7fa534101420 2024-09-12T01:26:20.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.454+0000 7fa5393e2640 1 -- 172.21.15.81:0/167073449 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa5200a2b80 msgr2=0x7fa5200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:20.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.454+0000 7fa5393e2640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa5200a2b80 0x7fa5200a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa5240058c0 tx=0x7fa524005d30 comp rx=0 tx=0).stop 2024-09-12T01:26:20.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.455+0000 7fa5393e2640 1 -- 172.21.15.81:0/167073449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa534101420 msgr2=0x7fa534199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:20.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.455+0000 7fa5393e2640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa534101420 0x7fa534199870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009a50 tx=0x7fa51c004270 comp rx=0 tx=0).stop 2024-09-12T01:26:20.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.455+0000 7fa5393e2640 1 -- 172.21.15.81:0/167073449 shutdown_connections 2024-09-12T01:26:20.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.455+0000 7fa5393e2640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa5200a2b80 0x7fa5200a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:20.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.455+0000 7fa5393e2640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa534106a80 0x7fa5341a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:20.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.455+0000 7fa5393e2640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa534101420 0x7fa534199870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:20.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.455+0000 7fa5393e2640 1 --2- 172.21.15.81:0/167073449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534100a80 0x7fa534199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:20.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.455+0000 7fa5393e2640 1 -- 172.21.15.81:0/167073449 >> 172.21.15.81:0/167073449 conn(0x7fa5340fc7a0 msgr2=0x7fa5340fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:20.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.455+0000 7fa5393e2640 1 -- 172.21.15.81:0/167073449 shutdown_connections 2024-09-12T01:26:20.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:20.455+0000 7fa5393e2640 1 -- 172.21.15.81:0/167073449 wait complete. 2024-09-12T01:26:20.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:20 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/167073449' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:26:20.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:20 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/167073449' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:26:20.769 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:20 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b[65607]: 2024-09-12T01:26:20.488+0000 7fe77b9bc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:26:20.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:20 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/167073449' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:26:21.154 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T01:26:21.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-12T01:26:21.399 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:21.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:21 smithi081 ceph-mon[30920]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-12T01:26:21.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:21 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/167073449' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T01:26:21.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:21 smithi081 ceph-mon[30920]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:26:21.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:21 smithi100 ceph-mon[35275]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-12T01:26:21.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:21 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/167073449' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T01:26:21.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:21 smithi100 ceph-mon[35275]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:26:21.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:21 smithi189 ceph-mon[35357]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-12T01:26:21.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:21 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/167073449' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T01:26:21.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:21 smithi189 ceph-mon[35357]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:26:21.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.856+0000 7ffa2d795640 1 -- 172.21.15.81:0/4234286978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa28102d40 msgr2=0x7ffa28103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.856+0000 7ffa2d795640 1 --2- 172.21.15.81:0/4234286978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa28102d40 0x7ffa28103120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009900 tx=0x7ffa1802a480 comp rx=0 tx=0).stop 2024-09-12T01:26:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.856+0000 7ffa2d795640 1 -- 172.21.15.81:0/4234286978 shutdown_connections 2024-09-12T01:26:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.856+0000 7ffa2d795640 1 --2- 172.21.15.81:0/4234286978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa2810c170 0x7ffa2810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.856+0000 7ffa2d795640 1 --2- 172.21.15.81:0/4234286978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa28103660 0x7ffa2810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.856+0000 7ffa2d795640 1 --2- 172.21.15.81:0/4234286978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa28102d40 0x7ffa28103120 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.856+0000 7ffa2d795640 1 -- 172.21.15.81:0/4234286978 >> 172.21.15.81:0/4234286978 conn(0x7ffa280fc7a0 msgr2=0x7ffa280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.856+0000 7ffa2d795640 1 -- 172.21.15.81:0/4234286978 shutdown_connections 2024-09-12T01:26:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.856+0000 7ffa2d795640 1 -- 172.21.15.81:0/4234286978 wait complete. 2024-09-12T01:26:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.857+0000 7ffa2d795640 1 Processor -- start 2024-09-12T01:26:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.857+0000 7ffa2d795640 1 -- start start 2024-09-12T01:26:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.857+0000 7ffa2d795640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa28102d40 0x7ffa281984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:21.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.857+0000 7ffa2d795640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa28103660 0x7ffa28198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.857+0000 7ffa2d795640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa2810c170 0x7ffa2819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.857+0000 7ffa2d795640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffa28111f70 con 0x7ffa2810c170 2024-09-12T01:26:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.857+0000 7ffa2d795640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffa28111df0 con 0x7ffa28103660 2024-09-12T01:26:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.857+0000 7ffa2d795640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa281120f0 con 0x7ffa28102d40 2024-09-12T01:26:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa277fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa2810c170 0x7ffa2819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa277fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa2810c170 0x7ffa2819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53708/0 (socket says 172.21.15.81:53708) 2024-09-12T01:26:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa277fe640 1 -- 172.21.15.81:0/4222521999 learned_addr learned my addr 172.21.15.81:0/4222521999 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa1e7fc640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa28103660 0x7ffa28198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa26ffd640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa28102d40 0x7ffa281984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa277fe640 1 -- 172.21.15.81:0/4222521999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa28102d40 msgr2=0x7ffa281984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa277fe640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa28102d40 0x7ffa281984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa277fe640 1 -- 172.21.15.81:0/4222521999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa28103660 msgr2=0x7ffa28198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:21.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa277fe640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa28103660 0x7ffa28198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa277fe640 1 -- 172.21.15.81:0/4222521999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2819d4a0 con 0x7ffa2810c170 2024-09-12T01:26:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa26ffd640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa28102d40 0x7ffa281984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa277fe640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa2810c170 0x7ffa2819cdc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000cad0 tx=0x7ffa2000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa24ff9640 1 -- 172.21.15.81:0/4222521999 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2000ae20 con 0x7ffa2810c170 2024-09-12T01:26:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa24ff9640 1 -- 172.21.15.81:0/4222521999 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa20005020 con 0x7ffa2810c170 2024-09-12T01:26:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa2d795640 1 -- 172.21.15.81:0/4222521999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2819d790 con 0x7ffa2810c170 2024-09-12T01:26:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa24ff9640 1 -- 172.21.15.81:0/4222521999 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2000f6f0 con 0x7ffa2810c170 2024-09-12T01:26:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.858+0000 7ffa2d795640 1 -- 172.21.15.81:0/4222521999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa281a5070 con 0x7ffa2810c170 2024-09-12T01:26:21.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.859+0000 7ffa2d795640 1 -- 172.21.15.81:0/4222521999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa28103120 con 0x7ffa2810c170 2024-09-12T01:26:21.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.860+0000 7ffa24ff9640 1 -- 172.21.15.81:0/4222521999 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ffa200051d0 con 0x7ffa2810c170 2024-09-12T01:26:21.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.861+0000 7ffa24ff9640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ffa140a2c00 0x7ffa140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:21.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.861+0000 7ffa26ffd640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ffa140a2c00 0x7ffa140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:21.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.861+0000 7ffa24ff9640 1 -- 172.21.15.81:0/4222521999 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ffa200cee70 con 0x7ffa2810c170 2024-09-12T01:26:21.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.861+0000 7ffa26ffd640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ffa140a2c00 0x7ffa140a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffa18005ab0 tx=0x7ffa18005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:21.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:21.865+0000 7ffa24ff9640 1 -- 172.21.15.81:0/4222521999 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa20014030 con 0x7ffa2810c170 2024-09-12T01:26:22.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.065+0000 7ffa2d795640 1 -- 172.21.15.81:0/4222521999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7ffa28106c50 con 0x7ffa2810c170 2024-09-12T01:26:22.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.459+0000 7ffa24ff9640 1 -- 172.21.15.81:0/4222521999 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7ffa2009bf20 con 0x7ffa2810c170 2024-09-12T01:26:22.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.461+0000 7ffa2d795640 1 -- 172.21.15.81:0/4222521999 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ffa140a2c00 msgr2=0x7ffa140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:22.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.461+0000 7ffa2d795640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ffa140a2c00 0x7ffa140a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffa18005ab0 tx=0x7ffa18005a20 comp rx=0 tx=0).stop 2024-09-12T01:26:22.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.461+0000 7ffa2d795640 1 -- 172.21.15.81:0/4222521999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa2810c170 msgr2=0x7ffa2819cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.461+0000 7ffa2d795640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa2810c170 0x7ffa2819cdc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000cad0 tx=0x7ffa2000cf90 comp rx=0 tx=0).stop 2024-09-12T01:26:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.461+0000 7ffa2d795640 1 -- 172.21.15.81:0/4222521999 shutdown_connections 2024-09-12T01:26:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.461+0000 7ffa2d795640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ffa140a2c00 0x7ffa140a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.461+0000 7ffa2d795640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa2810c170 0x7ffa2819cdc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.461+0000 7ffa2d795640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa28103660 0x7ffa28198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.461+0000 7ffa2d795640 1 --2- 172.21.15.81:0/4222521999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa28102d40 0x7ffa281984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.461+0000 7ffa2d795640 1 -- 172.21.15.81:0/4222521999 >> 172.21.15.81:0/4222521999 conn(0x7ffa280fc7a0 msgr2=0x7ffa280fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.461+0000 7ffa2d795640 1 -- 172.21.15.81:0/4222521999 shutdown_connections 2024-09-12T01:26:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:22.461+0000 7ffa2d795640 1 -- 172.21.15.81:0/4222521999 wait complete. 2024-09-12T01:26:22.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:22 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/4222521999' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T01:26:22.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:22 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/4222521999' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T01:26:22.879 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:22 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/4222521999' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T01:26:23.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T01:26:23.358 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:23.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:23 smithi081 ceph-mon[30920]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-12T01:26:23.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:23 smithi081 ceph-mon[30920]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T01:26:23.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:23 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/4222521999' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T01:26:23.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:23 smithi081 ceph-mon[30920]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T01:26:23.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:23 smithi081 ceph-mon[30920]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:26:23.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:23 smithi081 ceph-mon[30920]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T01:26:23.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:23 smithi081 ceph-mon[30920]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T01:26:23.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:23 smithi100 ceph-mon[35275]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-12T01:26:23.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:23 smithi100 ceph-mon[35275]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T01:26:23.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:23 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/4222521999' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T01:26:23.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:23 smithi100 ceph-mon[35275]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T01:26:23.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:23 smithi100 ceph-mon[35275]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:26:23.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:23 smithi100 ceph-mon[35275]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T01:26:23.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:23 smithi100 ceph-mon[35275]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T01:26:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:23 smithi189 ceph-mon[35357]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-12T01:26:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:23 smithi189 ceph-mon[35357]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T01:26:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:23 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/4222521999' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T01:26:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:23 smithi189 ceph-mon[35357]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T01:26:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:23 smithi189 ceph-mon[35357]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:26:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:23 smithi189 ceph-mon[35357]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T01:26:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:23 smithi189 ceph-mon[35357]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T01:26:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.857+0000 7f9304702640 1 -- 172.21.15.81:0/3443891464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92fc101de0 msgr2=0x7f92fc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.857+0000 7f9304702640 1 --2- 172.21.15.81:0/3443891464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92fc101de0 0x7f92fc1021c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009900 tx=0x7f92f002a410 comp rx=0 tx=0).stop 2024-09-12T01:26:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.857+0000 7f9304702640 1 -- 172.21.15.81:0/3443891464 shutdown_connections 2024-09-12T01:26:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.857+0000 7f9304702640 1 --2- 172.21.15.81:0/3443891464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92fc106f10 0x7f92fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.857+0000 7f9304702640 1 --2- 172.21.15.81:0/3443891464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92fc102790 0x7f92fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.857+0000 7f9304702640 1 --2- 172.21.15.81:0/3443891464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92fc101de0 0x7f92fc1021c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.857+0000 7f9304702640 1 -- 172.21.15.81:0/3443891464 >> 172.21.15.81:0/3443891464 conn(0x7f92fc0fd8c0 msgr2=0x7f92fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.857+0000 7f9304702640 1 -- 172.21.15.81:0/3443891464 shutdown_connections 2024-09-12T01:26:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.857+0000 7f9304702640 1 -- 172.21.15.81:0/3443891464 wait complete. 2024-09-12T01:26:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.857+0000 7f9304702640 1 Processor -- start 2024-09-12T01:26:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f9304702640 1 -- start start 2024-09-12T01:26:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f9304702640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92fc101de0 0x7f92fc198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f9304702640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92fc102790 0x7f92fc1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f9304702640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92fc106f10 0x7f92fc19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f9304702640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc111f90 con 0x7f92fc101de0 2024-09-12T01:26:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f9304702640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc111e10 con 0x7f92fc106f10 2024-09-12T01:26:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f9304702640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc112110 con 0x7f92fc102790 2024-09-12T01:26:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f930249e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92fc101de0 0x7f92fc198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f930249e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92fc101de0 0x7f92fc198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35048/0 (socket says 172.21.15.81:35048) 2024-09-12T01:26:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f930249e640 1 -- 172.21.15.81:0/196628069 learned_addr learned my addr 172.21.15.81:0/196628069 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f9302c9f640 1 --2- 172.21.15.81:0/196628069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92fc106f10 0x7f92fc19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f930249e640 1 -- 172.21.15.81:0/196628069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92fc102790 msgr2=0x7f92fc1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f930249e640 1 --2- 172.21.15.81:0/196628069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92fc102790 0x7f92fc1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f930249e640 1 -- 172.21.15.81:0/196628069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92fc106f10 msgr2=0x7f92fc19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f930249e640 1 --2- 172.21.15.81:0/196628069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92fc106f10 0x7f92fc19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f930249e640 1 -- 172.21.15.81:0/196628069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92fc19d440 con 0x7f92fc101de0 2024-09-12T01:26:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f930249e640 1 --2- 172.21.15.81:0/196628069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92fc101de0 0x7f92fc198490 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f92f0006010 tx=0x7f92f00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.858+0000 7f92ef7fe640 1 -- 172.21.15.81:0/196628069 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f003f030 con 0x7f92fc101de0 2024-09-12T01:26:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.859+0000 7f92ef7fe640 1 -- 172.21.15.81:0/196628069 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92f0003ce0 con 0x7f92fc101de0 2024-09-12T01:26:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.859+0000 7f9304702640 1 -- 172.21.15.81:0/196628069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92fc19d6d0 con 0x7f92fc101de0 2024-09-12T01:26:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.859+0000 7f92ef7fe640 1 -- 172.21.15.81:0/196628069 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0035070 con 0x7f92fc101de0 2024-09-12T01:26:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.859+0000 7f9304702640 1 -- 172.21.15.81:0/196628069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92fc1a5010 con 0x7f92fc101de0 2024-09-12T01:26:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.859+0000 7f9304702640 1 -- 172.21.15.81:0/196628069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92fc1032c0 con 0x7f92fc101de0 2024-09-12T01:26:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.861+0000 7f92ef7fe640 1 -- 172.21.15.81:0/196628069 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f92f0042030 con 0x7f92fc101de0 2024-09-12T01:26:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.861+0000 7f92ef7fe640 1 --2- 172.21.15.81:0/196628069 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f92e80a2b80 0x7f92e80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.861+0000 7f9301c9d640 1 --2- 172.21.15.81:0/196628069 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f92e80a2b80 0x7f92e80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.861+0000 7f92ef7fe640 1 -- 172.21.15.81:0/196628069 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f92f00ef850 con 0x7f92fc101de0 2024-09-12T01:26:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.862+0000 7f9301c9d640 1 --2- 172.21.15.81:0/196628069 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f92e80a2b80 0x7f92e80a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92f8005fd0 tx=0x7f92f8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:23.864+0000 7f92ef7fe640 1 -- 172.21.15.81:0/196628069 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f92f00bc9c0 con 0x7f92fc101de0 2024-09-12T01:26:24.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.067+0000 7f9304702640 1 -- 172.21.15.81:0/196628069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f92fc1021c0 con 0x7f92fc101de0 2024-09-12T01:26:24.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.248+0000 7f92ef7fe640 1 -- 172.21.15.81:0/196628069 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f92fc1021c0 con 0x7f92fc101de0 2024-09-12T01:26:24.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.250+0000 7f9304702640 1 -- 172.21.15.81:0/196628069 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f92e80a2b80 msgr2=0x7f92e80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:24.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.250+0000 7f9304702640 1 --2- 172.21.15.81:0/196628069 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f92e80a2b80 0x7f92e80a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f92f8005fd0 tx=0x7f92f8005850 comp rx=0 tx=0).stop 2024-09-12T01:26:24.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.250+0000 7f9304702640 1 -- 172.21.15.81:0/196628069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92fc101de0 msgr2=0x7f92fc198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:24.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.250+0000 7f9304702640 1 --2- 172.21.15.81:0/196628069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92fc101de0 0x7f92fc198490 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f92f0006010 tx=0x7f92f00042f0 comp rx=0 tx=0).stop 2024-09-12T01:26:24.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.250+0000 7f9304702640 1 -- 172.21.15.81:0/196628069 shutdown_connections 2024-09-12T01:26:24.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.250+0000 7f9304702640 1 --2- 172.21.15.81:0/196628069 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f92e80a2b80 0x7f92e80a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:24.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.250+0000 7f9304702640 1 --2- 172.21.15.81:0/196628069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92fc106f10 0x7f92fc19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:24.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.250+0000 7f9304702640 1 --2- 172.21.15.81:0/196628069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92fc102790 0x7f92fc1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:24.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.250+0000 7f9304702640 1 --2- 172.21.15.81:0/196628069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92fc101de0 0x7f92fc198490 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:24.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.250+0000 7f9304702640 1 -- 172.21.15.81:0/196628069 >> 172.21.15.81:0/196628069 conn(0x7f92fc0fd8c0 msgr2=0x7f92fc0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:24.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.250+0000 7f9304702640 1 -- 172.21.15.81:0/196628069 shutdown_connections 2024-09-12T01:26:24.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:24.250+0000 7f9304702640 1 -- 172.21.15.81:0/196628069 wait complete. 2024-09-12T01:26:24.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] up:active 2024-09-12T01:26:24.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T01:26:24.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T01:26:24.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T01:26:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T01:26:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/196628069' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T01:26:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/196628069' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T01:26:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] up:active 2024-09-12T01:26:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T01:26:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:26:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=k=up:creating} 3 up:standby-replay 5 up:standby 2024-09-12T01:26:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-09-12T01:26:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-12T01:26:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-12T01:26:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-12T01:26:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-12T01:26:24.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-12T01:26:24.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-12T01:26:24.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T01:26:24.740 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:24 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-09-12T01:26:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] up:active 2024-09-12T01:26:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T01:26:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T01:26:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T01:26:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T01:26:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/196628069' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T01:26:24.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/196628069' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T01:26:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] up:active 2024-09-12T01:26:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T01:26:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:26:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=k=up:creating} 3 up:standby-replay 5 up:standby 2024-09-12T01:26:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-09-12T01:26:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-12T01:26:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-12T01:26:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-12T01:26:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-12T01:26:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-12T01:26:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-12T01:26:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T01:26:24.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:24 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-09-12T01:26:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] up:active 2024-09-12T01:26:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T01:26:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T01:26:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T01:26:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T01:26:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/196628069' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T01:26:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/196628069' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T01:26:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] up:active 2024-09-12T01:26:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T01:26:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:26:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=k=up:creating} 3 up:standby-replay 5 up:standby 2024-09-12T01:26:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-09-12T01:26:24.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-12T01:26:24.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-12T01:26:24.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-12T01:26:24.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-12T01:26:24.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-12T01:26:24.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-12T01:26:24.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T01:26:24.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:24 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-09-12T01:26:24.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T01:26:25.236 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:25.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.685+0000 7f1db9806640 1 -- 172.21.15.81:0/256560083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db4102790 msgr2=0x7f1db41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:25.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.685+0000 7f1db9806640 1 --2- 172.21.15.81:0/256560083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db4102790 0x7f1db41067e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1da8009900 tx=0x7f1da802a410 comp rx=0 tx=0).stop 2024-09-12T01:26:25.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.685+0000 7f1db9806640 1 -- 172.21.15.81:0/256560083 shutdown_connections 2024-09-12T01:26:25.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.685+0000 7f1db9806640 1 --2- 172.21.15.81:0/256560083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1db4106f10 0x7f1db410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:25.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.685+0000 7f1db9806640 1 --2- 172.21.15.81:0/256560083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db4102790 0x7f1db41067e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:25.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.685+0000 7f1db9806640 1 --2- 172.21.15.81:0/256560083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1db4101de0 0x7f1db41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:25.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.685+0000 7f1db9806640 1 -- 172.21.15.81:0/256560083 >> 172.21.15.81:0/256560083 conn(0x7f1db40fd8c0 msgr2=0x7f1db40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:25.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.685+0000 7f1db9806640 1 -- 172.21.15.81:0/256560083 shutdown_connections 2024-09-12T01:26:25.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.685+0000 7f1db9806640 1 -- 172.21.15.81:0/256560083 wait complete. 2024-09-12T01:26:25.686 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-12T01:26:25.686 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-12T01:26:25.686 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-12T01:26:25.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-12T01:26:25.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-12T01:26:25.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-12T01:26:25.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-12T01:26:25.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T01:26:25.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-12T01:26:25.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T01:26:25.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] up:active 2024-09-12T01:26:25.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T01:26:25.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T01:26:25.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: Cluster is now healthy 2024-09-12T01:26:25.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=k=up:active} 3 up:standby-replay 5 up:standby 2024-09-12T01:26:25.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:25 smithi081 ceph-mon[30920]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-09-12T01:26:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.686+0000 7f1db9806640 1 Processor -- start 2024-09-12T01:26:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.686+0000 7f1db9806640 1 -- start start 2024-09-12T01:26:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db9806640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1db4101de0 0x7f1db4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db9806640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1db4102790 0x7f1db4198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db9806640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db4106f10 0x7f1db419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db9806640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1db4111f30 con 0x7f1db4106f10 2024-09-12T01:26:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db9806640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1db4111db0 con 0x7f1db4102790 2024-09-12T01:26:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db9806640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1db41120b0 con 0x7f1db4101de0 2024-09-12T01:26:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db4106f10 0x7f1db419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db4106f10 0x7f1db419cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35068/0 (socket says 172.21.15.81:35068) 2024-09-12T01:26:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db37fe640 1 -- 172.21.15.81:0/1334760400 learned_addr learned my addr 172.21.15.81:0/1334760400 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db27fc640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1db4102790 0x7f1db4198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db2ffd640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1db4101de0 0x7f1db4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db37fe640 1 -- 172.21.15.81:0/1334760400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1db4101de0 msgr2=0x7f1db4198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db37fe640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1db4101de0 0x7f1db4198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db37fe640 1 -- 172.21.15.81:0/1334760400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1db4102790 msgr2=0x7f1db4198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db37fe640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1db4102790 0x7f1db4198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.687+0000 7f1db37fe640 1 -- 172.21.15.81:0/1334760400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db419d3c0 con 0x7f1db4106f10 2024-09-12T01:26:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.688+0000 7f1db37fe640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db4106f10 0x7f1db419cce0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00cad0 tx=0x7f1dac00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.688+0000 7f1db8804640 1 -- 172.21.15.81:0/1334760400 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00ad60 con 0x7f1db4106f10 2024-09-12T01:26:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.688+0000 7f1db9806640 1 -- 172.21.15.81:0/1334760400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1db419d6b0 con 0x7f1db4106f10 2024-09-12T01:26:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.688+0000 7f1db8804640 1 -- 172.21.15.81:0/1334760400 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dac005020 con 0x7f1db4106f10 2024-09-12T01:26:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.688+0000 7f1db8804640 1 -- 172.21.15.81:0/1334760400 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00f6b0 con 0x7f1db4106f10 2024-09-12T01:26:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.688+0000 7f1db9806640 1 -- 172.21.15.81:0/1334760400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1db41a4f90 con 0x7f1db4106f10 2024-09-12T01:26:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.690+0000 7f1db9806640 1 -- 172.21.15.81:0/1334760400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1db41021c0 con 0x7f1db4106f10 2024-09-12T01:26:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.690+0000 7f1db8804640 1 -- 172.21.15.81:0/1334760400 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1dac00f850 con 0x7f1db4106f10 2024-09-12T01:26:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.691+0000 7f1db8804640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1d9c0a2b80 0x7f1d9c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.691+0000 7f1db2ffd640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1d9c0a2b80 0x7f1d9c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.691+0000 7f1db8804640 1 -- 172.21.15.81:0/1334760400 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f1dac0cefe0 con 0x7f1db4106f10 2024-09-12T01:26:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.692+0000 7f1db2ffd640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1d9c0a2b80 0x7f1d9c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1da400abe0 tx=0x7f1da400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:25.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.695+0000 7f1db8804640 1 -- 172.21.15.81:0/1334760400 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1dac014030 con 0x7f1db4106f10 2024-09-12T01:26:25.769 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b[65607]: 2024-09-12T01:26:25.489+0000 7fe77b9bc640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-12T01:26:25.769 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b[65607]: 2024-09-12T01:26:25.489+0000 7fe77b9bc640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-12T01:26:25.769 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b[65607]: 2024-09-12T01:26:25.489+0000 7fe77b9bc640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-12T01:26:25.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-12T01:26:25.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-12T01:26:25.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-12T01:26:25.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-12T01:26:25.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-12T01:26:25.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-12T01:26:25.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-12T01:26:25.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T01:26:25.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-12T01:26:25.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T01:26:25.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] up:active 2024-09-12T01:26:25.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T01:26:25.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T01:26:25.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: Cluster is now healthy 2024-09-12T01:26:25.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=k=up:active} 3 up:standby-replay 5 up:standby 2024-09-12T01:26:25.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:25 smithi100 ceph-mon[35275]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-09-12T01:26:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-12T01:26:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-12T01:26:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-12T01:26:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-12T01:26:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-12T01:26:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-12T01:26:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-12T01:26:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T01:26:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-12T01:26:25.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T01:26:25.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] up:active 2024-09-12T01:26:25.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T01:26:25.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T01:26:25.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: Cluster is now healthy 2024-09-12T01:26:25.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=k=up:active} 3 up:standby-replay 5 up:standby 2024-09-12T01:26:25.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:25 smithi189 ceph-mon[35357]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-09-12T01:26:25.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:25.897+0000 7f1db9806640 1 -- 172.21.15.81:0/1334760400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f1db410a0f0 con 0x7f1db4106f10 2024-09-12T01:26:26.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:26.477+0000 7f1db8804640 1 -- 172.21.15.81:0/1334760400 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f1dac09bf50 con 0x7f1db4106f10 2024-09-12T01:26:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:26.479+0000 7f1db9806640 1 -- 172.21.15.81:0/1334760400 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1d9c0a2b80 msgr2=0x7f1d9c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:26.479+0000 7f1db9806640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1d9c0a2b80 0x7f1d9c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1da400abe0 tx=0x7f1da400a2d0 comp rx=0 tx=0).stop 2024-09-12T01:26:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:26.479+0000 7f1db9806640 1 -- 172.21.15.81:0/1334760400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db4106f10 msgr2=0x7f1db419cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:26.479+0000 7f1db9806640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db4106f10 0x7f1db419cce0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00cad0 tx=0x7f1dac00ced0 comp rx=0 tx=0).stop 2024-09-12T01:26:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:26.479+0000 7f1db9806640 1 -- 172.21.15.81:0/1334760400 shutdown_connections 2024-09-12T01:26:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:26.479+0000 7f1db9806640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f1d9c0a2b80 0x7f1d9c0a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:26.479+0000 7f1db9806640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1db4106f10 0x7f1db419cce0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:26.479+0000 7f1db9806640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1db4102790 0x7f1db4198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:26.479+0000 7f1db9806640 1 --2- 172.21.15.81:0/1334760400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1db4101de0 0x7f1db4198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:26.479+0000 7f1db9806640 1 -- 172.21.15.81:0/1334760400 >> 172.21.15.81:0/1334760400 conn(0x7f1db40fd8c0 msgr2=0x7f1db40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:26.480+0000 7f1db9806640 1 -- 172.21.15.81:0/1334760400 shutdown_connections 2024-09-12T01:26:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:26.480+0000 7f1db9806640 1 -- 172.21.15.81:0/1334760400 wait complete. 2024-09-12T01:26:26.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:26 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1334760400' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:26:26.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:26 smithi081 ceph-mon[30920]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T01:26:26.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:26 smithi081 ceph-mon[30920]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-09-12T01:26:26.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:26 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1334760400' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:26:26.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:26 smithi100 ceph-mon[35275]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T01:26:26.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:26 smithi100 ceph-mon[35275]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-09-12T01:26:26.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:26 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1334760400' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:26:26.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:26 smithi189 ceph-mon[35357]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T01:26:26.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:26 smithi189 ceph-mon[35357]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-09-12T01:26:27.049 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-12T01:26:27.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T01:26:27.294 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:27.667 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:27 smithi081 ceph-mon[30920]: pgmap v283: 97 pgs: 4 peering, 93 active+clean; 583 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.5 KiB/s wr, 15 op/s 2024-09-12T01:26:27.667 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:27 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1334760400' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T01:26:27.667 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:27 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] up:active 2024-09-12T01:26:27.667 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:27 smithi081 ceph-mon[30920]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-09-12T01:26:27.667 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:27 smithi081 ceph-mon[30920]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:26:27.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:27 smithi100 ceph-mon[35275]: pgmap v283: 97 pgs: 4 peering, 93 active+clean; 583 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.5 KiB/s wr, 15 op/s 2024-09-12T01:26:27.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:27 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1334760400' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T01:26:27.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:27 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] up:active 2024-09-12T01:26:27.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:27 smithi100 ceph-mon[35275]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-09-12T01:26:27.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:27 smithi100 ceph-mon[35275]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:26:27.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.748+0000 7f265836d640 1 -- 172.21.15.81:0/2965576049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650100e20 msgr2=0x7f2650101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:27.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.748+0000 7f265836d640 1 --2- 172.21.15.81:0/2965576049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650100e20 0x7f2650101200 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f264c009900 tx=0x7f264c02a480 comp rx=0 tx=0).stop 2024-09-12T01:26:27.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 -- 172.21.15.81:0/2965576049 shutdown_connections 2024-09-12T01:26:27.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 --2- 172.21.15.81:0/2965576049 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2650102ef0 0x7f265010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:27.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 --2- 172.21.15.81:0/2965576049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2650102570 0x7f26501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:27.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 --2- 172.21.15.81:0/2965576049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650100e20 0x7f2650101200 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:27.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 -- 172.21.15.81:0/2965576049 >> 172.21.15.81:0/2965576049 conn(0x7f26500fc7d0 msgr2=0x7f26500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:27.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 -- 172.21.15.81:0/2965576049 shutdown_connections 2024-09-12T01:26:27.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 -- 172.21.15.81:0/2965576049 wait complete. 2024-09-12T01:26:27.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 Processor -- start 2024-09-12T01:26:27.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 -- start start 2024-09-12T01:26:27.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2650100e20 0x7f26501973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:27.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102570 0x7f2650197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:27.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2650102ef0 0x7f265019bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:27.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2650110fa0 con 0x7f2650102570 2024-09-12T01:26:27.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2650110e20 con 0x7f2650100e20 2024-09-12T01:26:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f265836d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2650111120 con 0x7f2650102ef0 2024-09-12T01:26:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.749+0000 7f2655908640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102570 0x7f2650197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f2655908640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102570 0x7f2650197900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35088/0 (socket says 172.21.15.81:35088) 2024-09-12T01:26:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f2655908640 1 -- 172.21.15.81:0/4243636765 learned_addr learned my addr 172.21.15.81:0/4243636765 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f2656109640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2650100e20 0x7f26501973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f2655908640 1 -- 172.21.15.81:0/4243636765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2650102ef0 msgr2=0x7f265019bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f2655908640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2650102ef0 0x7f265019bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f2655908640 1 -- 172.21.15.81:0/4243636765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2650100e20 msgr2=0x7f26501973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f2655908640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2650100e20 0x7f26501973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:27.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f2655908640 1 -- 172.21.15.81:0/4243636765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265019c370 con 0x7f2650102570 2024-09-12T01:26:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f2656109640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2650100e20 0x7f26501973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f2655908640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102570 0x7f2650197900 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f264400c920 tx=0x7f264400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f26437fe640 1 -- 172.21.15.81:0/4243636765 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2644007c70 con 0x7f2650102570 2024-09-12T01:26:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f26437fe640 1 -- 172.21.15.81:0/4243636765 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2644007e10 con 0x7f2650102570 2024-09-12T01:26:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f265836d640 1 -- 172.21.15.81:0/4243636765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f265019c660 con 0x7f2650102570 2024-09-12T01:26:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f26437fe640 1 -- 172.21.15.81:0/4243636765 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2644018890 con 0x7f2650102570 2024-09-12T01:26:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.750+0000 7f265836d640 1 -- 172.21.15.81:0/4243636765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26501a3f40 con 0x7f2650102570 2024-09-12T01:26:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.751+0000 7f265836d640 1 -- 172.21.15.81:0/4243636765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2650101200 con 0x7f2650102570 2024-09-12T01:26:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.752+0000 7f26437fe640 1 -- 172.21.15.81:0/4243636765 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2644018a70 con 0x7f2650102570 2024-09-12T01:26:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.753+0000 7f26437fe640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f263c0a2b80 0x7f263c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.753+0000 7f2656109640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f263c0a2b80 0x7f263c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:27.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.753+0000 7f26437fe640 1 -- 172.21.15.81:0/4243636765 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f26440cf230 con 0x7f2650102570 2024-09-12T01:26:27.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.753+0000 7f2656109640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f263c0a2b80 0x7f263c0a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f264c005ab0 tx=0x7f264c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:27.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.757+0000 7f26437fe640 1 -- 172.21.15.81:0/4243636765 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2644014030 con 0x7f2650102570 2024-09-12T01:26:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:27 smithi189 ceph-mon[35357]: pgmap v283: 97 pgs: 4 peering, 93 active+clean; 583 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.5 KiB/s wr, 15 op/s 2024-09-12T01:26:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:27 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1334760400' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T01:26:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:27 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] up:active 2024-09-12T01:26:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:27 smithi189 ceph-mon[35357]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-09-12T01:26:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:27 smithi189 ceph-mon[35357]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:26:27.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.947+0000 7f265836d640 1 -- 172.21.15.81:0/4243636765 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2650106f50 con 0x7f263c0a2b80 2024-09-12T01:26:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.971+0000 7f26437fe640 1 -- 172.21.15.81:0/4243636765 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2650106f50 con 0x7f263c0a2b80 2024-09-12T01:26:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.973+0000 7f265836d640 1 -- 172.21.15.81:0/4243636765 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f263c0a2b80 msgr2=0x7f263c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.973+0000 7f265836d640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f263c0a2b80 0x7f263c0a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f264c005ab0 tx=0x7f264c005a20 comp rx=0 tx=0).stop 2024-09-12T01:26:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.973+0000 7f265836d640 1 -- 172.21.15.81:0/4243636765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102570 msgr2=0x7f2650197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.973+0000 7f265836d640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102570 0x7f2650197900 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f264400c920 tx=0x7f264400cde0 comp rx=0 tx=0).stop 2024-09-12T01:26:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.973+0000 7f265836d640 1 -- 172.21.15.81:0/4243636765 shutdown_connections 2024-09-12T01:26:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.973+0000 7f265836d640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f263c0a2b80 0x7f263c0a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.973+0000 7f265836d640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2650102ef0 0x7f265019bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.973+0000 7f265836d640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102570 0x7f2650197900 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.973+0000 7f265836d640 1 --2- 172.21.15.81:0/4243636765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2650100e20 0x7f26501973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.973+0000 7f265836d640 1 -- 172.21.15.81:0/4243636765 >> 172.21.15.81:0/4243636765 conn(0x7f26500fc7d0 msgr2=0x7f2650106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.973+0000 7f265836d640 1 -- 172.21.15.81:0/4243636765 shutdown_connections 2024-09-12T01:26:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:27.973+0000 7f265836d640 1 -- 172.21.15.81:0/4243636765 wait complete. 2024-09-12T01:26:28.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:26:27 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:26:27.952+0000 7fb127595640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:26:28.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:26:27 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:26:27.952+0000 7fb127595640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:26:28.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:26:27 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:26:27.952+0000 7fb127595640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:26:28.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:26:27 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:26:27.952+0000 7fb127595640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:26:28.239 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:26:27 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:26:27.952+0000 7fb127595640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:26:28.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T01:26:28.826 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:29.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.293+0000 7fcb82314640 1 -- 172.21.15.81:0/15613495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb7c102d90 msgr2=0x7fcb7c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:29.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.293+0000 7fcb82314640 1 --2- 172.21.15.81:0/15613495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb7c102d90 0x7fcb7c103170 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009930 tx=0x7fcb6c02a420 comp rx=0 tx=0).stop 2024-09-12T01:26:29.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.293+0000 7fcb82314640 1 -- 172.21.15.81:0/15613495 shutdown_connections 2024-09-12T01:26:29.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.293+0000 7fcb82314640 1 --2- 172.21.15.81:0/15613495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb7c108290 0x7fcb7c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:29.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.293+0000 7fcb82314640 1 --2- 172.21.15.81:0/15613495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb7c103740 0x7fcb7c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:29.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.293+0000 7fcb82314640 1 --2- 172.21.15.81:0/15613495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb7c102d90 0x7fcb7c103170 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:29.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.293+0000 7fcb82314640 1 -- 172.21.15.81:0/15613495 >> 172.21.15.81:0/15613495 conn(0x7fcb7c0fc7d0 msgr2=0x7fcb7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:29.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.293+0000 7fcb82314640 1 -- 172.21.15.81:0/15613495 shutdown_connections 2024-09-12T01:26:29.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.293+0000 7fcb82314640 1 -- 172.21.15.81:0/15613495 wait complete. 2024-09-12T01:26:29.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.294+0000 7fcb82314640 1 Processor -- start 2024-09-12T01:26:29.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.294+0000 7fcb82314640 1 -- start start 2024-09-12T01:26:29.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.294+0000 7fcb82314640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb7c102d90 0x7fcb7c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.294+0000 7fcb82314640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb7c103740 0x7fcb7c19ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.294+0000 7fcb82314640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb7c108290 0x7fcb7c19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.294+0000 7fcb82314640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c112090 con 0x7fcb7c108290 2024-09-12T01:26:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.294+0000 7fcb82314640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c111f10 con 0x7fcb7c102d90 2024-09-12T01:26:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.294+0000 7fcb82314640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c112210 con 0x7fcb7c103740 2024-09-12T01:26:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb808b1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb7c108290 0x7fcb7c19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb808b1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb7c108290 0x7fcb7c19f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35126/0 (socket says 172.21.15.81:35126) 2024-09-12T01:26:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb808b1640 1 -- 172.21.15.81:0/2881044799 learned_addr learned my addr 172.21.15.81:0/2881044799 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb7b7fe640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb7c103740 0x7fcb7c19ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb7bfff640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb7c102d90 0x7fcb7c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb808b1640 1 -- 172.21.15.81:0/2881044799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb7c103740 msgr2=0x7fcb7c19ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb808b1640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb7c103740 0x7fcb7c19ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb808b1640 1 -- 172.21.15.81:0/2881044799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb7c102d90 msgr2=0x7fcb7c19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb808b1640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb7c102d90 0x7fcb7c19a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb808b1640 1 -- 172.21.15.81:0/2881044799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c19f700 con 0x7fcb7c108290 2024-09-12T01:26:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb7bfff640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb7c102d90 0x7fcb7c19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb808b1640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb7c108290 0x7fcb7c19f020 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400cad0 tx=0x7fcb7400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb797fa640 1 -- 172.21.15.81:0/2881044799 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7400ae20 con 0x7fcb7c108290 2024-09-12T01:26:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb797fa640 1 -- 172.21.15.81:0/2881044799 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb74005020 con 0x7fcb7c108290 2024-09-12T01:26:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb82314640 1 -- 172.21.15.81:0/2881044799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7c19f9f0 con 0x7fcb7c108290 2024-09-12T01:26:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb797fa640 1 -- 172.21.15.81:0/2881044799 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7400f6f0 con 0x7fcb7c108290 2024-09-12T01:26:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.295+0000 7fcb82314640 1 -- 172.21.15.81:0/2881044799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7c1a72d0 con 0x7fcb7c108290 2024-09-12T01:26:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.296+0000 7fcb82314640 1 -- 172.21.15.81:0/2881044799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7c06a7f0 con 0x7fcb7c108290 2024-09-12T01:26:29.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.297+0000 7fcb797fa640 1 -- 172.21.15.81:0/2881044799 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcb740051d0 con 0x7fcb7c108290 2024-09-12T01:26:29.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.298+0000 7fcb797fa640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcb640a2c10 0x7fcb640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:29.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.298+0000 7fcb7bfff640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcb640a2c10 0x7fcb640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:29.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.298+0000 7fcb797fa640 1 -- 172.21.15.81:0/2881044799 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcb740cf1f0 con 0x7fcb7c108290 2024-09-12T01:26:29.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.298+0000 7fcb7bfff640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcb640a2c10 0x7fcb640a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c000c00 tx=0x7fcb6c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:29.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.302+0000 7fcb797fa640 1 -- 172.21.15.81:0/2881044799 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb74014030 con 0x7fcb7c108290 2024-09-12T01:26:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.496+0000 7fcb82314640 1 -- 172.21.15.81:0/2881044799 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fcb7c062630 con 0x7fcb640a2c10 2024-09-12T01:26:29.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.523+0000 7fcb797fa640 1 -- 172.21.15.81:0/2881044799 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcb7c062630 con 0x7fcb640a2c10 2024-09-12T01:26:29.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.525+0000 7fcb82314640 1 -- 172.21.15.81:0/2881044799 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcb640a2c10 msgr2=0x7fcb640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:29.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.525+0000 7fcb82314640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcb640a2c10 0x7fcb640a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c000c00 tx=0x7fcb6c005a20 comp rx=0 tx=0).stop 2024-09-12T01:26:29.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.525+0000 7fcb82314640 1 -- 172.21.15.81:0/2881044799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb7c108290 msgr2=0x7fcb7c19f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:29.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.525+0000 7fcb82314640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb7c108290 0x7fcb7c19f020 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400cad0 tx=0x7fcb7400cf90 comp rx=0 tx=0).stop 2024-09-12T01:26:29.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.525+0000 7fcb82314640 1 -- 172.21.15.81:0/2881044799 shutdown_connections 2024-09-12T01:26:29.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.525+0000 7fcb82314640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcb640a2c10 0x7fcb640a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:29.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.525+0000 7fcb82314640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb7c108290 0x7fcb7c19f020 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:29.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.525+0000 7fcb82314640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb7c103740 0x7fcb7c19ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:29.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.525+0000 7fcb82314640 1 --2- 172.21.15.81:0/2881044799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb7c102d90 0x7fcb7c19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:29.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.525+0000 7fcb82314640 1 -- 172.21.15.81:0/2881044799 >> 172.21.15.81:0/2881044799 conn(0x7fcb7c0fc7d0 msgr2=0x7fcb7c100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:29.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.525+0000 7fcb82314640 1 -- 172.21.15.81:0/2881044799 shutdown_connections 2024-09-12T01:26:29.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:29.525+0000 7fcb82314640 1 -- 172.21.15.81:0/2881044799 wait complete. 2024-09-12T01:26:29.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:29 smithi100 ceph-mon[35275]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:29 smithi100 ceph-mon[35275]: pgmap v284: 97 pgs: 4 peering, 93 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.0 KiB/s wr, 23 op/s; 2 B/s, 0 objects/s recovering 2024-09-12T01:26:29.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:29 smithi100 ceph-mon[35275]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T01:26:29.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:29 smithi189 ceph-mon[35357]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:29.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:29 smithi189 ceph-mon[35357]: pgmap v284: 97 pgs: 4 peering, 93 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.0 KiB/s wr, 23 op/s; 2 B/s, 0 objects/s recovering 2024-09-12T01:26:29.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:29 smithi189 ceph-mon[35357]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T01:26:29.983 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:29 smithi081 ceph-mon[30920]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:29.983 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:29 smithi081 ceph-mon[30920]: pgmap v284: 97 pgs: 4 peering, 93 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.0 KiB/s wr, 23 op/s; 2 B/s, 0 objects/s recovering 2024-09-12T01:26:29.984 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:29 smithi081 ceph-mon[30920]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T01:26:30.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T01:26:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:30.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:30 smithi100 ceph-mon[35275]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:30.769 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:26:30 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b[65607]: 2024-09-12T01:26:30.489+0000 7fe77b9bc640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-12T01:26:30.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:30 smithi189 ceph-mon[35357]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:30.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:30 smithi081 ceph-mon[30920]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:30.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.925+0000 7f57023cd640 1 -- 172.21.15.81:0/3983703899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56fc100e20 msgr2=0x7f56fc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:30.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.925+0000 7f57023cd640 1 --2- 172.21.15.81:0/3983703899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56fc100e20 0x7f56fc101200 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009900 tx=0x7f56ec02a480 comp rx=0 tx=0).stop 2024-09-12T01:26:30.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.925+0000 7f57023cd640 1 -- 172.21.15.81:0/3983703899 shutdown_connections 2024-09-12T01:26:30.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.925+0000 7f57023cd640 1 --2- 172.21.15.81:0/3983703899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56fc102ef0 0x7f56fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.925+0000 7f57023cd640 1 --2- 172.21.15.81:0/3983703899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56fc102570 0x7f56fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.925+0000 7f57023cd640 1 --2- 172.21.15.81:0/3983703899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56fc100e20 0x7f56fc101200 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.925+0000 7f57023cd640 1 -- 172.21.15.81:0/3983703899 >> 172.21.15.81:0/3983703899 conn(0x7f56fc0fc7d0 msgr2=0x7f56fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.925+0000 7f57023cd640 1 -- 172.21.15.81:0/3983703899 shutdown_connections 2024-09-12T01:26:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.925+0000 7f57023cd640 1 -- 172.21.15.81:0/3983703899 wait complete. 2024-09-12T01:26:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f57023cd640 1 Processor -- start 2024-09-12T01:26:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f57023cd640 1 -- start start 2024-09-12T01:26:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f57023cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56fc100e20 0x7f56fc1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f57023cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56fc102570 0x7f56fc198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:30.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f57023cd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56fc102ef0 0x7f56fc19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f57023cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc110f50 con 0x7f56fc102570 2024-09-12T01:26:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f57023cd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc110dd0 con 0x7f56fc100e20 2024-09-12T01:26:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f57023cd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc1110d0 con 0x7f56fc102ef0 2024-09-12T01:26:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f56fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56fc102570 0x7f56fc198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f56fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56fc102570 0x7f56fc198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35156/0 (socket says 172.21.15.81:35156) 2024-09-12T01:26:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f56fb7fe640 1 -- 172.21.15.81:0/190401343 learned_addr learned my addr 172.21.15.81:0/190401343 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f56fbfff640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56fc100e20 0x7f56fc1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f570096a640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56fc102ef0 0x7f56fc19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f56fb7fe640 1 -- 172.21.15.81:0/190401343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56fc102ef0 msgr2=0x7f56fc19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f56fb7fe640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56fc102ef0 0x7f56fc19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f56fb7fe640 1 -- 172.21.15.81:0/190401343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56fc100e20 msgr2=0x7f56fc1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f56fb7fe640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56fc100e20 0x7f56fc1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f56fb7fe640 1 -- 172.21.15.81:0/190401343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56fc19d480 con 0x7f56fc102570 2024-09-12T01:26:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f56fbfff640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56fc100e20 0x7f56fc1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:26:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.926+0000 7f570096a640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56fc102ef0 0x7f56fc19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:26:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.927+0000 7f56fb7fe640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56fc102570 0x7f56fc198a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f56f000c920 tx=0x7f56f000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.927+0000 7f56f97fa640 1 -- 172.21.15.81:0/190401343 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0007c70 con 0x7f56fc102570 2024-09-12T01:26:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.927+0000 7f56f97fa640 1 -- 172.21.15.81:0/190401343 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56f0007e10 con 0x7f56fc102570 2024-09-12T01:26:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.927+0000 7f57023cd640 1 -- 172.21.15.81:0/190401343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56fc19d770 con 0x7f56fc102570 2024-09-12T01:26:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.927+0000 7f56f97fa640 1 -- 172.21.15.81:0/190401343 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0018890 con 0x7f56fc102570 2024-09-12T01:26:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.927+0000 7f57023cd640 1 -- 172.21.15.81:0/190401343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56fc1a5050 con 0x7f56fc102570 2024-09-12T01:26:30.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.928+0000 7f57023cd640 1 -- 172.21.15.81:0/190401343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56fc101200 con 0x7f56fc102570 2024-09-12T01:26:30.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.929+0000 7f56f97fa640 1 -- 172.21.15.81:0/190401343 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f56f0018b30 con 0x7f56fc102570 2024-09-12T01:26:30.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.930+0000 7f56f97fa640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f56e40a2c10 0x7f56e40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:30.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.930+0000 7f56fbfff640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f56e40a2c10 0x7f56e40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:30.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.930+0000 7f56f97fa640 1 -- 172.21.15.81:0/190401343 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f56f00cf3e0 con 0x7f56fc102570 2024-09-12T01:26:30.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.930+0000 7f56fbfff640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f56e40a2c10 0x7f56e40a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f56ec000c00 tx=0x7f56ec004100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:30.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:30.934+0000 7f56f97fa640 1 -- 172.21.15.81:0/190401343 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f56f0014030 con 0x7f56fc102570 2024-09-12T01:26:31.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.128+0000 7f57023cd640 1 -- 172.21.15.81:0/190401343 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f56fc106f10 con 0x7f56e40a2c10 2024-09-12T01:26:31.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.134+0000 7f56f97fa640 1 -- 172.21.15.81:0/190401343 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f56fc106f10 con 0x7f56e40a2c10 2024-09-12T01:26:31.136 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/qa/sv_0/3f3cc30f-33c8-4565-b1db-236037b9f163 2024-09-12T01:26:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.136+0000 7f57023cd640 1 -- 172.21.15.81:0/190401343 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f56e40a2c10 msgr2=0x7f56e40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.136+0000 7f57023cd640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f56e40a2c10 0x7f56e40a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f56ec000c00 tx=0x7f56ec004100 comp rx=0 tx=0).stop 2024-09-12T01:26:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.136+0000 7f57023cd640 1 -- 172.21.15.81:0/190401343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56fc102570 msgr2=0x7f56fc198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:31.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.136+0000 7f57023cd640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56fc102570 0x7f56fc198a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f56f000c920 tx=0x7f56f000cde0 comp rx=0 tx=0).stop 2024-09-12T01:26:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.136+0000 7f57023cd640 1 -- 172.21.15.81:0/190401343 shutdown_connections 2024-09-12T01:26:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.136+0000 7f57023cd640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f56e40a2c10 0x7f56e40a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.136+0000 7f57023cd640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56fc102ef0 0x7f56fc19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.136+0000 7f57023cd640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56fc102570 0x7f56fc198a10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.136+0000 7f57023cd640 1 --2- 172.21.15.81:0/190401343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56fc100e20 0x7f56fc1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.136+0000 7f57023cd640 1 -- 172.21.15.81:0/190401343 >> 172.21.15.81:0/190401343 conn(0x7f56fc0fc7d0 msgr2=0x7f56fc069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.136+0000 7f57023cd640 1 -- 172.21.15.81:0/190401343 shutdown_connections 2024-09-12T01:26:31.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:31.136+0000 7f57023cd640 1 -- 172.21.15.81:0/190401343 wait complete. 2024-09-12T01:26:31.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:31 smithi100 ceph-mon[35275]: pgmap v285: 97 pgs: 4 peering, 93 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.0 KiB/s wr, 23 op/s; 2 B/s, 0 objects/s recovering 2024-09-12T01:26:31.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:31 smithi189 ceph-mon[35357]: pgmap v285: 97 pgs: 4 peering, 93 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.0 KiB/s wr, 23 op/s; 2 B/s, 0 objects/s recovering 2024-09-12T01:26:31.828 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:31 smithi081 ceph-mon[30920]: pgmap v285: 97 pgs: 4 peering, 93 active+clean; 584 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.0 KiB/s wr, 23 op/s; 2 B/s, 0 objects/s recovering 2024-09-12T01:26:31.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T01:26:32.109 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.610+0000 7fd22084a640 1 -- 172.21.15.81:0/553796249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd21c102ef0 msgr2=0x7fd21c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.610+0000 7fd22084a640 1 --2- 172.21.15.81:0/553796249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd21c102ef0 0x7fd21c10da40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd214009ca0 tx=0x7fd21402a950 comp rx=0 tx=0).stop 2024-09-12T01:26:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.610+0000 7fd22084a640 1 -- 172.21.15.81:0/553796249 shutdown_connections 2024-09-12T01:26:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.610+0000 7fd22084a640 1 --2- 172.21.15.81:0/553796249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd21c102ef0 0x7fd21c10da40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.610+0000 7fd22084a640 1 --2- 172.21.15.81:0/553796249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd21c102570 0x7fd21c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.610+0000 7fd22084a640 1 --2- 172.21.15.81:0/553796249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd21c100e20 0x7fd21c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.610+0000 7fd22084a640 1 -- 172.21.15.81:0/553796249 >> 172.21.15.81:0/553796249 conn(0x7fd21c0fc7d0 msgr2=0x7fd21c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.610+0000 7fd22084a640 1 -- 172.21.15.81:0/553796249 shutdown_connections 2024-09-12T01:26:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.610+0000 7fd22084a640 1 -- 172.21.15.81:0/553796249 wait complete. 2024-09-12T01:26:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.611+0000 7fd22084a640 1 Processor -- start 2024-09-12T01:26:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.611+0000 7fd22084a640 1 -- start start 2024-09-12T01:26:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.611+0000 7fd22084a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd21c100e20 0x7fd21c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.611+0000 7fd22084a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd21c102570 0x7fd21c199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.611+0000 7fd22084a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd21c102ef0 0x7fd21c1a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.611+0000 7fd22084a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c110fa0 con 0x7fd21c100e20 2024-09-12T01:26:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.611+0000 7fd22084a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c110e20 con 0x7fd21c102ef0 2024-09-12T01:26:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.611+0000 7fd22084a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c111120 con 0x7fd21c102570 2024-09-12T01:26:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.611+0000 7fd21a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd21c100e20 0x7fd21c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.611+0000 7fd21a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd21c100e20 0x7fd21c199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51206/0 (socket says 172.21.15.81:51206) 2024-09-12T01:26:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.611+0000 7fd21a59c640 1 -- 172.21.15.81:0/2862975076 learned_addr learned my addr 172.21.15.81:0/2862975076 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd21ad9d640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd21c102ef0 0x7fd21c1a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd219d9b640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd21c102570 0x7fd21c199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd21a59c640 1 -- 172.21.15.81:0/2862975076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd21c102570 msgr2=0x7fd21c199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd21a59c640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd21c102570 0x7fd21c199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd21a59c640 1 -- 172.21.15.81:0/2862975076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd21c102ef0 msgr2=0x7fd21c1a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd21a59c640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd21c102ef0 0x7fd21c1a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd21a59c640 1 -- 172.21.15.81:0/2862975076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c1a48d0 con 0x7fd21c100e20 2024-09-12T01:26:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd219d9b640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd21c102570 0x7fd21c199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:26:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd21a59c640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd21c100e20 0x7fd21c199310 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00b4a0 tx=0x7fd20c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd20b7fe640 1 -- 172.21.15.81:0/2862975076 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c014070 con 0x7fd21c100e20 2024-09-12T01:26:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd22084a640 1 -- 172.21.15.81:0/2862975076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c1a4aa0 con 0x7fd21c100e20 2024-09-12T01:26:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd20b7fe640 1 -- 172.21.15.81:0/2862975076 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd20c010af0 con 0x7fd21c100e20 2024-09-12T01:26:32.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd20b7fe640 1 -- 172.21.15.81:0/2862975076 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c017d10 con 0x7fd21c100e20 2024-09-12T01:26:32.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.612+0000 7fd22084a640 1 -- 172.21.15.81:0/2862975076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c1a4fe0 con 0x7fd21c100e20 2024-09-12T01:26:32.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.613+0000 7fd22084a640 1 -- 172.21.15.81:0/2862975076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c101200 con 0x7fd21c100e20 2024-09-12T01:26:32.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.614+0000 7fd20b7fe640 1 -- 172.21.15.81:0/2862975076 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd20c017070 con 0x7fd21c100e20 2024-09-12T01:26:32.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.615+0000 7fd20b7fe640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fd2040a2c10 0x7fd2040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:32.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.615+0000 7fd219d9b640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fd2040a2c10 0x7fd2040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:32.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.615+0000 7fd20b7fe640 1 -- 172.21.15.81:0/2862975076 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd20c0ce4f0 con 0x7fd21c100e20 2024-09-12T01:26:32.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.615+0000 7fd219d9b640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fd2040a2c10 0x7fd2040a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd21c06ab00 tx=0x7fd210005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:32.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.619+0000 7fd20b7fe640 1 -- 172.21.15.81:0/2862975076 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd20c09b410 con 0x7fd21c100e20 2024-09-12T01:26:32.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:32 smithi100 ceph-mon[35275]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:32.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:32 smithi189 ceph-mon[35357]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.811+0000 7fd22084a640 1 -- 172.21.15.81:0/2862975076 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd21c106f50 con 0x7fd2040a2c10 2024-09-12T01:26:32.812 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:32 smithi081 ceph-mon[30920]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.838+0000 7fd20b7fe640 1 -- 172.21.15.81:0/2862975076 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd21c106f50 con 0x7fd2040a2c10 2024-09-12T01:26:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.840+0000 7fd22084a640 1 -- 172.21.15.81:0/2862975076 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fd2040a2c10 msgr2=0x7fd2040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.840+0000 7fd22084a640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fd2040a2c10 0x7fd2040a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd21c06ab00 tx=0x7fd210005e50 comp rx=0 tx=0).stop 2024-09-12T01:26:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.840+0000 7fd22084a640 1 -- 172.21.15.81:0/2862975076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd21c100e20 msgr2=0x7fd21c199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.840+0000 7fd22084a640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd21c100e20 0x7fd21c199310 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00b4a0 tx=0x7fd20c00b960 comp rx=0 tx=0).stop 2024-09-12T01:26:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.840+0000 7fd22084a640 1 -- 172.21.15.81:0/2862975076 shutdown_connections 2024-09-12T01:26:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.840+0000 7fd22084a640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fd2040a2c10 0x7fd2040a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.840+0000 7fd22084a640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd21c102ef0 0x7fd21c1a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.840+0000 7fd22084a640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd21c102570 0x7fd21c199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.840+0000 7fd22084a640 1 --2- 172.21.15.81:0/2862975076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd21c100e20 0x7fd21c199310 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.840+0000 7fd22084a640 1 -- 172.21.15.81:0/2862975076 >> 172.21.15.81:0/2862975076 conn(0x7fd21c0fc7d0 msgr2=0x7fd21c106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.840+0000 7fd22084a640 1 -- 172.21.15.81:0/2862975076 shutdown_connections 2024-09-12T01:26:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:32.840+0000 7fd22084a640 1 -- 172.21.15.81:0/2862975076 wait complete. 2024-09-12T01:26:33.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T01:26:33.512 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:33 smithi081 ceph-mon[30920]: pgmap v286: 97 pgs: 97 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.9 KiB/s wr, 33 op/s; 2 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T01:26:33.734 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:33.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:33 smithi100 ceph-mon[35275]: pgmap v286: 97 pgs: 97 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.9 KiB/s wr, 33 op/s; 2 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T01:26:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:33 smithi189 ceph-mon[35357]: pgmap v286: 97 pgs: 97 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.9 KiB/s wr, 33 op/s; 2 B/s, 1 keys/s, 1 objects/s recovering 2024-09-12T01:26:34.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.190+0000 7fef884ad640 1 -- 172.21.15.81:0/3496660038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef80101420 msgr2=0x7fef8010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.190+0000 7fef884ad640 1 --2- 172.21.15.81:0/3496660038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef80101420 0x7fef8010d950 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fef78009cd0 tx=0x7fef7802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:26:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.190+0000 7fef884ad640 1 -- 172.21.15.81:0/3496660038 shutdown_connections 2024-09-12T01:26:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.190+0000 7fef884ad640 1 --2- 172.21.15.81:0/3496660038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef80101420 0x7fef8010d950 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.190+0000 7fef884ad640 1 --2- 172.21.15.81:0/3496660038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef80100a80 0x7fef80100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.190+0000 7fef884ad640 1 --2- 172.21.15.81:0/3496660038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef80106a80 0x7fef80106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.190+0000 7fef884ad640 1 -- 172.21.15.81:0/3496660038 >> 172.21.15.81:0/3496660038 conn(0x7fef800fc7a0 msgr2=0x7fef800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.190+0000 7fef884ad640 1 -- 172.21.15.81:0/3496660038 shutdown_connections 2024-09-12T01:26:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.190+0000 7fef884ad640 1 -- 172.21.15.81:0/3496660038 wait complete. 2024-09-12T01:26:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef884ad640 1 Processor -- start 2024-09-12T01:26:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef884ad640 1 -- start start 2024-09-12T01:26:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef884ad640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef80100a80 0x7fef80197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:34.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef884ad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef80101420 0x7fef80197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef884ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef80106a80 0x7fef8019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef884ad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fef80110e80 con 0x7fef80106a80 2024-09-12T01:26:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef884ad640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fef80110d00 con 0x7fef80101420 2024-09-12T01:26:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef884ad640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef80111000 con 0x7fef80100a80 2024-09-12T01:26:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef86a4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef80106a80 0x7fef8019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef86a4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef80106a80 0x7fef8019bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51218/0 (socket says 172.21.15.81:51218) 2024-09-12T01:26:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef86a4a640 1 -- 172.21.15.81:0/2808540503 learned_addr learned my addr 172.21.15.81:0/2808540503 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef86249640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef80100a80 0x7fef80197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef85a48640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef80101420 0x7fef80197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef86a4a640 1 -- 172.21.15.81:0/2808540503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef80100a80 msgr2=0x7fef80197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef86a4a640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef80100a80 0x7fef80197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef86a4a640 1 -- 172.21.15.81:0/2808540503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef80101420 msgr2=0x7fef80197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:34.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef86a4a640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef80101420 0x7fef80197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:34.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.191+0000 7fef86a4a640 1 -- 172.21.15.81:0/2808540503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8019c2b0 con 0x7fef80106a80 2024-09-12T01:26:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.192+0000 7fef86a4a640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef80106a80 0x7fef8019bbd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fef78005cc0 tx=0x7fef78032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.192+0000 7fef737fe640 1 -- 172.21.15.81:0/2808540503 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef78004040 con 0x7fef80106a80 2024-09-12T01:26:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.192+0000 7fef884ad640 1 -- 172.21.15.81:0/2808540503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8019c540 con 0x7fef80106a80 2024-09-12T01:26:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.192+0000 7fef737fe640 1 -- 172.21.15.81:0/2808540503 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef780046c0 con 0x7fef80106a80 2024-09-12T01:26:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.192+0000 7fef737fe640 1 -- 172.21.15.81:0/2808540503 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef78030e00 con 0x7fef80106a80 2024-09-12T01:26:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.192+0000 7fef884ad640 1 -- 172.21.15.81:0/2808540503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef801a3e80 con 0x7fef80106a80 2024-09-12T01:26:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.193+0000 7fef884ad640 1 -- 172.21.15.81:0/2808540503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef80100ee0 con 0x7fef80106a80 2024-09-12T01:26:34.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.194+0000 7fef737fe640 1 -- 172.21.15.81:0/2808540503 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fef780305a0 con 0x7fef80106a80 2024-09-12T01:26:34.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.195+0000 7fef737fe640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fef6c0a2c10 0x7fef6c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:34.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.195+0000 7fef86249640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fef6c0a2c10 0x7fef6c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:34.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.195+0000 7fef737fe640 1 -- 172.21.15.81:0/2808540503 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fef7802e030 con 0x7fef80106a80 2024-09-12T01:26:34.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.195+0000 7fef86249640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fef6c0a2c10 0x7fef6c0a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fef74009b50 tx=0x7fef74005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.199+0000 7fef737fe640 1 -- 172.21.15.81:0/2808540503 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef7804b060 con 0x7fef80106a80 2024-09-12T01:26:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.392+0000 7fef884ad640 1 -- 172.21.15.81:0/2808540503 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fef80062630 con 0x7fef6c0a2c10 2024-09-12T01:26:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.397+0000 7fef737fe640 1 -- 172.21.15.81:0/2808540503 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fef80062630 con 0x7fef6c0a2c10 2024-09-12T01:26:34.397 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/qa/sv_1/49c92736-5bb8-485f-a741-b07875337467 2024-09-12T01:26:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.399+0000 7fef884ad640 1 -- 172.21.15.81:0/2808540503 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fef6c0a2c10 msgr2=0x7fef6c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.399+0000 7fef884ad640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fef6c0a2c10 0x7fef6c0a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fef74009b50 tx=0x7fef74005f90 comp rx=0 tx=0).stop 2024-09-12T01:26:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.399+0000 7fef884ad640 1 -- 172.21.15.81:0/2808540503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef80106a80 msgr2=0x7fef8019bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.399+0000 7fef884ad640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef80106a80 0x7fef8019bbd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fef78005cc0 tx=0x7fef78032f40 comp rx=0 tx=0).stop 2024-09-12T01:26:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.399+0000 7fef884ad640 1 -- 172.21.15.81:0/2808540503 shutdown_connections 2024-09-12T01:26:34.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.399+0000 7fef884ad640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fef6c0a2c10 0x7fef6c0a50d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:34.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.399+0000 7fef884ad640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef80106a80 0x7fef8019bbd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:34.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.399+0000 7fef884ad640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef80101420 0x7fef80197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:34.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.399+0000 7fef884ad640 1 --2- 172.21.15.81:0/2808540503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef80100a80 0x7fef80197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:34.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.399+0000 7fef884ad640 1 -- 172.21.15.81:0/2808540503 >> 172.21.15.81:0/2808540503 conn(0x7fef800fc7a0 msgr2=0x7fef800fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:34.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.399+0000 7fef884ad640 1 -- 172.21.15.81:0/2808540503 shutdown_connections 2024-09-12T01:26:34.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:34.399+0000 7fef884ad640 1 -- 172.21.15.81:0/2808540503 wait complete. 2024-09-12T01:26:34.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:34 smithi081 ceph-mon[30920]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:34.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:34 smithi100 ceph-mon[35275]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:34.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:34 smithi189 ceph-mon[35357]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:35.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:26:35.355 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:35 smithi081 ceph-mon[30920]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:35 smithi081 ceph-mon[30920]: pgmap v287: 97 pgs: 97 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.6 KiB/s wr, 29 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T01:26:35.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:35 smithi100 ceph-mon[35275]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:35.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:35 smithi100 ceph-mon[35275]: pgmap v287: 97 pgs: 97 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.6 KiB/s wr, 29 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T01:26:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:35 smithi189 ceph-mon[35357]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:26:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:35 smithi189 ceph-mon[35357]: pgmap v287: 97 pgs: 97 active+clean; 610 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.6 KiB/s wr, 29 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T01:26:35.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.825+0000 7f542b92c640 1 -- 172.21.15.81:0/957976214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5424100e20 msgr2=0x7f5424101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:35.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.825+0000 7f542b92c640 1 --2- 172.21.15.81:0/957976214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5424100e20 0x7f5424101200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5414009900 tx=0x7f541402a480 comp rx=0 tx=0).stop 2024-09-12T01:26:35.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.825+0000 7f542b92c640 1 -- 172.21.15.81:0/957976214 shutdown_connections 2024-09-12T01:26:35.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.825+0000 7f542b92c640 1 --2- 172.21.15.81:0/957976214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5424102ef0 0x7f542410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:35.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.825+0000 7f542b92c640 1 --2- 172.21.15.81:0/957976214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5424102570 0x7f54241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:35.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.825+0000 7f542b92c640 1 --2- 172.21.15.81:0/957976214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5424100e20 0x7f5424101200 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:35.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.825+0000 7f542b92c640 1 -- 172.21.15.81:0/957976214 >> 172.21.15.81:0/957976214 conn(0x7f54240fc7d0 msgr2=0x7f54240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:35.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.825+0000 7f542b92c640 1 -- 172.21.15.81:0/957976214 shutdown_connections 2024-09-12T01:26:35.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.825+0000 7f542b92c640 1 -- 172.21.15.81:0/957976214 wait complete. 2024-09-12T01:26:35.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.825+0000 7f542b92c640 1 Processor -- start 2024-09-12T01:26:35.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.825+0000 7f542b92c640 1 -- start start 2024-09-12T01:26:35.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f542b92c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5424100e20 0x7f54241984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:35.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f542b92c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5424102570 0x7f54241989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:35.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f542b92c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5424102ef0 0x7f542419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:35.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f542b92c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f54241120a0 con 0x7f5424100e20 2024-09-12T01:26:35.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f542b92c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5424111f20 con 0x7f5424102570 2024-09-12T01:26:35.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f542b92c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5424112220 con 0x7f5424102ef0 2024-09-12T01:26:35.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f54296c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5424100e20 0x7f54241984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:35.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f54296c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5424100e20 0x7f54241984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51238/0 (socket says 172.21.15.81:51238) 2024-09-12T01:26:35.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f54296c8640 1 -- 172.21.15.81:0/3957266056 learned_addr learned my addr 172.21.15.81:0/3957266056 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:35.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f5428ec7640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5424102570 0x7f54241989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:35.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f5429ec9640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5424102ef0 0x7f542419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:35.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f54296c8640 1 -- 172.21.15.81:0/3957266056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5424102ef0 msgr2=0x7f542419cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:35.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f54296c8640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5424102ef0 0x7f542419cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:35.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f54296c8640 1 -- 172.21.15.81:0/3957266056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5424102570 msgr2=0x7f54241989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:35.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f54296c8640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5424102570 0x7f54241989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:35.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f54296c8640 1 -- 172.21.15.81:0/3957266056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542419d450 con 0x7f5424100e20 2024-09-12T01:26:35.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f54296c8640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5424100e20 0x7f54241984a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5414006010 tx=0x7f5414003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:35.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f541a7fc640 1 -- 172.21.15.81:0/3957266056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541403f070 con 0x7f5424100e20 2024-09-12T01:26:35.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f541a7fc640 1 -- 172.21.15.81:0/3957266056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5414031c30 con 0x7f5424100e20 2024-09-12T01:26:35.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f542b92c640 1 -- 172.21.15.81:0/3957266056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542419d6e0 con 0x7f5424100e20 2024-09-12T01:26:35.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.826+0000 7f541a7fc640 1 -- 172.21.15.81:0/3957266056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414035030 con 0x7f5424100e20 2024-09-12T01:26:35.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.827+0000 7f542b92c640 1 -- 172.21.15.81:0/3957266056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54241a5020 con 0x7f5424100e20 2024-09-12T01:26:35.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.828+0000 7f542b92c640 1 -- 172.21.15.81:0/3957266056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54241021b0 con 0x7f5424100e20 2024-09-12T01:26:35.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.829+0000 7f541a7fc640 1 -- 172.21.15.81:0/3957266056 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5414042070 con 0x7f5424100e20 2024-09-12T01:26:35.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.829+0000 7f541a7fc640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f54100a2c10 0x7f54100a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:35.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.829+0000 7f5428ec7640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f54100a2c10 0x7f54100a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:35.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.829+0000 7f541a7fc640 1 -- 172.21.15.81:0/3957266056 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f54140efa30 con 0x7f5424100e20 2024-09-12T01:26:35.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.830+0000 7f5428ec7640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f54100a2c10 0x7f54100a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f54241072a0 tx=0x7f542000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:35.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:35.834+0000 7f541a7fc640 1 -- 172.21.15.81:0/3957266056 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5414031de0 con 0x7f5424100e20 2024-09-12T01:26:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.032+0000 7f542b92c640 1 -- 172.21.15.81:0/3957266056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5424199830 con 0x7f5424100e20 2024-09-12T01:26:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.033+0000 7f541a7fc640 1 -- 172.21.15.81:0/3957266056 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7f5424199830 con 0x7f5424100e20 2024-09-12T01:26:36.033 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:26:36.034 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-12T01:26:26:481147+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:26:26.481132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24448,24446,24401,24391]},"id":1}]} 2024-09-12T01:26:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-12T01:26:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.036+0000 7f542b92c640 1 -- 172.21.15.81:0/3957266056 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f54100a2c10 msgr2=0x7f54100a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.036+0000 7f542b92c640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f54100a2c10 0x7f54100a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f54241072a0 tx=0x7f542000b410 comp rx=0 tx=0).stop 2024-09-12T01:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.036+0000 7f542b92c640 1 -- 172.21.15.81:0/3957266056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5424100e20 msgr2=0x7f54241984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.036+0000 7f542b92c640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5424100e20 0x7f54241984a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5414006010 tx=0x7f5414003c10 comp rx=0 tx=0).stop 2024-09-12T01:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.036+0000 7f542b92c640 1 -- 172.21.15.81:0/3957266056 shutdown_connections 2024-09-12T01:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.036+0000 7f542b92c640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f54100a2c10 0x7f54100a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.036+0000 7f542b92c640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5424102ef0 0x7f542419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.036+0000 7f542b92c640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5424102570 0x7f54241989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.036+0000 7f542b92c640 1 --2- 172.21.15.81:0/3957266056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5424100e20 0x7f54241984a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.036+0000 7f542b92c640 1 -- 172.21.15.81:0/3957266056 >> 172.21.15.81:0/3957266056 conn(0x7f54240fc7d0 msgr2=0x7f54240fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.036+0000 7f542b92c640 1 -- 172.21.15.81:0/3957266056 shutdown_connections 2024-09-12T01:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:36.036+0000 7f542b92c640 1 -- 172.21.15.81:0/3957266056 wait complete. 2024-09-12T01:26:36.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:26:36.743 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:36 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3957266056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:26:36.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:36 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3957266056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:26:36.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:36 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3957266056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:26:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:37.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.424+0000 7fc4f52ac640 1 -- 172.21.15.81:0/3939347634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f0106f40 msgr2=0x7fc4f010eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.424+0000 7fc4f52ac640 1 --2- 172.21.15.81:0/3939347634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f0106f40 0x7fc4f010eac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009900 tx=0x7fc4e002a410 comp rx=0 tx=0).stop 2024-09-12T01:26:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.424+0000 7fc4f52ac640 1 -- 172.21.15.81:0/3939347634 shutdown_connections 2024-09-12T01:26:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.424+0000 7fc4f52ac640 1 --2- 172.21.15.81:0/3939347634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f0106f40 0x7fc4f010eac0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.424+0000 7fc4f52ac640 1 --2- 172.21.15.81:0/3939347634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4f01027c0 0x7fc4f0106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.424+0000 7fc4f52ac640 1 --2- 172.21.15.81:0/3939347634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0101e10 0x7fc4f01021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.424+0000 7fc4f52ac640 1 -- 172.21.15.81:0/3939347634 >> 172.21.15.81:0/3939347634 conn(0x7fc4f00fd8d0 msgr2=0x7fc4f00ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.424+0000 7fc4f52ac640 1 -- 172.21.15.81:0/3939347634 shutdown_connections 2024-09-12T01:26:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.424+0000 7fc4f52ac640 1 -- 172.21.15.81:0/3939347634 wait complete. 2024-09-12T01:26:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4f52ac640 1 Processor -- start 2024-09-12T01:26:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4f52ac640 1 -- start start 2024-09-12T01:26:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4f52ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f0101e10 0x7fc4f00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4f52ac640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4f01027c0 0x7fc4f0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4f52ac640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0106f40 0x7fc4f0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4f52ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f0111fa0 con 0x7fc4f0101e10 2024-09-12T01:26:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4f52ac640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f0111e20 con 0x7fc4f0106f40 2024-09-12T01:26:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4f52ac640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f0112120 con 0x7fc4f01027c0 2024-09-12T01:26:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4eeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f0101e10 0x7fc4f00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4eeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f0101e10 0x7fc4f00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51262/0 (socket says 172.21.15.81:51262) 2024-09-12T01:26:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4eeffd640 1 -- 172.21.15.81:0/2013426082 learned_addr learned my addr 172.21.15.81:0/2013426082 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4ef7fe640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0106f40 0x7fc4f0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4eeffd640 1 -- 172.21.15.81:0/2013426082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4f01027c0 msgr2=0x7fc4f0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4eeffd640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4f01027c0 0x7fc4f0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4eeffd640 1 -- 172.21.15.81:0/2013426082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0106f40 msgr2=0x7fc4f0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4eeffd640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0106f40 0x7fc4f0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:37.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4eeffd640 1 -- 172.21.15.81:0/2013426082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f01a6800 con 0x7fc4f0101e10 2024-09-12T01:26:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.425+0000 7fc4ef7fe640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0106f40 0x7fc4f0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:26:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.426+0000 7fc4eeffd640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f0101e10 0x7fc4f00744f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800eab0 tx=0x7fc4e800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.426+0000 7fc4e7fff640 1 -- 172.21.15.81:0/2013426082 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e800ce40 con 0x7fc4f0101e10 2024-09-12T01:26:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.426+0000 7fc4e7fff640 1 -- 172.21.15.81:0/2013426082 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e8011950 con 0x7fc4f0101e10 2024-09-12T01:26:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.426+0000 7fc4e7fff640 1 -- 172.21.15.81:0/2013426082 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8010ae0 con 0x7fc4f0101e10 2024-09-12T01:26:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.426+0000 7fc4f52ac640 1 -- 172.21.15.81:0/2013426082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f01a6af0 con 0x7fc4f0101e10 2024-09-12T01:26:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.426+0000 7fc4f52ac640 1 -- 172.21.15.81:0/2013426082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f01a6fe0 con 0x7fc4f0101e10 2024-09-12T01:26:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.427+0000 7fc4f52ac640 1 -- 172.21.15.81:0/2013426082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f01021f0 con 0x7fc4f0101e10 2024-09-12T01:26:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.428+0000 7fc4e7fff640 1 -- 172.21.15.81:0/2013426082 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc4e8011b00 con 0x7fc4f0101e10 2024-09-12T01:26:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.429+0000 7fc4e7fff640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc4dc0a2c10 0x7fc4dc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.429+0000 7fc4ee7fc640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc4dc0a2c10 0x7fc4dc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.429+0000 7fc4e7fff640 1 -- 172.21.15.81:0/2013426082 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc4e80cf9b0 con 0x7fc4f0101e10 2024-09-12T01:26:37.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.429+0000 7fc4ee7fc640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc4dc0a2c10 0x7fc4dc0a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0075f80 tx=0x7fc4d8005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.433+0000 7fc4e7fff640 1 -- 172.21.15.81:0/2013426082 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc4e8016030 con 0x7fc4f0101e10 2024-09-12T01:26:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.604+0000 7fc4f52ac640 1 -- 172.21.15.81:0/2013426082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4f01a73a0 con 0x7fc4f0101e10 2024-09-12T01:26:37.605 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:37 smithi081 ceph-mon[30920]: pgmap v288: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 19 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T01:26:37.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.606+0000 7fc4e7fff640 1 -- 172.21.15.81:0/2013426082 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22714 (secure 0 0 0) 0x7fc4e809c7c0 con 0x7fc4f0101e10 2024-09-12T01:26:37.607 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:26:37.607 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","created":"2024-09-12T01:18:28.404285+0000","modified":"2024-09-12T01:26:26.256495+0000","last_up_change":"2024-09-12T01:25:26.326110+0000","last_in_change":"2024-09-12T01:25:02.138698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:21:40.649584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:26:10.753723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:26:13.254837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc857dd4-eedc-4c48-89a0-4e69662e8e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6803","nonce":3870994528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6805","nonce":3870994528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6809","nonce":3870994528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6807","nonce":3870994528}]},"public_addr":"172.21.15.81:6803/3870994528","cluster_addr":"172.21.15.81:6805/3870994528","heartbeat_back_addr":"172.21.15.81:6809/3870994528","heartbeat_front_addr":"172.21.15.81:6807/3870994528","state":["exists","up"]},{"osd":1,"uuid":"04b8111b-d677-4fc8-8285-90683621ccf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6801","nonce":2098299652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6803","nonce":2098299652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6807","nonce":2098299652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6805","nonce":2098299652}]},"public_addr":"172.21.15.100:6801/2098299652","cluster_addr":"172.21.15.100:6803/2098299652","heartbeat_back_addr":"172.21.15.100:6807/2098299652","heartbeat_front_addr":"172.21.15.100:6805/2098299652","state":["exists","up"]},{"osd":2,"uuid":"763e357e-5a04-45ff-95e8-bc1abfeac056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6801","nonce":1353548110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6803","nonce":1353548110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6807","nonce":1353548110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6805","nonce":1353548110}]},"public_addr":"172.21.15.189:6801/1353548110","cluster_addr":"172.21.15.189:6803/1353548110","heartbeat_back_addr":"172.21.15.189:6807/1353548110","heartbeat_front_addr":"172.21.15.189:6805/1353548110","state":["exists","up"]},{"osd":3,"uuid":"99843578-1b9e-4ee0-91f1-ba419d07897e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6811","nonce":1064869637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6813","nonce":1064869637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6817","nonce":1064869637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6815","nonce":1064869637}]},"public_addr":"172.21.15.81:6811/1064869637","cluster_addr":"172.21.15.81:6813/1064869637","heartbeat_back_addr":"172.21.15.81:6817/1064869637","heartbeat_front_addr":"172.21.15.81:6815/1064869637","state":["exists","up"]},{"osd":4,"uuid":"a5787415-0905-420e-9ce8-eb6902727561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6809","nonce":1687792282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6811","nonce":1687792282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6815","nonce":1687792282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6813","nonce":1687792282}]},"public_addr":"172.21.15.100:6809/1687792282","cluster_addr":"172.21.15.100:6811/1687792282","heartbeat_back_addr":"172.21.15.100:6815/1687792282","heartbeat_front_addr":"172.21.15.100:6813/1687792282","state":["exists","up"]},{"osd":5,"uuid":"879548b5-5516-407c-8517-bbdbf356c0e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6809","nonce":823474396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6811","nonce":823474396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6815","nonce":823474396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6813","nonce":823474396}]},"public_addr":"172.21.15.189:6809/823474396","cluster_addr":"172.21.15.189:6811/823474396","heartbeat_back_addr":"172.21.15.189:6815/823474396","heartbeat_front_addr":"172.21.15.189:6813/823474396","state":["exists","up"]},{"osd":6,"uuid":"b665b97c-a9d3-475f-93f3-8a920cbb37d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6819","nonce":1522854005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6821","nonce":1522854005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6825","nonce":1522854005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6823","nonce":1522854005}]},"public_addr":"172.21.15.81:6819/1522854005","cluster_addr":"172.21.15.81:6821/1522854005","heartbeat_back_addr":"172.21.15.81:6825/1522854005","heartbeat_front_addr":"172.21.15.81:6823/1522854005","state":["exists","up"]},{"osd":7,"uuid":"46e082c8-d071-471a-8c86-ce5b5700cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6817","nonce":41478541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6819","nonce":41478541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6823","nonce":41478541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6821","nonce":41478541}]},"public_addr":"172.21.15.100:6817/41478541","cluster_addr":"172.21.15.100:6819/41478541","heartbeat_back_addr":"172.21.15.100:6823/41478541","heartbeat_front_addr":"172.21.15.100:6821/41478541","state":["exists","up"]},{"osd":8,"uuid":"fb9b93ef-5a33-4ffc-926e-a78c101bbbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6817","nonce":180766860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6819","nonce":180766860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6823","nonce":180766860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6821","nonce":180766860}]},"public_addr":"172.21.15.189:6817/180766860","cluster_addr":"172.21.15.189:6819/180766860","heartbeat_back_addr":"172.21.15.189:6823/180766860","heartbeat_front_addr":"172.21.15.189:6821/180766860","state":["exists","up"]},{"osd":9,"uuid":"0b7ec1a1-5ab9-4075-acfb-e0d82f018656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6827","nonce":1651232782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6829","nonce":1651232782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6833","nonce":1651232782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6831","nonce":1651232782}]},"public_addr":"172.21.15.81:6827/1651232782","cluster_addr":"172.21.15.81:6829/1651232782","heartbeat_back_addr":"172.21.15.81:6833/1651232782","heartbeat_front_addr":"172.21.15.81:6831/1651232782","state":["exists","up"]},{"osd":10,"uuid":"996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6825","nonce":3295868568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6827","nonce":3295868568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6831","nonce":3295868568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6829","nonce":3295868568}]},"public_addr":"172.21.15.100:6825/3295868568","cluster_addr":"172.21.15.100:6827/3295868568","heartbeat_back_addr":"172.21.15.100:6831/3295868568","heartbeat_front_addr":"172.21.15.100:6829/3295868568","state":["exists","up"]},{"osd":11,"uuid":"f051e2b2-fc58-489a-ab7c-8c1ff5448553","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6825","nonce":3852230978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6827","nonce":3852230978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6831","nonce":3852230978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6829","nonce":3852230978}]},"public_addr":"172.21.15.189:6825/3852230978","cluster_addr":"172.21.15.189:6827/3852230978","heartbeat_back_addr":"172.21.15.189:6831/3852230978","heartbeat_front_addr":"172.21.15.189:6829/3852230978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:20:47.371696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:12.762376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:37.936648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:03.950352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:28.922754+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:54.252149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:18.421479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:43.989505+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:08.789671+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:34.336367+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:59.089601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:25:23.761934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/4128337402":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/1460332159":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2577694203":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2393807982":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/2162789959":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/4219073331":"2024-09-13T01:19:00.926419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:26:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.608+0000 7fc4f52ac640 1 -- 172.21.15.81:0/2013426082 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc4dc0a2c10 msgr2=0x7fc4dc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.608+0000 7fc4f52ac640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc4dc0a2c10 0x7fc4dc0a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0075f80 tx=0x7fc4d8005c00 comp rx=0 tx=0).stop 2024-09-12T01:26:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.608+0000 7fc4f52ac640 1 -- 172.21.15.81:0/2013426082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f0101e10 msgr2=0x7fc4f00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.608+0000 7fc4f52ac640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f0101e10 0x7fc4f00744f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800eab0 tx=0x7fc4e800ef70 comp rx=0 tx=0).stop 2024-09-12T01:26:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.608+0000 7fc4f52ac640 1 -- 172.21.15.81:0/2013426082 shutdown_connections 2024-09-12T01:26:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.608+0000 7fc4f52ac640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc4dc0a2c10 0x7fc4dc0a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.608+0000 7fc4f52ac640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4f0106f40 0x7fc4f0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.608+0000 7fc4f52ac640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc4f01027c0 0x7fc4f0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.608+0000 7fc4f52ac640 1 --2- 172.21.15.81:0/2013426082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f0101e10 0x7fc4f00744f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.608+0000 7fc4f52ac640 1 -- 172.21.15.81:0/2013426082 >> 172.21.15.81:0/2013426082 conn(0x7fc4f00fd8d0 msgr2=0x7fc4f00ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.608+0000 7fc4f52ac640 1 -- 172.21.15.81:0/2013426082 shutdown_connections 2024-09-12T01:26:37.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:37.608+0000 7fc4f52ac640 1 -- 172.21.15.81:0/2013426082 wait complete. 2024-09-12T01:26:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:37 smithi100 ceph-mon[35275]: pgmap v288: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 19 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T01:26:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:37 smithi189 ceph-mon[35357]: pgmap v288: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 19 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T01:26:38.321 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T01:26:38.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:26:38.616 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:38.737 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:38 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2013426082' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:38.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:38 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2013426082' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:38.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:38 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2013426082' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:39.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.074+0000 7f2d86ac9640 1 -- 172.21.15.81:0/3575151157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d80101de0 msgr2=0x7f2d801021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:39.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.074+0000 7f2d86ac9640 1 --2- 172.21.15.81:0/3575151157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d80101de0 0x7f2d801021c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009900 tx=0x7f2d7402a410 comp rx=0 tx=0).stop 2024-09-12T01:26:39.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.074+0000 7f2d86ac9640 1 -- 172.21.15.81:0/3575151157 shutdown_connections 2024-09-12T01:26:39.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.074+0000 7f2d86ac9640 1 --2- 172.21.15.81:0/3575151157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d80106f10 0x7f2d8010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:39.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.074+0000 7f2d86ac9640 1 --2- 172.21.15.81:0/3575151157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d80102790 0x7f2d801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:39.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.074+0000 7f2d86ac9640 1 --2- 172.21.15.81:0/3575151157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d80101de0 0x7f2d801021c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:39.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.074+0000 7f2d86ac9640 1 -- 172.21.15.81:0/3575151157 >> 172.21.15.81:0/3575151157 conn(0x7f2d800fd8c0 msgr2=0x7f2d800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:39.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.074+0000 7f2d86ac9640 1 -- 172.21.15.81:0/3575151157 shutdown_connections 2024-09-12T01:26:39.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.074+0000 7f2d86ac9640 1 -- 172.21.15.81:0/3575151157 wait complete. 2024-09-12T01:26:39.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.075+0000 7f2d86ac9640 1 Processor -- start 2024-09-12T01:26:39.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.075+0000 7f2d86ac9640 1 -- start start 2024-09-12T01:26:39.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.075+0000 7f2d86ac9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d80101de0 0x7f2d801985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:39.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.075+0000 7f2d86ac9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d80102790 0x7f2d80198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:39.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.075+0000 7f2d86ac9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d80106f10 0x7f2d8019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.075+0000 7f2d86ac9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2d80112010 con 0x7f2d80101de0 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.075+0000 7f2d86ac9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d80111e90 con 0x7f2d80102790 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.075+0000 7f2d86ac9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2d80112190 con 0x7f2d80106f10 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.075+0000 7f2d84865640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d80101de0 0x7f2d801985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.075+0000 7f2d84865640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d80101de0 0x7f2d801985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51272/0 (socket says 172.21.15.81:51272) 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.075+0000 7f2d84865640 1 -- 172.21.15.81:0/1795485838 learned_addr learned my addr 172.21.15.81:0/1795485838 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d7ffff640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d80102790 0x7f2d80198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d85066640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d80106f10 0x7f2d8019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d84865640 1 -- 172.21.15.81:0/1795485838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d80106f10 msgr2=0x7f2d8019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d84865640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d80106f10 0x7f2d8019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d84865640 1 -- 172.21.15.81:0/1795485838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d80102790 msgr2=0x7f2d80198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d84865640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d80102790 0x7f2d80198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d84865640 1 -- 172.21.15.81:0/1795485838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8019d560 con 0x7f2d80101de0 2024-09-12T01:26:39.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d85066640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d80106f10 0x7f2d8019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:26:39.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d7ffff640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d80102790 0x7f2d80198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:26:39.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d84865640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d80101de0 0x7f2d801985b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2d74005ab0 tx=0x7f2d740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:39.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d7dffb640 1 -- 172.21.15.81:0/1795485838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7403f030 con 0x7f2d80101de0 2024-09-12T01:26:39.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d86ac9640 1 -- 172.21.15.81:0/1795485838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d8019d7f0 con 0x7f2d80101de0 2024-09-12T01:26:39.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d7dffb640 1 -- 172.21.15.81:0/1795485838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d74003ce0 con 0x7f2d80101de0 2024-09-12T01:26:39.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d7dffb640 1 -- 172.21.15.81:0/1795485838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74035070 con 0x7f2d80101de0 2024-09-12T01:26:39.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.076+0000 7f2d86ac9640 1 -- 172.21.15.81:0/1795485838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d801a5130 con 0x7f2d80101de0 2024-09-12T01:26:39.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.077+0000 7f2d86ac9640 1 -- 172.21.15.81:0/1795485838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d80102240 con 0x7f2d80101de0 2024-09-12T01:26:39.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.078+0000 7f2d7dffb640 1 -- 172.21.15.81:0/1795485838 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2d74042030 con 0x7f2d80101de0 2024-09-12T01:26:39.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.079+0000 7f2d7dffb640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f2d700a2c10 0x7f2d700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:39.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.079+0000 7f2d7ffff640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f2d700a2c10 0x7f2d700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:39.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.079+0000 7f2d7dffb640 1 -- 172.21.15.81:0/1795485838 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2d740efb40 con 0x7f2d80101de0 2024-09-12T01:26:39.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.079+0000 7f2d7ffff640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f2d700a2c10 0x7f2d700a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c006fd0 tx=0x7f2d6c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:39.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.083+0000 7f2d7dffb640 1 -- 172.21.15.81:0/1795485838 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d740bc950 con 0x7f2d80101de0 2024-09-12T01:26:39.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.246+0000 7f2d86ac9640 1 -- 172.21.15.81:0/1795485838 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d80062630 con 0x7f2d700a2c10 2024-09-12T01:26:39.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.253+0000 7f2d7dffb640 1 -- 172.21.15.81:0/1795485838 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258767 (secure 0 0 0) 0x7f2d80062630 con 0x7f2d700a2c10 2024-09-12T01:26:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:26:39.256 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T01:26:39.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.256+0000 7f2d86ac9640 1 -- 172.21.15.81:0/1795485838 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f2d700a2c10 msgr2=0x7f2d700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:39.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.256+0000 7f2d86ac9640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f2d700a2c10 0x7f2d700a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c006fd0 tx=0x7f2d6c008040 comp rx=0 tx=0).stop 2024-09-12T01:26:39.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.256+0000 7f2d86ac9640 1 -- 172.21.15.81:0/1795485838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d80101de0 msgr2=0x7f2d801985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:39.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.256+0000 7f2d86ac9640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d80101de0 0x7f2d801985b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2d74005ab0 tx=0x7f2d740042f0 comp rx=0 tx=0).stop 2024-09-12T01:26:39.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.256+0000 7f2d86ac9640 1 -- 172.21.15.81:0/1795485838 shutdown_connections 2024-09-12T01:26:39.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.256+0000 7f2d86ac9640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f2d700a2c10 0x7f2d700a50d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:39.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.256+0000 7f2d86ac9640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d80106f10 0x7f2d8019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:39.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.256+0000 7f2d86ac9640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d80102790 0x7f2d80198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:39.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.256+0000 7f2d86ac9640 1 --2- 172.21.15.81:0/1795485838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d80101de0 0x7f2d801985b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:39.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.256+0000 7f2d86ac9640 1 -- 172.21.15.81:0/1795485838 >> 172.21.15.81:0/1795485838 conn(0x7f2d800fd8c0 msgr2=0x7f2d800fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:39.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.256+0000 7f2d86ac9640 1 -- 172.21.15.81:0/1795485838 shutdown_connections 2024-09-12T01:26:39.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:39.257+0000 7f2d86ac9640 1 -- 172.21.15.81:0/1795485838 wait complete. 2024-09-12T01:26:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:39 smithi189 ceph-mon[35357]: pgmap v289: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.0 KiB/s wr, 18 op/s; 1 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T01:26:39.844 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:39 smithi081 ceph-mon[30920]: pgmap v289: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.0 KiB/s wr, 18 op/s; 1 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T01:26:39.917 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-09-12T01:26:38.431241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647529,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":285,"num_read_kb":256,"num_write":415,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180758,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374456,"kb_used_data":12708,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567368,"statfs":{"total":1151940427776,"available":1151556984832,"internally_reserved":0,"allocated":13012992,"data_stored":7165611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50483,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":90,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":10,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002872"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260973+0000","last_change":"2024-09-12T01:26:14.433907+0000","last_active":"2024-09-12T01:26:26.260973+0000","last_peered":"2024-09-12T01:26:26.260973+0000","last_clean":"2024-09-12T01:26:26.260973+0000","last_became_active":"2024-09-12T01:26:14.433495+0000","last_became_peered":"2024-09-12T01:26:14.433495+0000","last_unstale":"2024-09-12T01:26:26.260973+0000","last_undegraded":"2024-09-12T01:26:26.260973+0000","last_fullsized":"2024-09-12T01:26:26.260973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:12.836491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264454+0000","last_change":"2024-09-12T01:26:14.430873+0000","last_active":"2024-09-12T01:26:26.264454+0000","last_peered":"2024-09-12T01:26:26.264454+0000","last_clean":"2024-09-12T01:26:26.264454+0000","last_became_active":"2024-09-12T01:26:14.430572+0000","last_became_peered":"2024-09-12T01:26:14.430572+0000","last_unstale":"2024-09-12T01:26:26.264454+0000","last_undegraded":"2024-09-12T01:26:26.264454+0000","last_fullsized":"2024-09-12T01:26:26.264454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:15.160712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264571+0000","last_change":"2024-09-12T01:26:14.426117+0000","last_active":"2024-09-12T01:26:26.264571+0000","last_peered":"2024-09-12T01:26:26.264571+0000","last_clean":"2024-09-12T01:26:26.264571+0000","last_became_active":"2024-09-12T01:26:14.425831+0000","last_became_peered":"2024-09-12T01:26:14.425831+0000","last_unstale":"2024-09-12T01:26:26.264571+0000","last_undegraded":"2024-09-12T01:26:26.264571+0000","last_fullsized":"2024-09-12T01:26:26.264571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:15.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262656+0000","last_change":"2024-09-12T01:26:14.434545+0000","last_active":"2024-09-12T01:26:26.262656+0000","last_peered":"2024-09-12T01:26:26.262656+0000","last_clean":"2024-09-12T01:26:26.262656+0000","last_became_active":"2024-09-12T01:26:14.434222+0000","last_became_peered":"2024-09-12T01:26:14.434222+0000","last_unstale":"2024-09-12T01:26:26.262656+0000","last_undegraded":"2024-09-12T01:26:26.262656+0000","last_fullsized":"2024-09-12T01:26:26.262656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:36.789145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263142+0000","last_change":"2024-09-12T01:26:14.421900+0000","last_active":"2024-09-12T01:26:26.263142+0000","last_peered":"2024-09-12T01:26:26.263142+0000","last_clean":"2024-09-12T01:26:26.263142+0000","last_became_active":"2024-09-12T01:26:14.421558+0000","last_became_peered":"2024-09-12T01:26:14.421558+0000","last_unstale":"2024-09-12T01:26:26.263142+0000","last_undegraded":"2024-09-12T01:26:26.263142+0000","last_fullsized":"2024-09-12T01:26:26.263142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262080+0000","last_change":"2024-09-12T01:26:14.436641+0000","last_active":"2024-09-12T01:26:26.262080+0000","last_peered":"2024-09-12T01:26:26.262080+0000","last_clean":"2024-09-12T01:26:26.262080+0000","last_became_active":"2024-09-12T01:26:14.436347+0000","last_became_peered":"2024-09-12T01:26:14.436347+0000","last_unstale":"2024-09-12T01:26:26.262080+0000","last_undegraded":"2024-09-12T01:26:26.262080+0000","last_fullsized":"2024-09-12T01:26:26.262080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:52.756035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267385+0000","last_change":"2024-09-12T01:26:14.438676+0000","last_active":"2024-09-12T01:26:26.267385+0000","last_peered":"2024-09-12T01:26:26.267385+0000","last_clean":"2024-09-12T01:26:26.267385+0000","last_became_active":"2024-09-12T01:26:14.438332+0000","last_became_peered":"2024-09-12T01:26:14.438332+0000","last_unstale":"2024-09-12T01:26:26.267385+0000","last_undegraded":"2024-09-12T01:26:26.267385+0000","last_fullsized":"2024-09-12T01:26:26.267385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:06.459830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268827+0000","last_change":"2024-09-12T01:26:14.431676+0000","last_active":"2024-09-12T01:26:26.268827+0000","last_peered":"2024-09-12T01:26:26.268827+0000","last_clean":"2024-09-12T01:26:26.268827+0000","last_became_active":"2024-09-12T01:26:14.431378+0000","last_became_peered":"2024-09-12T01:26:14.431378+0000","last_unstale":"2024-09-12T01:26:26.268827+0000","last_undegraded":"2024-09-12T01:26:26.268827+0000","last_fullsized":"2024-09-12T01:26:26.268827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:23.523350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281590+0000","last_change":"2024-09-12T01:26:14.428381+0000","last_active":"2024-09-12T01:26:26.281590+0000","last_peered":"2024-09-12T01:26:26.281590+0000","last_clean":"2024-09-12T01:26:26.281590+0000","last_became_active":"2024-09-12T01:26:14.428031+0000","last_became_peered":"2024-09-12T01:26:14.428031+0000","last_unstale":"2024-09-12T01:26:26.281590+0000","last_undegraded":"2024-09-12T01:26:26.281590+0000","last_fullsized":"2024-09-12T01:26:26.281590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:40.920911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263022+0000","last_change":"2024-09-12T01:26:14.438849+0000","last_active":"2024-09-12T01:26:26.263022+0000","last_peered":"2024-09-12T01:26:26.263022+0000","last_clean":"2024-09-12T01:26:26.263022+0000","last_became_active":"2024-09-12T01:26:14.438510+0000","last_became_peered":"2024-09-12T01:26:14.438510+0000","last_unstale":"2024-09-12T01:26:26.263022+0000","last_undegraded":"2024-09-12T01:26:26.263022+0000","last_fullsized":"2024-09-12T01:26:26.263022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:12.257292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267570+0000","last_change":"2024-09-12T01:26:14.436468+0000","last_active":"2024-09-12T01:26:26.267570+0000","last_peered":"2024-09-12T01:26:26.267570+0000","last_clean":"2024-09-12T01:26:26.267570+0000","last_became_active":"2024-09-12T01:26:14.436095+0000","last_became_peered":"2024-09-12T01:26:14.436095+0000","last_unstale":"2024-09-12T01:26:26.267570+0000","last_undegraded":"2024-09-12T01:26:26.267570+0000","last_fullsized":"2024-09-12T01:26:26.267570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:43.441358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262728+0000","last_change":"2024-09-12T01:26:14.431384+0000","last_active":"2024-09-12T01:26:26.262728+0000","last_peered":"2024-09-12T01:26:26.262728+0000","last_clean":"2024-09-12T01:26:26.262728+0000","last_became_active":"2024-09-12T01:26:14.431079+0000","last_became_peered":"2024-09-12T01:26:14.431079+0000","last_unstale":"2024-09-12T01:26:26.262728+0000","last_undegraded":"2024-09-12T01:26:26.262728+0000","last_fullsized":"2024-09-12T01:26:26.262728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.178038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259683+0000","last_change":"2024-09-12T01:26:14.430163+0000","last_active":"2024-09-12T01:26:26.259683+0000","last_peered":"2024-09-12T01:26:26.259683+0000","last_clean":"2024-09-12T01:26:26.259683+0000","last_became_active":"2024-09-12T01:26:14.429863+0000","last_became_peered":"2024-09-12T01:26:14.429863+0000","last_unstale":"2024-09-12T01:26:26.259683+0000","last_undegraded":"2024-09-12T01:26:26.259683+0000","last_fullsized":"2024-09-12T01:26:26.259683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:44.432677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264436+0000","last_change":"2024-09-12T01:26:14.427304+0000","last_active":"2024-09-12T01:26:26.264436+0000","last_peered":"2024-09-12T01:26:26.264436+0000","last_clean":"2024-09-12T01:26:26.264436+0000","last_became_active":"2024-09-12T01:26:14.427006+0000","last_became_peered":"2024-09-12T01:26:14.427006+0000","last_unstale":"2024-09-12T01:26:26.264436+0000","last_undegraded":"2024-09-12T01:26:26.264436+0000","last_fullsized":"2024-09-12T01:26:26.264436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.930959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264315+0000","last_change":"2024-09-12T01:26:14.431018+0000","last_active":"2024-09-12T01:26:26.264315+0000","last_peered":"2024-09-12T01:26:26.264315+0000","last_clean":"2024-09-12T01:26:26.264315+0000","last_became_active":"2024-09-12T01:26:14.429518+0000","last_became_peered":"2024-09-12T01:26:14.429518+0000","last_unstale":"2024-09-12T01:26:26.264315+0000","last_undegraded":"2024-09-12T01:26:26.264315+0000","last_fullsized":"2024-09-12T01:26:26.264315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.504814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281095+0000","last_change":"2024-09-12T01:26:14.430601+0000","last_active":"2024-09-12T01:26:26.281095+0000","last_peered":"2024-09-12T01:26:26.281095+0000","last_clean":"2024-09-12T01:26:26.281095+0000","last_became_active":"2024-09-12T01:26:14.430304+0000","last_became_peered":"2024-09-12T01:26:14.430304+0000","last_unstale":"2024-09-12T01:26:26.281095+0000","last_undegraded":"2024-09-12T01:26:26.281095+0000","last_fullsized":"2024-09-12T01:26:26.281095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.414767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.261070+0000","last_change":"2024-09-12T01:26:14.432934+0000","last_active":"2024-09-12T01:26:26.261070+0000","last_peered":"2024-09-12T01:26:26.261070+0000","last_clean":"2024-09-12T01:26:26.261070+0000","last_became_active":"2024-09-12T01:26:14.432417+0000","last_became_peered":"2024-09-12T01:26:14.432417+0000","last_unstale":"2024-09-12T01:26:26.261070+0000","last_undegraded":"2024-09-12T01:26:26.261070+0000","last_fullsized":"2024-09-12T01:26:26.261070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.964880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262645+0000","last_change":"2024-09-12T01:26:14.429956+0000","last_active":"2024-09-12T01:26:26.262645+0000","last_peered":"2024-09-12T01:26:26.262645+0000","last_clean":"2024-09-12T01:26:26.262645+0000","last_became_active":"2024-09-12T01:26:14.429610+0000","last_became_peered":"2024-09-12T01:26:14.429610+0000","last_unstale":"2024-09-12T01:26:26.262645+0000","last_undegraded":"2024-09-12T01:26:26.262645+0000","last_fullsized":"2024-09-12T01:26:26.262645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:51.453221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266186+0000","last_change":"2024-09-12T01:26:14.423624+0000","last_active":"2024-09-12T01:26:26.266186+0000","last_peered":"2024-09-12T01:26:26.266186+0000","last_clean":"2024-09-12T01:26:26.266186+0000","last_became_active":"2024-09-12T01:26:14.423314+0000","last_became_peered":"2024-09-12T01:26:14.423314+0000","last_unstale":"2024-09-12T01:26:26.266186+0000","last_undegraded":"2024-09-12T01:26:26.266186+0000","last_fullsized":"2024-09-12T01:26:26.266186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.414323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260452+0000","last_change":"2024-09-12T01:26:14.433548+0000","last_active":"2024-09-12T01:26:26.260452+0000","last_peered":"2024-09-12T01:26:26.260452+0000","last_clean":"2024-09-12T01:26:26.260452+0000","last_became_active":"2024-09-12T01:26:14.433223+0000","last_became_peered":"2024-09-12T01:26:14.433223+0000","last_unstale":"2024-09-12T01:26:26.260452+0000","last_undegraded":"2024-09-12T01:26:26.260452+0000","last_fullsized":"2024-09-12T01:26:26.260452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.247354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259705+0000","last_change":"2024-09-12T01:26:14.431715+0000","last_active":"2024-09-12T01:26:26.259705+0000","last_peered":"2024-09-12T01:26:26.259705+0000","last_clean":"2024-09-12T01:26:26.259705+0000","last_became_active":"2024-09-12T01:26:14.430839+0000","last_became_peered":"2024-09-12T01:26:14.430839+0000","last_unstale":"2024-09-12T01:26:26.259705+0000","last_undegraded":"2024-09-12T01:26:26.259705+0000","last_fullsized":"2024-09-12T01:26:26.259705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:04.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281598+0000","last_change":"2024-09-12T01:26:14.431385+0000","last_active":"2024-09-12T01:26:26.281598+0000","last_peered":"2024-09-12T01:26:26.281598+0000","last_clean":"2024-09-12T01:26:26.281598+0000","last_became_active":"2024-09-12T01:26:14.431046+0000","last_became_peered":"2024-09-12T01:26:14.431046+0000","last_unstale":"2024-09-12T01:26:26.281598+0000","last_undegraded":"2024-09-12T01:26:26.281598+0000","last_fullsized":"2024-09-12T01:26:26.281598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:42.495019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268877+0000","last_change":"2024-09-12T01:26:14.427737+0000","last_active":"2024-09-12T01:26:26.268877+0000","last_peered":"2024-09-12T01:26:26.268877+0000","last_clean":"2024-09-12T01:26:26.268877+0000","last_became_active":"2024-09-12T01:26:14.427409+0000","last_became_peered":"2024-09-12T01:26:14.427409+0000","last_unstale":"2024-09-12T01:26:26.268877+0000","last_undegraded":"2024-09-12T01:26:26.268877+0000","last_fullsized":"2024-09-12T01:26:26.268877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:02.632914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265224+0000","last_change":"2024-09-12T01:26:14.433426+0000","last_active":"2024-09-12T01:26:26.265224+0000","last_peered":"2024-09-12T01:26:26.265224+0000","last_clean":"2024-09-12T01:26:26.265224+0000","last_became_active":"2024-09-12T01:26:14.431918+0000","last_became_peered":"2024-09-12T01:26:14.431918+0000","last_unstale":"2024-09-12T01:26:26.265224+0000","last_undegraded":"2024-09-12T01:26:26.265224+0000","last_fullsized":"2024-09-12T01:26:26.265224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.946072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269048+0000","last_change":"2024-09-12T01:26:26.268358+0000","last_active":"2024-09-12T01:26:26.269048+0000","last_peered":"2024-09-12T01:26:26.269048+0000","last_clean":"2024-09-12T01:26:26.269048+0000","last_became_active":"2024-09-12T01:26:26.268005+0000","last_became_peered":"2024-09-12T01:26:26.268005+0000","last_unstale":"2024-09-12T01:26:26.269048+0000","last_undegraded":"2024-09-12T01:26:26.269048+0000","last_fullsized":"2024-09-12T01:26:26.269048+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:53.977249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266391+0000","last_change":"2024-09-12T01:26:14.434536+0000","last_active":"2024-09-12T01:26:26.266391+0000","last_peered":"2024-09-12T01:26:26.266391+0000","last_clean":"2024-09-12T01:26:26.266391+0000","last_became_active":"2024-09-12T01:26:14.434148+0000","last_became_peered":"2024-09-12T01:26:14.434148+0000","last_unstale":"2024-09-12T01:26:26.266391+0000","last_undegraded":"2024-09-12T01:26:26.266391+0000","last_fullsized":"2024-09-12T01:26:26.266391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:47.576827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260633+0000","last_change":"2024-09-12T01:26:14.428040+0000","last_active":"2024-09-12T01:26:26.260633+0000","last_peered":"2024-09-12T01:26:26.260633+0000","last_clean":"2024-09-12T01:26:26.260633+0000","last_became_active":"2024-09-12T01:26:14.427709+0000","last_became_peered":"2024-09-12T01:26:14.427709+0000","last_unstale":"2024-09-12T01:26:26.260633+0000","last_undegraded":"2024-09-12T01:26:26.260633+0000","last_fullsized":"2024-09-12T01:26:26.260633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.256097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265649+0000","last_change":"2024-09-12T01:26:26.265649+0000","last_active":"2024-09-12T01:26:26.265649+0000","last_peered":"2024-09-12T01:26:26.265649+0000","last_clean":"2024-09-12T01:26:26.265649+0000","last_became_active":"2024-09-12T01:26:26.265251+0000","last_became_peered":"2024-09-12T01:26:26.265251+0000","last_unstale":"2024-09-12T01:26:26.265649+0000","last_undegraded":"2024-09-12T01:26:26.265649+0000","last_fullsized":"2024-09-12T01:26:26.265649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:31.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264674+0000","last_change":"2024-09-12T01:26:14.427596+0000","last_active":"2024-09-12T01:26:26.264674+0000","last_peered":"2024-09-12T01:26:26.264674+0000","last_clean":"2024-09-12T01:26:26.264674+0000","last_became_active":"2024-09-12T01:26:14.427291+0000","last_became_peered":"2024-09-12T01:26:14.427291+0000","last_unstale":"2024-09-12T01:26:26.264674+0000","last_undegraded":"2024-09-12T01:26:26.264674+0000","last_fullsized":"2024-09-12T01:26:26.264674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:51.529835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265856+0000","last_change":"2024-09-12T01:26:14.424197+0000","last_active":"2024-09-12T01:26:26.265856+0000","last_peered":"2024-09-12T01:26:26.265856+0000","last_clean":"2024-09-12T01:26:26.265856+0000","last_became_active":"2024-09-12T01:26:14.423422+0000","last_became_peered":"2024-09-12T01:26:14.423422+0000","last_unstale":"2024-09-12T01:26:26.265856+0000","last_undegraded":"2024-09-12T01:26:26.265856+0000","last_fullsized":"2024-09-12T01:26:26.265856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.725623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265870+0000","last_change":"2024-09-12T01:26:14.428116+0000","last_active":"2024-09-12T01:26:26.265870+0000","last_peered":"2024-09-12T01:26:26.265870+0000","last_clean":"2024-09-12T01:26:26.265870+0000","last_became_active":"2024-09-12T01:26:14.427804+0000","last_became_peered":"2024-09-12T01:26:14.427804+0000","last_unstale":"2024-09-12T01:26:26.265870+0000","last_undegraded":"2024-09-12T01:26:26.265870+0000","last_fullsized":"2024-09-12T01:26:26.265870+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:02.271305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260460+0000","last_change":"2024-09-12T01:26:14.432659+0000","last_active":"2024-09-12T01:26:26.260460+0000","last_peered":"2024-09-12T01:26:26.260460+0000","last_clean":"2024-09-12T01:26:26.260460+0000","last_became_active":"2024-09-12T01:26:14.432331+0000","last_became_peered":"2024-09-12T01:26:14.432331+0000","last_unstale":"2024-09-12T01:26:26.260460+0000","last_undegraded":"2024-09-12T01:26:26.260460+0000","last_fullsized":"2024-09-12T01:26:26.260460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.868909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263975+0000","last_change":"2024-09-12T01:26:14.426167+0000","last_active":"2024-09-12T01:26:26.263975+0000","last_peered":"2024-09-12T01:26:26.263975+0000","last_clean":"2024-09-12T01:26:26.263975+0000","last_became_active":"2024-09-12T01:26:14.425847+0000","last_became_peered":"2024-09-12T01:26:14.425847+0000","last_unstale":"2024-09-12T01:26:26.263975+0000","last_undegraded":"2024-09-12T01:26:26.263975+0000","last_fullsized":"2024-09-12T01:26:26.263975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:39.481527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.277446+0000","last_change":"2024-09-12T01:26:12.421487+0000","last_active":"2024-09-12T01:26:34.277446+0000","last_peered":"2024-09-12T01:26:34.277446+0000","last_clean":"2024-09-12T01:26:34.277446+0000","last_became_active":"2024-09-12T01:26:12.421096+0000","last_became_peered":"2024-09-12T01:26:12.421096+0000","last_unstale":"2024-09-12T01:26:34.277446+0000","last_undegraded":"2024-09-12T01:26:34.277446+0000","last_fullsized":"2024-09-12T01:26:34.277446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:12.410280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.270310+0000","last_change":"2024-09-12T01:26:26.270310+0000","last_active":"2024-09-12T01:26:26.270310+0000","last_peered":"2024-09-12T01:26:26.270310+0000","last_clean":"2024-09-12T01:26:26.270310+0000","last_became_active":"2024-09-12T01:26:26.269917+0000","last_became_peered":"2024-09-12T01:26:26.269917+0000","last_unstale":"2024-09-12T01:26:26.270310+0000","last_undegraded":"2024-09-12T01:26:26.270310+0000","last_fullsized":"2024-09-12T01:26:26.270310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:29.549456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.287218+0000","last_change":"2024-09-12T01:26:26.287218+0000","last_active":"2024-09-12T01:26:26.287218+0000","last_peered":"2024-09-12T01:26:26.287218+0000","last_clean":"2024-09-12T01:26:26.287218+0000","last_became_active":"2024-09-12T01:26:26.282251+0000","last_became_peered":"2024-09-12T01:26:26.282251+0000","last_unstale":"2024-09-12T01:26:26.287218+0000","last_undegraded":"2024-09-12T01:26:26.287218+0000","last_fullsized":"2024-09-12T01:26:26.287218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:53.888064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259505+0000","last_change":"2024-09-12T01:26:12.416100+0000","last_active":"2024-09-12T01:26:26.259505+0000","last_peered":"2024-09-12T01:26:26.259505+0000","last_clean":"2024-09-12T01:26:26.259505+0000","last_became_active":"2024-09-12T01:26:12.415799+0000","last_became_peered":"2024-09-12T01:26:12.415799+0000","last_unstale":"2024-09-12T01:26:26.259505+0000","last_undegraded":"2024-09-12T01:26:26.259505+0000","last_fullsized":"2024-09-12T01:26:26.259505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:41.826537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268900+0000","last_change":"2024-09-12T01:26:14.424922+0000","last_active":"2024-09-12T01:26:26.268900+0000","last_peered":"2024-09-12T01:26:26.268900+0000","last_clean":"2024-09-12T01:26:26.268900+0000","last_became_active":"2024-09-12T01:26:14.424580+0000","last_became_peered":"2024-09-12T01:26:14.424580+0000","last_unstale":"2024-09-12T01:26:26.268900+0000","last_undegraded":"2024-09-12T01:26:26.268900+0000","last_fullsized":"2024-09-12T01:26:26.268900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:05.697287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265114+0000","last_change":"2024-09-12T01:26:12.419339+0000","last_active":"2024-09-12T01:26:26.265114+0000","last_peered":"2024-09-12T01:26:26.265114+0000","last_clean":"2024-09-12T01:26:26.265114+0000","last_became_active":"2024-09-12T01:26:12.418925+0000","last_became_peered":"2024-09-12T01:26:12.418925+0000","last_unstale":"2024-09-12T01:26:26.265114+0000","last_undegraded":"2024-09-12T01:26:26.265114+0000","last_fullsized":"2024-09-12T01:26:26.265114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.390691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262458+0000","last_change":"2024-09-12T01:26:14.426611+0000","last_active":"2024-09-12T01:26:26.262458+0000","last_peered":"2024-09-12T01:26:26.262458+0000","last_clean":"2024-09-12T01:26:26.262458+0000","last_became_active":"2024-09-12T01:26:14.426268+0000","last_became_peered":"2024-09-12T01:26:14.426268+0000","last_unstale":"2024-09-12T01:26:26.262458+0000","last_undegraded":"2024-09-12T01:26:26.262458+0000","last_fullsized":"2024-09-12T01:26:26.262458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:34.676841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.277928+0000","last_change":"2024-09-12T01:26:12.420302+0000","last_active":"2024-09-12T01:26:35.277928+0000","last_peered":"2024-09-12T01:26:35.277928+0000","last_clean":"2024-09-12T01:26:35.277928+0000","last_became_active":"2024-09-12T01:26:12.419943+0000","last_became_peered":"2024-09-12T01:26:12.419943+0000","last_unstale":"2024-09-12T01:26:35.277928+0000","last_undegraded":"2024-09-12T01:26:35.277928+0000","last_fullsized":"2024-09-12T01:26:35.277928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:30.704272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281551+0000","last_change":"2024-09-12T01:26:14.433112+0000","last_active":"2024-09-12T01:26:26.281551+0000","last_peered":"2024-09-12T01:26:26.281551+0000","last_clean":"2024-09-12T01:26:26.281551+0000","last_became_active":"2024-09-12T01:26:14.432803+0000","last_became_peered":"2024-09-12T01:26:14.432803+0000","last_unstale":"2024-09-12T01:26:26.281551+0000","last_undegraded":"2024-09-12T01:26:26.281551+0000","last_fullsized":"2024-09-12T01:26:26.281551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:33.670485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267615+0000","last_change":"2024-09-12T01:26:12.424854+0000","last_active":"2024-09-12T01:26:26.267615+0000","last_peered":"2024-09-12T01:26:26.267615+0000","last_clean":"2024-09-12T01:26:26.267615+0000","last_became_active":"2024-09-12T01:26:12.424476+0000","last_became_peered":"2024-09-12T01:26:12.424476+0000","last_unstale":"2024-09-12T01:26:26.267615+0000","last_undegraded":"2024-09-12T01:26:26.267615+0000","last_fullsized":"2024-09-12T01:26:26.267615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:03.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264526+0000","last_change":"2024-09-12T01:26:14.431580+0000","last_active":"2024-09-12T01:26:26.264526+0000","last_peered":"2024-09-12T01:26:26.264526+0000","last_clean":"2024-09-12T01:26:26.264526+0000","last_became_active":"2024-09-12T01:26:14.431237+0000","last_became_peered":"2024-09-12T01:26:14.431237+0000","last_unstale":"2024-09-12T01:26:26.264526+0000","last_undegraded":"2024-09-12T01:26:26.264526+0000","last_fullsized":"2024-09-12T01:26:26.264526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:32.562156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263620+0000","last_change":"2024-09-12T01:26:12.802015+0000","last_active":"2024-09-12T01:26:26.263620+0000","last_peered":"2024-09-12T01:26:26.263620+0000","last_clean":"2024-09-12T01:26:26.263620+0000","last_became_active":"2024-09-12T01:26:12.801605+0000","last_became_peered":"2024-09-12T01:26:12.801605+0000","last_unstale":"2024-09-12T01:26:26.263620+0000","last_undegraded":"2024-09-12T01:26:26.263620+0000","last_fullsized":"2024-09-12T01:26:26.263620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:24.703911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281250+0000","last_change":"2024-09-12T01:26:14.433305+0000","last_active":"2024-09-12T01:26:26.281250+0000","last_peered":"2024-09-12T01:26:26.281250+0000","last_clean":"2024-09-12T01:26:26.281250+0000","last_became_active":"2024-09-12T01:26:14.432989+0000","last_became_peered":"2024-09-12T01:26:14.432989+0000","last_unstale":"2024-09-12T01:26:26.281250+0000","last_undegraded":"2024-09-12T01:26:26.281250+0000","last_fullsized":"2024-09-12T01:26:26.281250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:45.741460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'27","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.279102+0000","last_change":"2024-09-12T01:26:12.423148+0000","last_active":"2024-09-12T01:26:35.279102+0000","last_peered":"2024-09-12T01:26:35.279102+0000","last_clean":"2024-09-12T01:26:35.279102+0000","last_became_active":"2024-09-12T01:26:12.422754+0000","last_became_peered":"2024-09-12T01:26:12.422754+0000","last_unstale":"2024-09-12T01:26:35.279102+0000","last_undegraded":"2024-09-12T01:26:35.279102+0000","last_fullsized":"2024-09-12T01:26:35.279102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:01.017125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":63,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264153+0000","last_change":"2024-09-12T01:26:14.431568+0000","last_active":"2024-09-12T01:26:26.264153+0000","last_peered":"2024-09-12T01:26:26.264153+0000","last_clean":"2024-09-12T01:26:26.264153+0000","last_became_active":"2024-09-12T01:26:14.431215+0000","last_became_peered":"2024-09-12T01:26:14.431215+0000","last_unstale":"2024-09-12T01:26:26.264153+0000","last_undegraded":"2024-09-12T01:26:26.264153+0000","last_fullsized":"2024-09-12T01:26:26.264153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.552147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266274+0000","last_change":"2024-09-12T01:26:12.421986+0000","last_active":"2024-09-12T01:26:26.266274+0000","last_peered":"2024-09-12T01:26:26.266274+0000","last_clean":"2024-09-12T01:26:26.266274+0000","last_became_active":"2024-09-12T01:26:12.421391+0000","last_became_peered":"2024-09-12T01:26:12.421391+0000","last_unstale":"2024-09-12T01:26:26.266274+0000","last_undegraded":"2024-09-12T01:26:26.266274+0000","last_fullsized":"2024-09-12T01:26:26.266274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:20.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259524+0000","last_change":"2024-09-12T01:26:14.431435+0000","last_active":"2024-09-12T01:26:26.259524+0000","last_peered":"2024-09-12T01:26:26.259524+0000","last_clean":"2024-09-12T01:26:26.259524+0000","last_became_active":"2024-09-12T01:26:14.431143+0000","last_became_peered":"2024-09-12T01:26:14.431143+0000","last_unstale":"2024-09-12T01:26:26.259524+0000","last_undegraded":"2024-09-12T01:26:26.259524+0000","last_fullsized":"2024-09-12T01:26:26.259524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:58.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263497+0000","last_change":"2024-09-12T01:26:12.423972+0000","last_active":"2024-09-12T01:26:26.263497+0000","last_peered":"2024-09-12T01:26:26.263497+0000","last_clean":"2024-09-12T01:26:26.263497+0000","last_became_active":"2024-09-12T01:26:12.423594+0000","last_became_peered":"2024-09-12T01:26:12.423594+0000","last_unstale":"2024-09-12T01:26:26.263497+0000","last_undegraded":"2024-09-12T01:26:26.263497+0000","last_fullsized":"2024-09-12T01:26:26.263497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:37.783478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267451+0000","last_change":"2024-09-12T01:26:14.437207+0000","last_active":"2024-09-12T01:26:26.267451+0000","last_peered":"2024-09-12T01:26:26.267451+0000","last_clean":"2024-09-12T01:26:26.267451+0000","last_became_active":"2024-09-12T01:26:14.436940+0000","last_became_peered":"2024-09-12T01:26:14.436940+0000","last_unstale":"2024-09-12T01:26:26.267451+0000","last_undegraded":"2024-09-12T01:26:26.267451+0000","last_fullsized":"2024-09-12T01:26:26.267451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:34.454446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.278613+0000","last_change":"2024-09-12T01:26:12.420247+0000","last_active":"2024-09-12T01:26:35.278613+0000","last_peered":"2024-09-12T01:26:35.278613+0000","last_clean":"2024-09-12T01:26:35.278613+0000","last_became_active":"2024-09-12T01:26:12.419825+0000","last_became_peered":"2024-09-12T01:26:12.419825+0000","last_unstale":"2024-09-12T01:26:35.278613+0000","last_undegraded":"2024-09-12T01:26:35.278613+0000","last_fullsized":"2024-09-12T01:26:35.278613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:26.746225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267074+0000","last_change":"2024-09-12T01:26:14.439019+0000","last_active":"2024-09-12T01:26:26.267074+0000","last_peered":"2024-09-12T01:26:26.267074+0000","last_clean":"2024-09-12T01:26:26.267074+0000","last_became_active":"2024-09-12T01:26:14.438714+0000","last_became_peered":"2024-09-12T01:26:14.438714+0000","last_unstale":"2024-09-12T01:26:26.267074+0000","last_undegraded":"2024-09-12T01:26:26.267074+0000","last_fullsized":"2024-09-12T01:26:26.267074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.321464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264576+0000","last_change":"2024-09-12T01:26:12.800529+0000","last_active":"2024-09-12T01:26:26.264576+0000","last_peered":"2024-09-12T01:26:26.264576+0000","last_clean":"2024-09-12T01:26:26.264576+0000","last_became_active":"2024-09-12T01:26:12.800104+0000","last_became_peered":"2024-09-12T01:26:12.800104+0000","last_unstale":"2024-09-12T01:26:26.264576+0000","last_undegraded":"2024-09-12T01:26:26.264576+0000","last_fullsized":"2024-09-12T01:26:26.264576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.624321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263032+0000","last_change":"2024-09-12T01:26:14.435283+0000","last_active":"2024-09-12T01:26:26.263032+0000","last_peered":"2024-09-12T01:26:26.263032+0000","last_clean":"2024-09-12T01:26:26.263032+0000","last_became_active":"2024-09-12T01:26:14.434414+0000","last_became_peered":"2024-09-12T01:26:14.434414+0000","last_unstale":"2024-09-12T01:26:26.263032+0000","last_undegraded":"2024-09-12T01:26:26.263032+0000","last_fullsized":"2024-09-12T01:26:26.263032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.959405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.273529+0000","last_change":"2024-09-12T01:26:26.273053+0000","last_active":"2024-09-12T01:26:26.273529+0000","last_peered":"2024-09-12T01:26:26.273529+0000","last_clean":"2024-09-12T01:26:26.273529+0000","last_became_active":"2024-09-12T01:26:26.267178+0000","last_became_peered":"2024-09-12T01:26:26.267178+0000","last_unstale":"2024-09-12T01:26:26.273529+0000","last_undegraded":"2024-09-12T01:26:26.273529+0000","last_fullsized":"2024-09-12T01:26:26.273529+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:08.138485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260636+0000","last_change":"2024-09-12T01:26:14.433527+0000","last_active":"2024-09-12T01:26:26.260636+0000","last_peered":"2024-09-12T01:26:26.260636+0000","last_clean":"2024-09-12T01:26:26.260636+0000","last_became_active":"2024-09-12T01:26:14.433204+0000","last_became_peered":"2024-09-12T01:26:14.433204+0000","last_unstale":"2024-09-12T01:26:26.260636+0000","last_undegraded":"2024-09-12T01:26:26.260636+0000","last_fullsized":"2024-09-12T01:26:26.260636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:26.883916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259798+0000","last_change":"2024-09-12T01:26:12.420795+0000","last_active":"2024-09-12T01:26:26.259798+0000","last_peered":"2024-09-12T01:26:26.259798+0000","last_clean":"2024-09-12T01:26:26.259798+0000","last_became_active":"2024-09-12T01:26:12.420409+0000","last_became_peered":"2024-09-12T01:26:12.420409+0000","last_unstale":"2024-09-12T01:26:26.259798+0000","last_undegraded":"2024-09-12T01:26:26.259798+0000","last_fullsized":"2024-09-12T01:26:26.259798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:36.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267797+0000","last_change":"2024-09-12T01:26:14.440994+0000","last_active":"2024-09-12T01:26:26.267797+0000","last_peered":"2024-09-12T01:26:26.267797+0000","last_clean":"2024-09-12T01:26:26.267797+0000","last_became_active":"2024-09-12T01:26:14.440602+0000","last_became_peered":"2024-09-12T01:26:14.440602+0000","last_unstale":"2024-09-12T01:26:26.267797+0000","last_undegraded":"2024-09-12T01:26:26.267797+0000","last_fullsized":"2024-09-12T01:26:26.267797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.998991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263740+0000","last_change":"2024-09-12T01:26:12.419448+0000","last_active":"2024-09-12T01:26:26.263740+0000","last_peered":"2024-09-12T01:26:26.263740+0000","last_clean":"2024-09-12T01:26:26.263740+0000","last_became_active":"2024-09-12T01:26:12.419000+0000","last_became_peered":"2024-09-12T01:26:12.419000+0000","last_unstale":"2024-09-12T01:26:26.263740+0000","last_undegraded":"2024-09-12T01:26:26.263740+0000","last_fullsized":"2024-09-12T01:26:26.263740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:37.818833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267551+0000","last_change":"2024-09-12T01:26:14.437818+0000","last_active":"2024-09-12T01:26:26.267551+0000","last_peered":"2024-09-12T01:26:26.267551+0000","last_clean":"2024-09-12T01:26:26.267551+0000","last_became_active":"2024-09-12T01:26:14.437497+0000","last_became_peered":"2024-09-12T01:26:14.437497+0000","last_unstale":"2024-09-12T01:26:26.267551+0000","last_undegraded":"2024-09-12T01:26:26.267551+0000","last_fullsized":"2024-09-12T01:26:26.267551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:57.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.502873+0000","last_change":"2024-09-12T01:26:12.855850+0000","last_active":"2024-09-12T01:26:33.502873+0000","last_peered":"2024-09-12T01:26:33.502873+0000","last_clean":"2024-09-12T01:26:33.502873+0000","last_became_active":"2024-09-12T01:26:12.855400+0000","last_became_peered":"2024-09-12T01:26:12.855400+0000","last_unstale":"2024-09-12T01:26:33.502873+0000","last_undegraded":"2024-09-12T01:26:33.502873+0000","last_fullsized":"2024-09-12T01:26:33.502873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:32.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267683+0000","last_change":"2024-09-12T01:26:14.435982+0000","last_active":"2024-09-12T01:26:26.267683+0000","last_peered":"2024-09-12T01:26:26.267683+0000","last_clean":"2024-09-12T01:26:26.267683+0000","last_became_active":"2024-09-12T01:26:14.435595+0000","last_became_peered":"2024-09-12T01:26:14.435595+0000","last_unstale":"2024-09-12T01:26:26.267683+0000","last_undegraded":"2024-09-12T01:26:26.267683+0000","last_fullsized":"2024-09-12T01:26:26.267683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:31.101890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":343,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267513+0000","last_change":"2024-09-12T01:25:04.588449+0000","last_active":"2024-09-12T01:26:26.267513+0000","last_peered":"2024-09-12T01:26:26.267513+0000","last_clean":"2024-09-12T01:26:26.267513+0000","last_became_active":"2024-09-12T01:25:04.587949+0000","last_became_peered":"2024-09-12T01:25:04.587949+0000","last_unstale":"2024-09-12T01:26:26.267513+0000","last_undegraded":"2024-09-12T01:26:26.267513+0000","last_fullsized":"2024-09-12T01:26:26.267513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_clean_scrub_stamp":"2024-09-12T01:21:41.345624+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:41.015289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.261927+0000","last_change":"2024-09-12T01:26:12.421379+0000","last_active":"2024-09-12T01:26:26.261927+0000","last_peered":"2024-09-12T01:26:26.261927+0000","last_clean":"2024-09-12T01:26:26.261927+0000","last_became_active":"2024-09-12T01:26:12.421059+0000","last_became_peered":"2024-09-12T01:26:12.421059+0000","last_unstale":"2024-09-12T01:26:26.261927+0000","last_undegraded":"2024-09-12T01:26:26.261927+0000","last_fullsized":"2024-09-12T01:26:26.261927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269101+0000","last_change":"2024-09-12T01:26:14.430510+0000","last_active":"2024-09-12T01:26:26.269101+0000","last_peered":"2024-09-12T01:26:26.269101+0000","last_clean":"2024-09-12T01:26:26.269101+0000","last_became_active":"2024-09-12T01:26:14.430232+0000","last_became_peered":"2024-09-12T01:26:14.430232+0000","last_unstale":"2024-09-12T01:26:26.269101+0000","last_undegraded":"2024-09-12T01:26:26.269101+0000","last_fullsized":"2024-09-12T01:26:26.269101+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:55.114616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267369+0000","last_change":"2024-09-12T01:26:12.420938+0000","last_active":"2024-09-12T01:26:26.267369+0000","last_peered":"2024-09-12T01:26:26.267369+0000","last_clean":"2024-09-12T01:26:26.267369+0000","last_became_active":"2024-09-12T01:26:12.420599+0000","last_became_peered":"2024-09-12T01:26:12.420599+0000","last_unstale":"2024-09-12T01:26:26.267369+0000","last_undegraded":"2024-09-12T01:26:26.267369+0000","last_fullsized":"2024-09-12T01:26:26.267369+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.593237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259495+0000","last_change":"2024-09-12T01:26:14.428684+0000","last_active":"2024-09-12T01:26:26.259495+0000","last_peered":"2024-09-12T01:26:26.259495+0000","last_clean":"2024-09-12T01:26:26.259495+0000","last_became_active":"2024-09-12T01:26:14.428380+0000","last_became_peered":"2024-09-12T01:26:14.428380+0000","last_unstale":"2024-09-12T01:26:26.259495+0000","last_undegraded":"2024-09-12T01:26:26.259495+0000","last_fullsized":"2024-09-12T01:26:26.259495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:21.542122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.277065+0000","last_change":"2024-09-12T01:26:12.800048+0000","last_active":"2024-09-12T01:26:34.277065+0000","last_peered":"2024-09-12T01:26:34.277065+0000","last_clean":"2024-09-12T01:26:34.277065+0000","last_became_active":"2024-09-12T01:26:12.799646+0000","last_became_peered":"2024-09-12T01:26:12.799646+0000","last_unstale":"2024-09-12T01:26:34.277065+0000","last_undegraded":"2024-09-12T01:26:34.277065+0000","last_fullsized":"2024-09-12T01:26:34.277065+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:39.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268626+0000","last_change":"2024-09-12T01:26:26.268110+0000","last_active":"2024-09-12T01:26:26.268626+0000","last_peered":"2024-09-12T01:26:26.268626+0000","last_clean":"2024-09-12T01:26:26.268626+0000","last_became_active":"2024-09-12T01:26:26.267764+0000","last_became_peered":"2024-09-12T01:26:26.267764+0000","last_unstale":"2024-09-12T01:26:26.268626+0000","last_undegraded":"2024-09-12T01:26:26.268626+0000","last_fullsized":"2024-09-12T01:26:26.268626+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:37.009529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.504563+0000","last_change":"2024-09-12T01:26:12.424189+0000","last_active":"2024-09-12T01:26:35.504563+0000","last_peered":"2024-09-12T01:26:35.504563+0000","last_clean":"2024-09-12T01:26:35.504563+0000","last_became_active":"2024-09-12T01:26:12.423785+0000","last_became_peered":"2024-09-12T01:26:12.423785+0000","last_unstale":"2024-09-12T01:26:35.504563+0000","last_undegraded":"2024-09-12T01:26:35.504563+0000","last_fullsized":"2024-09-12T01:26:35.504563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:20.069821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262256+0000","last_change":"2024-09-12T01:26:14.437874+0000","last_active":"2024-09-12T01:26:26.262256+0000","last_peered":"2024-09-12T01:26:26.262256+0000","last_clean":"2024-09-12T01:26:26.262256+0000","last_became_active":"2024-09-12T01:26:14.437578+0000","last_became_peered":"2024-09-12T01:26:14.437578+0000","last_unstale":"2024-09-12T01:26:26.262256+0000","last_undegraded":"2024-09-12T01:26:26.262256+0000","last_fullsized":"2024-09-12T01:26:26.262256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:55.817763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267861+0000","last_change":"2024-09-12T01:26:26.267861+0000","last_active":"2024-09-12T01:26:26.267861+0000","last_peered":"2024-09-12T01:26:26.267861+0000","last_clean":"2024-09-12T01:26:26.267861+0000","last_became_active":"2024-09-12T01:26:26.267244+0000","last_became_peered":"2024-09-12T01:26:26.267244+0000","last_unstale":"2024-09-12T01:26:26.267861+0000","last_undegraded":"2024-09-12T01:26:26.267861+0000","last_fullsized":"2024-09-12T01:26:26.267861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:50.623916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262312+0000","last_change":"2024-09-12T01:26:14.434708+0000","last_active":"2024-09-12T01:26:26.262312+0000","last_peered":"2024-09-12T01:26:26.262312+0000","last_clean":"2024-09-12T01:26:26.262312+0000","last_became_active":"2024-09-12T01:26:14.434420+0000","last_became_peered":"2024-09-12T01:26:14.434420+0000","last_unstale":"2024-09-12T01:26:26.262312+0000","last_undegraded":"2024-09-12T01:26:26.262312+0000","last_fullsized":"2024-09-12T01:26:26.262312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:58.626769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264703+0000","last_change":"2024-09-12T01:26:12.800678+0000","last_active":"2024-09-12T01:26:26.264703+0000","last_peered":"2024-09-12T01:26:26.264703+0000","last_clean":"2024-09-12T01:26:26.264703+0000","last_became_active":"2024-09-12T01:26:12.800063+0000","last_became_peered":"2024-09-12T01:26:12.800063+0000","last_unstale":"2024-09-12T01:26:26.264703+0000","last_undegraded":"2024-09-12T01:26:26.264703+0000","last_fullsized":"2024-09-12T01:26:26.264703+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:01.110686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259849+0000","last_change":"2024-09-12T01:26:14.425695+0000","last_active":"2024-09-12T01:26:26.259849+0000","last_peered":"2024-09-12T01:26:26.259849+0000","last_clean":"2024-09-12T01:26:26.259849+0000","last_became_active":"2024-09-12T01:26:14.425435+0000","last_became_peered":"2024-09-12T01:26:14.425435+0000","last_unstale":"2024-09-12T01:26:26.259849+0000","last_undegraded":"2024-09-12T01:26:26.259849+0000","last_fullsized":"2024-09-12T01:26:26.259849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:19.193669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.442722+0000","last_change":"2024-09-12T01:26:12.412743+0000","last_active":"2024-09-12T01:26:33.442722+0000","last_peered":"2024-09-12T01:26:33.442722+0000","last_clean":"2024-09-12T01:26:33.442722+0000","last_became_active":"2024-09-12T01:26:12.412376+0000","last_became_peered":"2024-09-12T01:26:12.412376+0000","last_unstale":"2024-09-12T01:26:33.442722+0000","last_undegraded":"2024-09-12T01:26:33.442722+0000","last_fullsized":"2024-09-12T01:26:33.442722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.542370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269530+0000","last_change":"2024-09-12T01:26:14.429727+0000","last_active":"2024-09-12T01:26:26.269530+0000","last_peered":"2024-09-12T01:26:26.269530+0000","last_clean":"2024-09-12T01:26:26.269530+0000","last_became_active":"2024-09-12T01:26:14.429385+0000","last_became_peered":"2024-09-12T01:26:14.429385+0000","last_unstale":"2024-09-12T01:26:26.269530+0000","last_undegraded":"2024-09-12T01:26:26.269530+0000","last_fullsized":"2024-09-12T01:26:26.269530+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:43.855786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262760+0000","last_change":"2024-09-12T01:26:12.855632+0000","last_active":"2024-09-12T01:26:26.262760+0000","last_peered":"2024-09-12T01:26:26.262760+0000","last_clean":"2024-09-12T01:26:26.262760+0000","last_became_active":"2024-09-12T01:26:12.855305+0000","last_became_peered":"2024-09-12T01:26:12.855305+0000","last_unstale":"2024-09-12T01:26:26.262760+0000","last_undegraded":"2024-09-12T01:26:26.262760+0000","last_fullsized":"2024-09-12T01:26:26.262760+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.893689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264587+0000","last_change":"2024-09-12T01:26:14.428498+0000","last_active":"2024-09-12T01:26:26.264587+0000","last_peered":"2024-09-12T01:26:26.264587+0000","last_clean":"2024-09-12T01:26:26.264587+0000","last_became_active":"2024-09-12T01:26:14.428022+0000","last_became_peered":"2024-09-12T01:26:14.428022+0000","last_unstale":"2024-09-12T01:26:26.264587+0000","last_undegraded":"2024-09-12T01:26:26.264587+0000","last_fullsized":"2024-09-12T01:26:26.264587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.325399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281204+0000","last_change":"2024-09-12T01:26:12.800038+0000","last_active":"2024-09-12T01:26:26.281204+0000","last_peered":"2024-09-12T01:26:26.281204+0000","last_clean":"2024-09-12T01:26:26.281204+0000","last_became_active":"2024-09-12T01:26:12.799717+0000","last_became_peered":"2024-09-12T01:26:12.799717+0000","last_unstale":"2024-09-12T01:26:26.281204+0000","last_undegraded":"2024-09-12T01:26:26.281204+0000","last_fullsized":"2024-09-12T01:26:26.281204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.362437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262988+0000","last_change":"2024-09-12T01:26:14.430518+0000","last_active":"2024-09-12T01:26:26.262988+0000","last_peered":"2024-09-12T01:26:26.262988+0000","last_clean":"2024-09-12T01:26:26.262988+0000","last_became_active":"2024-09-12T01:26:14.430158+0000","last_became_peered":"2024-09-12T01:26:14.430158+0000","last_unstale":"2024-09-12T01:26:26.262988+0000","last_undegraded":"2024-09-12T01:26:26.262988+0000","last_fullsized":"2024-09-12T01:26:26.262988+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:55.696101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268990+0000","last_change":"2024-09-12T01:26:12.418427+0000","last_active":"2024-09-12T01:26:26.268990+0000","last_peered":"2024-09-12T01:26:26.268990+0000","last_clean":"2024-09-12T01:26:26.268990+0000","last_became_active":"2024-09-12T01:26:12.418135+0000","last_became_peered":"2024-09-12T01:26:12.418135+0000","last_unstale":"2024-09-12T01:26:26.268990+0000","last_undegraded":"2024-09-12T01:26:26.268990+0000","last_fullsized":"2024-09-12T01:26:26.268990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:32.946485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260572+0000","last_change":"2024-09-12T01:26:14.425817+0000","last_active":"2024-09-12T01:26:26.260572+0000","last_peered":"2024-09-12T01:26:26.260572+0000","last_clean":"2024-09-12T01:26:26.260572+0000","last_became_active":"2024-09-12T01:26:14.425443+0000","last_became_peered":"2024-09-12T01:26:14.425443+0000","last_unstale":"2024-09-12T01:26:26.260572+0000","last_undegraded":"2024-09-12T01:26:26.260572+0000","last_fullsized":"2024-09-12T01:26:26.260572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266274+0000","last_change":"2024-09-12T01:26:12.422742+0000","last_active":"2024-09-12T01:26:26.266274+0000","last_peered":"2024-09-12T01:26:26.266274+0000","last_clean":"2024-09-12T01:26:26.266274+0000","last_became_active":"2024-09-12T01:26:12.421914+0000","last_became_peered":"2024-09-12T01:26:12.421914+0000","last_unstale":"2024-09-12T01:26:26.266274+0000","last_undegraded":"2024-09-12T01:26:26.266274+0000","last_fullsized":"2024-09-12T01:26:26.266274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:53.427112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269168+0000","last_change":"2024-09-12T01:26:14.430425+0000","last_active":"2024-09-12T01:26:26.269168+0000","last_peered":"2024-09-12T01:26:26.269168+0000","last_clean":"2024-09-12T01:26:26.269168+0000","last_became_active":"2024-09-12T01:26:14.430128+0000","last_became_peered":"2024-09-12T01:26:14.430128+0000","last_unstale":"2024-09-12T01:26:26.269168+0000","last_undegraded":"2024-09-12T01:26:26.269168+0000","last_fullsized":"2024-09-12T01:26:26.269168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:17.653908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263276+0000","last_change":"2024-09-12T01:26:12.421463+0000","last_active":"2024-09-12T01:26:26.263276+0000","last_peered":"2024-09-12T01:26:26.263276+0000","last_clean":"2024-09-12T01:26:26.263276+0000","last_became_active":"2024-09-12T01:26:12.421143+0000","last_became_peered":"2024-09-12T01:26:12.421143+0000","last_unstale":"2024-09-12T01:26:26.263276+0000","last_undegraded":"2024-09-12T01:26:26.263276+0000","last_fullsized":"2024-09-12T01:26:26.263276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:09.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267454+0000","last_change":"2024-09-12T01:26:14.428643+0000","last_active":"2024-09-12T01:26:26.267454+0000","last_peered":"2024-09-12T01:26:26.267454+0000","last_clean":"2024-09-12T01:26:26.267454+0000","last_became_active":"2024-09-12T01:26:14.428344+0000","last_became_peered":"2024-09-12T01:26:14.428344+0000","last_unstale":"2024-09-12T01:26:26.267454+0000","last_undegraded":"2024-09-12T01:26:26.267454+0000","last_fullsized":"2024-09-12T01:26:26.267454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:17.213238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263512+0000","last_change":"2024-09-12T01:26:14.435108+0000","last_active":"2024-09-12T01:26:26.263512+0000","last_peered":"2024-09-12T01:26:26.263512+0000","last_clean":"2024-09-12T01:26:26.263512+0000","last_became_active":"2024-09-12T01:26:14.434806+0000","last_became_peered":"2024-09-12T01:26:14.434806+0000","last_unstale":"2024-09-12T01:26:26.263512+0000","last_undegraded":"2024-09-12T01:26:26.263512+0000","last_fullsized":"2024-09-12T01:26:26.263512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:01.188981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264537+0000","last_change":"2024-09-12T01:26:12.419027+0000","last_active":"2024-09-12T01:26:26.264537+0000","last_peered":"2024-09-12T01:26:26.264537+0000","last_clean":"2024-09-12T01:26:26.264537+0000","last_became_active":"2024-09-12T01:26:12.418579+0000","last_became_peered":"2024-09-12T01:26:12.418579+0000","last_unstale":"2024-09-12T01:26:26.264537+0000","last_undegraded":"2024-09-12T01:26:26.264537+0000","last_fullsized":"2024-09-12T01:26:26.264537+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.119864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281245+0000","last_change":"2024-09-12T01:26:14.429532+0000","last_active":"2024-09-12T01:26:26.281245+0000","last_peered":"2024-09-12T01:26:26.281245+0000","last_clean":"2024-09-12T01:26:26.281245+0000","last_became_active":"2024-09-12T01:26:14.429134+0000","last_became_peered":"2024-09-12T01:26:14.429134+0000","last_unstale":"2024-09-12T01:26:26.281245+0000","last_undegraded":"2024-09-12T01:26:26.281245+0000","last_fullsized":"2024-09-12T01:26:26.281245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:47.403388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.488999+0000","last_change":"2024-09-12T01:26:26.279322+0000","last_active":"2024-09-12T01:26:26.488999+0000","last_peered":"2024-09-12T01:26:26.488999+0000","last_clean":"2024-09-12T01:26:26.488999+0000","last_became_active":"2024-09-12T01:26:26.268752+0000","last_became_peered":"2024-09-12T01:26:26.268752+0000","last_unstale":"2024-09-12T01:26:26.488999+0000","last_undegraded":"2024-09-12T01:26:26.488999+0000","last_fullsized":"2024-09-12T01:26:26.488999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.411144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264547+0000","last_change":"2024-09-12T01:26:14.430831+0000","last_active":"2024-09-12T01:26:26.264547+0000","last_peered":"2024-09-12T01:26:26.264547+0000","last_clean":"2024-09-12T01:26:26.264547+0000","last_became_active":"2024-09-12T01:26:14.430531+0000","last_became_peered":"2024-09-12T01:26:14.430531+0000","last_unstale":"2024-09-12T01:26:26.264547+0000","last_undegraded":"2024-09-12T01:26:26.264547+0000","last_fullsized":"2024-09-12T01:26:26.264547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:02.522283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269397+0000","last_change":"2024-09-12T01:26:12.799921+0000","last_active":"2024-09-12T01:26:26.269397+0000","last_peered":"2024-09-12T01:26:26.269397+0000","last_clean":"2024-09-12T01:26:26.269397+0000","last_became_active":"2024-09-12T01:26:12.799608+0000","last_became_peered":"2024-09-12T01:26:12.799608+0000","last_unstale":"2024-09-12T01:26:26.269397+0000","last_undegraded":"2024-09-12T01:26:26.269397+0000","last_fullsized":"2024-09-12T01:26:26.269397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:00.821261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269287+0000","last_change":"2024-09-12T01:26:14.430937+0000","last_active":"2024-09-12T01:26:26.269287+0000","last_peered":"2024-09-12T01:26:26.269287+0000","last_clean":"2024-09-12T01:26:26.269287+0000","last_became_active":"2024-09-12T01:26:14.430656+0000","last_became_peered":"2024-09-12T01:26:14.430656+0000","last_unstale":"2024-09-12T01:26:26.269287+0000","last_undegraded":"2024-09-12T01:26:26.269287+0000","last_fullsized":"2024-09-12T01:26:26.269287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.874150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.503099+0000","last_change":"2024-09-12T01:26:12.419000+0000","last_active":"2024-09-12T01:26:34.503099+0000","last_peered":"2024-09-12T01:26:34.503099+0000","last_clean":"2024-09-12T01:26:34.503099+0000","last_became_active":"2024-09-12T01:26:12.418736+0000","last_became_peered":"2024-09-12T01:26:12.418736+0000","last_unstale":"2024-09-12T01:26:34.503099+0000","last_undegraded":"2024-09-12T01:26:34.503099+0000","last_fullsized":"2024-09-12T01:26:34.503099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:31.586983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56927,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":149,"num_read_kb":137,"num_write":232,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":170781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":905216,"data_stored":436466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36900,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708252,"statfs":{"total":95995035648,"available":95957250048,"internally_reserved":0,"allocated":1593344,"data_stored":1077978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972379,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":436374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201312,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":436730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462948,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1519616,"data_stored":1029272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":436091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855406,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1028557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986228,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":436345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":435916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":487336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":487116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":929792,"data_stored":437430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":51864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":52084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":52241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:26:39.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:26:40.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:39 smithi100 ceph-mon[35275]: pgmap v289: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.0 KiB/s wr, 18 op/s; 1 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T01:26:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:40.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:40 smithi081 ceph-mon[30920]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:26:40.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 -- 172.21.15.81:0/2684573155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3830106a90 msgr2=0x7f3830106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:40.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 --2- 172.21.15.81:0/2684573155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3830106a90 0x7f3830106e70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3820009930 tx=0x7f382002a420 comp rx=0 tx=0).stop 2024-09-12T01:26:40.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 -- 172.21.15.81:0/2684573155 shutdown_connections 2024-09-12T01:26:40.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 --2- 172.21.15.81:0/2684573155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3830101430 0x7f383010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 --2- 172.21.15.81:0/2684573155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3830100a90 0x7f3830100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 --2- 172.21.15.81:0/2684573155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3830106a90 0x7f3830106e70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 -- 172.21.15.81:0/2684573155 >> 172.21.15.81:0/2684573155 conn(0x7f38300fc7d0 msgr2=0x7f38300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 -- 172.21.15.81:0/2684573155 shutdown_connections 2024-09-12T01:26:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 -- 172.21.15.81:0/2684573155 wait complete. 2024-09-12T01:26:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 Processor -- start 2024-09-12T01:26:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 -- start start 2024-09-12T01:26:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3830100a90 0x7f3830198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3830101430 0x7f3830198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.692+0000 7f383630a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3830106a90 0x7f383019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f383630a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3830110eb0 con 0x7f3830100a90 2024-09-12T01:26:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f383630a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3830110d30 con 0x7f3830106a90 2024-09-12T01:26:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f383630a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3830111030 con 0x7f3830101430 2024-09-12T01:26:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f382ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3830100a90 0x7f3830198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f382ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3830100a90 0x7f3830198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51288/0 (socket says 172.21.15.81:51288) 2024-09-12T01:26:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f382ffff640 1 -- 172.21.15.81:0/2494167751 learned_addr learned my addr 172.21.15.81:0/2494167751 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f3827fff640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3830101430 0x7f3830198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f382ffff640 1 -- 172.21.15.81:0/2494167751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3830101430 msgr2=0x7f3830198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f38348a7640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3830106a90 0x7f383019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f382ffff640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3830101430 0x7f3830198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f382ffff640 1 -- 172.21.15.81:0/2494167751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3830106a90 msgr2=0x7f383019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f382ffff640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3830106a90 0x7f383019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:40.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f382ffff640 1 -- 172.21.15.81:0/2494167751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383019d3b0 con 0x7f3830100a90 2024-09-12T01:26:40.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f38348a7640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3830106a90 0x7f383019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:26:40.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f382ffff640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3830100a90 0x7f3830198400 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3820009a50 tx=0x7f3820004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:40.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f382dffb640 1 -- 172.21.15.81:0/2494167751 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382003f030 con 0x7f3830100a90 2024-09-12T01:26:40.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f382dffb640 1 -- 172.21.15.81:0/2494167751 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3820003ce0 con 0x7f3830100a90 2024-09-12T01:26:40.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f383630a640 1 -- 172.21.15.81:0/2494167751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383019d640 con 0x7f3830100a90 2024-09-12T01:26:40.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f382dffb640 1 -- 172.21.15.81:0/2494167751 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820035070 con 0x7f3830100a90 2024-09-12T01:26:40.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.693+0000 7f383630a640 1 -- 172.21.15.81:0/2494167751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38301a4f80 con 0x7f3830100a90 2024-09-12T01:26:40.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.694+0000 7f383630a640 1 -- 172.21.15.81:0/2494167751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38301021d0 con 0x7f3830100a90 2024-09-12T01:26:40.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.696+0000 7f382dffb640 1 -- 172.21.15.81:0/2494167751 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3820042030 con 0x7f3830100a90 2024-09-12T01:26:40.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.696+0000 7f382dffb640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f381c0a2c10 0x7f381c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:40.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.696+0000 7f3827fff640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f381c0a2c10 0x7f381c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:40.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.696+0000 7f382dffb640 1 -- 172.21.15.81:0/2494167751 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f38200ef7f0 con 0x7f3830100a90 2024-09-12T01:26:40.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.697+0000 7f3827fff640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f381c0a2c10 0x7f381c0a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3818005e10 tx=0x7f3818005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.701+0000 7f382dffb640 1 -- 172.21.15.81:0/2494167751 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f38200bc600 con 0x7f3830100a90 2024-09-12T01:26:40.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:40 smithi189 ceph-mon[35357]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:26:40.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.864+0000 7f383630a640 1 -- 172.21.15.81:0/2494167751 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f383010a080 con 0x7f381c0a2c10 2024-09-12T01:26:40.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.870+0000 7f382dffb640 1 -- 172.21.15.81:0/2494167751 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258763 (secure 0 0 0) 0x7f381800eac0 con 0x7f381c0a2c10 2024-09-12T01:26:40.872 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:26:40.873 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T01:26:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.873+0000 7f383630a640 1 -- 172.21.15.81:0/2494167751 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f381c0a2c10 msgr2=0x7f381c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.873+0000 7f383630a640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f381c0a2c10 0x7f381c0a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3818005e10 tx=0x7f3818005da0 comp rx=0 tx=0).stop 2024-09-12T01:26:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.873+0000 7f383630a640 1 -- 172.21.15.81:0/2494167751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3830100a90 msgr2=0x7f3830198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.873+0000 7f383630a640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3830100a90 0x7f3830198400 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3820009a50 tx=0x7f3820004270 comp rx=0 tx=0).stop 2024-09-12T01:26:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.873+0000 7f383630a640 1 -- 172.21.15.81:0/2494167751 shutdown_connections 2024-09-12T01:26:40.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.873+0000 7f383630a640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f381c0a2c10 0x7f381c0a50d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.873+0000 7f383630a640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3830106a90 0x7f383019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.873+0000 7f383630a640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3830101430 0x7f3830198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.873+0000 7f383630a640 1 --2- 172.21.15.81:0/2494167751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3830100a90 0x7f3830198400 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.873+0000 7f383630a640 1 -- 172.21.15.81:0/2494167751 >> 172.21.15.81:0/2494167751 conn(0x7f38300fc7d0 msgr2=0x7f383006a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.874+0000 7f383630a640 1 -- 172.21.15.81:0/2494167751 shutdown_connections 2024-09-12T01:26:40.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:40.874+0000 7f383630a640 1 -- 172.21.15.81:0/2494167751 wait complete. 2024-09-12T01:26:41.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:40 smithi100 ceph-mon[35275]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:26:41.622 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-09-12T01:26:40.431741+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647529,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":285,"num_read_kb":256,"num_write":415,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180758,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374460,"kb_used_data":12712,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567364,"statfs":{"total":1151940427776,"available":1151556980736,"internally_reserved":0,"allocated":13017088,"data_stored":7169868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49127,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":115,"num_read_kb":111,"num_write":37,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002879"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260973+0000","last_change":"2024-09-12T01:26:14.433907+0000","last_active":"2024-09-12T01:26:26.260973+0000","last_peered":"2024-09-12T01:26:26.260973+0000","last_clean":"2024-09-12T01:26:26.260973+0000","last_became_active":"2024-09-12T01:26:14.433495+0000","last_became_peered":"2024-09-12T01:26:14.433495+0000","last_unstale":"2024-09-12T01:26:26.260973+0000","last_undegraded":"2024-09-12T01:26:26.260973+0000","last_fullsized":"2024-09-12T01:26:26.260973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:12.836491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264454+0000","last_change":"2024-09-12T01:26:14.430873+0000","last_active":"2024-09-12T01:26:26.264454+0000","last_peered":"2024-09-12T01:26:26.264454+0000","last_clean":"2024-09-12T01:26:26.264454+0000","last_became_active":"2024-09-12T01:26:14.430572+0000","last_became_peered":"2024-09-12T01:26:14.430572+0000","last_unstale":"2024-09-12T01:26:26.264454+0000","last_undegraded":"2024-09-12T01:26:26.264454+0000","last_fullsized":"2024-09-12T01:26:26.264454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:15.160712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264571+0000","last_change":"2024-09-12T01:26:14.426117+0000","last_active":"2024-09-12T01:26:26.264571+0000","last_peered":"2024-09-12T01:26:26.264571+0000","last_clean":"2024-09-12T01:26:26.264571+0000","last_became_active":"2024-09-12T01:26:14.425831+0000","last_became_peered":"2024-09-12T01:26:14.425831+0000","last_unstale":"2024-09-12T01:26:26.264571+0000","last_undegraded":"2024-09-12T01:26:26.264571+0000","last_fullsized":"2024-09-12T01:26:26.264571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:15.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262656+0000","last_change":"2024-09-12T01:26:14.434545+0000","last_active":"2024-09-12T01:26:26.262656+0000","last_peered":"2024-09-12T01:26:26.262656+0000","last_clean":"2024-09-12T01:26:26.262656+0000","last_became_active":"2024-09-12T01:26:14.434222+0000","last_became_peered":"2024-09-12T01:26:14.434222+0000","last_unstale":"2024-09-12T01:26:26.262656+0000","last_undegraded":"2024-09-12T01:26:26.262656+0000","last_fullsized":"2024-09-12T01:26:26.262656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:36.789145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263142+0000","last_change":"2024-09-12T01:26:14.421900+0000","last_active":"2024-09-12T01:26:26.263142+0000","last_peered":"2024-09-12T01:26:26.263142+0000","last_clean":"2024-09-12T01:26:26.263142+0000","last_became_active":"2024-09-12T01:26:14.421558+0000","last_became_peered":"2024-09-12T01:26:14.421558+0000","last_unstale":"2024-09-12T01:26:26.263142+0000","last_undegraded":"2024-09-12T01:26:26.263142+0000","last_fullsized":"2024-09-12T01:26:26.263142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262080+0000","last_change":"2024-09-12T01:26:14.436641+0000","last_active":"2024-09-12T01:26:26.262080+0000","last_peered":"2024-09-12T01:26:26.262080+0000","last_clean":"2024-09-12T01:26:26.262080+0000","last_became_active":"2024-09-12T01:26:14.436347+0000","last_became_peered":"2024-09-12T01:26:14.436347+0000","last_unstale":"2024-09-12T01:26:26.262080+0000","last_undegraded":"2024-09-12T01:26:26.262080+0000","last_fullsized":"2024-09-12T01:26:26.262080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:52.756035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267385+0000","last_change":"2024-09-12T01:26:14.438676+0000","last_active":"2024-09-12T01:26:26.267385+0000","last_peered":"2024-09-12T01:26:26.267385+0000","last_clean":"2024-09-12T01:26:26.267385+0000","last_became_active":"2024-09-12T01:26:14.438332+0000","last_became_peered":"2024-09-12T01:26:14.438332+0000","last_unstale":"2024-09-12T01:26:26.267385+0000","last_undegraded":"2024-09-12T01:26:26.267385+0000","last_fullsized":"2024-09-12T01:26:26.267385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:06.459830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268827+0000","last_change":"2024-09-12T01:26:14.431676+0000","last_active":"2024-09-12T01:26:26.268827+0000","last_peered":"2024-09-12T01:26:26.268827+0000","last_clean":"2024-09-12T01:26:26.268827+0000","last_became_active":"2024-09-12T01:26:14.431378+0000","last_became_peered":"2024-09-12T01:26:14.431378+0000","last_unstale":"2024-09-12T01:26:26.268827+0000","last_undegraded":"2024-09-12T01:26:26.268827+0000","last_fullsized":"2024-09-12T01:26:26.268827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:23.523350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281590+0000","last_change":"2024-09-12T01:26:14.428381+0000","last_active":"2024-09-12T01:26:26.281590+0000","last_peered":"2024-09-12T01:26:26.281590+0000","last_clean":"2024-09-12T01:26:26.281590+0000","last_became_active":"2024-09-12T01:26:14.428031+0000","last_became_peered":"2024-09-12T01:26:14.428031+0000","last_unstale":"2024-09-12T01:26:26.281590+0000","last_undegraded":"2024-09-12T01:26:26.281590+0000","last_fullsized":"2024-09-12T01:26:26.281590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:40.920911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263022+0000","last_change":"2024-09-12T01:26:14.438849+0000","last_active":"2024-09-12T01:26:26.263022+0000","last_peered":"2024-09-12T01:26:26.263022+0000","last_clean":"2024-09-12T01:26:26.263022+0000","last_became_active":"2024-09-12T01:26:14.438510+0000","last_became_peered":"2024-09-12T01:26:14.438510+0000","last_unstale":"2024-09-12T01:26:26.263022+0000","last_undegraded":"2024-09-12T01:26:26.263022+0000","last_fullsized":"2024-09-12T01:26:26.263022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:12.257292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267570+0000","last_change":"2024-09-12T01:26:14.436468+0000","last_active":"2024-09-12T01:26:26.267570+0000","last_peered":"2024-09-12T01:26:26.267570+0000","last_clean":"2024-09-12T01:26:26.267570+0000","last_became_active":"2024-09-12T01:26:14.436095+0000","last_became_peered":"2024-09-12T01:26:14.436095+0000","last_unstale":"2024-09-12T01:26:26.267570+0000","last_undegraded":"2024-09-12T01:26:26.267570+0000","last_fullsized":"2024-09-12T01:26:26.267570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:43.441358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262728+0000","last_change":"2024-09-12T01:26:14.431384+0000","last_active":"2024-09-12T01:26:26.262728+0000","last_peered":"2024-09-12T01:26:26.262728+0000","last_clean":"2024-09-12T01:26:26.262728+0000","last_became_active":"2024-09-12T01:26:14.431079+0000","last_became_peered":"2024-09-12T01:26:14.431079+0000","last_unstale":"2024-09-12T01:26:26.262728+0000","last_undegraded":"2024-09-12T01:26:26.262728+0000","last_fullsized":"2024-09-12T01:26:26.262728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.178038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259683+0000","last_change":"2024-09-12T01:26:14.430163+0000","last_active":"2024-09-12T01:26:26.259683+0000","last_peered":"2024-09-12T01:26:26.259683+0000","last_clean":"2024-09-12T01:26:26.259683+0000","last_became_active":"2024-09-12T01:26:14.429863+0000","last_became_peered":"2024-09-12T01:26:14.429863+0000","last_unstale":"2024-09-12T01:26:26.259683+0000","last_undegraded":"2024-09-12T01:26:26.259683+0000","last_fullsized":"2024-09-12T01:26:26.259683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:44.432677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264436+0000","last_change":"2024-09-12T01:26:14.427304+0000","last_active":"2024-09-12T01:26:26.264436+0000","last_peered":"2024-09-12T01:26:26.264436+0000","last_clean":"2024-09-12T01:26:26.264436+0000","last_became_active":"2024-09-12T01:26:14.427006+0000","last_became_peered":"2024-09-12T01:26:14.427006+0000","last_unstale":"2024-09-12T01:26:26.264436+0000","last_undegraded":"2024-09-12T01:26:26.264436+0000","last_fullsized":"2024-09-12T01:26:26.264436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.930959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264315+0000","last_change":"2024-09-12T01:26:14.431018+0000","last_active":"2024-09-12T01:26:26.264315+0000","last_peered":"2024-09-12T01:26:26.264315+0000","last_clean":"2024-09-12T01:26:26.264315+0000","last_became_active":"2024-09-12T01:26:14.429518+0000","last_became_peered":"2024-09-12T01:26:14.429518+0000","last_unstale":"2024-09-12T01:26:26.264315+0000","last_undegraded":"2024-09-12T01:26:26.264315+0000","last_fullsized":"2024-09-12T01:26:26.264315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.504814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281095+0000","last_change":"2024-09-12T01:26:14.430601+0000","last_active":"2024-09-12T01:26:26.281095+0000","last_peered":"2024-09-12T01:26:26.281095+0000","last_clean":"2024-09-12T01:26:26.281095+0000","last_became_active":"2024-09-12T01:26:14.430304+0000","last_became_peered":"2024-09-12T01:26:14.430304+0000","last_unstale":"2024-09-12T01:26:26.281095+0000","last_undegraded":"2024-09-12T01:26:26.281095+0000","last_fullsized":"2024-09-12T01:26:26.281095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.414767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.261070+0000","last_change":"2024-09-12T01:26:14.432934+0000","last_active":"2024-09-12T01:26:26.261070+0000","last_peered":"2024-09-12T01:26:26.261070+0000","last_clean":"2024-09-12T01:26:26.261070+0000","last_became_active":"2024-09-12T01:26:14.432417+0000","last_became_peered":"2024-09-12T01:26:14.432417+0000","last_unstale":"2024-09-12T01:26:26.261070+0000","last_undegraded":"2024-09-12T01:26:26.261070+0000","last_fullsized":"2024-09-12T01:26:26.261070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.964880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262645+0000","last_change":"2024-09-12T01:26:14.429956+0000","last_active":"2024-09-12T01:26:26.262645+0000","last_peered":"2024-09-12T01:26:26.262645+0000","last_clean":"2024-09-12T01:26:26.262645+0000","last_became_active":"2024-09-12T01:26:14.429610+0000","last_became_peered":"2024-09-12T01:26:14.429610+0000","last_unstale":"2024-09-12T01:26:26.262645+0000","last_undegraded":"2024-09-12T01:26:26.262645+0000","last_fullsized":"2024-09-12T01:26:26.262645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:51.453221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266186+0000","last_change":"2024-09-12T01:26:14.423624+0000","last_active":"2024-09-12T01:26:26.266186+0000","last_peered":"2024-09-12T01:26:26.266186+0000","last_clean":"2024-09-12T01:26:26.266186+0000","last_became_active":"2024-09-12T01:26:14.423314+0000","last_became_peered":"2024-09-12T01:26:14.423314+0000","last_unstale":"2024-09-12T01:26:26.266186+0000","last_undegraded":"2024-09-12T01:26:26.266186+0000","last_fullsized":"2024-09-12T01:26:26.266186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.414323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260452+0000","last_change":"2024-09-12T01:26:14.433548+0000","last_active":"2024-09-12T01:26:26.260452+0000","last_peered":"2024-09-12T01:26:26.260452+0000","last_clean":"2024-09-12T01:26:26.260452+0000","last_became_active":"2024-09-12T01:26:14.433223+0000","last_became_peered":"2024-09-12T01:26:14.433223+0000","last_unstale":"2024-09-12T01:26:26.260452+0000","last_undegraded":"2024-09-12T01:26:26.260452+0000","last_fullsized":"2024-09-12T01:26:26.260452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.247354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259705+0000","last_change":"2024-09-12T01:26:14.431715+0000","last_active":"2024-09-12T01:26:26.259705+0000","last_peered":"2024-09-12T01:26:26.259705+0000","last_clean":"2024-09-12T01:26:26.259705+0000","last_became_active":"2024-09-12T01:26:14.430839+0000","last_became_peered":"2024-09-12T01:26:14.430839+0000","last_unstale":"2024-09-12T01:26:26.259705+0000","last_undegraded":"2024-09-12T01:26:26.259705+0000","last_fullsized":"2024-09-12T01:26:26.259705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:04.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281598+0000","last_change":"2024-09-12T01:26:14.431385+0000","last_active":"2024-09-12T01:26:26.281598+0000","last_peered":"2024-09-12T01:26:26.281598+0000","last_clean":"2024-09-12T01:26:26.281598+0000","last_became_active":"2024-09-12T01:26:14.431046+0000","last_became_peered":"2024-09-12T01:26:14.431046+0000","last_unstale":"2024-09-12T01:26:26.281598+0000","last_undegraded":"2024-09-12T01:26:26.281598+0000","last_fullsized":"2024-09-12T01:26:26.281598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:42.495019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268877+0000","last_change":"2024-09-12T01:26:14.427737+0000","last_active":"2024-09-12T01:26:26.268877+0000","last_peered":"2024-09-12T01:26:26.268877+0000","last_clean":"2024-09-12T01:26:26.268877+0000","last_became_active":"2024-09-12T01:26:14.427409+0000","last_became_peered":"2024-09-12T01:26:14.427409+0000","last_unstale":"2024-09-12T01:26:26.268877+0000","last_undegraded":"2024-09-12T01:26:26.268877+0000","last_fullsized":"2024-09-12T01:26:26.268877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:02.632914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265224+0000","last_change":"2024-09-12T01:26:14.433426+0000","last_active":"2024-09-12T01:26:26.265224+0000","last_peered":"2024-09-12T01:26:26.265224+0000","last_clean":"2024-09-12T01:26:26.265224+0000","last_became_active":"2024-09-12T01:26:14.431918+0000","last_became_peered":"2024-09-12T01:26:14.431918+0000","last_unstale":"2024-09-12T01:26:26.265224+0000","last_undegraded":"2024-09-12T01:26:26.265224+0000","last_fullsized":"2024-09-12T01:26:26.265224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.946072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269048+0000","last_change":"2024-09-12T01:26:26.268358+0000","last_active":"2024-09-12T01:26:26.269048+0000","last_peered":"2024-09-12T01:26:26.269048+0000","last_clean":"2024-09-12T01:26:26.269048+0000","last_became_active":"2024-09-12T01:26:26.268005+0000","last_became_peered":"2024-09-12T01:26:26.268005+0000","last_unstale":"2024-09-12T01:26:26.269048+0000","last_undegraded":"2024-09-12T01:26:26.269048+0000","last_fullsized":"2024-09-12T01:26:26.269048+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:53.977249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266391+0000","last_change":"2024-09-12T01:26:14.434536+0000","last_active":"2024-09-12T01:26:26.266391+0000","last_peered":"2024-09-12T01:26:26.266391+0000","last_clean":"2024-09-12T01:26:26.266391+0000","last_became_active":"2024-09-12T01:26:14.434148+0000","last_became_peered":"2024-09-12T01:26:14.434148+0000","last_unstale":"2024-09-12T01:26:26.266391+0000","last_undegraded":"2024-09-12T01:26:26.266391+0000","last_fullsized":"2024-09-12T01:26:26.266391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:47.576827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260633+0000","last_change":"2024-09-12T01:26:14.428040+0000","last_active":"2024-09-12T01:26:26.260633+0000","last_peered":"2024-09-12T01:26:26.260633+0000","last_clean":"2024-09-12T01:26:26.260633+0000","last_became_active":"2024-09-12T01:26:14.427709+0000","last_became_peered":"2024-09-12T01:26:14.427709+0000","last_unstale":"2024-09-12T01:26:26.260633+0000","last_undegraded":"2024-09-12T01:26:26.260633+0000","last_fullsized":"2024-09-12T01:26:26.260633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.256097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265649+0000","last_change":"2024-09-12T01:26:26.265649+0000","last_active":"2024-09-12T01:26:26.265649+0000","last_peered":"2024-09-12T01:26:26.265649+0000","last_clean":"2024-09-12T01:26:26.265649+0000","last_became_active":"2024-09-12T01:26:26.265251+0000","last_became_peered":"2024-09-12T01:26:26.265251+0000","last_unstale":"2024-09-12T01:26:26.265649+0000","last_undegraded":"2024-09-12T01:26:26.265649+0000","last_fullsized":"2024-09-12T01:26:26.265649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:31.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264674+0000","last_change":"2024-09-12T01:26:14.427596+0000","last_active":"2024-09-12T01:26:26.264674+0000","last_peered":"2024-09-12T01:26:26.264674+0000","last_clean":"2024-09-12T01:26:26.264674+0000","last_became_active":"2024-09-12T01:26:14.427291+0000","last_became_peered":"2024-09-12T01:26:14.427291+0000","last_unstale":"2024-09-12T01:26:26.264674+0000","last_undegraded":"2024-09-12T01:26:26.264674+0000","last_fullsized":"2024-09-12T01:26:26.264674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:51.529835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265856+0000","last_change":"2024-09-12T01:26:14.424197+0000","last_active":"2024-09-12T01:26:26.265856+0000","last_peered":"2024-09-12T01:26:26.265856+0000","last_clean":"2024-09-12T01:26:26.265856+0000","last_became_active":"2024-09-12T01:26:14.423422+0000","last_became_peered":"2024-09-12T01:26:14.423422+0000","last_unstale":"2024-09-12T01:26:26.265856+0000","last_undegraded":"2024-09-12T01:26:26.265856+0000","last_fullsized":"2024-09-12T01:26:26.265856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.725623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265870+0000","last_change":"2024-09-12T01:26:14.428116+0000","last_active":"2024-09-12T01:26:26.265870+0000","last_peered":"2024-09-12T01:26:26.265870+0000","last_clean":"2024-09-12T01:26:26.265870+0000","last_became_active":"2024-09-12T01:26:14.427804+0000","last_became_peered":"2024-09-12T01:26:14.427804+0000","last_unstale":"2024-09-12T01:26:26.265870+0000","last_undegraded":"2024-09-12T01:26:26.265870+0000","last_fullsized":"2024-09-12T01:26:26.265870+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:02.271305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260460+0000","last_change":"2024-09-12T01:26:14.432659+0000","last_active":"2024-09-12T01:26:26.260460+0000","last_peered":"2024-09-12T01:26:26.260460+0000","last_clean":"2024-09-12T01:26:26.260460+0000","last_became_active":"2024-09-12T01:26:14.432331+0000","last_became_peered":"2024-09-12T01:26:14.432331+0000","last_unstale":"2024-09-12T01:26:26.260460+0000","last_undegraded":"2024-09-12T01:26:26.260460+0000","last_fullsized":"2024-09-12T01:26:26.260460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.868909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263975+0000","last_change":"2024-09-12T01:26:14.426167+0000","last_active":"2024-09-12T01:26:26.263975+0000","last_peered":"2024-09-12T01:26:26.263975+0000","last_clean":"2024-09-12T01:26:26.263975+0000","last_became_active":"2024-09-12T01:26:14.425847+0000","last_became_peered":"2024-09-12T01:26:14.425847+0000","last_unstale":"2024-09-12T01:26:26.263975+0000","last_undegraded":"2024-09-12T01:26:26.263975+0000","last_fullsized":"2024-09-12T01:26:26.263975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:39.481527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.277446+0000","last_change":"2024-09-12T01:26:12.421487+0000","last_active":"2024-09-12T01:26:34.277446+0000","last_peered":"2024-09-12T01:26:34.277446+0000","last_clean":"2024-09-12T01:26:34.277446+0000","last_became_active":"2024-09-12T01:26:12.421096+0000","last_became_peered":"2024-09-12T01:26:12.421096+0000","last_unstale":"2024-09-12T01:26:34.277446+0000","last_undegraded":"2024-09-12T01:26:34.277446+0000","last_fullsized":"2024-09-12T01:26:34.277446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:12.410280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.270310+0000","last_change":"2024-09-12T01:26:26.270310+0000","last_active":"2024-09-12T01:26:26.270310+0000","last_peered":"2024-09-12T01:26:26.270310+0000","last_clean":"2024-09-12T01:26:26.270310+0000","last_became_active":"2024-09-12T01:26:26.269917+0000","last_became_peered":"2024-09-12T01:26:26.269917+0000","last_unstale":"2024-09-12T01:26:26.270310+0000","last_undegraded":"2024-09-12T01:26:26.270310+0000","last_fullsized":"2024-09-12T01:26:26.270310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:29.549456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.287218+0000","last_change":"2024-09-12T01:26:26.287218+0000","last_active":"2024-09-12T01:26:26.287218+0000","last_peered":"2024-09-12T01:26:26.287218+0000","last_clean":"2024-09-12T01:26:26.287218+0000","last_became_active":"2024-09-12T01:26:26.282251+0000","last_became_peered":"2024-09-12T01:26:26.282251+0000","last_unstale":"2024-09-12T01:26:26.287218+0000","last_undegraded":"2024-09-12T01:26:26.287218+0000","last_fullsized":"2024-09-12T01:26:26.287218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:53.888064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259505+0000","last_change":"2024-09-12T01:26:12.416100+0000","last_active":"2024-09-12T01:26:26.259505+0000","last_peered":"2024-09-12T01:26:26.259505+0000","last_clean":"2024-09-12T01:26:26.259505+0000","last_became_active":"2024-09-12T01:26:12.415799+0000","last_became_peered":"2024-09-12T01:26:12.415799+0000","last_unstale":"2024-09-12T01:26:26.259505+0000","last_undegraded":"2024-09-12T01:26:26.259505+0000","last_fullsized":"2024-09-12T01:26:26.259505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:41.826537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268900+0000","last_change":"2024-09-12T01:26:14.424922+0000","last_active":"2024-09-12T01:26:26.268900+0000","last_peered":"2024-09-12T01:26:26.268900+0000","last_clean":"2024-09-12T01:26:26.268900+0000","last_became_active":"2024-09-12T01:26:14.424580+0000","last_became_peered":"2024-09-12T01:26:14.424580+0000","last_unstale":"2024-09-12T01:26:26.268900+0000","last_undegraded":"2024-09-12T01:26:26.268900+0000","last_fullsized":"2024-09-12T01:26:26.268900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:05.697287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265114+0000","last_change":"2024-09-12T01:26:12.419339+0000","last_active":"2024-09-12T01:26:26.265114+0000","last_peered":"2024-09-12T01:26:26.265114+0000","last_clean":"2024-09-12T01:26:26.265114+0000","last_became_active":"2024-09-12T01:26:12.418925+0000","last_became_peered":"2024-09-12T01:26:12.418925+0000","last_unstale":"2024-09-12T01:26:26.265114+0000","last_undegraded":"2024-09-12T01:26:26.265114+0000","last_fullsized":"2024-09-12T01:26:26.265114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.390691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262458+0000","last_change":"2024-09-12T01:26:14.426611+0000","last_active":"2024-09-12T01:26:26.262458+0000","last_peered":"2024-09-12T01:26:26.262458+0000","last_clean":"2024-09-12T01:26:26.262458+0000","last_became_active":"2024-09-12T01:26:14.426268+0000","last_became_peered":"2024-09-12T01:26:14.426268+0000","last_unstale":"2024-09-12T01:26:26.262458+0000","last_undegraded":"2024-09-12T01:26:26.262458+0000","last_fullsized":"2024-09-12T01:26:26.262458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:34.676841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.277928+0000","last_change":"2024-09-12T01:26:12.420302+0000","last_active":"2024-09-12T01:26:35.277928+0000","last_peered":"2024-09-12T01:26:35.277928+0000","last_clean":"2024-09-12T01:26:35.277928+0000","last_became_active":"2024-09-12T01:26:12.419943+0000","last_became_peered":"2024-09-12T01:26:12.419943+0000","last_unstale":"2024-09-12T01:26:35.277928+0000","last_undegraded":"2024-09-12T01:26:35.277928+0000","last_fullsized":"2024-09-12T01:26:35.277928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:30.704272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281551+0000","last_change":"2024-09-12T01:26:14.433112+0000","last_active":"2024-09-12T01:26:26.281551+0000","last_peered":"2024-09-12T01:26:26.281551+0000","last_clean":"2024-09-12T01:26:26.281551+0000","last_became_active":"2024-09-12T01:26:14.432803+0000","last_became_peered":"2024-09-12T01:26:14.432803+0000","last_unstale":"2024-09-12T01:26:26.281551+0000","last_undegraded":"2024-09-12T01:26:26.281551+0000","last_fullsized":"2024-09-12T01:26:26.281551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:33.670485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267615+0000","last_change":"2024-09-12T01:26:12.424854+0000","last_active":"2024-09-12T01:26:26.267615+0000","last_peered":"2024-09-12T01:26:26.267615+0000","last_clean":"2024-09-12T01:26:26.267615+0000","last_became_active":"2024-09-12T01:26:12.424476+0000","last_became_peered":"2024-09-12T01:26:12.424476+0000","last_unstale":"2024-09-12T01:26:26.267615+0000","last_undegraded":"2024-09-12T01:26:26.267615+0000","last_fullsized":"2024-09-12T01:26:26.267615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:03.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264526+0000","last_change":"2024-09-12T01:26:14.431580+0000","last_active":"2024-09-12T01:26:26.264526+0000","last_peered":"2024-09-12T01:26:26.264526+0000","last_clean":"2024-09-12T01:26:26.264526+0000","last_became_active":"2024-09-12T01:26:14.431237+0000","last_became_peered":"2024-09-12T01:26:14.431237+0000","last_unstale":"2024-09-12T01:26:26.264526+0000","last_undegraded":"2024-09-12T01:26:26.264526+0000","last_fullsized":"2024-09-12T01:26:26.264526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:32.562156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263620+0000","last_change":"2024-09-12T01:26:12.802015+0000","last_active":"2024-09-12T01:26:26.263620+0000","last_peered":"2024-09-12T01:26:26.263620+0000","last_clean":"2024-09-12T01:26:26.263620+0000","last_became_active":"2024-09-12T01:26:12.801605+0000","last_became_peered":"2024-09-12T01:26:12.801605+0000","last_unstale":"2024-09-12T01:26:26.263620+0000","last_undegraded":"2024-09-12T01:26:26.263620+0000","last_fullsized":"2024-09-12T01:26:26.263620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:24.703911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281250+0000","last_change":"2024-09-12T01:26:14.433305+0000","last_active":"2024-09-12T01:26:26.281250+0000","last_peered":"2024-09-12T01:26:26.281250+0000","last_clean":"2024-09-12T01:26:26.281250+0000","last_became_active":"2024-09-12T01:26:14.432989+0000","last_became_peered":"2024-09-12T01:26:14.432989+0000","last_unstale":"2024-09-12T01:26:26.281250+0000","last_undegraded":"2024-09-12T01:26:26.281250+0000","last_fullsized":"2024-09-12T01:26:26.281250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:45.741460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'27","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.279102+0000","last_change":"2024-09-12T01:26:12.423148+0000","last_active":"2024-09-12T01:26:35.279102+0000","last_peered":"2024-09-12T01:26:35.279102+0000","last_clean":"2024-09-12T01:26:35.279102+0000","last_became_active":"2024-09-12T01:26:12.422754+0000","last_became_peered":"2024-09-12T01:26:12.422754+0000","last_unstale":"2024-09-12T01:26:35.279102+0000","last_undegraded":"2024-09-12T01:26:35.279102+0000","last_fullsized":"2024-09-12T01:26:35.279102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:01.017125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":63,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264153+0000","last_change":"2024-09-12T01:26:14.431568+0000","last_active":"2024-09-12T01:26:26.264153+0000","last_peered":"2024-09-12T01:26:26.264153+0000","last_clean":"2024-09-12T01:26:26.264153+0000","last_became_active":"2024-09-12T01:26:14.431215+0000","last_became_peered":"2024-09-12T01:26:14.431215+0000","last_unstale":"2024-09-12T01:26:26.264153+0000","last_undegraded":"2024-09-12T01:26:26.264153+0000","last_fullsized":"2024-09-12T01:26:26.264153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.552147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266274+0000","last_change":"2024-09-12T01:26:12.421986+0000","last_active":"2024-09-12T01:26:26.266274+0000","last_peered":"2024-09-12T01:26:26.266274+0000","last_clean":"2024-09-12T01:26:26.266274+0000","last_became_active":"2024-09-12T01:26:12.421391+0000","last_became_peered":"2024-09-12T01:26:12.421391+0000","last_unstale":"2024-09-12T01:26:26.266274+0000","last_undegraded":"2024-09-12T01:26:26.266274+0000","last_fullsized":"2024-09-12T01:26:26.266274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:20.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259524+0000","last_change":"2024-09-12T01:26:14.431435+0000","last_active":"2024-09-12T01:26:26.259524+0000","last_peered":"2024-09-12T01:26:26.259524+0000","last_clean":"2024-09-12T01:26:26.259524+0000","last_became_active":"2024-09-12T01:26:14.431143+0000","last_became_peered":"2024-09-12T01:26:14.431143+0000","last_unstale":"2024-09-12T01:26:26.259524+0000","last_undegraded":"2024-09-12T01:26:26.259524+0000","last_fullsized":"2024-09-12T01:26:26.259524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:58.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263497+0000","last_change":"2024-09-12T01:26:12.423972+0000","last_active":"2024-09-12T01:26:26.263497+0000","last_peered":"2024-09-12T01:26:26.263497+0000","last_clean":"2024-09-12T01:26:26.263497+0000","last_became_active":"2024-09-12T01:26:12.423594+0000","last_became_peered":"2024-09-12T01:26:12.423594+0000","last_unstale":"2024-09-12T01:26:26.263497+0000","last_undegraded":"2024-09-12T01:26:26.263497+0000","last_fullsized":"2024-09-12T01:26:26.263497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:37.783478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267451+0000","last_change":"2024-09-12T01:26:14.437207+0000","last_active":"2024-09-12T01:26:26.267451+0000","last_peered":"2024-09-12T01:26:26.267451+0000","last_clean":"2024-09-12T01:26:26.267451+0000","last_became_active":"2024-09-12T01:26:14.436940+0000","last_became_peered":"2024-09-12T01:26:14.436940+0000","last_unstale":"2024-09-12T01:26:26.267451+0000","last_undegraded":"2024-09-12T01:26:26.267451+0000","last_fullsized":"2024-09-12T01:26:26.267451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:34.454446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.278613+0000","last_change":"2024-09-12T01:26:12.420247+0000","last_active":"2024-09-12T01:26:35.278613+0000","last_peered":"2024-09-12T01:26:35.278613+0000","last_clean":"2024-09-12T01:26:35.278613+0000","last_became_active":"2024-09-12T01:26:12.419825+0000","last_became_peered":"2024-09-12T01:26:12.419825+0000","last_unstale":"2024-09-12T01:26:35.278613+0000","last_undegraded":"2024-09-12T01:26:35.278613+0000","last_fullsized":"2024-09-12T01:26:35.278613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:26.746225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267074+0000","last_change":"2024-09-12T01:26:14.439019+0000","last_active":"2024-09-12T01:26:26.267074+0000","last_peered":"2024-09-12T01:26:26.267074+0000","last_clean":"2024-09-12T01:26:26.267074+0000","last_became_active":"2024-09-12T01:26:14.438714+0000","last_became_peered":"2024-09-12T01:26:14.438714+0000","last_unstale":"2024-09-12T01:26:26.267074+0000","last_undegraded":"2024-09-12T01:26:26.267074+0000","last_fullsized":"2024-09-12T01:26:26.267074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.321464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264576+0000","last_change":"2024-09-12T01:26:12.800529+0000","last_active":"2024-09-12T01:26:26.264576+0000","last_peered":"2024-09-12T01:26:26.264576+0000","last_clean":"2024-09-12T01:26:26.264576+0000","last_became_active":"2024-09-12T01:26:12.800104+0000","last_became_peered":"2024-09-12T01:26:12.800104+0000","last_unstale":"2024-09-12T01:26:26.264576+0000","last_undegraded":"2024-09-12T01:26:26.264576+0000","last_fullsized":"2024-09-12T01:26:26.264576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.624321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263032+0000","last_change":"2024-09-12T01:26:14.435283+0000","last_active":"2024-09-12T01:26:26.263032+0000","last_peered":"2024-09-12T01:26:26.263032+0000","last_clean":"2024-09-12T01:26:26.263032+0000","last_became_active":"2024-09-12T01:26:14.434414+0000","last_became_peered":"2024-09-12T01:26:14.434414+0000","last_unstale":"2024-09-12T01:26:26.263032+0000","last_undegraded":"2024-09-12T01:26:26.263032+0000","last_fullsized":"2024-09-12T01:26:26.263032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.959405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.273529+0000","last_change":"2024-09-12T01:26:26.273053+0000","last_active":"2024-09-12T01:26:26.273529+0000","last_peered":"2024-09-12T01:26:26.273529+0000","last_clean":"2024-09-12T01:26:26.273529+0000","last_became_active":"2024-09-12T01:26:26.267178+0000","last_became_peered":"2024-09-12T01:26:26.267178+0000","last_unstale":"2024-09-12T01:26:26.273529+0000","last_undegraded":"2024-09-12T01:26:26.273529+0000","last_fullsized":"2024-09-12T01:26:26.273529+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:08.138485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260636+0000","last_change":"2024-09-12T01:26:14.433527+0000","last_active":"2024-09-12T01:26:26.260636+0000","last_peered":"2024-09-12T01:26:26.260636+0000","last_clean":"2024-09-12T01:26:26.260636+0000","last_became_active":"2024-09-12T01:26:14.433204+0000","last_became_peered":"2024-09-12T01:26:14.433204+0000","last_unstale":"2024-09-12T01:26:26.260636+0000","last_undegraded":"2024-09-12T01:26:26.260636+0000","last_fullsized":"2024-09-12T01:26:26.260636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:26.883916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259798+0000","last_change":"2024-09-12T01:26:12.420795+0000","last_active":"2024-09-12T01:26:26.259798+0000","last_peered":"2024-09-12T01:26:26.259798+0000","last_clean":"2024-09-12T01:26:26.259798+0000","last_became_active":"2024-09-12T01:26:12.420409+0000","last_became_peered":"2024-09-12T01:26:12.420409+0000","last_unstale":"2024-09-12T01:26:26.259798+0000","last_undegraded":"2024-09-12T01:26:26.259798+0000","last_fullsized":"2024-09-12T01:26:26.259798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:36.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267797+0000","last_change":"2024-09-12T01:26:14.440994+0000","last_active":"2024-09-12T01:26:26.267797+0000","last_peered":"2024-09-12T01:26:26.267797+0000","last_clean":"2024-09-12T01:26:26.267797+0000","last_became_active":"2024-09-12T01:26:14.440602+0000","last_became_peered":"2024-09-12T01:26:14.440602+0000","last_unstale":"2024-09-12T01:26:26.267797+0000","last_undegraded":"2024-09-12T01:26:26.267797+0000","last_fullsized":"2024-09-12T01:26:26.267797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.998991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263740+0000","last_change":"2024-09-12T01:26:12.419448+0000","last_active":"2024-09-12T01:26:26.263740+0000","last_peered":"2024-09-12T01:26:26.263740+0000","last_clean":"2024-09-12T01:26:26.263740+0000","last_became_active":"2024-09-12T01:26:12.419000+0000","last_became_peered":"2024-09-12T01:26:12.419000+0000","last_unstale":"2024-09-12T01:26:26.263740+0000","last_undegraded":"2024-09-12T01:26:26.263740+0000","last_fullsized":"2024-09-12T01:26:26.263740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:37.818833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267551+0000","last_change":"2024-09-12T01:26:14.437818+0000","last_active":"2024-09-12T01:26:26.267551+0000","last_peered":"2024-09-12T01:26:26.267551+0000","last_clean":"2024-09-12T01:26:26.267551+0000","last_became_active":"2024-09-12T01:26:14.437497+0000","last_became_peered":"2024-09-12T01:26:14.437497+0000","last_unstale":"2024-09-12T01:26:26.267551+0000","last_undegraded":"2024-09-12T01:26:26.267551+0000","last_fullsized":"2024-09-12T01:26:26.267551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:57.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.502873+0000","last_change":"2024-09-12T01:26:12.855850+0000","last_active":"2024-09-12T01:26:33.502873+0000","last_peered":"2024-09-12T01:26:33.502873+0000","last_clean":"2024-09-12T01:26:33.502873+0000","last_became_active":"2024-09-12T01:26:12.855400+0000","last_became_peered":"2024-09-12T01:26:12.855400+0000","last_unstale":"2024-09-12T01:26:33.502873+0000","last_undegraded":"2024-09-12T01:26:33.502873+0000","last_fullsized":"2024-09-12T01:26:33.502873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:32.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267683+0000","last_change":"2024-09-12T01:26:14.435982+0000","last_active":"2024-09-12T01:26:26.267683+0000","last_peered":"2024-09-12T01:26:26.267683+0000","last_clean":"2024-09-12T01:26:26.267683+0000","last_became_active":"2024-09-12T01:26:14.435595+0000","last_became_peered":"2024-09-12T01:26:14.435595+0000","last_unstale":"2024-09-12T01:26:26.267683+0000","last_undegraded":"2024-09-12T01:26:26.267683+0000","last_fullsized":"2024-09-12T01:26:26.267683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:31.101890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":343,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267513+0000","last_change":"2024-09-12T01:25:04.588449+0000","last_active":"2024-09-12T01:26:26.267513+0000","last_peered":"2024-09-12T01:26:26.267513+0000","last_clean":"2024-09-12T01:26:26.267513+0000","last_became_active":"2024-09-12T01:25:04.587949+0000","last_became_peered":"2024-09-12T01:25:04.587949+0000","last_unstale":"2024-09-12T01:26:26.267513+0000","last_undegraded":"2024-09-12T01:26:26.267513+0000","last_fullsized":"2024-09-12T01:26:26.267513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_clean_scrub_stamp":"2024-09-12T01:21:41.345624+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:41.015289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.261927+0000","last_change":"2024-09-12T01:26:12.421379+0000","last_active":"2024-09-12T01:26:26.261927+0000","last_peered":"2024-09-12T01:26:26.261927+0000","last_clean":"2024-09-12T01:26:26.261927+0000","last_became_active":"2024-09-12T01:26:12.421059+0000","last_became_peered":"2024-09-12T01:26:12.421059+0000","last_unstale":"2024-09-12T01:26:26.261927+0000","last_undegraded":"2024-09-12T01:26:26.261927+0000","last_fullsized":"2024-09-12T01:26:26.261927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269101+0000","last_change":"2024-09-12T01:26:14.430510+0000","last_active":"2024-09-12T01:26:26.269101+0000","last_peered":"2024-09-12T01:26:26.269101+0000","last_clean":"2024-09-12T01:26:26.269101+0000","last_became_active":"2024-09-12T01:26:14.430232+0000","last_became_peered":"2024-09-12T01:26:14.430232+0000","last_unstale":"2024-09-12T01:26:26.269101+0000","last_undegraded":"2024-09-12T01:26:26.269101+0000","last_fullsized":"2024-09-12T01:26:26.269101+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:55.114616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267369+0000","last_change":"2024-09-12T01:26:12.420938+0000","last_active":"2024-09-12T01:26:26.267369+0000","last_peered":"2024-09-12T01:26:26.267369+0000","last_clean":"2024-09-12T01:26:26.267369+0000","last_became_active":"2024-09-12T01:26:12.420599+0000","last_became_peered":"2024-09-12T01:26:12.420599+0000","last_unstale":"2024-09-12T01:26:26.267369+0000","last_undegraded":"2024-09-12T01:26:26.267369+0000","last_fullsized":"2024-09-12T01:26:26.267369+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.593237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259495+0000","last_change":"2024-09-12T01:26:14.428684+0000","last_active":"2024-09-12T01:26:26.259495+0000","last_peered":"2024-09-12T01:26:26.259495+0000","last_clean":"2024-09-12T01:26:26.259495+0000","last_became_active":"2024-09-12T01:26:14.428380+0000","last_became_peered":"2024-09-12T01:26:14.428380+0000","last_unstale":"2024-09-12T01:26:26.259495+0000","last_undegraded":"2024-09-12T01:26:26.259495+0000","last_fullsized":"2024-09-12T01:26:26.259495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:21.542122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.277065+0000","last_change":"2024-09-12T01:26:12.800048+0000","last_active":"2024-09-12T01:26:34.277065+0000","last_peered":"2024-09-12T01:26:34.277065+0000","last_clean":"2024-09-12T01:26:34.277065+0000","last_became_active":"2024-09-12T01:26:12.799646+0000","last_became_peered":"2024-09-12T01:26:12.799646+0000","last_unstale":"2024-09-12T01:26:34.277065+0000","last_undegraded":"2024-09-12T01:26:34.277065+0000","last_fullsized":"2024-09-12T01:26:34.277065+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:39.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268626+0000","last_change":"2024-09-12T01:26:26.268110+0000","last_active":"2024-09-12T01:26:26.268626+0000","last_peered":"2024-09-12T01:26:26.268626+0000","last_clean":"2024-09-12T01:26:26.268626+0000","last_became_active":"2024-09-12T01:26:26.267764+0000","last_became_peered":"2024-09-12T01:26:26.267764+0000","last_unstale":"2024-09-12T01:26:26.268626+0000","last_undegraded":"2024-09-12T01:26:26.268626+0000","last_fullsized":"2024-09-12T01:26:26.268626+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:37.009529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.504563+0000","last_change":"2024-09-12T01:26:12.424189+0000","last_active":"2024-09-12T01:26:35.504563+0000","last_peered":"2024-09-12T01:26:35.504563+0000","last_clean":"2024-09-12T01:26:35.504563+0000","last_became_active":"2024-09-12T01:26:12.423785+0000","last_became_peered":"2024-09-12T01:26:12.423785+0000","last_unstale":"2024-09-12T01:26:35.504563+0000","last_undegraded":"2024-09-12T01:26:35.504563+0000","last_fullsized":"2024-09-12T01:26:35.504563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:20.069821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262256+0000","last_change":"2024-09-12T01:26:14.437874+0000","last_active":"2024-09-12T01:26:26.262256+0000","last_peered":"2024-09-12T01:26:26.262256+0000","last_clean":"2024-09-12T01:26:26.262256+0000","last_became_active":"2024-09-12T01:26:14.437578+0000","last_became_peered":"2024-09-12T01:26:14.437578+0000","last_unstale":"2024-09-12T01:26:26.262256+0000","last_undegraded":"2024-09-12T01:26:26.262256+0000","last_fullsized":"2024-09-12T01:26:26.262256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:55.817763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267861+0000","last_change":"2024-09-12T01:26:26.267861+0000","last_active":"2024-09-12T01:26:26.267861+0000","last_peered":"2024-09-12T01:26:26.267861+0000","last_clean":"2024-09-12T01:26:26.267861+0000","last_became_active":"2024-09-12T01:26:26.267244+0000","last_became_peered":"2024-09-12T01:26:26.267244+0000","last_unstale":"2024-09-12T01:26:26.267861+0000","last_undegraded":"2024-09-12T01:26:26.267861+0000","last_fullsized":"2024-09-12T01:26:26.267861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:50.623916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262312+0000","last_change":"2024-09-12T01:26:14.434708+0000","last_active":"2024-09-12T01:26:26.262312+0000","last_peered":"2024-09-12T01:26:26.262312+0000","last_clean":"2024-09-12T01:26:26.262312+0000","last_became_active":"2024-09-12T01:26:14.434420+0000","last_became_peered":"2024-09-12T01:26:14.434420+0000","last_unstale":"2024-09-12T01:26:26.262312+0000","last_undegraded":"2024-09-12T01:26:26.262312+0000","last_fullsized":"2024-09-12T01:26:26.262312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:58.626769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264703+0000","last_change":"2024-09-12T01:26:12.800678+0000","last_active":"2024-09-12T01:26:26.264703+0000","last_peered":"2024-09-12T01:26:26.264703+0000","last_clean":"2024-09-12T01:26:26.264703+0000","last_became_active":"2024-09-12T01:26:12.800063+0000","last_became_peered":"2024-09-12T01:26:12.800063+0000","last_unstale":"2024-09-12T01:26:26.264703+0000","last_undegraded":"2024-09-12T01:26:26.264703+0000","last_fullsized":"2024-09-12T01:26:26.264703+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:01.110686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259849+0000","last_change":"2024-09-12T01:26:14.425695+0000","last_active":"2024-09-12T01:26:26.259849+0000","last_peered":"2024-09-12T01:26:26.259849+0000","last_clean":"2024-09-12T01:26:26.259849+0000","last_became_active":"2024-09-12T01:26:14.425435+0000","last_became_peered":"2024-09-12T01:26:14.425435+0000","last_unstale":"2024-09-12T01:26:26.259849+0000","last_undegraded":"2024-09-12T01:26:26.259849+0000","last_fullsized":"2024-09-12T01:26:26.259849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:19.193669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.442722+0000","last_change":"2024-09-12T01:26:12.412743+0000","last_active":"2024-09-12T01:26:33.442722+0000","last_peered":"2024-09-12T01:26:33.442722+0000","last_clean":"2024-09-12T01:26:33.442722+0000","last_became_active":"2024-09-12T01:26:12.412376+0000","last_became_peered":"2024-09-12T01:26:12.412376+0000","last_unstale":"2024-09-12T01:26:33.442722+0000","last_undegraded":"2024-09-12T01:26:33.442722+0000","last_fullsized":"2024-09-12T01:26:33.442722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.542370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269530+0000","last_change":"2024-09-12T01:26:14.429727+0000","last_active":"2024-09-12T01:26:26.269530+0000","last_peered":"2024-09-12T01:26:26.269530+0000","last_clean":"2024-09-12T01:26:26.269530+0000","last_became_active":"2024-09-12T01:26:14.429385+0000","last_became_peered":"2024-09-12T01:26:14.429385+0000","last_unstale":"2024-09-12T01:26:26.269530+0000","last_undegraded":"2024-09-12T01:26:26.269530+0000","last_fullsized":"2024-09-12T01:26:26.269530+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:43.855786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262760+0000","last_change":"2024-09-12T01:26:12.855632+0000","last_active":"2024-09-12T01:26:26.262760+0000","last_peered":"2024-09-12T01:26:26.262760+0000","last_clean":"2024-09-12T01:26:26.262760+0000","last_became_active":"2024-09-12T01:26:12.855305+0000","last_became_peered":"2024-09-12T01:26:12.855305+0000","last_unstale":"2024-09-12T01:26:26.262760+0000","last_undegraded":"2024-09-12T01:26:26.262760+0000","last_fullsized":"2024-09-12T01:26:26.262760+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.893689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264587+0000","last_change":"2024-09-12T01:26:14.428498+0000","last_active":"2024-09-12T01:26:26.264587+0000","last_peered":"2024-09-12T01:26:26.264587+0000","last_clean":"2024-09-12T01:26:26.264587+0000","last_became_active":"2024-09-12T01:26:14.428022+0000","last_became_peered":"2024-09-12T01:26:14.428022+0000","last_unstale":"2024-09-12T01:26:26.264587+0000","last_undegraded":"2024-09-12T01:26:26.264587+0000","last_fullsized":"2024-09-12T01:26:26.264587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.325399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281204+0000","last_change":"2024-09-12T01:26:12.800038+0000","last_active":"2024-09-12T01:26:26.281204+0000","last_peered":"2024-09-12T01:26:26.281204+0000","last_clean":"2024-09-12T01:26:26.281204+0000","last_became_active":"2024-09-12T01:26:12.799717+0000","last_became_peered":"2024-09-12T01:26:12.799717+0000","last_unstale":"2024-09-12T01:26:26.281204+0000","last_undegraded":"2024-09-12T01:26:26.281204+0000","last_fullsized":"2024-09-12T01:26:26.281204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.362437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262988+0000","last_change":"2024-09-12T01:26:14.430518+0000","last_active":"2024-09-12T01:26:26.262988+0000","last_peered":"2024-09-12T01:26:26.262988+0000","last_clean":"2024-09-12T01:26:26.262988+0000","last_became_active":"2024-09-12T01:26:14.430158+0000","last_became_peered":"2024-09-12T01:26:14.430158+0000","last_unstale":"2024-09-12T01:26:26.262988+0000","last_undegraded":"2024-09-12T01:26:26.262988+0000","last_fullsized":"2024-09-12T01:26:26.262988+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:55.696101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268990+0000","last_change":"2024-09-12T01:26:12.418427+0000","last_active":"2024-09-12T01:26:26.268990+0000","last_peered":"2024-09-12T01:26:26.268990+0000","last_clean":"2024-09-12T01:26:26.268990+0000","last_became_active":"2024-09-12T01:26:12.418135+0000","last_became_peered":"2024-09-12T01:26:12.418135+0000","last_unstale":"2024-09-12T01:26:26.268990+0000","last_undegraded":"2024-09-12T01:26:26.268990+0000","last_fullsized":"2024-09-12T01:26:26.268990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:32.946485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260572+0000","last_change":"2024-09-12T01:26:14.425817+0000","last_active":"2024-09-12T01:26:26.260572+0000","last_peered":"2024-09-12T01:26:26.260572+0000","last_clean":"2024-09-12T01:26:26.260572+0000","last_became_active":"2024-09-12T01:26:14.425443+0000","last_became_peered":"2024-09-12T01:26:14.425443+0000","last_unstale":"2024-09-12T01:26:26.260572+0000","last_undegraded":"2024-09-12T01:26:26.260572+0000","last_fullsized":"2024-09-12T01:26:26.260572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266274+0000","last_change":"2024-09-12T01:26:12.422742+0000","last_active":"2024-09-12T01:26:26.266274+0000","last_peered":"2024-09-12T01:26:26.266274+0000","last_clean":"2024-09-12T01:26:26.266274+0000","last_became_active":"2024-09-12T01:26:12.421914+0000","last_became_peered":"2024-09-12T01:26:12.421914+0000","last_unstale":"2024-09-12T01:26:26.266274+0000","last_undegraded":"2024-09-12T01:26:26.266274+0000","last_fullsized":"2024-09-12T01:26:26.266274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:53.427112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269168+0000","last_change":"2024-09-12T01:26:14.430425+0000","last_active":"2024-09-12T01:26:26.269168+0000","last_peered":"2024-09-12T01:26:26.269168+0000","last_clean":"2024-09-12T01:26:26.269168+0000","last_became_active":"2024-09-12T01:26:14.430128+0000","last_became_peered":"2024-09-12T01:26:14.430128+0000","last_unstale":"2024-09-12T01:26:26.269168+0000","last_undegraded":"2024-09-12T01:26:26.269168+0000","last_fullsized":"2024-09-12T01:26:26.269168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:17.653908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263276+0000","last_change":"2024-09-12T01:26:12.421463+0000","last_active":"2024-09-12T01:26:26.263276+0000","last_peered":"2024-09-12T01:26:26.263276+0000","last_clean":"2024-09-12T01:26:26.263276+0000","last_became_active":"2024-09-12T01:26:12.421143+0000","last_became_peered":"2024-09-12T01:26:12.421143+0000","last_unstale":"2024-09-12T01:26:26.263276+0000","last_undegraded":"2024-09-12T01:26:26.263276+0000","last_fullsized":"2024-09-12T01:26:26.263276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:09.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267454+0000","last_change":"2024-09-12T01:26:14.428643+0000","last_active":"2024-09-12T01:26:26.267454+0000","last_peered":"2024-09-12T01:26:26.267454+0000","last_clean":"2024-09-12T01:26:26.267454+0000","last_became_active":"2024-09-12T01:26:14.428344+0000","last_became_peered":"2024-09-12T01:26:14.428344+0000","last_unstale":"2024-09-12T01:26:26.267454+0000","last_undegraded":"2024-09-12T01:26:26.267454+0000","last_fullsized":"2024-09-12T01:26:26.267454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:17.213238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263512+0000","last_change":"2024-09-12T01:26:14.435108+0000","last_active":"2024-09-12T01:26:26.263512+0000","last_peered":"2024-09-12T01:26:26.263512+0000","last_clean":"2024-09-12T01:26:26.263512+0000","last_became_active":"2024-09-12T01:26:14.434806+0000","last_became_peered":"2024-09-12T01:26:14.434806+0000","last_unstale":"2024-09-12T01:26:26.263512+0000","last_undegraded":"2024-09-12T01:26:26.263512+0000","last_fullsized":"2024-09-12T01:26:26.263512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:01.188981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264537+0000","last_change":"2024-09-12T01:26:12.419027+0000","last_active":"2024-09-12T01:26:26.264537+0000","last_peered":"2024-09-12T01:26:26.264537+0000","last_clean":"2024-09-12T01:26:26.264537+0000","last_became_active":"2024-09-12T01:26:12.418579+0000","last_became_peered":"2024-09-12T01:26:12.418579+0000","last_unstale":"2024-09-12T01:26:26.264537+0000","last_undegraded":"2024-09-12T01:26:26.264537+0000","last_fullsized":"2024-09-12T01:26:26.264537+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.119864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281245+0000","last_change":"2024-09-12T01:26:14.429532+0000","last_active":"2024-09-12T01:26:26.281245+0000","last_peered":"2024-09-12T01:26:26.281245+0000","last_clean":"2024-09-12T01:26:26.281245+0000","last_became_active":"2024-09-12T01:26:14.429134+0000","last_became_peered":"2024-09-12T01:26:14.429134+0000","last_unstale":"2024-09-12T01:26:26.281245+0000","last_undegraded":"2024-09-12T01:26:26.281245+0000","last_fullsized":"2024-09-12T01:26:26.281245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:47.403388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.488999+0000","last_change":"2024-09-12T01:26:26.279322+0000","last_active":"2024-09-12T01:26:26.488999+0000","last_peered":"2024-09-12T01:26:26.488999+0000","last_clean":"2024-09-12T01:26:26.488999+0000","last_became_active":"2024-09-12T01:26:26.268752+0000","last_became_peered":"2024-09-12T01:26:26.268752+0000","last_unstale":"2024-09-12T01:26:26.488999+0000","last_undegraded":"2024-09-12T01:26:26.488999+0000","last_fullsized":"2024-09-12T01:26:26.488999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.411144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264547+0000","last_change":"2024-09-12T01:26:14.430831+0000","last_active":"2024-09-12T01:26:26.264547+0000","last_peered":"2024-09-12T01:26:26.264547+0000","last_clean":"2024-09-12T01:26:26.264547+0000","last_became_active":"2024-09-12T01:26:14.430531+0000","last_became_peered":"2024-09-12T01:26:14.430531+0000","last_unstale":"2024-09-12T01:26:26.264547+0000","last_undegraded":"2024-09-12T01:26:26.264547+0000","last_fullsized":"2024-09-12T01:26:26.264547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:02.522283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269397+0000","last_change":"2024-09-12T01:26:12.799921+0000","last_active":"2024-09-12T01:26:26.269397+0000","last_peered":"2024-09-12T01:26:26.269397+0000","last_clean":"2024-09-12T01:26:26.269397+0000","last_became_active":"2024-09-12T01:26:12.799608+0000","last_became_peered":"2024-09-12T01:26:12.799608+0000","last_unstale":"2024-09-12T01:26:26.269397+0000","last_undegraded":"2024-09-12T01:26:26.269397+0000","last_fullsized":"2024-09-12T01:26:26.269397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:00.821261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269287+0000","last_change":"2024-09-12T01:26:14.430937+0000","last_active":"2024-09-12T01:26:26.269287+0000","last_peered":"2024-09-12T01:26:26.269287+0000","last_clean":"2024-09-12T01:26:26.269287+0000","last_became_active":"2024-09-12T01:26:14.430656+0000","last_became_peered":"2024-09-12T01:26:14.430656+0000","last_unstale":"2024-09-12T01:26:26.269287+0000","last_undegraded":"2024-09-12T01:26:26.269287+0000","last_fullsized":"2024-09-12T01:26:26.269287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.874150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.503099+0000","last_change":"2024-09-12T01:26:12.419000+0000","last_active":"2024-09-12T01:26:34.503099+0000","last_peered":"2024-09-12T01:26:34.503099+0000","last_clean":"2024-09-12T01:26:34.503099+0000","last_became_active":"2024-09-12T01:26:12.418736+0000","last_became_peered":"2024-09-12T01:26:12.418736+0000","last_unstale":"2024-09-12T01:26:34.503099+0000","last_undegraded":"2024-09-12T01:26:34.503099+0000","last_fullsized":"2024-09-12T01:26:34.503099+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:31.586983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56927,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":149,"num_read_kb":137,"num_write":232,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":175038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":905216,"data_stored":436466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36900,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708252,"statfs":{"total":95995035648,"available":95957250048,"internally_reserved":0,"allocated":1593344,"data_stored":1077978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972379,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":436374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201312,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":436730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462948,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1519616,"data_stored":1029272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":436091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855406,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1028557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986228,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":436345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":435916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":487336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":491373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":929792,"data_stored":437430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":52084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":52241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:26:41.626 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T01:26:41.626 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T01:26:41.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T01:26:41.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:41 smithi189 ceph-mon[35357]: pgmap v290: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.0 KiB/s wr, 12 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T01:26:41.875 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:41.983 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:41 smithi081 ceph-mon[30920]: pgmap v290: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.0 KiB/s wr, 12 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T01:26:42.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:41 smithi100 ceph-mon[35275]: pgmap v290: 97 pgs: 97 active+clean; 632 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.0 KiB/s wr, 12 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T01:26:42.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.309+0000 7f770acc4640 1 -- 172.21.15.81:0/554787506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7704100b10 msgr2=0x7f7704100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:42.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.309+0000 7f770acc4640 1 --2- 172.21.15.81:0/554787506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7704100b10 0x7f7704100f10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009900 tx=0x7f76f802a410 comp rx=0 tx=0).stop 2024-09-12T01:26:42.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.309+0000 7f770acc4640 1 -- 172.21.15.81:0/554787506 shutdown_connections 2024-09-12T01:26:42.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.309+0000 7f770acc4640 1 --2- 172.21.15.81:0/554787506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77041026d0 0x7f7704108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:42.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.309+0000 7f770acc4640 1 --2- 172.21.15.81:0/554787506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7704101d10 0x7f7704102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:42.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.309+0000 7f770acc4640 1 --2- 172.21.15.81:0/554787506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7704100b10 0x7f7704100f10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:42.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.309+0000 7f770acc4640 1 -- 172.21.15.81:0/554787506 >> 172.21.15.81:0/554787506 conn(0x7f77040fc2a0 msgr2=0x7f77040fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:42.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.309+0000 7f770acc4640 1 -- 172.21.15.81:0/554787506 shutdown_connections 2024-09-12T01:26:42.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.309+0000 7f770acc4640 1 -- 172.21.15.81:0/554787506 wait complete. 2024-09-12T01:26:42.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.309+0000 7f770acc4640 1 Processor -- start 2024-09-12T01:26:42.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.309+0000 7f770acc4640 1 -- start start 2024-09-12T01:26:42.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f770acc4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7704100b10 0x7f7704196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:42.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f770acc4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7704101d10 0x7f7704197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:42.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f770acc4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77041026d0 0x7f770419e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:42.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f770acc4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f770410c7c0 con 0x7f7704101d10 2024-09-12T01:26:42.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f770acc4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f770410c640 con 0x7f77041026d0 2024-09-12T01:26:42.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f770acc4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f770410c940 con 0x7f7704100b10 2024-09-12T01:26:42.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7703fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7704101d10 0x7f7704197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:42.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7703fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7704101d10 0x7f7704197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33562/0 (socket says 172.21.15.81:33562) 2024-09-12T01:26:42.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7703fff640 1 -- 172.21.15.81:0/2000749692 learned_addr learned my addr 172.21.15.81:0/2000749692 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:42.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7708a60640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7704100b10 0x7f7704196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:42.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7709261640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77041026d0 0x7f770419e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:42.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7703fff640 1 -- 172.21.15.81:0/2000749692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7704100b10 msgr2=0x7f7704196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:42.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7703fff640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7704100b10 0x7f7704196e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7703fff640 1 -- 172.21.15.81:0/2000749692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77041026d0 msgr2=0x7f770419e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7703fff640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77041026d0 0x7f770419e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7703fff640 1 -- 172.21.15.81:0/2000749692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770419ea70 con 0x7f7704101d10 2024-09-12T01:26:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7703fff640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7704101d10 0x7f7704197380 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f76f000d950 tx=0x7f76f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7701ffb640 1 -- 172.21.15.81:0/2000749692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0017070 con 0x7f7704101d10 2024-09-12T01:26:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7701ffb640 1 -- 172.21.15.81:0/2000749692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76f0009c30 con 0x7f7704101d10 2024-09-12T01:26:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f770acc4640 1 -- 172.21.15.81:0/2000749692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f770419ed60 con 0x7f7704101d10 2024-09-12T01:26:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.310+0000 7f7701ffb640 1 -- 172.21.15.81:0/2000749692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f000f6b0 con 0x7f7704101d10 2024-09-12T01:26:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.311+0000 7f770acc4640 1 -- 172.21.15.81:0/2000749692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f770419f240 con 0x7f7704101d10 2024-09-12T01:26:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.312+0000 7f770acc4640 1 -- 172.21.15.81:0/2000749692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7704107f60 con 0x7f7704101d10 2024-09-12T01:26:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.313+0000 7f7701ffb640 1 -- 172.21.15.81:0/2000749692 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f76f00109d0 con 0x7f7704101d10 2024-09-12T01:26:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.313+0000 7f7701ffb640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f76f40a2c40 0x7f76f40a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.313+0000 7f7708a60640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f76f40a2c40 0x7f76f40a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:42.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.313+0000 7f7701ffb640 1 -- 172.21.15.81:0/2000749692 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f76f00cf1b0 con 0x7f7704101d10 2024-09-12T01:26:42.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.314+0000 7f7708a60640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f76f40a2c40 0x7f76f40a5100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f76f802aa00 tx=0x7f76f8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:42.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.317+0000 7f7701ffb640 1 -- 172.21.15.81:0/2000749692 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f76f009bfc0 con 0x7f7704101d10 2024-09-12T01:26:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.550+0000 7f770acc4640 1 -- 172.21.15.81:0/2000749692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f770402d7c0 con 0x7f7704101d10 2024-09-12T01:26:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.552+0000 7f7701ffb640 1 -- 172.21.15.81:0/2000749692 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f76f009b8c0 con 0x7f7704101d10 2024-09-12T01:26:42.551 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-12T01:26:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBSQ+Jm7hjmIBAAHoqiCXKOQwF8L8rwpvbSrA== 2024-09-12T01:26:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.554+0000 7f770acc4640 1 -- 172.21.15.81:0/2000749692 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f76f40a2c40 msgr2=0x7f76f40a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.554+0000 7f770acc4640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f76f40a2c40 0x7f76f40a5100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f76f802aa00 tx=0x7f76f8031400 comp rx=0 tx=0).stop 2024-09-12T01:26:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.554+0000 7f770acc4640 1 -- 172.21.15.81:0/2000749692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7704101d10 msgr2=0x7f7704197380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.554+0000 7f770acc4640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7704101d10 0x7f7704197380 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f76f000d950 tx=0x7f76f000de10 comp rx=0 tx=0).stop 2024-09-12T01:26:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.555+0000 7f770acc4640 1 -- 172.21.15.81:0/2000749692 shutdown_connections 2024-09-12T01:26:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.555+0000 7f770acc4640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f76f40a2c40 0x7f76f40a5100 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.555+0000 7f770acc4640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77041026d0 0x7f770419e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.555+0000 7f770acc4640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7704101d10 0x7f7704197380 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.555+0000 7f770acc4640 1 --2- 172.21.15.81:0/2000749692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7704100b10 0x7f7704196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.555+0000 7f770acc4640 1 -- 172.21.15.81:0/2000749692 >> 172.21.15.81:0/2000749692 conn(0x7f77040fc2a0 msgr2=0x7f7704105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.555+0000 7f770acc4640 1 -- 172.21.15.81:0/2000749692 shutdown_connections 2024-09-12T01:26:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:42.555+0000 7f770acc4640 1 -- 172.21.15.81:0/2000749692 wait complete. 2024-09-12T01:26:42.563 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:42 smithi081 ceph-mon[30920]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:26:43.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:42 smithi100 ceph-mon[35275]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:26:43.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:42 smithi189 ceph-mon[35357]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:26:43.217 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:26:43.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T01:26:43.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T01:26:43.253 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T01:26:43.253 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T01:26:43.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T01:26:43.536 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:43.783 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:43 smithi081 ceph-mon[30920]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.4 KiB/s wr, 17 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T01:26:43.783 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:43 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2000749692' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:26:43.783 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:43 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2000749692' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:26:44.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.005+0000 7fdf5a437640 1 -- 172.21.15.81:0/3208034879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54102570 msgr2=0x7fdf541029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:44.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.005+0000 7fdf5a437640 1 --2- 172.21.15.81:0/3208034879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54102570 0x7fdf541029b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009900 tx=0x7fdf3c02a480 comp rx=0 tx=0).stop 2024-09-12T01:26:44.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.005+0000 7fdf5a437640 1 -- 172.21.15.81:0/3208034879 shutdown_connections 2024-09-12T01:26:44.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.005+0000 7fdf5a437640 1 --2- 172.21.15.81:0/3208034879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf54102ef0 0x7fdf5410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:44.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.005+0000 7fdf5a437640 1 --2- 172.21.15.81:0/3208034879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54102570 0x7fdf541029b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:44.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.005+0000 7fdf5a437640 1 --2- 172.21.15.81:0/3208034879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf54100e20 0x7fdf54101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:44.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.005+0000 7fdf5a437640 1 -- 172.21.15.81:0/3208034879 >> 172.21.15.81:0/3208034879 conn(0x7fdf540fc7d0 msgr2=0x7fdf540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:44.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.005+0000 7fdf5a437640 1 -- 172.21.15.81:0/3208034879 shutdown_connections 2024-09-12T01:26:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.005+0000 7fdf5a437640 1 -- 172.21.15.81:0/3208034879 wait complete. 2024-09-12T01:26:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf5a437640 1 Processor -- start 2024-09-12T01:26:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf5a437640 1 -- start start 2024-09-12T01:26:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf5a437640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf54100e20 0x7fdf54197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf5a437640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf54102570 0x7fdf54197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf5a437640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54102ef0 0x7fdf5419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf5a437640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdf54110f80 con 0x7fdf54102ef0 2024-09-12T01:26:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf5a437640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdf54110e00 con 0x7fdf54102570 2024-09-12T01:26:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf5a437640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdf54111100 con 0x7fdf54100e20 2024-09-12T01:26:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf589d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54102ef0 0x7fdf5419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf589d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54102ef0 0x7fdf5419bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33582/0 (socket says 172.21.15.81:33582) 2024-09-12T01:26:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf589d4640 1 -- 172.21.15.81:0/2202501335 learned_addr learned my addr 172.21.15.81:0/2202501335 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf53fff640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf54100e20 0x7fdf54197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf589d4640 1 -- 172.21.15.81:0/2202501335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf54100e20 msgr2=0x7fdf54197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.006+0000 7fdf589d4640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf54100e20 0x7fdf54197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.007+0000 7fdf4bfff640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf54102570 0x7fdf54197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.007+0000 7fdf589d4640 1 -- 172.21.15.81:0/2202501335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf54102570 msgr2=0x7fdf54197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.007+0000 7fdf589d4640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf54102570 0x7fdf54197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.007+0000 7fdf589d4640 1 -- 172.21.15.81:0/2202501335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5419c3f0 con 0x7fdf54102ef0 2024-09-12T01:26:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.007+0000 7fdf53fff640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf54100e20 0x7fdf54197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.007+0000 7fdf589d4640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54102ef0 0x7fdf5419bd10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00eaa0 tx=0x7fdf4c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.007+0000 7fdf51ffb640 1 -- 172.21.15.81:0/2202501335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c00cdb0 con 0x7fdf54102ef0 2024-09-12T01:26:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.007+0000 7fdf5a437640 1 -- 172.21.15.81:0/2202501335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5419c6e0 con 0x7fdf54102ef0 2024-09-12T01:26:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.007+0000 7fdf51ffb640 1 -- 172.21.15.81:0/2202501335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf4c005020 con 0x7fdf54102ef0 2024-09-12T01:26:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.007+0000 7fdf51ffb640 1 -- 172.21.15.81:0/2202501335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0116b0 con 0x7fdf54102ef0 2024-09-12T01:26:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.007+0000 7fdf5a437640 1 -- 172.21.15.81:0/2202501335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf541a3fc0 con 0x7fdf54102ef0 2024-09-12T01:26:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.008+0000 7fdf5a437640 1 -- 172.21.15.81:0/2202501335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf54101200 con 0x7fdf54102ef0 2024-09-12T01:26:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.009+0000 7fdf51ffb640 1 -- 172.21.15.81:0/2202501335 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdf4c005560 con 0x7fdf54102ef0 2024-09-12T01:26:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.010+0000 7fdf51ffb640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fdf400a2c10 0x7fdf400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.010+0000 7fdf53fff640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fdf400a2c10 0x7fdf400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.010+0000 7fdf51ffb640 1 -- 172.21.15.81:0/2202501335 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdf4c0cf4c0 con 0x7fdf54102ef0 2024-09-12T01:26:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.010+0000 7fdf53fff640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fdf400a2c10 0x7fdf400a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdf440058c0 tx=0x7fdf44005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:44.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.014+0000 7fdf51ffb640 1 -- 172.21.15.81:0/2202501335 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdf4c016030 con 0x7fdf54102ef0 2024-09-12T01:26:44.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:43 smithi100 ceph-mon[35275]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.4 KiB/s wr, 17 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T01:26:44.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:43 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2000749692' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:26:44.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:43 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2000749692' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:26:44.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:43 smithi189 ceph-mon[35357]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.4 KiB/s wr, 17 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T01:26:44.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:43 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2000749692' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:26:44.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:43 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2000749692' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:26:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.225+0000 7fdf5a437640 1 -- 172.21.15.81:0/2202501335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fdf54109090 con 0x7fdf54102ef0 2024-09-12T01:26:44.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.229+0000 7fdf51ffb640 1 -- 172.21.15.81:0/2202501335 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263200 (secure 0 0 0) 0x7fdf4c09c2d0 con 0x7fdf54102ef0 2024-09-12T01:26:44.232 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:26:44.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.232+0000 7fdf5a437640 1 -- 172.21.15.81:0/2202501335 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fdf400a2c10 msgr2=0x7fdf400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:44.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.232+0000 7fdf5a437640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fdf400a2c10 0x7fdf400a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdf440058c0 tx=0x7fdf44005850 comp rx=0 tx=0).stop 2024-09-12T01:26:44.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.232+0000 7fdf5a437640 1 -- 172.21.15.81:0/2202501335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54102ef0 msgr2=0x7fdf5419bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:44.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.232+0000 7fdf5a437640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54102ef0 0x7fdf5419bd10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00eaa0 tx=0x7fdf4c00ef60 comp rx=0 tx=0).stop 2024-09-12T01:26:44.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.232+0000 7fdf5a437640 1 -- 172.21.15.81:0/2202501335 shutdown_connections 2024-09-12T01:26:44.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.232+0000 7fdf5a437640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fdf400a2c10 0x7fdf400a50d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:44.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.232+0000 7fdf5a437640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf54102ef0 0x7fdf5419bd10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:44.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.232+0000 7fdf5a437640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf54102570 0x7fdf54197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:44.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.232+0000 7fdf5a437640 1 --2- 172.21.15.81:0/2202501335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf54100e20 0x7fdf54197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:44.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.232+0000 7fdf5a437640 1 -- 172.21.15.81:0/2202501335 >> 172.21.15.81:0/2202501335 conn(0x7fdf540fc7d0 msgr2=0x7fdf540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:44.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.232+0000 7fdf5a437640 1 -- 172.21.15.81:0/2202501335 shutdown_connections 2024-09-12T01:26:44.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:44.232+0000 7fdf5a437640 1 -- 172.21.15.81:0/2202501335 wait complete. 2024-09-12T01:26:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:44 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2202501335' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:26:44.876 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:44 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2202501335' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:26:44.906 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2591597081},{"type":"v1","addr":"172.21.15.81:6801","nonce":2591597081}]},"active_addr":"172.21.15.81:6801/2591597081","active_change":"2024-09-12T01:19:24.346218+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.81:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":682685112}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1806419627}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1193015276}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3474474725}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1938409235}]}]} 2024-09-12T01:26:44.911 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T01:26:44.911 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T01:26:44.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:26:45.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:44 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2202501335' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:26:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:45.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.621+0000 7f0bed8a2640 1 -- 172.21.15.81:0/1034324629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be81082a0 msgr2=0x7f0be810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:45.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.621+0000 7f0bed8a2640 1 --2- 172.21.15.81:0/1034324629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be81082a0 0x7f0be810ec40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009930 tx=0x7f0be002a440 comp rx=0 tx=0).stop 2024-09-12T01:26:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.621+0000 7f0bed8a2640 1 -- 172.21.15.81:0/1034324629 shutdown_connections 2024-09-12T01:26:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.621+0000 7f0bed8a2640 1 --2- 172.21.15.81:0/1034324629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be81082a0 0x7f0be810ec40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.621+0000 7f0bed8a2640 1 --2- 172.21.15.81:0/1034324629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0be81036e0 0x7f0be8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.621+0000 7f0bed8a2640 1 --2- 172.21.15.81:0/1034324629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0be8102d30 0x7f0be8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.621+0000 7f0bed8a2640 1 -- 172.21.15.81:0/1034324629 >> 172.21.15.81:0/1034324629 conn(0x7f0be80fc7d0 msgr2=0x7f0be80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.621+0000 7f0bed8a2640 1 -- 172.21.15.81:0/1034324629 shutdown_connections 2024-09-12T01:26:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.621+0000 7f0bed8a2640 1 -- 172.21.15.81:0/1034324629 wait complete. 2024-09-12T01:26:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.621+0000 7f0bed8a2640 1 Processor -- start 2024-09-12T01:26:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0bed8a2640 1 -- start start 2024-09-12T01:26:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0bed8a2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0be8102d30 0x7f0be8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0bed8a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be81036e0 0x7f0be8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:45.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0bed8a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0be81082a0 0x7f0be8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0bed8a2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0be81120e0 con 0x7f0be81036e0 2024-09-12T01:26:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0bed8a2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0be8111f60 con 0x7f0be81082a0 2024-09-12T01:26:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0bed8a2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0be8112260 con 0x7f0be8102d30 2024-09-12T01:26:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0be67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be81036e0 0x7f0be8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0be67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be81036e0 0x7f0be8100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33606/0 (socket says 172.21.15.81:33606) 2024-09-12T01:26:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0be67fc640 1 -- 172.21.15.81:0/34727555 learned_addr learned my addr 172.21.15.81:0/34727555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0be77fe640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0be81082a0 0x7f0be8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0be6ffd640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0be8102d30 0x7f0be8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0be67fc640 1 -- 172.21.15.81:0/34727555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0be8102d30 msgr2=0x7f0be8100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0be67fc640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0be8102d30 0x7f0be8100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0be67fc640 1 -- 172.21.15.81:0/34727555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0be81082a0 msgr2=0x7f0be8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0be67fc640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0be81082a0 0x7f0be8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0be67fc640 1 -- 172.21.15.81:0/34727555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be81a6a90 con 0x7f0be81036e0 2024-09-12T01:26:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0be77fe640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0be81082a0 0x7f0be8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0be67fc640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be81036e0 0x7f0be8100ed0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc006fd0 tx=0x7f0bdc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.622+0000 7f0bec8a0640 1 -- 172.21.15.81:0/34727555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc011830 con 0x7f0be81036e0 2024-09-12T01:26:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.623+0000 7f0bed8a2640 1 -- 172.21.15.81:0/34727555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be81a6d80 con 0x7f0be81036e0 2024-09-12T01:26:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.623+0000 7f0bec8a0640 1 -- 172.21.15.81:0/34727555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bdc016070 con 0x7f0be81036e0 2024-09-12T01:26:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.623+0000 7f0bec8a0640 1 -- 172.21.15.81:0/34727555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc00f2e0 con 0x7f0be81036e0 2024-09-12T01:26:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.623+0000 7f0bed8a2640 1 -- 172.21.15.81:0/34727555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be81a7210 con 0x7f0be81036e0 2024-09-12T01:26:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.623+0000 7f0bed8a2640 1 -- 172.21.15.81:0/34727555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be8103110 con 0x7f0be81036e0 2024-09-12T01:26:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.625+0000 7f0bec8a0640 1 -- 172.21.15.81:0/34727555 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0bdc01b460 con 0x7f0be81036e0 2024-09-12T01:26:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.625+0000 7f0bec8a0640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f0bd00a2c10 0x7f0bd00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.625+0000 7f0bec8a0640 1 -- 172.21.15.81:0/34727555 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0bdc0ce830 con 0x7f0be81036e0 2024-09-12T01:26:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.625+0000 7f0be6ffd640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f0bd00a2c10 0x7f0bd00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.626+0000 7f0be6ffd640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f0bd00a2c10 0x7f0bd00a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8005fd0 tx=0x7f0bd8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.630+0000 7f0bec8a0640 1 -- 172.21.15.81:0/34727555 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0bdc09b750 con 0x7f0be81036e0 2024-09-12T01:26:45.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:45 smithi100 ceph-mon[35275]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-12T01:26:45.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.799+0000 7f0bed8a2640 1 -- 172.21.15.81:0/34727555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0be810a2b0 con 0x7f0be81036e0 2024-09-12T01:26:45.799 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:45 smithi081 ceph-mon[30920]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-12T01:26:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.801+0000 7f0bec8a0640 1 -- 172.21.15.81:0/34727555 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22714 (secure 0 0 0) 0x7f0bdc09b050 con 0x7f0be81036e0 2024-09-12T01:26:45.800 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:26:45.800 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","created":"2024-09-12T01:18:28.404285+0000","modified":"2024-09-12T01:26:26.256495+0000","last_up_change":"2024-09-12T01:25:26.326110+0000","last_in_change":"2024-09-12T01:25:02.138698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:21:40.649584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:26:10.753723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:26:13.254837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc857dd4-eedc-4c48-89a0-4e69662e8e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6803","nonce":3870994528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6805","nonce":3870994528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6809","nonce":3870994528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6807","nonce":3870994528}]},"public_addr":"172.21.15.81:6803/3870994528","cluster_addr":"172.21.15.81:6805/3870994528","heartbeat_back_addr":"172.21.15.81:6809/3870994528","heartbeat_front_addr":"172.21.15.81:6807/3870994528","state":["exists","up"]},{"osd":1,"uuid":"04b8111b-d677-4fc8-8285-90683621ccf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6801","nonce":2098299652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6803","nonce":2098299652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6807","nonce":2098299652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6805","nonce":2098299652}]},"public_addr":"172.21.15.100:6801/2098299652","cluster_addr":"172.21.15.100:6803/2098299652","heartbeat_back_addr":"172.21.15.100:6807/2098299652","heartbeat_front_addr":"172.21.15.100:6805/2098299652","state":["exists","up"]},{"osd":2,"uuid":"763e357e-5a04-45ff-95e8-bc1abfeac056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6801","nonce":1353548110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6803","nonce":1353548110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6807","nonce":1353548110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6805","nonce":1353548110}]},"public_addr":"172.21.15.189:6801/1353548110","cluster_addr":"172.21.15.189:6803/1353548110","heartbeat_back_addr":"172.21.15.189:6807/1353548110","heartbeat_front_addr":"172.21.15.189:6805/1353548110","state":["exists","up"]},{"osd":3,"uuid":"99843578-1b9e-4ee0-91f1-ba419d07897e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6811","nonce":1064869637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6813","nonce":1064869637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6817","nonce":1064869637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6815","nonce":1064869637}]},"public_addr":"172.21.15.81:6811/1064869637","cluster_addr":"172.21.15.81:6813/1064869637","heartbeat_back_addr":"172.21.15.81:6817/1064869637","heartbeat_front_addr":"172.21.15.81:6815/1064869637","state":["exists","up"]},{"osd":4,"uuid":"a5787415-0905-420e-9ce8-eb6902727561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6809","nonce":1687792282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6811","nonce":1687792282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6815","nonce":1687792282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6813","nonce":1687792282}]},"public_addr":"172.21.15.100:6809/1687792282","cluster_addr":"172.21.15.100:6811/1687792282","heartbeat_back_addr":"172.21.15.100:6815/1687792282","heartbeat_front_addr":"172.21.15.100:6813/1687792282","state":["exists","up"]},{"osd":5,"uuid":"879548b5-5516-407c-8517-bbdbf356c0e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6809","nonce":823474396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6811","nonce":823474396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6815","nonce":823474396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6813","nonce":823474396}]},"public_addr":"172.21.15.189:6809/823474396","cluster_addr":"172.21.15.189:6811/823474396","heartbeat_back_addr":"172.21.15.189:6815/823474396","heartbeat_front_addr":"172.21.15.189:6813/823474396","state":["exists","up"]},{"osd":6,"uuid":"b665b97c-a9d3-475f-93f3-8a920cbb37d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6819","nonce":1522854005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6821","nonce":1522854005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6825","nonce":1522854005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6823","nonce":1522854005}]},"public_addr":"172.21.15.81:6819/1522854005","cluster_addr":"172.21.15.81:6821/1522854005","heartbeat_back_addr":"172.21.15.81:6825/1522854005","heartbeat_front_addr":"172.21.15.81:6823/1522854005","state":["exists","up"]},{"osd":7,"uuid":"46e082c8-d071-471a-8c86-ce5b5700cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6817","nonce":41478541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6819","nonce":41478541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6823","nonce":41478541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6821","nonce":41478541}]},"public_addr":"172.21.15.100:6817/41478541","cluster_addr":"172.21.15.100:6819/41478541","heartbeat_back_addr":"172.21.15.100:6823/41478541","heartbeat_front_addr":"172.21.15.100:6821/41478541","state":["exists","up"]},{"osd":8,"uuid":"fb9b93ef-5a33-4ffc-926e-a78c101bbbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6817","nonce":180766860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6819","nonce":180766860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6823","nonce":180766860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6821","nonce":180766860}]},"public_addr":"172.21.15.189:6817/180766860","cluster_addr":"172.21.15.189:6819/180766860","heartbeat_back_addr":"172.21.15.189:6823/180766860","heartbeat_front_addr":"172.21.15.189:6821/180766860","state":["exists","up"]},{"osd":9,"uuid":"0b7ec1a1-5ab9-4075-acfb-e0d82f018656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6827","nonce":1651232782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6829","nonce":1651232782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6833","nonce":1651232782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6831","nonce":1651232782}]},"public_addr":"172.21.15.81:6827/1651232782","cluster_addr":"172.21.15.81:6829/1651232782","heartbeat_back_addr":"172.21.15.81:6833/1651232782","heartbeat_front_addr":"172.21.15.81:6831/1651232782","state":["exists","up"]},{"osd":10,"uuid":"996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6825","nonce":3295868568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6827","nonce":3295868568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6831","nonce":3295868568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6829","nonce":3295868568}]},"public_addr":"172.21.15.100:6825/3295868568","cluster_addr":"172.21.15.100:6827/3295868568","heartbeat_back_addr":"172.21.15.100:6831/3295868568","heartbeat_front_addr":"172.21.15.100:6829/3295868568","state":["exists","up"]},{"osd":11,"uuid":"f051e2b2-fc58-489a-ab7c-8c1ff5448553","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6825","nonce":3852230978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6827","nonce":3852230978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6831","nonce":3852230978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6829","nonce":3852230978}]},"public_addr":"172.21.15.189:6825/3852230978","cluster_addr":"172.21.15.189:6827/3852230978","heartbeat_back_addr":"172.21.15.189:6831/3852230978","heartbeat_front_addr":"172.21.15.189:6829/3852230978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:20:47.371696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:12.762376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:37.936648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:03.950352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:28.922754+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:54.252149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:18.421479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:43.989505+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:08.789671+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:34.336367+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:59.089601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:25:23.761934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/4128337402":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/1460332159":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2577694203":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2393807982":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/2162789959":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/4219073331":"2024-09-13T01:19:00.926419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:26:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.803+0000 7f0bed8a2640 1 -- 172.21.15.81:0/34727555 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f0bd00a2c10 msgr2=0x7f0bd00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.803+0000 7f0bed8a2640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f0bd00a2c10 0x7f0bd00a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8005fd0 tx=0x7f0bd8009500 comp rx=0 tx=0).stop 2024-09-12T01:26:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.803+0000 7f0bed8a2640 1 -- 172.21.15.81:0/34727555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be81036e0 msgr2=0x7f0be8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.803+0000 7f0bed8a2640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be81036e0 0x7f0be8100ed0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc006fd0 tx=0x7f0bdc00b8e0 comp rx=0 tx=0).stop 2024-09-12T01:26:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.803+0000 7f0bed8a2640 1 -- 172.21.15.81:0/34727555 shutdown_connections 2024-09-12T01:26:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.803+0000 7f0bed8a2640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f0bd00a2c10 0x7f0bd00a50d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.803+0000 7f0bed8a2640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0be81082a0 0x7f0be8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.803+0000 7f0bed8a2640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be81036e0 0x7f0be8100ed0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.803+0000 7f0bed8a2640 1 --2- 172.21.15.81:0/34727555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0be8102d30 0x7f0be8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.803+0000 7f0bed8a2640 1 -- 172.21.15.81:0/34727555 >> 172.21.15.81:0/34727555 conn(0x7f0be80fc7d0 msgr2=0x7f0be8106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.803+0000 7f0bed8a2640 1 -- 172.21.15.81:0/34727555 shutdown_connections 2024-09-12T01:26:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:45.803+0000 7f0bed8a2640 1 -- 172.21.15.81:0/34727555 wait complete. 2024-09-12T01:26:46.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:45 smithi189 ceph-mon[35357]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-12T01:26:46.420 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T01:26:46.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:26:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:46.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:46 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/34727555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:47.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:46 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/34727555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:47.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:46 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/34727555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:47.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.133+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2110482773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b28106f10 msgr2=0x7f5b2810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:47.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.133+0000 7f5b2fb34640 1 --2- 172.21.15.81:0/2110482773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b28106f10 0x7f5b2810ea90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009ca0 tx=0x7f5b2002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:26:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.133+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2110482773 shutdown_connections 2024-09-12T01:26:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.133+0000 7f5b2fb34640 1 --2- 172.21.15.81:0/2110482773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b28106f10 0x7f5b2810ea90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.133+0000 7f5b2fb34640 1 --2- 172.21.15.81:0/2110482773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b28102790 0x7f5b281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.133+0000 7f5b2fb34640 1 --2- 172.21.15.81:0/2110482773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b28101de0 0x7f5b281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.133+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2110482773 >> 172.21.15.81:0/2110482773 conn(0x7f5b280fd8c0 msgr2=0x7f5b280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.133+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2110482773 shutdown_connections 2024-09-12T01:26:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.133+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2110482773 wait complete. 2024-09-12T01:26:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2fb34640 1 Processor -- start 2024-09-12T01:26:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2fb34640 1 -- start start 2024-09-12T01:26:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2fb34640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b28101de0 0x7f5b28198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2fb34640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b28102790 0x7f5b28198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2fb34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b28106f10 0x7f5b2819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2fb34640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b28111fe0 con 0x7f5b28106f10 2024-09-12T01:26:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2fb34640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5b28111e60 con 0x7f5b28101de0 2024-09-12T01:26:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2fb34640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5b28112160 con 0x7f5b28102790 2024-09-12T01:26:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2e0d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b28106f10 0x7f5b2819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2e0d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b28106f10 0x7f5b2819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33620/0 (socket says 172.21.15.81:33620) 2024-09-12T01:26:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2e0d1640 1 -- 172.21.15.81:0/2683306306 learned_addr learned my addr 172.21.15.81:0/2683306306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2d8d0640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b28101de0 0x7f5b28198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2d0cf640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b28102790 0x7f5b28198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2e0d1640 1 -- 172.21.15.81:0/2683306306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b28102790 msgr2=0x7f5b28198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2e0d1640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b28102790 0x7f5b28198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2e0d1640 1 -- 172.21.15.81:0/2683306306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b28101de0 msgr2=0x7f5b28198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2e0d1640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b28101de0 0x7f5b28198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2e0d1640 1 -- 172.21.15.81:0/2683306306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2819d3f0 con 0x7f5b28106f10 2024-09-12T01:26:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.134+0000 7f5b2d8d0640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b28101de0 0x7f5b28198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.135+0000 7f5b2e0d1640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b28106f10 0x7f5b2819cd10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5b20003f40 tx=0x7f5b20003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.135+0000 7f5b1effd640 1 -- 172.21.15.81:0/2683306306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b200318c0 con 0x7f5b28106f10 2024-09-12T01:26:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.135+0000 7f5b1effd640 1 -- 172.21.15.81:0/2683306306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b20004520 con 0x7f5b28106f10 2024-09-12T01:26:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.135+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2683306306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2819d680 con 0x7f5b28106f10 2024-09-12T01:26:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.135+0000 7f5b1effd640 1 -- 172.21.15.81:0/2683306306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2002fe10 con 0x7f5b28106f10 2024-09-12T01:26:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.135+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2683306306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b281a4fc0 con 0x7f5b28106f10 2024-09-12T01:26:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.136+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2683306306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b281021c0 con 0x7f5b28106f10 2024-09-12T01:26:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.137+0000 7f5b1effd640 1 -- 172.21.15.81:0/2683306306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5b200046d0 con 0x7f5b28106f10 2024-09-12T01:26:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.137+0000 7f5b1effd640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5b140a2c10 0x7f5b140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.138+0000 7f5b2d8d0640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5b140a2c10 0x7f5b140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.138+0000 7f5b1effd640 1 -- 172.21.15.81:0/2683306306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5b200f07e0 con 0x7f5b28106f10 2024-09-12T01:26:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.138+0000 7f5b2d8d0640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5b140a2c10 0x7f5b140a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009930 tx=0x7f5b24008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.142+0000 7f5b1effd640 1 -- 172.21.15.81:0/2683306306 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b200bd700 con 0x7f5b28106f10 2024-09-12T01:26:47.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.311+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2683306306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b2810a150 con 0x7f5b28106f10 2024-09-12T01:26:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.312+0000 7f5b1effd640 1 -- 172.21.15.81:0/2683306306 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22714 (secure 0 0 0) 0x7f5b200dd0c0 con 0x7f5b28106f10 2024-09-12T01:26:47.312 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:26:47.312 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","created":"2024-09-12T01:18:28.404285+0000","modified":"2024-09-12T01:26:26.256495+0000","last_up_change":"2024-09-12T01:25:26.326110+0000","last_in_change":"2024-09-12T01:25:02.138698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:21:40.649584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:26:10.753723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:26:13.254837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc857dd4-eedc-4c48-89a0-4e69662e8e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6803","nonce":3870994528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6805","nonce":3870994528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6809","nonce":3870994528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6807","nonce":3870994528}]},"public_addr":"172.21.15.81:6803/3870994528","cluster_addr":"172.21.15.81:6805/3870994528","heartbeat_back_addr":"172.21.15.81:6809/3870994528","heartbeat_front_addr":"172.21.15.81:6807/3870994528","state":["exists","up"]},{"osd":1,"uuid":"04b8111b-d677-4fc8-8285-90683621ccf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6801","nonce":2098299652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6803","nonce":2098299652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6807","nonce":2098299652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6805","nonce":2098299652}]},"public_addr":"172.21.15.100:6801/2098299652","cluster_addr":"172.21.15.100:6803/2098299652","heartbeat_back_addr":"172.21.15.100:6807/2098299652","heartbeat_front_addr":"172.21.15.100:6805/2098299652","state":["exists","up"]},{"osd":2,"uuid":"763e357e-5a04-45ff-95e8-bc1abfeac056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6801","nonce":1353548110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6803","nonce":1353548110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6807","nonce":1353548110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6805","nonce":1353548110}]},"public_addr":"172.21.15.189:6801/1353548110","cluster_addr":"172.21.15.189:6803/1353548110","heartbeat_back_addr":"172.21.15.189:6807/1353548110","heartbeat_front_addr":"172.21.15.189:6805/1353548110","state":["exists","up"]},{"osd":3,"uuid":"99843578-1b9e-4ee0-91f1-ba419d07897e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6811","nonce":1064869637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6813","nonce":1064869637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6817","nonce":1064869637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6815","nonce":1064869637}]},"public_addr":"172.21.15.81:6811/1064869637","cluster_addr":"172.21.15.81:6813/1064869637","heartbeat_back_addr":"172.21.15.81:6817/1064869637","heartbeat_front_addr":"172.21.15.81:6815/1064869637","state":["exists","up"]},{"osd":4,"uuid":"a5787415-0905-420e-9ce8-eb6902727561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6809","nonce":1687792282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6811","nonce":1687792282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6815","nonce":1687792282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6813","nonce":1687792282}]},"public_addr":"172.21.15.100:6809/1687792282","cluster_addr":"172.21.15.100:6811/1687792282","heartbeat_back_addr":"172.21.15.100:6815/1687792282","heartbeat_front_addr":"172.21.15.100:6813/1687792282","state":["exists","up"]},{"osd":5,"uuid":"879548b5-5516-407c-8517-bbdbf356c0e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6809","nonce":823474396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6811","nonce":823474396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6815","nonce":823474396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6813","nonce":823474396}]},"public_addr":"172.21.15.189:6809/823474396","cluster_addr":"172.21.15.189:6811/823474396","heartbeat_back_addr":"172.21.15.189:6815/823474396","heartbeat_front_addr":"172.21.15.189:6813/823474396","state":["exists","up"]},{"osd":6,"uuid":"b665b97c-a9d3-475f-93f3-8a920cbb37d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6819","nonce":1522854005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6821","nonce":1522854005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6825","nonce":1522854005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6823","nonce":1522854005}]},"public_addr":"172.21.15.81:6819/1522854005","cluster_addr":"172.21.15.81:6821/1522854005","heartbeat_back_addr":"172.21.15.81:6825/1522854005","heartbeat_front_addr":"172.21.15.81:6823/1522854005","state":["exists","up"]},{"osd":7,"uuid":"46e082c8-d071-471a-8c86-ce5b5700cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6817","nonce":41478541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6819","nonce":41478541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6823","nonce":41478541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6821","nonce":41478541}]},"public_addr":"172.21.15.100:6817/41478541","cluster_addr":"172.21.15.100:6819/41478541","heartbeat_back_addr":"172.21.15.100:6823/41478541","heartbeat_front_addr":"172.21.15.100:6821/41478541","state":["exists","up"]},{"osd":8,"uuid":"fb9b93ef-5a33-4ffc-926e-a78c101bbbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6817","nonce":180766860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6819","nonce":180766860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6823","nonce":180766860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6821","nonce":180766860}]},"public_addr":"172.21.15.189:6817/180766860","cluster_addr":"172.21.15.189:6819/180766860","heartbeat_back_addr":"172.21.15.189:6823/180766860","heartbeat_front_addr":"172.21.15.189:6821/180766860","state":["exists","up"]},{"osd":9,"uuid":"0b7ec1a1-5ab9-4075-acfb-e0d82f018656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6827","nonce":1651232782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6829","nonce":1651232782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6833","nonce":1651232782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6831","nonce":1651232782}]},"public_addr":"172.21.15.81:6827/1651232782","cluster_addr":"172.21.15.81:6829/1651232782","heartbeat_back_addr":"172.21.15.81:6833/1651232782","heartbeat_front_addr":"172.21.15.81:6831/1651232782","state":["exists","up"]},{"osd":10,"uuid":"996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6825","nonce":3295868568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6827","nonce":3295868568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6831","nonce":3295868568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6829","nonce":3295868568}]},"public_addr":"172.21.15.100:6825/3295868568","cluster_addr":"172.21.15.100:6827/3295868568","heartbeat_back_addr":"172.21.15.100:6831/3295868568","heartbeat_front_addr":"172.21.15.100:6829/3295868568","state":["exists","up"]},{"osd":11,"uuid":"f051e2b2-fc58-489a-ab7c-8c1ff5448553","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6825","nonce":3852230978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6827","nonce":3852230978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6831","nonce":3852230978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6829","nonce":3852230978}]},"public_addr":"172.21.15.189:6825/3852230978","cluster_addr":"172.21.15.189:6827/3852230978","heartbeat_back_addr":"172.21.15.189:6831/3852230978","heartbeat_front_addr":"172.21.15.189:6829/3852230978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:20:47.371696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:12.762376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:37.936648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:03.950352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:28.922754+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:54.252149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:18.421479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:43.989505+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:08.789671+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:34.336367+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:59.089601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:25:23.761934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/4128337402":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/1460332159":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2577694203":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2393807982":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/2162789959":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/4219073331":"2024-09-13T01:19:00.926419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:26:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.314+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2683306306 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5b140a2c10 msgr2=0x7f5b140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.314+0000 7f5b2fb34640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5b140a2c10 0x7f5b140a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009930 tx=0x7f5b24008040 comp rx=0 tx=0).stop 2024-09-12T01:26:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.314+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2683306306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b28106f10 msgr2=0x7f5b2819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.314+0000 7f5b2fb34640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b28106f10 0x7f5b2819cd10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5b20003f40 tx=0x7f5b20003f70 comp rx=0 tx=0).stop 2024-09-12T01:26:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.314+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2683306306 shutdown_connections 2024-09-12T01:26:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.314+0000 7f5b2fb34640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5b140a2c10 0x7f5b140a50d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.314+0000 7f5b2fb34640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b28106f10 0x7f5b2819cd10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.314+0000 7f5b2fb34640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b28102790 0x7f5b28198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.314+0000 7f5b2fb34640 1 --2- 172.21.15.81:0/2683306306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b28101de0 0x7f5b28198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.314+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2683306306 >> 172.21.15.81:0/2683306306 conn(0x7f5b280fd8c0 msgr2=0x7f5b280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.315+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2683306306 shutdown_connections 2024-09-12T01:26:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:47.315+0000 7f5b2fb34640 1 -- 172.21.15.81:0/2683306306 wait complete. 2024-09-12T01:26:47.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:47 smithi081 ceph-mon[30920]: pgmap v293: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2024-09-12T01:26:47.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:47 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2683306306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:48.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:47 smithi100 ceph-mon[35275]: pgmap v293: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2024-09-12T01:26:48.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:47 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2683306306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:48.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:47 smithi189 ceph-mon[35357]: pgmap v293: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2024-09-12T01:26:48.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:47 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2683306306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:26:48.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T01:26:48.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T01:26:48.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T01:26:48.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T01:26:48.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T01:26:48.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T01:26:48.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T01:26:48.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T01:26:48.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T01:26:48.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T01:26:48.111 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T01:26:48.111 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T01:26:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:48.863 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:48.869 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:26:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.421+0000 7f757d8f0640 1 -- 172.21.15.81:0/3059816735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578100e20 msgr2=0x7f7578101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.421+0000 7f757d8f0640 1 --2- 172.21.15.81:0/3059816735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578100e20 0x7f7578101200 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7568009900 tx=0x7f756802a480 comp rx=0 tx=0).stop 2024-09-12T01:26:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.421+0000 7f757d8f0640 1 -- 172.21.15.81:0/3059816735 shutdown_connections 2024-09-12T01:26:49.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.421+0000 7f757d8f0640 1 --2- 172.21.15.81:0/3059816735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7578102ef0 0x7f757810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:49.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.421+0000 7f757d8f0640 1 --2- 172.21.15.81:0/3059816735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7578102570 0x7f75781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:49.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.421+0000 7f757d8f0640 1 --2- 172.21.15.81:0/3059816735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578100e20 0x7f7578101200 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:49.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.421+0000 7f757d8f0640 1 -- 172.21.15.81:0/3059816735 >> 172.21.15.81:0/3059816735 conn(0x7f75780fc7d0 msgr2=0x7f75780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:49.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.421+0000 7f757d8f0640 1 -- 172.21.15.81:0/3059816735 shutdown_connections 2024-09-12T01:26:49.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.421+0000 7f757d8f0640 1 -- 172.21.15.81:0/3059816735 wait complete. 2024-09-12T01:26:49.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f757d8f0640 1 Processor -- start 2024-09-12T01:26:49.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f757d8f0640 1 -- start start 2024-09-12T01:26:49.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f757d8f0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7578100e20 0x7f7578199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:49.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f757d8f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578102570 0x7f7578199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:49.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f757d8f0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7578102ef0 0x7f75781a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:49.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f757d8f0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7578110f80 con 0x7f7578102570 2024-09-12T01:26:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f757d8f0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7578110e00 con 0x7f7578102ef0 2024-09-12T01:26:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f757d8f0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7578111100 con 0x7f7578100e20 2024-09-12T01:26:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f756ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578102570 0x7f7578199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f756ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578102570 0x7f7578199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33634/0 (socket says 172.21.15.81:33634) 2024-09-12T01:26:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f756ffff640 1 -- 172.21.15.81:0/3999875183 learned_addr learned my addr 172.21.15.81:0/3999875183 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f756ffff640 1 -- 172.21.15.81:0/3999875183 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7578100e20 msgr2=0x7f7578199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f756ffff640 1 --2- 172.21.15.81:0/3999875183 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7578100e20 0x7f7578199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f756ffff640 1 -- 172.21.15.81:0/3999875183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7578102ef0 msgr2=0x7f75781a42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f756ffff640 1 --2- 172.21.15.81:0/3999875183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7578102ef0 0x7f75781a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.422+0000 7f756ffff640 1 -- 172.21.15.81:0/3999875183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75781a47f0 con 0x7f7578102570 2024-09-12T01:26:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.423+0000 7f756ffff640 1 --2- 172.21.15.81:0/3999875183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578102570 0x7f7578199770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f756000c920 tx=0x7f756000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.423+0000 7f757c8ee640 1 -- 172.21.15.81:0/3999875183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560007c70 con 0x7f7578102570 2024-09-12T01:26:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.423+0000 7f757c8ee640 1 -- 172.21.15.81:0/3999875183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7560007e10 con 0x7f7578102570 2024-09-12T01:26:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.423+0000 7f757d8f0640 1 -- 172.21.15.81:0/3999875183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75781a49c0 con 0x7f7578102570 2024-09-12T01:26:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.423+0000 7f757c8ee640 1 -- 172.21.15.81:0/3999875183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560018890 con 0x7f7578102570 2024-09-12T01:26:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.423+0000 7f757d8f0640 1 -- 172.21.15.81:0/3999875183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75781a4ed0 con 0x7f7578102570 2024-09-12T01:26:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.424+0000 7f757d8f0640 1 -- 172.21.15.81:0/3999875183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f75780fe9f0 con 0x7f7578102570 2024-09-12T01:26:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.425+0000 7f757c8ee640 1 -- 172.21.15.81:0/3999875183 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7560018a30 con 0x7f7578102570 2024-09-12T01:26:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.426+0000 7f757c8ee640 1 --2- 172.21.15.81:0/3999875183 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f75640a2c10 0x7f75640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.426+0000 7f7576ffd640 1 --2- 172.21.15.81:0/3999875183 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f75640a2c10 0x7f75640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.426+0000 7f757c8ee640 1 -- 172.21.15.81:0/3999875183 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f75600cf800 con 0x7f7578102570 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.426+0000 7f757c8ee640 1 --2- 172.21.15.81:0/3999875183 >> [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652] conn(0x7f75640ac7c0 0x7f75640aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.426+0000 7f757c8ee640 1 -- 172.21.15.81:0/3999875183 --> [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75640af330 con 0x7f75640ac7c0 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.426+0000 7f757c8ee640 1 -- 172.21.15.81:0/3999875183 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f75600cfc50 con 0x7f7578102570 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.426+0000 7f7576ffd640 1 --2- 172.21.15.81:0/3999875183 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f75640a2c10 0x7f75640a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f75680096c0 tx=0x7f7568000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.426+0000 7f75777fe640 1 --2- 172.21.15.81:0/3999875183 >> [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652] conn(0x7f75640ac7c0 0x7f75640aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.427+0000 7f75777fe640 1 --2- 172.21.15.81:0/3999875183 >> [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652] conn(0x7f75640ac7c0 0x7f75640aec60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.427+0000 7f757c8ee640 1 -- 172.21.15.81:0/3999875183 <== osd.1 v2:172.21.15.100:6800/2098299652 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f75640af330 con 0x7f75640ac7c0 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.441+0000 7f757d8f0640 1 -- 172.21.15.81:0/3999875183 --> [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f75781021b0 con 0x7f75640ac7c0 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.441+0000 7f757c8ee640 1 -- 172.21.15.81:0/3999875183 <== osd.1 v2:172.21.15.100:6800/2098299652 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f75781021b0 con 0x7f75640ac7c0 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.442+0000 7f757d8f0640 1 -- 172.21.15.81:0/3999875183 >> [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652] conn(0x7f75640ac7c0 msgr2=0x7f75640aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.442+0000 7f757d8f0640 1 --2- 172.21.15.81:0/3999875183 >> [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652] conn(0x7f75640ac7c0 0x7f75640aec60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:49.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.442+0000 7f757d8f0640 1 -- 172.21.15.81:0/3999875183 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f75640a2c10 msgr2=0x7f75640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.442+0000 7f757d8f0640 1 --2- 172.21.15.81:0/3999875183 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f75640a2c10 0x7f75640a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f75680096c0 tx=0x7f7568000bc0 comp rx=0 tx=0).stop 2024-09-12T01:26:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.442+0000 7f757d8f0640 1 -- 172.21.15.81:0/3999875183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578102570 msgr2=0x7f7578199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.442+0000 7f757d8f0640 1 --2- 172.21.15.81:0/3999875183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7578102570 0x7f7578199770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f756000c920 tx=0x7f756000cde0 comp rx=0 tx=0).stop 2024-09-12T01:26:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.442+0000 7f75777fe640 1 -- 172.21.15.81:0/3999875183 reap_dead start 2024-09-12T01:26:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.442+0000 7f757d8f0640 1 -- 172.21.15.81:0/3999875183 shutdown_connections 2024-09-12T01:26:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.442+0000 7f757d8f0640 1 -- 172.21.15.81:0/3999875183 >> 172.21.15.81:0/3999875183 conn(0x7f75780fc7d0 msgr2=0x7f75780fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.442+0000 7f757d8f0640 1 -- 172.21.15.81:0/3999875183 shutdown_connections 2024-09-12T01:26:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:49.442+0000 7f757d8f0640 1 -- 172.21.15.81:0/3999875183 wait complete. 2024-09-12T01:26:49.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:49 smithi081 ceph-mon[30920]: pgmap v294: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-12T01:26:50.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:49 smithi100 ceph-mon[35275]: pgmap v294: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-12T01:26:50.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:49 smithi189 ceph-mon[35357]: pgmap v294: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-12T01:26:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.000+0000 7fedc4042640 1 -- 172.21.15.81:0/4052126772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc106b80 msgr2=0x7fedbc106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.000+0000 7fedc4042640 1 --2- 172.21.15.81:0/4052126772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc106b80 0x7fedbc106f60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009900 tx=0x7fedb802a410 comp rx=0 tx=0).stop 2024-09-12T01:26:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.000+0000 7fedc4042640 1 -- 172.21.15.81:0/4052126772 shutdown_connections 2024-09-12T01:26:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.000+0000 7fedc4042640 1 --2- 172.21.15.81:0/4052126772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedbc100a50 0x7fedbc10ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.000+0000 7fedc4042640 1 --2- 172.21.15.81:0/4052126772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fedbc1000b0 0x7fedbc100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.000+0000 7fedc4042640 1 --2- 172.21.15.81:0/4052126772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc106b80 0x7fedbc106f60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.000+0000 7fedc4042640 1 -- 172.21.15.81:0/4052126772 >> 172.21.15.81:0/4052126772 conn(0x7fedbc0fbee0 msgr2=0x7fedbc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.001+0000 7fedc4042640 1 -- 172.21.15.81:0/4052126772 shutdown_connections 2024-09-12T01:26:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.001+0000 7fedc4042640 1 -- 172.21.15.81:0/4052126772 wait complete. 2024-09-12T01:26:51.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.001+0000 7fedc4042640 1 Processor -- start 2024-09-12T01:26:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.001+0000 7fedc4042640 1 -- start start 2024-09-12T01:26:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc4042640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fedbc1000b0 0x7fedbc1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc4042640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc100a50 0x7fedbc198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc4042640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedbc106b80 0x7fedbc19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc4042640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc112070 con 0x7fedbc100a50 2024-09-12T01:26:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc4042640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc111ef0 con 0x7fedbc106b80 2024-09-12T01:26:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc4042640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc1121f0 con 0x7fedbc1000b0 2024-09-12T01:26:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc15dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc100a50 0x7fedbc198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc15dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc100a50 0x7fedbc198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33676/0 (socket says 172.21.15.81:33676) 2024-09-12T01:26:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc15dd640 1 -- 172.21.15.81:0/91256868 learned_addr learned my addr 172.21.15.81:0/91256868 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc25df640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedbc106b80 0x7fedbc19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc1dde640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fedbc1000b0 0x7fedbc1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc15dd640 1 -- 172.21.15.81:0/91256868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fedbc1000b0 msgr2=0x7fedbc1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc15dd640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fedbc1000b0 0x7fedbc1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc15dd640 1 -- 172.21.15.81:0/91256868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedbc106b80 msgr2=0x7fedbc19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc15dd640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedbc106b80 0x7fedbc19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc15dd640 1 -- 172.21.15.81:0/91256868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc19d480 con 0x7fedbc100a50 2024-09-12T01:26:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc25df640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedbc106b80 0x7fedbc19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc15dd640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc100a50 0x7fedbc198a10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c970 tx=0x7fedac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedb2ffd640 1 -- 172.21.15.81:0/91256868 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac007bb0 con 0x7fedbc100a50 2024-09-12T01:26:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc4042640 1 -- 172.21.15.81:0/91256868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedbc19d770 con 0x7fedbc100a50 2024-09-12T01:26:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedb2ffd640 1 -- 172.21.15.81:0/91256868 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedac007d50 con 0x7fedbc100a50 2024-09-12T01:26:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedb2ffd640 1 -- 172.21.15.81:0/91256868 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac00f450 con 0x7fedbc100a50 2024-09-12T01:26:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.002+0000 7fedc4042640 1 -- 172.21.15.81:0/91256868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedbc1a5050 con 0x7fedbc100a50 2024-09-12T01:26:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.003+0000 7fedc4042640 1 -- 172.21.15.81:0/91256868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fedbc062900 con 0x7fedbc100a50 2024-09-12T01:26:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.004+0000 7fedb2ffd640 1 -- 172.21.15.81:0/91256868 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fedac004fa0 con 0x7fedbc100a50 2024-09-12T01:26:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.005+0000 7fedb2ffd640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7feda80a2c10 0x7feda80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.005+0000 7fedc1dde640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7feda80a2c10 0x7feda80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.005+0000 7fedb2ffd640 1 -- 172.21.15.81:0/91256868 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fedac0cf410 con 0x7fedbc100a50 2024-09-12T01:26:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.005+0000 7fedb2ffd640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568] conn(0x7feda80ac7c0 0x7feda80aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.005+0000 7fedb2ffd640 1 -- 172.21.15.81:0/91256868 --> [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feda80af330 con 0x7feda80ac7c0 2024-09-12T01:26:51.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.005+0000 7fedb2ffd640 1 -- 172.21.15.81:0/91256868 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fedac0cf860 con 0x7fedbc100a50 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.006+0000 7fedc1dde640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7feda80a2c10 0x7feda80a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fedb8005ab0 tx=0x7fedb8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.006+0000 7fedc25df640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568] conn(0x7feda80ac7c0 0x7feda80aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.006+0000 7fedc25df640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568] conn(0x7feda80ac7c0 0x7feda80aec60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.007+0000 7fedb2ffd640 1 -- 172.21.15.81:0/91256868 <== osd.10 v2:172.21.15.100:6824/3295868568 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feda80af330 con 0x7feda80ac7c0 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.020+0000 7fedc4042640 1 -- 172.21.15.81:0/91256868 --> [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fedbc062d00 con 0x7feda80ac7c0 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.021+0000 7fedb2ffd640 1 -- 172.21.15.81:0/91256868 <== osd.10 v2:172.21.15.100:6824/3295868568 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fedbc062d00 con 0x7feda80ac7c0 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.021+0000 7fedc4042640 1 -- 172.21.15.81:0/91256868 >> [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568] conn(0x7feda80ac7c0 msgr2=0x7feda80aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.021+0000 7fedc4042640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568] conn(0x7feda80ac7c0 0x7feda80aec60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.021+0000 7fedc4042640 1 -- 172.21.15.81:0/91256868 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7feda80a2c10 msgr2=0x7feda80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.021+0000 7fedc4042640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7feda80a2c10 0x7feda80a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fedb8005ab0 tx=0x7fedb8005a20 comp rx=0 tx=0).stop 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.021+0000 7fedc4042640 1 -- 172.21.15.81:0/91256868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc100a50 msgr2=0x7fedbc198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.021+0000 7fedc4042640 1 --2- 172.21.15.81:0/91256868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc100a50 0x7fedbc198a10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c970 tx=0x7fedac00ce30 comp rx=0 tx=0).stop 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.021+0000 7fedc25df640 1 -- 172.21.15.81:0/91256868 reap_dead start 2024-09-12T01:26:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.022+0000 7fedc4042640 1 -- 172.21.15.81:0/91256868 shutdown_connections 2024-09-12T01:26:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.022+0000 7fedc4042640 1 -- 172.21.15.81:0/91256868 >> 172.21.15.81:0/91256868 conn(0x7fedbc0fbee0 msgr2=0x7fedbc0fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.022+0000 7fedc4042640 1 -- 172.21.15.81:0/91256868 shutdown_connections 2024-09-12T01:26:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.022+0000 7fedc4042640 1 -- 172.21.15.81:0/91256868 wait complete. 2024-09-12T01:26:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.461+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/1375984141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc3810c170 msgr2=0x7fcc3810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.461+0000 7fcc3e0f7640 1 --2- 172.21.15.81:0/1375984141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc3810c170 0x7fcc3810e610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009ca0 tx=0x7fcc3002a950 comp rx=0 tx=0).stop 2024-09-12T01:26:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.461+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/1375984141 shutdown_connections 2024-09-12T01:26:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.461+0000 7fcc3e0f7640 1 --2- 172.21.15.81:0/1375984141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc3810c170 0x7fcc3810e610 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.461+0000 7fcc3e0f7640 1 --2- 172.21.15.81:0/1375984141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc38103660 0x7fcc3810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.461+0000 7fcc3e0f7640 1 --2- 172.21.15.81:0/1375984141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc38102d40 0x7fcc38103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.461+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/1375984141 >> 172.21.15.81:0/1375984141 conn(0x7fcc380fc7a0 msgr2=0x7fcc380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.461+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/1375984141 shutdown_connections 2024-09-12T01:26:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.461+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/1375984141 wait complete. 2024-09-12T01:26:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.462+0000 7fcc3e0f7640 1 Processor -- start 2024-09-12T01:26:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.462+0000 7fcc3e0f7640 1 -- start start 2024-09-12T01:26:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.462+0000 7fcc3e0f7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc38102d40 0x7fcc38198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.462+0000 7fcc3e0f7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc38103660 0x7fcc38198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.462+0000 7fcc3e0f7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc3810c170 0x7fcc3819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.462+0000 7fcc3e0f7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38112030 con 0x7fcc3810c170 2024-09-12T01:26:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.462+0000 7fcc3e0f7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38111eb0 con 0x7fcc38102d40 2024-09-12T01:26:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.462+0000 7fcc3e0f7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcc381121b0 con 0x7fcc38103660 2024-09-12T01:26:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.462+0000 7fcc37fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc3810c170 0x7fcc3819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.462+0000 7fcc37fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc3810c170 0x7fcc3819ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33692/0 (socket says 172.21.15.81:33692) 2024-09-12T01:26:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.462+0000 7fcc37fff640 1 -- 172.21.15.81:0/420594036 learned_addr learned my addr 172.21.15.81:0/420594036 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.462+0000 7fcc377fe640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc38102d40 0x7fcc38198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.463+0000 7fcc37fff640 1 -- 172.21.15.81:0/420594036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc38103660 msgr2=0x7fcc38198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.463+0000 7fcc36ffd640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc38103660 0x7fcc38198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.463+0000 7fcc37fff640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc38103660 0x7fcc38198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.463+0000 7fcc37fff640 1 -- 172.21.15.81:0/420594036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc38102d40 msgr2=0x7fcc38198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.463+0000 7fcc37fff640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc38102d40 0x7fcc38198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.463+0000 7fcc37fff640 1 -- 172.21.15.81:0/420594036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3819d4f0 con 0x7fcc3810c170 2024-09-12T01:26:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.463+0000 7fcc377fe640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc38102d40 0x7fcc38198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.463+0000 7fcc37fff640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc3810c170 0x7fcc3819ce10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcc30006010 tx=0x7fcc3002f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.463+0000 7fcc34ff9640 1 -- 172.21.15.81:0/420594036 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30034040 con 0x7fcc3810c170 2024-09-12T01:26:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.463+0000 7fcc34ff9640 1 -- 172.21.15.81:0/420594036 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc30003e00 con 0x7fcc3810c170 2024-09-12T01:26:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.463+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/420594036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3819d780 con 0x7fcc3810c170 2024-09-12T01:26:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.463+0000 7fcc34ff9640 1 -- 172.21.15.81:0/420594036 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc300456e0 con 0x7fcc3810c170 2024-09-12T01:26:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.463+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/420594036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc381a50c0 con 0x7fcc3810c170 2024-09-12T01:26:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.464+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/420594036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc38062980 con 0x7fcc3810c170 2024-09-12T01:26:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.465+0000 7fcc34ff9640 1 -- 172.21.15.81:0/420594036 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcc30037020 con 0x7fcc3810c170 2024-09-12T01:26:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.466+0000 7fcc34ff9640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcc200a2c90 0x7fcc200a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.466+0000 7fcc377fe640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcc200a2c90 0x7fcc200a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.466+0000 7fcc34ff9640 1 -- 172.21.15.81:0/420594036 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcc300f03f0 con 0x7fcc3810c170 2024-09-12T01:26:51.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.466+0000 7fcc34ff9640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637] conn(0x7fcc200ac840 0x7fcc200aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.466+0000 7fcc34ff9640 1 -- 172.21.15.81:0/420594036 --> [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc3003ce50 con 0x7fcc200ac840 2024-09-12T01:26:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.466+0000 7fcc34ff9640 1 -- 172.21.15.81:0/420594036 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fcc300f0840 con 0x7fcc3810c170 2024-09-12T01:26:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.466+0000 7fcc36ffd640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637] conn(0x7fcc200ac840 0x7fcc200aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.466+0000 7fcc377fe640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcc200a2c90 0x7fcc200a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009930 tx=0x7fcc28008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.467+0000 7fcc36ffd640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637] conn(0x7fcc200ac840 0x7fcc200aece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:51.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.467+0000 7fcc34ff9640 1 -- 172.21.15.81:0/420594036 <== osd.3 v2:172.21.15.81:6810/1064869637 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc3003ce50 con 0x7fcc200ac840 2024-09-12T01:26:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.481+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/420594036 --> [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcc38062db0 con 0x7fcc200ac840 2024-09-12T01:26:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.481+0000 7fcc34ff9640 1 -- 172.21.15.81:0/420594036 <== osd.3 v2:172.21.15.81:6810/1064869637 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcc38062db0 con 0x7fcc200ac840 2024-09-12T01:26:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.481+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/420594036 >> [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637] conn(0x7fcc200ac840 msgr2=0x7fcc200aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.481+0000 7fcc3e0f7640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637] conn(0x7fcc200ac840 0x7fcc200aece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.482+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/420594036 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcc200a2c90 msgr2=0x7fcc200a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.482+0000 7fcc3e0f7640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcc200a2c90 0x7fcc200a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009930 tx=0x7fcc28008040 comp rx=0 tx=0).stop 2024-09-12T01:26:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.482+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/420594036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc3810c170 msgr2=0x7fcc3819ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.482+0000 7fcc3e0f7640 1 --2- 172.21.15.81:0/420594036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc3810c170 0x7fcc3819ce10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcc30006010 tx=0x7fcc3002f710 comp rx=0 tx=0).stop 2024-09-12T01:26:51.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.482+0000 7fcc37fff640 1 -- 172.21.15.81:0/420594036 reap_dead start 2024-09-12T01:26:51.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.482+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/420594036 shutdown_connections 2024-09-12T01:26:51.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.482+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/420594036 >> 172.21.15.81:0/420594036 conn(0x7fcc380fc7a0 msgr2=0x7fcc380fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:51.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.482+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/420594036 shutdown_connections 2024-09-12T01:26:51.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.482+0000 7fcc3e0f7640 1 -- 172.21.15.81:0/420594036 wait complete. 2024-09-12T01:26:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.680+0000 7f405d9cc640 1 -- 172.21.15.81:0/1376281571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058101de0 msgr2=0x7f40581021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.680+0000 7f405d9cc640 1 --2- 172.21.15.81:0/1376281571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058101de0 0x7f40581021c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4048009900 tx=0x7f404802a410 comp rx=0 tx=0).stop 2024-09-12T01:26:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.680+0000 7f405d9cc640 1 -- 172.21.15.81:0/1376281571 shutdown_connections 2024-09-12T01:26:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.680+0000 7f405d9cc640 1 --2- 172.21.15.81:0/1376281571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4058106f10 0x7f405810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.680+0000 7f405d9cc640 1 --2- 172.21.15.81:0/1376281571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4058102790 0x7f40581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.680+0000 7f405d9cc640 1 --2- 172.21.15.81:0/1376281571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058101de0 0x7f40581021c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.680+0000 7f405d9cc640 1 -- 172.21.15.81:0/1376281571 >> 172.21.15.81:0/1376281571 conn(0x7f40580fd8c0 msgr2=0x7f40580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.680+0000 7f405d9cc640 1 -- 172.21.15.81:0/1376281571 shutdown_connections 2024-09-12T01:26:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.680+0000 7f405d9cc640 1 -- 172.21.15.81:0/1376281571 wait complete. 2024-09-12T01:26:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.680+0000 7f405d9cc640 1 Processor -- start 2024-09-12T01:26:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f405d9cc640 1 -- start start 2024-09-12T01:26:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f405d9cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4058101de0 0x7f4058198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f405d9cc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4058102790 0x7f4058198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f405d9cc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058106f10 0x7f405819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f405d9cc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4058111f30 con 0x7f4058106f10 2024-09-12T01:26:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f405d9cc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4058111db0 con 0x7f4058101de0 2024-09-12T01:26:51.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f405d9cc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40581120b0 con 0x7f4058102790 2024-09-12T01:26:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f40577fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058106f10 0x7f405819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f40577fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058106f10 0x7f405819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33704/0 (socket says 172.21.15.81:33704) 2024-09-12T01:26:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f40577fe640 1 -- 172.21.15.81:0/806016876 learned_addr learned my addr 172.21.15.81:0/806016876 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f4056ffd640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4058101de0 0x7f4058198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f40577fe640 1 -- 172.21.15.81:0/806016876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4058102790 msgr2=0x7f4058198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f40577fe640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4058102790 0x7f4058198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f40577fe640 1 -- 172.21.15.81:0/806016876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4058101de0 msgr2=0x7f4058198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f40577fe640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4058101de0 0x7f4058198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f40577fe640 1 -- 172.21.15.81:0/806016876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405819d3e0 con 0x7f4058106f10 2024-09-12T01:26:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f4056ffd640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4058101de0 0x7f4058198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.681+0000 7f40577fe640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058106f10 0x7f405819cd00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f405000cad0 tx=0x7f405000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.682+0000 7f405c9ca640 1 -- 172.21.15.81:0/806016876 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405000ae20 con 0x7f4058106f10 2024-09-12T01:26:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.682+0000 7f405d9cc640 1 -- 172.21.15.81:0/806016876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405819d6d0 con 0x7f4058106f10 2024-09-12T01:26:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.682+0000 7f405c9ca640 1 -- 172.21.15.81:0/806016876 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4050005020 con 0x7f4058106f10 2024-09-12T01:26:51.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.682+0000 7f405c9ca640 1 -- 172.21.15.81:0/806016876 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405000f6f0 con 0x7f4058106f10 2024-09-12T01:26:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.682+0000 7f405d9cc640 1 -- 172.21.15.81:0/806016876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40581a4fb0 con 0x7f4058106f10 2024-09-12T01:26:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.682+0000 7f405d9cc640 1 -- 172.21.15.81:0/806016876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4058062900 con 0x7f4058106f10 2024-09-12T01:26:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.684+0000 7f405c9ca640 1 -- 172.21.15.81:0/806016876 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f40500051d0 con 0x7f4058106f10 2024-09-12T01:26:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.684+0000 7f405c9ca640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f40400a2c10 0x7f40400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.684+0000 7f4056ffd640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f40400a2c10 0x7f40400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.684+0000 7f405c9ca640 1 -- 172.21.15.81:0/806016876 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f40500cf660 con 0x7f4058106f10 2024-09-12T01:26:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.685+0000 7f405c9ca640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528] conn(0x7f40400ac7c0 0x7f40400aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.685+0000 7f405c9ca640 1 -- 172.21.15.81:0/806016876 --> [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f40400af330 con 0x7f40400ac7c0 2024-09-12T01:26:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.685+0000 7f405c9ca640 1 -- 172.21.15.81:0/806016876 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f40500cfab0 con 0x7f4058106f10 2024-09-12T01:26:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.685+0000 7f40567fc640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528] conn(0x7f40400ac7c0 0x7f40400aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:51.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.685+0000 7f4056ffd640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f40400a2c10 0x7f40400a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4048005ab0 tx=0x7f4048005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.685+0000 7f40567fc640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528] conn(0x7f40400ac7c0 0x7f40400aec60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.686+0000 7f405c9ca640 1 -- 172.21.15.81:0/806016876 <== osd.0 v2:172.21.15.81:6802/3870994528 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f40400af330 con 0x7f40400ac7c0 2024-09-12T01:26:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.699+0000 7f405d9cc640 1 -- 172.21.15.81:0/806016876 --> [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4058062d80 con 0x7f40400ac7c0 2024-09-12T01:26:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.699+0000 7f405c9ca640 1 -- 172.21.15.81:0/806016876 <== osd.0 v2:172.21.15.81:6802/3870994528 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4058062d80 con 0x7f40400ac7c0 2024-09-12T01:26:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.700+0000 7f405d9cc640 1 -- 172.21.15.81:0/806016876 >> [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528] conn(0x7f40400ac7c0 msgr2=0x7f40400aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.700+0000 7f405d9cc640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528] conn(0x7f40400ac7c0 0x7f40400aec60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.700+0000 7f405d9cc640 1 -- 172.21.15.81:0/806016876 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f40400a2c10 msgr2=0x7f40400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.700+0000 7f405d9cc640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f40400a2c10 0x7f40400a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4048005ab0 tx=0x7f4048005a20 comp rx=0 tx=0).stop 2024-09-12T01:26:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.700+0000 7f405d9cc640 1 -- 172.21.15.81:0/806016876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058106f10 msgr2=0x7f405819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.700+0000 7f405d9cc640 1 --2- 172.21.15.81:0/806016876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058106f10 0x7f405819cd00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f405000cad0 tx=0x7f405000cf90 comp rx=0 tx=0).stop 2024-09-12T01:26:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.700+0000 7f40577fe640 1 -- 172.21.15.81:0/806016876 reap_dead start 2024-09-12T01:26:51.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.700+0000 7f405d9cc640 1 -- 172.21.15.81:0/806016876 shutdown_connections 2024-09-12T01:26:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.700+0000 7f405d9cc640 1 -- 172.21.15.81:0/806016876 >> 172.21.15.81:0/806016876 conn(0x7f40580fd8c0 msgr2=0x7f40580fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.700+0000 7f405d9cc640 1 -- 172.21.15.81:0/806016876 shutdown_connections 2024-09-12T01:26:51.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:51.700+0000 7f405d9cc640 1 -- 172.21.15.81:0/806016876 wait complete. 2024-09-12T01:26:51.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:51 smithi081 ceph-mon[30920]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-12T01:26:52.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:51 smithi100 ceph-mon[35275]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-12T01:26:52.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:51 smithi189 ceph-mon[35357]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-12T01:26:52.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.781+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1481660640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41d0106a80 msgr2=0x7f41d0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:52.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.781+0000 7f41d4e3e640 1 --2- 172.21.15.81:0/1481660640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41d0106a80 0x7f41d0106e60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009930 tx=0x7f41c002a420 comp rx=0 tx=0).stop 2024-09-12T01:26:52.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.781+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1481660640 shutdown_connections 2024-09-12T01:26:52.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.781+0000 7f41d4e3e640 1 --2- 172.21.15.81:0/1481660640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d0101420 0x7f41d010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.781+0000 7f41d4e3e640 1 --2- 172.21.15.81:0/1481660640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41d0100a80 0x7f41d0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.781+0000 7f41d4e3e640 1 --2- 172.21.15.81:0/1481660640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41d0106a80 0x7f41d0106e60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.781+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1481660640 >> 172.21.15.81:0/1481660640 conn(0x7f41d00fc7a0 msgr2=0x7f41d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.781+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1481660640 shutdown_connections 2024-09-12T01:26:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.781+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1481660640 wait complete. 2024-09-12T01:26:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41d4e3e640 1 Processor -- start 2024-09-12T01:26:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41d4e3e640 1 -- start start 2024-09-12T01:26:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41d4e3e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d0100a80 0x7f41d01984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41d4e3e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41d0101420 0x7f41d0198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41d4e3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41d0106a80 0x7f41d019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41d4e3e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f41d0110ea0 con 0x7f41d0106a80 2024-09-12T01:26:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41d4e3e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f41d0110d20 con 0x7f41d0100a80 2024-09-12T01:26:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41d4e3e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f41d0111020 con 0x7f41d0101420 2024-09-12T01:26:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41ced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41d0106a80 0x7f41d019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41ced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41d0106a80 0x7f41d019cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41870/0 (socket says 172.21.15.81:41870) 2024-09-12T01:26:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41ced9d640 1 -- 172.21.15.81:0/1910427482 learned_addr learned my addr 172.21.15.81:0/1910427482 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41ce59c640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d0100a80 0x7f41d01984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41ced9d640 1 -- 172.21.15.81:0/1910427482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41d0101420 msgr2=0x7f41d0198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41ced9d640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41d0101420 0x7f41d0198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41ced9d640 1 -- 172.21.15.81:0/1910427482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d0100a80 msgr2=0x7f41d01984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41ced9d640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d0100a80 0x7f41d01984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41ced9d640 1 -- 172.21.15.81:0/1910427482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d019d4a0 con 0x7f41d0106a80 2024-09-12T01:26:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.782+0000 7f41ce59c640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d0100a80 0x7f41d01984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.783+0000 7f41ced9d640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41d0106a80 0x7f41d019cdc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f41c800cad0 tx=0x7f41c800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.783+0000 7f41c77fe640 1 -- 172.21.15.81:0/1910427482 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c800ae20 con 0x7f41d0106a80 2024-09-12T01:26:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.783+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1910427482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d019d790 con 0x7f41d0106a80 2024-09-12T01:26:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.783+0000 7f41c77fe640 1 -- 172.21.15.81:0/1910427482 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41c8005020 con 0x7f41d0106a80 2024-09-12T01:26:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.783+0000 7f41c77fe640 1 -- 172.21.15.81:0/1910427482 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c800f6f0 con 0x7f41d0106a80 2024-09-12T01:26:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.783+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1910427482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d01a5070 con 0x7f41d0106a80 2024-09-12T01:26:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.784+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1910427482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41d00fd180 con 0x7f41d0106a80 2024-09-12T01:26:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.785+0000 7f41c77fe640 1 -- 172.21.15.81:0/1910427482 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f41c80051d0 con 0x7f41d0106a80 2024-09-12T01:26:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.786+0000 7f41c77fe640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f41bc0a2c10 0x7f41bc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.786+0000 7f41ce59c640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f41bc0a2c10 0x7f41bc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.786+0000 7f41c77fe640 1 -- 172.21.15.81:0/1910427482 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f41c80cf690 con 0x7f41d0106a80 2024-09-12T01:26:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.786+0000 7f41c77fe640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110] conn(0x7f41bc0ac7b0 0x7f41bc0aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.786+0000 7f41c77fe640 1 -- 172.21.15.81:0/1910427482 --> [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41bc0af320 con 0x7f41bc0ac7b0 2024-09-12T01:26:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.786+0000 7f41c77fe640 1 -- 172.21.15.81:0/1910427482 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f41c80cfae0 con 0x7f41d0106a80 2024-09-12T01:26:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.786+0000 7f41ce59c640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f41bc0a2c10 0x7f41bc0a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f41c0000c00 tx=0x7f41c0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.787+0000 7f41c7fff640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110] conn(0x7f41bc0ac7b0 0x7f41bc0aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.787+0000 7f41c7fff640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110] conn(0x7f41bc0ac7b0 0x7f41bc0aec50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.788+0000 7f41c77fe640 1 -- 172.21.15.81:0/1910427482 <== osd.2 v2:172.21.15.189:6800/1353548110 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f41bc0af320 con 0x7f41bc0ac7b0 2024-09-12T01:26:52.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.802+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1910427482 --> [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f41d01021c0 con 0x7f41bc0ac7b0 2024-09-12T01:26:52.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.802+0000 7f41c77fe640 1 -- 172.21.15.81:0/1910427482 <== osd.2 v2:172.21.15.189:6800/1353548110 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f41d01021c0 con 0x7f41bc0ac7b0 2024-09-12T01:26:52.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.803+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1910427482 >> [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110] conn(0x7f41bc0ac7b0 msgr2=0x7f41bc0aec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:52.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.803+0000 7f41d4e3e640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110] conn(0x7f41bc0ac7b0 0x7f41bc0aec50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:52.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.803+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1910427482 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f41bc0a2c10 msgr2=0x7f41bc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:52.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.803+0000 7f41d4e3e640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f41bc0a2c10 0x7f41bc0a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f41c0000c00 tx=0x7f41c0005a20 comp rx=0 tx=0).stop 2024-09-12T01:26:52.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.803+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1910427482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41d0106a80 msgr2=0x7f41d019cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:52.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.803+0000 7f41d4e3e640 1 --2- 172.21.15.81:0/1910427482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41d0106a80 0x7f41d019cdc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f41c800cad0 tx=0x7f41c800cf90 comp rx=0 tx=0).stop 2024-09-12T01:26:52.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.803+0000 7f41ced9d640 1 -- 172.21.15.81:0/1910427482 reap_dead start 2024-09-12T01:26:52.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.803+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1910427482 shutdown_connections 2024-09-12T01:26:52.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.803+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1910427482 >> 172.21.15.81:0/1910427482 conn(0x7f41d00fc7a0 msgr2=0x7f41d01048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:52.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.803+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1910427482 shutdown_connections 2024-09-12T01:26:52.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:52.803+0000 7f41d4e3e640 1 -- 172.21.15.81:0/1910427482 wait complete. 2024-09-12T01:26:53.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.667+0000 7f73832d5640 1 -- 172.21.15.81:0/2917191997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f737c101420 msgr2=0x7f737c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:53.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.667+0000 7f73832d5640 1 --2- 172.21.15.81:0/2917191997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f737c101420 0x7f737c10d950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7374009cd0 tx=0x7f737402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.667+0000 7f73832d5640 1 -- 172.21.15.81:0/2917191997 shutdown_connections 2024-09-12T01:26:53.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.667+0000 7f73832d5640 1 --2- 172.21.15.81:0/2917191997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f737c101420 0x7f737c10d950 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.667+0000 7f73832d5640 1 --2- 172.21.15.81:0/2917191997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c100a80 0x7f737c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.667+0000 7f73832d5640 1 --2- 172.21.15.81:0/2917191997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f737c106a80 0x7f737c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.667+0000 7f73832d5640 1 -- 172.21.15.81:0/2917191997 >> 172.21.15.81:0/2917191997 conn(0x7f737c0fc7a0 msgr2=0x7f737c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:53.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.667+0000 7f73832d5640 1 -- 172.21.15.81:0/2917191997 shutdown_connections 2024-09-12T01:26:53.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.667+0000 7f73832d5640 1 -- 172.21.15.81:0/2917191997 wait complete. 2024-09-12T01:26:53.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.668+0000 7f73832d5640 1 Processor -- start 2024-09-12T01:26:53.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.668+0000 7f73832d5640 1 -- start start 2024-09-12T01:26:53.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.668+0000 7f73832d5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f737c100a80 0x7f737c1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:53.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.668+0000 7f73832d5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c101420 0x7f737c197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.668+0000 7f73832d5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f737c106a80 0x7f737c197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.668+0000 7f73832d5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f737c110ea0 con 0x7f737c100a80 2024-09-12T01:26:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.668+0000 7f73832d5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f737c110d20 con 0x7f737c101420 2024-09-12T01:26:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.668+0000 7f73832d5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f737c111020 con 0x7f737c106a80 2024-09-12T01:26:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.668+0000 7f7381071640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f737c100a80 0x7f737c1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.668+0000 7f7381071640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f737c100a80 0x7f737c1970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33654/0 (socket says 172.21.15.81:33654) 2024-09-12T01:26:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.668+0000 7f7381071640 1 -- 172.21.15.81:0/539169759 learned_addr learned my addr 172.21.15.81:0/539169759 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.668+0000 7f7380870640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c101420 0x7f737c197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.668+0000 7f7381872640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f737c106a80 0x7f737c197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.669+0000 7f7381071640 1 -- 172.21.15.81:0/539169759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f737c106a80 msgr2=0x7f737c197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.669+0000 7f7381071640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f737c106a80 0x7f737c197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.669+0000 7f7381071640 1 -- 172.21.15.81:0/539169759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c101420 msgr2=0x7f737c197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.669+0000 7f7381071640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c101420 0x7f737c197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.669+0000 7f7381071640 1 -- 172.21.15.81:0/539169759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c1a6950 con 0x7f737c100a80 2024-09-12T01:26:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.669+0000 7f7380870640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f737c101420 0x7f737c197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.669+0000 7f7381071640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f737c100a80 0x7f737c1970e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f737800b4a0 tx=0x7f737800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.669+0000 7f73727fc640 1 -- 172.21.15.81:0/539169759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378014070 con 0x7f737c100a80 2024-09-12T01:26:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.669+0000 7f73832d5640 1 -- 172.21.15.81:0/539169759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f737c1a6c40 con 0x7f737c100a80 2024-09-12T01:26:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.669+0000 7f73727fc640 1 -- 172.21.15.81:0/539169759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7378010af0 con 0x7f737c100a80 2024-09-12T01:26:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.669+0000 7f73727fc640 1 -- 172.21.15.81:0/539169759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378017d10 con 0x7f737c100a80 2024-09-12T01:26:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.669+0000 7f73832d5640 1 -- 172.21.15.81:0/539169759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737c1a7130 con 0x7f737c100a80 2024-09-12T01:26:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.670+0000 7f73832d5640 1 -- 172.21.15.81:0/539169759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f737c0fd850 con 0x7f737c100a80 2024-09-12T01:26:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.671+0000 7f73727fc640 1 -- 172.21.15.81:0/539169759 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7378017070 con 0x7f737c100a80 2024-09-12T01:26:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.672+0000 7f73727fc640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f73680a2c10 0x7f73680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.672+0000 7f7380870640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f73680a2c10 0x7f73680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.672+0000 7f73727fc640 1 -- 172.21.15.81:0/539169759 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f73780ce900 con 0x7f737c100a80 2024-09-12T01:26:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.672+0000 7f73727fc640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541] conn(0x7f73680ac7c0 0x7f73680aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.672+0000 7f73727fc640 1 -- 172.21.15.81:0/539169759 --> [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73680af330 con 0x7f73680ac7c0 2024-09-12T01:26:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.672+0000 7f73727fc640 1 -- 172.21.15.81:0/539169759 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f73780ced50 con 0x7f737c100a80 2024-09-12T01:26:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.672+0000 7f7380870640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f73680a2c10 0x7f73680a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f737c199240 tx=0x7f736c005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.672+0000 7f7381872640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541] conn(0x7f73680ac7c0 0x7f73680aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.673+0000 7f7381872640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541] conn(0x7f73680ac7c0 0x7f73680aec60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.673+0000 7f73727fc640 1 -- 172.21.15.81:0/539169759 <== osd.7 v2:172.21.15.100:6816/41478541 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f73680af330 con 0x7f73680ac7c0 2024-09-12T01:26:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.687+0000 7f73832d5640 1 -- 172.21.15.81:0/539169759 --> [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f737c1021c0 con 0x7f73680ac7c0 2024-09-12T01:26:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.688+0000 7f73727fc640 1 -- 172.21.15.81:0/539169759 <== osd.7 v2:172.21.15.100:6816/41478541 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f737c1021c0 con 0x7f73680ac7c0 2024-09-12T01:26:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.688+0000 7f73832d5640 1 -- 172.21.15.81:0/539169759 >> [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541] conn(0x7f73680ac7c0 msgr2=0x7f73680aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.688+0000 7f73832d5640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541] conn(0x7f73680ac7c0 0x7f73680aec60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.688+0000 7f73832d5640 1 -- 172.21.15.81:0/539169759 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f73680a2c10 msgr2=0x7f73680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.688+0000 7f73832d5640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f73680a2c10 0x7f73680a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f737c199240 tx=0x7f736c005ec0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.688+0000 7f73832d5640 1 -- 172.21.15.81:0/539169759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f737c100a80 msgr2=0x7f737c1970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.688+0000 7f73832d5640 1 --2- 172.21.15.81:0/539169759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f737c100a80 0x7f737c1970e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f737800b4a0 tx=0x7f737800b960 comp rx=0 tx=0).stop 2024-09-12T01:26:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.688+0000 7f7381872640 1 -- 172.21.15.81:0/539169759 reap_dead start 2024-09-12T01:26:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.688+0000 7f73832d5640 1 -- 172.21.15.81:0/539169759 shutdown_connections 2024-09-12T01:26:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.688+0000 7f73832d5640 1 -- 172.21.15.81:0/539169759 >> 172.21.15.81:0/539169759 conn(0x7f737c0fc7a0 msgr2=0x7f737c0fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.688+0000 7f73832d5640 1 -- 172.21.15.81:0/539169759 shutdown_connections 2024-09-12T01:26:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:50.688+0000 7f73832d5640 1 -- 172.21.15.81:0/539169759 wait complete. 2024-09-12T01:26:53.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.670+0000 7fa141776640 1 -- 172.21.15.81:0/3824023153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c106f10 msgr2=0x7fa13c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:53.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.670+0000 7fa141776640 1 --2- 172.21.15.81:0/3824023153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c106f10 0x7fa13c10ea90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa134009ca0 tx=0x7fa13402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.670+0000 7fa141776640 1 -- 172.21.15.81:0/3824023153 shutdown_connections 2024-09-12T01:26:53.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.670+0000 7fa141776640 1 --2- 172.21.15.81:0/3824023153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c106f10 0x7fa13c10ea90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.670+0000 7fa141776640 1 --2- 172.21.15.81:0/3824023153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa13c102790 0x7fa13c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.670+0000 7fa141776640 1 --2- 172.21.15.81:0/3824023153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa13c101de0 0x7fa13c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.670+0000 7fa141776640 1 -- 172.21.15.81:0/3824023153 >> 172.21.15.81:0/3824023153 conn(0x7fa13c0fd8c0 msgr2=0x7fa13c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:53.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.670+0000 7fa141776640 1 -- 172.21.15.81:0/3824023153 shutdown_connections 2024-09-12T01:26:53.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.670+0000 7fa141776640 1 -- 172.21.15.81:0/3824023153 wait complete. 2024-09-12T01:26:53.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa141776640 1 Processor -- start 2024-09-12T01:26:53.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa141776640 1 -- start start 2024-09-12T01:26:53.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa141776640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa13c101de0 0x7fa13c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:53.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa141776640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c102790 0x7fa13c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:53.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa141776640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa13c106f10 0x7fa13c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:53.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa141776640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c111fb0 con 0x7fa13c102790 2024-09-12T01:26:53.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa141776640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c111e30 con 0x7fa13c101de0 2024-09-12T01:26:53.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa141776640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c112130 con 0x7fa13c106f10 2024-09-12T01:26:53.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa1327fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c102790 0x7fa13c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:53.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa1327fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c102790 0x7fa13c1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41886/0 (socket says 172.21.15.81:41886) 2024-09-12T01:26:53.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa1327fc640 1 -- 172.21.15.81:0/2298236807 learned_addr learned my addr 172.21.15.81:0/2298236807 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:53.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa1327fc640 1 -- 172.21.15.81:0/2298236807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa13c106f10 msgr2=0x7fa13c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:53.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa1327fc640 1 --2- 172.21.15.81:0/2298236807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa13c106f10 0x7fa13c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa1327fc640 1 -- 172.21.15.81:0/2298236807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa13c101de0 msgr2=0x7fa13c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:53.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa1327fc640 1 --2- 172.21.15.81:0/2298236807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa13c101de0 0x7fa13c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa1327fc640 1 -- 172.21.15.81:0/2298236807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c19d420 con 0x7fa13c102790 2024-09-12T01:26:53.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.671+0000 7fa1327fc640 1 --2- 172.21.15.81:0/2298236807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c102790 0x7fa13c1989b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c970 tx=0x7fa12400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:53.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.672+0000 7fa138ff9640 1 -- 172.21.15.81:0/2298236807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa124007bb0 con 0x7fa13c102790 2024-09-12T01:26:53.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.672+0000 7fa138ff9640 1 -- 172.21.15.81:0/2298236807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa124007d50 con 0x7fa13c102790 2024-09-12T01:26:53.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.672+0000 7fa141776640 1 -- 172.21.15.81:0/2298236807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13c19d710 con 0x7fa13c102790 2024-09-12T01:26:53.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.672+0000 7fa138ff9640 1 -- 172.21.15.81:0/2298236807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12400f450 con 0x7fa13c102790 2024-09-12T01:26:53.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.672+0000 7fa141776640 1 -- 172.21.15.81:0/2298236807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13c1a4ff0 con 0x7fa13c102790 2024-09-12T01:26:53.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.673+0000 7fa141776640 1 -- 172.21.15.81:0/2298236807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa13c062980 con 0x7fa13c102790 2024-09-12T01:26:53.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.674+0000 7fa138ff9640 1 -- 172.21.15.81:0/2298236807 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa124004fa0 con 0x7fa13c102790 2024-09-12T01:26:53.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.674+0000 7fa138ff9640 1 --2- 172.21.15.81:0/2298236807 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa1280a2c10 0x7fa1280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:53.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.675+0000 7fa13affd640 1 --2- 172.21.15.81:0/2298236807 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa1280a2c10 0x7fa1280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:53.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.675+0000 7fa138ff9640 1 -- 172.21.15.81:0/2298236807 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa1240cf410 con 0x7fa13c102790 2024-09-12T01:26:53.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.675+0000 7fa138ff9640 1 --2- 172.21.15.81:0/2298236807 >> [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396] conn(0x7fa1280ac7c0 0x7fa1280aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:53.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.675+0000 7fa138ff9640 1 -- 172.21.15.81:0/2298236807 --> [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1280af330 con 0x7fa1280ac7c0 2024-09-12T01:26:53.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.675+0000 7fa138ff9640 1 -- 172.21.15.81:0/2298236807 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fa1240cf850 con 0x7fa13c102790 2024-09-12T01:26:53.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.675+0000 7fa13affd640 1 --2- 172.21.15.81:0/2298236807 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa1280a2c10 0x7fa1280a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa12c009710 tx=0x7fa12c006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:53.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.675+0000 7fa13b7fe640 1 --2- 172.21.15.81:0/2298236807 >> [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396] conn(0x7fa1280ac7c0 0x7fa1280aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:53.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.676+0000 7fa13b7fe640 1 --2- 172.21.15.81:0/2298236807 >> [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396] conn(0x7fa1280ac7c0 0x7fa1280aec60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:53.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.677+0000 7fa138ff9640 1 -- 172.21.15.81:0/2298236807 <== osd.5 v2:172.21.15.189:6808/823474396 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa1280af330 con 0x7fa1280ac7c0 2024-09-12T01:26:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.690+0000 7fa141776640 1 -- 172.21.15.81:0/2298236807 --> [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa13c062e00 con 0x7fa1280ac7c0 2024-09-12T01:26:53.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.691+0000 7fa138ff9640 1 -- 172.21.15.81:0/2298236807 <== osd.5 v2:172.21.15.189:6808/823474396 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa13c062e00 con 0x7fa1280ac7c0 2024-09-12T01:26:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.691+0000 7fa141776640 1 -- 172.21.15.81:0/2298236807 >> [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396] conn(0x7fa1280ac7c0 msgr2=0x7fa1280aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.691+0000 7fa141776640 1 --2- 172.21.15.81:0/2298236807 >> [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396] conn(0x7fa1280ac7c0 0x7fa1280aec60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.691+0000 7fa141776640 1 -- 172.21.15.81:0/2298236807 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa1280a2c10 msgr2=0x7fa1280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.691+0000 7fa141776640 1 --2- 172.21.15.81:0/2298236807 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa1280a2c10 0x7fa1280a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa12c009710 tx=0x7fa12c006c90 comp rx=0 tx=0).stop 2024-09-12T01:26:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.691+0000 7fa141776640 1 -- 172.21.15.81:0/2298236807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c102790 msgr2=0x7fa13c1989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.691+0000 7fa141776640 1 --2- 172.21.15.81:0/2298236807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c102790 0x7fa13c1989b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c970 tx=0x7fa12400ce30 comp rx=0 tx=0).stop 2024-09-12T01:26:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.691+0000 7fa13b7fe640 1 -- 172.21.15.81:0/2298236807 reap_dead start 2024-09-12T01:26:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.691+0000 7fa141776640 1 -- 172.21.15.81:0/2298236807 shutdown_connections 2024-09-12T01:26:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.691+0000 7fa141776640 1 -- 172.21.15.81:0/2298236807 >> 172.21.15.81:0/2298236807 conn(0x7fa13c0fd8c0 msgr2=0x7fa13c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.691+0000 7fa141776640 1 -- 172.21.15.81:0/2298236807 shutdown_connections 2024-09-12T01:26:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:53.691+0000 7fa141776640 1 -- 172.21.15.81:0/2298236807 wait complete. 2024-09-12T01:26:53.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:53 smithi081 ceph-mon[30920]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 13 op/s 2024-09-12T01:26:54.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:53 smithi189 ceph-mon[35357]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 13 op/s 2024-09-12T01:26:54.116 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:53 smithi100 ceph-mon[35275]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 13 op/s 2024-09-12T01:26:54.117 INFO:teuthology.orchestra.run.smithi081.stdout:287762808857 2024-09-12T01:26:54.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T01:26:54.353 INFO:teuthology.orchestra.run.smithi081.stdout:34359738444 2024-09-12T01:26:54.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T01:26:54.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.980+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1713796788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fb4102ef0 msgr2=0x7f5fb410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:54.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.980+0000 7f5fb8a5e640 1 --2- 172.21.15.81:0/1713796788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fb4102ef0 0x7f5fb410da40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5fac009ca0 tx=0x7f5fac02a950 comp rx=0 tx=0).stop 2024-09-12T01:26:54.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.980+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1713796788 shutdown_connections 2024-09-12T01:26:54.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.980+0000 7f5fb8a5e640 1 --2- 172.21.15.81:0/1713796788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fb4102ef0 0x7f5fb410da40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:54.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.980+0000 7f5fb8a5e640 1 --2- 172.21.15.81:0/1713796788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5fb4102570 0x7f5fb41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:54.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.980+0000 7f5fb8a5e640 1 --2- 172.21.15.81:0/1713796788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fb4100e20 0x7f5fb4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:54.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.980+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1713796788 >> 172.21.15.81:0/1713796788 conn(0x7f5fb40fc7d0 msgr2=0x7f5fb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:54.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.980+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1713796788 shutdown_connections 2024-09-12T01:26:54.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.980+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1713796788 wait complete. 2024-09-12T01:26:54.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb8a5e640 1 Processor -- start 2024-09-12T01:26:54.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb8a5e640 1 -- start start 2024-09-12T01:26:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb8a5e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5fb4100e20 0x7f5fb419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb8a5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fb4102570 0x7f5fb419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb8a5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fb4102ef0 0x7f5fb419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb8a5e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb4110f80 con 0x7f5fb4102ef0 2024-09-12T01:26:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb8a5e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb4110e00 con 0x7f5fb4102570 2024-09-12T01:26:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb8a5e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb4111100 con 0x7f5fb4100e20 2024-09-12T01:26:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fb4102ef0 0x7f5fb419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fb4102ef0 0x7f5fb419efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41900/0 (socket says 172.21.15.81:41900) 2024-09-12T01:26:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb2d9d640 1 -- 172.21.15.81:0/1422369499 learned_addr learned my addr 172.21.15.81:0/1422369499 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb259c640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5fb4100e20 0x7f5fb419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb1d9b640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fb4102570 0x7f5fb419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:54.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb2d9d640 1 -- 172.21.15.81:0/1422369499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5fb4100e20 msgr2=0x7f5fb419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb2d9d640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5fb4100e20 0x7f5fb419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb2d9d640 1 -- 172.21.15.81:0/1422369499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fb4102570 msgr2=0x7f5fb419ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb2d9d640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fb4102570 0x7f5fb419ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.981+0000 7f5fb2d9d640 1 -- 172.21.15.81:0/1422369499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb419f6c0 con 0x7f5fb4102ef0 2024-09-12T01:26:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.982+0000 7f5fb2d9d640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fb4102ef0 0x7f5fb419efe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5fac006010 tx=0x7f5fac02f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.982+0000 7f5fab7fe640 1 -- 172.21.15.81:0/1422369499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac034040 con 0x7f5fb4102ef0 2024-09-12T01:26:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.982+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1422369499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb419f950 con 0x7f5fb4102ef0 2024-09-12T01:26:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.982+0000 7f5fab7fe640 1 -- 172.21.15.81:0/1422369499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fac003e00 con 0x7f5fb4102ef0 2024-09-12T01:26:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.982+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1422369499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb41a7290 con 0x7f5fb4102ef0 2024-09-12T01:26:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.982+0000 7f5fab7fe640 1 -- 172.21.15.81:0/1422369499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac045480 con 0x7f5fb4102ef0 2024-09-12T01:26:54.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.983+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1422369499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5f94001030 con 0x7f5fb4102ef0 2024-09-12T01:26:54.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.984+0000 7f5fab7fe640 1 -- 172.21.15.81:0/1422369499 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5fac037020 con 0x7f5fb4102ef0 2024-09-12T01:26:54.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.985+0000 7f5fab7fe640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5fa00a2c90 0x7f5fa00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:54.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.985+0000 7f5fb259c640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5fa00a2c90 0x7f5fa00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:54.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.985+0000 7f5fab7fe640 1 -- 172.21.15.81:0/1422369499 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5fac0f06a0 con 0x7f5fb4102ef0 2024-09-12T01:26:54.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.985+0000 7f5fab7fe640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282] conn(0x7f5fa00ac840 0x7f5fa00aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:54.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.985+0000 7f5fab7fe640 1 -- 172.21.15.81:0/1422369499 --> [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5fac033e50 con 0x7f5fa00ac840 2024-09-12T01:26:54.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.985+0000 7f5fab7fe640 1 -- 172.21.15.81:0/1422369499 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f5fac0f0af0 con 0x7f5fb4102ef0 2024-09-12T01:26:54.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.985+0000 7f5fb259c640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5fa00a2c90 0x7f5fa00a5150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40058c0 tx=0x7f5fa400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:54.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.985+0000 7f5fb1d9b640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282] conn(0x7f5fa00ac840 0x7f5fa00aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:54.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.986+0000 7f5fb1d9b640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282] conn(0x7f5fa00ac840 0x7f5fa00aece0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:54.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:54.987+0000 7f5fab7fe640 1 -- 172.21.15.81:0/1422369499 <== osd.4 v2:172.21.15.100:6808/1687792282 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5fac033e50 con 0x7f5fa00ac840 2024-09-12T01:26:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.000+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1422369499 --> [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5f94002dd0 con 0x7f5fa00ac840 2024-09-12T01:26:54.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.000+0000 7f5fab7fe640 1 -- 172.21.15.81:0/1422369499 <== osd.4 v2:172.21.15.100:6808/1687792282 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5f94002dd0 con 0x7f5fa00ac840 2024-09-12T01:26:55.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.001+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1422369499 >> [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282] conn(0x7f5fa00ac840 msgr2=0x7f5fa00aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.001+0000 7f5fb8a5e640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282] conn(0x7f5fa00ac840 0x7f5fa00aece0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.001+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1422369499 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5fa00a2c90 msgr2=0x7f5fa00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.001+0000 7f5fb8a5e640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f5fa00a2c90 0x7f5fa00a5150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40058c0 tx=0x7f5fa400a2d0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.001+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1422369499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fb4102ef0 msgr2=0x7f5fb419efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.001+0000 7f5fb8a5e640 1 --2- 172.21.15.81:0/1422369499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fb4102ef0 0x7f5fb419efe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5fac006010 tx=0x7f5fac02f6f0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.001+0000 7f5fb2d9d640 1 -- 172.21.15.81:0/1422369499 reap_dead start 2024-09-12T01:26:55.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.001+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1422369499 shutdown_connections 2024-09-12T01:26:55.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.001+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1422369499 >> 172.21.15.81:0/1422369499 conn(0x7f5fb40fc7d0 msgr2=0x7f5fb406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:55.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.001+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1422369499 shutdown_connections 2024-09-12T01:26:55.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.001+0000 7f5fb8a5e640 1 -- 172.21.15.81:0/1422369499 wait complete. 2024-09-12T01:26:55.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.499+0000 7f4d86d68640 1 -- 172.21.15.81:0/2546975864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d80101de0 msgr2=0x7f4d801021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.499+0000 7f4d86d68640 1 --2- 172.21.15.81:0/2546975864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d80101de0 0x7f4d801021c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009900 tx=0x7f4d7402a410 comp rx=0 tx=0).stop 2024-09-12T01:26:55.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.499+0000 7f4d86d68640 1 -- 172.21.15.81:0/2546975864 shutdown_connections 2024-09-12T01:26:55.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.499+0000 7f4d86d68640 1 --2- 172.21.15.81:0/2546975864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d80106f10 0x7f4d8010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.499+0000 7f4d86d68640 1 --2- 172.21.15.81:0/2546975864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d80102790 0x7f4d801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.499+0000 7f4d86d68640 1 --2- 172.21.15.81:0/2546975864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d80101de0 0x7f4d801021c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.499+0000 7f4d86d68640 1 -- 172.21.15.81:0/2546975864 >> 172.21.15.81:0/2546975864 conn(0x7f4d800fd8c0 msgr2=0x7f4d800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:55.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.499+0000 7f4d86d68640 1 -- 172.21.15.81:0/2546975864 shutdown_connections 2024-09-12T01:26:55.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.499+0000 7f4d86d68640 1 -- 172.21.15.81:0/2546975864 wait complete. 2024-09-12T01:26:55.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d86d68640 1 Processor -- start 2024-09-12T01:26:55.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d86d68640 1 -- start start 2024-09-12T01:26:55.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d86d68640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d80101de0 0x7f4d80198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:55.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d86d68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d80102790 0x7f4d801989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:55.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d86d68640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d80106f10 0x7f4d8019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:55.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d86d68640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d80111f70 con 0x7f4d80102790 2024-09-12T01:26:55.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d86d68640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d80111df0 con 0x7f4d80106f10 2024-09-12T01:26:55.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d86d68640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d801120f0 con 0x7f4d80101de0 2024-09-12T01:26:55.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d7ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d80102790 0x7f4d801989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:55.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d7ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d80102790 0x7f4d801989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41922/0 (socket says 172.21.15.81:41922) 2024-09-12T01:26:55.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d7ffff640 1 -- 172.21.15.81:0/1733150737 learned_addr learned my addr 172.21.15.81:0/1733150737 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:55.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d85305640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d80106f10 0x7f4d8019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:55.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d84b04640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d80101de0 0x7f4d80198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:55.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d7ffff640 1 -- 172.21.15.81:0/1733150737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d80101de0 msgr2=0x7f4d80198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d7ffff640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d80101de0 0x7f4d80198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d7ffff640 1 -- 172.21.15.81:0/1733150737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d80106f10 msgr2=0x7f4d8019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d7ffff640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d80106f10 0x7f4d8019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d7ffff640 1 -- 172.21.15.81:0/1733150737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8019d420 con 0x7f4d80102790 2024-09-12T01:26:55.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d84b04640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d80101de0 0x7f4d80198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:26:55.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.500+0000 7f4d7ffff640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d80102790 0x7f4d801989b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00c970 tx=0x7f4d6c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:55.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.501+0000 7f4d7dffb640 1 -- 172.21.15.81:0/1733150737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c007bb0 con 0x7f4d80102790 2024-09-12T01:26:55.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.501+0000 7f4d86d68640 1 -- 172.21.15.81:0/1733150737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8019d710 con 0x7f4d80102790 2024-09-12T01:26:55.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.501+0000 7f4d7dffb640 1 -- 172.21.15.81:0/1733150737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d6c007d50 con 0x7f4d80102790 2024-09-12T01:26:55.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.501+0000 7f4d7dffb640 1 -- 172.21.15.81:0/1733150737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c00f450 con 0x7f4d80102790 2024-09-12T01:26:55.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.501+0000 7f4d86d68640 1 -- 172.21.15.81:0/1733150737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d801a4ff0 con 0x7f4d80102790 2024-09-12T01:26:55.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.502+0000 7f4d86d68640 1 -- 172.21.15.81:0/1733150737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4d80062900 con 0x7f4d80102790 2024-09-12T01:26:55.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.503+0000 7f4d7dffb640 1 -- 172.21.15.81:0/1733150737 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4d6c004fa0 con 0x7f4d80102790 2024-09-12T01:26:55.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.503+0000 7f4d7dffb640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4d700a2c10 0x7f4d700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:55.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.503+0000 7f4d84b04640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4d700a2c10 0x7f4d700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:55.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.504+0000 7f4d7dffb640 1 -- 172.21.15.81:0/1733150737 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4d6c0cf360 con 0x7f4d80102790 2024-09-12T01:26:55.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.504+0000 7f4d7dffb640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860] conn(0x7f4d700ac7c0 0x7f4d700aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:55.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.504+0000 7f4d7dffb640 1 -- 172.21.15.81:0/1733150737 --> [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d700af330 con 0x7f4d700ac7c0 2024-09-12T01:26:55.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.504+0000 7f4d7dffb640 1 -- 172.21.15.81:0/1733150737 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f4d6c0cf7b0 con 0x7f4d80102790 2024-09-12T01:26:55.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.504+0000 7f4d84b04640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4d700a2c10 0x7f4d700a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d74000c00 tx=0x7f4d74032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:55.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.504+0000 7f4d85305640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860] conn(0x7f4d700ac7c0 0x7f4d700aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:55.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.504+0000 7f4d85305640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860] conn(0x7f4d700ac7c0 0x7f4d700aec60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:55.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.505+0000 7f4d7dffb640 1 -- 172.21.15.81:0/1733150737 <== osd.8 v2:172.21.15.189:6816/180766860 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4d700af330 con 0x7f4d700ac7c0 2024-09-12T01:26:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.519+0000 7f4d86d68640 1 -- 172.21.15.81:0/1733150737 --> [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4d80062d80 con 0x7f4d700ac7c0 2024-09-12T01:26:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.519+0000 7f4d7dffb640 1 -- 172.21.15.81:0/1733150737 <== osd.8 v2:172.21.15.189:6816/180766860 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4d80062d80 con 0x7f4d700ac7c0 2024-09-12T01:26:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.519+0000 7f4d86d68640 1 -- 172.21.15.81:0/1733150737 >> [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860] conn(0x7f4d700ac7c0 msgr2=0x7f4d700aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.519+0000 7f4d86d68640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860] conn(0x7f4d700ac7c0 0x7f4d700aec60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.519+0000 7f4d86d68640 1 -- 172.21.15.81:0/1733150737 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4d700a2c10 msgr2=0x7f4d700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.519+0000 7f4d86d68640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4d700a2c10 0x7f4d700a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d74000c00 tx=0x7f4d74032c70 comp rx=0 tx=0).stop 2024-09-12T01:26:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.519+0000 7f4d86d68640 1 -- 172.21.15.81:0/1733150737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d80102790 msgr2=0x7f4d801989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.519+0000 7f4d86d68640 1 --2- 172.21.15.81:0/1733150737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d80102790 0x7f4d801989b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00c970 tx=0x7f4d6c00ce30 comp rx=0 tx=0).stop 2024-09-12T01:26:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.519+0000 7f4d85305640 1 -- 172.21.15.81:0/1733150737 reap_dead start 2024-09-12T01:26:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.520+0000 7f4d86d68640 1 -- 172.21.15.81:0/1733150737 shutdown_connections 2024-09-12T01:26:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.520+0000 7f4d86d68640 1 -- 172.21.15.81:0/1733150737 >> 172.21.15.81:0/1733150737 conn(0x7f4d800fd8c0 msgr2=0x7f4d800fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.520+0000 7f4d86d68640 1 -- 172.21.15.81:0/1733150737 shutdown_connections 2024-09-12T01:26:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.520+0000 7f4d86d68640 1 -- 172.21.15.81:0/1733150737 wait complete. 2024-09-12T01:26:55.732 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:55 smithi081 ceph-mon[30920]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T01:26:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.733+0000 7f00b8e7a640 1 -- 172.21.15.81:0/3229198917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4102d90 msgr2=0x7f00b4103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.733+0000 7f00b8e7a640 1 --2- 172.21.15.81:0/3229198917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4102d90 0x7f00b4103170 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009930 tx=0x7f00a402a420 comp rx=0 tx=0).stop 2024-09-12T01:26:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.733+0000 7f00b8e7a640 1 -- 172.21.15.81:0/3229198917 shutdown_connections 2024-09-12T01:26:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.733+0000 7f00b8e7a640 1 --2- 172.21.15.81:0/3229198917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b4108290 0x7f00b410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.733+0000 7f00b8e7a640 1 --2- 172.21.15.81:0/3229198917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00b4103740 0x7f00b4107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.733+0000 7f00b8e7a640 1 --2- 172.21.15.81:0/3229198917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4102d90 0x7f00b4103170 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.733+0000 7f00b8e7a640 1 -- 172.21.15.81:0/3229198917 >> 172.21.15.81:0/3229198917 conn(0x7f00b40fc7d0 msgr2=0x7f00b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.733+0000 7f00b8e7a640 1 -- 172.21.15.81:0/3229198917 shutdown_connections 2024-09-12T01:26:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.733+0000 7f00b8e7a640 1 -- 172.21.15.81:0/3229198917 wait complete. 2024-09-12T01:26:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b8e7a640 1 Processor -- start 2024-09-12T01:26:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b8e7a640 1 -- start start 2024-09-12T01:26:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b8e7a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b4102d90 0x7f00b41009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b8e7a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00b4103740 0x7f00b4100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b8e7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108290 0x7f00b4101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b8e7a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4112090 con 0x7f00b4108290 2024-09-12T01:26:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b8e7a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4111f10 con 0x7f00b4102d90 2024-09-12T01:26:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b8e7a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4112210 con 0x7f00b4103740 2024-09-12T01:26:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108290 0x7f00b4101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108290 0x7f00b4101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41946/0 (socket says 172.21.15.81:41946) 2024-09-12T01:26:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b2d9d640 1 -- 172.21.15.81:0/2585611382 learned_addr learned my addr 172.21.15.81:0/2585611382 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b259c640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b4102d90 0x7f00b41009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:55.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b1d9b640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00b4103740 0x7f00b4100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:55.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b2d9d640 1 -- 172.21.15.81:0/2585611382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00b4103740 msgr2=0x7f00b4100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b2d9d640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00b4103740 0x7f00b4100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.734+0000 7f00b2d9d640 1 -- 172.21.15.81:0/2585611382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b4102d90 msgr2=0x7f00b41009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.735+0000 7f00b2d9d640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b4102d90 0x7f00b41009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.735+0000 7f00b2d9d640 1 -- 172.21.15.81:0/2585611382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b41a6a90 con 0x7f00b4108290 2024-09-12T01:26:55.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.735+0000 7f00b2d9d640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108290 0x7f00b4101470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00eaa0 tx=0x7f00ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:55.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.735+0000 7f00a37fe640 1 -- 172.21.15.81:0/2585611382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00cdb0 con 0x7f00b4108290 2024-09-12T01:26:55.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.735+0000 7f00a37fe640 1 -- 172.21.15.81:0/2585611382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00ac005020 con 0x7f00b4108290 2024-09-12T01:26:55.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.735+0000 7f00b8e7a640 1 -- 172.21.15.81:0/2585611382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b41a6d80 con 0x7f00b4108290 2024-09-12T01:26:55.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.735+0000 7f00a37fe640 1 -- 172.21.15.81:0/2585611382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0116b0 con 0x7f00b4108290 2024-09-12T01:26:55.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.735+0000 7f00b8e7a640 1 -- 172.21.15.81:0/2585611382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b41a7270 con 0x7f00b4108290 2024-09-12T01:26:55.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.736+0000 7f00b8e7a640 1 -- 172.21.15.81:0/2585611382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00b40628c0 con 0x7f00b4108290 2024-09-12T01:26:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.737+0000 7f00a37fe640 1 -- 172.21.15.81:0/2585611382 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f00ac005560 con 0x7f00b4108290 2024-09-12T01:26:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.738+0000 7f00a37fe640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f009c0a2c10 0x7f009c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.738+0000 7f00b259c640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f009c0a2c10 0x7f009c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.738+0000 7f00a37fe640 1 -- 172.21.15.81:0/2585611382 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f00ac0cf7d0 con 0x7f00b4108290 2024-09-12T01:26:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.738+0000 7f00a37fe640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005] conn(0x7f009c0ac7c0 0x7f009c0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.738+0000 7f00a37fe640 1 -- 172.21.15.81:0/2585611382 --> [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00ac014ec0 con 0x7f009c0ac7c0 2024-09-12T01:26:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.738+0000 7f00a37fe640 1 -- 172.21.15.81:0/2585611382 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f00ac0cfc20 con 0x7f00b4108290 2024-09-12T01:26:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.738+0000 7f00b1d9b640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005] conn(0x7f009c0ac7c0 0x7f009c0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.739+0000 7f00b259c640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f009c0a2c10 0x7f009c0a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009900 tx=0x7f00a40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.739+0000 7f00b1d9b640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005] conn(0x7f009c0ac7c0 0x7f009c0aec60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:55.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.740+0000 7f00a37fe640 1 -- 172.21.15.81:0/2585611382 <== osd.6 v2:172.21.15.81:6818/1522854005 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f00ac014ec0 con 0x7f009c0ac7c0 2024-09-12T01:26:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.754+0000 7f00b8e7a640 1 -- 172.21.15.81:0/2585611382 --> [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00b4062d40 con 0x7f009c0ac7c0 2024-09-12T01:26:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.755+0000 7f00a37fe640 1 -- 172.21.15.81:0/2585611382 <== osd.6 v2:172.21.15.81:6818/1522854005 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f00b4062d40 con 0x7f009c0ac7c0 2024-09-12T01:26:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.755+0000 7f00b8e7a640 1 -- 172.21.15.81:0/2585611382 >> [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005] conn(0x7f009c0ac7c0 msgr2=0x7f009c0aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.755+0000 7f00b8e7a640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005] conn(0x7f009c0ac7c0 0x7f009c0aec60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.755+0000 7f00b8e7a640 1 -- 172.21.15.81:0/2585611382 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f009c0a2c10 msgr2=0x7f009c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.755+0000 7f00b8e7a640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f009c0a2c10 0x7f009c0a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009900 tx=0x7f00a40058d0 comp rx=0 tx=0).stop 2024-09-12T01:26:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.755+0000 7f00b8e7a640 1 -- 172.21.15.81:0/2585611382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108290 msgr2=0x7f00b4101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.755+0000 7f00b8e7a640 1 --2- 172.21.15.81:0/2585611382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108290 0x7f00b4101470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00eaa0 tx=0x7f00ac00ef60 comp rx=0 tx=0).stop 2024-09-12T01:26:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.755+0000 7f00b2d9d640 1 -- 172.21.15.81:0/2585611382 reap_dead start 2024-09-12T01:26:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.755+0000 7f00b8e7a640 1 -- 172.21.15.81:0/2585611382 shutdown_connections 2024-09-12T01:26:55.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.755+0000 7f00b8e7a640 1 -- 172.21.15.81:0/2585611382 >> 172.21.15.81:0/2585611382 conn(0x7f00b40fc7d0 msgr2=0x7f00b4106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:55.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.756+0000 7f00b8e7a640 1 -- 172.21.15.81:0/2585611382 shutdown_connections 2024-09-12T01:26:55.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:55.756+0000 7f00b8e7a640 1 -- 172.21.15.81:0/2585611382 wait complete. 2024-09-12T01:26:56.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:55 smithi100 ceph-mon[35275]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T01:26:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:55 smithi189 ceph-mon[35357]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-12T01:26:56.356 INFO:teuthology.orchestra.run.smithi081.stdout:77309411394 2024-09-12T01:26:56.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T01:26:57.815 INFO:teuthology.orchestra.run.smithi081.stdout:103079215164 2024-09-12T01:26:57.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T01:26:57.837 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:57 smithi081 ceph-mon[30920]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T01:26:58.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:57 smithi100 ceph-mon[35275]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T01:26:58.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:57 smithi189 ceph-mon[35357]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T01:26:58.267 INFO:teuthology.orchestra.run.smithi081.stdout:150323855410 2024-09-12T01:26:58.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T01:26:58.771 INFO:teuthology.orchestra.run.smithi081.stdout:133143986232 2024-09-12T01:26:58.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T01:26:59.200 INFO:teuthology.orchestra.run.smithi081.stdout:55834574918 2024-09-12T01:26:59.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T01:26:59.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.360+0000 7fba566f8640 1 -- 172.21.15.81:0/218467720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba501082a0 msgr2=0x7fba5010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:59.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.360+0000 7fba566f8640 1 --2- 172.21.15.81:0/218467720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba501082a0 0x7fba5010ec40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fba48009cd0 tx=0x7fba4802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:26:59.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.360+0000 7fba566f8640 1 -- 172.21.15.81:0/218467720 shutdown_connections 2024-09-12T01:26:59.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.360+0000 7fba566f8640 1 --2- 172.21.15.81:0/218467720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba501082a0 0x7fba5010ec40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:59.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.360+0000 7fba566f8640 1 --2- 172.21.15.81:0/218467720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba501036e0 0x7fba50107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:59.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.360+0000 7fba566f8640 1 --2- 172.21.15.81:0/218467720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba50102d30 0x7fba50103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:59.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.360+0000 7fba566f8640 1 -- 172.21.15.81:0/218467720 >> 172.21.15.81:0/218467720 conn(0x7fba500fc7d0 msgr2=0x7fba500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:59.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.360+0000 7fba566f8640 1 -- 172.21.15.81:0/218467720 shutdown_connections 2024-09-12T01:26:59.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.360+0000 7fba566f8640 1 -- 172.21.15.81:0/218467720 wait complete. 2024-09-12T01:26:59.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.360+0000 7fba566f8640 1 Processor -- start 2024-09-12T01:26:59.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.360+0000 7fba566f8640 1 -- start start 2024-09-12T01:26:59.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba566f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba50102d30 0x7fba50198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:59.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba566f8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba501036e0 0x7fba50198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:59.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba566f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba501082a0 0x7fba5019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba566f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fba50112100 con 0x7fba50102d30 2024-09-12T01:26:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba566f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fba50111f80 con 0x7fba501082a0 2024-09-12T01:26:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba566f8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fba50112280 con 0x7fba501036e0 2024-09-12T01:26:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba50102d30 0x7fba50198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba50102d30 0x7fba50198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41960/0 (socket says 172.21.15.81:41960) 2024-09-12T01:26:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba4ffff640 1 -- 172.21.15.81:0/3117140999 learned_addr learned my addr 172.21.15.81:0/3117140999 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:26:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba54c95640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba501082a0 0x7fba5019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba47fff640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba501036e0 0x7fba50198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba4ffff640 1 -- 172.21.15.81:0/3117140999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba501036e0 msgr2=0x7fba50198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba4ffff640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba501036e0 0x7fba50198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba4ffff640 1 -- 172.21.15.81:0/3117140999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba501082a0 msgr2=0x7fba5019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba4ffff640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba501082a0 0x7fba5019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba4ffff640 1 -- 172.21.15.81:0/3117140999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5019d500 con 0x7fba50102d30 2024-09-12T01:26:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba47fff640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fba501036e0 0x7fba50198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:26:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba4ffff640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba50102d30 0x7fba50198550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fba4000b4a0 tx=0x7fba4000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba4dffb640 1 -- 172.21.15.81:0/3117140999 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40014070 con 0x7fba50102d30 2024-09-12T01:26:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba566f8640 1 -- 172.21.15.81:0/3117140999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5019d7f0 con 0x7fba50102d30 2024-09-12T01:26:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba4dffb640 1 -- 172.21.15.81:0/3117140999 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba40010af0 con 0x7fba50102d30 2024-09-12T01:26:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba4dffb640 1 -- 172.21.15.81:0/3117140999 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40017d10 con 0x7fba50102d30 2024-09-12T01:26:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.361+0000 7fba566f8640 1 -- 172.21.15.81:0/3117140999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba501a50d0 con 0x7fba50102d30 2024-09-12T01:26:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.362+0000 7fba566f8640 1 -- 172.21.15.81:0/3117140999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fba50062980 con 0x7fba50102d30 2024-09-12T01:26:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.363+0000 7fba4dffb640 1 -- 172.21.15.81:0/3117140999 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fba40017070 con 0x7fba50102d30 2024-09-12T01:26:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.364+0000 7fba4dffb640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fba3c0a2c10 0x7fba3c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.364+0000 7fba47fff640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fba3c0a2c10 0x7fba3c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.364+0000 7fba4dffb640 1 -- 172.21.15.81:0/3117140999 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fba400ce820 con 0x7fba50102d30 2024-09-12T01:26:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.364+0000 7fba4dffb640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978] conn(0x7fba3c0ac7c0 0x7fba3c0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:26:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.364+0000 7fba4dffb640 1 -- 172.21.15.81:0/3117140999 --> [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba4001ae50 con 0x7fba3c0ac7c0 2024-09-12T01:26:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.364+0000 7fba4dffb640 1 -- 172.21.15.81:0/3117140999 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fba400cec70 con 0x7fba50102d30 2024-09-12T01:26:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.365+0000 7fba47fff640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fba3c0a2c10 0x7fba3c0a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba500fed20 tx=0x7fba3800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.365+0000 7fba54c95640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978] conn(0x7fba3c0ac7c0 0x7fba3c0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:26:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.365+0000 7fba54c95640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978] conn(0x7fba3c0ac7c0 0x7fba3c0aec60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:26:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.366+0000 7fba4dffb640 1 -- 172.21.15.81:0/3117140999 <== osd.11 v2:172.21.15.189:6824/3852230978 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fba4001ae50 con 0x7fba3c0ac7c0 2024-09-12T01:26:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.380+0000 7fba566f8640 1 -- 172.21.15.81:0/3117140999 --> [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fba50062d80 con 0x7fba3c0ac7c0 2024-09-12T01:26:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.380+0000 7fba4dffb640 1 -- 172.21.15.81:0/3117140999 <== osd.11 v2:172.21.15.189:6824/3852230978 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fba50062d80 con 0x7fba3c0ac7c0 2024-09-12T01:26:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.381+0000 7fba566f8640 1 -- 172.21.15.81:0/3117140999 >> [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978] conn(0x7fba3c0ac7c0 msgr2=0x7fba3c0aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.381+0000 7fba566f8640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978] conn(0x7fba3c0ac7c0 0x7fba3c0aec60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:26:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.381+0000 7fba566f8640 1 -- 172.21.15.81:0/3117140999 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fba3c0a2c10 msgr2=0x7fba3c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.381+0000 7fba566f8640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fba3c0a2c10 0x7fba3c0a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba500fed20 tx=0x7fba3800a5c0 comp rx=0 tx=0).stop 2024-09-12T01:26:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.381+0000 7fba566f8640 1 -- 172.21.15.81:0/3117140999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba50102d30 msgr2=0x7fba50198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:26:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.381+0000 7fba566f8640 1 --2- 172.21.15.81:0/3117140999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba50102d30 0x7fba50198550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fba4000b4a0 tx=0x7fba4000b960 comp rx=0 tx=0).stop 2024-09-12T01:26:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.381+0000 7fba54c95640 1 -- 172.21.15.81:0/3117140999 reap_dead start 2024-09-12T01:26:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.381+0000 7fba566f8640 1 -- 172.21.15.81:0/3117140999 shutdown_connections 2024-09-12T01:26:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.381+0000 7fba566f8640 1 -- 172.21.15.81:0/3117140999 >> 172.21.15.81:0/3117140999 conn(0x7fba500fc7d0 msgr2=0x7fba50106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:26:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.381+0000 7fba566f8640 1 -- 172.21.15.81:0/3117140999 shutdown_connections 2024-09-12T01:26:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:26:57.381+0000 7fba566f8640 1 -- 172.21.15.81:0/3117140999 wait complete. 2024-09-12T01:26:59.815 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:26:59 smithi081 ceph-mon[30920]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:00.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:26:59 smithi100 ceph-mon[35275]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:26:59 smithi189 ceph-mon[35357]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:00.219 INFO:teuthology.orchestra.run.smithi081.stdout:317827579926 2024-09-12T01:27:00.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T01:27:00.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.461+0000 7fad1c152640 1 -- 172.21.15.81:0/3645155493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14106a60 msgr2=0x7fad14106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:00.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.461+0000 7fad1c152640 1 --2- 172.21.15.81:0/3645155493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14106a60 0x7fad14106e40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fad10009930 tx=0x7fad1002a420 comp rx=0 tx=0).stop 2024-09-12T01:27:00.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.461+0000 7fad1c152640 1 -- 172.21.15.81:0/3645155493 shutdown_connections 2024-09-12T01:27:00.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.461+0000 7fad1c152640 1 --2- 172.21.15.81:0/3645155493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14101400 0x7fad1410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:00.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.461+0000 7fad1c152640 1 --2- 172.21.15.81:0/3645155493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14100a60 0x7fad14100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:00.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.461+0000 7fad1c152640 1 --2- 172.21.15.81:0/3645155493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14106a60 0x7fad14106e40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:00.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.461+0000 7fad1c152640 1 -- 172.21.15.81:0/3645155493 >> 172.21.15.81:0/3645155493 conn(0x7fad140fc780 msgr2=0x7fad140feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:00.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.461+0000 7fad1c152640 1 -- 172.21.15.81:0/3645155493 shutdown_connections 2024-09-12T01:27:00.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.461+0000 7fad1c152640 1 -- 172.21.15.81:0/3645155493 wait complete. 2024-09-12T01:27:00.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad1c152640 1 Processor -- start 2024-09-12T01:27:00.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad1c152640 1 -- start start 2024-09-12T01:27:00.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad1c152640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14100a60 0x7fad14199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:00.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad1c152640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14101400 0x7fad14199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:00.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad1c152640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14106a60 0x7fad141a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:00.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad1c152640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad14110ed0 con 0x7fad14100a60 2024-09-12T01:27:00.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad1c152640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad14110d50 con 0x7fad14106a60 2024-09-12T01:27:00.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad1c152640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad14111050 con 0x7fad14101400 2024-09-12T01:27:00.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad19eee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14100a60 0x7fad14199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:00.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad19eee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14100a60 0x7fad14199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41976/0 (socket says 172.21.15.81:41976) 2024-09-12T01:27:00.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad19eee640 1 -- 172.21.15.81:0/1443101111 learned_addr learned my addr 172.21.15.81:0/1443101111 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:00.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad1a6ef640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14106a60 0x7fad141a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad19eee640 1 -- 172.21.15.81:0/1443101111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14101400 msgr2=0x7fad14199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad19eee640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14101400 0x7fad14199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad19eee640 1 -- 172.21.15.81:0/1443101111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14106a60 msgr2=0x7fad141a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad19eee640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14106a60 0x7fad141a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad19eee640 1 -- 172.21.15.81:0/1443101111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad141a48e0 con 0x7fad14100a60 2024-09-12T01:27:00.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.462+0000 7fad1a6ef640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad14106a60 0x7fad141a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:00.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.463+0000 7fad19eee640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14100a60 0x7fad14199320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fad1002a940 tx=0x7fad10003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:00.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.463+0000 7fad0affd640 1 -- 172.21.15.81:0/1443101111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1003f070 con 0x7fad14100a60 2024-09-12T01:27:00.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.463+0000 7fad1c152640 1 -- 172.21.15.81:0/1443101111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad141a4ab0 con 0x7fad14100a60 2024-09-12T01:27:00.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.463+0000 7fad0affd640 1 -- 172.21.15.81:0/1443101111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad1003b460 con 0x7fad14100a60 2024-09-12T01:27:00.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.463+0000 7fad0affd640 1 -- 172.21.15.81:0/1443101111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10035030 con 0x7fad14100a60 2024-09-12T01:27:00.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.463+0000 7fad1c152640 1 -- 172.21.15.81:0/1443101111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad141a4f00 con 0x7fad14100a60 2024-09-12T01:27:00.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.464+0000 7fad1c152640 1 -- 172.21.15.81:0/1443101111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad14062900 con 0x7fad14100a60 2024-09-12T01:27:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.465+0000 7fad0affd640 1 -- 172.21.15.81:0/1443101111 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fad10042070 con 0x7fad14100a60 2024-09-12T01:27:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.465+0000 7fad0affd640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fad000a2c10 0x7fad000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.466+0000 7fad196ed640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fad000a2c10 0x7fad000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.466+0000 7fad0affd640 1 -- 172.21.15.81:0/1443101111 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fad100efe80 con 0x7fad14100a60 2024-09-12T01:27:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.466+0000 7fad0affd640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782] conn(0x7fad000ac690 0x7fad000aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.466+0000 7fad0affd640 1 -- 172.21.15.81:0/1443101111 --> [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad10038e90 con 0x7fad000ac690 2024-09-12T01:27:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.466+0000 7fad0affd640 1 -- 172.21.15.81:0/1443101111 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fad100f02d0 con 0x7fad14100a60 2024-09-12T01:27:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.466+0000 7fad1a6ef640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782] conn(0x7fad000ac690 0x7fad000aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.466+0000 7fad196ed640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fad000a2c10 0x7fad000a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fad1406b2e0 tx=0x7fad04005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.466+0000 7fad1a6ef640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782] conn(0x7fad000ac690 0x7fad000aeb30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.467+0000 7fad0affd640 1 -- 172.21.15.81:0/1443101111 <== osd.9 v2:172.21.15.81:6826/1651232782 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad10038e90 con 0x7fad000ac690 2024-09-12T01:27:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.481+0000 7fad1c152640 1 -- 172.21.15.81:0/1443101111 --> [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fad14062d80 con 0x7fad000ac690 2024-09-12T01:27:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.481+0000 7fad0affd640 1 -- 172.21.15.81:0/1443101111 <== osd.9 v2:172.21.15.81:6826/1651232782 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fad14062d80 con 0x7fad000ac690 2024-09-12T01:27:00.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.482+0000 7fad1c152640 1 -- 172.21.15.81:0/1443101111 >> [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782] conn(0x7fad000ac690 msgr2=0x7fad000aeb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:00.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.482+0000 7fad1c152640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782] conn(0x7fad000ac690 0x7fad000aeb30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:00.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.482+0000 7fad1c152640 1 -- 172.21.15.81:0/1443101111 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fad000a2c10 msgr2=0x7fad000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:00.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.482+0000 7fad1c152640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fad000a2c10 0x7fad000a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fad1406b2e0 tx=0x7fad04005bf0 comp rx=0 tx=0).stop 2024-09-12T01:27:00.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.482+0000 7fad1c152640 1 -- 172.21.15.81:0/1443101111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14100a60 msgr2=0x7fad14199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:00.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.482+0000 7fad1c152640 1 --2- 172.21.15.81:0/1443101111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14100a60 0x7fad14199320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fad1002a940 tx=0x7fad10003c00 comp rx=0 tx=0).stop 2024-09-12T01:27:00.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.482+0000 7fad1a6ef640 1 -- 172.21.15.81:0/1443101111 reap_dead start 2024-09-12T01:27:00.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.482+0000 7fad1c152640 1 -- 172.21.15.81:0/1443101111 shutdown_connections 2024-09-12T01:27:00.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.482+0000 7fad1c152640 1 -- 172.21.15.81:0/1443101111 >> 172.21.15.81:0/1443101111 conn(0x7fad140fc780 msgr2=0x7fad140fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:00.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.482+0000 7fad1c152640 1 -- 172.21.15.81:0/1443101111 shutdown_connections 2024-09-12T01:27:00.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:00.482+0000 7fad1c152640 1 -- 172.21.15.81:0/1443101111 wait complete. 2024-09-12T01:27:00.995 INFO:teuthology.orchestra.run.smithi081.stdout:180388626479 2024-09-12T01:27:00.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T01:27:01.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:01 smithi081 ceph-mon[30920]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:01.775 INFO:teuthology.orchestra.run.smithi081.stdout:236223201316 2024-09-12T01:27:01.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T01:27:02.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:01 smithi100 ceph-mon[35275]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:02.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:01 smithi189 ceph-mon[35357]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:02.147 INFO:teuthology.orchestra.run.smithi081.stdout:201863462951 2024-09-12T01:27:02.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T01:27:02.665 INFO:teuthology.orchestra.run.smithi081.stdout:266287972384 2024-09-12T01:27:02.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T01:27:02.688 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:02.745 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:02.746 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:02.752 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:03.759 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:03 smithi081 ceph-mon[30920]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:03.834 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:03 smithi189 ceph-mon[35357]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:03.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.842+0000 7f46638dd640 1 -- 172.21.15.81:0/691478314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465c102d40 msgr2=0x7f465c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.842+0000 7f46638dd640 1 --2- 172.21.15.81:0/691478314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465c102d40 0x7f465c103120 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4658009900 tx=0x7f465802a480 comp rx=0 tx=0).stop 2024-09-12T01:27:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.842+0000 7f46638dd640 1 -- 172.21.15.81:0/691478314 shutdown_connections 2024-09-12T01:27:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.842+0000 7f46638dd640 1 --2- 172.21.15.81:0/691478314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f465c10c170 0x7f465c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.842+0000 7f46638dd640 1 --2- 172.21.15.81:0/691478314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f465c103660 0x7f465c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.842+0000 7f46638dd640 1 --2- 172.21.15.81:0/691478314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465c102d40 0x7f465c103120 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.842+0000 7f46638dd640 1 -- 172.21.15.81:0/691478314 >> 172.21.15.81:0/691478314 conn(0x7f465c0fc7a0 msgr2=0x7f465c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.842+0000 7f46638dd640 1 -- 172.21.15.81:0/691478314 shutdown_connections 2024-09-12T01:27:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.842+0000 7f46638dd640 1 -- 172.21.15.81:0/691478314 wait complete. 2024-09-12T01:27:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f46638dd640 1 Processor -- start 2024-09-12T01:27:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f46638dd640 1 -- start start 2024-09-12T01:27:03.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f46638dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465c102d40 0x7f465c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:03.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f46638dd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f465c103660 0x7f465c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:03.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f46638dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f465c10c170 0x7f465c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:03.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f46638dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f465c111fd0 con 0x7f465c102d40 2024-09-12T01:27:03.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f46638dd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f465c111e50 con 0x7f465c10c170 2024-09-12T01:27:03.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f46638dd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f465c112150 con 0x7f465c103660 2024-09-12T01:27:03.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f4661679640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465c102d40 0x7f465c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:03.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f4661679640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465c102d40 0x7f465c1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50130/0 (socket says 172.21.15.81:50130) 2024-09-12T01:27:03.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f4661679640 1 -- 172.21.15.81:0/1995419927 learned_addr learned my addr 172.21.15.81:0/1995419927 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:03.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f4660e78640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f465c103660 0x7f465c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:03.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f4661e7a640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f465c10c170 0x7f465c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:03.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f4661679640 1 -- 172.21.15.81:0/1995419927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f465c103660 msgr2=0x7f465c1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:03.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f4661679640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f465c103660 0x7f465c1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f4661679640 1 -- 172.21.15.81:0/1995419927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f465c10c170 msgr2=0x7f465c19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f4661679640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f465c10c170 0x7f465c19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f4661679640 1 -- 172.21.15.81:0/1995419927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c19d460 con 0x7f465c102d40 2024-09-12T01:27:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f4660e78640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f465c103660 0x7f465c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.843+0000 7f4661e7a640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f465c10c170 0x7f465c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.844+0000 7f4661679640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465c102d40 0x7f465c1984b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4658006010 tx=0x7f46580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.844+0000 7f46527fc640 1 -- 172.21.15.81:0/1995419927 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465803f030 con 0x7f465c102d40 2024-09-12T01:27:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.844+0000 7f46638dd640 1 -- 172.21.15.81:0/1995419927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465c19d6f0 con 0x7f465c102d40 2024-09-12T01:27:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.844+0000 7f46527fc640 1 -- 172.21.15.81:0/1995419927 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4658003ce0 con 0x7f465c102d40 2024-09-12T01:27:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.844+0000 7f46527fc640 1 -- 172.21.15.81:0/1995419927 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4658035070 con 0x7f465c102d40 2024-09-12T01:27:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.844+0000 7f46638dd640 1 -- 172.21.15.81:0/1995419927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465c1a5030 con 0x7f465c102d40 2024-09-12T01:27:03.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.845+0000 7f46638dd640 1 -- 172.21.15.81:0/1995419927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465c103120 con 0x7f465c102d40 2024-09-12T01:27:03.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.846+0000 7f46527fc640 1 -- 172.21.15.81:0/1995419927 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4658042030 con 0x7f465c102d40 2024-09-12T01:27:03.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.847+0000 7f46527fc640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f46480a2c10 0x7f46480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:03.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.847+0000 7f4660e78640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f46480a2c10 0x7f46480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:03.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.847+0000 7f46527fc640 1 -- 172.21.15.81:0/1995419927 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f46580ef8a0 con 0x7f465c102d40 2024-09-12T01:27:03.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.847+0000 7f4660e78640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f46480a2c10 0x7f46480a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f465c0feda0 tx=0x7f464c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:03.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:03.851+0000 7f46527fc640 1 -- 172.21.15.81:0/1995419927 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f46580bc770 con 0x7f465c102d40 2024-09-12T01:27:04.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:03 smithi100 ceph-mon[35275]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.026+0000 7f46638dd640 1 -- 172.21.15.81:0/1995419927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f465c107210 con 0x7f465c102d40 2024-09-12T01:27:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.027+0000 7f46527fc640 1 -- 172.21.15.81:0/1995419927 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f46580bc070 con 0x7f465c102d40 2024-09-12T01:27:04.026 INFO:teuthology.orchestra.run.smithi081.stdout:103079215166 2024-09-12T01:27:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.029+0000 7f46638dd640 1 -- 172.21.15.81:0/1995419927 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f46480a2c10 msgr2=0x7f46480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.029+0000 7f46638dd640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f46480a2c10 0x7f46480a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f465c0feda0 tx=0x7f464c008040 comp rx=0 tx=0).stop 2024-09-12T01:27:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.029+0000 7f46638dd640 1 -- 172.21.15.81:0/1995419927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465c102d40 msgr2=0x7f465c1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.029+0000 7f46638dd640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465c102d40 0x7f465c1984b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4658006010 tx=0x7f46580042f0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.029+0000 7f46638dd640 1 -- 172.21.15.81:0/1995419927 shutdown_connections 2024-09-12T01:27:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.029+0000 7f46638dd640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f46480a2c10 0x7f46480a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.029+0000 7f46638dd640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f465c10c170 0x7f465c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.029+0000 7f46638dd640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f465c103660 0x7f465c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.029+0000 7f46638dd640 1 --2- 172.21.15.81:0/1995419927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f465c102d40 0x7f465c1984b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.029+0000 7f46638dd640 1 -- 172.21.15.81:0/1995419927 >> 172.21.15.81:0/1995419927 conn(0x7f465c0fc7a0 msgr2=0x7f465c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.029+0000 7f46638dd640 1 -- 172.21.15.81:0/1995419927 shutdown_connections 2024-09-12T01:27:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.029+0000 7f46638dd640 1 -- 172.21.15.81:0/1995419927 wait complete. 2024-09-12T01:27:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.017+0000 7f32647bb640 1 -- 172.21.15.81:0/867997218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f325c102db0 msgr2=0x7f325c103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.017+0000 7f32647bb640 1 --2- 172.21.15.81:0/867997218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f325c102db0 0x7f325c103190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3258009930 tx=0x7f325802a420 comp rx=0 tx=0).stop 2024-09-12T01:27:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.017+0000 7f32647bb640 1 -- 172.21.15.81:0/867997218 shutdown_connections 2024-09-12T01:27:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.017+0000 7f32647bb640 1 --2- 172.21.15.81:0/867997218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f325c1082e0 0x7f325c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.017+0000 7f32647bb640 1 --2- 172.21.15.81:0/867997218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c103760 0x7f325c107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.017+0000 7f32647bb640 1 --2- 172.21.15.81:0/867997218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f325c102db0 0x7f325c103190 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.017+0000 7f32647bb640 1 -- 172.21.15.81:0/867997218 >> 172.21.15.81:0/867997218 conn(0x7f325c0fc7d0 msgr2=0x7f325c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.017+0000 7f32647bb640 1 -- 172.21.15.81:0/867997218 shutdown_connections 2024-09-12T01:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.017+0000 7f32647bb640 1 -- 172.21.15.81:0/867997218 wait complete. 2024-09-12T01:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.017+0000 7f32647bb640 1 Processor -- start 2024-09-12T01:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f32647bb640 1 -- start start 2024-09-12T01:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f32647bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c102db0 0x7f325c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f32647bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f325c103760 0x7f325c19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f32647bb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f325c1082e0 0x7f325c19f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f32647bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f325c112090 con 0x7f325c103760 2024-09-12T01:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f32647bb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f325c111f10 con 0x7f325c102db0 2024-09-12T01:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f32647bb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f325c112210 con 0x7f325c1082e0 2024-09-12T01:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f3262557640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c102db0 0x7f325c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f3261d56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f325c103760 0x7f325c19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f3262557640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c102db0 0x7f325c19a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:38382/0 (socket says 172.21.15.81:38382) 2024-09-12T01:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f3261d56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f325c103760 0x7f325c19ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50148/0 (socket says 172.21.15.81:50148) 2024-09-12T01:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f3262557640 1 -- 172.21.15.81:0/1607205342 learned_addr learned my addr 172.21.15.81:0/1607205342 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f3262d58640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f325c1082e0 0x7f325c19f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f3262557640 1 -- 172.21.15.81:0/1607205342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f325c1082e0 msgr2=0x7f325c19f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f3262557640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f325c1082e0 0x7f325c19f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f3262557640 1 -- 172.21.15.81:0/1607205342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f325c103760 msgr2=0x7f325c19ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f3262557640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f325c103760 0x7f325c19ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f3262557640 1 -- 172.21.15.81:0/1607205342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325c19f6f0 con 0x7f325c102db0 2024-09-12T01:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.018+0000 7f3261d56640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f325c103760 0x7f325c19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.019+0000 7f3262557640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c102db0 0x7f325c19a740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3258004770 tx=0x7f3258003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.019+0000 7f32537fe640 1 -- 172.21.15.81:0/1607205342 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325803f070 con 0x7f325c102db0 2024-09-12T01:27:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.019+0000 7f32537fe640 1 -- 172.21.15.81:0/1607205342 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3258031c20 con 0x7f325c102db0 2024-09-12T01:27:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.019+0000 7f32647bb640 1 -- 172.21.15.81:0/1607205342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f325c19f980 con 0x7f325c102db0 2024-09-12T01:27:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.019+0000 7f32537fe640 1 -- 172.21.15.81:0/1607205342 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258035030 con 0x7f325c102db0 2024-09-12T01:27:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.019+0000 7f32647bb640 1 -- 172.21.15.81:0/1607205342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f325c1a72c0 con 0x7f325c102db0 2024-09-12T01:27:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.020+0000 7f32647bb640 1 -- 172.21.15.81:0/1607205342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f325c06a7d0 con 0x7f325c102db0 2024-09-12T01:27:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.021+0000 7f32537fe640 1 -- 172.21.15.81:0/1607205342 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3258042070 con 0x7f325c102db0 2024-09-12T01:27:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.022+0000 7f32537fe640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f32480a2c10 0x7f32480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.022+0000 7f3261d56640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f32480a2c10 0x7f32480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.022+0000 7f32537fe640 1 -- 172.21.15.81:0/1607205342 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f32580efa80 con 0x7f325c102db0 2024-09-12T01:27:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.022+0000 7f3261d56640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f32480a2c10 0x7f32480a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f325c0fde60 tx=0x7f324c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.026+0000 7f32537fe640 1 -- 172.21.15.81:0/1607205342 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32580f1e20 con 0x7f325c102db0 2024-09-12T01:27:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.199+0000 7f32647bb640 1 -- 172.21.15.81:0/1607205342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f325c19bad0 con 0x7f325c102db0 2024-09-12T01:27:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.200+0000 7f32537fe640 1 -- 172.21.15.81:0/1607205342 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f325c19bad0 con 0x7f325c102db0 2024-09-12T01:27:04.199 INFO:teuthology.orchestra.run.smithi081.stdout:34359738446 2024-09-12T01:27:04.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.202+0000 7f32647bb640 1 -- 172.21.15.81:0/1607205342 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f32480a2c10 msgr2=0x7f32480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:04.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.202+0000 7f32647bb640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f32480a2c10 0x7f32480a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f325c0fde60 tx=0x7f324c00b390 comp rx=0 tx=0).stop 2024-09-12T01:27:04.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.202+0000 7f32647bb640 1 -- 172.21.15.81:0/1607205342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c102db0 msgr2=0x7f325c19a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:04.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.202+0000 7f32647bb640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c102db0 0x7f325c19a740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3258004770 tx=0x7f3258003b90 comp rx=0 tx=0).stop 2024-09-12T01:27:04.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.202+0000 7f32647bb640 1 -- 172.21.15.81:0/1607205342 shutdown_connections 2024-09-12T01:27:04.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.202+0000 7f32647bb640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f32480a2c10 0x7f32480a50d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.202+0000 7f32647bb640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f325c1082e0 0x7f325c19f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.202+0000 7f32647bb640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f325c103760 0x7f325c19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.202+0000 7f32647bb640 1 --2- 172.21.15.81:0/1607205342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c102db0 0x7f325c19a740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.202+0000 7f32647bb640 1 -- 172.21.15.81:0/1607205342 >> 172.21.15.81:0/1607205342 conn(0x7f325c0fc7d0 msgr2=0x7f325c0fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:04.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.202+0000 7f32647bb640 1 -- 172.21.15.81:0/1607205342 shutdown_connections 2024-09-12T01:27:04.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.202+0000 7f32647bb640 1 -- 172.21.15.81:0/1607205342 wait complete. 2024-09-12T01:27:04.656 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:04 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1995419927' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:27:04.656 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:04 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1607205342' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:27:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.470+0000 7f788680c640 1 -- 172.21.15.81:0/1120624480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7880101420 msgr2=0x7f788010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.470+0000 7f788680c640 1 --2- 172.21.15.81:0/1120624480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7880101420 0x7f788010d950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7878009cd0 tx=0x7f787802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.470+0000 7f788680c640 1 -- 172.21.15.81:0/1120624480 shutdown_connections 2024-09-12T01:27:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.470+0000 7f788680c640 1 --2- 172.21.15.81:0/1120624480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7880101420 0x7f788010d950 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.470+0000 7f788680c640 1 --2- 172.21.15.81:0/1120624480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7880100a80 0x7f7880100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.470+0000 7f788680c640 1 --2- 172.21.15.81:0/1120624480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7880106a80 0x7f7880106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.470+0000 7f788680c640 1 -- 172.21.15.81:0/1120624480 >> 172.21.15.81:0/1120624480 conn(0x7f78800fc7a0 msgr2=0x7f78800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.470+0000 7f788680c640 1 -- 172.21.15.81:0/1120624480 shutdown_connections 2024-09-12T01:27:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.470+0000 7f788680c640 1 -- 172.21.15.81:0/1120624480 wait complete. 2024-09-12T01:27:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f788680c640 1 Processor -- start 2024-09-12T01:27:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f788680c640 1 -- start start 2024-09-12T01:27:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f788680c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7880100a80 0x7f7880197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f788680c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7880101420 0x7f7880197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f788680c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7880106a80 0x7f788019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f788680c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7880110f70 con 0x7f7880106a80 2024-09-12T01:27:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f788680c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7880110df0 con 0x7f7880101420 2024-09-12T01:27:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f788680c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f78801110f0 con 0x7f7880100a80 2024-09-12T01:27:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f7884da9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7880106a80 0x7f788019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f7884da9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7880106a80 0x7f788019bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50164/0 (socket says 172.21.15.81:50164) 2024-09-12T01:27:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f7884da9640 1 -- 172.21.15.81:0/6926937 learned_addr learned my addr 172.21.15.81:0/6926937 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f787ffff640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7880100a80 0x7f7880197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:04.739 INFO:teuthology.orchestra.run.smithi081.stdout:55834574921 2024-09-12T01:27:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f787f7fe640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7880101420 0x7f7880197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f7884da9640 1 -- 172.21.15.81:0/6926937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7880100a80 msgr2=0x7f7880197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f7884da9640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7880100a80 0x7f7880197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f7884da9640 1 -- 172.21.15.81:0/6926937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7880101420 msgr2=0x7f7880197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f7884da9640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7880101420 0x7f7880197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f7884da9640 1 -- 172.21.15.81:0/6926937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788019c400 con 0x7f7880106a80 2024-09-12T01:27:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f787ffff640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7880100a80 0x7f7880197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.471+0000 7f787f7fe640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7880101420 0x7f7880197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.472+0000 7f7884da9640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7880106a80 0x7f788019bd20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7878009ca0 tx=0x7f7878003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.472+0000 7f787d7fa640 1 -- 172.21.15.81:0/6926937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878004240 con 0x7f7880106a80 2024-09-12T01:27:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.472+0000 7f787d7fa640 1 -- 172.21.15.81:0/6926937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78780305a0 con 0x7f7880106a80 2024-09-12T01:27:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.472+0000 7f788680c640 1 -- 172.21.15.81:0/6926937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f788019c690 con 0x7f7880106a80 2024-09-12T01:27:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.472+0000 7f787d7fa640 1 -- 172.21.15.81:0/6926937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787803a660 con 0x7f7880106a80 2024-09-12T01:27:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.472+0000 7f788680c640 1 -- 172.21.15.81:0/6926937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78801a3fd0 con 0x7f7880106a80 2024-09-12T01:27:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.473+0000 7f788680c640 1 -- 172.21.15.81:0/6926937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7880100f60 con 0x7f7880106a80 2024-09-12T01:27:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.474+0000 7f787d7fa640 1 -- 172.21.15.81:0/6926937 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7878030750 con 0x7f7880106a80 2024-09-12T01:27:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.475+0000 7f787d7fa640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f78680a2c10 0x7f78680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.475+0000 7f787ffff640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f78680a2c10 0x7f78680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.475+0000 7f787d7fa640 1 -- 172.21.15.81:0/6926937 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f787802e030 con 0x7f7880106a80 2024-09-12T01:27:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.475+0000 7f787ffff640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f78680a2c10 0x7f78680a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7870009930 tx=0x7f7870008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.479+0000 7f787d7fa640 1 -- 172.21.15.81:0/6926937 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f78780bd2a0 con 0x7f7880106a80 2024-09-12T01:27:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.656+0000 7f788680c640 1 -- 172.21.15.81:0/6926937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7880109010 con 0x7f7880106a80 2024-09-12T01:27:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.657+0000 7f787d7fa640 1 -- 172.21.15.81:0/6926937 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f78780bcba0 con 0x7f7880106a80 2024-09-12T01:27:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.659+0000 7f788680c640 1 -- 172.21.15.81:0/6926937 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f78680a2c10 msgr2=0x7f78680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.659+0000 7f788680c640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f78680a2c10 0x7f78680a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7870009930 tx=0x7f7870008040 comp rx=0 tx=0).stop 2024-09-12T01:27:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.659+0000 7f788680c640 1 -- 172.21.15.81:0/6926937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7880106a80 msgr2=0x7f788019bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.659+0000 7f788680c640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7880106a80 0x7f788019bd20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7878009ca0 tx=0x7f7878003ba0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.659+0000 7f788680c640 1 -- 172.21.15.81:0/6926937 shutdown_connections 2024-09-12T01:27:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.659+0000 7f788680c640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f78680a2c10 0x7f78680a50d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.659+0000 7f788680c640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7880106a80 0x7f788019bd20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.659+0000 7f788680c640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7880101420 0x7f7880197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.659+0000 7f788680c640 1 --2- 172.21.15.81:0/6926937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7880100a80 0x7f7880197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.659+0000 7f788680c640 1 -- 172.21.15.81:0/6926937 >> 172.21.15.81:0/6926937 conn(0x7f78800fc7a0 msgr2=0x7f78800fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.659+0000 7f788680c640 1 -- 172.21.15.81:0/6926937 shutdown_connections 2024-09-12T01:27:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:04.659+0000 7f788680c640 1 -- 172.21.15.81:0/6926937 wait complete. 2024-09-12T01:27:04.919 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:04 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1995419927' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:27:04.920 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:04 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1607205342' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:27:05.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:04 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1995419927' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:27:05.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:04 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1607205342' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:27:05.497 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738446 for osd.0 2024-09-12T01:27:05.497 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.657+0000 7f96ae921640 1 -- 172.21.15.81:0/4229904402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a8106f20 msgr2=0x7f96a810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.657+0000 7f96ae921640 1 --2- 172.21.15.81:0/4229904402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a8106f20 0x7f96a810eaa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009ca0 tx=0x7f96a002a8b0 comp rx=0 tx=0).stop 2024-09-12T01:27:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.657+0000 7f96ae921640 1 -- 172.21.15.81:0/4229904402 shutdown_connections 2024-09-12T01:27:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.657+0000 7f96ae921640 1 --2- 172.21.15.81:0/4229904402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a8106f20 0x7f96a810eaa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.657+0000 7f96ae921640 1 --2- 172.21.15.81:0/4229904402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96a81027a0 0x7f96a81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.657+0000 7f96ae921640 1 --2- 172.21.15.81:0/4229904402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96a8101df0 0x7f96a81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.657+0000 7f96ae921640 1 -- 172.21.15.81:0/4229904402 >> 172.21.15.81:0/4229904402 conn(0x7f96a80fd8b0 msgr2=0x7f96a80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.657+0000 7f96ae921640 1 -- 172.21.15.81:0/4229904402 shutdown_connections 2024-09-12T01:27:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.657+0000 7f96ae921640 1 -- 172.21.15.81:0/4229904402 wait complete. 2024-09-12T01:27:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.658+0000 7f96ae921640 1 Processor -- start 2024-09-12T01:27:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.658+0000 7f96ae921640 1 -- start start 2024-09-12T01:27:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.658+0000 7f96ae921640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a8101df0 0x7f96a8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.658+0000 7f96ae921640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96a81027a0 0x7f96a8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.658+0000 7f96ae921640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96a8106f20 0x7f96a819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.658+0000 7f96ae921640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96a8111f80 con 0x7f96a8101df0 2024-09-12T01:27:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.658+0000 7f96ae921640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f96a8111e00 con 0x7f96a81027a0 2024-09-12T01:27:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.658+0000 7f96ae921640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96a8112100 con 0x7f96a8106f20 2024-09-12T01:27:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.658+0000 7f96a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a8101df0 0x7f96a8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.658+0000 7f96a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a8101df0 0x7f96a8198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50186/0 (socket says 172.21.15.81:50186) 2024-09-12T01:27:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.658+0000 7f96a7fff640 1 -- 172.21.15.81:0/2562634164 learned_addr learned my addr 172.21.15.81:0/2562634164 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f969ffff640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96a81027a0 0x7f96a8198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f96acebe640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96a8106f20 0x7f96a819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f96a7fff640 1 -- 172.21.15.81:0/2562634164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96a8106f20 msgr2=0x7f96a819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f96a7fff640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96a8106f20 0x7f96a819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f96a7fff640 1 -- 172.21.15.81:0/2562634164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96a81027a0 msgr2=0x7f96a8198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f96a7fff640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96a81027a0 0x7f96a8198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f96a7fff640 1 -- 172.21.15.81:0/2562634164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a819d3b0 con 0x7f96a8101df0 2024-09-12T01:27:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f96acebe640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96a8106f20 0x7f96a819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f969ffff640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96a81027a0 0x7f96a8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:27:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f96a7fff640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a8101df0 0x7f96a8198400 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f969800d950 tx=0x7f969800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f96a5ffb640 1 -- 172.21.15.81:0/2562634164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698017070 con 0x7f96a8101df0 2024-09-12T01:27:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f96a5ffb640 1 -- 172.21.15.81:0/2562634164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9698009c30 con 0x7f96a8101df0 2024-09-12T01:27:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f96ae921640 1 -- 172.21.15.81:0/2562634164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a819d6a0 con 0x7f96a8101df0 2024-09-12T01:27:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f96a5ffb640 1 -- 172.21.15.81:0/2562634164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969800f6b0 con 0x7f96a8101df0 2024-09-12T01:27:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.659+0000 7f96ae921640 1 -- 172.21.15.81:0/2562634164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a81a4f80 con 0x7f96a8101df0 2024-09-12T01:27:05.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.660+0000 7f96ae921640 1 -- 172.21.15.81:0/2562634164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a81021d0 con 0x7f96a8101df0 2024-09-12T01:27:05.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.662+0000 7f96a5ffb640 1 -- 172.21.15.81:0/2562634164 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f96980109d0 con 0x7f96a8101df0 2024-09-12T01:27:05.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.663+0000 7f96a5ffb640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f96940a2c90 0x7f96940a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:05.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.663+0000 7f969ffff640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f96940a2c90 0x7f96940a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:05.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.663+0000 7f96a5ffb640 1 -- 172.21.15.81:0/2562634164 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f96980cede0 con 0x7f96a8101df0 2024-09-12T01:27:05.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.663+0000 7f969ffff640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f96940a2c90 0x7f96940a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f96a81087e0 tx=0x7f9690005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.668+0000 7f96a5ffb640 1 -- 172.21.15.81:0/2562634164 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9698009de0 con 0x7f96a8101df0 2024-09-12T01:27:05.669 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:05.669 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:05.703 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:05.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:05 smithi081 ceph-mon[30920]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:05.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:05 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/6926937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:27:05.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.863+0000 7f96ae921640 1 -- 172.21.15.81:0/2562634164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f96a8199760 con 0x7f96a8101df0 2024-09-12T01:27:05.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.864+0000 7f96a5ffb640 1 -- 172.21.15.81:0/2562634164 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f969809bc10 con 0x7f96a8101df0 2024-09-12T01:27:05.863 INFO:teuthology.orchestra.run.smithi081.stdout:236223201318 2024-09-12T01:27:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.866+0000 7f96ae921640 1 -- 172.21.15.81:0/2562634164 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f96940a2c90 msgr2=0x7f96940a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.866+0000 7f96ae921640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f96940a2c90 0x7f96940a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f96a81087e0 tx=0x7f9690005f90 comp rx=0 tx=0).stop 2024-09-12T01:27:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.866+0000 7f96ae921640 1 -- 172.21.15.81:0/2562634164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a8101df0 msgr2=0x7f96a8198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.866+0000 7f96ae921640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a8101df0 0x7f96a8198400 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f969800d950 tx=0x7f969800de10 comp rx=0 tx=0).stop 2024-09-12T01:27:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.866+0000 7f96ae921640 1 -- 172.21.15.81:0/2562634164 shutdown_connections 2024-09-12T01:27:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.866+0000 7f96ae921640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f96940a2c90 0x7f96940a5150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.866+0000 7f96ae921640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96a8106f20 0x7f96a819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.866+0000 7f96ae921640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96a81027a0 0x7f96a8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.866+0000 7f96ae921640 1 --2- 172.21.15.81:0/2562634164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a8101df0 0x7f96a8198400 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.866+0000 7f96ae921640 1 -- 172.21.15.81:0/2562634164 >> 172.21.15.81:0/2562634164 conn(0x7f96a80fd8b0 msgr2=0x7f96a80fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.866+0000 7f96ae921640 1 -- 172.21.15.81:0/2562634164 shutdown_connections 2024-09-12T01:27:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:05.866+0000 7f96ae921640 1 -- 172.21.15.81:0/2562634164 wait complete. 2024-09-12T01:27:06.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:05 smithi100 ceph-mon[35275]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:06.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:05 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/6926937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:27:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:05 smithi189 ceph-mon[35357]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:05 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/6926937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:27:06.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.310+0000 7f38d8707640 1 -- 172.21.15.81:0/3292832437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d0102570 msgr2=0x7f38d01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:06.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.310+0000 7f38d8707640 1 --2- 172.21.15.81:0/3292832437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d0102570 0x7f38d01029b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009900 tx=0x7f38c002a480 comp rx=0 tx=0).stop 2024-09-12T01:27:06.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.310+0000 7f38d8707640 1 -- 172.21.15.81:0/3292832437 shutdown_connections 2024-09-12T01:27:06.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.310+0000 7f38d8707640 1 --2- 172.21.15.81:0/3292832437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38d0102ef0 0x7f38d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:06.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.310+0000 7f38d8707640 1 --2- 172.21.15.81:0/3292832437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d0102570 0x7f38d01029b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:06.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.310+0000 7f38d8707640 1 --2- 172.21.15.81:0/3292832437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d0100e20 0x7f38d0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:06.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.310+0000 7f38d8707640 1 -- 172.21.15.81:0/3292832437 >> 172.21.15.81:0/3292832437 conn(0x7f38d00fc7d0 msgr2=0x7f38d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:06.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.310+0000 7f38d8707640 1 -- 172.21.15.81:0/3292832437 shutdown_connections 2024-09-12T01:27:06.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.310+0000 7f38d8707640 1 -- 172.21.15.81:0/3292832437 wait complete. 2024-09-12T01:27:06.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.310+0000 7f38d8707640 1 Processor -- start 2024-09-12T01:27:06.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.310+0000 7f38d8707640 1 -- start start 2024-09-12T01:27:06.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d8707640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38d0100e20 0x7f38d01993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:06.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d8707640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d0102570 0x7f38d0199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:06.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d8707640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d0102ef0 0x7f38d01a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:06.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d8707640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38d0110f80 con 0x7f38d0102570 2024-09-12T01:27:06.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d8707640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f38d0110e00 con 0x7f38d0100e20 2024-09-12T01:27:06.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d8707640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38d0111100 con 0x7f38d0102ef0 2024-09-12T01:27:06.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d5ca2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d0102570 0x7f38d0199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:06.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d5ca2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d0102570 0x7f38d0199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50200/0 (socket says 172.21.15.81:50200) 2024-09-12T01:27:06.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d5ca2640 1 -- 172.21.15.81:0/2634587672 learned_addr learned my addr 172.21.15.81:0/2634587672 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:06.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d64a3640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38d0100e20 0x7f38d01993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:06.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d6ca4640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d0102ef0 0x7f38d01a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:06.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d5ca2640 1 -- 172.21.15.81:0/2634587672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d0102ef0 msgr2=0x7f38d01a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:06.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d5ca2640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d0102ef0 0x7f38d01a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:06.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d5ca2640 1 -- 172.21.15.81:0/2634587672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38d0100e20 msgr2=0x7f38d01993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:06.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d5ca2640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38d0100e20 0x7f38d01993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:06.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d5ca2640 1 -- 172.21.15.81:0/2634587672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d01a49a0 con 0x7f38d0102570 2024-09-12T01:27:06.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d6ca4640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d0102ef0 0x7f38d01a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:06.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d5ca2640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d0102570 0x7f38d0199920 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f38c0006010 tx=0x7f38c0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:06.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38c77fe640 1 -- 172.21.15.81:0/2634587672 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c003f070 con 0x7f38d0102570 2024-09-12T01:27:06.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38c77fe640 1 -- 172.21.15.81:0/2634587672 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c0031c30 con 0x7f38d0102570 2024-09-12T01:27:06.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d8707640 1 -- 172.21.15.81:0/2634587672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d01a4b70 con 0x7f38d0102570 2024-09-12T01:27:06.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38c77fe640 1 -- 172.21.15.81:0/2634587672 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c0035030 con 0x7f38d0102570 2024-09-12T01:27:06.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.311+0000 7f38d8707640 1 -- 172.21.15.81:0/2634587672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d01a5020 con 0x7f38d0102570 2024-09-12T01:27:06.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.313+0000 7f38d8707640 1 -- 172.21.15.81:0/2634587672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d0101200 con 0x7f38d0102570 2024-09-12T01:27:06.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.313+0000 7f38c77fe640 1 -- 172.21.15.81:0/2634587672 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f38c0042070 con 0x7f38d0102570 2024-09-12T01:27:06.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.314+0000 7f38c77fe640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f38bc0a2c90 0x7f38bc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:06.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.314+0000 7f38d64a3640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f38bc0a2c90 0x7f38bc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:06.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.314+0000 7f38c77fe640 1 -- 172.21.15.81:0/2634587672 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f38c00ef850 con 0x7f38d0102570 2024-09-12T01:27:06.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.315+0000 7f38d64a3640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f38bc0a2c90 0x7f38bc0a5150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009bd0 tx=0x7f38cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:06.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.319+0000 7f38c77fe640 1 -- 172.21.15.81:0/2634587672 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f38c00bc660 con 0x7f38d0102570 2024-09-12T01:27:06.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.490+0000 7f38d8707640 1 -- 172.21.15.81:0/2634587672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f38d0109090 con 0x7f38d0102570 2024-09-12T01:27:06.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.490+0000 7f38c77fe640 1 -- 172.21.15.81:0/2634587672 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f38c00bbf60 con 0x7f38d0102570 2024-09-12T01:27:06.490 INFO:teuthology.orchestra.run.smithi081.stdout:201863462954 2024-09-12T01:27:06.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.492+0000 7f38d8707640 1 -- 172.21.15.81:0/2634587672 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f38bc0a2c90 msgr2=0x7f38bc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:06.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.492+0000 7f38d8707640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f38bc0a2c90 0x7f38bc0a5150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009bd0 tx=0x7f38cc005f90 comp rx=0 tx=0).stop 2024-09-12T01:27:06.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.492+0000 7f38d8707640 1 -- 172.21.15.81:0/2634587672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d0102570 msgr2=0x7f38d0199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:06.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.492+0000 7f38d8707640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d0102570 0x7f38d0199920 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f38c0006010 tx=0x7f38c0003c10 comp rx=0 tx=0).stop 2024-09-12T01:27:06.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.492+0000 7f38d8707640 1 -- 172.21.15.81:0/2634587672 shutdown_connections 2024-09-12T01:27:06.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.492+0000 7f38d8707640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f38bc0a2c90 0x7f38bc0a5150 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:06.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.492+0000 7f38d8707640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38d0102ef0 0x7f38d01a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:06.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.492+0000 7f38d8707640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d0102570 0x7f38d0199920 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:06.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.492+0000 7f38d8707640 1 --2- 172.21.15.81:0/2634587672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38d0100e20 0x7f38d01993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:06.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.492+0000 7f38d8707640 1 -- 172.21.15.81:0/2634587672 >> 172.21.15.81:0/2634587672 conn(0x7f38d00fc7d0 msgr2=0x7f38d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:06.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.492+0000 7f38d8707640 1 -- 172.21.15.81:0/2634587672 shutdown_connections 2024-09-12T01:27:06.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:06.492+0000 7f38d8707640 1 -- 172.21.15.81:0/2634587672 wait complete. 2024-09-12T01:27:06.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:06 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2562634164' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T01:27:06.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:06 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2634587672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T01:27:07.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:06 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2562634164' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T01:27:07.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:06 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2634587672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T01:27:07.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:06 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2562634164' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T01:27:07.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:06 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2634587672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T01:27:07.230 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215164 got 103079215166 for osd.3 2024-09-12T01:27:07.230 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:07.650 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574918 got 55834574921 for osd.1 2024-09-12T01:27:07.650 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:07.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:07 smithi081 ceph-mon[30920]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T01:27:08.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:07 smithi100 ceph-mon[35275]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T01:27:08.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:07 smithi189 ceph-mon[35357]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T01:27:08.044 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462951 got 201863462954 for osd.7 2024-09-12T01:27:08.045 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:08.201 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201316 got 236223201318 for osd.8 2024-09-12T01:27:08.202 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.886+0000 7f13b4ec2640 1 -- 172.21.15.81:0/2133198291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b0102ef0 msgr2=0x7f13b010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.886+0000 7f13b4ec2640 1 --2- 172.21.15.81:0/2133198291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b0102ef0 0x7f13b010da40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009ca0 tx=0x7f13a802a950 comp rx=0 tx=0).stop 2024-09-12T01:27:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.886+0000 7f13b4ec2640 1 -- 172.21.15.81:0/2133198291 shutdown_connections 2024-09-12T01:27:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.886+0000 7f13b4ec2640 1 --2- 172.21.15.81:0/2133198291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b0102ef0 0x7f13b010da40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.886+0000 7f13b4ec2640 1 --2- 172.21.15.81:0/2133198291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b0102570 0x7f13b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.886+0000 7f13b4ec2640 1 --2- 172.21.15.81:0/2133198291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13b0100e20 0x7f13b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.886+0000 7f13b4ec2640 1 -- 172.21.15.81:0/2133198291 >> 172.21.15.81:0/2133198291 conn(0x7f13b00fc7d0 msgr2=0x7f13b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.886+0000 7f13b4ec2640 1 -- 172.21.15.81:0/2133198291 shutdown_connections 2024-09-12T01:27:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.886+0000 7f13b4ec2640 1 -- 172.21.15.81:0/2133198291 wait complete. 2024-09-12T01:27:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.887+0000 7f13b4ec2640 1 Processor -- start 2024-09-12T01:27:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.887+0000 7f13b4ec2640 1 -- start start 2024-09-12T01:27:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.887+0000 7f13b4ec2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13b0100e20 0x7f13b01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.887+0000 7f13b4ec2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b0102570 0x7f13b0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.887+0000 7f13b4ec2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b0102ef0 0x7f13b019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.887+0000 7f13b4ec2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0110fc0 con 0x7f13b0102ef0 2024-09-12T01:27:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.887+0000 7f13b4ec2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0110e40 con 0x7f13b0102570 2024-09-12T01:27:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.887+0000 7f13b4ec2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0111140 con 0x7f13b0100e20 2024-09-12T01:27:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.887+0000 7f13aed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b0102ef0 0x7f13b019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.887+0000 7f13aed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b0102ef0 0x7f13b019ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50222/0 (socket says 172.21.15.81:50222) 2024-09-12T01:27:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.887+0000 7f13aed9d640 1 -- 172.21.15.81:0/952016687 learned_addr learned my addr 172.21.15.81:0/952016687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13aed9d640 1 -- 172.21.15.81:0/952016687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13b0100e20 msgr2=0x7f13b01985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13ae59c640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13b0100e20 0x7f13b01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13aed9d640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13b0100e20 0x7f13b01985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13aed9d640 1 -- 172.21.15.81:0/952016687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b0102570 msgr2=0x7f13b0198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13add9b640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b0102570 0x7f13b0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13aed9d640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b0102570 0x7f13b0198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13aed9d640 1 -- 172.21.15.81:0/952016687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b019d550 con 0x7f13b0102ef0 2024-09-12T01:27:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13add9b640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b0102570 0x7f13b0198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13aed9d640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b0102ef0 0x7f13b019ce70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f13a802ae70 tx=0x7f13a802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13a77fe640 1 -- 172.21.15.81:0/952016687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8034040 con 0x7f13b0102ef0 2024-09-12T01:27:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13b4ec2640 1 -- 172.21.15.81:0/952016687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b019d7e0 con 0x7f13b0102ef0 2024-09-12T01:27:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13a77fe640 1 -- 172.21.15.81:0/952016687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13a8030920 con 0x7f13b0102ef0 2024-09-12T01:27:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13a77fe640 1 -- 172.21.15.81:0/952016687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8045480 con 0x7f13b0102ef0 2024-09-12T01:27:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.888+0000 7f13b4ec2640 1 -- 172.21.15.81:0/952016687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b01a5120 con 0x7f13b0102ef0 2024-09-12T01:27:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.889+0000 7f13b4ec2640 1 -- 172.21.15.81:0/952016687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b01021b0 con 0x7f13b0102ef0 2024-09-12T01:27:08.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.891+0000 7f13a77fe640 1 -- 172.21.15.81:0/952016687 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f13a8037020 con 0x7f13b0102ef0 2024-09-12T01:27:08.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.892+0000 7f13a77fe640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f139c0a2c10 0x7f139c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:08.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.892+0000 7f13ae59c640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f139c0a2c10 0x7f139c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:08.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.892+0000 7f13a77fe640 1 -- 172.21.15.81:0/952016687 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f13a80f01b0 con 0x7f13b0102ef0 2024-09-12T01:27:08.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.892+0000 7f13ae59c640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f139c0a2c10 0x7f139c0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1398005fd0 tx=0x7f1398005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:08.895+0000 7f13a77fe640 1 -- 172.21.15.81:0/952016687 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13a80811b0 con 0x7f13b0102ef0 2024-09-12T01:27:08.895 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:09.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.067+0000 7f13b4ec2640 1 -- 172.21.15.81:0/952016687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f13b010a0a0 con 0x7f13b0102ef0 2024-09-12T01:27:09.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.068+0000 7f13a77fe640 1 -- 172.21.15.81:0/952016687 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f13a80bd0d0 con 0x7f13b0102ef0 2024-09-12T01:27:09.067 INFO:teuthology.orchestra.run.smithi081.stdout:133143986235 2024-09-12T01:27:09.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.070+0000 7f13b4ec2640 1 -- 172.21.15.81:0/952016687 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f139c0a2c10 msgr2=0x7f139c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:09.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.070+0000 7f13b4ec2640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f139c0a2c10 0x7f139c0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1398005fd0 tx=0x7f1398005850 comp rx=0 tx=0).stop 2024-09-12T01:27:09.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.070+0000 7f13b4ec2640 1 -- 172.21.15.81:0/952016687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b0102ef0 msgr2=0x7f13b019ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:09.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.070+0000 7f13b4ec2640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b0102ef0 0x7f13b019ce70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f13a802ae70 tx=0x7f13a802f5d0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.070+0000 7f13b4ec2640 1 -- 172.21.15.81:0/952016687 shutdown_connections 2024-09-12T01:27:09.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.070+0000 7f13b4ec2640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f139c0a2c10 0x7f139c0a50d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.070+0000 7f13b4ec2640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13b0102ef0 0x7f13b019ce70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.070+0000 7f13b4ec2640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b0102570 0x7f13b0198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.070+0000 7f13b4ec2640 1 --2- 172.21.15.81:0/952016687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13b0100e20 0x7f13b01985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.070+0000 7f13b4ec2640 1 -- 172.21.15.81:0/952016687 >> 172.21.15.81:0/952016687 conn(0x7f13b00fc7d0 msgr2=0x7f13b006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:09.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.070+0000 7f13b4ec2640 1 -- 172.21.15.81:0/952016687 shutdown_connections 2024-09-12T01:27:09.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.070+0000 7f13b4ec2640 1 -- 172.21.15.81:0/952016687 wait complete. 2024-09-12T01:27:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.365+0000 7f65a7f74640 1 -- 172.21.15.81:0/3694402278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a01082a0 msgr2=0x7f65a010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.365+0000 7f65a7f74640 1 --2- 172.21.15.81:0/3694402278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a01082a0 0x7f65a010ec40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6598009cd0 tx=0x7f659802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.365+0000 7f65a7f74640 1 -- 172.21.15.81:0/3694402278 shutdown_connections 2024-09-12T01:27:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.365+0000 7f65a7f74640 1 --2- 172.21.15.81:0/3694402278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a01082a0 0x7f65a010ec40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.365+0000 7f65a7f74640 1 --2- 172.21.15.81:0/3694402278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65a01036e0 0x7f65a0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.365+0000 7f65a7f74640 1 --2- 172.21.15.81:0/3694402278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65a0102d30 0x7f65a0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.365+0000 7f65a7f74640 1 -- 172.21.15.81:0/3694402278 >> 172.21.15.81:0/3694402278 conn(0x7f65a00fc7d0 msgr2=0x7f65a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.365+0000 7f65a7f74640 1 -- 172.21.15.81:0/3694402278 shutdown_connections 2024-09-12T01:27:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.365+0000 7f65a7f74640 1 -- 172.21.15.81:0/3694402278 wait complete. 2024-09-12T01:27:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a7f74640 1 Processor -- start 2024-09-12T01:27:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a7f74640 1 -- start start 2024-09-12T01:27:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a7f74640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65a0102d30 0x7f65a0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a7f74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a01036e0 0x7f65a0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a7f74640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65a01082a0 0x7f65a0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a7f74640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65a01120a0 con 0x7f65a01036e0 2024-09-12T01:27:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a7f74640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0111f20 con 0x7f65a0102d30 2024-09-12T01:27:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a7f74640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0112220 con 0x7f65a01082a0 2024-09-12T01:27:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a550f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a01036e0 0x7f65a0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a550f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a01036e0 0x7f65a0100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50240/0 (socket says 172.21.15.81:50240) 2024-09-12T01:27:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a550f640 1 -- 172.21.15.81:0/1210823072 learned_addr learned my addr 172.21.15.81:0/1210823072 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a5d10640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65a0102d30 0x7f65a0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a550f640 1 -- 172.21.15.81:0/1210823072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65a01082a0 msgr2=0x7f65a0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a550f640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65a01082a0 0x7f65a0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a550f640 1 -- 172.21.15.81:0/1210823072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65a0102d30 msgr2=0x7f65a0100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a550f640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65a0102d30 0x7f65a0100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a550f640 1 -- 172.21.15.81:0/1210823072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a01a6990 con 0x7f65a01036e0 2024-09-12T01:27:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a5d10640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65a0102d30 0x7f65a0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.366+0000 7f65a550f640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a01036e0 0x7f65a0100ed0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f659000d740 tx=0x7f659000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.367+0000 7f6596ffd640 1 -- 172.21.15.81:0/1210823072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590017070 con 0x7f65a01036e0 2024-09-12T01:27:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.367+0000 7f65a7f74640 1 -- 172.21.15.81:0/1210823072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a01a6c80 con 0x7f65a01036e0 2024-09-12T01:27:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.367+0000 7f6596ffd640 1 -- 172.21.15.81:0/1210823072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f659000de50 con 0x7f65a01036e0 2024-09-12T01:27:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.367+0000 7f6596ffd640 1 -- 172.21.15.81:0/1210823072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659000f6b0 con 0x7f65a01036e0 2024-09-12T01:27:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.367+0000 7f65a7f74640 1 -- 172.21.15.81:0/1210823072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a01a71c0 con 0x7f65a01036e0 2024-09-12T01:27:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.368+0000 7f65a7f74640 1 -- 172.21.15.81:0/1210823072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a0103110 con 0x7f65a01036e0 2024-09-12T01:27:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.369+0000 7f6596ffd640 1 -- 172.21.15.81:0/1210823072 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f659001a070 con 0x7f65a01036e0 2024-09-12T01:27:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.369+0000 7f6596ffd640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f658c0a2c10 0x7f658c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.370+0000 7f65a5d10640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f658c0a2c10 0x7f658c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.370+0000 7f6596ffd640 1 -- 172.21.15.81:0/1210823072 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f65900cebb0 con 0x7f65a01036e0 2024-09-12T01:27:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.370+0000 7f65a5d10640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f658c0a2c10 0x7f658c0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f659c00abe0 tx=0x7f659c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.373+0000 7f6596ffd640 1 -- 172.21.15.81:0/1210823072 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f659009b9c0 con 0x7f65a01036e0 2024-09-12T01:27:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.547+0000 7f65a7f74640 1 -- 172.21.15.81:0/1210823072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f65a0101ec0 con 0x7f65a01036e0 2024-09-12T01:27:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.547+0000 7f6596ffd640 1 -- 172.21.15.81:0/1210823072 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f659009b2c0 con 0x7f65a01036e0 2024-09-12T01:27:09.547 INFO:teuthology.orchestra.run.smithi081.stdout:317827579928 2024-09-12T01:27:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.549+0000 7f65a7f74640 1 -- 172.21.15.81:0/1210823072 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f658c0a2c10 msgr2=0x7f658c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.549+0000 7f65a7f74640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f658c0a2c10 0x7f658c0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f659c00abe0 tx=0x7f659c00a5c0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.549+0000 7f65a7f74640 1 -- 172.21.15.81:0/1210823072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a01036e0 msgr2=0x7f65a0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.549+0000 7f65a7f74640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a01036e0 0x7f65a0100ed0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f659000d740 tx=0x7f659000dc00 comp rx=0 tx=0).stop 2024-09-12T01:27:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.549+0000 7f65a7f74640 1 -- 172.21.15.81:0/1210823072 shutdown_connections 2024-09-12T01:27:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.549+0000 7f65a7f74640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f658c0a2c10 0x7f658c0a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.549+0000 7f65a7f74640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65a01082a0 0x7f65a0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.549+0000 7f65a7f74640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a01036e0 0x7f65a0100ed0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.549+0000 7f65a7f74640 1 --2- 172.21.15.81:0/1210823072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65a0102d30 0x7f65a0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.549+0000 7f65a7f74640 1 -- 172.21.15.81:0/1210823072 >> 172.21.15.81:0/1210823072 conn(0x7f65a00fc7d0 msgr2=0x7f65a0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.550+0000 7f65a7f74640 1 -- 172.21.15.81:0/1210823072 shutdown_connections 2024-09-12T01:27:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.550+0000 7f65a7f74640 1 -- 172.21.15.81:0/1210823072 wait complete. 2024-09-12T01:27:09.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.593+0000 7f237301c640 1 -- 172.21.15.81:0/1175256963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236c10c150 msgr2=0x7f236c10e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.593+0000 7f237301c640 1 --2- 172.21.15.81:0/1175256963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236c10c150 0x7f236c10e5f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2364009ca0 tx=0x7f236402a950 comp rx=0 tx=0).stop 2024-09-12T01:27:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 -- 172.21.15.81:0/1175256963 shutdown_connections 2024-09-12T01:27:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 --2- 172.21.15.81:0/1175256963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236c10c150 0x7f236c10e5f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 --2- 172.21.15.81:0/1175256963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236c103640 0x7f236c10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 --2- 172.21.15.81:0/1175256963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f236c102d20 0x7f236c103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 -- 172.21.15.81:0/1175256963 >> 172.21.15.81:0/1175256963 conn(0x7f236c0fc780 msgr2=0x7f236c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 -- 172.21.15.81:0/1175256963 shutdown_connections 2024-09-12T01:27:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 -- 172.21.15.81:0/1175256963 wait complete. 2024-09-12T01:27:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 Processor -- start 2024-09-12T01:27:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 -- start start 2024-09-12T01:27:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236c102d20 0x7f236c196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236c103640 0x7f236c1968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f236c10c150 0x7f236c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f236c10fe00 con 0x7f236c102d20 2024-09-12T01:27:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f236c10fc80 con 0x7f236c103640 2024-09-12T01:27:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.594+0000 7f237301c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f236c10ff80 con 0x7f236c10c150 2024-09-12T01:27:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.595+0000 7f2370db8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236c102d20 0x7f236c196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.595+0000 7f2370db8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236c102d20 0x7f236c196360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50272/0 (socket says 172.21.15.81:50272) 2024-09-12T01:27:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.595+0000 7f2370db8640 1 -- 172.21.15.81:0/3556102594 learned_addr learned my addr 172.21.15.81:0/3556102594 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.595+0000 7f23715b9640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f236c10c150 0x7f236c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.595+0000 7f236bfff640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236c103640 0x7f236c1968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.595+0000 7f2370db8640 1 -- 172.21.15.81:0/3556102594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f236c10c150 msgr2=0x7f236c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.595+0000 7f2370db8640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f236c10c150 0x7f236c19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.595+0000 7f2370db8640 1 -- 172.21.15.81:0/3556102594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236c103640 msgr2=0x7f236c1968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.595+0000 7f2370db8640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236c103640 0x7f236c1968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.595+0000 7f2370db8640 1 -- 172.21.15.81:0/3556102594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c19b310 con 0x7f236c102d20 2024-09-12T01:27:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.595+0000 7f2370db8640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236c102d20 0x7f236c196360 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f235c00b4a0 tx=0x7f235c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.596+0000 7f2369ffb640 1 -- 172.21.15.81:0/3556102594 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c014070 con 0x7f236c102d20 2024-09-12T01:27:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.596+0000 7f2369ffb640 1 -- 172.21.15.81:0/3556102594 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f235c010af0 con 0x7f236c102d20 2024-09-12T01:27:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.596+0000 7f237301c640 1 -- 172.21.15.81:0/3556102594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236c19b600 con 0x7f236c102d20 2024-09-12T01:27:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.596+0000 7f2369ffb640 1 -- 172.21.15.81:0/3556102594 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c017d10 con 0x7f236c102d20 2024-09-12T01:27:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.596+0000 7f237301c640 1 -- 172.21.15.81:0/3556102594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236c1a2ee0 con 0x7f236c102d20 2024-09-12T01:27:09.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.598+0000 7f237301c640 1 -- 172.21.15.81:0/3556102594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236c103180 con 0x7f236c102d20 2024-09-12T01:27:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.598+0000 7f2369ffb640 1 -- 172.21.15.81:0/3556102594 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f235c017070 con 0x7f236c102d20 2024-09-12T01:27:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.599+0000 7f2369ffb640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f23580a70a0 0x7f23580a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.599+0000 7f236bfff640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f23580a70a0 0x7f23580a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.599+0000 7f2369ffb640 1 -- 172.21.15.81:0/3556102594 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f235c0ce3c0 con 0x7f236c102d20 2024-09-12T01:27:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.600+0000 7f236bfff640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f23580a70a0 0x7f23580a9560 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f236c0fee10 tx=0x7f2354009060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:09.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.603+0000 7f2369ffb640 1 -- 172.21.15.81:0/3556102594 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f235c09ac90 con 0x7f236c102d20 2024-09-12T01:27:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.772+0000 7f237301c640 1 -- 172.21.15.81:0/3556102594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f236c107250 con 0x7f236c102d20 2024-09-12T01:27:09.772 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:09 smithi081 ceph-mon[30920]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:09.772 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:09 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/952016687' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:27:09.772 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:09 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1210823072' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T01:27:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.773+0000 7f2369ffb640 1 -- 172.21.15.81:0/3556102594 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f235c09ef90 con 0x7f236c102d20 2024-09-12T01:27:09.773 INFO:teuthology.orchestra.run.smithi081.stdout:150323855413 2024-09-12T01:27:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.775+0000 7f237301c640 1 -- 172.21.15.81:0/3556102594 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f23580a70a0 msgr2=0x7f23580a9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.775+0000 7f237301c640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f23580a70a0 0x7f23580a9560 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f236c0fee10 tx=0x7f2354009060 comp rx=0 tx=0).stop 2024-09-12T01:27:09.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.775+0000 7f237301c640 1 -- 172.21.15.81:0/3556102594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236c102d20 msgr2=0x7f236c196360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:09.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.775+0000 7f237301c640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236c102d20 0x7f236c196360 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f235c00b4a0 tx=0x7f235c00b960 comp rx=0 tx=0).stop 2024-09-12T01:27:09.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.775+0000 7f237301c640 1 -- 172.21.15.81:0/3556102594 shutdown_connections 2024-09-12T01:27:09.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.775+0000 7f237301c640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f23580a70a0 0x7f23580a9560 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.775+0000 7f237301c640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f236c10c150 0x7f236c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.775+0000 7f237301c640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236c103640 0x7f236c1968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.775+0000 7f237301c640 1 --2- 172.21.15.81:0/3556102594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236c102d20 0x7f236c196360 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:09.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.775+0000 7f237301c640 1 -- 172.21.15.81:0/3556102594 >> 172.21.15.81:0/3556102594 conn(0x7f236c0fc780 msgr2=0x7f236c0fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:09.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.775+0000 7f237301c640 1 -- 172.21.15.81:0/3556102594 shutdown_connections 2024-09-12T01:27:09.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:09.775+0000 7f237301c640 1 -- 172.21.15.81:0/3556102594 wait complete. 2024-09-12T01:27:10.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:09 smithi100 ceph-mon[35275]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:10.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:09 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/952016687' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:27:10.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:09 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1210823072' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T01:27:10.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:09 smithi189 ceph-mon[35357]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:10.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:09 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/952016687' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:27:10.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:09 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1210823072' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T01:27:10.623 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579926 got 317827579928 for osd.11 2024-09-12T01:27:10.624 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:10.691 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:10 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3556102594' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:27:10.691 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:10 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:27:10.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:10 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3556102594' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:27:10.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:10 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:27:10.864 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:10 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3556102594' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:27:10.864 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:10 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:27:11.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.216+0000 7fa32851a640 1 -- 172.21.15.81:0/996807023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa320101420 msgr2=0x7fa32010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:11.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.216+0000 7fa32851a640 1 --2- 172.21.15.81:0/996807023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa320101420 0x7fa32010d950 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa310009cd0 tx=0x7fa31002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:27:11.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.216+0000 7fa32851a640 1 -- 172.21.15.81:0/996807023 shutdown_connections 2024-09-12T01:27:11.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.216+0000 7fa32851a640 1 --2- 172.21.15.81:0/996807023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa320101420 0x7fa32010d950 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.216+0000 7fa32851a640 1 --2- 172.21.15.81:0/996807023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa320100a80 0x7fa320100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.216+0000 7fa32851a640 1 --2- 172.21.15.81:0/996807023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa320106a80 0x7fa320106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.216+0000 7fa32851a640 1 -- 172.21.15.81:0/996807023 >> 172.21.15.81:0/996807023 conn(0x7fa3200fc7a0 msgr2=0x7fa3200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.216+0000 7fa32851a640 1 -- 172.21.15.81:0/996807023 shutdown_connections 2024-09-12T01:27:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.216+0000 7fa32851a640 1 -- 172.21.15.81:0/996807023 wait complete. 2024-09-12T01:27:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.216+0000 7fa32851a640 1 Processor -- start 2024-09-12T01:27:11.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.216+0000 7fa32851a640 1 -- start start 2024-09-12T01:27:11.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa32851a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa320100a80 0x7fa320199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:11.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa32851a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa320101420 0x7fa3201997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:11.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa32851a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa320106a80 0x7fa3201a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:11.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa32851a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa320110ed0 con 0x7fa320106a80 2024-09-12T01:27:11.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa32851a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa320110d50 con 0x7fa320100a80 2024-09-12T01:27:11.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa32851a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa320111050 con 0x7fa320101420 2024-09-12T01:27:11.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa326ab7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa320106a80 0x7fa3201a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:11.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa326ab7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa320106a80 0x7fa3201a4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50276/0 (socket says 172.21.15.81:50276) 2024-09-12T01:27:11.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa326ab7640 1 -- 172.21.15.81:0/2200272190 learned_addr learned my addr 172.21.15.81:0/2200272190 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:11.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa3262b6640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa320100a80 0x7fa320199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:11.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa325ab5640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa320101420 0x7fa3201997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:11.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa326ab7640 1 -- 172.21.15.81:0/2200272190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa320101420 msgr2=0x7fa3201997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:11.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa326ab7640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa320101420 0x7fa3201997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:11.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa326ab7640 1 -- 172.21.15.81:0/2200272190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa320100a80 msgr2=0x7fa320199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:11.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa326ab7640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa320100a80 0x7fa320199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:11.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa326ab7640 1 -- 172.21.15.81:0/2200272190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3201a4840 con 0x7fa320106a80 2024-09-12T01:27:11.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa326ab7640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa320106a80 0x7fa3201a4300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa310033040 tx=0x7fa310031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:11.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa31f7fe640 1 -- 172.21.15.81:0/2200272190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310004040 con 0x7fa320106a80 2024-09-12T01:27:11.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.217+0000 7fa31f7fe640 1 -- 172.21.15.81:0/2200272190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3100046c0 con 0x7fa320106a80 2024-09-12T01:27:11.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.218+0000 7fa31f7fe640 1 -- 172.21.15.81:0/2200272190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310030ed0 con 0x7fa320106a80 2024-09-12T01:27:11.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.218+0000 7fa32851a640 1 -- 172.21.15.81:0/2200272190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3201a4a10 con 0x7fa320106a80 2024-09-12T01:27:11.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.218+0000 7fa32851a640 1 -- 172.21.15.81:0/2200272190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3201a4e70 con 0x7fa320106a80 2024-09-12T01:27:11.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.219+0000 7fa32851a640 1 -- 172.21.15.81:0/2200272190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa320100ee0 con 0x7fa320106a80 2024-09-12T01:27:11.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.220+0000 7fa31f7fe640 1 -- 172.21.15.81:0/2200272190 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa3100041e0 con 0x7fa320106a80 2024-09-12T01:27:11.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.220+0000 7fa31f7fe640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa3080a2c10 0x7fa3080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:11.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.220+0000 7fa3262b6640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa3080a2c10 0x7fa3080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:11.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.220+0000 7fa31f7fe640 1 -- 172.21.15.81:0/2200272190 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa31002e030 con 0x7fa320106a80 2024-09-12T01:27:11.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.221+0000 7fa3262b6640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa3080a2c10 0x7fa3080a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa318009b50 tx=0x7fa318005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:11.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.224+0000 7fa31f7fe640 1 -- 172.21.15.81:0/2200272190 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa31004b060 con 0x7fa320106a80 2024-09-12T01:27:11.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.404+0000 7fa32851a640 1 -- 172.21.15.81:0/2200272190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa3201a5170 con 0x7fa320106a80 2024-09-12T01:27:11.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.404+0000 7fa31f7fe640 1 -- 172.21.15.81:0/2200272190 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa3100bd3e0 con 0x7fa320106a80 2024-09-12T01:27:11.404 INFO:teuthology.orchestra.run.smithi081.stdout:287762808860 2024-09-12T01:27:11.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.406+0000 7fa32851a640 1 -- 172.21.15.81:0/2200272190 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa3080a2c10 msgr2=0x7fa3080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:11.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.406+0000 7fa32851a640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa3080a2c10 0x7fa3080a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa318009b50 tx=0x7fa318005f90 comp rx=0 tx=0).stop 2024-09-12T01:27:11.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.406+0000 7fa32851a640 1 -- 172.21.15.81:0/2200272190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa320106a80 msgr2=0x7fa3201a4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:11.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.406+0000 7fa32851a640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa320106a80 0x7fa3201a4300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa310033040 tx=0x7fa310031e60 comp rx=0 tx=0).stop 2024-09-12T01:27:11.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.406+0000 7fa32851a640 1 -- 172.21.15.81:0/2200272190 shutdown_connections 2024-09-12T01:27:11.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.406+0000 7fa32851a640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa3080a2c10 0x7fa3080a50d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:11.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.406+0000 7fa32851a640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa320106a80 0x7fa3201a4300 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:11.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.406+0000 7fa32851a640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa320101420 0x7fa3201997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:11.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.406+0000 7fa32851a640 1 --2- 172.21.15.81:0/2200272190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa320100a80 0x7fa320199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.407+0000 7fa32851a640 1 -- 172.21.15.81:0/2200272190 >> 172.21.15.81:0/2200272190 conn(0x7fa3200fc7a0 msgr2=0x7fa3200fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.407+0000 7fa32851a640 1 -- 172.21.15.81:0/2200272190 shutdown_connections 2024-09-12T01:27:11.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:11.407+0000 7fa32851a640 1 -- 172.21.15.81:0/2200272190 wait complete. 2024-09-12T01:27:11.867 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:11 smithi081 ceph-mon[30920]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:11.868 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:11.868 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:11.868 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:11.868 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:11 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:11.868 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:11 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2200272190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T01:27:11.894 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855410 got 150323855413 for osd.5 2024-09-12T01:27:11.894 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:12.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:11 smithi100 ceph-mon[35275]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:12.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:11 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:12.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:11 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:12.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:11 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:12.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:11 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:12.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:11 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2200272190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T01:27:12.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:11 smithi189 ceph-mon[35357]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:12.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:12.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:12.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:12.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:11 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:12.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:11 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2200272190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T01:27:12.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.074+0000 7f0faeb88640 1 -- 172.21.15.81:0/4045173474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa810c1a0 msgr2=0x7f0fa810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.074+0000 7f0faeb88640 1 --2- 172.21.15.81:0/4045173474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa810c1a0 0x7f0fa810e610 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009900 tx=0x7f0f9802a480 comp rx=0 tx=0).stop 2024-09-12T01:27:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.074+0000 7f0faeb88640 1 -- 172.21.15.81:0/4045173474 shutdown_connections 2024-09-12T01:27:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.074+0000 7f0faeb88640 1 --2- 172.21.15.81:0/4045173474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa810c1a0 0x7f0fa810e610 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.074+0000 7f0faeb88640 1 --2- 172.21.15.81:0/4045173474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fa8103720 0x7f0fa810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.074+0000 7f0faeb88640 1 --2- 172.21.15.81:0/4045173474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa8102e00 0x7f0fa81031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.074+0000 7f0faeb88640 1 -- 172.21.15.81:0/4045173474 >> 172.21.15.81:0/4045173474 conn(0x7f0fa80fc7a0 msgr2=0x7f0fa80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.074+0000 7f0faeb88640 1 -- 172.21.15.81:0/4045173474 shutdown_connections 2024-09-12T01:27:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.074+0000 7f0faeb88640 1 -- 172.21.15.81:0/4045173474 wait complete. 2024-09-12T01:27:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.075+0000 7f0faeb88640 1 Processor -- start 2024-09-12T01:27:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.075+0000 7f0faeb88640 1 -- start start 2024-09-12T01:27:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.075+0000 7f0faeb88640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa8102e00 0x7f0fa8198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:12.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.075+0000 7f0faeb88640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa8103720 0x7f0fa81988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:12.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.075+0000 7f0faeb88640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fa810c1a0 0x7f0fa819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:12.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.075+0000 7f0faeb88640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa8111f50 con 0x7f0fa8102e00 2024-09-12T01:27:12.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.075+0000 7f0faeb88640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa8111dd0 con 0x7f0fa8103720 2024-09-12T01:27:12.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.075+0000 7f0faeb88640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa81120d0 con 0x7f0fa810c1a0 2024-09-12T01:27:12.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.075+0000 7f0fac924640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa8102e00 0x7f0fa8198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:12.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.075+0000 7f0fac924640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa8102e00 0x7f0fa8198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50306/0 (socket says 172.21.15.81:50306) 2024-09-12T01:27:12.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.075+0000 7f0fac924640 1 -- 172.21.15.81:0/2291121770 learned_addr learned my addr 172.21.15.81:0/2291121770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:12.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.075+0000 7f0fad125640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fa810c1a0 0x7f0fa819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:12.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.075+0000 7f0fa7fff640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa8103720 0x7f0fa81988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:12.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.076+0000 7f0fac924640 1 -- 172.21.15.81:0/2291121770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fa810c1a0 msgr2=0x7f0fa819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:12.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.076+0000 7f0fac924640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fa810c1a0 0x7f0fa819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:12.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.076+0000 7f0fac924640 1 -- 172.21.15.81:0/2291121770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa8103720 msgr2=0x7f0fa81988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:12.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.076+0000 7f0fac924640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa8103720 0x7f0fa81988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.076+0000 7f0fac924640 1 -- 172.21.15.81:0/2291121770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa819d320 con 0x7f0fa8102e00 2024-09-12T01:27:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.076+0000 7f0fad125640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fa810c1a0 0x7f0fa819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.076+0000 7f0fa7fff640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa8103720 0x7f0fa81988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.076+0000 7f0fac924640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa8102e00 0x7f0fa8198370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000cce0 tx=0x7f0fa000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.076+0000 7f0fa5ffb640 1 -- 172.21.15.81:0/2291121770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000f650 con 0x7f0fa8102e00 2024-09-12T01:27:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.076+0000 7f0faeb88640 1 -- 172.21.15.81:0/2291121770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa819d610 con 0x7f0fa8102e00 2024-09-12T01:27:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.076+0000 7f0fa5ffb640 1 -- 172.21.15.81:0/2291121770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fa000fcd0 con 0x7f0fa8102e00 2024-09-12T01:27:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.076+0000 7f0fa5ffb640 1 -- 172.21.15.81:0/2291121770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0018c70 con 0x7f0fa8102e00 2024-09-12T01:27:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.076+0000 7f0faeb88640 1 -- 172.21.15.81:0/2291121770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa81a4ef0 con 0x7f0fa8102e00 2024-09-12T01:27:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.077+0000 7f0faeb88640 1 -- 172.21.15.81:0/2291121770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa81031e0 con 0x7f0fa8102e00 2024-09-12T01:27:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.078+0000 7f0fa5ffb640 1 -- 172.21.15.81:0/2291121770 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0fa000f7f0 con 0x7f0fa8102e00 2024-09-12T01:27:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.079+0000 7f0fa5ffb640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f0f900a2c10 0x7f0f900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.079+0000 7f0fa7fff640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f0f900a2c10 0x7f0f900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.079+0000 7f0fa5ffb640 1 -- 172.21.15.81:0/2291121770 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0fa00cf730 con 0x7f0fa8102e00 2024-09-12T01:27:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.079+0000 7f0fa7fff640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f0f900a2c10 0x7f0f900a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c005fd0 tx=0x7f0f9c0094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.083+0000 7f0fa5ffb640 1 -- 172.21.15.81:0/2291121770 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0fa0014030 con 0x7f0fa8102e00 2024-09-12T01:27:12.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.253+0000 7f0faeb88640 1 -- 172.21.15.81:0/2291121770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0fa81996d0 con 0x7f0fa8102e00 2024-09-12T01:27:12.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.253+0000 7f0fa5ffb640 1 -- 172.21.15.81:0/2291121770 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0fa009c540 con 0x7f0fa8102e00 2024-09-12T01:27:12.253 INFO:teuthology.orchestra.run.smithi081.stdout:180388626481 2024-09-12T01:27:12.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.255+0000 7f0faeb88640 1 -- 172.21.15.81:0/2291121770 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f0f900a2c10 msgr2=0x7f0f900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:12.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.256+0000 7f0faeb88640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f0f900a2c10 0x7f0f900a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c005fd0 tx=0x7f0f9c0094d0 comp rx=0 tx=0).stop 2024-09-12T01:27:12.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.256+0000 7f0faeb88640 1 -- 172.21.15.81:0/2291121770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa8102e00 msgr2=0x7f0fa8198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:12.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.256+0000 7f0faeb88640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa8102e00 0x7f0fa8198370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000cce0 tx=0x7f0fa000a620 comp rx=0 tx=0).stop 2024-09-12T01:27:12.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.256+0000 7f0faeb88640 1 -- 172.21.15.81:0/2291121770 shutdown_connections 2024-09-12T01:27:12.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.256+0000 7f0faeb88640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f0f900a2c10 0x7f0f900a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:12.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.256+0000 7f0faeb88640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0fa810c1a0 0x7f0fa819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:12.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.256+0000 7f0faeb88640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa8103720 0x7f0fa81988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:12.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.256+0000 7f0faeb88640 1 --2- 172.21.15.81:0/2291121770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fa8102e00 0x7f0fa8198370 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:12.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.256+0000 7f0faeb88640 1 -- 172.21.15.81:0/2291121770 >> 172.21.15.81:0/2291121770 conn(0x7f0fa80fc7a0 msgr2=0x7f0fa80fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:12.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.256+0000 7f0faeb88640 1 -- 172.21.15.81:0/2291121770 shutdown_connections 2024-09-12T01:27:12.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:12.256+0000 7f0faeb88640 1 -- 172.21.15.81:0/2291121770 wait complete. 2024-09-12T01:27:12.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:12 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2291121770' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T01:27:12.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:12 smithi081 ceph-mon[30920]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:12.816 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808857 got 287762808860 for osd.10 2024-09-12T01:27:12.816 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:13.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:12 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2291121770' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T01:27:13.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:12 smithi100 ceph-mon[35275]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:13.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:12 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2291121770' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T01:27:13.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:12 smithi189 ceph-mon[35357]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.501+0000 7fb32d5ac640 1 -- 172.21.15.81:0/336801018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3281036e0 msgr2=0x7fb328107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.501+0000 7fb32d5ac640 1 --2- 172.21.15.81:0/336801018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3281036e0 0x7fb328107b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb310009930 tx=0x7fb31002a420 comp rx=0 tx=0).stop 2024-09-12T01:27:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.501+0000 7fb32d5ac640 1 -- 172.21.15.81:0/336801018 shutdown_connections 2024-09-12T01:27:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.501+0000 7fb32d5ac640 1 --2- 172.21.15.81:0/336801018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3281082a0 0x7fb32810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.501+0000 7fb32d5ac640 1 --2- 172.21.15.81:0/336801018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3281036e0 0x7fb328107b90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.501+0000 7fb32d5ac640 1 --2- 172.21.15.81:0/336801018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb328102d30 0x7fb328103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.501+0000 7fb32d5ac640 1 -- 172.21.15.81:0/336801018 >> 172.21.15.81:0/336801018 conn(0x7fb3280fc7d0 msgr2=0x7fb3280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.501+0000 7fb32d5ac640 1 -- 172.21.15.81:0/336801018 shutdown_connections 2024-09-12T01:27:13.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.501+0000 7fb32d5ac640 1 -- 172.21.15.81:0/336801018 wait complete. 2024-09-12T01:27:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.502+0000 7fb32d5ac640 1 Processor -- start 2024-09-12T01:27:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.502+0000 7fb32d5ac640 1 -- start start 2024-09-12T01:27:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb32d5ac640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb328102d30 0x7fb328198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb32d5ac640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3281036e0 0x7fb328198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb32d5ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3281082a0 0x7fb32819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb32d5ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3281120e0 con 0x7fb3281082a0 2024-09-12T01:27:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb32d5ac640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb328111f60 con 0x7fb3281036e0 2024-09-12T01:27:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb32d5ac640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb328112260 con 0x7fb328102d30 2024-09-12T01:27:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb3277fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3281082a0 0x7fb32819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:13.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb3277fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3281082a0 0x7fb32819cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37054/0 (socket says 172.21.15.81:37054) 2024-09-12T01:27:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb3277fe640 1 -- 172.21.15.81:0/2026104820 learned_addr learned my addr 172.21.15.81:0/2026104820 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb326ffd640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb328102d30 0x7fb328198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb3267fc640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3281036e0 0x7fb328198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb3277fe640 1 -- 172.21.15.81:0/2026104820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb328102d30 msgr2=0x7fb328198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb3277fe640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb328102d30 0x7fb328198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb3277fe640 1 -- 172.21.15.81:0/2026104820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3281036e0 msgr2=0x7fb328198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb3277fe640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3281036e0 0x7fb328198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb3277fe640 1 -- 172.21.15.81:0/2026104820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32819d5f0 con 0x7fb3281082a0 2024-09-12T01:27:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb3277fe640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3281082a0 0x7fb32819cf10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb320009fd0 tx=0x7fb32000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb31ffff640 1 -- 172.21.15.81:0/2026104820 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320011830 con 0x7fb3281082a0 2024-09-12T01:27:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb31ffff640 1 -- 172.21.15.81:0/2026104820 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb320016070 con 0x7fb3281082a0 2024-09-12T01:27:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb32d5ac640 1 -- 172.21.15.81:0/2026104820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32819d8e0 con 0x7fb3281082a0 2024-09-12T01:27:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb31ffff640 1 -- 172.21.15.81:0/2026104820 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32000f2e0 con 0x7fb3281082a0 2024-09-12T01:27:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.503+0000 7fb32d5ac640 1 -- 172.21.15.81:0/2026104820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3281a51c0 con 0x7fb3281082a0 2024-09-12T01:27:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.504+0000 7fb32d5ac640 1 -- 172.21.15.81:0/2026104820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb328103110 con 0x7fb3281082a0 2024-09-12T01:27:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.505+0000 7fb31ffff640 1 -- 172.21.15.81:0/2026104820 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb3200119d0 con 0x7fb3281082a0 2024-09-12T01:27:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.506+0000 7fb31ffff640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb3140a2c10 0x7fb3140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.506+0000 7fb326ffd640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb3140a2c10 0x7fb3140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.507+0000 7fb31ffff640 1 -- 172.21.15.81:0/2026104820 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb3200ce810 con 0x7fb3281082a0 2024-09-12T01:27:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.507+0000 7fb326ffd640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb3140a2c10 0x7fb3140a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb318005fd0 tx=0x7fb318009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.511+0000 7fb31ffff640 1 -- 172.21.15.81:0/2026104820 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb32009b730 con 0x7fb3281082a0 2024-09-12T01:27:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.680+0000 7fb32d5ac640 1 -- 172.21.15.81:0/2026104820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb32810a2b0 con 0x7fb3281082a0 2024-09-12T01:27:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.681+0000 7fb31ffff640 1 -- 172.21.15.81:0/2026104820 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb32009b030 con 0x7fb3281082a0 2024-09-12T01:27:13.680 INFO:teuthology.orchestra.run.smithi081.stdout:77309411398 2024-09-12T01:27:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.683+0000 7fb32d5ac640 1 -- 172.21.15.81:0/2026104820 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb3140a2c10 msgr2=0x7fb3140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.683+0000 7fb32d5ac640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb3140a2c10 0x7fb3140a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb318005fd0 tx=0x7fb318009870 comp rx=0 tx=0).stop 2024-09-12T01:27:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.683+0000 7fb32d5ac640 1 -- 172.21.15.81:0/2026104820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3281082a0 msgr2=0x7fb32819cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.683+0000 7fb32d5ac640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3281082a0 0x7fb32819cf10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb320009fd0 tx=0x7fb32000b8e0 comp rx=0 tx=0).stop 2024-09-12T01:27:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.683+0000 7fb32d5ac640 1 -- 172.21.15.81:0/2026104820 shutdown_connections 2024-09-12T01:27:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.683+0000 7fb32d5ac640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb3140a2c10 0x7fb3140a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.683+0000 7fb32d5ac640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3281082a0 0x7fb32819cf10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.683+0000 7fb32d5ac640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3281036e0 0x7fb328198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.683+0000 7fb32d5ac640 1 --2- 172.21.15.81:0/2026104820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb328102d30 0x7fb328198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:13.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.683+0000 7fb32d5ac640 1 -- 172.21.15.81:0/2026104820 >> 172.21.15.81:0/2026104820 conn(0x7fb3280fc7d0 msgr2=0x7fb328105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:13.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.683+0000 7fb32d5ac640 1 -- 172.21.15.81:0/2026104820 shutdown_connections 2024-09-12T01:27:13.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:13.683+0000 7fb32d5ac640 1 -- 172.21.15.81:0/2026104820 wait complete. 2024-09-12T01:27:13.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:13 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2026104820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:27:14.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:13 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2026104820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:27:14.026 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626479 got 180388626481 for osd.6 2024-09-12T01:27:14.026 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:14.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:13 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2026104820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:27:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.427+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/2482897820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a3810e450 msgr2=0x7f9a38110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.427+0000 7f9a3f3c0640 1 --2- 172.21.15.81:0/2482897820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a3810e450 0x7f9a38110840 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9a34009ca0 tx=0x7f9a3402a950 comp rx=0 tx=0).stop 2024-09-12T01:27:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/2482897820 shutdown_connections 2024-09-12T01:27:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 --2- 172.21.15.81:0/2482897820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a3810e450 0x7f9a38110840 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 --2- 172.21.15.81:0/2482897820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a38074e30 0x7f9a3810df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 --2- 172.21.15.81:0/2482897820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a38074510 0x7f9a380748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/2482897820 >> 172.21.15.81:0/2482897820 conn(0x7f9a380fd8f0 msgr2=0x7f9a380ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/2482897820 shutdown_connections 2024-09-12T01:27:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/2482897820 wait complete. 2024-09-12T01:27:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 Processor -- start 2024-09-12T01:27:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 -- start start 2024-09-12T01:27:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a38074510 0x7f9a3819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38074e30 0x7f9a3819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a3810e450 0x7f9a3819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a38114180 con 0x7f9a38074e30 2024-09-12T01:27:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9a38114000 con 0x7f9a38074510 2024-09-12T01:27:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.428+0000 7f9a3f3c0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9a38114300 con 0x7f9a3810e450 2024-09-12T01:27:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3c95b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38074e30 0x7f9a3819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3c95b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38074e30 0x7f9a3819ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37062/0 (socket says 172.21.15.81:37062) 2024-09-12T01:27:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3c95b640 1 -- 172.21.15.81:0/4228842765 learned_addr learned my addr 172.21.15.81:0/4228842765 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3d15c640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a38074510 0x7f9a3819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3d95d640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a3810e450 0x7f9a3819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3c95b640 1 -- 172.21.15.81:0/4228842765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a3810e450 msgr2=0x7f9a3819ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3c95b640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a3810e450 0x7f9a3819ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3c95b640 1 -- 172.21.15.81:0/4228842765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a38074510 msgr2=0x7f9a3819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3c95b640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a38074510 0x7f9a3819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3c95b640 1 -- 172.21.15.81:0/4228842765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3819f670 con 0x7f9a38074e30 2024-09-12T01:27:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3d15c640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a38074510 0x7f9a3819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3d95d640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a3810e450 0x7f9a3819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3c95b640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38074e30 0x7f9a3819ac00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d770 tx=0x7f9a2800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a2e7fc640 1 -- 172.21.15.81:0/4228842765 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28017070 con 0x7f9a38074e30 2024-09-12T01:27:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/4228842765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3819f960 con 0x7f9a38074e30 2024-09-12T01:27:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a2e7fc640 1 -- 172.21.15.81:0/4228842765 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a28005500 con 0x7f9a38074e30 2024-09-12T01:27:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a2e7fc640 1 -- 172.21.15.81:0/4228842765 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28004e00 con 0x7f9a38074e30 2024-09-12T01:27:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.429+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/4228842765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a381a7240 con 0x7f9a38074e30 2024-09-12T01:27:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.430+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/4228842765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a380748f0 con 0x7f9a38074e30 2024-09-12T01:27:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.432+0000 7f9a2e7fc640 1 -- 172.21.15.81:0/4228842765 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9a28004fa0 con 0x7f9a38074e30 2024-09-12T01:27:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.433+0000 7f9a2e7fc640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9a240a2c10 0x7f9a240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.433+0000 7f9a3d15c640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9a240a2c10 0x7f9a240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.433+0000 7f9a2e7fc640 1 -- 172.21.15.81:0/4228842765 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9a280cefd0 con 0x7f9a38074e30 2024-09-12T01:27:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.434+0000 7f9a3d15c640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9a240a2c10 0x7f9a240a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9a300058c0 tx=0x7f9a30005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.437+0000 7f9a2e7fc640 1 -- 172.21.15.81:0/4228842765 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a2809be80 con 0x7f9a38074e30 2024-09-12T01:27:14.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.616+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/4228842765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f9a38109600 con 0x7f9a38074e30 2024-09-12T01:27:14.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.617+0000 7f9a2e7fc640 1 -- 172.21.15.81:0/4228842765 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9a2809b780 con 0x7f9a38074e30 2024-09-12T01:27:14.617 INFO:teuthology.orchestra.run.smithi081.stdout:266287972387 2024-09-12T01:27:14.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.618+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/4228842765 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9a240a2c10 msgr2=0x7f9a240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:14.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.618+0000 7f9a3f3c0640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9a240a2c10 0x7f9a240a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9a300058c0 tx=0x7f9a30005ec0 comp rx=0 tx=0).stop 2024-09-12T01:27:14.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.618+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/4228842765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38074e30 msgr2=0x7f9a3819ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:14.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.619+0000 7f9a3f3c0640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38074e30 0x7f9a3819ac00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d770 tx=0x7f9a2800dc30 comp rx=0 tx=0).stop 2024-09-12T01:27:14.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.619+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/4228842765 shutdown_connections 2024-09-12T01:27:14.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.619+0000 7f9a3f3c0640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f9a240a2c10 0x7f9a240a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:14.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.619+0000 7f9a3f3c0640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a3810e450 0x7f9a3819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:14.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.619+0000 7f9a3f3c0640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a38074e30 0x7f9a3819ac00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.619+0000 7f9a3f3c0640 1 --2- 172.21.15.81:0/4228842765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a38074510 0x7f9a3819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.619+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/4228842765 >> 172.21.15.81:0/4228842765 conn(0x7f9a380fd8f0 msgr2=0x7f9a380fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.619+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/4228842765 shutdown_connections 2024-09-12T01:27:14.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:14.619+0000 7f9a3f3c0640 1 -- 172.21.15.81:0/4228842765 wait complete. 2024-09-12T01:27:14.855 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:14 smithi081 ceph-mon[30920]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:14.855 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:14 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/4228842765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T01:27:14.883 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411394 got 77309411398 for osd.2 2024-09-12T01:27:14.883 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:15.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:14 smithi100 ceph-mon[35275]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:15.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:14 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/4228842765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T01:27:15.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:14 smithi189 ceph-mon[35357]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:15.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:14 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/4228842765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T01:27:15.497 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986232 got 133143986235 for osd.4 2024-09-12T01:27:15.497 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:15.956 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972384 got 266287972387 for osd.9 2024-09-12T01:27:15.956 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:15.956 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T01:27:15.957 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:27:16.717 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.199+0000 7f28f3e5e640 1 -- 172.21.15.81:0/2780760810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec101de0 msgr2=0x7f28ec1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.199+0000 7f28f3e5e640 1 --2- 172.21.15.81:0/2780760810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec101de0 0x7f28ec1021c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009ca0 tx=0x7f28e402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:27:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.199+0000 7f28f3e5e640 1 -- 172.21.15.81:0/2780760810 shutdown_connections 2024-09-12T01:27:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.199+0000 7f28f3e5e640 1 --2- 172.21.15.81:0/2780760810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28ec106f10 0x7f28ec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.199+0000 7f28f3e5e640 1 --2- 172.21.15.81:0/2780760810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28ec102790 0x7f28ec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.199+0000 7f28f3e5e640 1 --2- 172.21.15.81:0/2780760810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec101de0 0x7f28ec1021c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.199+0000 7f28f3e5e640 1 -- 172.21.15.81:0/2780760810 >> 172.21.15.81:0/2780760810 conn(0x7f28ec0fd880 msgr2=0x7f28ec0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.199+0000 7f28f3e5e640 1 -- 172.21.15.81:0/2780760810 shutdown_connections 2024-09-12T01:27:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.199+0000 7f28f3e5e640 1 -- 172.21.15.81:0/2780760810 wait complete. 2024-09-12T01:27:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.199+0000 7f28f3e5e640 1 Processor -- start 2024-09-12T01:27:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.199+0000 7f28f3e5e640 1 -- start start 2024-09-12T01:27:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f3e5e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28ec101de0 0x7f28ec19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f3e5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec102790 0x7f28ec19ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f3e5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28ec106f10 0x7f28ec19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f3e5e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec111f90 con 0x7f28ec102790 2024-09-12T01:27:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f3e5e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec111e10 con 0x7f28ec106f10 2024-09-12T01:27:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f3e5e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec112110 con 0x7f28ec101de0 2024-09-12T01:27:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f13f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec102790 0x7f28ec19ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f13f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec102790 0x7f28ec19ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37078/0 (socket says 172.21.15.81:37078) 2024-09-12T01:27:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f13f9640 1 -- 172.21.15.81:0/1021585957 learned_addr learned my addr 172.21.15.81:0/1021585957 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f13f9640 1 -- 172.21.15.81:0/1021585957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28ec101de0 msgr2=0x7f28ec19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f1bfa640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28ec101de0 0x7f28ec19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f23fb640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28ec106f10 0x7f28ec19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f13f9640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28ec101de0 0x7f28ec19a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f13f9640 1 -- 172.21.15.81:0/1021585957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28ec106f10 msgr2=0x7f28ec19f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f13f9640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28ec106f10 0x7f28ec19f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f13f9640 1 -- 172.21.15.81:0/1021585957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec19f700 con 0x7f28ec102790 2024-09-12T01:27:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f1bfa640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28ec101de0 0x7f28ec19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f13f9640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec102790 0x7f28ec19ac90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f28e000b4a0 tx=0x7f28e000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28eaffd640 1 -- 172.21.15.81:0/1021585957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e0014070 con 0x7f28ec102790 2024-09-12T01:27:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f3e5e640 1 -- 172.21.15.81:0/1021585957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ec19f9f0 con 0x7f28ec102790 2024-09-12T01:27:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28eaffd640 1 -- 172.21.15.81:0/1021585957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28e0010af0 con 0x7f28ec102790 2024-09-12T01:27:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28eaffd640 1 -- 172.21.15.81:0/1021585957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e0017d10 con 0x7f28ec102790 2024-09-12T01:27:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.200+0000 7f28f3e5e640 1 -- 172.21.15.81:0/1021585957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ec1a72d0 con 0x7f28ec102790 2024-09-12T01:27:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.201+0000 7f28f3e5e640 1 -- 172.21.15.81:0/1021585957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28ec1021c0 con 0x7f28ec102790 2024-09-12T01:27:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.203+0000 7f28eaffd640 1 -- 172.21.15.81:0/1021585957 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f28e0017070 con 0x7f28ec102790 2024-09-12T01:27:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.203+0000 7f28eaffd640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f28d40a2c10 0x7f28d40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.203+0000 7f28f1bfa640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f28d40a2c10 0x7f28d40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.203+0000 7f28eaffd640 1 -- 172.21.15.81:0/1021585957 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f28e00ce920 con 0x7f28ec102790 2024-09-12T01:27:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.204+0000 7f28f1bfa640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f28d40a2c10 0x7f28d40a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009ca0 tx=0x7f28e4000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.206+0000 7f28eaffd640 1 -- 172.21.15.81:0/1021585957 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f28e009b7e0 con 0x7f28ec102790 2024-09-12T01:27:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.388+0000 7f28f3e5e640 1 -- 172.21.15.81:0/1021585957 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28ec0feca0 con 0x7f28d40a2c10 2024-09-12T01:27:17.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.395+0000 7f28eaffd640 1 -- 172.21.15.81:0/1021585957 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258761 (secure 0 0 0) 0x7f28ec0feca0 con 0x7f28d40a2c10 2024-09-12T01:27:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:17.399 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T01:27:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.399+0000 7f28f3e5e640 1 -- 172.21.15.81:0/1021585957 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f28d40a2c10 msgr2=0x7f28d40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.399+0000 7f28f3e5e640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f28d40a2c10 0x7f28d40a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009ca0 tx=0x7f28e4000f40 comp rx=0 tx=0).stop 2024-09-12T01:27:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.399+0000 7f28f3e5e640 1 -- 172.21.15.81:0/1021585957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec102790 msgr2=0x7f28ec19ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.399+0000 7f28f3e5e640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec102790 0x7f28ec19ac90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f28e000b4a0 tx=0x7f28e000b960 comp rx=0 tx=0).stop 2024-09-12T01:27:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.399+0000 7f28f3e5e640 1 -- 172.21.15.81:0/1021585957 shutdown_connections 2024-09-12T01:27:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.399+0000 7f28f3e5e640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f28d40a2c10 0x7f28d40a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.399+0000 7f28f3e5e640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28ec106f10 0x7f28ec19f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.399+0000 7f28f3e5e640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ec102790 0x7f28ec19ac90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.399+0000 7f28f3e5e640 1 --2- 172.21.15.81:0/1021585957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28ec101de0 0x7f28ec19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.399+0000 7f28f3e5e640 1 -- 172.21.15.81:0/1021585957 >> 172.21.15.81:0/1021585957 conn(0x7f28ec0fd880 msgr2=0x7f28ec0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.399+0000 7f28f3e5e640 1 -- 172.21.15.81:0/1021585957 shutdown_connections 2024-09-12T01:27:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:17.399+0000 7f28f3e5e640 1 -- 172.21.15.81:0/1021585957 wait complete. 2024-09-12T01:27:17.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:17 smithi081 ceph-mon[30920]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T01:27:17.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:17 smithi100 ceph-mon[35275]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T01:27:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:17 smithi189 ceph-mon[35357]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T01:27:18.111 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-12T01:27:16.440459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657181,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":670,"num_read_kb":461,"num_write":424,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180758,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":346,"ondisk_log_size":346,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378640,"kb_used_data":12732,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124563184,"statfs":{"total":1151940427776,"available":1151552700416,"internally_reserved":0,"allocated":13037568,"data_stored":7194567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":69,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002882"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260973+0000","last_change":"2024-09-12T01:26:14.433907+0000","last_active":"2024-09-12T01:26:26.260973+0000","last_peered":"2024-09-12T01:26:26.260973+0000","last_clean":"2024-09-12T01:26:26.260973+0000","last_became_active":"2024-09-12T01:26:14.433495+0000","last_became_peered":"2024-09-12T01:26:14.433495+0000","last_unstale":"2024-09-12T01:26:26.260973+0000","last_undegraded":"2024-09-12T01:26:26.260973+0000","last_fullsized":"2024-09-12T01:26:26.260973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:12.836491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264454+0000","last_change":"2024-09-12T01:26:14.430873+0000","last_active":"2024-09-12T01:26:26.264454+0000","last_peered":"2024-09-12T01:26:26.264454+0000","last_clean":"2024-09-12T01:26:26.264454+0000","last_became_active":"2024-09-12T01:26:14.430572+0000","last_became_peered":"2024-09-12T01:26:14.430572+0000","last_unstale":"2024-09-12T01:26:26.264454+0000","last_undegraded":"2024-09-12T01:26:26.264454+0000","last_fullsized":"2024-09-12T01:26:26.264454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:15.160712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264571+0000","last_change":"2024-09-12T01:26:14.426117+0000","last_active":"2024-09-12T01:26:26.264571+0000","last_peered":"2024-09-12T01:26:26.264571+0000","last_clean":"2024-09-12T01:26:26.264571+0000","last_became_active":"2024-09-12T01:26:14.425831+0000","last_became_peered":"2024-09-12T01:26:14.425831+0000","last_unstale":"2024-09-12T01:26:26.264571+0000","last_undegraded":"2024-09-12T01:26:26.264571+0000","last_fullsized":"2024-09-12T01:26:26.264571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:15.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262656+0000","last_change":"2024-09-12T01:26:14.434545+0000","last_active":"2024-09-12T01:26:26.262656+0000","last_peered":"2024-09-12T01:26:26.262656+0000","last_clean":"2024-09-12T01:26:26.262656+0000","last_became_active":"2024-09-12T01:26:14.434222+0000","last_became_peered":"2024-09-12T01:26:14.434222+0000","last_unstale":"2024-09-12T01:26:26.262656+0000","last_undegraded":"2024-09-12T01:26:26.262656+0000","last_fullsized":"2024-09-12T01:26:26.262656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:36.789145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263142+0000","last_change":"2024-09-12T01:26:14.421900+0000","last_active":"2024-09-12T01:26:26.263142+0000","last_peered":"2024-09-12T01:26:26.263142+0000","last_clean":"2024-09-12T01:26:26.263142+0000","last_became_active":"2024-09-12T01:26:14.421558+0000","last_became_peered":"2024-09-12T01:26:14.421558+0000","last_unstale":"2024-09-12T01:26:26.263142+0000","last_undegraded":"2024-09-12T01:26:26.263142+0000","last_fullsized":"2024-09-12T01:26:26.263142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262080+0000","last_change":"2024-09-12T01:26:14.436641+0000","last_active":"2024-09-12T01:26:26.262080+0000","last_peered":"2024-09-12T01:26:26.262080+0000","last_clean":"2024-09-12T01:26:26.262080+0000","last_became_active":"2024-09-12T01:26:14.436347+0000","last_became_peered":"2024-09-12T01:26:14.436347+0000","last_unstale":"2024-09-12T01:26:26.262080+0000","last_undegraded":"2024-09-12T01:26:26.262080+0000","last_fullsized":"2024-09-12T01:26:26.262080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:52.756035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267385+0000","last_change":"2024-09-12T01:26:14.438676+0000","last_active":"2024-09-12T01:26:26.267385+0000","last_peered":"2024-09-12T01:26:26.267385+0000","last_clean":"2024-09-12T01:26:26.267385+0000","last_became_active":"2024-09-12T01:26:14.438332+0000","last_became_peered":"2024-09-12T01:26:14.438332+0000","last_unstale":"2024-09-12T01:26:26.267385+0000","last_undegraded":"2024-09-12T01:26:26.267385+0000","last_fullsized":"2024-09-12T01:26:26.267385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:06.459830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268827+0000","last_change":"2024-09-12T01:26:14.431676+0000","last_active":"2024-09-12T01:26:26.268827+0000","last_peered":"2024-09-12T01:26:26.268827+0000","last_clean":"2024-09-12T01:26:26.268827+0000","last_became_active":"2024-09-12T01:26:14.431378+0000","last_became_peered":"2024-09-12T01:26:14.431378+0000","last_unstale":"2024-09-12T01:26:26.268827+0000","last_undegraded":"2024-09-12T01:26:26.268827+0000","last_fullsized":"2024-09-12T01:26:26.268827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:23.523350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281590+0000","last_change":"2024-09-12T01:26:14.428381+0000","last_active":"2024-09-12T01:26:26.281590+0000","last_peered":"2024-09-12T01:26:26.281590+0000","last_clean":"2024-09-12T01:26:26.281590+0000","last_became_active":"2024-09-12T01:26:14.428031+0000","last_became_peered":"2024-09-12T01:26:14.428031+0000","last_unstale":"2024-09-12T01:26:26.281590+0000","last_undegraded":"2024-09-12T01:26:26.281590+0000","last_fullsized":"2024-09-12T01:26:26.281590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:40.920911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263022+0000","last_change":"2024-09-12T01:26:14.438849+0000","last_active":"2024-09-12T01:26:26.263022+0000","last_peered":"2024-09-12T01:26:26.263022+0000","last_clean":"2024-09-12T01:26:26.263022+0000","last_became_active":"2024-09-12T01:26:14.438510+0000","last_became_peered":"2024-09-12T01:26:14.438510+0000","last_unstale":"2024-09-12T01:26:26.263022+0000","last_undegraded":"2024-09-12T01:26:26.263022+0000","last_fullsized":"2024-09-12T01:26:26.263022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:12.257292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267570+0000","last_change":"2024-09-12T01:26:14.436468+0000","last_active":"2024-09-12T01:26:26.267570+0000","last_peered":"2024-09-12T01:26:26.267570+0000","last_clean":"2024-09-12T01:26:26.267570+0000","last_became_active":"2024-09-12T01:26:14.436095+0000","last_became_peered":"2024-09-12T01:26:14.436095+0000","last_unstale":"2024-09-12T01:26:26.267570+0000","last_undegraded":"2024-09-12T01:26:26.267570+0000","last_fullsized":"2024-09-12T01:26:26.267570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:43.441358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262728+0000","last_change":"2024-09-12T01:26:14.431384+0000","last_active":"2024-09-12T01:26:26.262728+0000","last_peered":"2024-09-12T01:26:26.262728+0000","last_clean":"2024-09-12T01:26:26.262728+0000","last_became_active":"2024-09-12T01:26:14.431079+0000","last_became_peered":"2024-09-12T01:26:14.431079+0000","last_unstale":"2024-09-12T01:26:26.262728+0000","last_undegraded":"2024-09-12T01:26:26.262728+0000","last_fullsized":"2024-09-12T01:26:26.262728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.178038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259683+0000","last_change":"2024-09-12T01:26:14.430163+0000","last_active":"2024-09-12T01:26:26.259683+0000","last_peered":"2024-09-12T01:26:26.259683+0000","last_clean":"2024-09-12T01:26:26.259683+0000","last_became_active":"2024-09-12T01:26:14.429863+0000","last_became_peered":"2024-09-12T01:26:14.429863+0000","last_unstale":"2024-09-12T01:26:26.259683+0000","last_undegraded":"2024-09-12T01:26:26.259683+0000","last_fullsized":"2024-09-12T01:26:26.259683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:44.432677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264436+0000","last_change":"2024-09-12T01:26:14.427304+0000","last_active":"2024-09-12T01:26:26.264436+0000","last_peered":"2024-09-12T01:26:26.264436+0000","last_clean":"2024-09-12T01:26:26.264436+0000","last_became_active":"2024-09-12T01:26:14.427006+0000","last_became_peered":"2024-09-12T01:26:14.427006+0000","last_unstale":"2024-09-12T01:26:26.264436+0000","last_undegraded":"2024-09-12T01:26:26.264436+0000","last_fullsized":"2024-09-12T01:26:26.264436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.930959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264315+0000","last_change":"2024-09-12T01:26:14.431018+0000","last_active":"2024-09-12T01:26:26.264315+0000","last_peered":"2024-09-12T01:26:26.264315+0000","last_clean":"2024-09-12T01:26:26.264315+0000","last_became_active":"2024-09-12T01:26:14.429518+0000","last_became_peered":"2024-09-12T01:26:14.429518+0000","last_unstale":"2024-09-12T01:26:26.264315+0000","last_undegraded":"2024-09-12T01:26:26.264315+0000","last_fullsized":"2024-09-12T01:26:26.264315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.504814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281095+0000","last_change":"2024-09-12T01:26:14.430601+0000","last_active":"2024-09-12T01:26:26.281095+0000","last_peered":"2024-09-12T01:26:26.281095+0000","last_clean":"2024-09-12T01:26:26.281095+0000","last_became_active":"2024-09-12T01:26:14.430304+0000","last_became_peered":"2024-09-12T01:26:14.430304+0000","last_unstale":"2024-09-12T01:26:26.281095+0000","last_undegraded":"2024-09-12T01:26:26.281095+0000","last_fullsized":"2024-09-12T01:26:26.281095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.414767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.261070+0000","last_change":"2024-09-12T01:26:14.432934+0000","last_active":"2024-09-12T01:26:26.261070+0000","last_peered":"2024-09-12T01:26:26.261070+0000","last_clean":"2024-09-12T01:26:26.261070+0000","last_became_active":"2024-09-12T01:26:14.432417+0000","last_became_peered":"2024-09-12T01:26:14.432417+0000","last_unstale":"2024-09-12T01:26:26.261070+0000","last_undegraded":"2024-09-12T01:26:26.261070+0000","last_fullsized":"2024-09-12T01:26:26.261070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.964880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262645+0000","last_change":"2024-09-12T01:26:14.429956+0000","last_active":"2024-09-12T01:26:26.262645+0000","last_peered":"2024-09-12T01:26:26.262645+0000","last_clean":"2024-09-12T01:26:26.262645+0000","last_became_active":"2024-09-12T01:26:14.429610+0000","last_became_peered":"2024-09-12T01:26:14.429610+0000","last_unstale":"2024-09-12T01:26:26.262645+0000","last_undegraded":"2024-09-12T01:26:26.262645+0000","last_fullsized":"2024-09-12T01:26:26.262645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:51.453221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266186+0000","last_change":"2024-09-12T01:26:14.423624+0000","last_active":"2024-09-12T01:26:26.266186+0000","last_peered":"2024-09-12T01:26:26.266186+0000","last_clean":"2024-09-12T01:26:26.266186+0000","last_became_active":"2024-09-12T01:26:14.423314+0000","last_became_peered":"2024-09-12T01:26:14.423314+0000","last_unstale":"2024-09-12T01:26:26.266186+0000","last_undegraded":"2024-09-12T01:26:26.266186+0000","last_fullsized":"2024-09-12T01:26:26.266186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.414323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260452+0000","last_change":"2024-09-12T01:26:14.433548+0000","last_active":"2024-09-12T01:26:26.260452+0000","last_peered":"2024-09-12T01:26:26.260452+0000","last_clean":"2024-09-12T01:26:26.260452+0000","last_became_active":"2024-09-12T01:26:14.433223+0000","last_became_peered":"2024-09-12T01:26:14.433223+0000","last_unstale":"2024-09-12T01:26:26.260452+0000","last_undegraded":"2024-09-12T01:26:26.260452+0000","last_fullsized":"2024-09-12T01:26:26.260452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.247354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259705+0000","last_change":"2024-09-12T01:26:14.431715+0000","last_active":"2024-09-12T01:26:26.259705+0000","last_peered":"2024-09-12T01:26:26.259705+0000","last_clean":"2024-09-12T01:26:26.259705+0000","last_became_active":"2024-09-12T01:26:14.430839+0000","last_became_peered":"2024-09-12T01:26:14.430839+0000","last_unstale":"2024-09-12T01:26:26.259705+0000","last_undegraded":"2024-09-12T01:26:26.259705+0000","last_fullsized":"2024-09-12T01:26:26.259705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:04.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281598+0000","last_change":"2024-09-12T01:26:14.431385+0000","last_active":"2024-09-12T01:26:26.281598+0000","last_peered":"2024-09-12T01:26:26.281598+0000","last_clean":"2024-09-12T01:26:26.281598+0000","last_became_active":"2024-09-12T01:26:14.431046+0000","last_became_peered":"2024-09-12T01:26:14.431046+0000","last_unstale":"2024-09-12T01:26:26.281598+0000","last_undegraded":"2024-09-12T01:26:26.281598+0000","last_fullsized":"2024-09-12T01:26:26.281598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:42.495019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268877+0000","last_change":"2024-09-12T01:26:14.427737+0000","last_active":"2024-09-12T01:26:26.268877+0000","last_peered":"2024-09-12T01:26:26.268877+0000","last_clean":"2024-09-12T01:26:26.268877+0000","last_became_active":"2024-09-12T01:26:14.427409+0000","last_became_peered":"2024-09-12T01:26:14.427409+0000","last_unstale":"2024-09-12T01:26:26.268877+0000","last_undegraded":"2024-09-12T01:26:26.268877+0000","last_fullsized":"2024-09-12T01:26:26.268877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:02.632914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265224+0000","last_change":"2024-09-12T01:26:14.433426+0000","last_active":"2024-09-12T01:26:26.265224+0000","last_peered":"2024-09-12T01:26:26.265224+0000","last_clean":"2024-09-12T01:26:26.265224+0000","last_became_active":"2024-09-12T01:26:14.431918+0000","last_became_peered":"2024-09-12T01:26:14.431918+0000","last_unstale":"2024-09-12T01:26:26.265224+0000","last_undegraded":"2024-09-12T01:26:26.265224+0000","last_fullsized":"2024-09-12T01:26:26.265224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.946072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269048+0000","last_change":"2024-09-12T01:26:26.268358+0000","last_active":"2024-09-12T01:26:26.269048+0000","last_peered":"2024-09-12T01:26:26.269048+0000","last_clean":"2024-09-12T01:26:26.269048+0000","last_became_active":"2024-09-12T01:26:26.268005+0000","last_became_peered":"2024-09-12T01:26:26.268005+0000","last_unstale":"2024-09-12T01:26:26.269048+0000","last_undegraded":"2024-09-12T01:26:26.269048+0000","last_fullsized":"2024-09-12T01:26:26.269048+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:53.977249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266391+0000","last_change":"2024-09-12T01:26:14.434536+0000","last_active":"2024-09-12T01:26:26.266391+0000","last_peered":"2024-09-12T01:26:26.266391+0000","last_clean":"2024-09-12T01:26:26.266391+0000","last_became_active":"2024-09-12T01:26:14.434148+0000","last_became_peered":"2024-09-12T01:26:14.434148+0000","last_unstale":"2024-09-12T01:26:26.266391+0000","last_undegraded":"2024-09-12T01:26:26.266391+0000","last_fullsized":"2024-09-12T01:26:26.266391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:47.576827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260633+0000","last_change":"2024-09-12T01:26:14.428040+0000","last_active":"2024-09-12T01:26:26.260633+0000","last_peered":"2024-09-12T01:26:26.260633+0000","last_clean":"2024-09-12T01:26:26.260633+0000","last_became_active":"2024-09-12T01:26:14.427709+0000","last_became_peered":"2024-09-12T01:26:14.427709+0000","last_unstale":"2024-09-12T01:26:26.260633+0000","last_undegraded":"2024-09-12T01:26:26.260633+0000","last_fullsized":"2024-09-12T01:26:26.260633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.256097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265649+0000","last_change":"2024-09-12T01:26:26.265649+0000","last_active":"2024-09-12T01:26:26.265649+0000","last_peered":"2024-09-12T01:26:26.265649+0000","last_clean":"2024-09-12T01:26:26.265649+0000","last_became_active":"2024-09-12T01:26:26.265251+0000","last_became_peered":"2024-09-12T01:26:26.265251+0000","last_unstale":"2024-09-12T01:26:26.265649+0000","last_undegraded":"2024-09-12T01:26:26.265649+0000","last_fullsized":"2024-09-12T01:26:26.265649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:31.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264674+0000","last_change":"2024-09-12T01:26:14.427596+0000","last_active":"2024-09-12T01:26:26.264674+0000","last_peered":"2024-09-12T01:26:26.264674+0000","last_clean":"2024-09-12T01:26:26.264674+0000","last_became_active":"2024-09-12T01:26:14.427291+0000","last_became_peered":"2024-09-12T01:26:14.427291+0000","last_unstale":"2024-09-12T01:26:26.264674+0000","last_undegraded":"2024-09-12T01:26:26.264674+0000","last_fullsized":"2024-09-12T01:26:26.264674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:51.529835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265856+0000","last_change":"2024-09-12T01:26:14.424197+0000","last_active":"2024-09-12T01:26:26.265856+0000","last_peered":"2024-09-12T01:26:26.265856+0000","last_clean":"2024-09-12T01:26:26.265856+0000","last_became_active":"2024-09-12T01:26:14.423422+0000","last_became_peered":"2024-09-12T01:26:14.423422+0000","last_unstale":"2024-09-12T01:26:26.265856+0000","last_undegraded":"2024-09-12T01:26:26.265856+0000","last_fullsized":"2024-09-12T01:26:26.265856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.725623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265870+0000","last_change":"2024-09-12T01:26:14.428116+0000","last_active":"2024-09-12T01:26:26.265870+0000","last_peered":"2024-09-12T01:26:26.265870+0000","last_clean":"2024-09-12T01:26:26.265870+0000","last_became_active":"2024-09-12T01:26:14.427804+0000","last_became_peered":"2024-09-12T01:26:14.427804+0000","last_unstale":"2024-09-12T01:26:26.265870+0000","last_undegraded":"2024-09-12T01:26:26.265870+0000","last_fullsized":"2024-09-12T01:26:26.265870+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:02.271305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260460+0000","last_change":"2024-09-12T01:26:14.432659+0000","last_active":"2024-09-12T01:26:26.260460+0000","last_peered":"2024-09-12T01:26:26.260460+0000","last_clean":"2024-09-12T01:26:26.260460+0000","last_became_active":"2024-09-12T01:26:14.432331+0000","last_became_peered":"2024-09-12T01:26:14.432331+0000","last_unstale":"2024-09-12T01:26:26.260460+0000","last_undegraded":"2024-09-12T01:26:26.260460+0000","last_fullsized":"2024-09-12T01:26:26.260460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.868909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263975+0000","last_change":"2024-09-12T01:26:14.426167+0000","last_active":"2024-09-12T01:26:26.263975+0000","last_peered":"2024-09-12T01:26:26.263975+0000","last_clean":"2024-09-12T01:26:26.263975+0000","last_became_active":"2024-09-12T01:26:14.425847+0000","last_became_peered":"2024-09-12T01:26:14.425847+0000","last_unstale":"2024-09-12T01:26:26.263975+0000","last_undegraded":"2024-09-12T01:26:26.263975+0000","last_fullsized":"2024-09-12T01:26:26.263975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:39.481527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:14.331801+0000","last_change":"2024-09-12T01:26:12.421487+0000","last_active":"2024-09-12T01:27:14.331801+0000","last_peered":"2024-09-12T01:27:14.331801+0000","last_clean":"2024-09-12T01:27:14.331801+0000","last_became_active":"2024-09-12T01:26:12.421096+0000","last_became_peered":"2024-09-12T01:26:12.421096+0000","last_unstale":"2024-09-12T01:27:14.331801+0000","last_undegraded":"2024-09-12T01:27:14.331801+0000","last_fullsized":"2024-09-12T01:27:14.331801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:12.410280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.270310+0000","last_change":"2024-09-12T01:26:26.270310+0000","last_active":"2024-09-12T01:26:26.270310+0000","last_peered":"2024-09-12T01:26:26.270310+0000","last_clean":"2024-09-12T01:26:26.270310+0000","last_became_active":"2024-09-12T01:26:26.269917+0000","last_became_peered":"2024-09-12T01:26:26.269917+0000","last_unstale":"2024-09-12T01:26:26.270310+0000","last_undegraded":"2024-09-12T01:26:26.270310+0000","last_fullsized":"2024-09-12T01:26:26.270310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:29.549456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.287218+0000","last_change":"2024-09-12T01:26:26.287218+0000","last_active":"2024-09-12T01:26:26.287218+0000","last_peered":"2024-09-12T01:26:26.287218+0000","last_clean":"2024-09-12T01:26:26.287218+0000","last_became_active":"2024-09-12T01:26:26.282251+0000","last_became_peered":"2024-09-12T01:26:26.282251+0000","last_unstale":"2024-09-12T01:26:26.287218+0000","last_undegraded":"2024-09-12T01:26:26.287218+0000","last_fullsized":"2024-09-12T01:26:26.287218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:53.888064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259505+0000","last_change":"2024-09-12T01:26:12.416100+0000","last_active":"2024-09-12T01:26:26.259505+0000","last_peered":"2024-09-12T01:26:26.259505+0000","last_clean":"2024-09-12T01:26:26.259505+0000","last_became_active":"2024-09-12T01:26:12.415799+0000","last_became_peered":"2024-09-12T01:26:12.415799+0000","last_unstale":"2024-09-12T01:26:26.259505+0000","last_undegraded":"2024-09-12T01:26:26.259505+0000","last_fullsized":"2024-09-12T01:26:26.259505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:41.826537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268900+0000","last_change":"2024-09-12T01:26:14.424922+0000","last_active":"2024-09-12T01:26:26.268900+0000","last_peered":"2024-09-12T01:26:26.268900+0000","last_clean":"2024-09-12T01:26:26.268900+0000","last_became_active":"2024-09-12T01:26:14.424580+0000","last_became_peered":"2024-09-12T01:26:14.424580+0000","last_unstale":"2024-09-12T01:26:26.268900+0000","last_undegraded":"2024-09-12T01:26:26.268900+0000","last_fullsized":"2024-09-12T01:26:26.268900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:05.697287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265114+0000","last_change":"2024-09-12T01:26:12.419339+0000","last_active":"2024-09-12T01:26:26.265114+0000","last_peered":"2024-09-12T01:26:26.265114+0000","last_clean":"2024-09-12T01:26:26.265114+0000","last_became_active":"2024-09-12T01:26:12.418925+0000","last_became_peered":"2024-09-12T01:26:12.418925+0000","last_unstale":"2024-09-12T01:26:26.265114+0000","last_undegraded":"2024-09-12T01:26:26.265114+0000","last_fullsized":"2024-09-12T01:26:26.265114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.390691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262458+0000","last_change":"2024-09-12T01:26:14.426611+0000","last_active":"2024-09-12T01:26:26.262458+0000","last_peered":"2024-09-12T01:26:26.262458+0000","last_clean":"2024-09-12T01:26:26.262458+0000","last_became_active":"2024-09-12T01:26:14.426268+0000","last_became_peered":"2024-09-12T01:26:14.426268+0000","last_unstale":"2024-09-12T01:26:26.262458+0000","last_undegraded":"2024-09-12T01:26:26.262458+0000","last_fullsized":"2024-09-12T01:26:26.262458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:34.676841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":127,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:14.574263+0000","last_change":"2024-09-12T01:26:12.420302+0000","last_active":"2024-09-12T01:27:14.574263+0000","last_peered":"2024-09-12T01:27:14.574263+0000","last_clean":"2024-09-12T01:27:14.574263+0000","last_became_active":"2024-09-12T01:26:12.419943+0000","last_became_peered":"2024-09-12T01:26:12.419943+0000","last_unstale":"2024-09-12T01:27:14.574263+0000","last_undegraded":"2024-09-12T01:27:14.574263+0000","last_fullsized":"2024-09-12T01:27:14.574263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:30.704272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281551+0000","last_change":"2024-09-12T01:26:14.433112+0000","last_active":"2024-09-12T01:26:26.281551+0000","last_peered":"2024-09-12T01:26:26.281551+0000","last_clean":"2024-09-12T01:26:26.281551+0000","last_became_active":"2024-09-12T01:26:14.432803+0000","last_became_peered":"2024-09-12T01:26:14.432803+0000","last_unstale":"2024-09-12T01:26:26.281551+0000","last_undegraded":"2024-09-12T01:26:26.281551+0000","last_fullsized":"2024-09-12T01:26:26.281551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:33.670485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267615+0000","last_change":"2024-09-12T01:26:12.424854+0000","last_active":"2024-09-12T01:26:26.267615+0000","last_peered":"2024-09-12T01:26:26.267615+0000","last_clean":"2024-09-12T01:26:26.267615+0000","last_became_active":"2024-09-12T01:26:12.424476+0000","last_became_peered":"2024-09-12T01:26:12.424476+0000","last_unstale":"2024-09-12T01:26:26.267615+0000","last_undegraded":"2024-09-12T01:26:26.267615+0000","last_fullsized":"2024-09-12T01:26:26.267615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:03.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264526+0000","last_change":"2024-09-12T01:26:14.431580+0000","last_active":"2024-09-12T01:26:26.264526+0000","last_peered":"2024-09-12T01:26:26.264526+0000","last_clean":"2024-09-12T01:26:26.264526+0000","last_became_active":"2024-09-12T01:26:14.431237+0000","last_became_peered":"2024-09-12T01:26:14.431237+0000","last_unstale":"2024-09-12T01:26:26.264526+0000","last_undegraded":"2024-09-12T01:26:26.264526+0000","last_fullsized":"2024-09-12T01:26:26.264526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:32.562156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263620+0000","last_change":"2024-09-12T01:26:12.802015+0000","last_active":"2024-09-12T01:26:26.263620+0000","last_peered":"2024-09-12T01:26:26.263620+0000","last_clean":"2024-09-12T01:26:26.263620+0000","last_became_active":"2024-09-12T01:26:12.801605+0000","last_became_peered":"2024-09-12T01:26:12.801605+0000","last_unstale":"2024-09-12T01:26:26.263620+0000","last_undegraded":"2024-09-12T01:26:26.263620+0000","last_fullsized":"2024-09-12T01:26:26.263620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:24.703911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281250+0000","last_change":"2024-09-12T01:26:14.433305+0000","last_active":"2024-09-12T01:26:26.281250+0000","last_peered":"2024-09-12T01:26:26.281250+0000","last_clean":"2024-09-12T01:26:26.281250+0000","last_became_active":"2024-09-12T01:26:14.432989+0000","last_became_peered":"2024-09-12T01:26:14.432989+0000","last_unstale":"2024-09-12T01:26:26.281250+0000","last_undegraded":"2024-09-12T01:26:26.281250+0000","last_fullsized":"2024-09-12T01:26:26.281250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:45.741460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":164,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:15.332518+0000","last_change":"2024-09-12T01:26:12.423148+0000","last_active":"2024-09-12T01:27:15.332518+0000","last_peered":"2024-09-12T01:27:15.332518+0000","last_clean":"2024-09-12T01:27:15.332518+0000","last_became_active":"2024-09-12T01:26:12.422754+0000","last_became_peered":"2024-09-12T01:26:12.422754+0000","last_unstale":"2024-09-12T01:27:15.332518+0000","last_undegraded":"2024-09-12T01:27:15.332518+0000","last_fullsized":"2024-09-12T01:27:15.332518+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:01.017125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":112,"num_read_kb":114,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264153+0000","last_change":"2024-09-12T01:26:14.431568+0000","last_active":"2024-09-12T01:26:26.264153+0000","last_peered":"2024-09-12T01:26:26.264153+0000","last_clean":"2024-09-12T01:26:26.264153+0000","last_became_active":"2024-09-12T01:26:14.431215+0000","last_became_peered":"2024-09-12T01:26:14.431215+0000","last_unstale":"2024-09-12T01:26:26.264153+0000","last_undegraded":"2024-09-12T01:26:26.264153+0000","last_fullsized":"2024-09-12T01:26:26.264153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.552147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266274+0000","last_change":"2024-09-12T01:26:12.421986+0000","last_active":"2024-09-12T01:26:26.266274+0000","last_peered":"2024-09-12T01:26:26.266274+0000","last_clean":"2024-09-12T01:26:26.266274+0000","last_became_active":"2024-09-12T01:26:12.421391+0000","last_became_peered":"2024-09-12T01:26:12.421391+0000","last_unstale":"2024-09-12T01:26:26.266274+0000","last_undegraded":"2024-09-12T01:26:26.266274+0000","last_fullsized":"2024-09-12T01:26:26.266274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:20.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259524+0000","last_change":"2024-09-12T01:26:14.431435+0000","last_active":"2024-09-12T01:26:26.259524+0000","last_peered":"2024-09-12T01:26:26.259524+0000","last_clean":"2024-09-12T01:26:26.259524+0000","last_became_active":"2024-09-12T01:26:14.431143+0000","last_became_peered":"2024-09-12T01:26:14.431143+0000","last_unstale":"2024-09-12T01:26:26.259524+0000","last_undegraded":"2024-09-12T01:26:26.259524+0000","last_fullsized":"2024-09-12T01:26:26.259524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:58.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263497+0000","last_change":"2024-09-12T01:26:12.423972+0000","last_active":"2024-09-12T01:26:26.263497+0000","last_peered":"2024-09-12T01:26:26.263497+0000","last_clean":"2024-09-12T01:26:26.263497+0000","last_became_active":"2024-09-12T01:26:12.423594+0000","last_became_peered":"2024-09-12T01:26:12.423594+0000","last_unstale":"2024-09-12T01:26:26.263497+0000","last_undegraded":"2024-09-12T01:26:26.263497+0000","last_fullsized":"2024-09-12T01:26:26.263497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:37.783478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267451+0000","last_change":"2024-09-12T01:26:14.437207+0000","last_active":"2024-09-12T01:26:26.267451+0000","last_peered":"2024-09-12T01:26:26.267451+0000","last_clean":"2024-09-12T01:26:26.267451+0000","last_became_active":"2024-09-12T01:26:14.436940+0000","last_became_peered":"2024-09-12T01:26:14.436940+0000","last_unstale":"2024-09-12T01:26:26.267451+0000","last_undegraded":"2024-09-12T01:26:26.267451+0000","last_fullsized":"2024-09-12T01:26:26.267451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:34.454446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:10.326728+0000","last_change":"2024-09-12T01:26:12.420247+0000","last_active":"2024-09-12T01:27:10.326728+0000","last_peered":"2024-09-12T01:27:10.326728+0000","last_clean":"2024-09-12T01:27:10.326728+0000","last_became_active":"2024-09-12T01:26:12.419825+0000","last_became_peered":"2024-09-12T01:26:12.419825+0000","last_unstale":"2024-09-12T01:27:10.326728+0000","last_undegraded":"2024-09-12T01:27:10.326728+0000","last_fullsized":"2024-09-12T01:27:10.326728+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:26.746225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267074+0000","last_change":"2024-09-12T01:26:14.439019+0000","last_active":"2024-09-12T01:26:26.267074+0000","last_peered":"2024-09-12T01:26:26.267074+0000","last_clean":"2024-09-12T01:26:26.267074+0000","last_became_active":"2024-09-12T01:26:14.438714+0000","last_became_peered":"2024-09-12T01:26:14.438714+0000","last_unstale":"2024-09-12T01:26:26.267074+0000","last_undegraded":"2024-09-12T01:26:26.267074+0000","last_fullsized":"2024-09-12T01:26:26.267074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.321464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264576+0000","last_change":"2024-09-12T01:26:12.800529+0000","last_active":"2024-09-12T01:26:26.264576+0000","last_peered":"2024-09-12T01:26:26.264576+0000","last_clean":"2024-09-12T01:26:26.264576+0000","last_became_active":"2024-09-12T01:26:12.800104+0000","last_became_peered":"2024-09-12T01:26:12.800104+0000","last_unstale":"2024-09-12T01:26:26.264576+0000","last_undegraded":"2024-09-12T01:26:26.264576+0000","last_fullsized":"2024-09-12T01:26:26.264576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.624321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263032+0000","last_change":"2024-09-12T01:26:14.435283+0000","last_active":"2024-09-12T01:26:26.263032+0000","last_peered":"2024-09-12T01:26:26.263032+0000","last_clean":"2024-09-12T01:26:26.263032+0000","last_became_active":"2024-09-12T01:26:14.434414+0000","last_became_peered":"2024-09-12T01:26:14.434414+0000","last_unstale":"2024-09-12T01:26:26.263032+0000","last_undegraded":"2024-09-12T01:26:26.263032+0000","last_fullsized":"2024-09-12T01:26:26.263032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.959405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.273529+0000","last_change":"2024-09-12T01:26:26.273053+0000","last_active":"2024-09-12T01:26:26.273529+0000","last_peered":"2024-09-12T01:26:26.273529+0000","last_clean":"2024-09-12T01:26:26.273529+0000","last_became_active":"2024-09-12T01:26:26.267178+0000","last_became_peered":"2024-09-12T01:26:26.267178+0000","last_unstale":"2024-09-12T01:26:26.273529+0000","last_undegraded":"2024-09-12T01:26:26.273529+0000","last_fullsized":"2024-09-12T01:26:26.273529+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:08.138485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260636+0000","last_change":"2024-09-12T01:26:14.433527+0000","last_active":"2024-09-12T01:26:26.260636+0000","last_peered":"2024-09-12T01:26:26.260636+0000","last_clean":"2024-09-12T01:26:26.260636+0000","last_became_active":"2024-09-12T01:26:14.433204+0000","last_became_peered":"2024-09-12T01:26:14.433204+0000","last_unstale":"2024-09-12T01:26:26.260636+0000","last_undegraded":"2024-09-12T01:26:26.260636+0000","last_fullsized":"2024-09-12T01:26:26.260636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:26.883916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259798+0000","last_change":"2024-09-12T01:26:12.420795+0000","last_active":"2024-09-12T01:26:26.259798+0000","last_peered":"2024-09-12T01:26:26.259798+0000","last_clean":"2024-09-12T01:26:26.259798+0000","last_became_active":"2024-09-12T01:26:12.420409+0000","last_became_peered":"2024-09-12T01:26:12.420409+0000","last_unstale":"2024-09-12T01:26:26.259798+0000","last_undegraded":"2024-09-12T01:26:26.259798+0000","last_fullsized":"2024-09-12T01:26:26.259798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:36.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267797+0000","last_change":"2024-09-12T01:26:14.440994+0000","last_active":"2024-09-12T01:26:26.267797+0000","last_peered":"2024-09-12T01:26:26.267797+0000","last_clean":"2024-09-12T01:26:26.267797+0000","last_became_active":"2024-09-12T01:26:14.440602+0000","last_became_peered":"2024-09-12T01:26:14.440602+0000","last_unstale":"2024-09-12T01:26:26.267797+0000","last_undegraded":"2024-09-12T01:26:26.267797+0000","last_fullsized":"2024-09-12T01:26:26.267797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.998991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263740+0000","last_change":"2024-09-12T01:26:12.419448+0000","last_active":"2024-09-12T01:26:26.263740+0000","last_peered":"2024-09-12T01:26:26.263740+0000","last_clean":"2024-09-12T01:26:26.263740+0000","last_became_active":"2024-09-12T01:26:12.419000+0000","last_became_peered":"2024-09-12T01:26:12.419000+0000","last_unstale":"2024-09-12T01:26:26.263740+0000","last_undegraded":"2024-09-12T01:26:26.263740+0000","last_fullsized":"2024-09-12T01:26:26.263740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:37.818833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267551+0000","last_change":"2024-09-12T01:26:14.437818+0000","last_active":"2024-09-12T01:26:26.267551+0000","last_peered":"2024-09-12T01:26:26.267551+0000","last_clean":"2024-09-12T01:26:26.267551+0000","last_became_active":"2024-09-12T01:26:14.437497+0000","last_became_peered":"2024-09-12T01:26:14.437497+0000","last_unstale":"2024-09-12T01:26:26.267551+0000","last_undegraded":"2024-09-12T01:26:26.267551+0000","last_fullsized":"2024-09-12T01:26:26.267551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:57.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:13.573763+0000","last_change":"2024-09-12T01:26:12.855850+0000","last_active":"2024-09-12T01:27:13.573763+0000","last_peered":"2024-09-12T01:27:13.573763+0000","last_clean":"2024-09-12T01:27:13.573763+0000","last_became_active":"2024-09-12T01:26:12.855400+0000","last_became_peered":"2024-09-12T01:26:12.855400+0000","last_unstale":"2024-09-12T01:27:13.573763+0000","last_undegraded":"2024-09-12T01:27:13.573763+0000","last_fullsized":"2024-09-12T01:27:13.573763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:32.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267683+0000","last_change":"2024-09-12T01:26:14.435982+0000","last_active":"2024-09-12T01:26:26.267683+0000","last_peered":"2024-09-12T01:26:26.267683+0000","last_clean":"2024-09-12T01:26:26.267683+0000","last_became_active":"2024-09-12T01:26:14.435595+0000","last_became_peered":"2024-09-12T01:26:14.435595+0000","last_unstale":"2024-09-12T01:26:26.267683+0000","last_undegraded":"2024-09-12T01:26:26.267683+0000","last_fullsized":"2024-09-12T01:26:26.267683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:31.101890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":343,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267513+0000","last_change":"2024-09-12T01:25:04.588449+0000","last_active":"2024-09-12T01:26:26.267513+0000","last_peered":"2024-09-12T01:26:26.267513+0000","last_clean":"2024-09-12T01:26:26.267513+0000","last_became_active":"2024-09-12T01:25:04.587949+0000","last_became_peered":"2024-09-12T01:25:04.587949+0000","last_unstale":"2024-09-12T01:26:26.267513+0000","last_undegraded":"2024-09-12T01:26:26.267513+0000","last_fullsized":"2024-09-12T01:26:26.267513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_clean_scrub_stamp":"2024-09-12T01:21:41.345624+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:41.015289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.261927+0000","last_change":"2024-09-12T01:26:12.421379+0000","last_active":"2024-09-12T01:26:26.261927+0000","last_peered":"2024-09-12T01:26:26.261927+0000","last_clean":"2024-09-12T01:26:26.261927+0000","last_became_active":"2024-09-12T01:26:12.421059+0000","last_became_peered":"2024-09-12T01:26:12.421059+0000","last_unstale":"2024-09-12T01:26:26.261927+0000","last_undegraded":"2024-09-12T01:26:26.261927+0000","last_fullsized":"2024-09-12T01:26:26.261927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269101+0000","last_change":"2024-09-12T01:26:14.430510+0000","last_active":"2024-09-12T01:26:26.269101+0000","last_peered":"2024-09-12T01:26:26.269101+0000","last_clean":"2024-09-12T01:26:26.269101+0000","last_became_active":"2024-09-12T01:26:14.430232+0000","last_became_peered":"2024-09-12T01:26:14.430232+0000","last_unstale":"2024-09-12T01:26:26.269101+0000","last_undegraded":"2024-09-12T01:26:26.269101+0000","last_fullsized":"2024-09-12T01:26:26.269101+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:55.114616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267369+0000","last_change":"2024-09-12T01:26:12.420938+0000","last_active":"2024-09-12T01:26:26.267369+0000","last_peered":"2024-09-12T01:26:26.267369+0000","last_clean":"2024-09-12T01:26:26.267369+0000","last_became_active":"2024-09-12T01:26:12.420599+0000","last_became_peered":"2024-09-12T01:26:12.420599+0000","last_unstale":"2024-09-12T01:26:26.267369+0000","last_undegraded":"2024-09-12T01:26:26.267369+0000","last_fullsized":"2024-09-12T01:26:26.267369+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.593237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259495+0000","last_change":"2024-09-12T01:26:14.428684+0000","last_active":"2024-09-12T01:26:26.259495+0000","last_peered":"2024-09-12T01:26:26.259495+0000","last_clean":"2024-09-12T01:26:26.259495+0000","last_became_active":"2024-09-12T01:26:14.428380+0000","last_became_peered":"2024-09-12T01:26:14.428380+0000","last_unstale":"2024-09-12T01:26:26.259495+0000","last_undegraded":"2024-09-12T01:26:26.259495+0000","last_fullsized":"2024-09-12T01:26:26.259495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:21.542122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:14.331236+0000","last_change":"2024-09-12T01:26:12.800048+0000","last_active":"2024-09-12T01:27:14.331236+0000","last_peered":"2024-09-12T01:27:14.331236+0000","last_clean":"2024-09-12T01:27:14.331236+0000","last_became_active":"2024-09-12T01:26:12.799646+0000","last_became_peered":"2024-09-12T01:26:12.799646+0000","last_unstale":"2024-09-12T01:27:14.331236+0000","last_undegraded":"2024-09-12T01:27:14.331236+0000","last_fullsized":"2024-09-12T01:27:14.331236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:39.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268626+0000","last_change":"2024-09-12T01:26:26.268110+0000","last_active":"2024-09-12T01:26:26.268626+0000","last_peered":"2024-09-12T01:26:26.268626+0000","last_clean":"2024-09-12T01:26:26.268626+0000","last_became_active":"2024-09-12T01:26:26.267764+0000","last_became_peered":"2024-09-12T01:26:26.267764+0000","last_unstale":"2024-09-12T01:26:26.268626+0000","last_undegraded":"2024-09-12T01:26:26.268626+0000","last_fullsized":"2024-09-12T01:26:26.268626+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:37.009529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.547535+0000","last_change":"2024-09-12T01:26:12.424189+0000","last_active":"2024-09-12T01:27:09.547535+0000","last_peered":"2024-09-12T01:27:09.547535+0000","last_clean":"2024-09-12T01:27:09.547535+0000","last_became_active":"2024-09-12T01:26:12.423785+0000","last_became_peered":"2024-09-12T01:26:12.423785+0000","last_unstale":"2024-09-12T01:27:09.547535+0000","last_undegraded":"2024-09-12T01:27:09.547535+0000","last_fullsized":"2024-09-12T01:27:09.547535+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:20.069821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262256+0000","last_change":"2024-09-12T01:26:14.437874+0000","last_active":"2024-09-12T01:26:26.262256+0000","last_peered":"2024-09-12T01:26:26.262256+0000","last_clean":"2024-09-12T01:26:26.262256+0000","last_became_active":"2024-09-12T01:26:14.437578+0000","last_became_peered":"2024-09-12T01:26:14.437578+0000","last_unstale":"2024-09-12T01:26:26.262256+0000","last_undegraded":"2024-09-12T01:26:26.262256+0000","last_fullsized":"2024-09-12T01:26:26.262256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:55.817763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267861+0000","last_change":"2024-09-12T01:26:26.267861+0000","last_active":"2024-09-12T01:26:26.267861+0000","last_peered":"2024-09-12T01:26:26.267861+0000","last_clean":"2024-09-12T01:26:26.267861+0000","last_became_active":"2024-09-12T01:26:26.267244+0000","last_became_peered":"2024-09-12T01:26:26.267244+0000","last_unstale":"2024-09-12T01:26:26.267861+0000","last_undegraded":"2024-09-12T01:26:26.267861+0000","last_fullsized":"2024-09-12T01:26:26.267861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:50.623916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262312+0000","last_change":"2024-09-12T01:26:14.434708+0000","last_active":"2024-09-12T01:26:26.262312+0000","last_peered":"2024-09-12T01:26:26.262312+0000","last_clean":"2024-09-12T01:26:26.262312+0000","last_became_active":"2024-09-12T01:26:14.434420+0000","last_became_peered":"2024-09-12T01:26:14.434420+0000","last_unstale":"2024-09-12T01:26:26.262312+0000","last_undegraded":"2024-09-12T01:26:26.262312+0000","last_fullsized":"2024-09-12T01:26:26.262312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:58.626769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264703+0000","last_change":"2024-09-12T01:26:12.800678+0000","last_active":"2024-09-12T01:26:26.264703+0000","last_peered":"2024-09-12T01:26:26.264703+0000","last_clean":"2024-09-12T01:26:26.264703+0000","last_became_active":"2024-09-12T01:26:12.800063+0000","last_became_peered":"2024-09-12T01:26:12.800063+0000","last_unstale":"2024-09-12T01:26:26.264703+0000","last_undegraded":"2024-09-12T01:26:26.264703+0000","last_fullsized":"2024-09-12T01:26:26.264703+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:01.110686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259849+0000","last_change":"2024-09-12T01:26:14.425695+0000","last_active":"2024-09-12T01:26:26.259849+0000","last_peered":"2024-09-12T01:26:26.259849+0000","last_clean":"2024-09-12T01:26:26.259849+0000","last_became_active":"2024-09-12T01:26:14.425435+0000","last_became_peered":"2024-09-12T01:26:14.425435+0000","last_unstale":"2024-09-12T01:26:26.259849+0000","last_undegraded":"2024-09-12T01:26:26.259849+0000","last_fullsized":"2024-09-12T01:26:26.259849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:19.193669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:38.443226+0000","last_change":"2024-09-12T01:26:12.412743+0000","last_active":"2024-09-12T01:26:38.443226+0000","last_peered":"2024-09-12T01:26:38.443226+0000","last_clean":"2024-09-12T01:26:38.443226+0000","last_became_active":"2024-09-12T01:26:12.412376+0000","last_became_peered":"2024-09-12T01:26:12.412376+0000","last_unstale":"2024-09-12T01:26:38.443226+0000","last_undegraded":"2024-09-12T01:26:38.443226+0000","last_fullsized":"2024-09-12T01:26:38.443226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.542370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269530+0000","last_change":"2024-09-12T01:26:14.429727+0000","last_active":"2024-09-12T01:26:26.269530+0000","last_peered":"2024-09-12T01:26:26.269530+0000","last_clean":"2024-09-12T01:26:26.269530+0000","last_became_active":"2024-09-12T01:26:14.429385+0000","last_became_peered":"2024-09-12T01:26:14.429385+0000","last_unstale":"2024-09-12T01:26:26.269530+0000","last_undegraded":"2024-09-12T01:26:26.269530+0000","last_fullsized":"2024-09-12T01:26:26.269530+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:43.855786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262760+0000","last_change":"2024-09-12T01:26:12.855632+0000","last_active":"2024-09-12T01:26:26.262760+0000","last_peered":"2024-09-12T01:26:26.262760+0000","last_clean":"2024-09-12T01:26:26.262760+0000","last_became_active":"2024-09-12T01:26:12.855305+0000","last_became_peered":"2024-09-12T01:26:12.855305+0000","last_unstale":"2024-09-12T01:26:26.262760+0000","last_undegraded":"2024-09-12T01:26:26.262760+0000","last_fullsized":"2024-09-12T01:26:26.262760+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.893689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264587+0000","last_change":"2024-09-12T01:26:14.428498+0000","last_active":"2024-09-12T01:26:26.264587+0000","last_peered":"2024-09-12T01:26:26.264587+0000","last_clean":"2024-09-12T01:26:26.264587+0000","last_became_active":"2024-09-12T01:26:14.428022+0000","last_became_peered":"2024-09-12T01:26:14.428022+0000","last_unstale":"2024-09-12T01:26:26.264587+0000","last_undegraded":"2024-09-12T01:26:26.264587+0000","last_fullsized":"2024-09-12T01:26:26.264587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.325399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281204+0000","last_change":"2024-09-12T01:26:12.800038+0000","last_active":"2024-09-12T01:26:26.281204+0000","last_peered":"2024-09-12T01:26:26.281204+0000","last_clean":"2024-09-12T01:26:26.281204+0000","last_became_active":"2024-09-12T01:26:12.799717+0000","last_became_peered":"2024-09-12T01:26:12.799717+0000","last_unstale":"2024-09-12T01:26:26.281204+0000","last_undegraded":"2024-09-12T01:26:26.281204+0000","last_fullsized":"2024-09-12T01:26:26.281204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.362437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262988+0000","last_change":"2024-09-12T01:26:14.430518+0000","last_active":"2024-09-12T01:26:26.262988+0000","last_peered":"2024-09-12T01:26:26.262988+0000","last_clean":"2024-09-12T01:26:26.262988+0000","last_became_active":"2024-09-12T01:26:14.430158+0000","last_became_peered":"2024-09-12T01:26:14.430158+0000","last_unstale":"2024-09-12T01:26:26.262988+0000","last_undegraded":"2024-09-12T01:26:26.262988+0000","last_fullsized":"2024-09-12T01:26:26.262988+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:55.696101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268990+0000","last_change":"2024-09-12T01:26:12.418427+0000","last_active":"2024-09-12T01:26:26.268990+0000","last_peered":"2024-09-12T01:26:26.268990+0000","last_clean":"2024-09-12T01:26:26.268990+0000","last_became_active":"2024-09-12T01:26:12.418135+0000","last_became_peered":"2024-09-12T01:26:12.418135+0000","last_unstale":"2024-09-12T01:26:26.268990+0000","last_undegraded":"2024-09-12T01:26:26.268990+0000","last_fullsized":"2024-09-12T01:26:26.268990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:32.946485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260572+0000","last_change":"2024-09-12T01:26:14.425817+0000","last_active":"2024-09-12T01:26:26.260572+0000","last_peered":"2024-09-12T01:26:26.260572+0000","last_clean":"2024-09-12T01:26:26.260572+0000","last_became_active":"2024-09-12T01:26:14.425443+0000","last_became_peered":"2024-09-12T01:26:14.425443+0000","last_unstale":"2024-09-12T01:26:26.260572+0000","last_undegraded":"2024-09-12T01:26:26.260572+0000","last_fullsized":"2024-09-12T01:26:26.260572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266274+0000","last_change":"2024-09-12T01:26:12.422742+0000","last_active":"2024-09-12T01:26:26.266274+0000","last_peered":"2024-09-12T01:26:26.266274+0000","last_clean":"2024-09-12T01:26:26.266274+0000","last_became_active":"2024-09-12T01:26:12.421914+0000","last_became_peered":"2024-09-12T01:26:12.421914+0000","last_unstale":"2024-09-12T01:26:26.266274+0000","last_undegraded":"2024-09-12T01:26:26.266274+0000","last_fullsized":"2024-09-12T01:26:26.266274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:53.427112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269168+0000","last_change":"2024-09-12T01:26:14.430425+0000","last_active":"2024-09-12T01:26:26.269168+0000","last_peered":"2024-09-12T01:26:26.269168+0000","last_clean":"2024-09-12T01:26:26.269168+0000","last_became_active":"2024-09-12T01:26:14.430128+0000","last_became_peered":"2024-09-12T01:26:14.430128+0000","last_unstale":"2024-09-12T01:26:26.269168+0000","last_undegraded":"2024-09-12T01:26:26.269168+0000","last_fullsized":"2024-09-12T01:26:26.269168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:17.653908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263276+0000","last_change":"2024-09-12T01:26:12.421463+0000","last_active":"2024-09-12T01:26:26.263276+0000","last_peered":"2024-09-12T01:26:26.263276+0000","last_clean":"2024-09-12T01:26:26.263276+0000","last_became_active":"2024-09-12T01:26:12.421143+0000","last_became_peered":"2024-09-12T01:26:12.421143+0000","last_unstale":"2024-09-12T01:26:26.263276+0000","last_undegraded":"2024-09-12T01:26:26.263276+0000","last_fullsized":"2024-09-12T01:26:26.263276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:09.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267454+0000","last_change":"2024-09-12T01:26:14.428643+0000","last_active":"2024-09-12T01:26:26.267454+0000","last_peered":"2024-09-12T01:26:26.267454+0000","last_clean":"2024-09-12T01:26:26.267454+0000","last_became_active":"2024-09-12T01:26:14.428344+0000","last_became_peered":"2024-09-12T01:26:14.428344+0000","last_unstale":"2024-09-12T01:26:26.267454+0000","last_undegraded":"2024-09-12T01:26:26.267454+0000","last_fullsized":"2024-09-12T01:26:26.267454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:17.213238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263512+0000","last_change":"2024-09-12T01:26:14.435108+0000","last_active":"2024-09-12T01:26:26.263512+0000","last_peered":"2024-09-12T01:26:26.263512+0000","last_clean":"2024-09-12T01:26:26.263512+0000","last_became_active":"2024-09-12T01:26:14.434806+0000","last_became_peered":"2024-09-12T01:26:14.434806+0000","last_unstale":"2024-09-12T01:26:26.263512+0000","last_undegraded":"2024-09-12T01:26:26.263512+0000","last_fullsized":"2024-09-12T01:26:26.263512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:01.188981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264537+0000","last_change":"2024-09-12T01:26:12.419027+0000","last_active":"2024-09-12T01:26:26.264537+0000","last_peered":"2024-09-12T01:26:26.264537+0000","last_clean":"2024-09-12T01:26:26.264537+0000","last_became_active":"2024-09-12T01:26:12.418579+0000","last_became_peered":"2024-09-12T01:26:12.418579+0000","last_unstale":"2024-09-12T01:26:26.264537+0000","last_undegraded":"2024-09-12T01:26:26.264537+0000","last_fullsized":"2024-09-12T01:26:26.264537+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.119864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281245+0000","last_change":"2024-09-12T01:26:14.429532+0000","last_active":"2024-09-12T01:26:26.281245+0000","last_peered":"2024-09-12T01:26:26.281245+0000","last_clean":"2024-09-12T01:26:26.281245+0000","last_became_active":"2024-09-12T01:26:14.429134+0000","last_became_peered":"2024-09-12T01:26:14.429134+0000","last_unstale":"2024-09-12T01:26:26.281245+0000","last_undegraded":"2024-09-12T01:26:26.281245+0000","last_fullsized":"2024-09-12T01:26:26.281245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:47.403388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.488999+0000","last_change":"2024-09-12T01:26:26.279322+0000","last_active":"2024-09-12T01:26:26.488999+0000","last_peered":"2024-09-12T01:26:26.488999+0000","last_clean":"2024-09-12T01:26:26.488999+0000","last_became_active":"2024-09-12T01:26:26.268752+0000","last_became_peered":"2024-09-12T01:26:26.268752+0000","last_unstale":"2024-09-12T01:26:26.488999+0000","last_undegraded":"2024-09-12T01:26:26.488999+0000","last_fullsized":"2024-09-12T01:26:26.488999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.411144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264547+0000","last_change":"2024-09-12T01:26:14.430831+0000","last_active":"2024-09-12T01:26:26.264547+0000","last_peered":"2024-09-12T01:26:26.264547+0000","last_clean":"2024-09-12T01:26:26.264547+0000","last_became_active":"2024-09-12T01:26:14.430531+0000","last_became_peered":"2024-09-12T01:26:14.430531+0000","last_unstale":"2024-09-12T01:26:26.264547+0000","last_undegraded":"2024-09-12T01:26:26.264547+0000","last_fullsized":"2024-09-12T01:26:26.264547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:02.522283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269397+0000","last_change":"2024-09-12T01:26:12.799921+0000","last_active":"2024-09-12T01:26:26.269397+0000","last_peered":"2024-09-12T01:26:26.269397+0000","last_clean":"2024-09-12T01:26:26.269397+0000","last_became_active":"2024-09-12T01:26:12.799608+0000","last_became_peered":"2024-09-12T01:26:12.799608+0000","last_unstale":"2024-09-12T01:26:26.269397+0000","last_undegraded":"2024-09-12T01:26:26.269397+0000","last_fullsized":"2024-09-12T01:26:26.269397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:00.821261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269287+0000","last_change":"2024-09-12T01:26:14.430937+0000","last_active":"2024-09-12T01:26:26.269287+0000","last_peered":"2024-09-12T01:26:26.269287+0000","last_clean":"2024-09-12T01:26:26.269287+0000","last_became_active":"2024-09-12T01:26:14.430656+0000","last_became_peered":"2024-09-12T01:26:14.430656+0000","last_unstale":"2024-09-12T01:26:26.269287+0000","last_undegraded":"2024-09-12T01:26:26.269287+0000","last_fullsized":"2024-09-12T01:26:26.269287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.874150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.547064+0000","last_change":"2024-09-12T01:26:12.419000+0000","last_active":"2024-09-12T01:27:09.547064+0000","last_peered":"2024-09-12T01:27:09.547064+0000","last_clean":"2024-09-12T01:27:09.547064+0000","last_became_active":"2024-09-12T01:26:12.418736+0000","last_became_peered":"2024-09-12T01:26:12.418736+0000","last_unstale":"2024-09-12T01:27:09.547064+0000","last_undegraded":"2024-09-12T01:27:09.547064+0000","last_fullsized":"2024-09-12T01:27:09.547064+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:31.586983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66579,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":534,"num_read_kb":342,"num_write":241,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":199737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":905216,"data_stored":436466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36908,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708244,"statfs":{"total":95995035648,"available":95957241856,"internally_reserved":0,"allocated":1601536,"data_stored":1087630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":436374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201321,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":436730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462956,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1519616,"data_stored":1029272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":436091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855415,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1028557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":436345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":435916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":496988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":496768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":929792,"data_stored":437430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:27:18.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:27:18.371 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:18.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:18 smithi100 ceph-mon[35275]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:27:18.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:18 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:18.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:18 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:18.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:18 smithi189 ceph-mon[35357]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:27:18.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:18 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:18.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:18 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:18.819 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:18 smithi081 ceph-mon[30920]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:27:18.820 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:18 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:18.820 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:18 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.897+0000 7fc034351640 1 -- 172.21.15.81:0/2752496821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc02c103660 msgr2=0x7fc02c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.897+0000 7fc034351640 1 --2- 172.21.15.81:0/2752496821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc02c103660 0x7fc02c10bb50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009900 tx=0x7fc01c02a480 comp rx=0 tx=0).stop 2024-09-12T01:27:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.897+0000 7fc034351640 1 -- 172.21.15.81:0/2752496821 shutdown_connections 2024-09-12T01:27:18.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.897+0000 7fc034351640 1 --2- 172.21.15.81:0/2752496821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc02c10c170 0x7fc02c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.897+0000 7fc034351640 1 --2- 172.21.15.81:0/2752496821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc02c103660 0x7fc02c10bb50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.897+0000 7fc034351640 1 --2- 172.21.15.81:0/2752496821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c102d40 0x7fc02c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.897+0000 7fc034351640 1 -- 172.21.15.81:0/2752496821 >> 172.21.15.81:0/2752496821 conn(0x7fc02c0fc7a0 msgr2=0x7fc02c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.897+0000 7fc034351640 1 -- 172.21.15.81:0/2752496821 shutdown_connections 2024-09-12T01:27:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.897+0000 7fc034351640 1 -- 172.21.15.81:0/2752496821 wait complete. 2024-09-12T01:27:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.898+0000 7fc034351640 1 Processor -- start 2024-09-12T01:27:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.898+0000 7fc034351640 1 -- start start 2024-09-12T01:27:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.898+0000 7fc034351640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c102d40 0x7fc02c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.898+0000 7fc034351640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc02c103660 0x7fc02c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.898+0000 7fc034351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc02c10c170 0x7fc02c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.898+0000 7fc034351640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c111f70 con 0x7fc02c10c170 2024-09-12T01:27:18.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.898+0000 7fc034351640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c111df0 con 0x7fc02c102d40 2024-09-12T01:27:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.898+0000 7fc034351640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1120f0 con 0x7fc02c103660 2024-09-12T01:27:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.898+0000 7fc0328ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc02c10c170 0x7fc02c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.898+0000 7fc0328ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc02c10c170 0x7fc02c19ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37088/0 (socket says 172.21.15.81:37088) 2024-09-12T01:27:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.898+0000 7fc0328ee640 1 -- 172.21.15.81:0/2777277086 learned_addr learned my addr 172.21.15.81:0/2777277086 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.898+0000 7fc0318ec640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc02c103660 0x7fc02c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.898+0000 7fc0320ed640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c102d40 0x7fc02c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.899+0000 7fc0328ee640 1 -- 172.21.15.81:0/2777277086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc02c103660 msgr2=0x7fc02c198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.899+0000 7fc0328ee640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc02c103660 0x7fc02c198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.899+0000 7fc0328ee640 1 -- 172.21.15.81:0/2777277086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c102d40 msgr2=0x7fc02c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.899+0000 7fc0328ee640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c102d40 0x7fc02c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.899+0000 7fc0328ee640 1 -- 172.21.15.81:0/2777277086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c19d390 con 0x7fc02c10c170 2024-09-12T01:27:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.899+0000 7fc0328ee640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc02c10c170 0x7fc02c19ccb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc02400cce0 tx=0x7fc02400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:18.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.899+0000 7fc0237fe640 1 -- 172.21.15.81:0/2777277086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02400f450 con 0x7fc02c10c170 2024-09-12T01:27:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.899+0000 7fc0237fe640 1 -- 172.21.15.81:0/2777277086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc02400fad0 con 0x7fc02c10c170 2024-09-12T01:27:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.899+0000 7fc034351640 1 -- 172.21.15.81:0/2777277086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02c19d680 con 0x7fc02c10c170 2024-09-12T01:27:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.899+0000 7fc0237fe640 1 -- 172.21.15.81:0/2777277086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024018c10 con 0x7fc02c10c170 2024-09-12T01:27:18.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.899+0000 7fc034351640 1 -- 172.21.15.81:0/2777277086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02c1a4f60 con 0x7fc02c10c170 2024-09-12T01:27:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.900+0000 7fc034351640 1 -- 172.21.15.81:0/2777277086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc02c103120 con 0x7fc02c10c170 2024-09-12T01:27:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.901+0000 7fc0237fe640 1 -- 172.21.15.81:0/2777277086 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc02400f5f0 con 0x7fc02c10c170 2024-09-12T01:27:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.902+0000 7fc0237fe640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc0180a2c90 0x7fc0180a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.902+0000 7fc0320ed640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc0180a2c90 0x7fc0180a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.902+0000 7fc0237fe640 1 -- 172.21.15.81:0/2777277086 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc0240cf6c0 con 0x7fc02c10c170 2024-09-12T01:27:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.903+0000 7fc0320ed640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc0180a2c90 0x7fc0180a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc02800bbe0 tx=0x7fc02800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:18.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:18.906+0000 7fc0237fe640 1 -- 172.21.15.81:0/2777277086 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc024014030 con 0x7fc02c10c170 2024-09-12T01:27:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.069+0000 7fc034351640 1 -- 172.21.15.81:0/2777277086 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc02c062630 con 0x7fc0180a2c90 2024-09-12T01:27:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.075+0000 7fc0237fe640 1 -- 172.21.15.81:0/2777277086 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258761 (secure 0 0 0) 0x7fc02c062630 con 0x7fc0180a2c90 2024-09-12T01:27:19.078 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T01:27:19.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.078+0000 7fc034351640 1 -- 172.21.15.81:0/2777277086 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc0180a2c90 msgr2=0x7fc0180a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:19.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.078+0000 7fc034351640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc0180a2c90 0x7fc0180a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc02800bbe0 tx=0x7fc02800b390 comp rx=0 tx=0).stop 2024-09-12T01:27:19.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.078+0000 7fc034351640 1 -- 172.21.15.81:0/2777277086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc02c10c170 msgr2=0x7fc02c19ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:19.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.078+0000 7fc034351640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc02c10c170 0x7fc02c19ccb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc02400cce0 tx=0x7fc02400a620 comp rx=0 tx=0).stop 2024-09-12T01:27:19.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.078+0000 7fc034351640 1 -- 172.21.15.81:0/2777277086 shutdown_connections 2024-09-12T01:27:19.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.078+0000 7fc034351640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc0180a2c90 0x7fc0180a5150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:19.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.078+0000 7fc034351640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc02c10c170 0x7fc02c19ccb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:19.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.078+0000 7fc034351640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc02c103660 0x7fc02c198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:19.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.078+0000 7fc034351640 1 --2- 172.21.15.81:0/2777277086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c102d40 0x7fc02c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:19.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.078+0000 7fc034351640 1 -- 172.21.15.81:0/2777277086 >> 172.21.15.81:0/2777277086 conn(0x7fc02c0fc7a0 msgr2=0x7fc02c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:19.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.078+0000 7fc034351640 1 -- 172.21.15.81:0/2777277086 shutdown_connections 2024-09-12T01:27:19.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:19.078+0000 7fc034351640 1 -- 172.21.15.81:0/2777277086 wait complete. 2024-09-12T01:27:19.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:19 smithi081 ceph-mon[30920]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-12T01:27:19.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:27:19.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:27:19.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:19 smithi081 ceph-mon[30920]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:19.743 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-12T01:27:18.440912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657181,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":685,"num_read_kb":466,"num_write":424,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180758,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":346,"ondisk_log_size":346,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378640,"kb_used_data":12732,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124563184,"statfs":{"total":1151940427776,"available":1151552700416,"internally_reserved":0,"allocated":13037568,"data_stored":7194567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":54,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002964"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260973+0000","last_change":"2024-09-12T01:26:14.433907+0000","last_active":"2024-09-12T01:26:26.260973+0000","last_peered":"2024-09-12T01:26:26.260973+0000","last_clean":"2024-09-12T01:26:26.260973+0000","last_became_active":"2024-09-12T01:26:14.433495+0000","last_became_peered":"2024-09-12T01:26:14.433495+0000","last_unstale":"2024-09-12T01:26:26.260973+0000","last_undegraded":"2024-09-12T01:26:26.260973+0000","last_fullsized":"2024-09-12T01:26:26.260973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:12.836491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264454+0000","last_change":"2024-09-12T01:26:14.430873+0000","last_active":"2024-09-12T01:26:26.264454+0000","last_peered":"2024-09-12T01:26:26.264454+0000","last_clean":"2024-09-12T01:26:26.264454+0000","last_became_active":"2024-09-12T01:26:14.430572+0000","last_became_peered":"2024-09-12T01:26:14.430572+0000","last_unstale":"2024-09-12T01:26:26.264454+0000","last_undegraded":"2024-09-12T01:26:26.264454+0000","last_fullsized":"2024-09-12T01:26:26.264454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:15.160712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264571+0000","last_change":"2024-09-12T01:26:14.426117+0000","last_active":"2024-09-12T01:26:26.264571+0000","last_peered":"2024-09-12T01:26:26.264571+0000","last_clean":"2024-09-12T01:26:26.264571+0000","last_became_active":"2024-09-12T01:26:14.425831+0000","last_became_peered":"2024-09-12T01:26:14.425831+0000","last_unstale":"2024-09-12T01:26:26.264571+0000","last_undegraded":"2024-09-12T01:26:26.264571+0000","last_fullsized":"2024-09-12T01:26:26.264571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:15.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262656+0000","last_change":"2024-09-12T01:26:14.434545+0000","last_active":"2024-09-12T01:26:26.262656+0000","last_peered":"2024-09-12T01:26:26.262656+0000","last_clean":"2024-09-12T01:26:26.262656+0000","last_became_active":"2024-09-12T01:26:14.434222+0000","last_became_peered":"2024-09-12T01:26:14.434222+0000","last_unstale":"2024-09-12T01:26:26.262656+0000","last_undegraded":"2024-09-12T01:26:26.262656+0000","last_fullsized":"2024-09-12T01:26:26.262656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:36.789145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263142+0000","last_change":"2024-09-12T01:26:14.421900+0000","last_active":"2024-09-12T01:26:26.263142+0000","last_peered":"2024-09-12T01:26:26.263142+0000","last_clean":"2024-09-12T01:26:26.263142+0000","last_became_active":"2024-09-12T01:26:14.421558+0000","last_became_peered":"2024-09-12T01:26:14.421558+0000","last_unstale":"2024-09-12T01:26:26.263142+0000","last_undegraded":"2024-09-12T01:26:26.263142+0000","last_fullsized":"2024-09-12T01:26:26.263142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262080+0000","last_change":"2024-09-12T01:26:14.436641+0000","last_active":"2024-09-12T01:26:26.262080+0000","last_peered":"2024-09-12T01:26:26.262080+0000","last_clean":"2024-09-12T01:26:26.262080+0000","last_became_active":"2024-09-12T01:26:14.436347+0000","last_became_peered":"2024-09-12T01:26:14.436347+0000","last_unstale":"2024-09-12T01:26:26.262080+0000","last_undegraded":"2024-09-12T01:26:26.262080+0000","last_fullsized":"2024-09-12T01:26:26.262080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:52.756035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267385+0000","last_change":"2024-09-12T01:26:14.438676+0000","last_active":"2024-09-12T01:26:26.267385+0000","last_peered":"2024-09-12T01:26:26.267385+0000","last_clean":"2024-09-12T01:26:26.267385+0000","last_became_active":"2024-09-12T01:26:14.438332+0000","last_became_peered":"2024-09-12T01:26:14.438332+0000","last_unstale":"2024-09-12T01:26:26.267385+0000","last_undegraded":"2024-09-12T01:26:26.267385+0000","last_fullsized":"2024-09-12T01:26:26.267385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:06.459830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268827+0000","last_change":"2024-09-12T01:26:14.431676+0000","last_active":"2024-09-12T01:26:26.268827+0000","last_peered":"2024-09-12T01:26:26.268827+0000","last_clean":"2024-09-12T01:26:26.268827+0000","last_became_active":"2024-09-12T01:26:14.431378+0000","last_became_peered":"2024-09-12T01:26:14.431378+0000","last_unstale":"2024-09-12T01:26:26.268827+0000","last_undegraded":"2024-09-12T01:26:26.268827+0000","last_fullsized":"2024-09-12T01:26:26.268827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:23.523350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281590+0000","last_change":"2024-09-12T01:26:14.428381+0000","last_active":"2024-09-12T01:26:26.281590+0000","last_peered":"2024-09-12T01:26:26.281590+0000","last_clean":"2024-09-12T01:26:26.281590+0000","last_became_active":"2024-09-12T01:26:14.428031+0000","last_became_peered":"2024-09-12T01:26:14.428031+0000","last_unstale":"2024-09-12T01:26:26.281590+0000","last_undegraded":"2024-09-12T01:26:26.281590+0000","last_fullsized":"2024-09-12T01:26:26.281590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:40.920911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263022+0000","last_change":"2024-09-12T01:26:14.438849+0000","last_active":"2024-09-12T01:26:26.263022+0000","last_peered":"2024-09-12T01:26:26.263022+0000","last_clean":"2024-09-12T01:26:26.263022+0000","last_became_active":"2024-09-12T01:26:14.438510+0000","last_became_peered":"2024-09-12T01:26:14.438510+0000","last_unstale":"2024-09-12T01:26:26.263022+0000","last_undegraded":"2024-09-12T01:26:26.263022+0000","last_fullsized":"2024-09-12T01:26:26.263022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:12.257292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267570+0000","last_change":"2024-09-12T01:26:14.436468+0000","last_active":"2024-09-12T01:26:26.267570+0000","last_peered":"2024-09-12T01:26:26.267570+0000","last_clean":"2024-09-12T01:26:26.267570+0000","last_became_active":"2024-09-12T01:26:14.436095+0000","last_became_peered":"2024-09-12T01:26:14.436095+0000","last_unstale":"2024-09-12T01:26:26.267570+0000","last_undegraded":"2024-09-12T01:26:26.267570+0000","last_fullsized":"2024-09-12T01:26:26.267570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:43.441358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262728+0000","last_change":"2024-09-12T01:26:14.431384+0000","last_active":"2024-09-12T01:26:26.262728+0000","last_peered":"2024-09-12T01:26:26.262728+0000","last_clean":"2024-09-12T01:26:26.262728+0000","last_became_active":"2024-09-12T01:26:14.431079+0000","last_became_peered":"2024-09-12T01:26:14.431079+0000","last_unstale":"2024-09-12T01:26:26.262728+0000","last_undegraded":"2024-09-12T01:26:26.262728+0000","last_fullsized":"2024-09-12T01:26:26.262728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.178038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259683+0000","last_change":"2024-09-12T01:26:14.430163+0000","last_active":"2024-09-12T01:26:26.259683+0000","last_peered":"2024-09-12T01:26:26.259683+0000","last_clean":"2024-09-12T01:26:26.259683+0000","last_became_active":"2024-09-12T01:26:14.429863+0000","last_became_peered":"2024-09-12T01:26:14.429863+0000","last_unstale":"2024-09-12T01:26:26.259683+0000","last_undegraded":"2024-09-12T01:26:26.259683+0000","last_fullsized":"2024-09-12T01:26:26.259683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:44.432677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264436+0000","last_change":"2024-09-12T01:26:14.427304+0000","last_active":"2024-09-12T01:26:26.264436+0000","last_peered":"2024-09-12T01:26:26.264436+0000","last_clean":"2024-09-12T01:26:26.264436+0000","last_became_active":"2024-09-12T01:26:14.427006+0000","last_became_peered":"2024-09-12T01:26:14.427006+0000","last_unstale":"2024-09-12T01:26:26.264436+0000","last_undegraded":"2024-09-12T01:26:26.264436+0000","last_fullsized":"2024-09-12T01:26:26.264436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.930959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264315+0000","last_change":"2024-09-12T01:26:14.431018+0000","last_active":"2024-09-12T01:26:26.264315+0000","last_peered":"2024-09-12T01:26:26.264315+0000","last_clean":"2024-09-12T01:26:26.264315+0000","last_became_active":"2024-09-12T01:26:14.429518+0000","last_became_peered":"2024-09-12T01:26:14.429518+0000","last_unstale":"2024-09-12T01:26:26.264315+0000","last_undegraded":"2024-09-12T01:26:26.264315+0000","last_fullsized":"2024-09-12T01:26:26.264315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.504814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281095+0000","last_change":"2024-09-12T01:26:14.430601+0000","last_active":"2024-09-12T01:26:26.281095+0000","last_peered":"2024-09-12T01:26:26.281095+0000","last_clean":"2024-09-12T01:26:26.281095+0000","last_became_active":"2024-09-12T01:26:14.430304+0000","last_became_peered":"2024-09-12T01:26:14.430304+0000","last_unstale":"2024-09-12T01:26:26.281095+0000","last_undegraded":"2024-09-12T01:26:26.281095+0000","last_fullsized":"2024-09-12T01:26:26.281095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.414767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.261070+0000","last_change":"2024-09-12T01:26:14.432934+0000","last_active":"2024-09-12T01:26:26.261070+0000","last_peered":"2024-09-12T01:26:26.261070+0000","last_clean":"2024-09-12T01:26:26.261070+0000","last_became_active":"2024-09-12T01:26:14.432417+0000","last_became_peered":"2024-09-12T01:26:14.432417+0000","last_unstale":"2024-09-12T01:26:26.261070+0000","last_undegraded":"2024-09-12T01:26:26.261070+0000","last_fullsized":"2024-09-12T01:26:26.261070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.964880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262645+0000","last_change":"2024-09-12T01:26:14.429956+0000","last_active":"2024-09-12T01:26:26.262645+0000","last_peered":"2024-09-12T01:26:26.262645+0000","last_clean":"2024-09-12T01:26:26.262645+0000","last_became_active":"2024-09-12T01:26:14.429610+0000","last_became_peered":"2024-09-12T01:26:14.429610+0000","last_unstale":"2024-09-12T01:26:26.262645+0000","last_undegraded":"2024-09-12T01:26:26.262645+0000","last_fullsized":"2024-09-12T01:26:26.262645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:51.453221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266186+0000","last_change":"2024-09-12T01:26:14.423624+0000","last_active":"2024-09-12T01:26:26.266186+0000","last_peered":"2024-09-12T01:26:26.266186+0000","last_clean":"2024-09-12T01:26:26.266186+0000","last_became_active":"2024-09-12T01:26:14.423314+0000","last_became_peered":"2024-09-12T01:26:14.423314+0000","last_unstale":"2024-09-12T01:26:26.266186+0000","last_undegraded":"2024-09-12T01:26:26.266186+0000","last_fullsized":"2024-09-12T01:26:26.266186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.414323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260452+0000","last_change":"2024-09-12T01:26:14.433548+0000","last_active":"2024-09-12T01:26:26.260452+0000","last_peered":"2024-09-12T01:26:26.260452+0000","last_clean":"2024-09-12T01:26:26.260452+0000","last_became_active":"2024-09-12T01:26:14.433223+0000","last_became_peered":"2024-09-12T01:26:14.433223+0000","last_unstale":"2024-09-12T01:26:26.260452+0000","last_undegraded":"2024-09-12T01:26:26.260452+0000","last_fullsized":"2024-09-12T01:26:26.260452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.247354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259705+0000","last_change":"2024-09-12T01:26:14.431715+0000","last_active":"2024-09-12T01:26:26.259705+0000","last_peered":"2024-09-12T01:26:26.259705+0000","last_clean":"2024-09-12T01:26:26.259705+0000","last_became_active":"2024-09-12T01:26:14.430839+0000","last_became_peered":"2024-09-12T01:26:14.430839+0000","last_unstale":"2024-09-12T01:26:26.259705+0000","last_undegraded":"2024-09-12T01:26:26.259705+0000","last_fullsized":"2024-09-12T01:26:26.259705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:04.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281598+0000","last_change":"2024-09-12T01:26:14.431385+0000","last_active":"2024-09-12T01:26:26.281598+0000","last_peered":"2024-09-12T01:26:26.281598+0000","last_clean":"2024-09-12T01:26:26.281598+0000","last_became_active":"2024-09-12T01:26:14.431046+0000","last_became_peered":"2024-09-12T01:26:14.431046+0000","last_unstale":"2024-09-12T01:26:26.281598+0000","last_undegraded":"2024-09-12T01:26:26.281598+0000","last_fullsized":"2024-09-12T01:26:26.281598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:42.495019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268877+0000","last_change":"2024-09-12T01:26:14.427737+0000","last_active":"2024-09-12T01:26:26.268877+0000","last_peered":"2024-09-12T01:26:26.268877+0000","last_clean":"2024-09-12T01:26:26.268877+0000","last_became_active":"2024-09-12T01:26:14.427409+0000","last_became_peered":"2024-09-12T01:26:14.427409+0000","last_unstale":"2024-09-12T01:26:26.268877+0000","last_undegraded":"2024-09-12T01:26:26.268877+0000","last_fullsized":"2024-09-12T01:26:26.268877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:02.632914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265224+0000","last_change":"2024-09-12T01:26:14.433426+0000","last_active":"2024-09-12T01:26:26.265224+0000","last_peered":"2024-09-12T01:26:26.265224+0000","last_clean":"2024-09-12T01:26:26.265224+0000","last_became_active":"2024-09-12T01:26:14.431918+0000","last_became_peered":"2024-09-12T01:26:14.431918+0000","last_unstale":"2024-09-12T01:26:26.265224+0000","last_undegraded":"2024-09-12T01:26:26.265224+0000","last_fullsized":"2024-09-12T01:26:26.265224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.946072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269048+0000","last_change":"2024-09-12T01:26:26.268358+0000","last_active":"2024-09-12T01:26:26.269048+0000","last_peered":"2024-09-12T01:26:26.269048+0000","last_clean":"2024-09-12T01:26:26.269048+0000","last_became_active":"2024-09-12T01:26:26.268005+0000","last_became_peered":"2024-09-12T01:26:26.268005+0000","last_unstale":"2024-09-12T01:26:26.269048+0000","last_undegraded":"2024-09-12T01:26:26.269048+0000","last_fullsized":"2024-09-12T01:26:26.269048+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:53.977249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266391+0000","last_change":"2024-09-12T01:26:14.434536+0000","last_active":"2024-09-12T01:26:26.266391+0000","last_peered":"2024-09-12T01:26:26.266391+0000","last_clean":"2024-09-12T01:26:26.266391+0000","last_became_active":"2024-09-12T01:26:14.434148+0000","last_became_peered":"2024-09-12T01:26:14.434148+0000","last_unstale":"2024-09-12T01:26:26.266391+0000","last_undegraded":"2024-09-12T01:26:26.266391+0000","last_fullsized":"2024-09-12T01:26:26.266391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:47.576827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260633+0000","last_change":"2024-09-12T01:26:14.428040+0000","last_active":"2024-09-12T01:26:26.260633+0000","last_peered":"2024-09-12T01:26:26.260633+0000","last_clean":"2024-09-12T01:26:26.260633+0000","last_became_active":"2024-09-12T01:26:14.427709+0000","last_became_peered":"2024-09-12T01:26:14.427709+0000","last_unstale":"2024-09-12T01:26:26.260633+0000","last_undegraded":"2024-09-12T01:26:26.260633+0000","last_fullsized":"2024-09-12T01:26:26.260633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.256097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265649+0000","last_change":"2024-09-12T01:26:26.265649+0000","last_active":"2024-09-12T01:26:26.265649+0000","last_peered":"2024-09-12T01:26:26.265649+0000","last_clean":"2024-09-12T01:26:26.265649+0000","last_became_active":"2024-09-12T01:26:26.265251+0000","last_became_peered":"2024-09-12T01:26:26.265251+0000","last_unstale":"2024-09-12T01:26:26.265649+0000","last_undegraded":"2024-09-12T01:26:26.265649+0000","last_fullsized":"2024-09-12T01:26:26.265649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:31.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264674+0000","last_change":"2024-09-12T01:26:14.427596+0000","last_active":"2024-09-12T01:26:26.264674+0000","last_peered":"2024-09-12T01:26:26.264674+0000","last_clean":"2024-09-12T01:26:26.264674+0000","last_became_active":"2024-09-12T01:26:14.427291+0000","last_became_peered":"2024-09-12T01:26:14.427291+0000","last_unstale":"2024-09-12T01:26:26.264674+0000","last_undegraded":"2024-09-12T01:26:26.264674+0000","last_fullsized":"2024-09-12T01:26:26.264674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:51.529835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265856+0000","last_change":"2024-09-12T01:26:14.424197+0000","last_active":"2024-09-12T01:26:26.265856+0000","last_peered":"2024-09-12T01:26:26.265856+0000","last_clean":"2024-09-12T01:26:26.265856+0000","last_became_active":"2024-09-12T01:26:14.423422+0000","last_became_peered":"2024-09-12T01:26:14.423422+0000","last_unstale":"2024-09-12T01:26:26.265856+0000","last_undegraded":"2024-09-12T01:26:26.265856+0000","last_fullsized":"2024-09-12T01:26:26.265856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.725623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265870+0000","last_change":"2024-09-12T01:26:14.428116+0000","last_active":"2024-09-12T01:26:26.265870+0000","last_peered":"2024-09-12T01:26:26.265870+0000","last_clean":"2024-09-12T01:26:26.265870+0000","last_became_active":"2024-09-12T01:26:14.427804+0000","last_became_peered":"2024-09-12T01:26:14.427804+0000","last_unstale":"2024-09-12T01:26:26.265870+0000","last_undegraded":"2024-09-12T01:26:26.265870+0000","last_fullsized":"2024-09-12T01:26:26.265870+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:02.271305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260460+0000","last_change":"2024-09-12T01:26:14.432659+0000","last_active":"2024-09-12T01:26:26.260460+0000","last_peered":"2024-09-12T01:26:26.260460+0000","last_clean":"2024-09-12T01:26:26.260460+0000","last_became_active":"2024-09-12T01:26:14.432331+0000","last_became_peered":"2024-09-12T01:26:14.432331+0000","last_unstale":"2024-09-12T01:26:26.260460+0000","last_undegraded":"2024-09-12T01:26:26.260460+0000","last_fullsized":"2024-09-12T01:26:26.260460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.868909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263975+0000","last_change":"2024-09-12T01:26:14.426167+0000","last_active":"2024-09-12T01:26:26.263975+0000","last_peered":"2024-09-12T01:26:26.263975+0000","last_clean":"2024-09-12T01:26:26.263975+0000","last_became_active":"2024-09-12T01:26:14.425847+0000","last_became_peered":"2024-09-12T01:26:14.425847+0000","last_unstale":"2024-09-12T01:26:26.263975+0000","last_undegraded":"2024-09-12T01:26:26.263975+0000","last_fullsized":"2024-09-12T01:26:26.263975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:39.481527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:14.331801+0000","last_change":"2024-09-12T01:26:12.421487+0000","last_active":"2024-09-12T01:27:14.331801+0000","last_peered":"2024-09-12T01:27:14.331801+0000","last_clean":"2024-09-12T01:27:14.331801+0000","last_became_active":"2024-09-12T01:26:12.421096+0000","last_became_peered":"2024-09-12T01:26:12.421096+0000","last_unstale":"2024-09-12T01:27:14.331801+0000","last_undegraded":"2024-09-12T01:27:14.331801+0000","last_fullsized":"2024-09-12T01:27:14.331801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:12.410280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.270310+0000","last_change":"2024-09-12T01:26:26.270310+0000","last_active":"2024-09-12T01:26:26.270310+0000","last_peered":"2024-09-12T01:26:26.270310+0000","last_clean":"2024-09-12T01:26:26.270310+0000","last_became_active":"2024-09-12T01:26:26.269917+0000","last_became_peered":"2024-09-12T01:26:26.269917+0000","last_unstale":"2024-09-12T01:26:26.270310+0000","last_undegraded":"2024-09-12T01:26:26.270310+0000","last_fullsized":"2024-09-12T01:26:26.270310+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:29.549456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.287218+0000","last_change":"2024-09-12T01:26:26.287218+0000","last_active":"2024-09-12T01:26:26.287218+0000","last_peered":"2024-09-12T01:26:26.287218+0000","last_clean":"2024-09-12T01:26:26.287218+0000","last_became_active":"2024-09-12T01:26:26.282251+0000","last_became_peered":"2024-09-12T01:26:26.282251+0000","last_unstale":"2024-09-12T01:26:26.287218+0000","last_undegraded":"2024-09-12T01:26:26.287218+0000","last_fullsized":"2024-09-12T01:26:26.287218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:53.888064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259505+0000","last_change":"2024-09-12T01:26:12.416100+0000","last_active":"2024-09-12T01:26:26.259505+0000","last_peered":"2024-09-12T01:26:26.259505+0000","last_clean":"2024-09-12T01:26:26.259505+0000","last_became_active":"2024-09-12T01:26:12.415799+0000","last_became_peered":"2024-09-12T01:26:12.415799+0000","last_unstale":"2024-09-12T01:26:26.259505+0000","last_undegraded":"2024-09-12T01:26:26.259505+0000","last_fullsized":"2024-09-12T01:26:26.259505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:41.826537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268900+0000","last_change":"2024-09-12T01:26:14.424922+0000","last_active":"2024-09-12T01:26:26.268900+0000","last_peered":"2024-09-12T01:26:26.268900+0000","last_clean":"2024-09-12T01:26:26.268900+0000","last_became_active":"2024-09-12T01:26:14.424580+0000","last_became_peered":"2024-09-12T01:26:14.424580+0000","last_unstale":"2024-09-12T01:26:26.268900+0000","last_undegraded":"2024-09-12T01:26:26.268900+0000","last_fullsized":"2024-09-12T01:26:26.268900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:05.697287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.265114+0000","last_change":"2024-09-12T01:26:12.419339+0000","last_active":"2024-09-12T01:26:26.265114+0000","last_peered":"2024-09-12T01:26:26.265114+0000","last_clean":"2024-09-12T01:26:26.265114+0000","last_became_active":"2024-09-12T01:26:12.418925+0000","last_became_peered":"2024-09-12T01:26:12.418925+0000","last_unstale":"2024-09-12T01:26:26.265114+0000","last_undegraded":"2024-09-12T01:26:26.265114+0000","last_fullsized":"2024-09-12T01:26:26.265114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.390691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262458+0000","last_change":"2024-09-12T01:26:14.426611+0000","last_active":"2024-09-12T01:26:26.262458+0000","last_peered":"2024-09-12T01:26:26.262458+0000","last_clean":"2024-09-12T01:26:26.262458+0000","last_became_active":"2024-09-12T01:26:14.426268+0000","last_became_peered":"2024-09-12T01:26:14.426268+0000","last_unstale":"2024-09-12T01:26:26.262458+0000","last_undegraded":"2024-09-12T01:26:26.262458+0000","last_fullsized":"2024-09-12T01:26:26.262458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:34.676841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":127,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:14.574263+0000","last_change":"2024-09-12T01:26:12.420302+0000","last_active":"2024-09-12T01:27:14.574263+0000","last_peered":"2024-09-12T01:27:14.574263+0000","last_clean":"2024-09-12T01:27:14.574263+0000","last_became_active":"2024-09-12T01:26:12.419943+0000","last_became_peered":"2024-09-12T01:26:12.419943+0000","last_unstale":"2024-09-12T01:27:14.574263+0000","last_undegraded":"2024-09-12T01:27:14.574263+0000","last_fullsized":"2024-09-12T01:27:14.574263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:30.704272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281551+0000","last_change":"2024-09-12T01:26:14.433112+0000","last_active":"2024-09-12T01:26:26.281551+0000","last_peered":"2024-09-12T01:26:26.281551+0000","last_clean":"2024-09-12T01:26:26.281551+0000","last_became_active":"2024-09-12T01:26:14.432803+0000","last_became_peered":"2024-09-12T01:26:14.432803+0000","last_unstale":"2024-09-12T01:26:26.281551+0000","last_undegraded":"2024-09-12T01:26:26.281551+0000","last_fullsized":"2024-09-12T01:26:26.281551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:33.670485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267615+0000","last_change":"2024-09-12T01:26:12.424854+0000","last_active":"2024-09-12T01:26:26.267615+0000","last_peered":"2024-09-12T01:26:26.267615+0000","last_clean":"2024-09-12T01:26:26.267615+0000","last_became_active":"2024-09-12T01:26:12.424476+0000","last_became_peered":"2024-09-12T01:26:12.424476+0000","last_unstale":"2024-09-12T01:26:26.267615+0000","last_undegraded":"2024-09-12T01:26:26.267615+0000","last_fullsized":"2024-09-12T01:26:26.267615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:03.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264526+0000","last_change":"2024-09-12T01:26:14.431580+0000","last_active":"2024-09-12T01:26:26.264526+0000","last_peered":"2024-09-12T01:26:26.264526+0000","last_clean":"2024-09-12T01:26:26.264526+0000","last_became_active":"2024-09-12T01:26:14.431237+0000","last_became_peered":"2024-09-12T01:26:14.431237+0000","last_unstale":"2024-09-12T01:26:26.264526+0000","last_undegraded":"2024-09-12T01:26:26.264526+0000","last_fullsized":"2024-09-12T01:26:26.264526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:32.562156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263620+0000","last_change":"2024-09-12T01:26:12.802015+0000","last_active":"2024-09-12T01:26:26.263620+0000","last_peered":"2024-09-12T01:26:26.263620+0000","last_clean":"2024-09-12T01:26:26.263620+0000","last_became_active":"2024-09-12T01:26:12.801605+0000","last_became_peered":"2024-09-12T01:26:12.801605+0000","last_unstale":"2024-09-12T01:26:26.263620+0000","last_undegraded":"2024-09-12T01:26:26.263620+0000","last_fullsized":"2024-09-12T01:26:26.263620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:24.703911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281250+0000","last_change":"2024-09-12T01:26:14.433305+0000","last_active":"2024-09-12T01:26:26.281250+0000","last_peered":"2024-09-12T01:26:26.281250+0000","last_clean":"2024-09-12T01:26:26.281250+0000","last_became_active":"2024-09-12T01:26:14.432989+0000","last_became_peered":"2024-09-12T01:26:14.432989+0000","last_unstale":"2024-09-12T01:26:26.281250+0000","last_undegraded":"2024-09-12T01:26:26.281250+0000","last_fullsized":"2024-09-12T01:26:26.281250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:45.741460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":164,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:15.332518+0000","last_change":"2024-09-12T01:26:12.423148+0000","last_active":"2024-09-12T01:27:15.332518+0000","last_peered":"2024-09-12T01:27:15.332518+0000","last_clean":"2024-09-12T01:27:15.332518+0000","last_became_active":"2024-09-12T01:26:12.422754+0000","last_became_peered":"2024-09-12T01:26:12.422754+0000","last_unstale":"2024-09-12T01:27:15.332518+0000","last_undegraded":"2024-09-12T01:27:15.332518+0000","last_fullsized":"2024-09-12T01:27:15.332518+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:01.017125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":112,"num_read_kb":114,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264153+0000","last_change":"2024-09-12T01:26:14.431568+0000","last_active":"2024-09-12T01:26:26.264153+0000","last_peered":"2024-09-12T01:26:26.264153+0000","last_clean":"2024-09-12T01:26:26.264153+0000","last_became_active":"2024-09-12T01:26:14.431215+0000","last_became_peered":"2024-09-12T01:26:14.431215+0000","last_unstale":"2024-09-12T01:26:26.264153+0000","last_undegraded":"2024-09-12T01:26:26.264153+0000","last_fullsized":"2024-09-12T01:26:26.264153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.552147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266274+0000","last_change":"2024-09-12T01:26:12.421986+0000","last_active":"2024-09-12T01:26:26.266274+0000","last_peered":"2024-09-12T01:26:26.266274+0000","last_clean":"2024-09-12T01:26:26.266274+0000","last_became_active":"2024-09-12T01:26:12.421391+0000","last_became_peered":"2024-09-12T01:26:12.421391+0000","last_unstale":"2024-09-12T01:26:26.266274+0000","last_undegraded":"2024-09-12T01:26:26.266274+0000","last_fullsized":"2024-09-12T01:26:26.266274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:20.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259524+0000","last_change":"2024-09-12T01:26:14.431435+0000","last_active":"2024-09-12T01:26:26.259524+0000","last_peered":"2024-09-12T01:26:26.259524+0000","last_clean":"2024-09-12T01:26:26.259524+0000","last_became_active":"2024-09-12T01:26:14.431143+0000","last_became_peered":"2024-09-12T01:26:14.431143+0000","last_unstale":"2024-09-12T01:26:26.259524+0000","last_undegraded":"2024-09-12T01:26:26.259524+0000","last_fullsized":"2024-09-12T01:26:26.259524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:58.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263497+0000","last_change":"2024-09-12T01:26:12.423972+0000","last_active":"2024-09-12T01:26:26.263497+0000","last_peered":"2024-09-12T01:26:26.263497+0000","last_clean":"2024-09-12T01:26:26.263497+0000","last_became_active":"2024-09-12T01:26:12.423594+0000","last_became_peered":"2024-09-12T01:26:12.423594+0000","last_unstale":"2024-09-12T01:26:26.263497+0000","last_undegraded":"2024-09-12T01:26:26.263497+0000","last_fullsized":"2024-09-12T01:26:26.263497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:37.783478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267451+0000","last_change":"2024-09-12T01:26:14.437207+0000","last_active":"2024-09-12T01:26:26.267451+0000","last_peered":"2024-09-12T01:26:26.267451+0000","last_clean":"2024-09-12T01:26:26.267451+0000","last_became_active":"2024-09-12T01:26:14.436940+0000","last_became_peered":"2024-09-12T01:26:14.436940+0000","last_unstale":"2024-09-12T01:26:26.267451+0000","last_undegraded":"2024-09-12T01:26:26.267451+0000","last_fullsized":"2024-09-12T01:26:26.267451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:34.454446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:15.333200+0000","last_change":"2024-09-12T01:26:12.420247+0000","last_active":"2024-09-12T01:27:15.333200+0000","last_peered":"2024-09-12T01:27:15.333200+0000","last_clean":"2024-09-12T01:27:15.333200+0000","last_became_active":"2024-09-12T01:26:12.419825+0000","last_became_peered":"2024-09-12T01:26:12.419825+0000","last_unstale":"2024-09-12T01:27:15.333200+0000","last_undegraded":"2024-09-12T01:27:15.333200+0000","last_fullsized":"2024-09-12T01:27:15.333200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:26.746225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267074+0000","last_change":"2024-09-12T01:26:14.439019+0000","last_active":"2024-09-12T01:26:26.267074+0000","last_peered":"2024-09-12T01:26:26.267074+0000","last_clean":"2024-09-12T01:26:26.267074+0000","last_became_active":"2024-09-12T01:26:14.438714+0000","last_became_peered":"2024-09-12T01:26:14.438714+0000","last_unstale":"2024-09-12T01:26:26.267074+0000","last_undegraded":"2024-09-12T01:26:26.267074+0000","last_fullsized":"2024-09-12T01:26:26.267074+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.321464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264576+0000","last_change":"2024-09-12T01:26:12.800529+0000","last_active":"2024-09-12T01:26:26.264576+0000","last_peered":"2024-09-12T01:26:26.264576+0000","last_clean":"2024-09-12T01:26:26.264576+0000","last_became_active":"2024-09-12T01:26:12.800104+0000","last_became_peered":"2024-09-12T01:26:12.800104+0000","last_unstale":"2024-09-12T01:26:26.264576+0000","last_undegraded":"2024-09-12T01:26:26.264576+0000","last_fullsized":"2024-09-12T01:26:26.264576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.624321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263032+0000","last_change":"2024-09-12T01:26:14.435283+0000","last_active":"2024-09-12T01:26:26.263032+0000","last_peered":"2024-09-12T01:26:26.263032+0000","last_clean":"2024-09-12T01:26:26.263032+0000","last_became_active":"2024-09-12T01:26:14.434414+0000","last_became_peered":"2024-09-12T01:26:14.434414+0000","last_unstale":"2024-09-12T01:26:26.263032+0000","last_undegraded":"2024-09-12T01:26:26.263032+0000","last_fullsized":"2024-09-12T01:26:26.263032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.959405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.273529+0000","last_change":"2024-09-12T01:26:26.273053+0000","last_active":"2024-09-12T01:26:26.273529+0000","last_peered":"2024-09-12T01:26:26.273529+0000","last_clean":"2024-09-12T01:26:26.273529+0000","last_became_active":"2024-09-12T01:26:26.267178+0000","last_became_peered":"2024-09-12T01:26:26.267178+0000","last_unstale":"2024-09-12T01:26:26.273529+0000","last_undegraded":"2024-09-12T01:26:26.273529+0000","last_fullsized":"2024-09-12T01:26:26.273529+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:08.138485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260636+0000","last_change":"2024-09-12T01:26:14.433527+0000","last_active":"2024-09-12T01:26:26.260636+0000","last_peered":"2024-09-12T01:26:26.260636+0000","last_clean":"2024-09-12T01:26:26.260636+0000","last_became_active":"2024-09-12T01:26:14.433204+0000","last_became_peered":"2024-09-12T01:26:14.433204+0000","last_unstale":"2024-09-12T01:26:26.260636+0000","last_undegraded":"2024-09-12T01:26:26.260636+0000","last_fullsized":"2024-09-12T01:26:26.260636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:26.883916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259798+0000","last_change":"2024-09-12T01:26:12.420795+0000","last_active":"2024-09-12T01:26:26.259798+0000","last_peered":"2024-09-12T01:26:26.259798+0000","last_clean":"2024-09-12T01:26:26.259798+0000","last_became_active":"2024-09-12T01:26:12.420409+0000","last_became_peered":"2024-09-12T01:26:12.420409+0000","last_unstale":"2024-09-12T01:26:26.259798+0000","last_undegraded":"2024-09-12T01:26:26.259798+0000","last_fullsized":"2024-09-12T01:26:26.259798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:36.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267797+0000","last_change":"2024-09-12T01:26:14.440994+0000","last_active":"2024-09-12T01:26:26.267797+0000","last_peered":"2024-09-12T01:26:26.267797+0000","last_clean":"2024-09-12T01:26:26.267797+0000","last_became_active":"2024-09-12T01:26:14.440602+0000","last_became_peered":"2024-09-12T01:26:14.440602+0000","last_unstale":"2024-09-12T01:26:26.267797+0000","last_undegraded":"2024-09-12T01:26:26.267797+0000","last_fullsized":"2024-09-12T01:26:26.267797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.998991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263740+0000","last_change":"2024-09-12T01:26:12.419448+0000","last_active":"2024-09-12T01:26:26.263740+0000","last_peered":"2024-09-12T01:26:26.263740+0000","last_clean":"2024-09-12T01:26:26.263740+0000","last_became_active":"2024-09-12T01:26:12.419000+0000","last_became_peered":"2024-09-12T01:26:12.419000+0000","last_unstale":"2024-09-12T01:26:26.263740+0000","last_undegraded":"2024-09-12T01:26:26.263740+0000","last_fullsized":"2024-09-12T01:26:26.263740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:37.818833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267551+0000","last_change":"2024-09-12T01:26:14.437818+0000","last_active":"2024-09-12T01:26:26.267551+0000","last_peered":"2024-09-12T01:26:26.267551+0000","last_clean":"2024-09-12T01:26:26.267551+0000","last_became_active":"2024-09-12T01:26:14.437497+0000","last_became_peered":"2024-09-12T01:26:14.437497+0000","last_unstale":"2024-09-12T01:26:26.267551+0000","last_undegraded":"2024-09-12T01:26:26.267551+0000","last_fullsized":"2024-09-12T01:26:26.267551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:57.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:13.573763+0000","last_change":"2024-09-12T01:26:12.855850+0000","last_active":"2024-09-12T01:27:13.573763+0000","last_peered":"2024-09-12T01:27:13.573763+0000","last_clean":"2024-09-12T01:27:13.573763+0000","last_became_active":"2024-09-12T01:26:12.855400+0000","last_became_peered":"2024-09-12T01:26:12.855400+0000","last_unstale":"2024-09-12T01:27:13.573763+0000","last_undegraded":"2024-09-12T01:27:13.573763+0000","last_fullsized":"2024-09-12T01:27:13.573763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:32.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267683+0000","last_change":"2024-09-12T01:26:14.435982+0000","last_active":"2024-09-12T01:26:26.267683+0000","last_peered":"2024-09-12T01:26:26.267683+0000","last_clean":"2024-09-12T01:26:26.267683+0000","last_became_active":"2024-09-12T01:26:14.435595+0000","last_became_peered":"2024-09-12T01:26:14.435595+0000","last_unstale":"2024-09-12T01:26:26.267683+0000","last_undegraded":"2024-09-12T01:26:26.267683+0000","last_fullsized":"2024-09-12T01:26:26.267683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:31.101890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":343,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267513+0000","last_change":"2024-09-12T01:25:04.588449+0000","last_active":"2024-09-12T01:26:26.267513+0000","last_peered":"2024-09-12T01:26:26.267513+0000","last_clean":"2024-09-12T01:26:26.267513+0000","last_became_active":"2024-09-12T01:25:04.587949+0000","last_became_peered":"2024-09-12T01:25:04.587949+0000","last_unstale":"2024-09-12T01:26:26.267513+0000","last_undegraded":"2024-09-12T01:26:26.267513+0000","last_fullsized":"2024-09-12T01:26:26.267513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_clean_scrub_stamp":"2024-09-12T01:21:41.345624+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:41.015289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.261927+0000","last_change":"2024-09-12T01:26:12.421379+0000","last_active":"2024-09-12T01:26:26.261927+0000","last_peered":"2024-09-12T01:26:26.261927+0000","last_clean":"2024-09-12T01:26:26.261927+0000","last_became_active":"2024-09-12T01:26:12.421059+0000","last_became_peered":"2024-09-12T01:26:12.421059+0000","last_unstale":"2024-09-12T01:26:26.261927+0000","last_undegraded":"2024-09-12T01:26:26.261927+0000","last_fullsized":"2024-09-12T01:26:26.261927+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269101+0000","last_change":"2024-09-12T01:26:14.430510+0000","last_active":"2024-09-12T01:26:26.269101+0000","last_peered":"2024-09-12T01:26:26.269101+0000","last_clean":"2024-09-12T01:26:26.269101+0000","last_became_active":"2024-09-12T01:26:14.430232+0000","last_became_peered":"2024-09-12T01:26:14.430232+0000","last_unstale":"2024-09-12T01:26:26.269101+0000","last_undegraded":"2024-09-12T01:26:26.269101+0000","last_fullsized":"2024-09-12T01:26:26.269101+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:55.114616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267369+0000","last_change":"2024-09-12T01:26:12.420938+0000","last_active":"2024-09-12T01:26:26.267369+0000","last_peered":"2024-09-12T01:26:26.267369+0000","last_clean":"2024-09-12T01:26:26.267369+0000","last_became_active":"2024-09-12T01:26:12.420599+0000","last_became_peered":"2024-09-12T01:26:12.420599+0000","last_unstale":"2024-09-12T01:26:26.267369+0000","last_undegraded":"2024-09-12T01:26:26.267369+0000","last_fullsized":"2024-09-12T01:26:26.267369+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.593237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259495+0000","last_change":"2024-09-12T01:26:14.428684+0000","last_active":"2024-09-12T01:26:26.259495+0000","last_peered":"2024-09-12T01:26:26.259495+0000","last_clean":"2024-09-12T01:26:26.259495+0000","last_became_active":"2024-09-12T01:26:14.428380+0000","last_became_peered":"2024-09-12T01:26:14.428380+0000","last_unstale":"2024-09-12T01:26:26.259495+0000","last_undegraded":"2024-09-12T01:26:26.259495+0000","last_fullsized":"2024-09-12T01:26:26.259495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:21.542122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:14.331236+0000","last_change":"2024-09-12T01:26:12.800048+0000","last_active":"2024-09-12T01:27:14.331236+0000","last_peered":"2024-09-12T01:27:14.331236+0000","last_clean":"2024-09-12T01:27:14.331236+0000","last_became_active":"2024-09-12T01:26:12.799646+0000","last_became_peered":"2024-09-12T01:26:12.799646+0000","last_unstale":"2024-09-12T01:27:14.331236+0000","last_undegraded":"2024-09-12T01:27:14.331236+0000","last_fullsized":"2024-09-12T01:27:14.331236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:39.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268626+0000","last_change":"2024-09-12T01:26:26.268110+0000","last_active":"2024-09-12T01:26:26.268626+0000","last_peered":"2024-09-12T01:26:26.268626+0000","last_clean":"2024-09-12T01:26:26.268626+0000","last_became_active":"2024-09-12T01:26:26.267764+0000","last_became_peered":"2024-09-12T01:26:26.267764+0000","last_unstale":"2024-09-12T01:26:26.268626+0000","last_undegraded":"2024-09-12T01:26:26.268626+0000","last_fullsized":"2024-09-12T01:26:26.268626+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:37.009529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:14.554043+0000","last_change":"2024-09-12T01:26:12.424189+0000","last_active":"2024-09-12T01:27:14.554043+0000","last_peered":"2024-09-12T01:27:14.554043+0000","last_clean":"2024-09-12T01:27:14.554043+0000","last_became_active":"2024-09-12T01:26:12.423785+0000","last_became_peered":"2024-09-12T01:26:12.423785+0000","last_unstale":"2024-09-12T01:27:14.554043+0000","last_undegraded":"2024-09-12T01:27:14.554043+0000","last_fullsized":"2024-09-12T01:27:14.554043+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:20.069821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262256+0000","last_change":"2024-09-12T01:26:14.437874+0000","last_active":"2024-09-12T01:26:26.262256+0000","last_peered":"2024-09-12T01:26:26.262256+0000","last_clean":"2024-09-12T01:26:26.262256+0000","last_became_active":"2024-09-12T01:26:14.437578+0000","last_became_peered":"2024-09-12T01:26:14.437578+0000","last_unstale":"2024-09-12T01:26:26.262256+0000","last_undegraded":"2024-09-12T01:26:26.262256+0000","last_fullsized":"2024-09-12T01:26:26.262256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:55.817763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267861+0000","last_change":"2024-09-12T01:26:26.267861+0000","last_active":"2024-09-12T01:26:26.267861+0000","last_peered":"2024-09-12T01:26:26.267861+0000","last_clean":"2024-09-12T01:26:26.267861+0000","last_became_active":"2024-09-12T01:26:26.267244+0000","last_became_peered":"2024-09-12T01:26:26.267244+0000","last_unstale":"2024-09-12T01:26:26.267861+0000","last_undegraded":"2024-09-12T01:26:26.267861+0000","last_fullsized":"2024-09-12T01:26:26.267861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:50.623916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262312+0000","last_change":"2024-09-12T01:26:14.434708+0000","last_active":"2024-09-12T01:26:26.262312+0000","last_peered":"2024-09-12T01:26:26.262312+0000","last_clean":"2024-09-12T01:26:26.262312+0000","last_became_active":"2024-09-12T01:26:14.434420+0000","last_became_peered":"2024-09-12T01:26:14.434420+0000","last_unstale":"2024-09-12T01:26:26.262312+0000","last_undegraded":"2024-09-12T01:26:26.262312+0000","last_fullsized":"2024-09-12T01:26:26.262312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:58.626769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264703+0000","last_change":"2024-09-12T01:26:12.800678+0000","last_active":"2024-09-12T01:26:26.264703+0000","last_peered":"2024-09-12T01:26:26.264703+0000","last_clean":"2024-09-12T01:26:26.264703+0000","last_became_active":"2024-09-12T01:26:12.800063+0000","last_became_peered":"2024-09-12T01:26:12.800063+0000","last_unstale":"2024-09-12T01:26:26.264703+0000","last_undegraded":"2024-09-12T01:26:26.264703+0000","last_fullsized":"2024-09-12T01:26:26.264703+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:01.110686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.259849+0000","last_change":"2024-09-12T01:26:14.425695+0000","last_active":"2024-09-12T01:26:26.259849+0000","last_peered":"2024-09-12T01:26:26.259849+0000","last_clean":"2024-09-12T01:26:26.259849+0000","last_became_active":"2024-09-12T01:26:14.425435+0000","last_became_peered":"2024-09-12T01:26:14.425435+0000","last_unstale":"2024-09-12T01:26:26.259849+0000","last_undegraded":"2024-09-12T01:26:26.259849+0000","last_fullsized":"2024-09-12T01:26:26.259849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:19.193669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:38.443226+0000","last_change":"2024-09-12T01:26:12.412743+0000","last_active":"2024-09-12T01:26:38.443226+0000","last_peered":"2024-09-12T01:26:38.443226+0000","last_clean":"2024-09-12T01:26:38.443226+0000","last_became_active":"2024-09-12T01:26:12.412376+0000","last_became_peered":"2024-09-12T01:26:12.412376+0000","last_unstale":"2024-09-12T01:26:38.443226+0000","last_undegraded":"2024-09-12T01:26:38.443226+0000","last_fullsized":"2024-09-12T01:26:38.443226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.542370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269530+0000","last_change":"2024-09-12T01:26:14.429727+0000","last_active":"2024-09-12T01:26:26.269530+0000","last_peered":"2024-09-12T01:26:26.269530+0000","last_clean":"2024-09-12T01:26:26.269530+0000","last_became_active":"2024-09-12T01:26:14.429385+0000","last_became_peered":"2024-09-12T01:26:14.429385+0000","last_unstale":"2024-09-12T01:26:26.269530+0000","last_undegraded":"2024-09-12T01:26:26.269530+0000","last_fullsized":"2024-09-12T01:26:26.269530+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:43.855786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262760+0000","last_change":"2024-09-12T01:26:12.855632+0000","last_active":"2024-09-12T01:26:26.262760+0000","last_peered":"2024-09-12T01:26:26.262760+0000","last_clean":"2024-09-12T01:26:26.262760+0000","last_became_active":"2024-09-12T01:26:12.855305+0000","last_became_peered":"2024-09-12T01:26:12.855305+0000","last_unstale":"2024-09-12T01:26:26.262760+0000","last_undegraded":"2024-09-12T01:26:26.262760+0000","last_fullsized":"2024-09-12T01:26:26.262760+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.893689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264587+0000","last_change":"2024-09-12T01:26:14.428498+0000","last_active":"2024-09-12T01:26:26.264587+0000","last_peered":"2024-09-12T01:26:26.264587+0000","last_clean":"2024-09-12T01:26:26.264587+0000","last_became_active":"2024-09-12T01:26:14.428022+0000","last_became_peered":"2024-09-12T01:26:14.428022+0000","last_unstale":"2024-09-12T01:26:26.264587+0000","last_undegraded":"2024-09-12T01:26:26.264587+0000","last_fullsized":"2024-09-12T01:26:26.264587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.325399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281204+0000","last_change":"2024-09-12T01:26:12.800038+0000","last_active":"2024-09-12T01:26:26.281204+0000","last_peered":"2024-09-12T01:26:26.281204+0000","last_clean":"2024-09-12T01:26:26.281204+0000","last_became_active":"2024-09-12T01:26:12.799717+0000","last_became_peered":"2024-09-12T01:26:12.799717+0000","last_unstale":"2024-09-12T01:26:26.281204+0000","last_undegraded":"2024-09-12T01:26:26.281204+0000","last_fullsized":"2024-09-12T01:26:26.281204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.362437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.262988+0000","last_change":"2024-09-12T01:26:14.430518+0000","last_active":"2024-09-12T01:26:26.262988+0000","last_peered":"2024-09-12T01:26:26.262988+0000","last_clean":"2024-09-12T01:26:26.262988+0000","last_became_active":"2024-09-12T01:26:14.430158+0000","last_became_peered":"2024-09-12T01:26:14.430158+0000","last_unstale":"2024-09-12T01:26:26.262988+0000","last_undegraded":"2024-09-12T01:26:26.262988+0000","last_fullsized":"2024-09-12T01:26:26.262988+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:55.696101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.268990+0000","last_change":"2024-09-12T01:26:12.418427+0000","last_active":"2024-09-12T01:26:26.268990+0000","last_peered":"2024-09-12T01:26:26.268990+0000","last_clean":"2024-09-12T01:26:26.268990+0000","last_became_active":"2024-09-12T01:26:12.418135+0000","last_became_peered":"2024-09-12T01:26:12.418135+0000","last_unstale":"2024-09-12T01:26:26.268990+0000","last_undegraded":"2024-09-12T01:26:26.268990+0000","last_fullsized":"2024-09-12T01:26:26.268990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:32.946485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.260572+0000","last_change":"2024-09-12T01:26:14.425817+0000","last_active":"2024-09-12T01:26:26.260572+0000","last_peered":"2024-09-12T01:26:26.260572+0000","last_clean":"2024-09-12T01:26:26.260572+0000","last_became_active":"2024-09-12T01:26:14.425443+0000","last_became_peered":"2024-09-12T01:26:14.425443+0000","last_unstale":"2024-09-12T01:26:26.260572+0000","last_undegraded":"2024-09-12T01:26:26.260572+0000","last_fullsized":"2024-09-12T01:26:26.260572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.266274+0000","last_change":"2024-09-12T01:26:12.422742+0000","last_active":"2024-09-12T01:26:26.266274+0000","last_peered":"2024-09-12T01:26:26.266274+0000","last_clean":"2024-09-12T01:26:26.266274+0000","last_became_active":"2024-09-12T01:26:12.421914+0000","last_became_peered":"2024-09-12T01:26:12.421914+0000","last_unstale":"2024-09-12T01:26:26.266274+0000","last_undegraded":"2024-09-12T01:26:26.266274+0000","last_fullsized":"2024-09-12T01:26:26.266274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:53.427112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269168+0000","last_change":"2024-09-12T01:26:14.430425+0000","last_active":"2024-09-12T01:26:26.269168+0000","last_peered":"2024-09-12T01:26:26.269168+0000","last_clean":"2024-09-12T01:26:26.269168+0000","last_became_active":"2024-09-12T01:26:14.430128+0000","last_became_peered":"2024-09-12T01:26:14.430128+0000","last_unstale":"2024-09-12T01:26:26.269168+0000","last_undegraded":"2024-09-12T01:26:26.269168+0000","last_fullsized":"2024-09-12T01:26:26.269168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:17.653908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263276+0000","last_change":"2024-09-12T01:26:12.421463+0000","last_active":"2024-09-12T01:26:26.263276+0000","last_peered":"2024-09-12T01:26:26.263276+0000","last_clean":"2024-09-12T01:26:26.263276+0000","last_became_active":"2024-09-12T01:26:12.421143+0000","last_became_peered":"2024-09-12T01:26:12.421143+0000","last_unstale":"2024-09-12T01:26:26.263276+0000","last_undegraded":"2024-09-12T01:26:26.263276+0000","last_fullsized":"2024-09-12T01:26:26.263276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:09.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.267454+0000","last_change":"2024-09-12T01:26:14.428643+0000","last_active":"2024-09-12T01:26:26.267454+0000","last_peered":"2024-09-12T01:26:26.267454+0000","last_clean":"2024-09-12T01:26:26.267454+0000","last_became_active":"2024-09-12T01:26:14.428344+0000","last_became_peered":"2024-09-12T01:26:14.428344+0000","last_unstale":"2024-09-12T01:26:26.267454+0000","last_undegraded":"2024-09-12T01:26:26.267454+0000","last_fullsized":"2024-09-12T01:26:26.267454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:17.213238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.263512+0000","last_change":"2024-09-12T01:26:14.435108+0000","last_active":"2024-09-12T01:26:26.263512+0000","last_peered":"2024-09-12T01:26:26.263512+0000","last_clean":"2024-09-12T01:26:26.263512+0000","last_became_active":"2024-09-12T01:26:14.434806+0000","last_became_peered":"2024-09-12T01:26:14.434806+0000","last_unstale":"2024-09-12T01:26:26.263512+0000","last_undegraded":"2024-09-12T01:26:26.263512+0000","last_fullsized":"2024-09-12T01:26:26.263512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:01.188981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264537+0000","last_change":"2024-09-12T01:26:12.419027+0000","last_active":"2024-09-12T01:26:26.264537+0000","last_peered":"2024-09-12T01:26:26.264537+0000","last_clean":"2024-09-12T01:26:26.264537+0000","last_became_active":"2024-09-12T01:26:12.418579+0000","last_became_peered":"2024-09-12T01:26:12.418579+0000","last_unstale":"2024-09-12T01:26:26.264537+0000","last_undegraded":"2024-09-12T01:26:26.264537+0000","last_fullsized":"2024-09-12T01:26:26.264537+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.119864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.281245+0000","last_change":"2024-09-12T01:26:14.429532+0000","last_active":"2024-09-12T01:26:26.281245+0000","last_peered":"2024-09-12T01:26:26.281245+0000","last_clean":"2024-09-12T01:26:26.281245+0000","last_became_active":"2024-09-12T01:26:14.429134+0000","last_became_peered":"2024-09-12T01:26:14.429134+0000","last_unstale":"2024-09-12T01:26:26.281245+0000","last_undegraded":"2024-09-12T01:26:26.281245+0000","last_fullsized":"2024-09-12T01:26:26.281245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:47.403388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.488999+0000","last_change":"2024-09-12T01:26:26.279322+0000","last_active":"2024-09-12T01:26:26.488999+0000","last_peered":"2024-09-12T01:26:26.488999+0000","last_clean":"2024-09-12T01:26:26.488999+0000","last_became_active":"2024-09-12T01:26:26.268752+0000","last_became_peered":"2024-09-12T01:26:26.268752+0000","last_unstale":"2024-09-12T01:26:26.488999+0000","last_undegraded":"2024-09-12T01:26:26.488999+0000","last_fullsized":"2024-09-12T01:26:26.488999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.411144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.264547+0000","last_change":"2024-09-12T01:26:14.430831+0000","last_active":"2024-09-12T01:26:26.264547+0000","last_peered":"2024-09-12T01:26:26.264547+0000","last_clean":"2024-09-12T01:26:26.264547+0000","last_became_active":"2024-09-12T01:26:14.430531+0000","last_became_peered":"2024-09-12T01:26:14.430531+0000","last_unstale":"2024-09-12T01:26:26.264547+0000","last_undegraded":"2024-09-12T01:26:26.264547+0000","last_fullsized":"2024-09-12T01:26:26.264547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:02.522283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269397+0000","last_change":"2024-09-12T01:26:12.799921+0000","last_active":"2024-09-12T01:26:26.269397+0000","last_peered":"2024-09-12T01:26:26.269397+0000","last_clean":"2024-09-12T01:26:26.269397+0000","last_became_active":"2024-09-12T01:26:12.799608+0000","last_became_peered":"2024-09-12T01:26:12.799608+0000","last_unstale":"2024-09-12T01:26:26.269397+0000","last_undegraded":"2024-09-12T01:26:26.269397+0000","last_fullsized":"2024-09-12T01:26:26.269397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:00.821261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:26:26.269287+0000","last_change":"2024-09-12T01:26:14.430937+0000","last_active":"2024-09-12T01:26:26.269287+0000","last_peered":"2024-09-12T01:26:26.269287+0000","last_clean":"2024-09-12T01:26:26.269287+0000","last_became_active":"2024-09-12T01:26:14.430656+0000","last_became_peered":"2024-09-12T01:26:14.430656+0000","last_unstale":"2024-09-12T01:26:26.269287+0000","last_undegraded":"2024-09-12T01:26:26.269287+0000","last_fullsized":"2024-09-12T01:26:26.269287+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.874150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":86,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:27:14.553457+0000","last_change":"2024-09-12T01:26:12.419000+0000","last_active":"2024-09-12T01:27:14.553457+0000","last_peered":"2024-09-12T01:27:14.553457+0000","last_clean":"2024-09-12T01:27:14.553457+0000","last_became_active":"2024-09-12T01:26:12.418736+0000","last_became_peered":"2024-09-12T01:26:12.418736+0000","last_unstale":"2024-09-12T01:27:14.553457+0000","last_undegraded":"2024-09-12T01:27:14.553457+0000","last_fullsized":"2024-09-12T01:27:14.553457+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:31.586983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66579,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":549,"num_read_kb":347,"num_write":241,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":199737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579930,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":905216,"data_stored":436466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36908,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708244,"statfs":{"total":95995035648,"available":95957241856,"internally_reserved":0,"allocated":1601536,"data_stored":1087630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972388,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":436374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201321,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":436730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462957,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1519616,"data_stored":1029272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":436091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855415,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1028557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":436345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":925696,"data_stored":435916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":496988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":496768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":929792,"data_stored":437430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:27:19.748 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T01:27:19.748 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T01:27:19.748 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T01:27:19.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T01:27:19.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:19 smithi100 ceph-mon[35275]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-12T01:27:19.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:27:19.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:27:19.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:19 smithi100 ceph-mon[35275]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:19 smithi189 ceph-mon[35357]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-12T01:27:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:27:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:27:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:19 smithi189 ceph-mon[35357]: from='mgr.14150 172.21.15.81:0/974625646' entity='mgr.x' 2024-09-12T01:27:19.994 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:20.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.465+0000 7f8e2578b640 1 -- 172.21.15.81:0/825934266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e20101420 msgr2=0x7f8e2010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:20.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.465+0000 7f8e2578b640 1 --2- 172.21.15.81:0/825934266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e20101420 0x7f8e2010d950 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009cd0 tx=0x7f8e1802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:27:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.465+0000 7f8e2578b640 1 -- 172.21.15.81:0/825934266 shutdown_connections 2024-09-12T01:27:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.465+0000 7f8e2578b640 1 --2- 172.21.15.81:0/825934266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e20101420 0x7f8e2010d950 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.465+0000 7f8e2578b640 1 --2- 172.21.15.81:0/825934266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e20100a80 0x7f8e20100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.465+0000 7f8e2578b640 1 --2- 172.21.15.81:0/825934266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e20106a80 0x7f8e20106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.465+0000 7f8e2578b640 1 -- 172.21.15.81:0/825934266 >> 172.21.15.81:0/825934266 conn(0x7f8e200fc7a0 msgr2=0x7f8e200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.465+0000 7f8e2578b640 1 -- 172.21.15.81:0/825934266 shutdown_connections 2024-09-12T01:27:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.465+0000 7f8e2578b640 1 -- 172.21.15.81:0/825934266 wait complete. 2024-09-12T01:27:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.466+0000 7f8e2578b640 1 Processor -- start 2024-09-12T01:27:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.466+0000 7f8e2578b640 1 -- start start 2024-09-12T01:27:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.466+0000 7f8e2578b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e20100a80 0x7f8e20198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.466+0000 7f8e2578b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e20101420 0x7f8e201989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.466+0000 7f8e2578b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e20106a80 0x7f8e2019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.466+0000 7f8e2578b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20110e80 con 0x7f8e20100a80 2024-09-12T01:27:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.466+0000 7f8e2578b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20110d00 con 0x7f8e20101420 2024-09-12T01:27:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.466+0000 7f8e2578b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20111000 con 0x7f8e20106a80 2024-09-12T01:27:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.466+0000 7f8e1effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e20100a80 0x7f8e20198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.466+0000 7f8e1effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e20100a80 0x7f8e20198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37106/0 (socket says 172.21.15.81:37106) 2024-09-12T01:27:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.466+0000 7f8e1effd640 1 -- 172.21.15.81:0/1550754643 learned_addr learned my addr 172.21.15.81:0/1550754643 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e1e7fc640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e20101420 0x7f8e201989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e1effd640 1 -- 172.21.15.81:0/1550754643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e20106a80 msgr2=0x7f8e2019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e1f7fe640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e20106a80 0x7f8e2019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e1effd640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e20106a80 0x7f8e2019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e1effd640 1 -- 172.21.15.81:0/1550754643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e20101420 msgr2=0x7f8e201989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e1effd640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e20101420 0x7f8e201989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e1effd640 1 -- 172.21.15.81:0/1550754643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2019d440 con 0x7f8e20100a80 2024-09-12T01:27:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e1e7fc640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e20101420 0x7f8e201989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e1effd640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e20100a80 0x7f8e20198490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c970 tx=0x7f8e0800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e17fff640 1 -- 172.21.15.81:0/1550754643 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08007bb0 con 0x7f8e20100a80 2024-09-12T01:27:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e2578b640 1 -- 172.21.15.81:0/1550754643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e2019d730 con 0x7f8e20100a80 2024-09-12T01:27:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e17fff640 1 -- 172.21.15.81:0/1550754643 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e08007d50 con 0x7f8e20100a80 2024-09-12T01:27:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e17fff640 1 -- 172.21.15.81:0/1550754643 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800f450 con 0x7f8e20100a80 2024-09-12T01:27:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.467+0000 7f8e2578b640 1 -- 172.21.15.81:0/1550754643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e201a5010 con 0x7f8e20100a80 2024-09-12T01:27:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.468+0000 7f8e2578b640 1 -- 172.21.15.81:0/1550754643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e20100ee0 con 0x7f8e20100a80 2024-09-12T01:27:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.469+0000 7f8e17fff640 1 -- 172.21.15.81:0/1550754643 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8e08005020 con 0x7f8e20100a80 2024-09-12T01:27:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.470+0000 7f8e17fff640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8e0c0a2c10 0x7f8e0c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.470+0000 7f8e1e7fc640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8e0c0a2c10 0x7f8e0c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.470+0000 7f8e17fff640 1 -- 172.21.15.81:0/1550754643 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8e080cefe0 con 0x7f8e20100a80 2024-09-12T01:27:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.470+0000 7f8e1e7fc640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8e0c0a2c10 0x7f8e0c0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8e20105200 tx=0x7f8e10005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.474+0000 7f8e17fff640 1 -- 172.21.15.81:0/1550754643 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e08014030 con 0x7f8e20100a80 2024-09-12T01:27:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.683+0000 7f8e2578b640 1 -- 172.21.15.81:0/1550754643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8e2010a030 con 0x7f8e20100a80 2024-09-12T01:27:20.683 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:20 smithi081 ceph-mon[30920]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:27:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.683+0000 7f8e17fff640 1 -- 172.21.15.81:0/1550754643 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8e0809bdf0 con 0x7f8e20100a80 2024-09-12T01:27:20.684 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:20.684 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T01:27:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.686+0000 7f8e2578b640 1 -- 172.21.15.81:0/1550754643 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8e0c0a2c10 msgr2=0x7f8e0c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.686+0000 7f8e2578b640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8e0c0a2c10 0x7f8e0c0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8e20105200 tx=0x7f8e10005e50 comp rx=0 tx=0).stop 2024-09-12T01:27:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.686+0000 7f8e2578b640 1 -- 172.21.15.81:0/1550754643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e20100a80 msgr2=0x7f8e20198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.686+0000 7f8e2578b640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e20100a80 0x7f8e20198490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c970 tx=0x7f8e0800ce30 comp rx=0 tx=0).stop 2024-09-12T01:27:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.686+0000 7f8e2578b640 1 -- 172.21.15.81:0/1550754643 shutdown_connections 2024-09-12T01:27:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.686+0000 7f8e2578b640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8e0c0a2c10 0x7f8e0c0a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.686+0000 7f8e2578b640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8e20106a80 0x7f8e2019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.686+0000 7f8e2578b640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e20101420 0x7f8e201989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.686+0000 7f8e2578b640 1 --2- 172.21.15.81:0/1550754643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e20100a80 0x7f8e20198490 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.686+0000 7f8e2578b640 1 -- 172.21.15.81:0/1550754643 >> 172.21.15.81:0/1550754643 conn(0x7f8e200fc7a0 msgr2=0x7f8e2006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.686+0000 7f8e2578b640 1 -- 172.21.15.81:0/1550754643 shutdown_connections 2024-09-12T01:27:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:20.686+0000 7f8e2578b640 1 -- 172.21.15.81:0/1550754643 wait complete. 2024-09-12T01:27:20.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:20 smithi100 ceph-mon[35275]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:27:20.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:20 smithi189 ceph-mon[35357]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:27:21.301 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T01:27:21.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:27:21.547 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:21.668 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:21 smithi081 ceph-mon[30920]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:27:21.668 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:21 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1550754643' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:27:21.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:21 smithi100 ceph-mon[35275]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:27:21.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:21 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1550754643' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:27:21.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:21 smithi189 ceph-mon[35357]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:27:21.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:21 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1550754643' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:27:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.049+0000 7fef21f4b640 1 -- 172.21.15.81:0/2828845827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1c102570 msgr2=0x7fef1c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.049+0000 7fef21f4b640 1 --2- 172.21.15.81:0/2828845827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1c102570 0x7fef1c1029b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fef04009900 tx=0x7fef0402a480 comp rx=0 tx=0).stop 2024-09-12T01:27:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.049+0000 7fef21f4b640 1 -- 172.21.15.81:0/2828845827 shutdown_connections 2024-09-12T01:27:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.049+0000 7fef21f4b640 1 --2- 172.21.15.81:0/2828845827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c102ef0 0x7fef1c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.049+0000 7fef21f4b640 1 --2- 172.21.15.81:0/2828845827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1c102570 0x7fef1c1029b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.049+0000 7fef21f4b640 1 --2- 172.21.15.81:0/2828845827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef1c100e20 0x7fef1c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.049+0000 7fef21f4b640 1 -- 172.21.15.81:0/2828845827 >> 172.21.15.81:0/2828845827 conn(0x7fef1c0fc7d0 msgr2=0x7fef1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.049+0000 7fef21f4b640 1 -- 172.21.15.81:0/2828845827 shutdown_connections 2024-09-12T01:27:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.049+0000 7fef21f4b640 1 -- 172.21.15.81:0/2828845827 wait complete. 2024-09-12T01:27:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.049+0000 7fef21f4b640 1 Processor -- start 2024-09-12T01:27:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef21f4b640 1 -- start start 2024-09-12T01:27:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef21f4b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef1c100e20 0x7fef1c197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef21f4b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c102570 0x7fef1c197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef21f4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1c102ef0 0x7fef1c19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef21f4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c110fa0 con 0x7fef1c102ef0 2024-09-12T01:27:22.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef21f4b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c110e20 con 0x7fef1c100e20 2024-09-12T01:27:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef21f4b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c111120 con 0x7fef1c102570 2024-09-12T01:27:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef1bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1c102ef0 0x7fef1c19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef1bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1c102ef0 0x7fef1c19bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37132/0 (socket says 172.21.15.81:37132) 2024-09-12T01:27:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef1bfff640 1 -- 172.21.15.81:0/609014034 learned_addr learned my addr 172.21.15.81:0/609014034 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef1b7fe640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef1c100e20 0x7fef1c197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef1affd640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c102570 0x7fef1c197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef1bfff640 1 -- 172.21.15.81:0/609014034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c102570 msgr2=0x7fef1c197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef1bfff640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c102570 0x7fef1c197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef1bfff640 1 -- 172.21.15.81:0/609014034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef1c100e20 msgr2=0x7fef1c197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef1bfff640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef1c100e20 0x7fef1c197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef1bfff640 1 -- 172.21.15.81:0/609014034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c19c3d0 con 0x7fef1c102ef0 2024-09-12T01:27:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef1affd640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c102570 0x7fef1c197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.050+0000 7fef1bfff640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1c102ef0 0x7fef1c19bcf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00d960 tx=0x7fef0c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.051+0000 7fef18ff9640 1 -- 172.21.15.81:0/609014034 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c01b070 con 0x7fef1c102ef0 2024-09-12T01:27:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.051+0000 7fef21f4b640 1 -- 172.21.15.81:0/609014034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1c19c6c0 con 0x7fef1c102ef0 2024-09-12T01:27:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.051+0000 7fef18ff9640 1 -- 172.21.15.81:0/609014034 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef0c00ed60 con 0x7fef1c102ef0 2024-09-12T01:27:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.051+0000 7fef18ff9640 1 -- 172.21.15.81:0/609014034 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0147e0 con 0x7fef1c102ef0 2024-09-12T01:27:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.051+0000 7fef21f4b640 1 -- 172.21.15.81:0/609014034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1c069f70 con 0x7fef1c102ef0 2024-09-12T01:27:22.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.052+0000 7fef21f4b640 1 -- 172.21.15.81:0/609014034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef1c101200 con 0x7fef1c102ef0 2024-09-12T01:27:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.053+0000 7fef18ff9640 1 -- 172.21.15.81:0/609014034 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fef0c01e070 con 0x7fef1c102ef0 2024-09-12T01:27:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.054+0000 7fef18ff9640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fef080a2c10 0x7fef080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.054+0000 7fef1b7fe640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fef080a2c10 0x7fef080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.054+0000 7fef18ff9640 1 -- 172.21.15.81:0/609014034 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fef0c0d0ca0 con 0x7fef1c102ef0 2024-09-12T01:27:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.054+0000 7fef1b7fe640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fef080a2c10 0x7fef080a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fef14005c40 tx=0x7fef1400a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:22.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.057+0000 7fef18ff9640 1 -- 172.21.15.81:0/609014034 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef0c09d570 con 0x7fef1c102ef0 2024-09-12T01:27:22.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.256+0000 7fef21f4b640 1 -- 172.21.15.81:0/609014034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef1c06aa50 con 0x7fef1c102ef0 2024-09-12T01:27:22.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.257+0000 7fef18ff9640 1 -- 172.21.15.81:0/609014034 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7fef0c0a1870 con 0x7fef1c102ef0 2024-09-12T01:27:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:22.258 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-12T01:26:26:481147+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:26:26.481132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24448,24446,24401,24391]},"id":1}]} 2024-09-12T01:27:22.259 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-12T01:27:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.259+0000 7fef21f4b640 1 -- 172.21.15.81:0/609014034 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fef080a2c10 msgr2=0x7fef080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.259+0000 7fef21f4b640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fef080a2c10 0x7fef080a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fef14005c40 tx=0x7fef1400a590 comp rx=0 tx=0).stop 2024-09-12T01:27:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.259+0000 7fef21f4b640 1 -- 172.21.15.81:0/609014034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1c102ef0 msgr2=0x7fef1c19bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.259+0000 7fef21f4b640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1c102ef0 0x7fef1c19bcf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00d960 tx=0x7fef0c00de20 comp rx=0 tx=0).stop 2024-09-12T01:27:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.259+0000 7fef21f4b640 1 -- 172.21.15.81:0/609014034 shutdown_connections 2024-09-12T01:27:22.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.259+0000 7fef21f4b640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fef080a2c10 0x7fef080a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:22.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.259+0000 7fef21f4b640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1c102ef0 0x7fef1c19bcf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:22.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.259+0000 7fef21f4b640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef1c102570 0x7fef1c197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:22.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.259+0000 7fef21f4b640 1 --2- 172.21.15.81:0/609014034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef1c100e20 0x7fef1c197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:22.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.259+0000 7fef21f4b640 1 -- 172.21.15.81:0/609014034 >> 172.21.15.81:0/609014034 conn(0x7fef1c0fc7d0 msgr2=0x7fef1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:22.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.259+0000 7fef21f4b640 1 -- 172.21.15.81:0/609014034 shutdown_connections 2024-09-12T01:27:22.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:22.259+0000 7fef21f4b640 1 -- 172.21.15.81:0/609014034 wait complete. 2024-09-12T01:27:22.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:22 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/609014034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:22.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:22 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/609014034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:22.890 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:22 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/609014034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:22.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:27:23.162 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:23.551 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:23 smithi081 ceph-mon[30920]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:23.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.630+0000 7fbd99d9c640 1 -- 172.21.15.81:0/2113337665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd94106a70 msgr2=0x7fbd94106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:23.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.630+0000 7fbd99d9c640 1 --2- 172.21.15.81:0/2113337665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd94106a70 0x7fbd94106e50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009cd0 tx=0x7fbd8c02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:27:23.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.630+0000 7fbd99d9c640 1 -- 172.21.15.81:0/2113337665 shutdown_connections 2024-09-12T01:27:23.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.630+0000 7fbd99d9c640 1 --2- 172.21.15.81:0/2113337665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd94101410 0x7fbd9410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:23.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.630+0000 7fbd99d9c640 1 --2- 172.21.15.81:0/2113337665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94100a70 0x7fbd94100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:23.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.630+0000 7fbd99d9c640 1 --2- 172.21.15.81:0/2113337665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd94106a70 0x7fbd94106e50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.630+0000 7fbd99d9c640 1 -- 172.21.15.81:0/2113337665 >> 172.21.15.81:0/2113337665 conn(0x7fbd940fc790 msgr2=0x7fbd940febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.630+0000 7fbd99d9c640 1 -- 172.21.15.81:0/2113337665 shutdown_connections 2024-09-12T01:27:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.630+0000 7fbd99d9c640 1 -- 172.21.15.81:0/2113337665 wait complete. 2024-09-12T01:27:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.631+0000 7fbd99d9c640 1 Processor -- start 2024-09-12T01:27:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.631+0000 7fbd99d9c640 1 -- start start 2024-09-12T01:27:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.631+0000 7fbd99d9c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd94100a70 0x7fbd94198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.631+0000 7fbd99d9c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94101410 0x7fbd94198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.631+0000 7fbd99d9c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd94106a70 0x7fbd9419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.631+0000 7fbd99d9c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94112010 con 0x7fbd94106a70 2024-09-12T01:27:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.631+0000 7fbd99d9c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94111e90 con 0x7fbd94101410 2024-09-12T01:27:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.631+0000 7fbd99d9c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94112190 con 0x7fbd94100a70 2024-09-12T01:27:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.631+0000 7fbd93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd94106a70 0x7fbd9419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.631+0000 7fbd93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd94106a70 0x7fbd9419cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56254/0 (socket says 172.21.15.81:56254) 2024-09-12T01:27:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.631+0000 7fbd93fff640 1 -- 172.21.15.81:0/935443607 learned_addr learned my addr 172.21.15.81:0/935443607 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd92ffd640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94101410 0x7fbd94198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd937fe640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd94100a70 0x7fbd94198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd93fff640 1 -- 172.21.15.81:0/935443607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd94100a70 msgr2=0x7fbd94198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd93fff640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd94100a70 0x7fbd94198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd93fff640 1 -- 172.21.15.81:0/935443607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94101410 msgr2=0x7fbd94198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd93fff640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94101410 0x7fbd94198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd93fff640 1 -- 172.21.15.81:0/935443607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9419d5c0 con 0x7fbd94106a70 2024-09-12T01:27:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd937fe640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd94100a70 0x7fbd94198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd93fff640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd94106a70 0x7fbd9419cee0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009fd0 tx=0x7fbd8400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd90ff9640 1 -- 172.21.15.81:0/935443607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84011830 con 0x7fbd94106a70 2024-09-12T01:27:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd99d9c640 1 -- 172.21.15.81:0/935443607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9419d8b0 con 0x7fbd94106a70 2024-09-12T01:27:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd90ff9640 1 -- 172.21.15.81:0/935443607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd84016070 con 0x7fbd94106a70 2024-09-12T01:27:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd90ff9640 1 -- 172.21.15.81:0/935443607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8400f2e0 con 0x7fbd94106a70 2024-09-12T01:27:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.632+0000 7fbd99d9c640 1 -- 172.21.15.81:0/935443607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd941a5190 con 0x7fbd94106a70 2024-09-12T01:27:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.633+0000 7fbd99d9c640 1 -- 172.21.15.81:0/935443607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd94100f50 con 0x7fbd94106a70 2024-09-12T01:27:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.634+0000 7fbd90ff9640 1 -- 172.21.15.81:0/935443607 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbd840119d0 con 0x7fbd94106a70 2024-09-12T01:27:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.635+0000 7fbd90ff9640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbd800a2c10 0x7fbd800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.635+0000 7fbd937fe640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbd800a2c10 0x7fbd800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.635+0000 7fbd90ff9640 1 -- 172.21.15.81:0/935443607 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbd840ce810 con 0x7fbd94106a70 2024-09-12T01:27:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.636+0000 7fbd937fe640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbd800a2c10 0x7fbd800a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c000f80 tx=0x7fbd8c031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.639+0000 7fbd90ff9640 1 -- 172.21.15.81:0/935443607 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd8409b730 con 0x7fbd94106a70 2024-09-12T01:27:23.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:23 smithi100 ceph-mon[35275]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:23 smithi189 ceph-mon[35357]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.843+0000 7fbd99d9c640 1 -- 172.21.15.81:0/935443607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd94109040 con 0x7fbd94106a70 2024-09-12T01:27:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.844+0000 7fbd90ff9640 1 -- 172.21.15.81:0/935443607 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7fbd8409b030 con 0x7fbd94106a70 2024-09-12T01:27:23.845 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:23.845 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-12T01:26:26:481147+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:26:26.481132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24448,24446,24401,24391]},"id":1}]} 2024-09-12T01:27:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-12T01:27:23.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.846+0000 7fbd99d9c640 1 -- 172.21.15.81:0/935443607 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbd800a2c10 msgr2=0x7fbd800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:23.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.846+0000 7fbd99d9c640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbd800a2c10 0x7fbd800a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c000f80 tx=0x7fbd8c031510 comp rx=0 tx=0).stop 2024-09-12T01:27:23.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.847+0000 7fbd99d9c640 1 -- 172.21.15.81:0/935443607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd94106a70 msgr2=0x7fbd9419cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:23.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.847+0000 7fbd99d9c640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd94106a70 0x7fbd9419cee0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009fd0 tx=0x7fbd8400b8e0 comp rx=0 tx=0).stop 2024-09-12T01:27:23.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.847+0000 7fbd99d9c640 1 -- 172.21.15.81:0/935443607 shutdown_connections 2024-09-12T01:27:23.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.847+0000 7fbd99d9c640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbd800a2c10 0x7fbd800a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:23.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.847+0000 7fbd99d9c640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd94106a70 0x7fbd9419cee0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:23.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.847+0000 7fbd99d9c640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd94101410 0x7fbd94198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:23.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.847+0000 7fbd99d9c640 1 --2- 172.21.15.81:0/935443607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd94100a70 0x7fbd94198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:23.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.847+0000 7fbd99d9c640 1 -- 172.21.15.81:0/935443607 >> 172.21.15.81:0/935443607 conn(0x7fbd940fc790 msgr2=0x7fbd940fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:23.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.847+0000 7fbd99d9c640 1 -- 172.21.15.81:0/935443607 shutdown_connections 2024-09-12T01:27:23.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:23.847+0000 7fbd99d9c640 1 -- 172.21.15.81:0/935443607 wait complete. 2024-09-12T01:27:24.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:27:24.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:24 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/935443607' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:24.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:24 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/935443607' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:24.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:24 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/935443607' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:25.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.188+0000 7f140e0c4640 1 -- 172.21.15.81:0/2606463332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408101420 msgr2=0x7f140810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.188+0000 7f140e0c4640 1 --2- 172.21.15.81:0/2606463332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408101420 0x7f140810d950 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1400009cd0 tx=0x7f140002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:27:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.188+0000 7f140e0c4640 1 -- 172.21.15.81:0/2606463332 shutdown_connections 2024-09-12T01:27:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.188+0000 7f140e0c4640 1 --2- 172.21.15.81:0/2606463332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408101420 0x7f140810d950 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.188+0000 7f140e0c4640 1 --2- 172.21.15.81:0/2606463332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1408100a80 0x7f1408100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.188+0000 7f140e0c4640 1 --2- 172.21.15.81:0/2606463332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1408106a80 0x7f1408106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.188+0000 7f140e0c4640 1 -- 172.21.15.81:0/2606463332 >> 172.21.15.81:0/2606463332 conn(0x7f14080fc7a0 msgr2=0x7f14080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.188+0000 7f140e0c4640 1 -- 172.21.15.81:0/2606463332 shutdown_connections 2024-09-12T01:27:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.188+0000 7f140e0c4640 1 -- 172.21.15.81:0/2606463332 wait complete. 2024-09-12T01:27:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.188+0000 7f140e0c4640 1 Processor -- start 2024-09-12T01:27:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f140e0c4640 1 -- start start 2024-09-12T01:27:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f140e0c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408100a80 0x7f1408197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f140e0c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1408101420 0x7f1408197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f140e0c4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1408106a80 0x7f140819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f140e0c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1408110e80 con 0x7f1408100a80 2024-09-12T01:27:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f140e0c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1408110d00 con 0x7f1408101420 2024-09-12T01:27:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f140e0c4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1408111000 con 0x7f1408106a80 2024-09-12T01:27:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f14077fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408100a80 0x7f1408197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f14077fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408100a80 0x7f1408197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56274/0 (socket says 172.21.15.81:56274) 2024-09-12T01:27:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f14077fe640 1 -- 172.21.15.81:0/3218184418 learned_addr learned my addr 172.21.15.81:0/3218184418 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f1407fff640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1408106a80 0x7f140819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f1406ffd640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1408101420 0x7f1408197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f14077fe640 1 -- 172.21.15.81:0/3218184418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1408106a80 msgr2=0x7f140819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f14077fe640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1408106a80 0x7f140819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f14077fe640 1 -- 172.21.15.81:0/3218184418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1408101420 msgr2=0x7f1408197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f14077fe640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1408101420 0x7f1408197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f14077fe640 1 -- 172.21.15.81:0/3218184418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140819c2d0 con 0x7f1408100a80 2024-09-12T01:27:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f1407fff640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1408106a80 0x7f140819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f1406ffd640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1408101420 0x7f1408197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f14077fe640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408100a80 0x7f1408197320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f13f800d770 tx=0x7f13f800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.189+0000 7f1404ff9640 1 -- 172.21.15.81:0/3218184418 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8017070 con 0x7f1408100a80 2024-09-12T01:27:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.190+0000 7f140e0c4640 1 -- 172.21.15.81:0/3218184418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140819c5c0 con 0x7f1408100a80 2024-09-12T01:27:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.190+0000 7f1404ff9640 1 -- 172.21.15.81:0/3218184418 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13f8005500 con 0x7f1408100a80 2024-09-12T01:27:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.190+0000 7f1404ff9640 1 -- 172.21.15.81:0/3218184418 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8004e00 con 0x7f1408100a80 2024-09-12T01:27:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.190+0000 7f140e0c4640 1 -- 172.21.15.81:0/3218184418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14081a3ea0 con 0x7f1408100a80 2024-09-12T01:27:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.191+0000 7f140e0c4640 1 -- 172.21.15.81:0/3218184418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1408100ee0 con 0x7f1408100a80 2024-09-12T01:27:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.192+0000 7f1404ff9640 1 -- 172.21.15.81:0/3218184418 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f13f8004fa0 con 0x7f1408100a80 2024-09-12T01:27:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.193+0000 7f1404ff9640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f13f00a2c10 0x7f13f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.193+0000 7f1404ff9640 1 -- 172.21.15.81:0/3218184418 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f13f80cf020 con 0x7f1408100a80 2024-09-12T01:27:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.193+0000 7f1406ffd640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f13f00a2c10 0x7f13f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.194+0000 7f1406ffd640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f13f00a2c10 0x7f13f00a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f13fc005d00 tx=0x7f13fc009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.196+0000 7f1404ff9640 1 -- 172.21.15.81:0/3218184418 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13f809be30 con 0x7f1408100a80 2024-09-12T01:27:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.375+0000 7f140e0c4640 1 -- 172.21.15.81:0/3218184418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1408198680 con 0x7f1408100a80 2024-09-12T01:27:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.377+0000 7f1404ff9640 1 -- 172.21.15.81:0/3218184418 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22714 (secure 0 0 0) 0x7f13f809b730 con 0x7f1408100a80 2024-09-12T01:27:25.535 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:25.535 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","created":"2024-09-12T01:18:28.404285+0000","modified":"2024-09-12T01:26:26.256495+0000","last_up_change":"2024-09-12T01:25:26.326110+0000","last_in_change":"2024-09-12T01:25:02.138698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:21:40.649584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:26:10.753723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:26:13.254837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc857dd4-eedc-4c48-89a0-4e69662e8e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6803","nonce":3870994528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6805","nonce":3870994528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6809","nonce":3870994528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6807","nonce":3870994528}]},"public_addr":"172.21.15.81:6803/3870994528","cluster_addr":"172.21.15.81:6805/3870994528","heartbeat_back_addr":"172.21.15.81:6809/3870994528","heartbeat_front_addr":"172.21.15.81:6807/3870994528","state":["exists","up"]},{"osd":1,"uuid":"04b8111b-d677-4fc8-8285-90683621ccf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6801","nonce":2098299652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6803","nonce":2098299652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6807","nonce":2098299652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6805","nonce":2098299652}]},"public_addr":"172.21.15.100:6801/2098299652","cluster_addr":"172.21.15.100:6803/2098299652","heartbeat_back_addr":"172.21.15.100:6807/2098299652","heartbeat_front_addr":"172.21.15.100:6805/2098299652","state":["exists","up"]},{"osd":2,"uuid":"763e357e-5a04-45ff-95e8-bc1abfeac056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6801","nonce":1353548110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6803","nonce":1353548110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6807","nonce":1353548110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6805","nonce":1353548110}]},"public_addr":"172.21.15.189:6801/1353548110","cluster_addr":"172.21.15.189:6803/1353548110","heartbeat_back_addr":"172.21.15.189:6807/1353548110","heartbeat_front_addr":"172.21.15.189:6805/1353548110","state":["exists","up"]},{"osd":3,"uuid":"99843578-1b9e-4ee0-91f1-ba419d07897e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6811","nonce":1064869637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6813","nonce":1064869637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6817","nonce":1064869637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6815","nonce":1064869637}]},"public_addr":"172.21.15.81:6811/1064869637","cluster_addr":"172.21.15.81:6813/1064869637","heartbeat_back_addr":"172.21.15.81:6817/1064869637","heartbeat_front_addr":"172.21.15.81:6815/1064869637","state":["exists","up"]},{"osd":4,"uuid":"a5787415-0905-420e-9ce8-eb6902727561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6809","nonce":1687792282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6811","nonce":1687792282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6815","nonce":1687792282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6813","nonce":1687792282}]},"public_addr":"172.21.15.100:6809/1687792282","cluster_addr":"172.21.15.100:6811/1687792282","heartbeat_back_addr":"172.21.15.100:6815/1687792282","heartbeat_front_addr":"172.21.15.100:6813/1687792282","state":["exists","up"]},{"osd":5,"uuid":"879548b5-5516-407c-8517-bbdbf356c0e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6809","nonce":823474396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6811","nonce":823474396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6815","nonce":823474396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6813","nonce":823474396}]},"public_addr":"172.21.15.189:6809/823474396","cluster_addr":"172.21.15.189:6811/823474396","heartbeat_back_addr":"172.21.15.189:6815/823474396","heartbeat_front_addr":"172.21.15.189:6813/823474396","state":["exists","up"]},{"osd":6,"uuid":"b665b97c-a9d3-475f-93f3-8a920cbb37d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6819","nonce":1522854005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6821","nonce":1522854005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6825","nonce":1522854005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6823","nonce":1522854005}]},"public_addr":"172.21.15.81:6819/1522854005","cluster_addr":"172.21.15.81:6821/1522854005","heartbeat_back_addr":"172.21.15.81:6825/1522854005","heartbeat_front_addr":"172.21.15.81:6823/1522854005","state":["exists","up"]},{"osd":7,"uuid":"46e082c8-d071-471a-8c86-ce5b5700cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6817","nonce":41478541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6819","nonce":41478541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6823","nonce":41478541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6821","nonce":41478541}]},"public_addr":"172.21.15.100:6817/41478541","cluster_addr":"172.21.15.100:6819/41478541","heartbeat_back_addr":"172.21.15.100:6823/41478541","heartbeat_front_addr":"172.21.15.100:6821/41478541","state":["exists","up"]},{"osd":8,"uuid":"fb9b93ef-5a33-4ffc-926e-a78c101bbbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6817","nonce":180766860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6819","nonce":180766860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6823","nonce":180766860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6821","nonce":180766860}]},"public_addr":"172.21.15.189:6817/180766860","cluster_addr":"172.21.15.189:6819/180766860","heartbeat_back_addr":"172.21.15.189:6823/180766860","heartbeat_front_addr":"172.21.15.189:6821/180766860","state":["exists","up"]},{"osd":9,"uuid":"0b7ec1a1-5ab9-4075-acfb-e0d82f018656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6827","nonce":1651232782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6829","nonce":1651232782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6833","nonce":1651232782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6831","nonce":1651232782}]},"public_addr":"172.21.15.81:6827/1651232782","cluster_addr":"172.21.15.81:6829/1651232782","heartbeat_back_addr":"172.21.15.81:6833/1651232782","heartbeat_front_addr":"172.21.15.81:6831/1651232782","state":["exists","up"]},{"osd":10,"uuid":"996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6825","nonce":3295868568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6827","nonce":3295868568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6831","nonce":3295868568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6829","nonce":3295868568}]},"public_addr":"172.21.15.100:6825/3295868568","cluster_addr":"172.21.15.100:6827/3295868568","heartbeat_back_addr":"172.21.15.100:6831/3295868568","heartbeat_front_addr":"172.21.15.100:6829/3295868568","state":["exists","up"]},{"osd":11,"uuid":"f051e2b2-fc58-489a-ab7c-8c1ff5448553","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6825","nonce":3852230978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6827","nonce":3852230978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6831","nonce":3852230978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6829","nonce":3852230978}]},"public_addr":"172.21.15.189:6825/3852230978","cluster_addr":"172.21.15.189:6827/3852230978","heartbeat_back_addr":"172.21.15.189:6831/3852230978","heartbeat_front_addr":"172.21.15.189:6829/3852230978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:20:47.371696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:12.762376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:37.936648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:03.950352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:28.922754+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:54.252149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:18.421479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:43.989505+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:08.789671+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:34.336367+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:59.089601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:25:23.761934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/4128337402":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/1460332159":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2577694203":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2393807982":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/2162789959":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/4219073331":"2024-09-13T01:19:00.926419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:27:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.380+0000 7f140e0c4640 1 -- 172.21.15.81:0/3218184418 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f13f00a2c10 msgr2=0x7f13f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.380+0000 7f140e0c4640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f13f00a2c10 0x7f13f00a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f13fc005d00 tx=0x7f13fc009550 comp rx=0 tx=0).stop 2024-09-12T01:27:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.380+0000 7f140e0c4640 1 -- 172.21.15.81:0/3218184418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408100a80 msgr2=0x7f1408197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.380+0000 7f140e0c4640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408100a80 0x7f1408197320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f13f800d770 tx=0x7f13f800dc30 comp rx=0 tx=0).stop 2024-09-12T01:27:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.380+0000 7f140e0c4640 1 -- 172.21.15.81:0/3218184418 shutdown_connections 2024-09-12T01:27:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.380+0000 7f140e0c4640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f13f00a2c10 0x7f13f00a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.380+0000 7f140e0c4640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1408106a80 0x7f140819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.380+0000 7f140e0c4640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1408101420 0x7f1408197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.380+0000 7f140e0c4640 1 --2- 172.21.15.81:0/3218184418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408100a80 0x7f1408197320 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.380+0000 7f140e0c4640 1 -- 172.21.15.81:0/3218184418 >> 172.21.15.81:0/3218184418 conn(0x7f14080fc7a0 msgr2=0x7f14080fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.380+0000 7f140e0c4640 1 -- 172.21.15.81:0/3218184418 shutdown_connections 2024-09-12T01:27:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:25.380+0000 7f140e0c4640 1 -- 172.21.15.81:0/3218184418 wait complete. 2024-09-12T01:27:25.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:25 smithi081 ceph-mon[30920]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:27:25.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:25 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3218184418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:27:25.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:25 smithi100 ceph-mon[35275]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:27:25.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:25 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3218184418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:27:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:25 smithi189 ceph-mon[35357]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:27:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:25 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3218184418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:27:26.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:27:26.310 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:26.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.763+0000 7effd03d0640 1 -- 172.21.15.81:0/2067139197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effc8102d40 msgr2=0x7effc8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:26.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.763+0000 7effd03d0640 1 --2- 172.21.15.81:0/2067139197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effc8102d40 0x7effc8103120 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7effb8009900 tx=0x7effb802a480 comp rx=0 tx=0).stop 2024-09-12T01:27:26.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.763+0000 7effd03d0640 1 -- 172.21.15.81:0/2067139197 shutdown_connections 2024-09-12T01:27:26.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.763+0000 7effd03d0640 1 --2- 172.21.15.81:0/2067139197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc810c170 0x7effc810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:26.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.763+0000 7effd03d0640 1 --2- 172.21.15.81:0/2067139197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc8103660 0x7effc810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.763+0000 7effd03d0640 1 --2- 172.21.15.81:0/2067139197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effc8102d40 0x7effc8103120 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.763+0000 7effd03d0640 1 -- 172.21.15.81:0/2067139197 >> 172.21.15.81:0/2067139197 conn(0x7effc80fc7a0 msgr2=0x7effc80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.763+0000 7effd03d0640 1 -- 172.21.15.81:0/2067139197 shutdown_connections 2024-09-12T01:27:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.763+0000 7effd03d0640 1 -- 172.21.15.81:0/2067139197 wait complete. 2024-09-12T01:27:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effd03d0640 1 Processor -- start 2024-09-12T01:27:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effd03d0640 1 -- start start 2024-09-12T01:27:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effd03d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effc8102d40 0x7effc81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effd03d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc8103660 0x7effc8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effd03d0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc810c170 0x7effc819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effd03d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7effc8111fb0 con 0x7effc8102d40 2024-09-12T01:27:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effd03d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effc8111e30 con 0x7effc8103660 2024-09-12T01:27:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effd03d0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7effc8112130 con 0x7effc810c170 2024-09-12T01:27:26.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effce16c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effc8102d40 0x7effc81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effce16c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effc8102d40 0x7effc81984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56298/0 (socket says 172.21.15.81:56298) 2024-09-12T01:27:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effce16c640 1 -- 172.21.15.81:0/3563767850 learned_addr learned my addr 172.21.15.81:0/3563767850 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effce96d640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc810c170 0x7effc819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effcd96b640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc8103660 0x7effc8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effce16c640 1 -- 172.21.15.81:0/3563767850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc810c170 msgr2=0x7effc819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effce16c640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc810c170 0x7effc819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effce16c640 1 -- 172.21.15.81:0/3563767850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc8103660 msgr2=0x7effc8198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effce16c640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc8103660 0x7effc8198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effce16c640 1 -- 172.21.15.81:0/3563767850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc819d480 con 0x7effc8102d40 2024-09-12T01:27:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effcd96b640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc8103660 0x7effc8198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effce16c640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effc8102d40 0x7effc81984d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7effb8005ab0 tx=0x7effb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.764+0000 7effbf7fe640 1 -- 172.21.15.81:0/3563767850 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb803f030 con 0x7effc8102d40 2024-09-12T01:27:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.765+0000 7effd03d0640 1 -- 172.21.15.81:0/3563767850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc819d710 con 0x7effc8102d40 2024-09-12T01:27:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.765+0000 7effbf7fe640 1 -- 172.21.15.81:0/3563767850 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effb8003ce0 con 0x7effc8102d40 2024-09-12T01:27:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.765+0000 7effbf7fe640 1 -- 172.21.15.81:0/3563767850 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8035070 con 0x7effc8102d40 2024-09-12T01:27:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.765+0000 7effd03d0640 1 -- 172.21.15.81:0/3563767850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc81a5050 con 0x7effc8102d40 2024-09-12T01:27:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.766+0000 7effd03d0640 1 -- 172.21.15.81:0/3563767850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc8103120 con 0x7effc8102d40 2024-09-12T01:27:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.767+0000 7effbf7fe640 1 -- 172.21.15.81:0/3563767850 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7effb8042030 con 0x7effc8102d40 2024-09-12T01:27:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.767+0000 7effbf7fe640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7effb40a2c90 0x7effb40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.767+0000 7effcd96b640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7effb40a2c90 0x7effb40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.767+0000 7effbf7fe640 1 -- 172.21.15.81:0/3563767850 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7effb80efd30 con 0x7effc8102d40 2024-09-12T01:27:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.768+0000 7effcd96b640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7effb40a2c90 0x7effb40a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7effc4006fd0 tx=0x7effc4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.770+0000 7effbf7fe640 1 -- 172.21.15.81:0/3563767850 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7effb80bcb40 con 0x7effc8102d40 2024-09-12T01:27:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.971+0000 7effd03d0640 1 -- 172.21.15.81:0/3563767850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effc8107210 con 0x7effc8102d40 2024-09-12T01:27:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.972+0000 7effbf7fe640 1 -- 172.21.15.81:0/3563767850 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7effb80bc440 con 0x7effc8102d40 2024-09-12T01:27:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:26.972 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-12T01:26:26:481147+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:26:26.481132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24448,24446,24401,24391]},"id":1}]} 2024-09-12T01:27:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-12T01:27:26.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.974+0000 7effd03d0640 1 -- 172.21.15.81:0/3563767850 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7effb40a2c90 msgr2=0x7effb40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:26.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.974+0000 7effd03d0640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7effb40a2c90 0x7effb40a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7effc4006fd0 tx=0x7effc4008040 comp rx=0 tx=0).stop 2024-09-12T01:27:26.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.974+0000 7effd03d0640 1 -- 172.21.15.81:0/3563767850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effc8102d40 msgr2=0x7effc81984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:26.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.974+0000 7effd03d0640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effc8102d40 0x7effc81984d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7effb8005ab0 tx=0x7effb80042f0 comp rx=0 tx=0).stop 2024-09-12T01:27:26.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.974+0000 7effd03d0640 1 -- 172.21.15.81:0/3563767850 shutdown_connections 2024-09-12T01:27:26.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.974+0000 7effd03d0640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7effb40a2c90 0x7effb40a5150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:26.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.974+0000 7effd03d0640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc810c170 0x7effc819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:26.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.974+0000 7effd03d0640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc8103660 0x7effc8198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:26.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.974+0000 7effd03d0640 1 --2- 172.21.15.81:0/3563767850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effc8102d40 0x7effc81984d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:26.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.974+0000 7effd03d0640 1 -- 172.21.15.81:0/3563767850 >> 172.21.15.81:0/3563767850 conn(0x7effc80fc7a0 msgr2=0x7effc80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:26.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.975+0000 7effd03d0640 1 -- 172.21.15.81:0/3563767850 shutdown_connections 2024-09-12T01:27:26.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:26.975+0000 7effd03d0640 1 -- 172.21.15.81:0/3563767850 wait complete. 2024-09-12T01:27:27.592 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T01:26:15.004450+0000', 'modified': '2024-09-12T01:26:26.481132+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24473, 'mds_1': 24448, 'mds_2': 24446, 'mds_3': 24401, 'mds_4': 24391}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14601': {'gid': 14601, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6839/1118446149', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 1118446149}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 1118446149}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14613': {'gid': 14613, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6841/3373717964', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6840', 'nonce': 3373717964}, {'type': 'v1', 'addr': '172.21.15.81:6841', 'nonce': 3373717964}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24391': {'gid': 24391, 'name': 'l', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.189:6833/2998951094', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6832', 'nonce': 2998951094}, {'type': 'v1', 'addr': '172.21.15.189:6833', 'nonce': 2998951094}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24401': {'gid': 24401, 'name': 'k', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.100:6833/2684949307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6832', 'nonce': 2684949307}, {'type': 'v1', 'addr': '172.21.15.100:6833', 'nonce': 2684949307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/79706687', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 79706687}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 79706687}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24425': {'gid': 24425, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.100:6835/3858178529', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6834', 'nonce': 3858178529}, {'type': 'v1', 'addr': '172.21.15.100:6835', 'nonce': 3858178529}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/129654641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 129654641}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 129654641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.100:6837/2276544763', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6836', 'nonce': 2276544763}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 2276544763}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.189:6839/1856874876', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 1856874876}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 1856874876}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6839/3435943351', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 3435943351}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 3435943351}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24473, 'qdb_cluster': [24473, 24448, 24446, 24401, 24391]} 2024-09-12T01:27:27.592 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T01:27:27.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.l status 2024-09-12T01:27:27.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:27 smithi100 ceph-mon[35275]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T01:27:27.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:27 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3563767850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:27 smithi189 ceph-mon[35357]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T01:27:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:27 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3563767850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:27.835 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:27.956 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:27 smithi081 ceph-mon[30920]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T01:27:27.956 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:27 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3563767850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.355+0000 7fe4695c5640 1 -- 172.21.15.81:0/1533322256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe464103670 msgr2=0x7fe46410bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.355+0000 7fe4695c5640 1 --2- 172.21.15.81:0/1533322256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe464103670 0x7fe46410bb60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009900 tx=0x7fe44c02a480 comp rx=0 tx=0).stop 2024-09-12T01:27:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.355+0000 7fe4695c5640 1 -- 172.21.15.81:0/1533322256 shutdown_connections 2024-09-12T01:27:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.355+0000 7fe4695c5640 1 --2- 172.21.15.81:0/1533322256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe46410c180 0x7fe46410e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.355+0000 7fe4695c5640 1 --2- 172.21.15.81:0/1533322256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe464103670 0x7fe46410bb60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.355+0000 7fe4695c5640 1 --2- 172.21.15.81:0/1533322256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe464102d50 0x7fe464103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.355+0000 7fe4695c5640 1 -- 172.21.15.81:0/1533322256 >> 172.21.15.81:0/1533322256 conn(0x7fe4640fc7d0 msgr2=0x7fe4640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.355+0000 7fe4695c5640 1 -- 172.21.15.81:0/1533322256 shutdown_connections 2024-09-12T01:27:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.355+0000 7fe4695c5640 1 -- 172.21.15.81:0/1533322256 wait complete. 2024-09-12T01:27:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.356+0000 7fe4695c5640 1 Processor -- start 2024-09-12T01:27:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.356+0000 7fe4695c5640 1 -- start start 2024-09-12T01:27:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.356+0000 7fe4695c5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe464102d50 0x7fe464198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.356+0000 7fe4695c5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe464103670 0x7fe464198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.356+0000 7fe4695c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe46410c180 0x7fe46419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.356+0000 7fe4695c5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe464111f80 con 0x7fe46410c180 2024-09-12T01:27:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.356+0000 7fe4695c5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe464111e00 con 0x7fe464103670 2024-09-12T01:27:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.356+0000 7fe4695c5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe464112100 con 0x7fe464102d50 2024-09-12T01:27:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe4637fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe46410c180 0x7fe46419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe4637fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe46410c180 0x7fe46419ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56304/0 (socket says 172.21.15.81:56304) 2024-09-12T01:27:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe4637fe640 1 -- 172.21.15.81:0/3688608106 learned_addr learned my addr 172.21.15.81:0/3688608106 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe462ffd640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe464102d50 0x7fe464198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe464103670 0x7fe464198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe4637fe640 1 -- 172.21.15.81:0/3688608106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe464102d50 msgr2=0x7fe464198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe4637fe640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe464102d50 0x7fe464198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe4637fe640 1 -- 172.21.15.81:0/3688608106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe464103670 msgr2=0x7fe464198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe4637fe640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe464103670 0x7fe464198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe4637fe640 1 -- 172.21.15.81:0/3688608106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46419d3d0 con 0x7fe46410c180 2024-09-12T01:27:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe4637fe640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe46410c180 0x7fe46419ccf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00c970 tx=0x7fe45c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe45bfff640 1 -- 172.21.15.81:0/3688608106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c007bb0 con 0x7fe46410c180 2024-09-12T01:27:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe4695c5640 1 -- 172.21.15.81:0/3688608106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe46419d6c0 con 0x7fe46410c180 2024-09-12T01:27:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe45bfff640 1 -- 172.21.15.81:0/3688608106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe45c007d50 con 0x7fe46410c180 2024-09-12T01:27:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe45bfff640 1 -- 172.21.15.81:0/3688608106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c018800 con 0x7fe46410c180 2024-09-12T01:27:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.357+0000 7fe4695c5640 1 -- 172.21.15.81:0/3688608106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4641a4fa0 con 0x7fe46410c180 2024-09-12T01:27:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.359+0000 7fe45bfff640 1 -- 172.21.15.81:0/3688608106 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe45c00fa50 con 0x7fe46410c180 2024-09-12T01:27:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe46b99e740 1 Processor -- start 2024-09-12T01:27:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe46b99e740 1 -- start start 2024-09-12T01:27:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe46b99e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 0x5580724f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe46b99e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f82f0 0x558072502670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe46b99e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558072502bb0 0x558072504fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe46b99e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55807245e090 con 0x5580724f79d0 2024-09-12T01:27:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe46b99e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558072405a70 con 0x558072502bb0 2024-09-12T01:27:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe46b99e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55807245a050 con 0x5580724f82f0 2024-09-12T01:27:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe45bfff640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe4500a2c10 0x7fe4500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe4627fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 0x5580724f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe4627fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 0x5580724f7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56312/0 (socket says 172.21.15.81:56312) 2024-09-12T01:27:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe4627fc640 1 -- 172.21.15.81:0/3869514383 learned_addr learned my addr 172.21.15.81:0/3869514383 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe462ffd640 1 --2- 172.21.15.81:0/3869514383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f82f0 0x558072502670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe4637fe640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe4500a2c10 0x7fe4500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3869514383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558072502bb0 0x558072504fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe45bfff640 1 -- 172.21.15.81:0/3688608106 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe45c0cf1c0 con 0x7fe46410c180 2024-09-12T01:27:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe4627fc640 1 -- 172.21.15.81:0/3869514383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f82f0 msgr2=0x558072502670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3869514383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f82f0 0x558072502670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.360+0000 7fe4627fc640 1 -- 172.21.15.81:0/3869514383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558072502bb0 msgr2=0x558072504fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.361+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3869514383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558072502bb0 0x558072504fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.361+0000 7fe4627fc640 1 -- 172.21.15.81:0/3869514383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558072412130 con 0x5580724f79d0 2024-09-12T01:27:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.361+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3869514383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 0x5580724f7db0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe44c032fd0 tx=0x7fe44c005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9117b98814ce99af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.361+0000 7fe4637fe640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe4500a2c10 0x7fe4500a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00ffd0 tx=0x7fe45c097450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.361+0000 7fe4597fa640 1 -- 172.21.15.81:0/3869514383 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c043020 con 0x5580724f79d0 2024-09-12T01:27:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.361+0000 7fe4597fa640 1 -- 172.21.15.81:0/3869514383 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe44c0318b0 con 0x5580724f79d0 2024-09-12T01:27:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.361+0000 7fe4597fa640 1 -- 172.21.15.81:0/3869514383 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c035050 con 0x5580724f79d0 2024-09-12T01:27:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 -- 172.21.15.81:0/3869514383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 msgr2=0x5580724f7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3869514383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 0x5580724f7db0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe44c032fd0 tx=0x7fe44c005d70 comp rx=0 tx=0).stop 2024-09-12T01:27:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 -- 172.21.15.81:0/3869514383 shutdown_connections 2024-09-12T01:27:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3869514383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558072502bb0 0x558072504fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3869514383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f82f0 0x558072502670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3869514383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 0x5580724f7db0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 -- 172.21.15.81:0/3869514383 >> 172.21.15.81:0/3869514383 conn(0x5580724f3f60 msgr2=0x5580724f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 -- 172.21.15.81:0/3869514383 shutdown_connections 2024-09-12T01:27:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 -- 172.21.15.81:0/3869514383 wait complete. 2024-09-12T01:27:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 -- start start 2024-09-12T01:27:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 Processor -- start 2024-09-12T01:27:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f79d0 0x558072502490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f82f0 0x5580724ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558072502bb0 0x5580724ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558072505780 con 0x5580724f82f0 2024-09-12T01:27:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558072418f20 con 0x558072502bb0 2024-09-12T01:27:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558072505900 con 0x5580724f79d0 2024-09-12T01:27:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe46b99e740 10 client.0 _ll_register_callbacks cb 0x5580723e2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe462ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f82f0 0x5580724ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.362+0000 7fe462ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f82f0 0x5580724ff7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56324/0 (socket says 172.21.15.81:56324) 2024-09-12T01:27:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe462ffd640 1 -- 172.21.15.81:0/3803086964 learned_addr learned my addr 172.21.15.81:0/3803086964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f79d0 0x558072502490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558072502bb0 0x5580724ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe462ffd640 1 -- 172.21.15.81:0/3803086964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f79d0 msgr2=0x558072502490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe462ffd640 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f79d0 0x558072502490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe462ffd640 1 -- 172.21.15.81:0/3803086964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558072502bb0 msgr2=0x5580724ffd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe462ffd640 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558072502bb0 0x5580724ffd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe462ffd640 1 -- 172.21.15.81:0/3803086964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580721cf2b0 con 0x5580724f82f0 2024-09-12T01:27:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f79d0 0x558072502490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe462ffd640 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f82f0 0x5580724ff7e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe454004070 tx=0x7fe454004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a1248d7e49a767 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe44a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe44a7fc640 1 -- 172.21.15.81:0/3803086964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454013c40 con 0x5580724f82f0 2024-09-12T01:27:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe44a7fc640 1 -- 172.21.15.81:0/3803086964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe454013de0 con 0x5580724f82f0 2024-09-12T01:27:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe46b99e740 1 -- 172.21.15.81:0/3803086964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe44c0318b0 con 0x5580724f82f0 2024-09-12T01:27:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe44a7fc640 1 -- 172.21.15.81:0/3803086964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe45401c440 con 0x5580724f82f0 2024-09-12T01:27:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe46b99e740 10 client.14970 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe46b99e740 1 -- 172.21.15.81:0/3803086964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558072511150 con 0x5580724f82f0 2024-09-12T01:27:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.363+0000 7fe44a7fc640 1 -- 172.21.15.81:0/3803086964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe44c0318b0 con 0x5580724f82f0 2024-09-12T01:27:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.364+0000 7fe44a7fc640 1 -- 172.21.15.81:0/3803086964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe45401a070 con 0x5580724f82f0 2024-09-12T01:27:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.364+0000 7fe46b99e740 10 client.14970 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.364+0000 7fe46b99e740 10 client.14970 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-12T01:27:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.364+0000 7fe46b99e740 20 client.14970 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.364+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x5580725137c0 0x558072514c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.364+0000 7fe46b99e740 4 client.14970 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:27:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.364+0000 7fe46b99e740 1 -- 172.21.15.81:0/3803086964 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55807246b600 con 0x5580725137c0 2024-09-12T01:27:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.364+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x5580725137c0 0x558072514c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.365+0000 7fe44a7fc640 10 client.14970 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:27:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.365+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x5580725137c0 0x558072514c30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8e20803db706e79b server_cookie=3a594c910fff1410 in_seq=0 out_seq=0 2024-09-12T01:27:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.365+0000 7fe44a7fc640 1 -- 172.21.15.81:0/3803086964 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55807246b600 con 0x5580725137c0 2024-09-12T01:27:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.365+0000 7fe44a7fc640 10 client.14970 handle_command_reply: tid=0 2024-09-12T01:27:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.365+0000 7fe46b99e740 1 client.14970 shutdown 2024-09-12T01:27:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.365+0000 7fe46b99e740 1 -- 172.21.15.81:0/3803086964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f82f0 msgr2=0x5580724ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.365+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f82f0 0x5580724ff7e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe454004070 tx=0x7fe454004530 comp rx=0 tx=0).stop 2024-09-12T01:27:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.365+0000 7fe46b99e740 1 -- 172.21.15.81:0/3803086964 shutdown_connections 2024-09-12T01:27:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.365+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558072502bb0 0x5580724ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.365+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f82f0 0x5580724ff7e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.365+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x5580725137c0 0x558072514c30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.365+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3803086964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f79d0 0x558072502490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.366+0000 7fe46b99e740 1 -- 172.21.15.81:0/3803086964 >> 172.21.15.81:0/3803086964 conn(0x5580724f3f60 msgr2=0x5580724f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.366+0000 7fe44a7fc640 0 client.14970 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:27:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.366+0000 7fe46b99e740 1 -- 172.21.15.81:0/3803086964 shutdown_connections 2024-09-12T01:27:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.366+0000 7fe46b99e740 1 -- 172.21.15.81:0/3803086964 wait complete. 2024-09-12T01:27:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.366+0000 7fe46b99e740 20 client.14970 trim_cache size 0 max 16384 2024-09-12T01:27:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.383+0000 7fe46b99e740 1 Processor -- start 2024-09-12T01:27:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.383+0000 7fe46b99e740 1 -- start start 2024-09-12T01:27:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe46b99e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f79d0 0x558072514c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe46b99e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5580724f82f0 0x55807251d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe46b99e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558072502bb0 0x5580724fa610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe46b99e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558072512f70 con 0x558072502bb0 2024-09-12T01:27:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe46b99e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558072513640 con 0x5580724f82f0 2024-09-12T01:27:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe46b99e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558072513d10 con 0x5580724f79d0 2024-09-12T01:27:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe4627fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558072502bb0 0x5580724fa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe4627fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558072502bb0 0x5580724fa610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56328/0 (socket says 172.21.15.81:56328) 2024-09-12T01:27:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe4627fc640 1 -- 172.21.15.81:0/3225809859 learned_addr learned my addr 172.21.15.81:0/3225809859 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe462ffd640 1 --2- 172.21.15.81:0/3225809859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5580724f82f0 0x55807251d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3225809859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f79d0 0x558072514c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe4627fc640 1 -- 172.21.15.81:0/3225809859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f79d0 msgr2=0x558072514c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3225809859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f79d0 0x558072514c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe4627fc640 1 -- 172.21.15.81:0/3225809859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5580724f82f0 msgr2=0x55807251d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3225809859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5580724f82f0 0x55807251d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe4627fc640 1 -- 172.21.15.81:0/3225809859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580724fdd50 con 0x558072502bb0 2024-09-12T01:27:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe4627fc640 1 --2- 172.21.15.81:0/3225809859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558072502bb0 0x5580724fa610 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe44c032d80 tx=0x7fe44c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334045483408d854 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe458ff9640 1 -- 172.21.15.81:0/3225809859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c035070 con 0x558072502bb0 2024-09-12T01:27:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe458ff9640 1 -- 172.21.15.81:0/3225809859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe44c03a480 con 0x558072502bb0 2024-09-12T01:27:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.384+0000 7fe458ff9640 1 -- 172.21.15.81:0/3225809859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c043040 con 0x558072502bb0 2024-09-12T01:27:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.385+0000 7fe46b99e740 1 -- 172.21.15.81:0/3225809859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558072502bb0 msgr2=0x5580724fa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.385+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3225809859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558072502bb0 0x5580724fa610 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe44c032d80 tx=0x7fe44c000bc0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.385+0000 7fe46b99e740 1 -- 172.21.15.81:0/3225809859 shutdown_connections 2024-09-12T01:27:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.385+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3225809859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558072502bb0 0x5580724fa610 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.385+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3225809859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5580724f82f0 0x55807251d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.385+0000 7fe46b99e740 1 --2- 172.21.15.81:0/3225809859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5580724f79d0 0x558072514c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.385+0000 7fe46b99e740 1 -- 172.21.15.81:0/3225809859 >> 172.21.15.81:0/3225809859 conn(0x5580724f3f60 msgr2=0x5580724fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.385+0000 7fe46b99e740 1 -- 172.21.15.81:0/3225809859 shutdown_connections 2024-09-12T01:27:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.385+0000 7fe46b99e740 1 -- 172.21.15.81:0/3225809859 wait complete. 2024-09-12T01:27:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe46b99e740 1 -- start start 2024-09-12T01:27:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe46b99e740 1 Processor -- start 2024-09-12T01:27:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe46b99e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 0x5580724fc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe46b99e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5580724f82f0 0x5580724fc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe46b99e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558072502bb0 0x558072579ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe46b99e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558072514ab0 con 0x5580724f79d0 2024-09-12T01:27:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe46b99e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5580725143e0 con 0x5580724f82f0 2024-09-12T01:27:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe46b99e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558072515180 con 0x558072502bb0 2024-09-12T01:27:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe46b99e740 10 client.0 _ll_register_callbacks cb 0x7fe454009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe4627fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 0x5580724fc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe4627fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 0x5580724fc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56330/0 (socket says 172.21.15.81:56330) 2024-09-12T01:27:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe4627fc640 1 -- 172.21.15.81:0/1107091976 learned_addr learned my addr 172.21.15.81:0/1107091976 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe4627fc640 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558072502bb0 0x558072579ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe462ffd640 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5580724f82f0 0x5580724fc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe4627fc640 1 -- 172.21.15.81:0/1107091976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558072502bb0 msgr2=0x558072579ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe4627fc640 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558072502bb0 0x558072579ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe4627fc640 1 -- 172.21.15.81:0/1107091976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5580724f82f0 msgr2=0x5580724fc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe4627fc640 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5580724f82f0 0x5580724fc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe4627fc640 1 -- 172.21.15.81:0/1107091976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807257a500 con 0x5580724f79d0 2024-09-12T01:27:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe462ffd640 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5580724f82f0 0x5580724fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe4627fc640 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 0x5580724fc3f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe44c031720 tx=0x7fe44c0316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba28862b8c61d737 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.386+0000 7fe44a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe44a7fc640 1 -- 172.21.15.81:0/1107091976 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c043070 con 0x5580724f79d0 2024-09-12T01:27:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe44a7fc640 1 -- 172.21.15.81:0/1107091976 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe44c031d00 con 0x5580724f79d0 2024-09-12T01:27:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe46b99e740 1 -- 172.21.15.81:0/1107091976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe44c03a480 con 0x5580724f79d0 2024-09-12T01:27:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe44a7fc640 1 -- 172.21.15.81:0/1107091976 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe44c035040 con 0x5580724f79d0 2024-09-12T01:27:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe46b99e740 10 client.14976 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe46b99e740 1 -- 172.21.15.81:0/1107091976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558072581850 con 0x5580724f79d0 2024-09-12T01:27:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe44a7fc640 1 -- 172.21.15.81:0/1107091976 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe44c03a480 con 0x5580724f79d0 2024-09-12T01:27:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe44a7fc640 1 -- 172.21.15.81:0/1107091976 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe44c03d6b0 con 0x5580724f79d0 2024-09-12T01:27:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe46b99e740 10 client.14976 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe46b99e740 10 client.14976 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-12T01:27:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe46b99e740 20 client.14976 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe46b99e740 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x558072585be0 0x5580725848f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe46b99e740 4 client.14976 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:27:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe46b99e740 1 -- 172.21.15.81:0/1107091976 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "status"}) -- 0x558072465b10 con 0x558072585be0 2024-09-12T01:27:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.387+0000 7fe462ffd640 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x558072585be0 0x5580725848f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe462ffd640 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x558072585be0 0x5580725848f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ff79d2c73016dc5c server_cookie=5d98b3a33211fe5e in_seq=0 out_seq=0 2024-09-12T01:27:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe44a7fc640 10 client.14976 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:27:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe44a7fc640 1 -- 172.21.15.81:0/1107091976 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558072465b10 con 0x558072585be0 2024-09-12T01:27:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe44a7fc640 10 client.14976 handle_command_reply: tid=0 2024-09-12T01:27:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe46b99e740 1 client.14976 shutdown 2024-09-12T01:27:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe46b99e740 1 -- 172.21.15.81:0/1107091976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 msgr2=0x5580724fc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe46b99e740 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 0x5580724fc3f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe44c031720 tx=0x7fe44c0316b0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe46b99e740 1 -- 172.21.15.81:0/1107091976 shutdown_connections 2024-09-12T01:27:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe46b99e740 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x558072585be0 0x5580725848f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe46b99e740 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558072502bb0 0x558072579ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe46b99e740 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5580724f82f0 0x5580724fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe46b99e740 1 --2- 172.21.15.81:0/1107091976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5580724f79d0 0x5580724fc3f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe46b99e740 1 -- 172.21.15.81:0/1107091976 >> 172.21.15.81:0/1107091976 conn(0x5580724f3f60 msgr2=0x558072500e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe44a7fc640 0 client.14976 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:27:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe46b99e740 1 -- 172.21.15.81:0/1107091976 shutdown_connections 2024-09-12T01:27:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe46b99e740 1 -- 172.21.15.81:0/1107091976 wait complete. 2024-09-12T01:27:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.388+0000 7fe46b99e740 20 client.14976 trim_cache size 0 max 16384 2024-09-12T01:27:28.402 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:27:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:27:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 4, 2024-09-12T01:27:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24391, 2024-09-12T01:27:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:27:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:27:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:27:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 63.118692291000002, 2024-09-12T01:27:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T01:27:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-12T01:27:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:27:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 113.93941904499999 2024-09-12T01:27:28.403 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:27:28.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.389+0000 7fe4695c5640 1 -- 172.21.15.81:0/3688608106 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe4500a2c10 msgr2=0x7fe4500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:28.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.389+0000 7fe4695c5640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe4500a2c10 0x7fe4500a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00ffd0 tx=0x7fe45c097450 comp rx=0 tx=0).stop 2024-09-12T01:27:28.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.389+0000 7fe4695c5640 1 -- 172.21.15.81:0/3688608106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe46410c180 msgr2=0x7fe46419ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:28.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.389+0000 7fe4695c5640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe46410c180 0x7fe46419ccf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00c970 tx=0x7fe45c00ce30 comp rx=0 tx=0).stop 2024-09-12T01:27:28.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.389+0000 7fe4695c5640 1 -- 172.21.15.81:0/3688608106 shutdown_connections 2024-09-12T01:27:28.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.389+0000 7fe4695c5640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fe4500a2c10 0x7fe4500a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.389+0000 7fe4695c5640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe46410c180 0x7fe46419ccf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.389+0000 7fe4695c5640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe464103670 0x7fe464198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.389+0000 7fe4695c5640 1 --2- 172.21.15.81:0/3688608106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe464102d50 0x7fe464198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:28.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.389+0000 7fe4695c5640 1 -- 172.21.15.81:0/3688608106 >> 172.21.15.81:0/3688608106 conn(0x7fe4640fc7d0 msgr2=0x7fe4640fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:28.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.389+0000 7fe4695c5640 1 -- 172.21.15.81:0/3688608106 shutdown_connections 2024-09-12T01:27:28.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:28.389+0000 7fe4695c5640 1 -- 172.21.15.81:0/3688608106 wait complete. 2024-09-12T01:27:29.090 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.k status 2024-09-12T01:27:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:29.708 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:29 smithi081 ceph-mon[30920]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:29.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:29 smithi189 ceph-mon[35357]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.789+0000 7fee278ff640 1 -- 172.21.15.81:0/1348057522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20106a80 msgr2=0x7fee20106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.789+0000 7fee278ff640 1 --2- 172.21.15.81:0/1348057522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20106a80 0x7fee20106e60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009930 tx=0x7fee1c02a420 comp rx=0 tx=0).stop 2024-09-12T01:27:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.789+0000 7fee278ff640 1 -- 172.21.15.81:0/1348057522 shutdown_connections 2024-09-12T01:27:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.789+0000 7fee278ff640 1 --2- 172.21.15.81:0/1348057522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee20101420 0x7fee2010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.789+0000 7fee278ff640 1 --2- 172.21.15.81:0/1348057522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee20100a80 0x7fee20100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.789+0000 7fee278ff640 1 --2- 172.21.15.81:0/1348057522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20106a80 0x7fee20106e60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.789+0000 7fee278ff640 1 -- 172.21.15.81:0/1348057522 >> 172.21.15.81:0/1348057522 conn(0x7fee200fc7a0 msgr2=0x7fee200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.789+0000 7fee278ff640 1 -- 172.21.15.81:0/1348057522 shutdown_connections 2024-09-12T01:27:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.789+0000 7fee278ff640 1 -- 172.21.15.81:0/1348057522 wait complete. 2024-09-12T01:27:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.789+0000 7fee278ff640 1 Processor -- start 2024-09-12T01:27:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.789+0000 7fee278ff640 1 -- start start 2024-09-12T01:27:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee278ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20100a80 0x7fee20198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee278ff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee20101420 0x7fee20198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee278ff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee20106a80 0x7fee2019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee278ff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fee20110e80 con 0x7fee20100a80 2024-09-12T01:27:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee278ff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fee20110d00 con 0x7fee20101420 2024-09-12T01:27:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee278ff640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fee20111000 con 0x7fee20106a80 2024-09-12T01:27:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee2569b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20100a80 0x7fee20198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee2569b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20100a80 0x7fee20198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56342/0 (socket says 172.21.15.81:56342) 2024-09-12T01:27:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee2569b640 1 -- 172.21.15.81:0/3109127243 learned_addr learned my addr 172.21.15.81:0/3109127243 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee25e9c640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee20106a80 0x7fee2019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee2569b640 1 -- 172.21.15.81:0/3109127243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee20106a80 msgr2=0x7fee2019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee2569b640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee20106a80 0x7fee2019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee2569b640 1 -- 172.21.15.81:0/3109127243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee20101420 msgr2=0x7fee20198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee24e9a640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee20101420 0x7fee20198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee2569b640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee20101420 0x7fee20198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee2569b640 1 -- 172.21.15.81:0/3109127243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2019d3f0 con 0x7fee20100a80 2024-09-12T01:27:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee24e9a640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee20101420 0x7fee20198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee2569b640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20100a80 0x7fee20198440 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009230 tx=0x7fee1c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee167fc640 1 -- 172.21.15.81:0/3109127243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c03f030 con 0x7fee20100a80 2024-09-12T01:27:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee167fc640 1 -- 172.21.15.81:0/3109127243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee1c003ad0 con 0x7fee20100a80 2024-09-12T01:27:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee278ff640 1 -- 172.21.15.81:0/3109127243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee2019d680 con 0x7fee20100a80 2024-09-12T01:27:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee167fc640 1 -- 172.21.15.81:0/3109127243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c035070 con 0x7fee20100a80 2024-09-12T01:27:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.790+0000 7fee278ff640 1 -- 172.21.15.81:0/3109127243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee201a4fc0 con 0x7fee20100a80 2024-09-12T01:27:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.793+0000 7fee167fc640 1 -- 172.21.15.81:0/3109127243 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fee1c042030 con 0x7fee20100a80 2024-09-12T01:27:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.793+0000 7fee29cd8740 1 Processor -- start 2024-09-12T01:27:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.793+0000 7fee29cd8740 1 -- start start 2024-09-12T01:27:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.793+0000 7fee29cd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 0x5590a3a1bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.793+0000 7fee29cd8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 0x5590a3a2aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.793+0000 7fee29cd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a2afc0 0x5590a3a2d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.793+0000 7fee29cd8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5590a3982090 con 0x5590a3a1c1d0 2024-09-12T01:27:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.793+0000 7fee29cd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5590a3929a70 con 0x5590a3a1b8b0 2024-09-12T01:27:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.793+0000 7fee29cd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5590a397e050 con 0x5590a3a2afc0 2024-09-12T01:27:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee2569b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 0x5590a3a2aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee2569b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 0x5590a3a2aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56356/0 (socket says 172.21.15.81:56356) 2024-09-12T01:27:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee2569b640 1 -- 172.21.15.81:0/415114554 learned_addr learned my addr 172.21.15.81:0/415114554 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee24e9a640 1 --2- 172.21.15.81:0/415114554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a2afc0 0x5590a3a2d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee25e9c640 1 --2- 172.21.15.81:0/415114554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 0x5590a3a1bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee167fc640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fee0c0a2c90 0x7fee0c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee25e9c640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fee0c0a2c90 0x7fee0c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee2569b640 1 -- 172.21.15.81:0/415114554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a2afc0 msgr2=0x5590a3a2d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee2569b640 1 --2- 172.21.15.81:0/415114554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a2afc0 0x5590a3a2d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee2569b640 1 -- 172.21.15.81:0/415114554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 msgr2=0x5590a3a1bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee2569b640 1 --2- 172.21.15.81:0/415114554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 0x5590a3a1bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee2569b640 1 -- 172.21.15.81:0/415114554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a3936130 con 0x5590a3a1c1d0 2024-09-12T01:27:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee167fc640 1 -- 172.21.15.81:0/3109127243 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fee1c0ef6f0 con 0x7fee20100a80 2024-09-12T01:27:29.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee2569b640 1 --2- 172.21.15.81:0/415114554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 0x5590a3a2aa80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0bbb00 tx=0x7fee1c04b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a728c5542ecadff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee25e9c640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fee0c0a2c90 0x7fee0c0a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fee18005fd0 tx=0x7fee18004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee0b7fe640 1 -- 172.21.15.81:0/415114554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0c01b0 con 0x5590a3a1c1d0 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee0b7fe640 1 -- 172.21.15.81:0/415114554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee1c0c4a70 con 0x5590a3a1c1d0 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.794+0000 7fee0b7fe640 1 -- 172.21.15.81:0/415114554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c003c80 con 0x5590a3a1c1d0 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.795+0000 7fee29cd8740 1 -- 172.21.15.81:0/415114554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 msgr2=0x5590a3a2aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.795+0000 7fee29cd8740 1 --2- 172.21.15.81:0/415114554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 0x5590a3a2aa80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0bbb00 tx=0x7fee1c04b000 comp rx=0 tx=0).stop 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.795+0000 7fee29cd8740 1 -- 172.21.15.81:0/415114554 shutdown_connections 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.795+0000 7fee29cd8740 1 --2- 172.21.15.81:0/415114554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a2afc0 0x5590a3a2d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.795+0000 7fee29cd8740 1 --2- 172.21.15.81:0/415114554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 0x5590a3a2aa80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.795+0000 7fee29cd8740 1 --2- 172.21.15.81:0/415114554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 0x5590a3a1bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.795+0000 7fee29cd8740 1 -- 172.21.15.81:0/415114554 >> 172.21.15.81:0/415114554 conn(0x5590a3a17f60 msgr2=0x5590a3a18340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.795+0000 7fee29cd8740 1 -- 172.21.15.81:0/415114554 shutdown_connections 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.795+0000 7fee29cd8740 1 -- 172.21.15.81:0/415114554 wait complete. 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee29cd8740 1 -- start start 2024-09-12T01:27:29.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee29cd8740 1 Processor -- start 2024-09-12T01:27:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee29cd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 0x5590a3a2a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee29cd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1c1d0 0x5590a3a27ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee29cd8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 0x5590a3a280e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee29cd8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5590a3a2d950 con 0x5590a3a2afc0 2024-09-12T01:27:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee29cd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5590a393cf20 con 0x5590a3a1b8b0 2024-09-12T01:27:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee29cd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5590a3a2dad0 con 0x5590a3a1c1d0 2024-09-12T01:27:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee29cd8740 10 client.0 _ll_register_callbacks cb 0x5590a3906030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee25e9c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 0x5590a3a280e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee25e9c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 0x5590a3a280e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56368/0 (socket says 172.21.15.81:56368) 2024-09-12T01:27:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee25e9c640 1 -- 172.21.15.81:0/3269693374 learned_addr learned my addr 172.21.15.81:0/3269693374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:29.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee24e9a640 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1c1d0 0x5590a3a27ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee2569b640 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 0x5590a3a2a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee25e9c640 1 -- 172.21.15.81:0/3269693374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1c1d0 msgr2=0x5590a3a27ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee25e9c640 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1c1d0 0x5590a3a27ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee25e9c640 1 -- 172.21.15.81:0/3269693374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 msgr2=0x5590a3a2a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.796+0000 7fee25e9c640 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 0x5590a3a2a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee25e9c640 1 -- 172.21.15.81:0/3269693374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a36f32b0 con 0x5590a3a2afc0 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee24e9a640 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1c1d0 0x5590a3a27ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee25e9c640 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 0x5590a3a280e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fee18014300 tx=0x7fee18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c52c4948ab2d49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee08ff9640 1 -- 172.21.15.81:0/3269693374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18025070 con 0x5590a3a2afc0 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee29cd8740 1 -- 172.21.15.81:0/3269693374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee1c0c4a70 con 0x5590a3a2afc0 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee08ff9640 1 -- 172.21.15.81:0/3269693374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fee18004b20 con 0x5590a3a2afc0 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee08ff9640 1 -- 172.21.15.81:0/3269693374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fee18030050 con 0x5590a3a2afc0 2024-09-12T01:27:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee29cd8740 10 client.14988 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:29.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee29cd8740 1 -- 172.21.15.81:0/3269693374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5590a3a39240 con 0x5590a3a2afc0 2024-09-12T01:27:29.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee08ff9640 1 -- 172.21.15.81:0/3269693374 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee1c0c4a70 con 0x5590a3a2afc0 2024-09-12T01:27:29.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee08ff9640 1 -- 172.21.15.81:0/3269693374 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fee18020040 con 0x5590a3a2afc0 2024-09-12T01:27:29.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee29cd8740 10 client.14988 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:29.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.797+0000 7fee29cd8740 10 client.14988 resolve_mds: resolved name 'k' to daemon mds.k 2024-09-12T01:27:29.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.798+0000 7fee29cd8740 20 client.14988 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:29.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.798+0000 7fee29cd8740 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5590a3a3b910 0x5590a3a3cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.798+0000 7fee29cd8740 4 client.14988 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:27:29.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.798+0000 7fee29cd8740 1 -- 172.21.15.81:0/3269693374 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590a398f600 con 0x5590a3a3b910 2024-09-12T01:27:29.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.798+0000 7fee2569b640 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5590a3a3b910 0x5590a3a3cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.798+0000 7fee08ff9640 10 client.14988 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:27:29.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.798+0000 7fee2569b640 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5590a3a3b910 0x5590a3a3cd80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=46d8999fd13a55df server_cookie=24f6ab78690ca1e6 in_seq=0 out_seq=0 2024-09-12T01:27:29.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.799+0000 7fee08ff9640 1 -- 172.21.15.81:0/3269693374 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590a398f600 con 0x5590a3a3b910 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.799+0000 7fee08ff9640 10 client.14988 handle_command_reply: tid=0 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.799+0000 7fee29cd8740 1 client.14988 shutdown 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.799+0000 7fee29cd8740 1 -- 172.21.15.81:0/3269693374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 msgr2=0x5590a3a280e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.799+0000 7fee29cd8740 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 0x5590a3a280e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fee18014300 tx=0x7fee18004a40 comp rx=0 tx=0).stop 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.800+0000 7fee29cd8740 1 -- 172.21.15.81:0/3269693374 shutdown_connections 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.800+0000 7fee29cd8740 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5590a3a3b910 0x5590a3a3cd80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.800+0000 7fee29cd8740 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 0x5590a3a280e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.800+0000 7fee29cd8740 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1c1d0 0x5590a3a27ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.800+0000 7fee29cd8740 1 --2- 172.21.15.81:0/3269693374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 0x5590a3a2a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.800+0000 7fee29cd8740 1 -- 172.21.15.81:0/3269693374 >> 172.21.15.81:0/3269693374 conn(0x5590a3a17f60 msgr2=0x5590a3a1dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.800+0000 7fee08ff9640 0 client.14988 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.800+0000 7fee29cd8740 1 -- 172.21.15.81:0/3269693374 shutdown_connections 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.800+0000 7fee29cd8740 1 -- 172.21.15.81:0/3269693374 wait complete. 2024-09-12T01:27:29.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.800+0000 7fee29cd8740 20 client.14988 trim_cache size 0 max 16384 2024-09-12T01:27:29.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.817+0000 7fee29cd8740 1 Processor -- start 2024-09-12T01:27:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.817+0000 7fee29cd8740 1 -- start start 2024-09-12T01:27:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.817+0000 7fee29cd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1b8b0 0x5590a3a3b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.817+0000 7fee29cd8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 0x5590a3a3c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.817+0000 7fee29cd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a2afc0 0x5590a3a12ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.817+0000 7fee29cd8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5590a3a3b0c0 con 0x5590a3a1c1d0 2024-09-12T01:27:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.817+0000 7fee29cd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5590a3a3b790 con 0x5590a3a2afc0 2024-09-12T01:27:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.817+0000 7fee29cd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5590a3a3be60 con 0x5590a3a1b8b0 2024-09-12T01:27:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee24e9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 0x5590a3a3c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee24e9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 0x5590a3a3c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56370/0 (socket says 172.21.15.81:56370) 2024-09-12T01:27:29.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee24e9a640 1 -- 172.21.15.81:0/13218720 learned_addr learned my addr 172.21.15.81:0/13218720 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee25e9c640 1 --2- 172.21.15.81:0/13218720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a2afc0 0x5590a3a12ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee24e9a640 1 -- 172.21.15.81:0/13218720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1b8b0 msgr2=0x5590a3a3b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee24e9a640 1 --2- 172.21.15.81:0/13218720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1b8b0 0x5590a3a3b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee24e9a640 1 -- 172.21.15.81:0/13218720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a2afc0 msgr2=0x5590a3a12ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee24e9a640 1 --2- 172.21.15.81:0/13218720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a2afc0 0x5590a3a12ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee24e9a640 1 -- 172.21.15.81:0/13218720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a3a28bb0 con 0x5590a3a1c1d0 2024-09-12T01:27:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee25e9c640 1 --2- 172.21.15.81:0/13218720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a2afc0 0x5590a3a12ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee24e9a640 1 --2- 172.21.15.81:0/13218720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 0x5590a3a3c6b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fee2006b7e0 tx=0x7fee10011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd13260bf409554 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee0affd640 1 -- 172.21.15.81:0/13218720 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1000bc80 con 0x5590a3a1c1d0 2024-09-12T01:27:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee0affd640 1 -- 172.21.15.81:0/13218720 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee1000be20 con 0x5590a3a1c1d0 2024-09-12T01:27:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.818+0000 7fee0affd640 1 -- 172.21.15.81:0/13218720 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1001a790 con 0x5590a3a1c1d0 2024-09-12T01:27:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.819+0000 7fee29cd8740 1 -- 172.21.15.81:0/13218720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 msgr2=0x5590a3a3c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.819+0000 7fee29cd8740 1 --2- 172.21.15.81:0/13218720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 0x5590a3a3c6b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fee2006b7e0 tx=0x7fee10011810 comp rx=0 tx=0).stop 2024-09-12T01:27:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.819+0000 7fee29cd8740 1 -- 172.21.15.81:0/13218720 shutdown_connections 2024-09-12T01:27:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.819+0000 7fee29cd8740 1 --2- 172.21.15.81:0/13218720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a2afc0 0x5590a3a12ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.819+0000 7fee29cd8740 1 --2- 172.21.15.81:0/13218720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a1c1d0 0x5590a3a3c6b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.819+0000 7fee29cd8740 1 --2- 172.21.15.81:0/13218720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1b8b0 0x5590a3a3b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.819+0000 7fee29cd8740 1 -- 172.21.15.81:0/13218720 >> 172.21.15.81:0/13218720 conn(0x5590a3a17f60 msgr2=0x5590a3a18340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.819+0000 7fee29cd8740 1 -- 172.21.15.81:0/13218720 shutdown_connections 2024-09-12T01:27:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.819+0000 7fee29cd8740 1 -- 172.21.15.81:0/13218720 wait complete. 2024-09-12T01:27:29.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.819+0000 7fee29cd8740 1 -- start start 2024-09-12T01:27:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.819+0000 7fee29cd8740 1 Processor -- start 2024-09-12T01:27:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee29cd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 0x5590a3a45960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee29cd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1c1d0 0x5590a3a3df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee29cd8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 0x5590a3a3e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee29cd8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5590a3a3cc00 con 0x5590a3a2afc0 2024-09-12T01:27:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee29cd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5590a3a3c530 con 0x5590a3a1b8b0 2024-09-12T01:27:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee29cd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5590a3a3d2d0 con 0x5590a3a1c1d0 2024-09-12T01:27:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee29cd8740 10 client.0 _ll_register_callbacks cb 0x7fee18014ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee25e9c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 0x5590a3a3e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee25e9c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 0x5590a3a3e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56384/0 (socket says 172.21.15.81:56384) 2024-09-12T01:27:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee25e9c640 1 -- 172.21.15.81:0/921271795 learned_addr learned my addr 172.21.15.81:0/921271795 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee2569b640 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 0x5590a3a45960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee24e9a640 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1c1d0 0x5590a3a3df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee25e9c640 1 -- 172.21.15.81:0/921271795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1c1d0 msgr2=0x5590a3a3df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee25e9c640 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1c1d0 0x5590a3a3df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee25e9c640 1 -- 172.21.15.81:0/921271795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 msgr2=0x5590a3a45960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee25e9c640 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 0x5590a3a45960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee25e9c640 1 -- 172.21.15.81:0/921271795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a3a3ed50 con 0x5590a3a2afc0 2024-09-12T01:27:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee24e9a640 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1c1d0 0x5590a3a3df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee2569b640 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 0x5590a3a45960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee25e9c640 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 0x5590a3a3e520 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fee18015010 tx=0x7fee18012f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7332c0c8455411de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.820+0000 7fee08ff9640 1 -- 172.21.15.81:0/921271795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18025040 con 0x5590a3a2afc0 2024-09-12T01:27:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee08ff9640 1 -- 172.21.15.81:0/921271795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fee18011a30 con 0x5590a3a2afc0 2024-09-12T01:27:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee29cd8740 1 -- 172.21.15.81:0/921271795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee1000be20 con 0x5590a3a2afc0 2024-09-12T01:27:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee08ff9640 1 -- 172.21.15.81:0/921271795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fee1801a040 con 0x5590a3a2afc0 2024-09-12T01:27:29.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee29cd8740 10 client.14994 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:29.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee29cd8740 1 -- 172.21.15.81:0/921271795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5590a3aa50b0 con 0x5590a3a2afc0 2024-09-12T01:27:29.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee08ff9640 1 -- 172.21.15.81:0/921271795 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee1000be20 con 0x5590a3a2afc0 2024-09-12T01:27:29.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee08ff9640 1 -- 172.21.15.81:0/921271795 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fee18020040 con 0x5590a3a2afc0 2024-09-12T01:27:29.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee29cd8740 10 client.14994 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:29.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee29cd8740 10 client.14994 resolve_mds: resolved name 'k' to daemon mds.k 2024-09-12T01:27:29.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee29cd8740 20 client.14994 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:29.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee29cd8740 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5590a3aa9c20 0x5590a3aa8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:29.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee29cd8740 4 client.14994 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:27:29.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee29cd8740 1 -- 172.21.15.81:0/921271795 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "status"}) -- 0x5590a3989b10 con 0x5590a3aa9c20 2024-09-12T01:27:29.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.821+0000 7fee2569b640 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5590a3aa9c20 0x5590a3aa8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:29.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee2569b640 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5590a3aa9c20 0x5590a3aa8930 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6ccd5872879fe072 server_cookie=9fb9b0ba311ef4cb in_seq=0 out_seq=0 2024-09-12T01:27:29.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee08ff9640 10 client.14994 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:27:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee08ff9640 1 -- 172.21.15.81:0/921271795 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5590a3989b10 con 0x5590a3aa9c20 2024-09-12T01:27:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee08ff9640 10 client.14994 handle_command_reply: tid=0 2024-09-12T01:27:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee29cd8740 1 client.14994 shutdown 2024-09-12T01:27:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee29cd8740 1 -- 172.21.15.81:0/921271795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 msgr2=0x5590a3a3e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee29cd8740 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 0x5590a3a3e520 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fee18015010 tx=0x7fee18012f50 comp rx=0 tx=0).stop 2024-09-12T01:27:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee29cd8740 1 -- 172.21.15.81:0/921271795 shutdown_connections 2024-09-12T01:27:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee29cd8740 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5590a3aa9c20 0x5590a3aa8930 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee29cd8740 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590a3a2afc0 0x5590a3a3e520 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee29cd8740 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590a3a1c1d0 0x5590a3a3df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee29cd8740 1 --2- 172.21.15.81:0/921271795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5590a3a1b8b0 0x5590a3a45960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee29cd8740 1 -- 172.21.15.81:0/921271795 >> 172.21.15.81:0/921271795 conn(0x5590a3a17f60 msgr2=0x5590a3a12ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee08ff9640 0 client.14994 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:27:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee29cd8740 1 -- 172.21.15.81:0/921271795 shutdown_connections 2024-09-12T01:27:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.822+0000 7fee29cd8740 1 -- 172.21.15.81:0/921271795 wait complete. 2024-09-12T01:27:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.823+0000 7fee29cd8740 20 client.14994 trim_cache size 0 max 16384 2024-09-12T01:27:29.829 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:27:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:27:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 3, 2024-09-12T01:27:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24401, 2024-09-12T01:27:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:27:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:27:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:27:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 65.567144518999996, 2024-09-12T01:27:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T01:27:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-12T01:27:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:27:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 112.84697017000001 2024-09-12T01:27:29.830 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:27:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.823+0000 7fee278ff640 1 -- 172.21.15.81:0/3109127243 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fee0c0a2c90 msgr2=0x7fee0c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.823+0000 7fee278ff640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fee0c0a2c90 0x7fee0c0a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fee18005fd0 tx=0x7fee18004ab0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.823+0000 7fee278ff640 1 -- 172.21.15.81:0/3109127243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20100a80 msgr2=0x7fee20198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.823+0000 7fee278ff640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20100a80 0x7fee20198440 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009230 tx=0x7fee1c004270 comp rx=0 tx=0).stop 2024-09-12T01:27:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.823+0000 7fee278ff640 1 -- 172.21.15.81:0/3109127243 shutdown_connections 2024-09-12T01:27:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.823+0000 7fee278ff640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fee0c0a2c90 0x7fee0c0a5150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.823+0000 7fee278ff640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee20106a80 0x7fee2019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.823+0000 7fee278ff640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee20101420 0x7fee20198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.823+0000 7fee278ff640 1 --2- 172.21.15.81:0/3109127243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee20100a80 0x7fee20198440 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.823+0000 7fee278ff640 1 -- 172.21.15.81:0/3109127243 >> 172.21.15.81:0/3109127243 conn(0x7fee200fc7a0 msgr2=0x7fee20104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.823+0000 7fee278ff640 1 -- 172.21.15.81:0/3109127243 shutdown_connections 2024-09-12T01:27:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:29.823+0000 7fee278ff640 1 -- 172.21.15.81:0/3109127243 wait complete. 2024-09-12T01:27:30.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:29 smithi100 ceph-mon[35275]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:30.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T01:27:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:31.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.288+0000 7fc19fa9d640 1 -- 172.21.15.81:0/1773743890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc198101450 msgr2=0x7fc198105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:31.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.288+0000 7fc19fa9d640 1 --2- 172.21.15.81:0/1773743890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc198101450 0x7fc198105920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc188009900 tx=0x7fc18802a470 comp rx=0 tx=0).stop 2024-09-12T01:27:31.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.288+0000 7fc19fa9d640 1 -- 172.21.15.81:0/1773743890 shutdown_connections 2024-09-12T01:27:31.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.288+0000 7fc19fa9d640 1 --2- 172.21.15.81:0/1773743890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc198105f40 0x7fc1981063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.288+0000 7fc19fa9d640 1 --2- 172.21.15.81:0/1773743890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc198101450 0x7fc198105920 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.288+0000 7fc19fa9d640 1 --2- 172.21.15.81:0/1773743890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc198100b30 0x7fc198100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.288+0000 7fc19fa9d640 1 -- 172.21.15.81:0/1773743890 >> 172.21.15.81:0/1773743890 conn(0x7fc1980fc7a0 msgr2=0x7fc1980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:31.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.288+0000 7fc19fa9d640 1 -- 172.21.15.81:0/1773743890 shutdown_connections 2024-09-12T01:27:31.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.288+0000 7fc19fa9d640 1 -- 172.21.15.81:0/1773743890 wait complete. 2024-09-12T01:27:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19fa9d640 1 Processor -- start 2024-09-12T01:27:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19fa9d640 1 -- start start 2024-09-12T01:27:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19fa9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc198100b30 0x7fc1981a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19fa9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc198101450 0x7fc1981a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19fa9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc198105f40 0x7fc19819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19fa9d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc1981185c0 con 0x7fc198101450 2024-09-12T01:27:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19fa9d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc198118440 con 0x7fc198100b30 2024-09-12T01:27:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19fa9d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc198118740 con 0x7fc198105f40 2024-09-12T01:27:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc198101450 0x7fc1981a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc198101450 0x7fc1981a4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56408/0 (socket says 172.21.15.81:56408) 2024-09-12T01:27:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19d038640 1 -- 172.21.15.81:0/2637336722 learned_addr learned my addr 172.21.15.81:0/2637336722 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19e03a640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc198105f40 0x7fc19819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19d839640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc198100b30 0x7fc1981a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19d038640 1 -- 172.21.15.81:0/2637336722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc198105f40 msgr2=0x7fc19819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19d038640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc198105f40 0x7fc19819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19d038640 1 -- 172.21.15.81:0/2637336722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc198100b30 msgr2=0x7fc1981a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19d038640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc198100b30 0x7fc1981a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19d038640 1 -- 172.21.15.81:0/2637336722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19819f000 con 0x7fc198101450 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19e03a640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc198105f40 0x7fc19819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.289+0000 7fc19d038640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc198101450 0x7fc1981a4c50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc188005ab0 tx=0x7fc1880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.290+0000 7fc18effd640 1 -- 172.21.15.81:0/2637336722 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18803f030 con 0x7fc198101450 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.290+0000 7fc19fa9d640 1 -- 172.21.15.81:0/2637336722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19819f290 con 0x7fc198101450 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.290+0000 7fc18effd640 1 -- 172.21.15.81:0/2637336722 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc188003ce0 con 0x7fc198101450 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.290+0000 7fc18effd640 1 -- 172.21.15.81:0/2637336722 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188035070 con 0x7fc198101450 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.290+0000 7fc19fa9d640 1 -- 172.21.15.81:0/2637336722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1981ab5e0 con 0x7fc198101450 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.292+0000 7fc18effd640 1 -- 172.21.15.81:0/2637336722 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc188042030 con 0x7fc198101450 2024-09-12T01:27:31.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.292+0000 7fc1a1e76740 1 Processor -- start 2024-09-12T01:27:31.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.292+0000 7fc1a1e76740 1 -- start start 2024-09-12T01:27:31.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc1a1e76740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a527334db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc1a1e76740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a5273352f0 0x55a52733f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc1a1e76740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a52733fbb0 0x55a527341fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc1a1e76740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a52729b090 con 0x55a52733fbb0 2024-09-12T01:27:31.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc1a1e76740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a527242a70 con 0x55a5273349d0 2024-09-12T01:27:31.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc1a1e76740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a527297050 con 0x55a5273352f0 2024-09-12T01:27:31.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc18effd640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc1840a2c10 0x7fc1840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc19d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a52733fbb0 0x55a527341fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc19d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a52733fbb0 0x55a527341fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56420/0 (socket says 172.21.15.81:56420) 2024-09-12T01:27:31.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc19d038640 1 -- 172.21.15.81:0/2928543209 learned_addr learned my addr 172.21.15.81:0/2928543209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:31.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc19e03a640 1 --2- 172.21.15.81:0/2928543209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a527334db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc19d839640 1 --2- 172.21.15.81:0/2928543209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a5273352f0 0x55a52733f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc19e03a640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc1840a2c10 0x7fc1840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc18effd640 1 -- 172.21.15.81:0/2637336722 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc1880ef6f0 con 0x7fc198101450 2024-09-12T01:27:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc19d038640 1 -- 172.21.15.81:0/2928543209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a5273352f0 msgr2=0x55a52733f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc19d038640 1 --2- 172.21.15.81:0/2928543209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a5273352f0 0x55a52733f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc19d038640 1 -- 172.21.15.81:0/2928543209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 msgr2=0x55a527334db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc19d038640 1 --2- 172.21.15.81:0/2928543209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a527334db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc19d038640 1 -- 172.21.15.81:0/2928543209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a52724f130 con 0x55a52733fbb0 2024-09-12T01:27:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc19d038640 1 --2- 172.21.15.81:0/2928543209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a52733fbb0 0x55a527341fa0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ed050 tx=0x7fc18802a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa2c8d99fd710ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.293+0000 7fc19e03a640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc1840a2c10 0x7fc1840a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc190007310 tx=0x7fc1900072a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.294+0000 7fc183fff640 1 -- 172.21.15.81:0/2928543209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188049070 con 0x55a52733fbb0 2024-09-12T01:27:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.294+0000 7fc183fff640 1 -- 172.21.15.81:0/2928543209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1880bc500 con 0x55a52733fbb0 2024-09-12T01:27:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.294+0000 7fc183fff640 1 -- 172.21.15.81:0/2928543209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1880ed300 con 0x55a52733fbb0 2024-09-12T01:27:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.294+0000 7fc1a1e76740 1 -- 172.21.15.81:0/2928543209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a52733fbb0 msgr2=0x55a527341fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.294+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/2928543209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a52733fbb0 0x55a527341fa0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ed050 tx=0x7fc18802a470 comp rx=0 tx=0).stop 2024-09-12T01:27:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.294+0000 7fc1a1e76740 1 -- 172.21.15.81:0/2928543209 shutdown_connections 2024-09-12T01:27:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.294+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/2928543209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a52733fbb0 0x55a527341fa0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.294+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/2928543209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a5273352f0 0x55a52733f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.294+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/2928543209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a527334db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.294+0000 7fc1a1e76740 1 -- 172.21.15.81:0/2928543209 >> 172.21.15.81:0/2928543209 conn(0x55a527330f60 msgr2=0x55a527331340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc1a1e76740 1 -- 172.21.15.81:0/2928543209 shutdown_connections 2024-09-12T01:27:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc1a1e76740 1 -- 172.21.15.81:0/2928543209 wait complete. 2024-09-12T01:27:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc1a1e76740 1 -- start start 2024-09-12T01:27:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc1a1e76740 1 Processor -- start 2024-09-12T01:27:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc1a1e76740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273349d0 0x55a52733f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc1a1e76740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a5273352f0 0x55a52733c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc1a1e76740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a52733fbb0 0x55a52733cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc1a1e76740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a527342540 con 0x55a5273349d0 2024-09-12T01:27:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc1a1e76740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a527255f20 con 0x55a52733fbb0 2024-09-12T01:27:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc1a1e76740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a5273426c0 con 0x55a5273352f0 2024-09-12T01:27:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc1a1e76740 10 client.0 _ll_register_callbacks cb 0x55a52721f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc19d839640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273349d0 0x55a52733f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc19d839640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273349d0 0x55a52733f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56426/0 (socket says 172.21.15.81:56426) 2024-09-12T01:27:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.295+0000 7fc19d839640 1 -- 172.21.15.81:0/2096159319 learned_addr learned my addr 172.21.15.81:0/2096159319 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc19d038640 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a5273352f0 0x55a52733c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc19e03a640 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a52733fbb0 0x55a52733cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc19d839640 1 -- 172.21.15.81:0/2096159319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a5273352f0 msgr2=0x55a52733c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc19d839640 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a5273352f0 0x55a52733c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc19d839640 1 -- 172.21.15.81:0/2096159319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a52733fbb0 msgr2=0x55a52733cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc19d839640 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a52733fbb0 0x55a52733cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc19d839640 1 -- 172.21.15.81:0/2096159319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a52700c2b0 con 0x55a5273349d0 2024-09-12T01:27:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc19e03a640 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a52733fbb0 0x55a52733cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc19d839640 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273349d0 0x55a52733f430 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc194010500 tx=0x7fc1940109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205e1cfd840abe47 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc1817fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc1817fa640 1 -- 172.21.15.81:0/2096159319 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19401a020 con 0x55a5273349d0 2024-09-12T01:27:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc1a1e76740 1 -- 172.21.15.81:0/2096159319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1880bc500 con 0x55a5273349d0 2024-09-12T01:27:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc1817fa640 1 -- 172.21.15.81:0/2096159319 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc194016750 con 0x55a5273349d0 2024-09-12T01:27:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc1817fa640 1 -- 172.21.15.81:0/2096159319 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc194016950 con 0x55a5273349d0 2024-09-12T01:27:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc1a1e76740 10 client.15006 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc1a1e76740 1 -- 172.21.15.81:0/2096159319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a52734dde0 con 0x55a5273349d0 2024-09-12T01:27:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.296+0000 7fc1817fa640 1 -- 172.21.15.81:0/2096159319 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1880bc500 con 0x55a5273349d0 2024-09-12T01:27:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.297+0000 7fc1817fa640 1 -- 172.21.15.81:0/2096159319 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc194014ce0 con 0x55a5273349d0 2024-09-12T01:27:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.297+0000 7fc1a1e76740 10 client.15006 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.297+0000 7fc1a1e76740 10 client.15006 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.297+0000 7fc1a1e76740 20 client.15006 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.297+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a5273504c0 0x55a527351930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.297+0000 7fc1a1e76740 4 client.15006 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.297+0000 7fc1a1e76740 1 -- 172.21.15.81:0/2096159319 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5272a8600 con 0x55a5273504c0 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.297+0000 7fc19d038640 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a5273504c0 0x55a527351930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.297+0000 7fc19d038640 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a5273504c0 0x55a527351930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a3c334c5ba7106c2 server_cookie=ba9a5b656d662870 in_seq=0 out_seq=0 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.297+0000 7fc1817fa640 10 client.15006 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1817fa640 1 -- 172.21.15.81:0/2096159319 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5272a8600 con 0x55a5273504c0 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1817fa640 10 client.15006 handle_command_reply: tid=0 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1a1e76740 1 client.15006 shutdown 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1a1e76740 1 -- 172.21.15.81:0/2096159319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273349d0 msgr2=0x55a52733f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273349d0 0x55a52733f430 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc194010500 tx=0x7fc1940109c0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1a1e76740 1 -- 172.21.15.81:0/2096159319 shutdown_connections 2024-09-12T01:27:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a5273504c0 0x55a527351930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a52733fbb0 0x55a52733cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a5273352f0 0x55a52733c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/2096159319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273349d0 0x55a52733f430 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1817fa640 0 client.15006 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:27:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1a1e76740 1 -- 172.21.15.81:0/2096159319 >> 172.21.15.81:0/2096159319 conn(0x55a527330f60 msgr2=0x55a527336c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1a1e76740 1 -- 172.21.15.81:0/2096159319 shutdown_connections 2024-09-12T01:27:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.298+0000 7fc1a1e76740 1 -- 172.21.15.81:0/2096159319 wait complete. 2024-09-12T01:27:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.299+0000 7fc1a1e76740 20 client.15006 trim_cache size 0 max 16384 2024-09-12T01:27:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc1a1e76740 1 Processor -- start 2024-09-12T01:27:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc1a1e76740 1 -- start start 2024-09-12T01:27:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc1a1e76740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a52734aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc1a1e76740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 0x55a52734b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc1a1e76740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a52733fbb0 0x55a527359c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc1a1e76740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a52734fc70 con 0x55a5273352f0 2024-09-12T01:27:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc1a1e76740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a527350340 con 0x55a5273349d0 2024-09-12T01:27:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc1a1e76740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a527350a10 con 0x55a52733fbb0 2024-09-12T01:27:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc19d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 0x55a52734b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc19d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 0x55a52734b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56428/0 (socket says 172.21.15.81:56428) 2024-09-12T01:27:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc19d038640 1 -- 172.21.15.81:0/630196032 learned_addr learned my addr 172.21.15.81:0/630196032 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc19d038640 1 -- 172.21.15.81:0/630196032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a52733fbb0 msgr2=0x55a527359c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc19e03a640 1 --2- 172.21.15.81:0/630196032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a52733fbb0 0x55a527359c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc19d839640 1 --2- 172.21.15.81:0/630196032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a52734aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc19d038640 1 --2- 172.21.15.81:0/630196032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a52733fbb0 0x55a527359c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc19d038640 1 -- 172.21.15.81:0/630196032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 msgr2=0x55a52734aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc19d038640 1 --2- 172.21.15.81:0/630196032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a52734aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc19d038640 1 -- 172.21.15.81:0/630196032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a52733ad40 con 0x55a5273352f0 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc19e03a640 1 --2- 172.21.15.81:0/630196032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a52733fbb0 0x55a527359c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.316+0000 7fc19d839640 1 --2- 172.21.15.81:0/630196032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a52734aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.317+0000 7fc19d038640 1 --2- 172.21.15.81:0/630196032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 0x55a52734b530 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ed630 tx=0x7fc1880bbd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6094d00a11aefae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.317+0000 7fc1837fe640 1 -- 172.21.15.81:0/630196032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1880d8070 con 0x55a5273352f0 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.317+0000 7fc1837fe640 1 -- 172.21.15.81:0/630196032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1880c01b0 con 0x55a5273352f0 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.317+0000 7fc1837fe640 1 -- 172.21.15.81:0/630196032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188049040 con 0x55a5273352f0 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.317+0000 7fc1a1e76740 1 -- 172.21.15.81:0/630196032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 msgr2=0x55a52734b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.317+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/630196032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 0x55a52734b530 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ed630 tx=0x7fc1880bbd00 comp rx=0 tx=0).stop 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.317+0000 7fc1a1e76740 1 -- 172.21.15.81:0/630196032 shutdown_connections 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.317+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/630196032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a52733fbb0 0x55a527359c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.317+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/630196032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 0x55a52734b530 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.317+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/630196032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a52734aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.317+0000 7fc1a1e76740 1 -- 172.21.15.81:0/630196032 >> 172.21.15.81:0/630196032 conn(0x55a527330f60 msgr2=0x55a52734f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.317+0000 7fc1a1e76740 1 -- 172.21.15.81:0/630196032 shutdown_connections 2024-09-12T01:27:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.317+0000 7fc1a1e76740 1 -- 172.21.15.81:0/630196032 wait complete. 2024-09-12T01:27:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc1a1e76740 1 -- start start 2024-09-12T01:27:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc1a1e76740 1 Processor -- start 2024-09-12T01:27:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc1a1e76740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a527354d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc1a1e76740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 0x55a527355240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc1a1e76740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a52733fbb0 0x55a5273b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc1a1e76740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a5273517b0 con 0x55a5273352f0 2024-09-12T01:27:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc1a1e76740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a5273510e0 con 0x55a5273349d0 2024-09-12T01:27:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc1a1e76740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a527351e80 con 0x55a52733fbb0 2024-09-12T01:27:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc1a1e76740 10 client.0 _ll_register_callbacks cb 0x7fc19400b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc19d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 0x55a527355240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc19d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 0x55a527355240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56444/0 (socket says 172.21.15.81:56444) 2024-09-12T01:27:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc19d038640 1 -- 172.21.15.81:0/3207767047 learned_addr learned my addr 172.21.15.81:0/3207767047 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc19e03a640 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a52733fbb0 0x55a5273b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc19d839640 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a527354d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc19d038640 1 -- 172.21.15.81:0/3207767047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a52733fbb0 msgr2=0x55a5273b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.318+0000 7fc19d038640 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a52733fbb0 0x55a5273b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc19d038640 1 -- 172.21.15.81:0/3207767047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 msgr2=0x55a527354d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc19d038640 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a527354d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc19d038640 1 -- 172.21.15.81:0/3207767047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5273b9100 con 0x55a5273352f0 2024-09-12T01:27:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc19d839640 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a527354d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc19d038640 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 0x55a527355240 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ba0b0 tx=0x7fc18803b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1285a087bbfb694 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1817fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1817fa640 1 -- 172.21.15.81:0/3207767047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1880d8070 con 0x55a5273352f0 2024-09-12T01:27:31.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1817fa640 1 -- 172.21.15.81:0/3207767047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc18803b460 con 0x55a5273352f0 2024-09-12T01:27:31.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1a1e76740 1 -- 172.21.15.81:0/3207767047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1880c01b0 con 0x55a5273352f0 2024-09-12T01:27:31.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1817fa640 1 -- 172.21.15.81:0/3207767047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc188049030 con 0x55a5273352f0 2024-09-12T01:27:31.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1a1e76740 10 client.15012 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:31.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1a1e76740 1 -- 172.21.15.81:0/3207767047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a5273ba230 con 0x55a5273352f0 2024-09-12T01:27:31.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1817fa640 1 -- 172.21.15.81:0/3207767047 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1880c01b0 con 0x55a5273352f0 2024-09-12T01:27:31.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1817fa640 1 -- 172.21.15.81:0/3207767047 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc1880b8470 con 0x55a5273352f0 2024-09-12T01:27:31.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1a1e76740 10 client.15012 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:31.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1a1e76740 10 client.15012 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:27:31.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1a1e76740 20 client.15012 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:31.340 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:27:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:27:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-12T01:27:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24446, 2024-09-12T01:27:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:27:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:27:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:27:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 67.849027337999999, 2024-09-12T01:27:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T01:27:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-12T01:27:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:27:31.340 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 97.954886709999997 2024-09-12T01:27:31.341 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:27:31.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a5273be950 0x55a5273bd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:31.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1a1e76740 4 client.15012 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:27:31.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.319+0000 7fc1a1e76740 1 -- 172.21.15.81:0/3207767047 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "status"}) -- 0x55a5272a2b10 con 0x55a5273be950 2024-09-12T01:27:31.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.320+0000 7fc19d839640 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a5273be950 0x55a5273bd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:31.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.320+0000 7fc19d839640 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a5273be950 0x55a5273bd660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee79b88bb8a28193 server_cookie=5bc87c8f9fb3165f in_seq=0 out_seq=0 2024-09-12T01:27:31.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.320+0000 7fc1817fa640 10 client.15012 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:27:31.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.320+0000 7fc1817fa640 1 -- 172.21.15.81:0/3207767047 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a5272a2b10 con 0x55a5273be950 2024-09-12T01:27:31.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.320+0000 7fc1817fa640 10 client.15012 handle_command_reply: tid=0 2024-09-12T01:27:31.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.320+0000 7fc1a1e76740 1 client.15012 shutdown 2024-09-12T01:27:31.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.320+0000 7fc1a1e76740 1 -- 172.21.15.81:0/3207767047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 msgr2=0x55a527355240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:31.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.320+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 0x55a527355240 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ba0b0 tx=0x7fc18803b720 comp rx=0 tx=0).stop 2024-09-12T01:27:31.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc1a1e76740 1 -- 172.21.15.81:0/3207767047 shutdown_connections 2024-09-12T01:27:31.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a5273be950 0x55a5273bd660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a52733fbb0 0x55a5273b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5273352f0 0x55a527355240 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc1a1e76740 1 --2- 172.21.15.81:0/3207767047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5273349d0 0x55a527354d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc1817fa640 0 client.15012 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:27:31.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc1a1e76740 1 -- 172.21.15.81:0/3207767047 >> 172.21.15.81:0/3207767047 conn(0x55a527330f60 msgr2=0x55a52733de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:31.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc1a1e76740 1 -- 172.21.15.81:0/3207767047 shutdown_connections 2024-09-12T01:27:31.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc1a1e76740 1 -- 172.21.15.81:0/3207767047 wait complete. 2024-09-12T01:27:31.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc1a1e76740 20 client.15012 trim_cache size 0 max 16384 2024-09-12T01:27:31.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc19fa9d640 1 -- 172.21.15.81:0/2637336722 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc1840a2c10 msgr2=0x7fc1840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:31.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc19fa9d640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc1840a2c10 0x7fc1840a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc190007310 tx=0x7fc1900072a0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc19fa9d640 1 -- 172.21.15.81:0/2637336722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc198101450 msgr2=0x7fc1981a4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc19fa9d640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc198101450 0x7fc1981a4c50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc188005ab0 tx=0x7fc1880042f0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc19fa9d640 1 -- 172.21.15.81:0/2637336722 shutdown_connections 2024-09-12T01:27:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc19fa9d640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fc1840a2c10 0x7fc1840a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc19fa9d640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc198105f40 0x7fc19819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc19fa9d640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc198101450 0x7fc1981a4c50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc19fa9d640 1 --2- 172.21.15.81:0/2637336722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc198100b30 0x7fc1981a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc19fa9d640 1 -- 172.21.15.81:0/2637336722 >> 172.21.15.81:0/2637336722 conn(0x7fc1980fc7a0 msgr2=0x7fc19810f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.321+0000 7fc19fa9d640 1 -- 172.21.15.81:0/2637336722 shutdown_connections 2024-09-12T01:27:31.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:31.322+0000 7fc19fa9d640 1 -- 172.21.15.81:0/2637336722 wait complete. 2024-09-12T01:27:31.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:31 smithi189 ceph-mon[35357]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:31.903 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:31 smithi081 ceph-mon[30920]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:31.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T01:27:32.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:31 smithi100 ceph-mon[35275]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:32.173 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:32.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.664+0000 7faadb31c640 1 -- 172.21.15.81:0/1944701203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4102790 msgr2=0x7faad41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:32.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.664+0000 7faadb31c640 1 --2- 172.21.15.81:0/1944701203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4102790 0x7faad41067e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faac8009900 tx=0x7faac802a410 comp rx=0 tx=0).stop 2024-09-12T01:27:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.664+0000 7faadb31c640 1 -- 172.21.15.81:0/1944701203 shutdown_connections 2024-09-12T01:27:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.664+0000 7faadb31c640 1 --2- 172.21.15.81:0/1944701203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faad4106f10 0x7faad410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.664+0000 7faadb31c640 1 --2- 172.21.15.81:0/1944701203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4102790 0x7faad41067e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.664+0000 7faadb31c640 1 --2- 172.21.15.81:0/1944701203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faad4101de0 0x7faad41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.664+0000 7faadb31c640 1 -- 172.21.15.81:0/1944701203 >> 172.21.15.81:0/1944701203 conn(0x7faad40fd8c0 msgr2=0x7faad40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.664+0000 7faadb31c640 1 -- 172.21.15.81:0/1944701203 shutdown_connections 2024-09-12T01:27:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.664+0000 7faadb31c640 1 -- 172.21.15.81:0/1944701203 wait complete. 2024-09-12T01:27:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.664+0000 7faadb31c640 1 Processor -- start 2024-09-12T01:27:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.664+0000 7faadb31c640 1 -- start start 2024-09-12T01:27:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faadb31c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faad4101de0 0x7faad41985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faadb31c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faad4102790 0x7faad4198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faadb31c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4106f10 0x7faad419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faadb31c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faad4112010 con 0x7faad4106f10 2024-09-12T01:27:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faadb31c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faad4111e90 con 0x7faad4101de0 2024-09-12T01:27:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faadb31c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faad4112190 con 0x7faad4102790 2024-09-12T01:27:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faad98b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4106f10 0x7faad419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faad98b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4106f10 0x7faad419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44974/0 (socket says 172.21.15.81:44974) 2024-09-12T01:27:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faad98b9640 1 -- 172.21.15.81:0/3338635013 learned_addr learned my addr 172.21.15.81:0/3338635013 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faad98b9640 1 -- 172.21.15.81:0/3338635013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faad4102790 msgr2=0x7faad4198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faad98b9640 1 --2- 172.21.15.81:0/3338635013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faad4102790 0x7faad4198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faad98b9640 1 -- 172.21.15.81:0/3338635013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faad4101de0 msgr2=0x7faad41985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faad98b9640 1 --2- 172.21.15.81:0/3338635013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faad4101de0 0x7faad41985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faad98b9640 1 -- 172.21.15.81:0/3338635013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad419d560 con 0x7faad4106f10 2024-09-12T01:27:32.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faad98b9640 1 --2- 172.21.15.81:0/3338635013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4106f10 0x7faad419ce80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faacc00b970 tx=0x7faacc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:32.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faac67fc640 1 -- 172.21.15.81:0/3338635013 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc019070 con 0x7faad4106f10 2024-09-12T01:27:32.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faadb31c640 1 -- 172.21.15.81:0/3338635013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad419d850 con 0x7faad4106f10 2024-09-12T01:27:32.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faac67fc640 1 -- 172.21.15.81:0/3338635013 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faacc00cb40 con 0x7faad4106f10 2024-09-12T01:27:32.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faac67fc640 1 -- 172.21.15.81:0/3338635013 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc007650 con 0x7faad4106f10 2024-09-12T01:27:32.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.665+0000 7faadb31c640 1 -- 172.21.15.81:0/3338635013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad41a5130 con 0x7faad4106f10 2024-09-12T01:27:32.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.668+0000 7faac67fc640 1 -- 172.21.15.81:0/3338635013 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faacc01c070 con 0x7faad4106f10 2024-09-12T01:27:32.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.668+0000 7faadd6f5740 1 Processor -- start 2024-09-12T01:27:32.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.668+0000 7faadd6f5740 1 -- start start 2024-09-12T01:27:32.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.668+0000 7faadd6f5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544e8b0 0x55a44544ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.668+0000 7faadd6f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44544f1d0 0x55a44545da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.668+0000 7faadd6f5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44545dfc0 0x55a4454603b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.668+0000 7faadd6f5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a4453b5090 con 0x55a44544e8b0 2024-09-12T01:27:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.668+0000 7faadd6f5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a44535ca70 con 0x55a44545dfc0 2024-09-12T01:27:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.668+0000 7faadd6f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a4453b1050 con 0x55a44544f1d0 2024-09-12T01:27:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faad88b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544e8b0 0x55a44544ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faac67fc640 1 --2- 172.21.15.81:0/3338635013 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7faac00a2c10 0x7faac00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faad88b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544e8b0 0x55a44544ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44984/0 (socket says 172.21.15.81:44984) 2024-09-12T01:27:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faad88b7640 1 -- 172.21.15.81:0/431434946 learned_addr learned my addr 172.21.15.81:0/431434946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faad90b8640 1 --2- 172.21.15.81:0/431434946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44544f1d0 0x55a44545da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faad98b9640 1 --2- 172.21.15.81:0/3338635013 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7faac00a2c10 0x7faac00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faad88b7640 1 -- 172.21.15.81:0/431434946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44544f1d0 msgr2=0x55a44545da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faad88b7640 1 --2- 172.21.15.81:0/431434946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44544f1d0 0x55a44545da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faad88b7640 1 -- 172.21.15.81:0/431434946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44545dfc0 msgr2=0x55a4454603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faad88b7640 1 --2- 172.21.15.81:0/431434946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44545dfc0 0x55a4454603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faad88b7640 1 -- 172.21.15.81:0/431434946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a445369130 con 0x55a44544e8b0 2024-09-12T01:27:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faad90b8640 1 --2- 172.21.15.81:0/431434946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44544f1d0 0x55a44545da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faac67fc640 1 -- 172.21.15.81:0/3338635013 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7faacc0ce750 con 0x7faad4106f10 2024-09-12T01:27:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faad88b7640 1 --2- 172.21.15.81:0/431434946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544e8b0 0x55a44544ec90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faac802a930 tx=0x7faac8032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803194aa6d6a462d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faad98b9640 1 --2- 172.21.15.81:0/3338635013 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7faac00a2c10 0x7faac00a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faacc06e000 tx=0x7faacc0c5b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faabf7fe640 1 -- 172.21.15.81:0/431434946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8040070 con 0x55a44544e8b0 2024-09-12T01:27:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faabf7fe640 1 -- 172.21.15.81:0/431434946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faac8032e20 con 0x55a44544e8b0 2024-09-12T01:27:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.669+0000 7faabf7fe640 1 -- 172.21.15.81:0/431434946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8035040 con 0x55a44544e8b0 2024-09-12T01:27:32.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.670+0000 7faadd6f5740 1 -- 172.21.15.81:0/431434946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544e8b0 msgr2=0x55a44544ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.670+0000 7faadd6f5740 1 --2- 172.21.15.81:0/431434946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544e8b0 0x55a44544ec90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faac802a930 tx=0x7faac8032c30 comp rx=0 tx=0).stop 2024-09-12T01:27:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.670+0000 7faadd6f5740 1 -- 172.21.15.81:0/431434946 shutdown_connections 2024-09-12T01:27:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.670+0000 7faadd6f5740 1 --2- 172.21.15.81:0/431434946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44545dfc0 0x55a4454603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.670+0000 7faadd6f5740 1 --2- 172.21.15.81:0/431434946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44544f1d0 0x55a44545da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.670+0000 7faadd6f5740 1 --2- 172.21.15.81:0/431434946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544e8b0 0x55a44544ec90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.670+0000 7faadd6f5740 1 -- 172.21.15.81:0/431434946 >> 172.21.15.81:0/431434946 conn(0x55a44544af60 msgr2=0x55a44544b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:32.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.670+0000 7faadd6f5740 1 -- 172.21.15.81:0/431434946 shutdown_connections 2024-09-12T01:27:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.670+0000 7faadd6f5740 1 -- 172.21.15.81:0/431434946 wait complete. 2024-09-12T01:27:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.670+0000 7faadd6f5740 1 -- start start 2024-09-12T01:27:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.670+0000 7faadd6f5740 1 Processor -- start 2024-09-12T01:27:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faadd6f5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544e8b0 0x55a44545d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faadd6f5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 0x55a44545abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faadd6f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44545dfc0 0x55a44545b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faadd6f5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a445460b90 con 0x55a44544f1d0 2024-09-12T01:27:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faadd6f5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a44536ff20 con 0x55a44544e8b0 2024-09-12T01:27:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faadd6f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a445460d10 con 0x55a44545dfc0 2024-09-12T01:27:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faadd6f5740 10 client.0 _ll_register_callbacks cb 0x55a445339030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faad90b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 0x55a44545abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faad90b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 0x55a44545abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44988/0 (socket says 172.21.15.81:44988) 2024-09-12T01:27:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faad90b8640 1 -- 172.21.15.81:0/1813566125 learned_addr learned my addr 172.21.15.81:0/1813566125 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:32.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faad88b7640 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544e8b0 0x55a44545d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faad88b7640 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44545dfc0 0x55a44545b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faad90b8640 1 -- 172.21.15.81:0/1813566125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44545dfc0 msgr2=0x55a44545b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:32.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faad90b8640 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44545dfc0 0x55a44545b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faad90b8640 1 -- 172.21.15.81:0/1813566125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544e8b0 msgr2=0x55a44545d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:32.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faad90b8640 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544e8b0 0x55a44545d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faad90b8640 1 -- 172.21.15.81:0/1813566125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4451262b0 con 0x55a44544f1d0 2024-09-12T01:27:32.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faad88b7640 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44545dfc0 0x55a44545b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:32.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faad90b8640 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 0x55a44545abb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7faad000d190 tx=0x7faad000d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f421fe49f6f72bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:32.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faabcff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:32.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.671+0000 7faabcff9640 1 -- 172.21.15.81:0/1813566125 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad00125f0 con 0x55a44544f1d0 2024-09-12T01:27:32.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faabcff9640 1 -- 172.21.15.81:0/1813566125 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7faad0012790 con 0x55a44544f1d0 2024-09-12T01:27:32.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faadd6f5740 1 -- 172.21.15.81:0/1813566125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faac8032e20 con 0x55a44544f1d0 2024-09-12T01:27:32.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faabcff9640 1 -- 172.21.15.81:0/1813566125 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faad0012990 con 0x55a44544f1d0 2024-09-12T01:27:32.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faadd6f5740 10 client.15024 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:32.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faadd6f5740 1 -- 172.21.15.81:0/1813566125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a44546c550 con 0x55a44544f1d0 2024-09-12T01:27:32.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faabcff9640 1 -- 172.21.15.81:0/1813566125 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faac8032e20 con 0x55a44544f1d0 2024-09-12T01:27:32.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faabcff9640 1 -- 172.21.15.81:0/1813566125 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7faad001fce0 con 0x55a44544f1d0 2024-09-12T01:27:32.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faadd6f5740 10 client.15024 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:32.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faadd6f5740 10 client.15024 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:27:32.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faadd6f5740 20 client.15024 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:32.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faadd6f5740 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55a44546ec00 0x55a445470070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faadd6f5740 4 client.15024 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:27:32.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faadd6f5740 1 -- 172.21.15.81:0/1813566125 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4453c2600 con 0x55a44546ec00 2024-09-12T01:27:32.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.672+0000 7faad88b7640 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55a44546ec00 0x55a445470070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.673+0000 7faabcff9640 10 client.15024 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:27:32.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.673+0000 7faad88b7640 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55a44546ec00 0x55a445470070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b2cf3c8d3be6ae02 server_cookie=8d3598adbea1470a in_seq=0 out_seq=0 2024-09-12T01:27:32.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faabcff9640 1 -- 172.21.15.81:0/1813566125 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4453c2600 con 0x55a44546ec00 2024-09-12T01:27:32.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faabcff9640 10 client.15024 handle_command_reply: tid=0 2024-09-12T01:27:32.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faadd6f5740 1 client.15024 shutdown 2024-09-12T01:27:32.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faadd6f5740 1 -- 172.21.15.81:0/1813566125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 msgr2=0x55a44545abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:32.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faadd6f5740 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 0x55a44545abb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7faad000d190 tx=0x7faad000d650 comp rx=0 tx=0).stop 2024-09-12T01:27:32.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faadd6f5740 1 -- 172.21.15.81:0/1813566125 shutdown_connections 2024-09-12T01:27:32.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faadd6f5740 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44545dfc0 0x55a44545b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faadd6f5740 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55a44546ec00 0x55a445470070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faadd6f5740 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 0x55a44545abb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faadd6f5740 1 --2- 172.21.15.81:0/1813566125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544e8b0 0x55a44545d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faabcff9640 0 client.15024 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:27:32.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faadd6f5740 1 -- 172.21.15.81:0/1813566125 >> 172.21.15.81:0/1813566125 conn(0x55a44544af60 msgr2=0x55a445450cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:32.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faadd6f5740 1 -- 172.21.15.81:0/1813566125 shutdown_connections 2024-09-12T01:27:32.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faadd6f5740 1 -- 172.21.15.81:0/1813566125 wait complete. 2024-09-12T01:27:32.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.674+0000 7faadd6f5740 20 client.15024 trim_cache size 0 max 16384 2024-09-12T01:27:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faadd6f5740 1 Processor -- start 2024-09-12T01:27:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faadd6f5740 1 -- start start 2024-09-12T01:27:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faadd6f5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544e8b0 0x55a445457e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faadd6f5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 0x55a445458350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faadd6f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44545dfc0 0x55a445459480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faadd6f5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a44546e3b0 con 0x55a44544f1d0 2024-09-12T01:27:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faadd6f5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a44546ea80 con 0x55a44544e8b0 2024-09-12T01:27:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faadd6f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a44546f150 con 0x55a44545dfc0 2024-09-12T01:27:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faad90b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 0x55a445458350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faad90b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 0x55a445458350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44990/0 (socket says 172.21.15.81:44990) 2024-09-12T01:27:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faad90b8640 1 -- 172.21.15.81:0/1465101503 learned_addr learned my addr 172.21.15.81:0/1465101503 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faad88b7640 1 --2- 172.21.15.81:0/1465101503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544e8b0 0x55a445457e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faad90b8640 1 -- 172.21.15.81:0/1465101503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44545dfc0 msgr2=0x55a445459480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faad90b8640 1 --2- 172.21.15.81:0/1465101503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44545dfc0 0x55a445459480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faad90b8640 1 -- 172.21.15.81:0/1465101503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544e8b0 msgr2=0x55a445457e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:32.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faad90b8640 1 --2- 172.21.15.81:0/1465101503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544e8b0 0x55a445457e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faad90b8640 1 -- 172.21.15.81:0/1465101503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a44545d480 con 0x55a44544f1d0 2024-09-12T01:27:32.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faad90b8640 1 --2- 172.21.15.81:0/1465101503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 0x55a445458350 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7faad0007280 tx=0x7faad00072b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d12a153f01f682 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:32.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.692+0000 7faabeffd640 1 -- 172.21.15.81:0/1465101503 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad000de80 con 0x55a44544f1d0 2024-09-12T01:27:32.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.693+0000 7faabeffd640 1 -- 172.21.15.81:0/1465101503 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faad0018070 con 0x55a44544f1d0 2024-09-12T01:27:32.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.693+0000 7faabeffd640 1 -- 172.21.15.81:0/1465101503 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad0013b60 con 0x55a44544f1d0 2024-09-12T01:27:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.693+0000 7faadd6f5740 1 -- 172.21.15.81:0/1465101503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 msgr2=0x55a445458350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.693+0000 7faadd6f5740 1 --2- 172.21.15.81:0/1465101503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 0x55a445458350 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7faad0007280 tx=0x7faad00072b0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.693+0000 7faadd6f5740 1 -- 172.21.15.81:0/1465101503 shutdown_connections 2024-09-12T01:27:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.693+0000 7faadd6f5740 1 --2- 172.21.15.81:0/1465101503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44545dfc0 0x55a445459480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.693+0000 7faadd6f5740 1 --2- 172.21.15.81:0/1465101503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44544f1d0 0x55a445458350 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.693+0000 7faadd6f5740 1 --2- 172.21.15.81:0/1465101503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544e8b0 0x55a445457e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.693+0000 7faadd6f5740 1 -- 172.21.15.81:0/1465101503 >> 172.21.15.81:0/1465101503 conn(0x55a44544af60 msgr2=0x55a445456240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.693+0000 7faadd6f5740 1 -- 172.21.15.81:0/1465101503 shutdown_connections 2024-09-12T01:27:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.693+0000 7faadd6f5740 1 -- 172.21.15.81:0/1465101503 wait complete. 2024-09-12T01:27:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.693+0000 7faadd6f5740 1 -- start start 2024-09-12T01:27:32.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faadd6f5740 1 Processor -- start 2024-09-12T01:27:32.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faadd6f5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44544e8b0 0x55a4454786d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faadd6f5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544f1d0 0x55a445478c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faadd6f5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44545dfc0 0x55a445471bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faadd6f5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a44546fef0 con 0x55a44545dfc0 2024-09-12T01:27:32.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faadd6f5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a44546f820 con 0x55a44544f1d0 2024-09-12T01:27:32.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faadd6f5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a4454705c0 con 0x55a44544e8b0 2024-09-12T01:27:32.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faadd6f5740 10 client.0 _ll_register_callbacks cb 0x7faad0007120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:32.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faad88b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44545dfc0 0x55a445471bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faad88b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44545dfc0 0x55a445471bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45006/0 (socket says 172.21.15.81:45006) 2024-09-12T01:27:32.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faad88b7640 1 -- 172.21.15.81:0/4152170774 learned_addr learned my addr 172.21.15.81:0/4152170774 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:32.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faad90b8640 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544f1d0 0x55a445478c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faad88b7640 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44544e8b0 0x55a4454786d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faad88b7640 1 -- 172.21.15.81:0/4152170774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44544e8b0 msgr2=0x55a4454786d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:32.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faad88b7640 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44544e8b0 0x55a4454786d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faad88b7640 1 -- 172.21.15.81:0/4152170774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544f1d0 msgr2=0x55a445478c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:32.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faad88b7640 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544f1d0 0x55a445478c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faad88b7640 1 -- 172.21.15.81:0/4152170774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4454723e0 con 0x55a44545dfc0 2024-09-12T01:27:32.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.694+0000 7faad90b8640 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544f1d0 0x55a445478c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:32.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faad88b7640 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44545dfc0 0x55a445471bb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7faac80057c0 tx=0x7faac8005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680b2140453d0f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:32.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faabcff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faabcff9640 1 -- 172.21.15.81:0/4152170774 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8035040 con 0x55a44545dfc0 2024-09-12T01:27:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faabcff9640 1 -- 172.21.15.81:0/4152170774 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7faac80039a0 con 0x55a44545dfc0 2024-09-12T01:27:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faadd6f5740 1 -- 172.21.15.81:0/4152170774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faad0018070 con 0x55a44545dfc0 2024-09-12T01:27:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faabcff9640 1 -- 172.21.15.81:0/4152170774 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faac8040040 con 0x55a44545dfc0 2024-09-12T01:27:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faadd6f5740 10 client.15030 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faadd6f5740 1 -- 172.21.15.81:0/4152170774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a445476e90 con 0x55a44545dfc0 2024-09-12T01:27:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faabcff9640 1 -- 172.21.15.81:0/4152170774 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faad0018070 con 0x55a44545dfc0 2024-09-12T01:27:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faabcff9640 1 -- 172.21.15.81:0/4152170774 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7faac8031cd0 con 0x55a44545dfc0 2024-09-12T01:27:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faadd6f5740 10 client.15030 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faadd6f5740 10 client.15030 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:27:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faadd6f5740 20 client.15030 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faadd6f5740 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55a4454dd750 0x55a4454dc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faadd6f5740 4 client.15030 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:27:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.695+0000 7faadd6f5740 1 -- 172.21.15.81:0/4152170774 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "status"}) -- 0x55a4453bcb10 con 0x55a4454dd750 2024-09-12T01:27:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faad90b8640 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55a4454dd750 0x55a4454dc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faad90b8640 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55a4454dd750 0x55a4454dc460 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d93066428c5505fe server_cookie=a63f2dd962bc0371 in_seq=0 out_seq=0 2024-09-12T01:27:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faabcff9640 10 client.15030 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:27:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faabcff9640 1 -- 172.21.15.81:0/4152170774 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a4453bcb10 con 0x55a4454dd750 2024-09-12T01:27:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faabcff9640 10 client.15030 handle_command_reply: tid=0 2024-09-12T01:27:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faadd6f5740 1 client.15030 shutdown 2024-09-12T01:27:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faadd6f5740 1 -- 172.21.15.81:0/4152170774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44545dfc0 msgr2=0x55a445471bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faadd6f5740 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44545dfc0 0x55a445471bb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7faac80057c0 tx=0x7faac8005d50 comp rx=0 tx=0).stop 2024-09-12T01:27:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faadd6f5740 1 -- 172.21.15.81:0/4152170774 shutdown_connections 2024-09-12T01:27:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faadd6f5740 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55a4454dd750 0x55a4454dc460 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faadd6f5740 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a44545dfc0 0x55a445471bb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faadd6f5740 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a44544f1d0 0x55a445478c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faadd6f5740 1 --2- 172.21.15.81:0/4152170774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a44544e8b0 0x55a4454786d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faadd6f5740 1 -- 172.21.15.81:0/4152170774 >> 172.21.15.81:0/4152170774 conn(0x55a44544af60 msgr2=0x55a44545c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:32.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faabcff9640 0 client.15030 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:27:32.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faadd6f5740 1 -- 172.21.15.81:0/4152170774 shutdown_connections 2024-09-12T01:27:32.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.696+0000 7faadd6f5740 1 -- 172.21.15.81:0/4152170774 wait complete. 2024-09-12T01:27:32.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.697+0000 7faadd6f5740 20 client.15030 trim_cache size 0 max 16384 2024-09-12T01:27:32.716 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:27:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:27:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-12T01:27:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24448, 2024-09-12T01:27:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:27:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:27:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:27:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 70.231626697999999, 2024-09-12T01:27:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T01:27:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-12T01:27:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:27:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 96.880869356999995 2024-09-12T01:27:32.718 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:27:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.697+0000 7faadb31c640 1 -- 172.21.15.81:0/3338635013 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7faac00a2c10 msgr2=0x7faac00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.697+0000 7faadb31c640 1 --2- 172.21.15.81:0/3338635013 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7faac00a2c10 0x7faac00a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faacc06e000 tx=0x7faacc0c5b00 comp rx=0 tx=0).stop 2024-09-12T01:27:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.697+0000 7faadb31c640 1 -- 172.21.15.81:0/3338635013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4106f10 msgr2=0x7faad419ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.697+0000 7faadb31c640 1 --2- 172.21.15.81:0/3338635013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4106f10 0x7faad419ce80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faacc00b970 tx=0x7faacc00be30 comp rx=0 tx=0).stop 2024-09-12T01:27:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.697+0000 7faadb31c640 1 -- 172.21.15.81:0/3338635013 shutdown_connections 2024-09-12T01:27:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.697+0000 7faadb31c640 1 --2- 172.21.15.81:0/3338635013 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7faac00a2c10 0x7faac00a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.697+0000 7faadb31c640 1 --2- 172.21.15.81:0/3338635013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faad4106f10 0x7faad419ce80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.697+0000 7faadb31c640 1 --2- 172.21.15.81:0/3338635013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faad4102790 0x7faad4198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.697+0000 7faadb31c640 1 --2- 172.21.15.81:0/3338635013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faad4101de0 0x7faad41985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.697+0000 7faadb31c640 1 -- 172.21.15.81:0/3338635013 >> 172.21.15.81:0/3338635013 conn(0x7faad40fd8c0 msgr2=0x7faad40fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.697+0000 7faadb31c640 1 -- 172.21.15.81:0/3338635013 shutdown_connections 2024-09-12T01:27:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:32.697+0000 7faadb31c640 1 -- 172.21.15.81:0/3338635013 wait complete. 2024-09-12T01:27:33.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T01:27:33.718 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:33 smithi081 ceph-mon[30920]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:33 smithi189 ceph-mon[35357]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:34.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:33 smithi100 ceph-mon[35275]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.195+0000 7fb3ac8b1640 1 -- 172.21.15.81:0/2964840841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a8102d30 msgr2=0x7fb3a8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.195+0000 7fb3ac8b1640 1 --2- 172.21.15.81:0/2964840841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a8102d30 0x7fb3a8103110 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009930 tx=0x7fb3a002a440 comp rx=0 tx=0).stop 2024-09-12T01:27:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.195+0000 7fb3ac8b1640 1 -- 172.21.15.81:0/2964840841 shutdown_connections 2024-09-12T01:27:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.195+0000 7fb3ac8b1640 1 --2- 172.21.15.81:0/2964840841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3a81082a0 0x7fb3a810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.195+0000 7fb3ac8b1640 1 --2- 172.21.15.81:0/2964840841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3a81036e0 0x7fb3a8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.195+0000 7fb3ac8b1640 1 --2- 172.21.15.81:0/2964840841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a8102d30 0x7fb3a8103110 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.195+0000 7fb3ac8b1640 1 -- 172.21.15.81:0/2964840841 >> 172.21.15.81:0/2964840841 conn(0x7fb3a80fc7d0 msgr2=0x7fb3a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.195+0000 7fb3ac8b1640 1 -- 172.21.15.81:0/2964840841 shutdown_connections 2024-09-12T01:27:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.195+0000 7fb3ac8b1640 1 -- 172.21.15.81:0/2964840841 wait complete. 2024-09-12T01:27:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.196+0000 7fb3ac8b1640 1 Processor -- start 2024-09-12T01:27:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.196+0000 7fb3ac8b1640 1 -- start start 2024-09-12T01:27:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.196+0000 7fb3ac8b1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3a8102d30 0x7fb3a8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.196+0000 7fb3ac8b1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81036e0 0x7fb3a8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.196+0000 7fb3ac8b1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3a81082a0 0x7fb3a8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.196+0000 7fb3ac8b1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a8112100 con 0x7fb3a81036e0 2024-09-12T01:27:34.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.196+0000 7fb3ac8b1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a8111f80 con 0x7fb3a81082a0 2024-09-12T01:27:34.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.196+0000 7fb3ac8b1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a8112280 con 0x7fb3a8102d30 2024-09-12T01:27:34.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.196+0000 7fb3a5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81036e0 0x7fb3a8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb3a5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81036e0 0x7fb3a8100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45038/0 (socket says 172.21.15.81:45038) 2024-09-12T01:27:34.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb3a5d9b640 1 -- 172.21.15.81:0/2882618348 learned_addr learned my addr 172.21.15.81:0/2882618348 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb3a659c640 1 --2- 172.21.15.81:0/2882618348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3a8102d30 0x7fb3a8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb3a5d9b640 1 -- 172.21.15.81:0/2882618348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3a8102d30 msgr2=0x7fb3a8100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb3a5d9b640 1 --2- 172.21.15.81:0/2882618348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3a8102d30 0x7fb3a8100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb3a5d9b640 1 -- 172.21.15.81:0/2882618348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3a81082a0 msgr2=0x7fb3a8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb3a5d9b640 1 --2- 172.21.15.81:0/2882618348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3a81082a0 0x7fb3a8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb3a5d9b640 1 -- 172.21.15.81:0/2882618348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a81a6b10 con 0x7fb3a81036e0 2024-09-12T01:27:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb3a5d9b640 1 --2- 172.21.15.81:0/2882618348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81036e0 0x7fb3a8100ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb390006fd0 tx=0x7fb39000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb39f7fe640 1 -- 172.21.15.81:0/2882618348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390011830 con 0x7fb3a81036e0 2024-09-12T01:27:34.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb39f7fe640 1 -- 172.21.15.81:0/2882618348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb390016070 con 0x7fb3a81036e0 2024-09-12T01:27:34.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb3ac8b1640 1 -- 172.21.15.81:0/2882618348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a81a6e00 con 0x7fb3a81036e0 2024-09-12T01:27:34.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb39f7fe640 1 -- 172.21.15.81:0/2882618348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39000f2e0 con 0x7fb3a81036e0 2024-09-12T01:27:34.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.197+0000 7fb3ac8b1640 1 -- 172.21.15.81:0/2882618348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a81a72b0 con 0x7fb3a81036e0 2024-09-12T01:27:34.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.199+0000 7fb39f7fe640 1 -- 172.21.15.81:0/2882618348 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb39001b460 con 0x7fb3a81036e0 2024-09-12T01:27:34.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb3aec8a740 1 Processor -- start 2024-09-12T01:27:34.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb3aec8a740 1 -- start start 2024-09-12T01:27:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb39f7fe640 1 --2- 172.21.15.81:0/2882618348 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb3940a2c10 0x7fb3940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb3aec8a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6dd3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb3aec8a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd42f0 0x55eaa6dde670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb3aec8a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6de0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb3aec8a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55eaa6d3a090 con 0x55eaa6ddebb0 2024-09-12T01:27:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb3aec8a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eaa6ce1a70 con 0x55eaa6dd42f0 2024-09-12T01:27:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb3aec8a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55eaa6d36050 con 0x55eaa6dd39d0 2024-09-12T01:27:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb3a6d9d640 1 --2- 172.21.15.81:0/2882618348 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb3940a2c10 0x7fb3940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb3a659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6dd3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb39f7fe640 1 -- 172.21.15.81:0/2882618348 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb3900ce740 con 0x7fb3a81036e0 2024-09-12T01:27:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb3a659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6dd3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.81:48418/0 (socket says 172.21.15.81:48418) 2024-09-12T01:27:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb3a659c640 1 -- 172.21.15.81:0/2935040517 learned_addr learned my addr 172.21.15.81:0/2935040517 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.200+0000 7fb3a6d9d640 1 --2- 172.21.15.81:0/2935040517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6de0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.201+0000 7fb3a5d9b640 1 --2- 172.21.15.81:0/2935040517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd42f0 0x55eaa6dde670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.201+0000 7fb3a659c640 1 -- 172.21.15.81:0/2935040517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd42f0 msgr2=0x55eaa6dde670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.201+0000 7fb3a659c640 1 --2- 172.21.15.81:0/2935040517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd42f0 0x55eaa6dde670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.201+0000 7fb3a659c640 1 -- 172.21.15.81:0/2935040517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 msgr2=0x55eaa6de0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.201+0000 7fb3a659c640 1 --2- 172.21.15.81:0/2935040517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6de0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.201+0000 7fb3a659c640 1 -- 172.21.15.81:0/2935040517 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaa6cee130 con 0x55eaa6dd39d0 2024-09-12T01:27:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.201+0000 7fb3a6d9d640 1 --2- 172.21.15.81:0/2882618348 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb3940a2c10 0x7fb3940a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb398005c40 tx=0x7fb398009c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.201+0000 7fb3a659c640 1 --2- 172.21.15.81:0/2935040517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6dd3db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb3a002a960 tx=0x7fb3a00315b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaabeadbcee2f234 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.201+0000 7fb39cff9640 1 -- 172.21.15.81:0/2935040517 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0040070 con 0x55eaa6dd39d0 2024-09-12T01:27:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.201+0000 7fb39cff9640 1 -- 172.21.15.81:0/2935040517 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3a0005020 con 0x55eaa6dd39d0 2024-09-12T01:27:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.201+0000 7fb39cff9640 1 -- 172.21.15.81:0/2935040517 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0035040 con 0x55eaa6dd39d0 2024-09-12T01:27:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.202+0000 7fb3aec8a740 1 -- 172.21.15.81:0/2935040517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 msgr2=0x55eaa6dd3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.202+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/2935040517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6dd3db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb3a002a960 tx=0x7fb3a00315b0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.202+0000 7fb3aec8a740 1 -- 172.21.15.81:0/2935040517 shutdown_connections 2024-09-12T01:27:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.202+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/2935040517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6de0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.202+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/2935040517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd42f0 0x55eaa6dde670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.202+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/2935040517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6dd3db0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.202+0000 7fb3aec8a740 1 -- 172.21.15.81:0/2935040517 >> 172.21.15.81:0/2935040517 conn(0x55eaa6dcff60 msgr2=0x55eaa6dd0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.202+0000 7fb3aec8a740 1 -- 172.21.15.81:0/2935040517 shutdown_connections 2024-09-12T01:27:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.202+0000 7fb3aec8a740 1 -- 172.21.15.81:0/2935040517 wait complete. 2024-09-12T01:27:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.202+0000 7fb3aec8a740 1 -- start start 2024-09-12T01:27:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.202+0000 7fb3aec8a740 1 Processor -- start 2024-09-12T01:27:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3aec8a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6dde320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3aec8a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd42f0 0x55eaa6ddb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3aec8a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3aec8a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55eaa6de1780 con 0x55eaa6ddebb0 2024-09-12T01:27:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3aec8a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eaa6cf4f20 con 0x55eaa6dd42f0 2024-09-12T01:27:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3aec8a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55eaa6de1900 con 0x55eaa6dd39d0 2024-09-12T01:27:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3aec8a740 10 client.0 _ll_register_callbacks cb 0x55eaa6cbe030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3a6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3a659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6dde320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3a6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45060/0 (socket says 172.21.15.81:45060) 2024-09-12T01:27:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3a6d9d640 1 -- 172.21.15.81:0/3873643766 learned_addr learned my addr 172.21.15.81:0/3873643766 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3a5d9b640 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd42f0 0x55eaa6ddb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3a659c640 1 -- 172.21.15.81:0/3873643766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd42f0 msgr2=0x55eaa6ddb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3a659c640 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd42f0 0x55eaa6ddb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3a659c640 1 -- 172.21.15.81:0/3873643766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 msgr2=0x55eaa6ddbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3a659c640 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3a659c640 1 -- 172.21.15.81:0/3873643766 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaa6aab2b0 con 0x55eaa6dd39d0 2024-09-12T01:27:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3a6d9d640 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:27:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3a5d9b640 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd42f0 0x55eaa6ddb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3a659c640 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6dde320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0006010 tx=0x7fb3a002a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b209aa4968f1998f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb38dffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T01:27:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb38dffb640 1 -- 172.21.15.81:0/3873643766 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a004b070 con 0x55eaa6dd39d0 2024-09-12T01:27:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb38dffb640 1 -- 172.21.15.81:0/3873643766 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb3a0004770 con 0x55eaa6dd39d0 2024-09-12T01:27:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.203+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3873643766 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3a0005020 con 0x55eaa6dd39d0 2024-09-12T01:27:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.204+0000 7fb38dffb640 1 -- 172.21.15.81:0/3873643766 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb3a0057050 con 0x55eaa6dd39d0 2024-09-12T01:27:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.204+0000 7fb3aec8a740 10 client.24661 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.204+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3873643766 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eaa6de1780 con 0x55eaa6dd39d0 2024-09-12T01:27:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.204+0000 7fb38dffb640 1 -- 172.21.15.81:0/3873643766 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3a0005020 con 0x55eaa6dd39d0 2024-09-12T01:27:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.204+0000 7fb38dffb640 1 -- 172.21.15.81:0/3873643766 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb3a003cab0 con 0x55eaa6dd39d0 2024-09-12T01:27:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.204+0000 7fb3aec8a740 10 client.24661 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.204+0000 7fb3aec8a740 10 client.24661 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:27:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.204+0000 7fb3aec8a740 20 client.24661 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.204+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55eaa6def0e0 0x55eaa6df0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.204+0000 7fb3aec8a740 4 client.24661 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:27:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.204+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3873643766 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eaa6d47600 con 0x55eaa6def0e0 2024-09-12T01:27:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.204+0000 7fb3a5d9b640 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55eaa6def0e0 0x55eaa6df0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.205+0000 7fb38dffb640 10 client.24661 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:27:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.205+0000 7fb3a5d9b640 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55eaa6def0e0 0x55eaa6df0550 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97e49c4de4137fe5 server_cookie=1a911259ea53b8eb in_seq=0 out_seq=0 2024-09-12T01:27:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.205+0000 7fb38dffb640 1 -- 172.21.15.81:0/3873643766 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eaa6d47600 con 0x55eaa6def0e0 2024-09-12T01:27:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.205+0000 7fb38dffb640 10 client.24661 handle_command_reply: tid=0 2024-09-12T01:27:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.205+0000 7fb3aec8a740 1 client.24661 shutdown 2024-09-12T01:27:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.206+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3873643766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 msgr2=0x55eaa6dde320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.206+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6dde320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0006010 tx=0x7fb3a002a440 comp rx=0 tx=0).stop 2024-09-12T01:27:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.206+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3873643766 shutdown_connections 2024-09-12T01:27:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.206+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55eaa6def0e0 0x55eaa6df0550 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.206+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.206+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd42f0 0x55eaa6ddb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.206+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/3873643766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6dde320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.206+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3873643766 >> 172.21.15.81:0/3873643766 conn(0x55eaa6dcff60 msgr2=0x55eaa6dd5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.206+0000 7fb38dffb640 0 client.24661 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:27:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.206+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3873643766 shutdown_connections 2024-09-12T01:27:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.206+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3873643766 wait complete. 2024-09-12T01:27:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.206+0000 7fb3aec8a740 20 client.24661 trim_cache size 0 max 16384 2024-09-12T01:27:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.223+0000 7fb3aec8a740 1 Processor -- start 2024-09-12T01:27:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.223+0000 7fb3aec8a740 1 -- start start 2024-09-12T01:27:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.223+0000 7fb3aec8a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6deea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.223+0000 7fb3aec8a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6dd42f0 0x55eaa6defe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.223+0000 7fb3aec8a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.223+0000 7fb3aec8a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55eaa6dee890 con 0x55eaa6dd42f0 2024-09-12T01:27:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.223+0000 7fb3aec8a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eaa6deef60 con 0x55eaa6ddebb0 2024-09-12T01:27:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.223+0000 7fb3aec8a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55eaa6def630 con 0x55eaa6dd39d0 2024-09-12T01:27:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.223+0000 7fb3a5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6dd42f0 0x55eaa6defe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.223+0000 7fb3a5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6dd42f0 0x55eaa6defe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45064/0 (socket says 172.21.15.81:45064) 2024-09-12T01:27:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.223+0000 7fb3a5d9b640 1 -- 172.21.15.81:0/1717175880 learned_addr learned my addr 172.21.15.81:0/1717175880 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.223+0000 7fb3a659c640 1 --2- 172.21.15.81:0/1717175880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6deea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.224+0000 7fb3a5d9b640 1 -- 172.21.15.81:0/1717175880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 msgr2=0x55eaa6deea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.224+0000 7fb3a5d9b640 1 --2- 172.21.15.81:0/1717175880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6deea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.224+0000 7fb3a5d9b640 1 -- 172.21.15.81:0/1717175880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6ddebb0 msgr2=0x55eaa6ddbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.224+0000 7fb3a5d9b640 1 --2- 172.21.15.81:0/1717175880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.224+0000 7fb3a5d9b640 1 -- 172.21.15.81:0/1717175880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaa6dd4120 con 0x55eaa6dd42f0 2024-09-12T01:27:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.224+0000 7fb3a5d9b640 1 --2- 172.21.15.81:0/1717175880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6dd42f0 0x55eaa6defe80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb39000bde0 tx=0x7fb3900bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce2ab2db721264d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.224+0000 7fb38ffff640 1 -- 172.21.15.81:0/1717175880 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39009b660 con 0x55eaa6dd42f0 2024-09-12T01:27:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.224+0000 7fb38ffff640 1 -- 172.21.15.81:0/1717175880 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb39009af60 con 0x55eaa6dd42f0 2024-09-12T01:27:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.224+0000 7fb38ffff640 1 -- 172.21.15.81:0/1717175880 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3900992f0 con 0x55eaa6dd42f0 2024-09-12T01:27:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.224+0000 7fb3aec8a740 1 -- 172.21.15.81:0/1717175880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6dd42f0 msgr2=0x55eaa6defe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.224+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/1717175880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6dd42f0 0x55eaa6defe80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb39000bde0 tx=0x7fb3900bb040 comp rx=0 tx=0).stop 2024-09-12T01:27:34.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 -- 172.21.15.81:0/1717175880 shutdown_connections 2024-09-12T01:27:34.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/1717175880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/1717175880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6dd42f0 0x55eaa6defe80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/1717175880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd39d0 0x55eaa6deea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 -- 172.21.15.81:0/1717175880 >> 172.21.15.81:0/1717175880 conn(0x55eaa6dcff60 msgr2=0x55eaa6dee0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 -- 172.21.15.81:0/1717175880 shutdown_connections 2024-09-12T01:27:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 -- 172.21.15.81:0/1717175880 wait complete. 2024-09-12T01:27:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 -- start start 2024-09-12T01:27:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 Processor -- start 2024-09-12T01:27:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd39d0 0x55eaa6ddf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd42f0 0x55eaa6ddf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55eaa6df03d0 con 0x55eaa6ddebb0 2024-09-12T01:27:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eaa6defd00 con 0x55eaa6dd39d0 2024-09-12T01:27:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55eaa6df0aa0 con 0x55eaa6dd42f0 2024-09-12T01:27:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3aec8a740 10 client.0 _ll_register_callbacks cb 0x7fb3a0009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3a6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3a6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45072/0 (socket says 172.21.15.81:45072) 2024-09-12T01:27:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3a6d9d640 1 -- 172.21.15.81:0/3734173170 learned_addr learned my addr 172.21.15.81:0/3734173170 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.225+0000 7fb3a5d9b640 1 --2- 172.21.15.81:0/3734173170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd42f0 0x55eaa6ddf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb3a659c640 1 --2- 172.21.15.81:0/3734173170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd39d0 0x55eaa6ddf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb3a6d9d640 1 -- 172.21.15.81:0/3734173170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd42f0 msgr2=0x55eaa6ddf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb3a6d9d640 1 --2- 172.21.15.81:0/3734173170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd42f0 0x55eaa6ddf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb3a6d9d640 1 -- 172.21.15.81:0/3734173170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd39d0 msgr2=0x55eaa6ddf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb3a6d9d640 1 --2- 172.21.15.81:0/3734173170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd39d0 0x55eaa6ddf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb3a6d9d640 1 -- 172.21.15.81:0/3734173170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaa6e57910 con 0x55eaa6ddebb0 2024-09-12T01:27:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb3a6d9d640 1 --2- 172.21.15.81:0/3734173170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddfbf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb398009270 tx=0x7fb398004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94adbb8fe1354bad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb38dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb38dffb640 1 -- 172.21.15.81:0/3734173170 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398004d20 con 0x55eaa6ddebb0 2024-09-12T01:27:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb38dffb640 1 -- 172.21.15.81:0/3734173170 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb398004240 con 0x55eaa6ddebb0 2024-09-12T01:27:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3734173170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb39009af60 con 0x55eaa6ddebb0 2024-09-12T01:27:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb38dffb640 1 -- 172.21.15.81:0/3734173170 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb398004440 con 0x55eaa6ddebb0 2024-09-12T01:27:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb3aec8a740 10 client.15048 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3734173170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eaa6e58bf0 con 0x55eaa6ddebb0 2024-09-12T01:27:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb38dffb640 1 -- 172.21.15.81:0/3734173170 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb39009af60 con 0x55eaa6ddebb0 2024-09-12T01:27:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.226+0000 7fb38dffb640 1 -- 172.21.15.81:0/3734173170 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb398027030 con 0x55eaa6ddebb0 2024-09-12T01:27:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.227+0000 7fb3aec8a740 10 client.15048 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.227+0000 7fb3aec8a740 10 client.15048 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:27:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.227+0000 7fb3aec8a740 20 client.15048 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:34.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.227+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/3734173170 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55eaa6e5d7a0 0x55eaa6e5c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:34.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.227+0000 7fb3aec8a740 4 client.15048 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:27:34.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.227+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3734173170 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "status"}) -- 0x55eaa6d41b10 con 0x55eaa6e5d7a0 2024-09-12T01:27:34.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.227+0000 7fb3a659c640 1 --2- 172.21.15.81:0/3734173170 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55eaa6e5d7a0 0x55eaa6e5c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:34.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.227+0000 7fb38dffb640 10 client.15048 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:27:34.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.227+0000 7fb3a659c640 1 --2- 172.21.15.81:0/3734173170 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55eaa6e5d7a0 0x55eaa6e5c4b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b15fb18a3d85f4ab server_cookie=a011c9bddf62faa8 in_seq=0 out_seq=0 2024-09-12T01:27:34.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb38dffb640 1 -- 172.21.15.81:0/3734173170 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55eaa6d41b10 con 0x55eaa6e5d7a0 2024-09-12T01:27:34.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb38dffb640 10 client.15048 handle_command_reply: tid=0 2024-09-12T01:27:34.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb3aec8a740 1 client.15048 shutdown 2024-09-12T01:27:34.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3734173170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 msgr2=0x55eaa6ddfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:34.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/3734173170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddfbf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb398009270 tx=0x7fb398004a40 comp rx=0 tx=0).stop 2024-09-12T01:27:34.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3734173170 shutdown_connections 2024-09-12T01:27:34.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/3734173170 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55eaa6e5d7a0 0x55eaa6e5c4b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/3734173170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eaa6ddebb0 0x55eaa6ddfbf0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/3734173170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eaa6dd42f0 0x55eaa6ddf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb3aec8a740 1 --2- 172.21.15.81:0/3734173170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eaa6dd39d0 0x55eaa6ddf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3734173170 >> 172.21.15.81:0/3734173170 conn(0x55eaa6dcff60 msgr2=0x55eaa6ddcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb38dffb640 0 client.15048 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:27:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3734173170 shutdown_connections 2024-09-12T01:27:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb3aec8a740 1 -- 172.21.15.81:0/3734173170 wait complete. 2024-09-12T01:27:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.228+0000 7fb3aec8a740 20 client.15048 trim_cache size 0 max 16384 2024-09-12T01:27:34.240 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:27:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:27:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-12T01:27:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24473, 2024-09-12T01:27:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:27:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:27:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:27:34.240 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 78.793493799999993, 2024-09-12T01:27:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T01:27:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-12T01:27:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:27:34.241 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 89.674749667 2024-09-12T01:27:34.241 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:27:34.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.229+0000 7fb3ac8b1640 1 -- 172.21.15.81:0/2882618348 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb3940a2c10 msgr2=0x7fb3940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:34.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.229+0000 7fb3ac8b1640 1 --2- 172.21.15.81:0/2882618348 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb3940a2c10 0x7fb3940a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb398005c40 tx=0x7fb398009c70 comp rx=0 tx=0).stop 2024-09-12T01:27:34.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.229+0000 7fb3ac8b1640 1 -- 172.21.15.81:0/2882618348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81036e0 msgr2=0x7fb3a8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:34.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.229+0000 7fb3ac8b1640 1 --2- 172.21.15.81:0/2882618348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81036e0 0x7fb3a8100ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb390006fd0 tx=0x7fb39000b8e0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.229+0000 7fb3ac8b1640 1 -- 172.21.15.81:0/2882618348 shutdown_connections 2024-09-12T01:27:34.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.229+0000 7fb3ac8b1640 1 --2- 172.21.15.81:0/2882618348 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb3940a2c10 0x7fb3940a50d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.229+0000 7fb3ac8b1640 1 --2- 172.21.15.81:0/2882618348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3a81082a0 0x7fb3a8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.229+0000 7fb3ac8b1640 1 --2- 172.21.15.81:0/2882618348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a81036e0 0x7fb3a8100ed0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.229+0000 7fb3ac8b1640 1 --2- 172.21.15.81:0/2882618348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3a8102d30 0x7fb3a8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:34.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.229+0000 7fb3ac8b1640 1 -- 172.21.15.81:0/2882618348 >> 172.21.15.81:0/2882618348 conn(0x7fb3a80fc7d0 msgr2=0x7fb3a8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:34.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.229+0000 7fb3ac8b1640 1 -- 172.21.15.81:0/2882618348 shutdown_connections 2024-09-12T01:27:34.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:34.229+0000 7fb3ac8b1640 1 -- 172.21.15.81:0/2882618348 wait complete. 2024-09-12T01:27:34.871 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T01:27:34.871 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:27:34.885 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T01:27:34.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T01:27:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.579+0000 7f026ae5d640 1 -- 172.21.15.81:0/21756444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02641037d0 msgr2=0x7f026410a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.579+0000 7f026ae5d640 1 --2- 172.21.15.81:0/21756444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02641037d0 0x7f026410a060 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f025c009ca0 tx=0x7f025c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:27:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 -- 172.21.15.81:0/21756444 shutdown_connections 2024-09-12T01:27:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 --2- 172.21.15.81:0/21756444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02641037d0 0x7f026410a060 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 --2- 172.21.15.81:0/21756444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0264102e10 0x7f0264103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 --2- 172.21.15.81:0/21756444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0264101c10 0x7f0264102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 -- 172.21.15.81:0/21756444 >> 172.21.15.81:0/21756444 conn(0x7f02640fd3c0 msgr2=0x7f02640ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 -- 172.21.15.81:0/21756444 shutdown_connections 2024-09-12T01:27:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 -- 172.21.15.81:0/21756444 wait complete. 2024-09-12T01:27:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 Processor -- start 2024-09-12T01:27:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 -- start start 2024-09-12T01:27:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0264101c10 0x7f0264197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0264102e10 0x7f0264198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02641037d0 0x7f026419f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f026410d890 con 0x7f0264102e10 2024-09-12T01:27:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f026410d710 con 0x7f02641037d0 2024-09-12T01:27:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f026ae5d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f026410da10 con 0x7f0264101c10 2024-09-12T01:27:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.580+0000 7f0263fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0264102e10 0x7f0264198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f0263fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0264102e10 0x7f0264198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45088/0 (socket says 172.21.15.81:45088) 2024-09-12T01:27:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f0263fff640 1 -- 172.21.15.81:0/788615167 learned_addr learned my addr 172.21.15.81:0/788615167 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f02693fa640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02641037d0 0x7f026419f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f0268bf9640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0264101c10 0x7f0264197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f0263fff640 1 -- 172.21.15.81:0/788615167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0264101c10 msgr2=0x7f0264197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f0263fff640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0264101c10 0x7f0264197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f0263fff640 1 -- 172.21.15.81:0/788615167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02641037d0 msgr2=0x7f026419f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f0263fff640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02641037d0 0x7f026419f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f0263fff640 1 -- 172.21.15.81:0/788615167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026419fa30 con 0x7f0264102e10 2024-09-12T01:27:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f02693fa640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02641037d0 0x7f026419f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f0268bf9640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0264101c10 0x7f0264197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f0263fff640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0264102e10 0x7f0264198340 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f025800c920 tx=0x7f025800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f0261ffb640 1 -- 172.21.15.81:0/788615167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258007c70 con 0x7f0264102e10 2024-09-12T01:27:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f026ae5d640 1 -- 172.21.15.81:0/788615167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026419fd20 con 0x7f0264102e10 2024-09-12T01:27:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f0261ffb640 1 -- 172.21.15.81:0/788615167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0258007e10 con 0x7f0264102e10 2024-09-12T01:27:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f0261ffb640 1 -- 172.21.15.81:0/788615167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258018890 con 0x7f0264102e10 2024-09-12T01:27:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.581+0000 7f026ae5d640 1 -- 172.21.15.81:0/788615167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02641a0200 con 0x7f0264102e10 2024-09-12T01:27:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.582+0000 7f026ae5d640 1 -- 172.21.15.81:0/788615167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0264108fc0 con 0x7f0264102e10 2024-09-12T01:27:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.583+0000 7f0261ffb640 1 -- 172.21.15.81:0/788615167 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0258018a30 con 0x7f0264102e10 2024-09-12T01:27:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.584+0000 7f0261ffb640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f024c0a2c40 0x7f024c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.584+0000 7f0268bf9640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f024c0a2c40 0x7f024c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.584+0000 7f0261ffb640 1 -- 172.21.15.81:0/788615167 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f02580cf360 con 0x7f0264102e10 2024-09-12T01:27:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.584+0000 7f0268bf9640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f024c0a2c40 0x7f024c0a5100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0264102c70 tx=0x7f0254005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.588+0000 7f0261ffb640 1 -- 172.21.15.81:0/788615167 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0258014030 con 0x7f0264102e10 2024-09-12T01:27:35.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.770+0000 7f026ae5d640 1 -- 172.21.15.81:0/788615167 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f0264062630 con 0x7f024c0a2c40 2024-09-12T01:27:35.770 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:35 smithi081 ceph-mon[30920]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:35.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.771+0000 7f0261ffb640 1 -- 172.21.15.81:0/788615167 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f0264062630 con 0x7f024c0a2c40 2024-09-12T01:27:35.771 INFO:teuthology.orchestra.run.smithi081.stdout:Backend: cephadm 2024-09-12T01:27:35.771 INFO:teuthology.orchestra.run.smithi081.stdout:Available: Yes 2024-09-12T01:27:35.771 INFO:teuthology.orchestra.run.smithi081.stdout:Paused: No 2024-09-12T01:27:35.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.773+0000 7f026ae5d640 1 -- 172.21.15.81:0/788615167 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f024c0a2c40 msgr2=0x7f024c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:35.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.773+0000 7f026ae5d640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f024c0a2c40 0x7f024c0a5100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0264102c70 tx=0x7f0254005f90 comp rx=0 tx=0).stop 2024-09-12T01:27:35.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.773+0000 7f026ae5d640 1 -- 172.21.15.81:0/788615167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0264102e10 msgr2=0x7f0264198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:35.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.773+0000 7f026ae5d640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0264102e10 0x7f0264198340 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f025800c920 tx=0x7f025800cde0 comp rx=0 tx=0).stop 2024-09-12T01:27:35.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.773+0000 7f026ae5d640 1 -- 172.21.15.81:0/788615167 shutdown_connections 2024-09-12T01:27:35.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.773+0000 7f026ae5d640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f024c0a2c40 0x7f024c0a5100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:35.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.773+0000 7f026ae5d640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02641037d0 0x7f026419f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:35.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.773+0000 7f026ae5d640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0264102e10 0x7f0264198340 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:35.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.774+0000 7f026ae5d640 1 --2- 172.21.15.81:0/788615167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0264101c10 0x7f0264197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:35.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.774+0000 7f026ae5d640 1 -- 172.21.15.81:0/788615167 >> 172.21.15.81:0/788615167 conn(0x7f02640fd3c0 msgr2=0x7f0264106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:35.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.774+0000 7f026ae5d640 1 -- 172.21.15.81:0/788615167 shutdown_connections 2024-09-12T01:27:35.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:35.774+0000 7f026ae5d640 1 -- 172.21.15.81:0/788615167 wait complete. 2024-09-12T01:27:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:35 smithi189 ceph-mon[35357]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:35.821 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:35 smithi100 ceph-mon[35275]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:36.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T01:27:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.145+0000 7f3de9b36640 1 -- 172.21.15.81:0/398657091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de4101cd0 msgr2=0x7f3de4102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.145+0000 7f3de9b36640 1 --2- 172.21.15.81:0/398657091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de4101cd0 0x7f3de4102150 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009ca0 tx=0x7f3dcc02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:27:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.145+0000 7f3de9b36640 1 -- 172.21.15.81:0/398657091 shutdown_connections 2024-09-12T01:27:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.145+0000 7f3de9b36640 1 --2- 172.21.15.81:0/398657091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de4102690 0x7f3de4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.145+0000 7f3de9b36640 1 --2- 172.21.15.81:0/398657091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de4101cd0 0x7f3de4102150 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.145+0000 7f3de9b36640 1 --2- 172.21.15.81:0/398657091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3de4100ad0 0x7f3de4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.145+0000 7f3de9b36640 1 -- 172.21.15.81:0/398657091 >> 172.21.15.81:0/398657091 conn(0x7f3de40fc280 msgr2=0x7f3de40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.145+0000 7f3de9b36640 1 -- 172.21.15.81:0/398657091 shutdown_connections 2024-09-12T01:27:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.145+0000 7f3de9b36640 1 -- 172.21.15.81:0/398657091 wait complete. 2024-09-12T01:27:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.145+0000 7f3de9b36640 1 Processor -- start 2024-09-12T01:27:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.145+0000 7f3de9b36640 1 -- start start 2024-09-12T01:27:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de9b36640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de4100ad0 0x7f3de4196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de9b36640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de4101cd0 0x7f3de41974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de9b36640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3de4102690 0x7f3de419e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de9b36640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3de410c850 con 0x7f3de4101cd0 2024-09-12T01:27:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de9b36640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3de410c6d0 con 0x7f3de4100ad0 2024-09-12T01:27:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de9b36640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3de410c9d0 con 0x7f3de4102690 2024-09-12T01:27:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de4101cd0 0x7f3de41974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de4101cd0 0x7f3de41974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45104/0 (socket says 172.21.15.81:45104) 2024-09-12T01:27:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de2ffd640 1 -- 172.21.15.81:0/2484118362 learned_addr learned my addr 172.21.15.81:0/2484118362 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de37fe640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de4100ad0 0x7f3de4196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de2ffd640 1 -- 172.21.15.81:0/2484118362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3de4102690 msgr2=0x7f3de419e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de3fff640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3de4102690 0x7f3de419e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de2ffd640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3de4102690 0x7f3de419e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de2ffd640 1 -- 172.21.15.81:0/2484118362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de4100ad0 msgr2=0x7f3de4196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de2ffd640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de4100ad0 0x7f3de4196f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de2ffd640 1 -- 172.21.15.81:0/2484118362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de419ebc0 con 0x7f3de4101cd0 2024-09-12T01:27:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de2ffd640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de4101cd0 0x7f3de41974d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc031a40 tx=0x7f3dcc02f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de0ff9640 1 -- 172.21.15.81:0/2484118362 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc02fdc0 con 0x7f3de4101cd0 2024-09-12T01:27:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de0ff9640 1 -- 172.21.15.81:0/2484118362 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dcc030aa0 con 0x7f3de4101cd0 2024-09-12T01:27:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de9b36640 1 -- 172.21.15.81:0/2484118362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de419ee50 con 0x7f3de4101cd0 2024-09-12T01:27:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.146+0000 7f3de0ff9640 1 -- 172.21.15.81:0/2484118362 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc046910 con 0x7f3de4101cd0 2024-09-12T01:27:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.147+0000 7f3de9b36640 1 -- 172.21.15.81:0/2484118362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de419f380 con 0x7f3de4101cd0 2024-09-12T01:27:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.147+0000 7f3de9b36640 1 -- 172.21.15.81:0/2484118362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de4107f60 con 0x7f3de4101cd0 2024-09-12T01:27:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.148+0000 7f3de0ff9640 1 -- 172.21.15.81:0/2484118362 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3dcc030c50 con 0x7f3de4101cd0 2024-09-12T01:27:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.149+0000 7f3de0ff9640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3dc40a2c40 0x7f3dc40a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.149+0000 7f3de37fe640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3dc40a2c40 0x7f3dc40a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.149+0000 7f3de0ff9640 1 -- 172.21.15.81:0/2484118362 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3dcc0f0800 con 0x7f3de4101cd0 2024-09-12T01:27:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.150+0000 7f3de37fe640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3dc40a2c40 0x7f3dc40a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3de4101b30 tx=0x7f3dd4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.153+0000 7f3de0ff9640 1 -- 172.21.15.81:0/2484118362 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3dcc0bd720 con 0x7f3de4101cd0 2024-09-12T01:27:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.327+0000 7f3de9b36640 1 -- 172.21.15.81:0/2484118362 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3de4062630 con 0x7f3dc40a2c40 2024-09-12T01:27:37.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.339+0000 7f3de0ff9640 1 -- 172.21.15.81:0/2484118362 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f3de4062630 con 0x7f3dc40a2c40 2024-09-12T01:27:37.339 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:27:37.339 INFO:teuthology.orchestra.run.smithi081.stdout:mds.a smithi081 running (95s) 19s ago 95s 19.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 1d50f334aaba 2024-09-12T01:27:37.339 INFO:teuthology.orchestra.run.smithi081.stdout:mds.b smithi100 running (93s) 26s ago 92s 25.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 bb4c616ba026 2024-09-12T01:27:37.339 INFO:teuthology.orchestra.run.smithi081.stdout:mds.c smithi189 running (106s) 26s ago 106s 19.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 f0c12febf156 2024-09-12T01:27:37.339 INFO:teuthology.orchestra.run.smithi081.stdout:mds.d smithi081 running (114s) 19s ago 113s 15.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 cdacb5c32c75 2024-09-12T01:27:37.339 INFO:teuthology.orchestra.run.smithi081.stdout:mds.e smithi100 running (111s) 26s ago 111s 17.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 4d4271f81e88 2024-09-12T01:27:37.339 INFO:teuthology.orchestra.run.smithi081.stdout:mds.f smithi189 running (109s) 26s ago 108s 16.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 81899e089eec 2024-09-12T01:27:37.340 INFO:teuthology.orchestra.run.smithi081.stdout:mds.g smithi081 running (99s) 19s ago 98s 19.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 67bcc15999e4 2024-09-12T01:27:37.340 INFO:teuthology.orchestra.run.smithi081.stdout:mds.h smithi100 running (104s) 26s ago 103s 18.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 a15bb8afa819 2024-09-12T01:27:37.340 INFO:teuthology.orchestra.run.smithi081.stdout:mds.i smithi189 running (101s) 26s ago 101s 17.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 1ca6ae8cab52 2024-09-12T01:27:37.340 INFO:teuthology.orchestra.run.smithi081.stdout:mds.j smithi081 running (117s) 19s ago 117s 13.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 2bfd40f1b6ab 2024-09-12T01:27:37.340 INFO:teuthology.orchestra.run.smithi081.stdout:mds.k smithi100 running (2m) 26s ago 2m 17.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 2382889f0038 2024-09-12T01:27:37.340 INFO:teuthology.orchestra.run.smithi081.stdout:mds.l smithi189 running (2m) 26s ago 2m 20.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 88eddc80e550 2024-09-12T01:27:37.340 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.x smithi081 *:9283,8765 running (8m) 19s ago 8m 508M - 19.1.1-298-gb53b6d3e 54467abc55f8 d8813b804726 2024-09-12T01:27:37.340 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.y smithi100 *:8443,8765 running (7m) 26s ago 7m 443M - 19.1.1-298-gb53b6d3e 54467abc55f8 857d8ffb590f 2024-09-12T01:27:37.340 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.z smithi189 *:8443,8765 running (7m) 26s ago 7m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 7c617f0adcf8 2024-09-12T01:27:37.340 INFO:teuthology.orchestra.run.smithi081.stdout:mon.a smithi081 running (8m) 19s ago 9m 49.7M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 19c5878e9e2a 2024-09-12T01:27:37.341 INFO:teuthology.orchestra.run.smithi081.stdout:mon.b smithi100 running (7m) 26s ago 7m 39.9M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 0ebf8c15e535 2024-09-12T01:27:37.341 INFO:teuthology.orchestra.run.smithi081.stdout:mon.c smithi189 running (7m) 26s ago 7m 39.4M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 5934253a917b 2024-09-12T01:27:37.341 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (6m) 19s ago 6m 51.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 770296514b0d 2024-09-12T01:27:37.341 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi100 running (6m) 26s ago 6m 54.7M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 dfd5469c3fd1 2024-09-12T01:27:37.341 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi189 running (6m) 26s ago 6m 56.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 d31fb6e473f7 2024-09-12T01:27:37.341 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi081 running (5m) 19s ago 5m 55.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 fb9ae421ae03 2024-09-12T01:27:37.341 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi100 running (5m) 26s ago 5m 54.2M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 15121556d3ce 2024-09-12T01:27:37.341 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi189 running (4m) 26s ago 4m 46.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 338fcf849513 2024-09-12T01:27:37.341 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 smithi081 running (4m) 19s ago 4m 45.6M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 3a238f1109a8 2024-09-12T01:27:37.341 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 smithi100 running (4m) 26s ago 4m 46.7M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 5f36f0b0ee45 2024-09-12T01:27:37.342 INFO:teuthology.orchestra.run.smithi081.stdout:osd.8 smithi189 running (3m) 26s ago 3m 53.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 85b5fbf2ec65 2024-09-12T01:27:37.342 INFO:teuthology.orchestra.run.smithi081.stdout:osd.9 smithi081 running (3m) 19s ago 3m 46.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 08794ff683a7 2024-09-12T01:27:37.342 INFO:teuthology.orchestra.run.smithi081.stdout:osd.10 smithi100 running (2m) 26s ago 2m 55.2M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 7b569af33fdb 2024-09-12T01:27:37.342 INFO:teuthology.orchestra.run.smithi081.stdout:osd.11 smithi189 running (2m) 26s ago 2m 50.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 ee554f1b4713 2024-09-12T01:27:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.341+0000 7f3de9b36640 1 -- 172.21.15.81:0/2484118362 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3dc40a2c40 msgr2=0x7f3dc40a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.341+0000 7f3de9b36640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3dc40a2c40 0x7f3dc40a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3de4101b30 tx=0x7f3dd4009110 comp rx=0 tx=0).stop 2024-09-12T01:27:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.341+0000 7f3de9b36640 1 -- 172.21.15.81:0/2484118362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de4101cd0 msgr2=0x7f3de41974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.341+0000 7f3de9b36640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de4101cd0 0x7f3de41974d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc031a40 tx=0x7f3dcc02f840 comp rx=0 tx=0).stop 2024-09-12T01:27:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.341+0000 7f3de9b36640 1 -- 172.21.15.81:0/2484118362 shutdown_connections 2024-09-12T01:27:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.341+0000 7f3de9b36640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f3dc40a2c40 0x7f3dc40a5100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.341+0000 7f3de9b36640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3de4102690 0x7f3de419e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.341+0000 7f3de9b36640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de4101cd0 0x7f3de41974d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.341+0000 7f3de9b36640 1 --2- 172.21.15.81:0/2484118362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3de4100ad0 0x7f3de4196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.341+0000 7f3de9b36640 1 -- 172.21.15.81:0/2484118362 >> 172.21.15.81:0/2484118362 conn(0x7f3de40fc280 msgr2=0x7f3de4105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.341+0000 7f3de9b36640 1 -- 172.21.15.81:0/2484118362 shutdown_connections 2024-09-12T01:27:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:37.341+0000 7f3de9b36640 1 -- 172.21.15.81:0/2484118362 wait complete. 2024-09-12T01:27:37.659 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:37 smithi081 ceph-mon[30920]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:37.660 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:37 smithi081 ceph-mon[30920]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:27:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:37 smithi189 ceph-mon[35357]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:37 smithi189 ceph-mon[35357]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:27:37.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T01:27:38.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:37 smithi100 ceph-mon[35275]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:38.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:37 smithi100 ceph-mon[35275]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:27:38.203 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:38.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:38 smithi081 ceph-mon[30920]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:38.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.695+0000 7f337ad8a640 1 -- 172.21.15.81:0/1181360457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33741017a0 msgr2=0x7f3374109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:38.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.695+0000 7f337ad8a640 1 --2- 172.21.15.81:0/1181360457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33741017a0 0x7f3374109040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f336c009ca0 tx=0x7f336c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:27:38.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.695+0000 7f337ad8a640 1 -- 172.21.15.81:0/1181360457 shutdown_connections 2024-09-12T01:27:38.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.695+0000 7f337ad8a640 1 --2- 172.21.15.81:0/1181360457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33741017a0 0x7f3374109040 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.695+0000 7f337ad8a640 1 --2- 172.21.15.81:0/1181360457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3374100de0 0x7f3374101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.695+0000 7f337ad8a640 1 --2- 172.21.15.81:0/1181360457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33741020a0 0x7f33741024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.695+0000 7f337ad8a640 1 -- 172.21.15.81:0/1181360457 >> 172.21.15.81:0/1181360457 conn(0x7f33740fba40 msgr2=0x7f33740fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.695+0000 7f337ad8a640 1 -- 172.21.15.81:0/1181360457 shutdown_connections 2024-09-12T01:27:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.695+0000 7f337ad8a640 1 -- 172.21.15.81:0/1181360457 wait complete. 2024-09-12T01:27:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.695+0000 7f337ad8a640 1 Processor -- start 2024-09-12T01:27:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f337ad8a640 1 -- start start 2024-09-12T01:27:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f337ad8a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3374100de0 0x7f3374197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f337ad8a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33741017a0 0x7f3374198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f337ad8a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33741020a0 0x7f337419f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f337ad8a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f337410c820 con 0x7f33741020a0 2024-09-12T01:27:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f337ad8a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f337410c6a0 con 0x7f33741017a0 2024-09-12T01:27:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f337ad8a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f337410c9a0 con 0x7f3374100de0 2024-09-12T01:27:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3379327640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33741020a0 0x7f337419f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3379327640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33741020a0 0x7f337419f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45132/0 (socket says 172.21.15.81:45132) 2024-09-12T01:27:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3379327640 1 -- 172.21.15.81:0/2065729142 learned_addr learned my addr 172.21.15.81:0/2065729142 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3373fff640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33741017a0 0x7f3374198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3378b26640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3374100de0 0x7f3374197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3379327640 1 -- 172.21.15.81:0/2065729142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3374100de0 msgr2=0x7f3374197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3379327640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3374100de0 0x7f3374197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3379327640 1 -- 172.21.15.81:0/2065729142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33741017a0 msgr2=0x7f3374198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3379327640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33741017a0 0x7f3374198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3379327640 1 -- 172.21.15.81:0/2065729142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337419fc20 con 0x7f33741020a0 2024-09-12T01:27:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3378b26640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3374100de0 0x7f3374197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3379327640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33741020a0 0x7f337419f5b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f336c031ee0 tx=0x7f336c031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3371ffb640 1 -- 172.21.15.81:0/2065729142 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c003c30 con 0x7f33741020a0 2024-09-12T01:27:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.696+0000 7f3371ffb640 1 -- 172.21.15.81:0/2065729142 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f336c003dd0 con 0x7f33741020a0 2024-09-12T01:27:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.697+0000 7f337ad8a640 1 -- 172.21.15.81:0/2065729142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337419feb0 con 0x7f33741020a0 2024-09-12T01:27:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.697+0000 7f3371ffb640 1 -- 172.21.15.81:0/2065729142 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c02fbd0 con 0x7f33741020a0 2024-09-12T01:27:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.697+0000 7f337ad8a640 1 -- 172.21.15.81:0/2065729142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33741a0430 con 0x7f33741020a0 2024-09-12T01:27:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.698+0000 7f337ad8a640 1 -- 172.21.15.81:0/2065729142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33741a0750 con 0x7f33741020a0 2024-09-12T01:27:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.699+0000 7f3371ffb640 1 -- 172.21.15.81:0/2065729142 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f336c0046c0 con 0x7f33741020a0 2024-09-12T01:27:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.699+0000 7f3371ffb640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f33640a2cc0 0x7f33640a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.700+0000 7f3378b26640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f33640a2cc0 0x7f33640a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.700+0000 7f3371ffb640 1 -- 172.21.15.81:0/2065729142 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f336c0f0500 con 0x7f33741020a0 2024-09-12T01:27:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.700+0000 7f3378b26640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f33640a2cc0 0x7f33640a5180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f337406a510 tx=0x7f3368008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.703+0000 7f3371ffb640 1 -- 172.21.15.81:0/2065729142 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f336c0bd420 con 0x7f33741020a0 2024-09-12T01:27:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.879+0000 7f337ad8a640 1 -- 172.21.15.81:0/2065729142 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f33741a0920 con 0x7f33640a2cc0 2024-09-12T01:27:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.884+0000 7f3371ffb640 1 -- 172.21.15.81:0/2065729142 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f33741a0920 con 0x7f33640a2cc0 2024-09-12T01:27:38.883 INFO:teuthology.orchestra.run.smithi081.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T01:27:38.884 INFO:teuthology.orchestra.run.smithi081.stdout:mds.all 12/12 27s ago 2m smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-12T01:27:38.884 INFO:teuthology.orchestra.run.smithi081.stdout:mgr 3/3 27s ago 7m smithi081=x;smithi100=y;smithi189=z;count:3 2024-09-12T01:27:38.884 INFO:teuthology.orchestra.run.smithi081.stdout:mon 3/3 27s ago 7m smithi081:172.21.15.81=a;smithi100:172.21.15.100=b;smithi189:172.21.15.189=c;count:3 2024-09-12T01:27:38.884 INFO:teuthology.orchestra.run.smithi081.stdout:osd 12 27s ago - 2024-09-12T01:27:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.886+0000 7f337ad8a640 1 -- 172.21.15.81:0/2065729142 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f33640a2cc0 msgr2=0x7f33640a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.886+0000 7f337ad8a640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f33640a2cc0 0x7f33640a5180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f337406a510 tx=0x7f3368008040 comp rx=0 tx=0).stop 2024-09-12T01:27:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.886+0000 7f337ad8a640 1 -- 172.21.15.81:0/2065729142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33741020a0 msgr2=0x7f337419f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.886+0000 7f337ad8a640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33741020a0 0x7f337419f5b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f336c031ee0 tx=0x7f336c031f10 comp rx=0 tx=0).stop 2024-09-12T01:27:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.886+0000 7f337ad8a640 1 -- 172.21.15.81:0/2065729142 shutdown_connections 2024-09-12T01:27:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.886+0000 7f337ad8a640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f33640a2cc0 0x7f33640a5180 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.886+0000 7f337ad8a640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33741020a0 0x7f337419f5b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.886+0000 7f337ad8a640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33741017a0 0x7f3374198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.886+0000 7f337ad8a640 1 --2- 172.21.15.81:0/2065729142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3374100de0 0x7f3374197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.886+0000 7f337ad8a640 1 -- 172.21.15.81:0/2065729142 >> 172.21.15.81:0/2065729142 conn(0x7f33740fba40 msgr2=0x7f33740ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.887+0000 7f337ad8a640 1 -- 172.21.15.81:0/2065729142 shutdown_connections 2024-09-12T01:27:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:38.887+0000 7f337ad8a640 1 -- 172.21.15.81:0/2065729142 wait complete. 2024-09-12T01:27:39.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:38 smithi100 ceph-mon[35275]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:39.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:38 smithi189 ceph-mon[35357]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:39.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T01:27:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:39 smithi081 ceph-mon[30920]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:40.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:39 smithi100 ceph-mon[35275]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:40.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:39 smithi189 ceph-mon[35357]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:40.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.253+0000 7fdbcecce640 1 -- 172.21.15.81:0/1192298032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc8103870 msgr2=0x7fdbc810a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:40.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.253+0000 7fdbcecce640 1 --2- 172.21.15.81:0/1192298032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc8103870 0x7fdbc810a100 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009cd0 tx=0x7fdbc002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:27:40.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.253+0000 7fdbcecce640 1 -- 172.21.15.81:0/1192298032 shutdown_connections 2024-09-12T01:27:40.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.253+0000 7fdbcecce640 1 --2- 172.21.15.81:0/1192298032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc8103870 0x7fdbc810a100 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:40.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.253+0000 7fdbcecce640 1 --2- 172.21.15.81:0/1192298032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbc8102eb0 0x7fdbc8103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:40.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.253+0000 7fdbcecce640 1 --2- 172.21.15.81:0/1192298032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbc80ffed0 0x7fdbc81002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:40.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.253+0000 7fdbcecce640 1 -- 172.21.15.81:0/1192298032 >> 172.21.15.81:0/1192298032 conn(0x7fdbc80fba40 msgr2=0x7fdbc80fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:40.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.253+0000 7fdbcecce640 1 -- 172.21.15.81:0/1192298032 shutdown_connections 2024-09-12T01:27:40.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.253+0000 7fdbcecce640 1 -- 172.21.15.81:0/1192298032 wait complete. 2024-09-12T01:27:40.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcecce640 1 Processor -- start 2024-09-12T01:27:40.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcecce640 1 -- start start 2024-09-12T01:27:40.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcecce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc80ffed0 0x7fdbc8197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:40.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcecce640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbc8102eb0 0x7fdbc81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:40.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcecce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbc8103870 0x7fdbc819f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:40.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcecce640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc810d910 con 0x7fdbc80ffed0 2024-09-12T01:27:40.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcecce640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc810d790 con 0x7fdbc8103870 2024-09-12T01:27:40.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcecce640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc810da90 con 0x7fdbc8102eb0 2024-09-12T01:27:40.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcca6a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc80ffed0 0x7fdbc8197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:40.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcca6a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc80ffed0 0x7fdbc8197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45144/0 (socket says 172.21.15.81:45144) 2024-09-12T01:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcca6a640 1 -- 172.21.15.81:0/2336960654 learned_addr learned my addr 172.21.15.81:0/2336960654 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcd26b640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbc8103870 0x7fdbc819f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbc7fff640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbc8102eb0 0x7fdbc81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcca6a640 1 -- 172.21.15.81:0/2336960654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbc8102eb0 msgr2=0x7fdbc81984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcca6a640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbc8102eb0 0x7fdbc81984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcca6a640 1 -- 172.21.15.81:0/2336960654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbc8103870 msgr2=0x7fdbc819f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.254+0000 7fdbcca6a640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbc8103870 0x7fdbc819f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.255+0000 7fdbcca6a640 1 -- 172.21.15.81:0/2336960654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc819fbd0 con 0x7fdbc80ffed0 2024-09-12T01:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.255+0000 7fdbcd26b640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbc8103870 0x7fdbc819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.255+0000 7fdbcca6a640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc80ffed0 0x7fdbc8197fa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00c970 tx=0x7fdbbc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.255+0000 7fdbc5ffb640 1 -- 172.21.15.81:0/2336960654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc004220 con 0x7fdbc80ffed0 2024-09-12T01:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.255+0000 7fdbc5ffb640 1 -- 172.21.15.81:0/2336960654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbbc0043c0 con 0x7fdbc80ffed0 2024-09-12T01:27:40.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.255+0000 7fdbcecce640 1 -- 172.21.15.81:0/2336960654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc819fec0 con 0x7fdbc80ffed0 2024-09-12T01:27:40.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.255+0000 7fdbc5ffb640 1 -- 172.21.15.81:0/2336960654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00f450 con 0x7fdbc80ffed0 2024-09-12T01:27:40.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.255+0000 7fdbcecce640 1 -- 172.21.15.81:0/2336960654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc81a0390 con 0x7fdbc80ffed0 2024-09-12T01:27:40.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.256+0000 7fdbcecce640 1 -- 172.21.15.81:0/2336960654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc8109100 con 0x7fdbc80ffed0 2024-09-12T01:27:40.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.257+0000 7fdbc5ffb640 1 -- 172.21.15.81:0/2336960654 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdbbc0079b0 con 0x7fdbc80ffed0 2024-09-12T01:27:40.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.258+0000 7fdbc5ffb640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fdbb80a2c40 0x7fdbb80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:40.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.258+0000 7fdbc7fff640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fdbb80a2c40 0x7fdbb80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:40.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.258+0000 7fdbc5ffb640 1 -- 172.21.15.81:0/2336960654 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdbbc0cefb0 con 0x7fdbc80ffed0 2024-09-12T01:27:40.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.258+0000 7fdbc7fff640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fdbb80a2c40 0x7fdbb80a5100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdbc81994c0 tx=0x7fdbb4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:40.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.262+0000 7fdbc5ffb640 1 -- 172.21.15.81:0/2336960654 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdbbc014030 con 0x7fdbc80ffed0 2024-09-12T01:27:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.435+0000 7fdbcecce640 1 -- 172.21.15.81:0/2336960654 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fdbc8062630 con 0x7fdbb80a2c40 2024-09-12T01:27:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.437+0000 7fdbc5ffb640 1 -- 172.21.15.81:0/2336960654 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fdbc8062630 con 0x7fdbb80a2c40 2024-09-12T01:27:40.436 INFO:teuthology.orchestra.run.smithi081.stdout:HOST ADDR LABELS STATUS 2024-09-12T01:27:40.436 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 172.21.15.81 2024-09-12T01:27:40.436 INFO:teuthology.orchestra.run.smithi081.stdout:smithi100 172.21.15.100 2024-09-12T01:27:40.436 INFO:teuthology.orchestra.run.smithi081.stdout:smithi189 172.21.15.189 2024-09-12T01:27:40.436 INFO:teuthology.orchestra.run.smithi081.stdout:3 hosts in cluster 2024-09-12T01:27:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.439+0000 7fdbcecce640 1 -- 172.21.15.81:0/2336960654 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fdbb80a2c40 msgr2=0x7fdbb80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.439+0000 7fdbcecce640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fdbb80a2c40 0x7fdbb80a5100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdbc81994c0 tx=0x7fdbb4008040 comp rx=0 tx=0).stop 2024-09-12T01:27:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.439+0000 7fdbcecce640 1 -- 172.21.15.81:0/2336960654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc80ffed0 msgr2=0x7fdbc8197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.439+0000 7fdbcecce640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc80ffed0 0x7fdbc8197fa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00c970 tx=0x7fdbbc00ce30 comp rx=0 tx=0).stop 2024-09-12T01:27:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.439+0000 7fdbcecce640 1 -- 172.21.15.81:0/2336960654 shutdown_connections 2024-09-12T01:27:40.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.439+0000 7fdbcecce640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fdbb80a2c40 0x7fdbb80a5100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:40.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.439+0000 7fdbcecce640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbc8103870 0x7fdbc819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:40.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.439+0000 7fdbcecce640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbc8102eb0 0x7fdbc81984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:40.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.439+0000 7fdbcecce640 1 --2- 172.21.15.81:0/2336960654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc80ffed0 0x7fdbc8197fa0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:40.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.439+0000 7fdbcecce640 1 -- 172.21.15.81:0/2336960654 >> 172.21.15.81:0/2336960654 conn(0x7fdbc80fba40 msgr2=0x7fdbc81062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:40.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.439+0000 7fdbcecce640 1 -- 172.21.15.81:0/2336960654 shutdown_connections 2024-09-12T01:27:40.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:40.439+0000 7fdbcecce640 1 -- 172.21.15.81:0/2336960654 wait complete. 2024-09-12T01:27:40.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:40 smithi081 ceph-mon[30920]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:41.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:40 smithi100 ceph-mon[35275]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:41.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:40 smithi189 ceph-mon[35357]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:41.126 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T01:27:41.371 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:41.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:41 smithi081 ceph-mon[30920]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:41.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:41 smithi081 ceph-mon[30920]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:41.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.813+0000 7f4a81ca3640 1 -- 172.21.15.81:0/449361428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c1026d0 msgr2=0x7f4a7c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:41.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.813+0000 7f4a81ca3640 1 --2- 172.21.15.81:0/449361428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c1026d0 0x7f4a7c108f60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009ca0 tx=0x7f4a7402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:27:41.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.813+0000 7f4a81ca3640 1 -- 172.21.15.81:0/449361428 shutdown_connections 2024-09-12T01:27:41.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.813+0000 7f4a81ca3640 1 --2- 172.21.15.81:0/449361428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c1026d0 0x7f4a7c108f60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:41.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.813+0000 7f4a81ca3640 1 --2- 172.21.15.81:0/449361428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a7c101d10 0x7f4a7c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:41.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.813+0000 7f4a81ca3640 1 --2- 172.21.15.81:0/449361428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a7c100b10 0x7f4a7c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:41.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.813+0000 7f4a81ca3640 1 -- 172.21.15.81:0/449361428 >> 172.21.15.81:0/449361428 conn(0x7f4a7c0fc2a0 msgr2=0x7f4a7c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:41.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.814+0000 7f4a81ca3640 1 -- 172.21.15.81:0/449361428 shutdown_connections 2024-09-12T01:27:41.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.814+0000 7f4a81ca3640 1 -- 172.21.15.81:0/449361428 wait complete. 2024-09-12T01:27:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.814+0000 7f4a81ca3640 1 Processor -- start 2024-09-12T01:27:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.814+0000 7f4a81ca3640 1 -- start start 2024-09-12T01:27:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.814+0000 7f4a81ca3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c100b10 0x7f4a7c197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.814+0000 7f4a81ca3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a7c101d10 0x7f4a7c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.814+0000 7f4a81ca3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a7c1026d0 0x7f4a7c19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.814+0000 7f4a81ca3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c10c7f0 con 0x7f4a7c100b10 2024-09-12T01:27:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.814+0000 7f4a81ca3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c10c670 con 0x7f4a7c101d10 2024-09-12T01:27:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.814+0000 7f4a81ca3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c10c970 con 0x7f4a7c1026d0 2024-09-12T01:27:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.814+0000 7f4a7b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c100b10 0x7f4a7c197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.814+0000 7f4a7b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c100b10 0x7f4a7c197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45162/0 (socket says 172.21.15.81:45162) 2024-09-12T01:27:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.814+0000 7f4a7b7fe640 1 -- 172.21.15.81:0/1783173583 learned_addr learned my addr 172.21.15.81:0/1783173583 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.815+0000 7f4a7bfff640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a7c1026d0 0x7f4a7c19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.815+0000 7f4a73fff640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a7c101d10 0x7f4a7c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.815+0000 7f4a7b7fe640 1 -- 172.21.15.81:0/1783173583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a7c1026d0 msgr2=0x7f4a7c19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.815+0000 7f4a7b7fe640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a7c1026d0 0x7f4a7c19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.815+0000 7f4a7b7fe640 1 -- 172.21.15.81:0/1783173583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a7c101d10 msgr2=0x7f4a7c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.815+0000 7f4a7b7fe640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a7c101d10 0x7f4a7c198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.815+0000 7f4a7b7fe640 1 -- 172.21.15.81:0/1783173583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c19fb40 con 0x7f4a7c100b10 2024-09-12T01:27:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.815+0000 7f4a7b7fe640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c100b10 0x7f4a7c197f10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00d770 tx=0x7f4a6c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.815+0000 7f4a797fa640 1 -- 172.21.15.81:0/1783173583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c017070 con 0x7f4a7c100b10 2024-09-12T01:27:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.815+0000 7f4a797fa640 1 -- 172.21.15.81:0/1783173583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a6c009c30 con 0x7f4a7c100b10 2024-09-12T01:27:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.815+0000 7f4a81ca3640 1 -- 172.21.15.81:0/1783173583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7c19fe30 con 0x7f4a7c100b10 2024-09-12T01:27:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.815+0000 7f4a797fa640 1 -- 172.21.15.81:0/1783173583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c003dd0 con 0x7f4a7c100b10 2024-09-12T01:27:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.815+0000 7f4a81ca3640 1 -- 172.21.15.81:0/1783173583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7c1a0300 con 0x7f4a7c100b10 2024-09-12T01:27:41.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.816+0000 7f4a81ca3640 1 -- 172.21.15.81:0/1783173583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a7c1a0560 con 0x7f4a7c100b10 2024-09-12T01:27:41.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.817+0000 7f4a797fa640 1 -- 172.21.15.81:0/1783173583 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4a6c003f70 con 0x7f4a7c100b10 2024-09-12T01:27:41.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.818+0000 7f4a797fa640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4a680a2c40 0x7f4a680a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:41.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.818+0000 7f4a73fff640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4a680a2c40 0x7f4a680a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.818+0000 7f4a797fa640 1 -- 172.21.15.81:0/1783173583 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4a6c0ceb20 con 0x7f4a7c100b10 2024-09-12T01:27:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.818+0000 7f4a73fff640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4a680a2c40 0x7f4a680a5100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c199430 tx=0x7f4a64008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:41.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.822+0000 7f4a797fa640 1 -- 172.21.15.81:0/1783173583 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a6c09b930 con 0x7f4a7c100b10 2024-09-12T01:27:41.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.993+0000 7f4a81ca3640 1 -- 172.21.15.81:0/1783173583 --> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f4a7c062630 con 0x7f4a680a2c40 2024-09-12T01:27:41.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.995+0000 7f4a797fa640 1 -- 172.21.15.81:0/1783173583 <== mgr.14150 v2:172.21.15.81:6800/2591597081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f4a7c062630 con 0x7f4a680a2c40 2024-09-12T01:27:41.995 INFO:teuthology.orchestra.run.smithi081.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T01:27:41.995 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400N7400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T01:27:41.995 INFO:teuthology.orchestra.run.smithi081.stdout:smithi100 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WR400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T01:27:41.995 INFO:teuthology.orchestra.run.smithi081.stdout:smithi189 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6232004L400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T01:27:41.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.997+0000 7f4a81ca3640 1 -- 172.21.15.81:0/1783173583 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4a680a2c40 msgr2=0x7f4a680a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:41.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.997+0000 7f4a81ca3640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4a680a2c40 0x7f4a680a5100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c199430 tx=0x7f4a64008040 comp rx=0 tx=0).stop 2024-09-12T01:27:41.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.997+0000 7f4a81ca3640 1 -- 172.21.15.81:0/1783173583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c100b10 msgr2=0x7f4a7c197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:41.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.997+0000 7f4a81ca3640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c100b10 0x7f4a7c197f10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00d770 tx=0x7f4a6c00dc30 comp rx=0 tx=0).stop 2024-09-12T01:27:41.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.997+0000 7f4a81ca3640 1 -- 172.21.15.81:0/1783173583 shutdown_connections 2024-09-12T01:27:41.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.997+0000 7f4a81ca3640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f4a680a2c40 0x7f4a680a5100 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:41.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.997+0000 7f4a81ca3640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4a7c1026d0 0x7f4a7c19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:41.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.997+0000 7f4a81ca3640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a7c101d10 0x7f4a7c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:41.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.997+0000 7f4a81ca3640 1 --2- 172.21.15.81:0/1783173583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c100b10 0x7f4a7c197f10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:41.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.997+0000 7f4a81ca3640 1 -- 172.21.15.81:0/1783173583 >> 172.21.15.81:0/1783173583 conn(0x7f4a7c0fc2a0 msgr2=0x7f4a7c0fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:41.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.997+0000 7f4a81ca3640 1 -- 172.21.15.81:0/1783173583 shutdown_connections 2024-09-12T01:27:41.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:41.997+0000 7f4a81ca3640 1 -- 172.21.15.81:0/1783173583 wait complete. 2024-09-12T01:27:42.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:41 smithi100 ceph-mon[35275]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:42.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:41 smithi100 ceph-mon[35275]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:42.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:41 smithi189 ceph-mon[35357]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:42.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:41 smithi189 ceph-mon[35357]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:42.646 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:27:42.660 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T01:27:42.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T01:27:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.361+0000 7fa7ab033640 1 -- 172.21.15.81:0/21669046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4101d10 msgr2=0x7fa7a4102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.361+0000 7fa7ab033640 1 --2- 172.21.15.81:0/21669046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4101d10 0x7fa7a4102190 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa790009900 tx=0x7fa79002a410 comp rx=0 tx=0).stop 2024-09-12T01:27:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.361+0000 7fa7ab033640 1 -- 172.21.15.81:0/21669046 shutdown_connections 2024-09-12T01:27:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.361+0000 7fa7ab033640 1 --2- 172.21.15.81:0/21669046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7a41026d0 0x7fa7a4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.361+0000 7fa7ab033640 1 --2- 172.21.15.81:0/21669046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4101d10 0x7fa7a4102190 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.361+0000 7fa7ab033640 1 --2- 172.21.15.81:0/21669046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a4100b10 0x7fa7a4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.361+0000 7fa7ab033640 1 -- 172.21.15.81:0/21669046 >> 172.21.15.81:0/21669046 conn(0x7fa7a40fc2a0 msgr2=0x7fa7a40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.361+0000 7fa7ab033640 1 -- 172.21.15.81:0/21669046 shutdown_connections 2024-09-12T01:27:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.361+0000 7fa7ab033640 1 -- 172.21.15.81:0/21669046 wait complete. 2024-09-12T01:27:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7ab033640 1 Processor -- start 2024-09-12T01:27:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7ab033640 1 -- start start 2024-09-12T01:27:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7ab033640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4100b10 0x7fa7a406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7ab033640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7a4101d10 0x7fa7a419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7ab033640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a41026d0 0x7fa7a419f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7ab033640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a410c790 con 0x7fa7a4100b10 2024-09-12T01:27:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7ab033640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a410c610 con 0x7fa7a4101d10 2024-09-12T01:27:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7ab033640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a410c910 con 0x7fa7a41026d0 2024-09-12T01:27:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7a8dcf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4100b10 0x7fa7a406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7a8dcf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4100b10 0x7fa7a406b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47308/0 (socket says 172.21.15.81:47308) 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7a8dcf640 1 -- 172.21.15.81:0/2779229154 learned_addr learned my addr 172.21.15.81:0/2779229154 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7a3fff640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7a4101d10 0x7fa7a419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7a8dcf640 1 -- 172.21.15.81:0/2779229154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a41026d0 msgr2=0x7fa7a419f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7a8dcf640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a41026d0 0x7fa7a419f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7a8dcf640 1 -- 172.21.15.81:0/2779229154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7a4101d10 msgr2=0x7fa7a419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7a8dcf640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7a4101d10 0x7fa7a419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7a8dcf640 1 -- 172.21.15.81:0/2779229154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a419fbf0 con 0x7fa7a4100b10 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.362+0000 7fa7a3fff640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7a4101d10 0x7fa7a419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.363+0000 7fa7a8dcf640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4100b10 0x7fa7a406b2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa79800c970 tx=0x7fa79800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.363+0000 7fa7a1ffb640 1 -- 172.21.15.81:0/2779229154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798004220 con 0x7fa7a4100b10 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.363+0000 7fa7a1ffb640 1 -- 172.21.15.81:0/2779229154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7980043c0 con 0x7fa7a4100b10 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.363+0000 7fa7ab033640 1 -- 172.21.15.81:0/2779229154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a419fe80 con 0x7fa7a4100b10 2024-09-12T01:27:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.363+0000 7fa7a1ffb640 1 -- 172.21.15.81:0/2779229154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798004a00 con 0x7fa7a4100b10 2024-09-12T01:27:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.363+0000 7fa7ab033640 1 -- 172.21.15.81:0/2779229154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a41a02e0 con 0x7fa7a4100b10 2024-09-12T01:27:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.364+0000 7fa7ab033640 1 -- 172.21.15.81:0/2779229154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a4107f00 con 0x7fa7a4100b10 2024-09-12T01:27:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.365+0000 7fa7a1ffb640 1 -- 172.21.15.81:0/2779229154 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa7980079b0 con 0x7fa7a4100b10 2024-09-12T01:27:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.366+0000 7fa7a1ffb640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa7940a2c10 0x7fa7940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.366+0000 7fa7a3fff640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa7940a2c10 0x7fa7940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.366+0000 7fa7a1ffb640 1 -- 172.21.15.81:0/2779229154 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa7980cf010 con 0x7fa7a4100b10 2024-09-12T01:27:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.366+0000 7fa7a3fff640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa7940a2c10 0x7fa7940a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa790000c00 tx=0x7fa790031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.370+0000 7fa7a1ffb640 1 -- 172.21.15.81:0/2779229154 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa798014030 con 0x7fa7a4100b10 2024-09-12T01:27:43.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.574+0000 7fa7ab033640 1 -- 172.21.15.81:0/2779229154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa7a402d9b0 con 0x7fa7a4100b10 2024-09-12T01:27:43.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.574+0000 7fa7a1ffb640 1 -- 172.21.15.81:0/2779229154 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3128 (secure 0 0 0) 0x7fa79809be20 con 0x7fa7a4100b10 2024-09-12T01:27:43.573 INFO:teuthology.orchestra.run.smithi081.stdout:e27 2024-09-12T01:27:43.574 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-12T01:26:26:481147+0000 2024-09-12T01:27:43.574 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:27:43.574 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:27:43.574 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-12T01:27:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:43.574 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:27:43.574 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-12T01:27:43.574 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 27 2024-09-12T01:27:43.574 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T01:27:43.574 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-12T01:26:15.004450+0000 2024-09-12T01:27:43.574 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-12T01:26:26.481132+0000 2024-09-12T01:27:43.574 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 300 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 0 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 5 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1,2,3,4 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=24473,1=24448,2=24446,3=24401,4=24391} 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-12T01:27:43.575 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-12T01:27:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-12T01:27:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-12T01:27:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-12T01:27:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-12T01:27:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-12T01:27:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 0 2024-09-12T01:27:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 24473 members: 24473,24448,24446,24401,24391 2024-09-12T01:27:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b{0:24473} state up:active seq 4 addr [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:27:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c{0:24430} state up:standby-replay seq 1 addr [v2:172.21.15.189:6836/129654641,v1:172.21.15.189:6837/129654641] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:27:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.i{1:24448} state up:active seq 8 addr [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:27:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.e{1:24425} state up:standby-replay seq 1 addr [v2:172.21.15.100:6834/3858178529,v1:172.21.15.100:6835/3858178529] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:27:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.h{2:24446} state up:active seq 9 addr [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:27:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.f{2:24424} state up:standby-replay seq 1 addr [v2:172.21.15.189:6834/79706687,v1:172.21.15.189:6835/79706687] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:27:43.577 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.k{3:24401} state up:active seq 13 addr [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:27:43.577 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a{3:14613} state up:standby-replay seq 1 addr [v2:172.21.15.81:6840/3373717964,v1:172.21.15.81:6841/3373717964] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:27:43.577 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.l{4:24391} state up:active seq 14 addr [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:27:43.577 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.g{4:14601} state up:standby-replay seq 1 addr [v2:172.21.15.81:6838/1118446149,v1:172.21.15.81:6839/1118446149] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:27:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:43.577 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-12T01:27:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:43.577 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.j{-1:14541} state up:standby seq 1 addr [v2:172.21.15.81:6834/248009752,v1:172.21.15.81:6835/248009752] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:27:43.577 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d{-1:14553} state up:standby seq 1 addr [v2:172.21.15.81:6836/530662098,v1:172.21.15.81:6837/530662098] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-12T01:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.577+0000 7fa7ab033640 1 -- 172.21.15.81:0/2779229154 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa7940a2c10 msgr2=0x7fa7940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.577+0000 7fa7ab033640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa7940a2c10 0x7fa7940a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa790000c00 tx=0x7fa790031400 comp rx=0 tx=0).stop 2024-09-12T01:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.577+0000 7fa7ab033640 1 -- 172.21.15.81:0/2779229154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4100b10 msgr2=0x7fa7a406b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.577+0000 7fa7ab033640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4100b10 0x7fa7a406b2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa79800c970 tx=0x7fa79800ce30 comp rx=0 tx=0).stop 2024-09-12T01:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.577+0000 7fa7ab033640 1 -- 172.21.15.81:0/2779229154 shutdown_connections 2024-09-12T01:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.577+0000 7fa7ab033640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fa7940a2c10 0x7fa7940a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.577+0000 7fa7ab033640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a41026d0 0x7fa7a419f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.577+0000 7fa7ab033640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7a4101d10 0x7fa7a419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.577+0000 7fa7ab033640 1 --2- 172.21.15.81:0/2779229154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a4100b10 0x7fa7a406b2f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:43.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.577+0000 7fa7ab033640 1 -- 172.21.15.81:0/2779229154 >> 172.21.15.81:0/2779229154 conn(0x7fa7a40fc2a0 msgr2=0x7fa7a41050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:43.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.577+0000 7fa7ab033640 1 -- 172.21.15.81:0/2779229154 shutdown_connections 2024-09-12T01:27:43.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:43.577+0000 7fa7ab033640 1 -- 172.21.15.81:0/2779229154 wait complete. 2024-09-12T01:27:43.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:43 smithi081 ceph-mon[30920]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:43.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:43 smithi081 ceph-mon[30920]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:44.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:43 smithi100 ceph-mon[35275]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:44.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:43 smithi100 ceph-mon[35275]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:44.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:43 smithi189 ceph-mon[35357]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:27:44.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:43 smithi189 ceph-mon[35357]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:44.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T01:27:44.438 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:44.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:44 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2779229154' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:27:44.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:44 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2779229154' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:27:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.921+0000 7f8933117640 1 -- 172.21.15.81:0/695041737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892c102e00 msgr2=0x7f892c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.921+0000 7f8933117640 1 --2- 172.21.15.81:0/695041737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892c102e00 0x7f892c103280 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8918009900 tx=0x7f891802a410 comp rx=0 tx=0).stop 2024-09-12T01:27:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.921+0000 7f8933117640 1 -- 172.21.15.81:0/695041737 shutdown_connections 2024-09-12T01:27:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.921+0000 7f8933117640 1 --2- 172.21.15.81:0/695041737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f892c1037c0 0x7f892c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.921+0000 7f8933117640 1 --2- 172.21.15.81:0/695041737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892c102e00 0x7f892c103280 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.922+0000 7f8933117640 1 --2- 172.21.15.81:0/695041737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f892c101c00 0x7f892c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.922+0000 7f8933117640 1 -- 172.21.15.81:0/695041737 >> 172.21.15.81:0/695041737 conn(0x7f892c0fd3b0 msgr2=0x7f892c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.922+0000 7f8933117640 1 -- 172.21.15.81:0/695041737 shutdown_connections 2024-09-12T01:27:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.922+0000 7f8933117640 1 -- 172.21.15.81:0/695041737 wait complete. 2024-09-12T01:27:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.922+0000 7f8933117640 1 Processor -- start 2024-09-12T01:27:44.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.922+0000 7f8933117640 1 -- start start 2024-09-12T01:27:44.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.922+0000 7f8933117640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f892c101c00 0x7f892c197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:44.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.922+0000 7f8933117640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892c102e00 0x7f892c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:44.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.922+0000 7f8933117640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f892c1037c0 0x7f892c19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:44.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.922+0000 7f8933117640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f892c10d950 con 0x7f892c102e00 2024-09-12T01:27:44.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.922+0000 7f8933117640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f892c10d7d0 con 0x7f892c1037c0 2024-09-12T01:27:44.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.922+0000 7f8933117640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f892c10dad0 con 0x7f892c101c00 2024-09-12T01:27:44.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.922+0000 7f892bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892c102e00 0x7f892c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:44.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f892bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892c102e00 0x7f892c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47322/0 (socket says 172.21.15.81:47322) 2024-09-12T01:27:44.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f892bfff640 1 -- 172.21.15.81:0/3917939291 learned_addr learned my addr 172.21.15.81:0/3917939291 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:44.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f8930eb3640 1 --2- 172.21.15.81:0/3917939291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f892c101c00 0x7f892c197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:44.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f892bfff640 1 -- 172.21.15.81:0/3917939291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f892c101c00 msgr2=0x7f892c197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:44.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f892bfff640 1 --2- 172.21.15.81:0/3917939291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f892c101c00 0x7f892c197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:44.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f892bfff640 1 -- 172.21.15.81:0/3917939291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f892c1037c0 msgr2=0x7f892c19f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:44.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f892bfff640 1 --2- 172.21.15.81:0/3917939291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f892c1037c0 0x7f892c19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:44.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f892bfff640 1 -- 172.21.15.81:0/3917939291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892c19fb80 con 0x7f892c102e00 2024-09-12T01:27:44.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f892bfff640 1 --2- 172.21.15.81:0/3917939291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892c102e00 0x7f892c198490 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8918031440 tx=0x7f8918032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:44.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f8929ffb640 1 -- 172.21.15.81:0/3917939291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891803f030 con 0x7f892c102e00 2024-09-12T01:27:44.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f8929ffb640 1 -- 172.21.15.81:0/3917939291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8918003ce0 con 0x7f892c102e00 2024-09-12T01:27:44.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f8933117640 1 -- 172.21.15.81:0/3917939291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892c19fe10 con 0x7f892c102e00 2024-09-12T01:27:44.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f8929ffb640 1 -- 172.21.15.81:0/3917939291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918035070 con 0x7f892c102e00 2024-09-12T01:27:44.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.923+0000 7f8933117640 1 -- 172.21.15.81:0/3917939291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f892c1a02e0 con 0x7f892c102e00 2024-09-12T01:27:44.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.924+0000 7f8933117640 1 -- 172.21.15.81:0/3917939291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f892c108fb0 con 0x7f892c102e00 2024-09-12T01:27:44.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.925+0000 7f8929ffb640 1 -- 172.21.15.81:0/3917939291 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8918042030 con 0x7f892c102e00 2024-09-12T01:27:44.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.926+0000 7f8929ffb640 1 --2- 172.21.15.81:0/3917939291 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f891c0a2c40 0x7f891c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:44.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.926+0000 7f8930eb3640 1 --2- 172.21.15.81:0/3917939291 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f891c0a2c40 0x7f891c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:44.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.926+0000 7f8929ffb640 1 -- 172.21.15.81:0/3917939291 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89180ef760 con 0x7f892c102e00 2024-09-12T01:27:44.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.927+0000 7f8930eb3640 1 --2- 172.21.15.81:0/3917939291 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f891c0a2c40 0x7f891c0a5100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f892c102c60 tx=0x7f8920009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:44.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:44.930+0000 7f8929ffb640 1 -- 172.21.15.81:0/3917939291 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89180bc570 con 0x7f892c102e00 2024-09-12T01:27:45.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:44 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2779229154' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:27:45.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.101+0000 7f8933117640 1 -- 172.21.15.81:0/3917939291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f892c02d7c0 con 0x7f892c102e00 2024-09-12T01:27:45.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.102+0000 7f8929ffb640 1 -- 172.21.15.81:0/3917939291 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5281 (secure 0 0 0) 0x7f89180bbe70 con 0x7f892c102e00 2024-09-12T01:27:45.101 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 82 2024-09-12T01:27:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:fsid c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:27:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-12T01:18:28.404285+0000 2024-09-12T01:27:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-12T01:26:26.256495+0000 2024-09-12T01:27:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T01:27:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:crush_version 26 2024-09-12T01:27:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:full_ratio 0.95 2024-09-12T01:27:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:backfillfull_ratio 0.9 2024-09-12T01:27:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:nearfull_ratio 0.85 2024-09-12T01:27:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:require_min_compat_client luminous 2024-09-12T01:27:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:min_compat_client luminous 2024-09-12T01:27:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:require_osd_release squid 2024-09-12T01:27:45.102 INFO:teuthology.orchestra.run.smithi081.stdout:stretch_mode_enabled false 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:max_osd 12 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 up in weight 1 up_from 8 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6802/3870994528,v1:172.21.15.81:6803/3870994528] [v2:172.21.15.81:6804/3870994528,v1:172.21.15.81:6805/3870994528] exists,up dc857dd4-eedc-4c48-89a0-4e69662e8e6d 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 up in weight 1 up_from 13 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6800/2098299652,v1:172.21.15.100:6801/2098299652] [v2:172.21.15.100:6802/2098299652,v1:172.21.15.100:6803/2098299652] exists,up 04b8111b-d677-4fc8-8285-90683621ccf3 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 up in weight 1 up_from 18 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6800/1353548110,v1:172.21.15.189:6801/1353548110] [v2:172.21.15.189:6802/1353548110,v1:172.21.15.189:6803/1353548110] exists,up 763e357e-5a04-45ff-95e8-bc1abfeac056 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 up in weight 1 up_from 24 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6810/1064869637,v1:172.21.15.81:6811/1064869637] [v2:172.21.15.81:6812/1064869637,v1:172.21.15.81:6813/1064869637] exists,up 99843578-1b9e-4ee0-91f1-ba419d07897e 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 up in weight 1 up_from 31 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6808/1687792282,v1:172.21.15.100:6809/1687792282] [v2:172.21.15.100:6810/1687792282,v1:172.21.15.100:6811/1687792282] exists,up a5787415-0905-420e-9ce8-eb6902727561 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 up in weight 1 up_from 35 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6808/823474396,v1:172.21.15.189:6809/823474396] [v2:172.21.15.189:6810/823474396,v1:172.21.15.189:6811/823474396] exists,up 879548b5-5516-407c-8517-bbdbf356c0e5 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 up in weight 1 up_from 42 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6818/1522854005,v1:172.21.15.81:6819/1522854005] [v2:172.21.15.81:6820/1522854005,v1:172.21.15.81:6821/1522854005] exists,up b665b97c-a9d3-475f-93f3-8a920cbb37d3 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 up in weight 1 up_from 47 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6816/41478541,v1:172.21.15.100:6817/41478541] [v2:172.21.15.100:6818/41478541,v1:172.21.15.100:6819/41478541] exists,up 46e082c8-d071-471a-8c86-ce5b5700cec5 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:osd.8 up in weight 1 up_from 55 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6816/180766860,v1:172.21.15.189:6817/180766860] [v2:172.21.15.189:6818/180766860,v1:172.21.15.189:6819/180766860] exists,up fb9b93ef-5a33-4ffc-926e-a78c101bbbbe 2024-09-12T01:27:45.103 INFO:teuthology.orchestra.run.smithi081.stdout:osd.9 up in weight 1 up_from 62 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6826/1651232782,v1:172.21.15.81:6827/1651232782] [v2:172.21.15.81:6828/1651232782,v1:172.21.15.81:6829/1651232782] exists,up 0b7ec1a1-5ab9-4075-acfb-e0d82f018656 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:osd.10 up in weight 1 up_from 67 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6824/3295868568,v1:172.21.15.100:6825/3295868568] [v2:172.21.15.100:6826/3295868568,v1:172.21.15.100:6827/3295868568] exists,up 996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:osd.11 up in weight 1 up_from 74 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6824/3852230978,v1:172.21.15.189:6825/3852230978] [v2:172.21.15.189:6826/3852230978,v1:172.21.15.189:6827/3852230978] exists,up f051e2b2-fc58-489a-ab7c-8c1ff5448553 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 2.4 [2,11] 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 2.f [8,11] 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 2.1a [8,1] 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 2.1d [2,4] 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.0 [5,9] 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.1b [4,8] 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.24 [4,9] 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.27 [3,9] 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/4128337402 expires 2024-09-13T01:19:24.346074+0000 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6800/1857307616 expires 2024-09-13T01:19:24.346074+0000 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/1460332159 expires 2024-09-13T01:19:24.346074+0000 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/2577694203 expires 2024-09-13T01:19:00.926419+0000 2024-09-12T01:27:45.104 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6801/1762827469 expires 2024-09-13T01:19:00.926419+0000 2024-09-12T01:27:45.105 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6801/1857307616 expires 2024-09-13T01:19:24.346074+0000 2024-09-12T01:27:45.105 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/2393807982 expires 2024-09-13T01:19:24.346074+0000 2024-09-12T01:27:45.105 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6800/1762827469 expires 2024-09-13T01:19:00.926419+0000 2024-09-12T01:27:45.105 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/2162789959 expires 2024-09-13T01:19:00.926419+0000 2024-09-12T01:27:45.105 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/4219073331 expires 2024-09-13T01:19:00.926419+0000 2024-09-12T01:27:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.104+0000 7f8933117640 1 -- 172.21.15.81:0/3917939291 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f891c0a2c40 msgr2=0x7f891c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.104+0000 7f8933117640 1 --2- 172.21.15.81:0/3917939291 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f891c0a2c40 0x7f891c0a5100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f892c102c60 tx=0x7f8920009110 comp rx=0 tx=0).stop 2024-09-12T01:27:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.104+0000 7f8933117640 1 -- 172.21.15.81:0/3917939291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892c102e00 msgr2=0x7f892c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.104+0000 7f8933117640 1 --2- 172.21.15.81:0/3917939291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892c102e00 0x7f892c198490 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8918031440 tx=0x7f8918032ce0 comp rx=0 tx=0).stop 2024-09-12T01:27:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.104+0000 7f8933117640 1 -- 172.21.15.81:0/3917939291 shutdown_connections 2024-09-12T01:27:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.104+0000 7f8933117640 1 --2- 172.21.15.81:0/3917939291 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f891c0a2c40 0x7f891c0a5100 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.104+0000 7f8933117640 1 --2- 172.21.15.81:0/3917939291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f892c1037c0 0x7f892c19f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.104+0000 7f8933117640 1 --2- 172.21.15.81:0/3917939291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892c102e00 0x7f892c198490 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.104+0000 7f8933117640 1 --2- 172.21.15.81:0/3917939291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f892c101c00 0x7f892c197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.104+0000 7f8933117640 1 -- 172.21.15.81:0/3917939291 >> 172.21.15.81:0/3917939291 conn(0x7f892c0fd3b0 msgr2=0x7f892c106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.105+0000 7f8933117640 1 -- 172.21.15.81:0/3917939291 shutdown_connections 2024-09-12T01:27:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:45.105+0000 7f8933117640 1 -- 172.21.15.81:0/3917939291 wait complete. 2024-09-12T01:27:45.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:45 smithi081 ceph-mon[30920]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:45.730 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:45 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3917939291' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T01:27:45.756 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T01:27:45.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:27:46.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:45 smithi100 ceph-mon[35275]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:46.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:45 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3917939291' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T01:27:46.021 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:46.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:45 smithi189 ceph-mon[35357]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:46.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:45 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3917939291' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T01:27:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.521+0000 7f7cada4c640 1 -- 172.21.15.81:0/2890898373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca8106a80 msgr2=0x7f7ca8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.521+0000 7f7cada4c640 1 --2- 172.21.15.81:0/2890898373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca8106a80 0x7f7ca8106e60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009930 tx=0x7f7c9802a420 comp rx=0 tx=0).stop 2024-09-12T01:27:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.521+0000 7f7cada4c640 1 -- 172.21.15.81:0/2890898373 shutdown_connections 2024-09-12T01:27:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.521+0000 7f7cada4c640 1 --2- 172.21.15.81:0/2890898373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ca8101420 0x7f7ca810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.521+0000 7f7cada4c640 1 --2- 172.21.15.81:0/2890898373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca8100a80 0x7f7ca8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.521+0000 7f7cada4c640 1 --2- 172.21.15.81:0/2890898373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca8106a80 0x7f7ca8106e60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.521+0000 7f7cada4c640 1 -- 172.21.15.81:0/2890898373 >> 172.21.15.81:0/2890898373 conn(0x7f7ca80fc7a0 msgr2=0x7f7ca80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.521+0000 7f7cada4c640 1 -- 172.21.15.81:0/2890898373 shutdown_connections 2024-09-12T01:27:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.521+0000 7f7cada4c640 1 -- 172.21.15.81:0/2890898373 wait complete. 2024-09-12T01:27:46.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.522+0000 7f7cada4c640 1 Processor -- start 2024-09-12T01:27:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.522+0000 7f7cada4c640 1 -- start start 2024-09-12T01:27:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.522+0000 7f7cada4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca8100a80 0x7f7ca81992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.522+0000 7f7cada4c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ca8101420 0x7f7ca81997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.522+0000 7f7cada4c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca8106a80 0x7f7ca81a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.522+0000 7f7cada4c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca8110e80 con 0x7f7ca8106a80 2024-09-12T01:27:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.522+0000 7f7cada4c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca8110d00 con 0x7f7ca8100a80 2024-09-12T01:27:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.522+0000 7f7cada4c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca8111000 con 0x7f7ca8101420 2024-09-12T01:27:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.522+0000 7f7ca77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca8106a80 0x7f7ca81a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.522+0000 7f7ca77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca8106a80 0x7f7ca81a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47340/0 (socket says 172.21.15.81:47340) 2024-09-12T01:27:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.522+0000 7f7ca6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca8100a80 0x7f7ca81992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.522+0000 7f7ca77fe640 1 -- 172.21.15.81:0/2785171142 learned_addr learned my addr 172.21.15.81:0/2785171142 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.522+0000 7f7c9ffff640 1 --2- 172.21.15.81:0/2785171142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ca8101420 0x7f7ca81997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:46.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.523+0000 7f7ca77fe640 1 -- 172.21.15.81:0/2785171142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ca8101420 msgr2=0x7f7ca81997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.523+0000 7f7ca77fe640 1 --2- 172.21.15.81:0/2785171142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ca8101420 0x7f7ca81997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.523+0000 7f7ca77fe640 1 -- 172.21.15.81:0/2785171142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca8100a80 msgr2=0x7f7ca81992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.523+0000 7f7ca77fe640 1 --2- 172.21.15.81:0/2785171142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca8100a80 0x7f7ca81992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.523+0000 7f7ca77fe640 1 -- 172.21.15.81:0/2785171142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca81a4870 con 0x7f7ca8106a80 2024-09-12T01:27:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.523+0000 7f7ca77fe640 1 --2- 172.21.15.81:0/2785171142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca8106a80 0x7f7ca81a4330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000cad0 tx=0x7f7ca000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.523+0000 7f7caca4a640 1 -- 172.21.15.81:0/2785171142 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca000ae20 con 0x7f7ca8106a80 2024-09-12T01:27:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.523+0000 7f7caca4a640 1 -- 172.21.15.81:0/2785171142 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca0005020 con 0x7f7ca8106a80 2024-09-12T01:27:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.523+0000 7f7cada4c640 1 -- 172.21.15.81:0/2785171142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca81a4a40 con 0x7f7ca8106a80 2024-09-12T01:27:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.523+0000 7f7caca4a640 1 -- 172.21.15.81:0/2785171142 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca000f6f0 con 0x7f7ca8106a80 2024-09-12T01:27:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.523+0000 7f7cada4c640 1 -- 172.21.15.81:0/2785171142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca81a4f50 con 0x7f7ca8106a80 2024-09-12T01:27:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.524+0000 7f7cada4c640 1 -- 172.21.15.81:0/2785171142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca8100ee0 con 0x7f7ca8106a80 2024-09-12T01:27:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.525+0000 7f7caca4a640 1 -- 172.21.15.81:0/2785171142 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7ca00051d0 con 0x7f7ca8106a80 2024-09-12T01:27:46.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.526+0000 7f7caca4a640 1 --2- 172.21.15.81:0/2785171142 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f7c940a2c10 0x7f7c940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.526+0000 7f7ca6ffd640 1 --2- 172.21.15.81:0/2785171142 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f7c940a2c10 0x7f7c940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.526+0000 7f7caca4a640 1 -- 172.21.15.81:0/2785171142 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7ca00cf450 con 0x7f7ca8106a80 2024-09-12T01:27:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.526+0000 7f7ca6ffd640 1 --2- 172.21.15.81:0/2785171142 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f7c940a2c10 0x7f7c940a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009900 tx=0x7f7c980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.530+0000 7f7caca4a640 1 -- 172.21.15.81:0/2785171142 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ca0014030 con 0x7f7ca8106a80 2024-09-12T01:27:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.734+0000 7f7cada4c640 1 -- 172.21.15.81:0/2785171142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ca8108ff0 con 0x7f7ca8106a80 2024-09-12T01:27:46.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.734+0000 7f7caca4a640 1 -- 172.21.15.81:0/2785171142 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7f7ca009bbb0 con 0x7f7ca8106a80 2024-09-12T01:27:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:46.734 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-12T01:26:26:481147+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:26:26.481132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24448,24446,24401,24391]},"id":1}]} 2024-09-12T01:27:46.734 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-12T01:27:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.736+0000 7f7cada4c640 1 -- 172.21.15.81:0/2785171142 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f7c940a2c10 msgr2=0x7f7c940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.736+0000 7f7cada4c640 1 --2- 172.21.15.81:0/2785171142 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f7c940a2c10 0x7f7c940a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009900 tx=0x7f7c980058d0 comp rx=0 tx=0).stop 2024-09-12T01:27:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.736+0000 7f7cada4c640 1 -- 172.21.15.81:0/2785171142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca8106a80 msgr2=0x7f7ca81a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.736+0000 7f7cada4c640 1 --2- 172.21.15.81:0/2785171142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca8106a80 0x7f7ca81a4330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000cad0 tx=0x7f7ca000cf90 comp rx=0 tx=0).stop 2024-09-12T01:27:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.737+0000 7f7cada4c640 1 -- 172.21.15.81:0/2785171142 shutdown_connections 2024-09-12T01:27:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.737+0000 7f7cada4c640 1 --2- 172.21.15.81:0/2785171142 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f7c940a2c10 0x7f7c940a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.737+0000 7f7cada4c640 1 --2- 172.21.15.81:0/2785171142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca8106a80 0x7f7ca81a4330 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.737+0000 7f7cada4c640 1 --2- 172.21.15.81:0/2785171142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ca8101420 0x7f7ca81997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:46.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.737+0000 7f7cada4c640 1 --2- 172.21.15.81:0/2785171142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca8100a80 0x7f7ca81992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:46.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.737+0000 7f7cada4c640 1 -- 172.21.15.81:0/2785171142 >> 172.21.15.81:0/2785171142 conn(0x7f7ca80fc7a0 msgr2=0x7f7ca80fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:46.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.737+0000 7f7cada4c640 1 -- 172.21.15.81:0/2785171142 shutdown_connections 2024-09-12T01:27:46.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:46.737+0000 7f7cada4c640 1 -- 172.21.15.81:0/2785171142 wait complete. 2024-09-12T01:27:47.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:27:47.596 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:47.717 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:47 smithi081 ceph-mon[30920]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:27:47.717 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:47 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2785171142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:48.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:47 smithi100 ceph-mon[35275]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:27:48.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:47 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2785171142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:48.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:47 smithi189 ceph-mon[35357]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:27:48.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:47 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2785171142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:48.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.112+0000 7f8472bbd640 1 -- 172.21.15.81:0/2602050925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f846c10c180 msgr2=0x7f846c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:48.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.112+0000 7f8472bbd640 1 --2- 172.21.15.81:0/2602050925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f846c10c180 0x7f846c10e600 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8464009ca0 tx=0x7f846402a950 comp rx=0 tx=0).stop 2024-09-12T01:27:48.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.112+0000 7f8472bbd640 1 -- 172.21.15.81:0/2602050925 shutdown_connections 2024-09-12T01:27:48.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.112+0000 7f8472bbd640 1 --2- 172.21.15.81:0/2602050925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f846c10c180 0x7f846c10e600 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.112+0000 7f8472bbd640 1 --2- 172.21.15.81:0/2602050925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f846c1036c0 0x7f846c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.112+0000 7f8472bbd640 1 --2- 172.21.15.81:0/2602050925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f846c102da0 0x7f846c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.112+0000 7f8472bbd640 1 -- 172.21.15.81:0/2602050925 >> 172.21.15.81:0/2602050925 conn(0x7f846c0fc7a0 msgr2=0x7f846c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.112+0000 7f8472bbd640 1 -- 172.21.15.81:0/2602050925 shutdown_connections 2024-09-12T01:27:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.112+0000 7f8472bbd640 1 -- 172.21.15.81:0/2602050925 wait complete. 2024-09-12T01:27:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f8472bbd640 1 Processor -- start 2024-09-12T01:27:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f8472bbd640 1 -- start start 2024-09-12T01:27:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f8472bbd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f846c102da0 0x7f846c100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f8472bbd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f846c1036c0 0x7f846c100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f8472bbd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f846c10c180 0x7f846c101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f8472bbd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f846c111ff0 con 0x7f846c1036c0 2024-09-12T01:27:48.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f8472bbd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f846c111e70 con 0x7f846c102da0 2024-09-12T01:27:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f8472bbd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f846c112170 con 0x7f846c10c180 2024-09-12T01:27:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f846bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f846c1036c0 0x7f846c100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f846bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f846c1036c0 0x7f846c100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47358/0 (socket says 172.21.15.81:47358) 2024-09-12T01:27:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f846bfff640 1 -- 172.21.15.81:0/2139873012 learned_addr learned my addr 172.21.15.81:0/2139873012 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f8470959640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f846c102da0 0x7f846c100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f846bfff640 1 -- 172.21.15.81:0/2139873012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f846c10c180 msgr2=0x7f846c101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f846bfff640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f846c10c180 0x7f846c101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f846bfff640 1 -- 172.21.15.81:0/2139873012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f846c102da0 msgr2=0x7f846c100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f846bfff640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f846c102da0 0x7f846c100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f846bfff640 1 -- 172.21.15.81:0/2139873012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846c1a68d0 con 0x7f846c1036c0 2024-09-12T01:27:48.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f8470959640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f846c102da0 0x7f846c100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.113+0000 7f846bfff640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f846c1036c0 0x7f846c100f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f845800c890 tx=0x7f845800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.114+0000 7f8469ffb640 1 -- 172.21.15.81:0/2139873012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458004220 con 0x7f846c1036c0 2024-09-12T01:27:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.114+0000 7f8469ffb640 1 -- 172.21.15.81:0/2139873012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84580043c0 con 0x7f846c1036c0 2024-09-12T01:27:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.114+0000 7f8469ffb640 1 -- 172.21.15.81:0/2139873012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84580049e0 con 0x7f846c1036c0 2024-09-12T01:27:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.114+0000 7f8472bbd640 1 -- 172.21.15.81:0/2139873012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846c1a6bc0 con 0x7f846c1036c0 2024-09-12T01:27:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.114+0000 7f8472bbd640 1 -- 172.21.15.81:0/2139873012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f846c1a7150 con 0x7f846c1036c0 2024-09-12T01:27:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.115+0000 7f8472bbd640 1 -- 172.21.15.81:0/2139873012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f846c103180 con 0x7f846c1036c0 2024-09-12T01:27:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.116+0000 7f8469ffb640 1 -- 172.21.15.81:0/2139873012 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f84580079b0 con 0x7f846c1036c0 2024-09-12T01:27:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.116+0000 7f8469ffb640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f845c0a2c90 0x7f845c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:48.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.116+0000 7f8470959640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f845c0a2c90 0x7f845c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.116+0000 7f8469ffb640 1 -- 172.21.15.81:0/2139873012 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f84580cf250 con 0x7f846c1036c0 2024-09-12T01:27:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.117+0000 7f8470959640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f845c0a2c90 0x7f845c0a5150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8460009930 tx=0x7f8460008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.120+0000 7f8469ffb640 1 -- 172.21.15.81:0/2139873012 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8458014030 con 0x7f846c1036c0 2024-09-12T01:27:48.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.321+0000 7f8472bbd640 1 -- 172.21.15.81:0/2139873012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f846c1a7380 con 0x7f846c1036c0 2024-09-12T01:27:48.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.321+0000 7f8469ffb640 1 -- 172.21.15.81:0/2139873012 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7f845809c060 con 0x7f846c1036c0 2024-09-12T01:27:48.321 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:48.321 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-12T01:26:26:481147+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:26:26.481132+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24448,24446,24401,24391]},"id":1}]} 2024-09-12T01:27:48.321 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-12T01:27:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.324+0000 7f8472bbd640 1 -- 172.21.15.81:0/2139873012 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f845c0a2c90 msgr2=0x7f845c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.324+0000 7f8472bbd640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f845c0a2c90 0x7f845c0a5150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8460009930 tx=0x7f8460008040 comp rx=0 tx=0).stop 2024-09-12T01:27:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.324+0000 7f8472bbd640 1 -- 172.21.15.81:0/2139873012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f846c1036c0 msgr2=0x7f846c100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.324+0000 7f8472bbd640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f846c1036c0 0x7f846c100f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f845800c890 tx=0x7f845800cd50 comp rx=0 tx=0).stop 2024-09-12T01:27:48.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.324+0000 7f8472bbd640 1 -- 172.21.15.81:0/2139873012 shutdown_connections 2024-09-12T01:27:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.324+0000 7f8472bbd640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f845c0a2c90 0x7f845c0a5150 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.324+0000 7f8472bbd640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f846c10c180 0x7f846c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.324+0000 7f8472bbd640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f846c1036c0 0x7f846c100f40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.324+0000 7f8472bbd640 1 --2- 172.21.15.81:0/2139873012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f846c102da0 0x7f846c100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.324+0000 7f8472bbd640 1 -- 172.21.15.81:0/2139873012 >> 172.21.15.81:0/2139873012 conn(0x7f846c0fc7a0 msgr2=0x7f846c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.324+0000 7f8472bbd640 1 -- 172.21.15.81:0/2139873012 shutdown_connections 2024-09-12T01:27:48.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:48.324+0000 7f8472bbd640 1 -- 172.21.15.81:0/2139873012 wait complete. 2024-09-12T01:27:48.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:48 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2139873012' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:48.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:27:49.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:48 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2139873012' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:49.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:48 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2139873012' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:27:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.643+0000 7fbbd63e5640 1 -- 172.21.15.81:0/2803621714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbd0106a80 msgr2=0x7fbbd0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.643+0000 7fbbd63e5640 1 --2- 172.21.15.81:0/2803621714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbd0106a80 0x7fbbd0106e60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0009930 tx=0x7fbbc002a420 comp rx=0 tx=0).stop 2024-09-12T01:27:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.643+0000 7fbbd63e5640 1 -- 172.21.15.81:0/2803621714 shutdown_connections 2024-09-12T01:27:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.643+0000 7fbbd63e5640 1 --2- 172.21.15.81:0/2803621714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbd0101420 0x7fbbd010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.643+0000 7fbbd63e5640 1 --2- 172.21.15.81:0/2803621714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbd0100a80 0x7fbbd0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.643+0000 7fbbd63e5640 1 --2- 172.21.15.81:0/2803621714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbd0106a80 0x7fbbd0106e60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.643+0000 7fbbd63e5640 1 -- 172.21.15.81:0/2803621714 >> 172.21.15.81:0/2803621714 conn(0x7fbbd00fc7a0 msgr2=0x7fbbd00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.643+0000 7fbbd63e5640 1 -- 172.21.15.81:0/2803621714 shutdown_connections 2024-09-12T01:27:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.643+0000 7fbbd63e5640 1 -- 172.21.15.81:0/2803621714 wait complete. 2024-09-12T01:27:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.644+0000 7fbbd63e5640 1 Processor -- start 2024-09-12T01:27:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.644+0000 7fbbd63e5640 1 -- start start 2024-09-12T01:27:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.644+0000 7fbbd63e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbd0100a80 0x7fbbd0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.644+0000 7fbbd63e5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbd0101420 0x7fbbd01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.644+0000 7fbbd63e5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbd0106a80 0x7fbbd019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.644+0000 7fbbd63e5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd0110ed0 con 0x7fbbd0106a80 2024-09-12T01:27:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.644+0000 7fbbd63e5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd0110d50 con 0x7fbbd0100a80 2024-09-12T01:27:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.644+0000 7fbbd63e5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd0111050 con 0x7fbbd0101420 2024-09-12T01:27:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.644+0000 7fbbd4982640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbd0106a80 0x7fbbd019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.644+0000 7fbbd4982640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbd0106a80 0x7fbbd019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47368/0 (socket says 172.21.15.81:47368) 2024-09-12T01:27:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.644+0000 7fbbd4982640 1 -- 172.21.15.81:0/399177417 learned_addr learned my addr 172.21.15.81:0/399177417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.644+0000 7fbbcffff640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbd0100a80 0x7fbbd0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.644+0000 7fbbc7fff640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbd0101420 0x7fbbd01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.645+0000 7fbbd4982640 1 -- 172.21.15.81:0/399177417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbd0101420 msgr2=0x7fbbd01989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.645+0000 7fbbd4982640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbd0101420 0x7fbbd01989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.645+0000 7fbbd4982640 1 -- 172.21.15.81:0/399177417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbd0100a80 msgr2=0x7fbbd0198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.645+0000 7fbbd4982640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbd0100a80 0x7fbbd0198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.645+0000 7fbbd4982640 1 -- 172.21.15.81:0/399177417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd019d420 con 0x7fbbd0106a80 2024-09-12T01:27:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.645+0000 7fbbc7fff640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbd0101420 0x7fbbd01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.645+0000 7fbbd4982640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbd0106a80 0x7fbbd019cd40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009fd0 tx=0x7fbbc800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.645+0000 7fbbcdffb640 1 -- 172.21.15.81:0/399177417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8017070 con 0x7fbbd0106a80 2024-09-12T01:27:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.645+0000 7fbbd63e5640 1 -- 172.21.15.81:0/399177417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbd019d710 con 0x7fbbd0106a80 2024-09-12T01:27:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.645+0000 7fbbcdffb640 1 -- 172.21.15.81:0/399177417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbc8003e50 con 0x7fbbd0106a80 2024-09-12T01:27:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.645+0000 7fbbcdffb640 1 -- 172.21.15.81:0/399177417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80106c0 con 0x7fbbd0106a80 2024-09-12T01:27:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.645+0000 7fbbd63e5640 1 -- 172.21.15.81:0/399177417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbd01a4ff0 con 0x7fbbd0106a80 2024-09-12T01:27:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.646+0000 7fbbd63e5640 1 -- 172.21.15.81:0/399177417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbd0100ee0 con 0x7fbbd0106a80 2024-09-12T01:27:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.647+0000 7fbbcdffb640 1 -- 172.21.15.81:0/399177417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbbc8003970 con 0x7fbbd0106a80 2024-09-12T01:27:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.648+0000 7fbbcdffb640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbbbc0a2c10 0x7fbbbc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.648+0000 7fbbcdffb640 1 -- 172.21.15.81:0/399177417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbbc80cef30 con 0x7fbbd0106a80 2024-09-12T01:27:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.648+0000 7fbbcffff640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbbbc0a2c10 0x7fbbbc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.648+0000 7fbbcffff640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbbbc0a2c10 0x7fbbbc0a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0006010 tx=0x7fbbc0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.652+0000 7fbbcdffb640 1 -- 172.21.15.81:0/399177417 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbbc809bd40 con 0x7fbbd0106a80 2024-09-12T01:27:49.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.819+0000 7fbbd63e5640 1 -- 172.21.15.81:0/399177417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbd010a000 con 0x7fbbd0106a80 2024-09-12T01:27:49.819 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:49 smithi081 ceph-mon[30920]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:49.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.821+0000 7fbbcdffb640 1 -- 172.21.15.81:0/399177417 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22714 (secure 0 0 0) 0x7fbbc8097020 con 0x7fbbd0106a80 2024-09-12T01:27:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:27:49.821 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","created":"2024-09-12T01:18:28.404285+0000","modified":"2024-09-12T01:26:26.256495+0000","last_up_change":"2024-09-12T01:25:26.326110+0000","last_in_change":"2024-09-12T01:25:02.138698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:21:40.649584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:26:10.753723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:26:13.254837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc857dd4-eedc-4c48-89a0-4e69662e8e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6803","nonce":3870994528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6805","nonce":3870994528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6809","nonce":3870994528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6807","nonce":3870994528}]},"public_addr":"172.21.15.81:6803/3870994528","cluster_addr":"172.21.15.81:6805/3870994528","heartbeat_back_addr":"172.21.15.81:6809/3870994528","heartbeat_front_addr":"172.21.15.81:6807/3870994528","state":["exists","up"]},{"osd":1,"uuid":"04b8111b-d677-4fc8-8285-90683621ccf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6801","nonce":2098299652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6803","nonce":2098299652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6807","nonce":2098299652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6805","nonce":2098299652}]},"public_addr":"172.21.15.100:6801/2098299652","cluster_addr":"172.21.15.100:6803/2098299652","heartbeat_back_addr":"172.21.15.100:6807/2098299652","heartbeat_front_addr":"172.21.15.100:6805/2098299652","state":["exists","up"]},{"osd":2,"uuid":"763e357e-5a04-45ff-95e8-bc1abfeac056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6801","nonce":1353548110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6803","nonce":1353548110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6807","nonce":1353548110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6805","nonce":1353548110}]},"public_addr":"172.21.15.189:6801/1353548110","cluster_addr":"172.21.15.189:6803/1353548110","heartbeat_back_addr":"172.21.15.189:6807/1353548110","heartbeat_front_addr":"172.21.15.189:6805/1353548110","state":["exists","up"]},{"osd":3,"uuid":"99843578-1b9e-4ee0-91f1-ba419d07897e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6811","nonce":1064869637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6813","nonce":1064869637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6817","nonce":1064869637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6815","nonce":1064869637}]},"public_addr":"172.21.15.81:6811/1064869637","cluster_addr":"172.21.15.81:6813/1064869637","heartbeat_back_addr":"172.21.15.81:6817/1064869637","heartbeat_front_addr":"172.21.15.81:6815/1064869637","state":["exists","up"]},{"osd":4,"uuid":"a5787415-0905-420e-9ce8-eb6902727561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6809","nonce":1687792282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6811","nonce":1687792282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6815","nonce":1687792282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6813","nonce":1687792282}]},"public_addr":"172.21.15.100:6809/1687792282","cluster_addr":"172.21.15.100:6811/1687792282","heartbeat_back_addr":"172.21.15.100:6815/1687792282","heartbeat_front_addr":"172.21.15.100:6813/1687792282","state":["exists","up"]},{"osd":5,"uuid":"879548b5-5516-407c-8517-bbdbf356c0e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6809","nonce":823474396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6811","nonce":823474396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6815","nonce":823474396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6813","nonce":823474396}]},"public_addr":"172.21.15.189:6809/823474396","cluster_addr":"172.21.15.189:6811/823474396","heartbeat_back_addr":"172.21.15.189:6815/823474396","heartbeat_front_addr":"172.21.15.189:6813/823474396","state":["exists","up"]},{"osd":6,"uuid":"b665b97c-a9d3-475f-93f3-8a920cbb37d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6819","nonce":1522854005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6821","nonce":1522854005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6825","nonce":1522854005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6823","nonce":1522854005}]},"public_addr":"172.21.15.81:6819/1522854005","cluster_addr":"172.21.15.81:6821/1522854005","heartbeat_back_addr":"172.21.15.81:6825/1522854005","heartbeat_front_addr":"172.21.15.81:6823/1522854005","state":["exists","up"]},{"osd":7,"uuid":"46e082c8-d071-471a-8c86-ce5b5700cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6817","nonce":41478541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6819","nonce":41478541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6823","nonce":41478541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6821","nonce":41478541}]},"public_addr":"172.21.15.100:6817/41478541","cluster_addr":"172.21.15.100:6819/41478541","heartbeat_back_addr":"172.21.15.100:6823/41478541","heartbeat_front_addr":"172.21.15.100:6821/41478541","state":["exists","up"]},{"osd":8,"uuid":"fb9b93ef-5a33-4ffc-926e-a78c101bbbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6817","nonce":180766860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6819","nonce":180766860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6823","nonce":180766860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6821","nonce":180766860}]},"public_addr":"172.21.15.189:6817/180766860","cluster_addr":"172.21.15.189:6819/180766860","heartbeat_back_addr":"172.21.15.189:6823/180766860","heartbeat_front_addr":"172.21.15.189:6821/180766860","state":["exists","up"]},{"osd":9,"uuid":"0b7ec1a1-5ab9-4075-acfb-e0d82f018656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6827","nonce":1651232782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6829","nonce":1651232782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6833","nonce":1651232782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6831","nonce":1651232782}]},"public_addr":"172.21.15.81:6827/1651232782","cluster_addr":"172.21.15.81:6829/1651232782","heartbeat_back_addr":"172.21.15.81:6833/1651232782","heartbeat_front_addr":"172.21.15.81:6831/1651232782","state":["exists","up"]},{"osd":10,"uuid":"996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6825","nonce":3295868568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6827","nonce":3295868568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6831","nonce":3295868568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6829","nonce":3295868568}]},"public_addr":"172.21.15.100:6825/3295868568","cluster_addr":"172.21.15.100:6827/3295868568","heartbeat_back_addr":"172.21.15.100:6831/3295868568","heartbeat_front_addr":"172.21.15.100:6829/3295868568","state":["exists","up"]},{"osd":11,"uuid":"f051e2b2-fc58-489a-ab7c-8c1ff5448553","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6825","nonce":3852230978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6827","nonce":3852230978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6831","nonce":3852230978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6829","nonce":3852230978}]},"public_addr":"172.21.15.189:6825/3852230978","cluster_addr":"172.21.15.189:6827/3852230978","heartbeat_back_addr":"172.21.15.189:6831/3852230978","heartbeat_front_addr":"172.21.15.189:6829/3852230978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:20:47.371696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:12.762376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:37.936648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:03.950352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:28.922754+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:54.252149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:18.421479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:43.989505+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:08.789671+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:34.336367+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:59.089601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:25:23.761934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/4128337402":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/1460332159":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2577694203":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2393807982":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/2162789959":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/4219073331":"2024-09-13T01:19:00.926419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:27:49.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.823+0000 7fbbd63e5640 1 -- 172.21.15.81:0/399177417 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbbbc0a2c10 msgr2=0x7fbbbc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:49.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.823+0000 7fbbd63e5640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbbbc0a2c10 0x7fbbbc0a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0006010 tx=0x7fbbc0000bc0 comp rx=0 tx=0).stop 2024-09-12T01:27:49.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.823+0000 7fbbd63e5640 1 -- 172.21.15.81:0/399177417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbd0106a80 msgr2=0x7fbbd019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.823+0000 7fbbd63e5640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbd0106a80 0x7fbbd019cd40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009fd0 tx=0x7fbbc800b260 comp rx=0 tx=0).stop 2024-09-12T01:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.823+0000 7fbbd63e5640 1 -- 172.21.15.81:0/399177417 shutdown_connections 2024-09-12T01:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.823+0000 7fbbd63e5640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fbbbc0a2c10 0x7fbbbc0a50d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.823+0000 7fbbd63e5640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbd0106a80 0x7fbbd019cd40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.823+0000 7fbbd63e5640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbbd0101420 0x7fbbd01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.823+0000 7fbbd63e5640 1 --2- 172.21.15.81:0/399177417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbd0100a80 0x7fbbd0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.823+0000 7fbbd63e5640 1 -- 172.21.15.81:0/399177417 >> 172.21.15.81:0/399177417 conn(0x7fbbd00fc7a0 msgr2=0x7fbbd006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.823+0000 7fbbd63e5640 1 -- 172.21.15.81:0/399177417 shutdown_connections 2024-09-12T01:27:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:49.823+0000 7fbbd63e5640 1 -- 172.21.15.81:0/399177417 wait complete. 2024-09-12T01:27:50.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:49 smithi100 ceph-mon[35275]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:50.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:49 smithi189 ceph-mon[35357]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:27:50.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T01:26:15.004450+0000', 'modified': '2024-09-12T01:26:26.481132+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24473, 'mds_1': 24448, 'mds_2': 24446, 'mds_3': 24401, 'mds_4': 24391}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14601': {'gid': 14601, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6839/1118446149', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 1118446149}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 1118446149}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14613': {'gid': 14613, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6841/3373717964', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6840', 'nonce': 3373717964}, {'type': 'v1', 'addr': '172.21.15.81:6841', 'nonce': 3373717964}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24391': {'gid': 24391, 'name': 'l', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.189:6833/2998951094', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6832', 'nonce': 2998951094}, {'type': 'v1', 'addr': '172.21.15.189:6833', 'nonce': 2998951094}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24401': {'gid': 24401, 'name': 'k', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.100:6833/2684949307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6832', 'nonce': 2684949307}, {'type': 'v1', 'addr': '172.21.15.100:6833', 'nonce': 2684949307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/79706687', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 79706687}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 79706687}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24425': {'gid': 24425, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.100:6835/3858178529', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6834', 'nonce': 3858178529}, {'type': 'v1', 'addr': '172.21.15.100:6835', 'nonce': 3858178529}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/129654641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 129654641}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 129654641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.100:6837/2276544763', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6836', 'nonce': 2276544763}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 2276544763}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.189:6839/1856874876', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 1856874876}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 1856874876}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6839/3435943351', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 3435943351}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 3435943351}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24473, 'qdb_cluster': [24473, 24448, 24446, 24401, 24391]} 2024-09-12T01:27:50.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T01:27:50.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.l status 2024-09-12T01:27:50.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:50 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/399177417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:27:50.755 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:51.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:50 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/399177417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:27:51.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:50 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/399177417' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:27:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.245+0000 7f8fa2140640 1 -- 172.21.15.81:0/408656635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9c102d40 msgr2=0x7f8f9c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.245+0000 7f8fa2140640 1 --2- 172.21.15.81:0/408656635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9c102d40 0x7f8f9c103120 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009900 tx=0x7f8f8c02a480 comp rx=0 tx=0).stop 2024-09-12T01:27:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.245+0000 7f8fa2140640 1 -- 172.21.15.81:0/408656635 shutdown_connections 2024-09-12T01:27:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.245+0000 7f8fa2140640 1 --2- 172.21.15.81:0/408656635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f9c10c170 0x7f8f9c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.245+0000 7f8fa2140640 1 --2- 172.21.15.81:0/408656635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f9c103660 0x7f8f9c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.245+0000 7f8fa2140640 1 --2- 172.21.15.81:0/408656635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9c102d40 0x7f8f9c103120 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.245+0000 7f8fa2140640 1 -- 172.21.15.81:0/408656635 >> 172.21.15.81:0/408656635 conn(0x7f8f9c0fc7a0 msgr2=0x7f8f9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.245+0000 7f8fa2140640 1 -- 172.21.15.81:0/408656635 shutdown_connections 2024-09-12T01:27:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.245+0000 7f8fa2140640 1 -- 172.21.15.81:0/408656635 wait complete. 2024-09-12T01:27:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.245+0000 7f8fa2140640 1 Processor -- start 2024-09-12T01:27:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8fa2140640 1 -- start start 2024-09-12T01:27:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8fa2140640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f9c102d40 0x7f8f9c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8fa2140640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f9c103660 0x7f8f9c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8fa2140640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9c10c170 0x7f8f9c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8fa2140640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c112030 con 0x7f8f9c10c170 2024-09-12T01:27:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8fa2140640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c111eb0 con 0x7f8f9c102d40 2024-09-12T01:27:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8fa2140640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c1121b0 con 0x7f8f9c103660 2024-09-12T01:27:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8f9bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9c10c170 0x7f8f9c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8f9bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9c10c170 0x7f8f9c19ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47392/0 (socket says 172.21.15.81:47392) 2024-09-12T01:27:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8f9bfff640 1 -- 172.21.15.81:0/1750772553 learned_addr learned my addr 172.21.15.81:0/1750772553 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8f9b7fe640 1 --2- 172.21.15.81:0/1750772553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f9c102d40 0x7f8f9c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8f9bfff640 1 -- 172.21.15.81:0/1750772553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f9c103660 msgr2=0x7f8f9c198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8f9bfff640 1 --2- 172.21.15.81:0/1750772553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f9c103660 0x7f8f9c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8f9bfff640 1 -- 172.21.15.81:0/1750772553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f9c102d40 msgr2=0x7f8f9c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8f9bfff640 1 --2- 172.21.15.81:0/1750772553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f9c102d40 0x7f8f9c1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.246+0000 7f8f9bfff640 1 -- 172.21.15.81:0/1750772553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9c19d550 con 0x7f8f9c10c170 2024-09-12T01:27:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.247+0000 7f8f9bfff640 1 --2- 172.21.15.81:0/1750772553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9c10c170 0x7f8f9c19ce70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400b970 tx=0x7f8f9400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.247+0000 7f8f997fa640 1 -- 172.21.15.81:0/1750772553 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94019070 con 0x7f8f9c10c170 2024-09-12T01:27:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.247+0000 7f8f997fa640 1 -- 172.21.15.81:0/1750772553 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f9400cb40 con 0x7f8f9c10c170 2024-09-12T01:27:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.247+0000 7f8fa2140640 1 -- 172.21.15.81:0/1750772553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9c19d840 con 0x7f8f9c10c170 2024-09-12T01:27:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.247+0000 7f8f997fa640 1 -- 172.21.15.81:0/1750772553 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94007650 con 0x7f8f9c10c170 2024-09-12T01:27:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.247+0000 7f8fa2140640 1 -- 172.21.15.81:0/1750772553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9c1a5120 con 0x7f8f9c10c170 2024-09-12T01:27:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.249+0000 7f8f997fa640 1 -- 172.21.15.81:0/1750772553 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8f9401c070 con 0x7f8f9c10c170 2024-09-12T01:27:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.249+0000 7f8fa4519740 1 Processor -- start 2024-09-12T01:27:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.249+0000 7f8fa4519740 1 -- start start 2024-09-12T01:27:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8fa4519740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f19d0 0x5583190f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8fa4519740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f22f0 0x5583190fc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8fa4519740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190fcbb0 0x5583190fefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8fa4519740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558319058090 con 0x5583190f22f0 2024-09-12T01:27:51.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8fa4519740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558318fffa70 con 0x5583190fcbb0 2024-09-12T01:27:51.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8fa4519740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558319054050 con 0x5583190f19d0 2024-09-12T01:27:51.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f22f0 0x5583190fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:51.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f22f0 0x5583190fc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47402/0 (socket says 172.21.15.81:47402) 2024-09-12T01:27:51.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f9b7fe640 1 -- 172.21.15.81:0/1824274049 learned_addr learned my addr 172.21.15.81:0/1824274049 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:51.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f997fa640 1 --2- 172.21.15.81:0/1750772553 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8f880a2c90 0x7f8f880a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/1824274049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190fcbb0 0x5583190fefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:51.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/1824274049 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f19d0 0x5583190f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:51.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f9b7fe640 1 -- 172.21.15.81:0/1824274049 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f19d0 msgr2=0x5583190f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:51.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f9b7fe640 1 --2- 172.21.15.81:0/1824274049 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f19d0 0x5583190f1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f9b7fe640 1 -- 172.21.15.81:0/1824274049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190fcbb0 msgr2=0x5583190fefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:51.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f9b7fe640 1 --2- 172.21.15.81:0/1824274049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190fcbb0 0x5583190fefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f9b7fe640 1 -- 172.21.15.81:0/1824274049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55831900c130 con 0x5583190f22f0 2024-09-12T01:27:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/1824274049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190fcbb0 0x5583190fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f997fa640 1 -- 172.21.15.81:0/1750772553 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8f940ce6e0 con 0x7f8f9c10c170 2024-09-12T01:27:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f9bfff640 1 --2- 172.21.15.81:0/1750772553 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8f880a2c90 0x7f8f880a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f9b7fe640 1 --2- 172.21.15.81:0/1824274049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f22f0 0x5583190fc670 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c005ab0 tx=0x7f8f8c031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765cad91239d2091 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f91ffb640 1 -- 172.21.15.81:0/1824274049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c03f070 con 0x5583190f22f0 2024-09-12T01:27:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f91ffb640 1 -- 172.21.15.81:0/1824274049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f8c031a20 con 0x5583190f22f0 2024-09-12T01:27:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.250+0000 7f8f91ffb640 1 -- 172.21.15.81:0/1824274049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c035070 con 0x5583190f22f0 2024-09-12T01:27:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.251+0000 7f8fa4519740 1 -- 172.21.15.81:0/1824274049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f22f0 msgr2=0x5583190fc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.251+0000 7f8f9bfff640 1 --2- 172.21.15.81:0/1750772553 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8f880a2c90 0x7f8f880a5150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400b940 tx=0x7f8f94009970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.251+0000 7f8fa4519740 1 --2- 172.21.15.81:0/1824274049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f22f0 0x5583190fc670 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c005ab0 tx=0x7f8f8c031630 comp rx=0 tx=0).stop 2024-09-12T01:27:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.251+0000 7f8fa4519740 1 -- 172.21.15.81:0/1824274049 shutdown_connections 2024-09-12T01:27:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.251+0000 7f8fa4519740 1 --2- 172.21.15.81:0/1824274049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190fcbb0 0x5583190fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.251+0000 7f8fa4519740 1 --2- 172.21.15.81:0/1824274049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f22f0 0x5583190fc670 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.251+0000 7f8fa4519740 1 --2- 172.21.15.81:0/1824274049 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f19d0 0x5583190f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.251+0000 7f8fa4519740 1 -- 172.21.15.81:0/1824274049 >> 172.21.15.81:0/1824274049 conn(0x5583190edf60 msgr2=0x5583190ee340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.251+0000 7f8fa4519740 1 -- 172.21.15.81:0/1824274049 shutdown_connections 2024-09-12T01:27:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.251+0000 7f8fa4519740 1 -- 172.21.15.81:0/1824274049 wait complete. 2024-09-12T01:27:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8fa4519740 1 -- start start 2024-09-12T01:27:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8fa4519740 1 Processor -- start 2024-09-12T01:27:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8fa4519740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 0x5583190fc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8fa4519740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190f22f0 0x5583190f97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8fa4519740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190fcbb0 0x5583190f9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8fa4519740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5583190ff780 con 0x5583190f19d0 2024-09-12T01:27:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8fa4519740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558319012f20 con 0x5583190f22f0 2024-09-12T01:27:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8fa4519740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5583190ff900 con 0x5583190fcbb0 2024-09-12T01:27:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8fa4519740 10 client.0 _ll_register_callbacks cb 0x558318fdc030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8f92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 0x5583190fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:51.288 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:27:51.288 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:27:51.288 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 4, 2024-09-12T01:27:51.288 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24391, 2024-09-12T01:27:51.288 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:27:51.288 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:27:51.289 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:27:51.289 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 86.007776250999996, 2024-09-12T01:27:51.289 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T01:27:51.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-12T01:27:51.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:27:51.289 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 136.828505799 2024-09-12T01:27:51.289 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:27:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8f92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 0x5583190fc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47408/0 (socket says 172.21.15.81:47408) 2024-09-12T01:27:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8f92ffd640 1 -- 172.21.15.81:0/70976277 learned_addr learned my addr 172.21.15.81:0/70976277 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8f92ffd640 1 -- 172.21.15.81:0/70976277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190fcbb0 msgr2=0x5583190f9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/70976277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190fcbb0 0x5583190f9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8f92ffd640 1 -- 172.21.15.81:0/70976277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190f22f0 msgr2=0x5583190f97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/70976277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190f22f0 0x5583190f97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.252+0000 7f8f92ffd640 1 -- 172.21.15.81:0/70976277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558318dc92b0 con 0x5583190f19d0 2024-09-12T01:27:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/70976277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 0x5583190fc450 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8f84005eb0 tx=0x7f8f840018d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefe24dd4257d839 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8f7affd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8f7affd640 1 -- 172.21.15.81:0/70976277 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84012040 con 0x5583190f19d0 2024-09-12T01:27:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8f7affd640 1 -- 172.21.15.81:0/70976277 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8f84008c20 con 0x5583190f19d0 2024-09-12T01:27:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8fa4519740 1 -- 172.21.15.81:0/70976277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f8c031a20 con 0x5583190f19d0 2024-09-12T01:27:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8f7affd640 1 -- 172.21.15.81:0/70976277 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8f84008e20 con 0x5583190f19d0 2024-09-12T01:27:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8fa4519740 10 client.15120 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8fa4519740 1 -- 172.21.15.81:0/70976277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55831910b0a0 con 0x5583190f19d0 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8f7affd640 1 -- 172.21.15.81:0/70976277 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f8c031a20 con 0x5583190f19d0 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8f7affd640 1 -- 172.21.15.81:0/70976277 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8f84015070 con 0x5583190f19d0 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8fa4519740 10 client.15120 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8fa4519740 10 client.15120 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8fa4519740 20 client.15120 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8fa4519740 1 --2- 172.21.15.81:0/70976277 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55831910d750 0x55831910ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8fa4519740 4 client.15120 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.253+0000 7f8fa4519740 1 -- 172.21.15.81:0/70976277 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558319065600 con 0x55831910d750 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.254+0000 7f8f9b7fe640 1 --2- 172.21.15.81:0/70976277 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55831910d750 0x55831910ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.254+0000 7f8f7affd640 10 client.15120 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.254+0000 7f8f9b7fe640 1 --2- 172.21.15.81:0/70976277 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55831910d750 0x55831910ebc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=570e16895f9c4024 server_cookie=312aceb99e2963da in_seq=0 out_seq=0 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8f7affd640 1 -- 172.21.15.81:0/70976277 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558319065600 con 0x55831910d750 2024-09-12T01:27:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8f7affd640 10 client.15120 handle_command_reply: tid=0 2024-09-12T01:27:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8fa4519740 1 client.15120 shutdown 2024-09-12T01:27:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8fa4519740 1 -- 172.21.15.81:0/70976277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 msgr2=0x5583190fc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8fa4519740 1 --2- 172.21.15.81:0/70976277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 0x5583190fc450 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8f84005eb0 tx=0x7f8f840018d0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8fa4519740 1 -- 172.21.15.81:0/70976277 shutdown_connections 2024-09-12T01:27:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8fa4519740 1 --2- 172.21.15.81:0/70976277 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55831910d750 0x55831910ebc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8fa4519740 1 --2- 172.21.15.81:0/70976277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190fcbb0 0x5583190f9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8fa4519740 1 --2- 172.21.15.81:0/70976277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190f22f0 0x5583190f97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8f7affd640 0 client.15120 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:27:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8fa4519740 1 --2- 172.21.15.81:0/70976277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 0x5583190fc450 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8fa4519740 1 -- 172.21.15.81:0/70976277 >> 172.21.15.81:0/70976277 conn(0x5583190edf60 msgr2=0x5583190f3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8fa4519740 1 -- 172.21.15.81:0/70976277 shutdown_connections 2024-09-12T01:27:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8fa4519740 1 -- 172.21.15.81:0/70976277 wait complete. 2024-09-12T01:27:51.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.255+0000 7f8fa4519740 20 client.15120 trim_cache size 0 max 16384 2024-09-12T01:27:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8fa4519740 1 Processor -- start 2024-09-12T01:27:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8fa4519740 1 -- start start 2024-09-12T01:27:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8fa4519740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 0x55831910d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8fa4519740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f22f0 0x55831910de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8fa4519740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190fcbb0 0x558319117290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8fa4519740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55831910cf00 con 0x5583190f19d0 2024-09-12T01:27:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8fa4519740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55831910d5d0 con 0x5583190fcbb0 2024-09-12T01:27:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8fa4519740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55831910dca0 con 0x5583190f22f0 2024-09-12T01:27:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8f92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 0x55831910d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8f92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 0x55831910d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47410/0 (socket says 172.21.15.81:47410) 2024-09-12T01:27:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8f92ffd640 1 -- 172.21.15.81:0/2350927038 learned_addr learned my addr 172.21.15.81:0/2350927038 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8f92ffd640 1 -- 172.21.15.81:0/2350927038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f22f0 msgr2=0x55831910de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8f9b7fe640 1 --2- 172.21.15.81:0/2350927038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f22f0 0x55831910de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/2350927038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f22f0 0x55831910de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8f92ffd640 1 -- 172.21.15.81:0/2350927038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190fcbb0 msgr2=0x558319117290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/2350927038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190fcbb0 0x558319117290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8f92ffd640 1 -- 172.21.15.81:0/2350927038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583190f1800 con 0x5583190f19d0 2024-09-12T01:27:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8f9b7fe640 1 --2- 172.21.15.81:0/2350927038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f22f0 0x55831910de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.273+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/2350927038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 0x55831910d080 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8f84007310 tx=0x7f8f84007640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d5f2abe308ed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.274+0000 7f8f917fa640 1 -- 172.21.15.81:0/2350927038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84021b10 con 0x5583190f19d0 2024-09-12T01:27:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.274+0000 7f8f917fa640 1 -- 172.21.15.81:0/2350927038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f84021cb0 con 0x5583190f19d0 2024-09-12T01:27:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.274+0000 7f8f917fa640 1 -- 172.21.15.81:0/2350927038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84005290 con 0x5583190f19d0 2024-09-12T01:27:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.274+0000 7f8fa4519740 1 -- 172.21.15.81:0/2350927038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 msgr2=0x55831910d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.274+0000 7f8fa4519740 1 --2- 172.21.15.81:0/2350927038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 0x55831910d080 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8f84007310 tx=0x7f8f84007640 comp rx=0 tx=0).stop 2024-09-12T01:27:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.274+0000 7f8fa4519740 1 -- 172.21.15.81:0/2350927038 shutdown_connections 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.274+0000 7f8fa4519740 1 --2- 172.21.15.81:0/2350927038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190fcbb0 0x558319117290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.274+0000 7f8fa4519740 1 --2- 172.21.15.81:0/2350927038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f22f0 0x55831910de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.274+0000 7f8fa4519740 1 --2- 172.21.15.81:0/2350927038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190f19d0 0x55831910d080 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.274+0000 7f8fa4519740 1 -- 172.21.15.81:0/2350927038 >> 172.21.15.81:0/2350927038 conn(0x5583190edf60 msgr2=0x5583190ee340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.274+0000 7f8fa4519740 1 -- 172.21.15.81:0/2350927038 shutdown_connections 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.274+0000 7f8fa4519740 1 -- 172.21.15.81:0/2350927038 wait complete. 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.274+0000 7f8fa4519740 1 -- start start 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8fa4519740 1 Processor -- start 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8fa4519740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f19d0 0x558319173440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8fa4519740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190f22f0 0x558319173980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8fa4519740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190fcbb0 0x558319110970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8fa4519740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55831910ea40 con 0x5583190fcbb0 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8fa4519740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55831910e370 con 0x5583190f22f0 2024-09-12T01:27:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8fa4519740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55831910f110 con 0x5583190f19d0 2024-09-12T01:27:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8fa4519740 10 client.0 _ll_register_callbacks cb 0x7f8f9c06b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8f92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190fcbb0 0x558319110970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8f92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190fcbb0 0x558319110970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47416/0 (socket says 172.21.15.81:47416) 2024-09-12T01:27:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8f92ffd640 1 -- 172.21.15.81:0/1440801095 learned_addr learned my addr 172.21.15.81:0/1440801095 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8f92ffd640 1 -- 172.21.15.81:0/1440801095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f19d0 msgr2=0x558319173440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/1440801095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f19d0 0x558319173440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8f92ffd640 1 -- 172.21.15.81:0/1440801095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190f22f0 msgr2=0x558319173980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/1440801095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190f22f0 0x558319173980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8f92ffd640 1 -- 172.21.15.81:0/1440801095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558319111180 con 0x5583190fcbb0 2024-09-12T01:27:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/1440801095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190fcbb0 0x558319110970 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8f84008ad0 tx=0x7f8f840217a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636dfcc606261178 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:51.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.275+0000 7f8f7affd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8f7affd640 1 -- 172.21.15.81:0/1440801095 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84009ce0 con 0x5583190fcbb0 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8f7affd640 1 -- 172.21.15.81:0/1440801095 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8f84005000 con 0x5583190fcbb0 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8fa4519740 1 -- 172.21.15.81:0/1440801095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f84021cb0 con 0x5583190fcbb0 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8f7affd640 1 -- 172.21.15.81:0/1440801095 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8f84005200 con 0x5583190fcbb0 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8fa4519740 10 client.15126 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8fa4519740 1 -- 172.21.15.81:0/1440801095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55831917bcb0 con 0x5583190fcbb0 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8f7affd640 1 -- 172.21.15.81:0/1440801095 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f84021cb0 con 0x5583190fcbb0 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8f7affd640 1 -- 172.21.15.81:0/1440801095 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8f84015050 con 0x5583190fcbb0 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8fa4519740 10 client.15126 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8fa4519740 10 client.15126 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8fa4519740 20 client.15126 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8fa4519740 1 --2- 172.21.15.81:0/1440801095 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x558319180560 0x55831917f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8fa4519740 4 client.15126 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:27:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.276+0000 7f8fa4519740 1 -- 172.21.15.81:0/1440801095 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "status"}) -- 0x55831905fb10 con 0x558319180560 2024-09-12T01:27:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.277+0000 7f8f9b7fe640 1 --2- 172.21.15.81:0/1440801095 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x558319180560 0x55831917f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.277+0000 7f8f7affd640 10 client.15126 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:27:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.277+0000 7f8f9b7fe640 1 --2- 172.21.15.81:0/1440801095 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x558319180560 0x55831917f270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3196d2da037f372e server_cookie=4768a2e62f9c1854 in_seq=0 out_seq=0 2024-09-12T01:27:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.277+0000 7f8f7affd640 1 -- 172.21.15.81:0/1440801095 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55831905fb10 con 0x558319180560 2024-09-12T01:27:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.277+0000 7f8f7affd640 10 client.15126 handle_command_reply: tid=0 2024-09-12T01:27:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.277+0000 7f8fa4519740 1 client.15126 shutdown 2024-09-12T01:27:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa4519740 1 -- 172.21.15.81:0/1440801095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190fcbb0 msgr2=0x558319110970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa4519740 1 --2- 172.21.15.81:0/1440801095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190fcbb0 0x558319110970 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8f84008ad0 tx=0x7f8f840217a0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa4519740 1 -- 172.21.15.81:0/1440801095 shutdown_connections 2024-09-12T01:27:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa4519740 1 --2- 172.21.15.81:0/1440801095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583190fcbb0 0x558319110970 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa4519740 1 --2- 172.21.15.81:0/1440801095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583190f22f0 0x558319173980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa4519740 1 --2- 172.21.15.81:0/1440801095 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x558319180560 0x55831917f270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa4519740 1 --2- 172.21.15.81:0/1440801095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583190f19d0 0x558319173440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa4519740 1 -- 172.21.15.81:0/1440801095 >> 172.21.15.81:0/1440801095 conn(0x5583190edf60 msgr2=0x5583190ec800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8f7affd640 0 client.15126 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa4519740 1 -- 172.21.15.81:0/1440801095 shutdown_connections 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa4519740 1 -- 172.21.15.81:0/1440801095 wait complete. 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa4519740 20 client.15126 trim_cache size 0 max 16384 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa2140640 1 -- 172.21.15.81:0/1750772553 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8f880a2c90 msgr2=0x7f8f880a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa2140640 1 --2- 172.21.15.81:0/1750772553 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8f880a2c90 0x7f8f880a5150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400b940 tx=0x7f8f94009970 comp rx=0 tx=0).stop 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa2140640 1 -- 172.21.15.81:0/1750772553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9c10c170 msgr2=0x7f8f9c19ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa2140640 1 --2- 172.21.15.81:0/1750772553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9c10c170 0x7f8f9c19ce70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400b970 tx=0x7f8f9400be30 comp rx=0 tx=0).stop 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa2140640 1 -- 172.21.15.81:0/1750772553 shutdown_connections 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa2140640 1 --2- 172.21.15.81:0/1750772553 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8f880a2c90 0x7f8f880a5150 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa2140640 1 --2- 172.21.15.81:0/1750772553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9c10c170 0x7f8f9c19ce70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa2140640 1 --2- 172.21.15.81:0/1750772553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f9c103660 0x7f8f9c198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa2140640 1 --2- 172.21.15.81:0/1750772553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f9c102d40 0x7f8f9c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:51.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.278+0000 7f8fa2140640 1 -- 172.21.15.81:0/1750772553 >> 172.21.15.81:0/1750772553 conn(0x7f8f9c0fc7a0 msgr2=0x7f8f9c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:51.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.279+0000 7f8fa2140640 1 -- 172.21.15.81:0/1750772553 shutdown_connections 2024-09-12T01:27:51.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:51.279+0000 7f8fa2140640 1 -- 172.21.15.81:0/1750772553 wait complete. 2024-09-12T01:27:51.935 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:51 smithi081 ceph-mon[30920]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:51.962 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.k status 2024-09-12T01:27:52.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:51 smithi100 ceph-mon[35275]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:52.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:51 smithi189 ceph-mon[35357]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:52.207 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.671+0000 7fcf4bbd1640 1 -- 172.21.15.81:0/540927533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf44106a80 msgr2=0x7fcf44106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.671+0000 7fcf4bbd1640 1 --2- 172.21.15.81:0/540927533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf44106a80 0x7fcf44106e60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009930 tx=0x7fcf4002a420 comp rx=0 tx=0).stop 2024-09-12T01:27:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.671+0000 7fcf4bbd1640 1 -- 172.21.15.81:0/540927533 shutdown_connections 2024-09-12T01:27:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.671+0000 7fcf4bbd1640 1 --2- 172.21.15.81:0/540927533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf44101420 0x7fcf4410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.671+0000 7fcf4bbd1640 1 --2- 172.21.15.81:0/540927533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf44100a80 0x7fcf44100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.671+0000 7fcf4bbd1640 1 --2- 172.21.15.81:0/540927533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf44106a80 0x7fcf44106e60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.671+0000 7fcf4bbd1640 1 -- 172.21.15.81:0/540927533 >> 172.21.15.81:0/540927533 conn(0x7fcf440fc7a0 msgr2=0x7fcf440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.671+0000 7fcf4bbd1640 1 -- 172.21.15.81:0/540927533 shutdown_connections 2024-09-12T01:27:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.671+0000 7fcf4bbd1640 1 -- 172.21.15.81:0/540927533 wait complete. 2024-09-12T01:27:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4bbd1640 1 Processor -- start 2024-09-12T01:27:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4bbd1640 1 -- start start 2024-09-12T01:27:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4bbd1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf44100a80 0x7fcf44198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4bbd1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf44101420 0x7fcf44198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4bbd1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf44106a80 0x7fcf4419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4bbd1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcf44110f20 con 0x7fcf44101420 2024-09-12T01:27:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4bbd1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcf44110da0 con 0x7fcf44100a80 2024-09-12T01:27:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4bbd1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcf441110a0 con 0x7fcf44106a80 2024-09-12T01:27:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4916c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf44101420 0x7fcf44198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4916c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf44101420 0x7fcf44198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45702/0 (socket says 172.21.15.81:45702) 2024-09-12T01:27:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4916c640 1 -- 172.21.15.81:0/168798366 learned_addr learned my addr 172.21.15.81:0/168798366 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4996d640 1 --2- 172.21.15.81:0/168798366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf44100a80 0x7fcf44198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4916c640 1 -- 172.21.15.81:0/168798366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf44106a80 msgr2=0x7fcf4419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4916c640 1 --2- 172.21.15.81:0/168798366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf44106a80 0x7fcf4419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4916c640 1 -- 172.21.15.81:0/168798366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf44100a80 msgr2=0x7fcf44198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4916c640 1 --2- 172.21.15.81:0/168798366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf44100a80 0x7fcf44198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4916c640 1 -- 172.21.15.81:0/168798366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4419d5b0 con 0x7fcf44101420 2024-09-12T01:27:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4916c640 1 --2- 172.21.15.81:0/168798366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf44101420 0x7fcf44198b40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400b4a0 tx=0x7fcf3400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf3affd640 1 -- 172.21.15.81:0/168798366 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf34014070 con 0x7fcf44101420 2024-09-12T01:27:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf3affd640 1 -- 172.21.15.81:0/168798366 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf34010af0 con 0x7fcf44101420 2024-09-12T01:27:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf4bbd1640 1 -- 172.21.15.81:0/168798366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf4419d8a0 con 0x7fcf44101420 2024-09-12T01:27:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.672+0000 7fcf3affd640 1 -- 172.21.15.81:0/168798366 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf34017d10 con 0x7fcf44101420 2024-09-12T01:27:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.673+0000 7fcf4bbd1640 1 -- 172.21.15.81:0/168798366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf441a5180 con 0x7fcf44101420 2024-09-12T01:27:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.675+0000 7fcf3affd640 1 -- 172.21.15.81:0/168798366 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcf34017070 con 0x7fcf44101420 2024-09-12T01:27:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.675+0000 7fcf4dfaa740 1 Processor -- start 2024-09-12T01:27:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.675+0000 7fcf4dfaa740 1 -- start start 2024-09-12T01:27:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.675+0000 7fcf3affd640 1 --2- 172.21.15.81:0/168798366 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcf300a2c90 0x7fcf300a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.675+0000 7fcf4dfaa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fc7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4dfaa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fd2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4dfaa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9fd4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4a16e640 1 --2- 172.21.15.81:0/168798366 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcf300a2c90 0x7fcf300a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4dfaa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7c9f2e090 con 0x55b7c9fc79d0 2024-09-12T01:27:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4dfaa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7c9ed5a70 con 0x55b7c9fc82f0 2024-09-12T01:27:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4dfaa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7c9f2a050 con 0x55b7c9fd2bb0 2024-09-12T01:27:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf3affd640 1 -- 172.21.15.81:0/168798366 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcf340ce520 con 0x7fcf44101420 2024-09-12T01:27:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4996d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fc7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4996d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fc7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45710/0 (socket says 172.21.15.81:45710) 2024-09-12T01:27:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4996d640 1 -- 172.21.15.81:0/3525454998 learned_addr learned my addr 172.21.15.81:0/3525454998 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4916c640 1 --2- 172.21.15.81:0/3525454998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fd2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4996d640 1 -- 172.21.15.81:0/3525454998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fd2bb0 msgr2=0x55b7c9fd4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4a16e640 1 --2- 172.21.15.81:0/3525454998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9fd4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4996d640 1 --2- 172.21.15.81:0/3525454998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9fd4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4996d640 1 -- 172.21.15.81:0/3525454998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fc82f0 msgr2=0x55b7c9fd2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4996d640 1 --2- 172.21.15.81:0/3525454998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fd2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4996d640 1 -- 172.21.15.81:0/3525454998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c9ee2130 con 0x55b7c9fc79d0 2024-09-12T01:27:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4916c640 1 --2- 172.21.15.81:0/3525454998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fd2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4a16e640 1 --2- 172.21.15.81:0/3525454998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9fd4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4a16e640 1 --2- 172.21.15.81:0/168798366 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcf300a2c90 0x7fcf300a5150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00abc0 tx=0x7fcf3c00c3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf4996d640 1 --2- 172.21.15.81:0/3525454998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fc7db0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcf40031550 tx=0x7fcf40032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38655f91ad36135a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf2ffff640 1 -- 172.21.15.81:0/3525454998 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4003f070 con 0x55b7c9fc79d0 2024-09-12T01:27:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf2ffff640 1 -- 172.21.15.81:0/3525454998 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf400317b0 con 0x55b7c9fc79d0 2024-09-12T01:27:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.676+0000 7fcf2ffff640 1 -- 172.21.15.81:0/3525454998 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf40035070 con 0x55b7c9fc79d0 2024-09-12T01:27:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.677+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/3525454998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 msgr2=0x55b7c9fc7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.677+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/3525454998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fc7db0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcf40031550 tx=0x7fcf40032cb0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.677+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/3525454998 shutdown_connections 2024-09-12T01:27:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.677+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/3525454998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9fd4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.677+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/3525454998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fd2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.677+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/3525454998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fc7db0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.677+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/3525454998 >> 172.21.15.81:0/3525454998 conn(0x55b7c9fc3f60 msgr2=0x55b7c9fc4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.677+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/3525454998 shutdown_connections 2024-09-12T01:27:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.677+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/3525454998 wait complete. 2024-09-12T01:27:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4dfaa740 1 -- start start 2024-09-12T01:27:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4dfaa740 1 Processor -- start 2024-09-12T01:27:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4dfaa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fd2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4dfaa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fcf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4dfaa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9fcfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4dfaa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7c9fd9b90 con 0x55b7c9fd2bb0 2024-09-12T01:27:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4dfaa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7c9ee8f20 con 0x55b7c9fc79d0 2024-09-12T01:27:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4dfaa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7c9fd9d10 con 0x55b7c9fc82f0 2024-09-12T01:27:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4dfaa740 10 client.0 _ll_register_callbacks cb 0x55b7c9eb2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4a16e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9fcfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4a16e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9fcfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45726/0 (socket says 172.21.15.81:45726) 2024-09-12T01:27:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4a16e640 1 -- 172.21.15.81:0/2965812910 learned_addr learned my addr 172.21.15.81:0/2965812910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4996d640 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fd2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.678+0000 7fcf4916c640 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fcf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf4a16e640 1 -- 172.21.15.81:0/2965812910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc82f0 msgr2=0x55b7c9fcf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf4a16e640 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fcf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf4a16e640 1 -- 172.21.15.81:0/2965812910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fc79d0 msgr2=0x55b7c9fd2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf4a16e640 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fd2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf4a16e640 1 -- 172.21.15.81:0/2965812910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c9c9f2b0 con 0x55b7c9fd2bb0 2024-09-12T01:27:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf4996d640 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fd2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf4a16e640 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9fcfbd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00ddd0 tx=0x7fcf3c004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539cb655dc9c1339 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf2d7fa640 1 -- 172.21.15.81:0/2965812910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c020070 con 0x55b7c9fd2bb0 2024-09-12T01:27:52.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf2d7fa640 1 -- 172.21.15.81:0/2965812910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcf3c01c420 con 0x55b7c9fd2bb0 2024-09-12T01:27:52.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2965812910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf400317b0 con 0x55b7c9fd2bb0 2024-09-12T01:27:52.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf2d7fa640 1 -- 172.21.15.81:0/2965812910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcf3c02c050 con 0x55b7c9fd2bb0 2024-09-12T01:27:52.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf4dfaa740 10 client.15138 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:52.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2965812910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b7c9fe53a0 con 0x55b7c9fd2bb0 2024-09-12T01:27:52.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf2d7fa640 1 -- 172.21.15.81:0/2965812910 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf400317b0 con 0x55b7c9fd2bb0 2024-09-12T01:27:52.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf2d7fa640 1 -- 172.21.15.81:0/2965812910 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fcf3c024740 con 0x55b7c9fd2bb0 2024-09-12T01:27:52.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf4dfaa740 10 client.15138 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:52.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf4dfaa740 10 client.15138 resolve_mds: resolved name 'k' to daemon mds.k 2024-09-12T01:27:52.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.679+0000 7fcf4dfaa740 20 client.15138 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:52.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.680+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55b7c9fe7a00 0x55b7c9fe8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.680+0000 7fcf4dfaa740 4 client.15138 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:27:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.680+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2965812910 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7c9f3b600 con 0x55b7c9fe7a00 2024-09-12T01:27:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.680+0000 7fcf4996d640 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55b7c9fe7a00 0x55b7c9fe8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.680+0000 7fcf4996d640 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55b7c9fe7a00 0x55b7c9fe8e70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c6d6bc59dc779ad1 server_cookie=b7a8f0c30a0c2af2 in_seq=0 out_seq=0 2024-09-12T01:27:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.680+0000 7fcf2d7fa640 10 client.15138 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:27:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf2d7fa640 1 -- 172.21.15.81:0/2965812910 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7c9f3b600 con 0x55b7c9fe7a00 2024-09-12T01:27:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf2d7fa640 10 client.15138 handle_command_reply: tid=0 2024-09-12T01:27:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf4dfaa740 1 client.15138 shutdown 2024-09-12T01:27:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2965812910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fd2bb0 msgr2=0x55b7c9fcfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9fcfbd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00ddd0 tx=0x7fcf3c004bc0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2965812910 shutdown_connections 2024-09-12T01:27:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55b7c9fe7a00 0x55b7c9fe8e70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9fcfbd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fcf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/2965812910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fd2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2965812910 >> 172.21.15.81:0/2965812910 conn(0x55b7c9fc3f60 msgr2=0x55b7c9fc9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:52.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf2d7fa640 0 client.15138 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:27:52.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2965812910 shutdown_connections 2024-09-12T01:27:52.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2965812910 wait complete. 2024-09-12T01:27:52.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.681+0000 7fcf4dfaa740 20 client.15138 trim_cache size 0 max 16384 2024-09-12T01:27:52.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4dfaa740 1 Processor -- start 2024-09-12T01:27:52.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4dfaa740 1 -- start start 2024-09-12T01:27:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4dfaa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fcdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4dfaa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4dfaa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9ff1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4dfaa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7c9fe71b0 con 0x55b7c9fc82f0 2024-09-12T01:27:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4dfaa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7c9fe7880 con 0x55b7c9fd2bb0 2024-09-12T01:27:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4dfaa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7c9fe7f50 con 0x55b7c9fc79d0 2024-09-12T01:27:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4916c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4916c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45730/0 (socket says 172.21.15.81:45730) 2024-09-12T01:27:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4916c640 1 -- 172.21.15.81:0/303872870 learned_addr learned my addr 172.21.15.81:0/303872870 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4916c640 1 -- 172.21.15.81:0/303872870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc79d0 msgr2=0x55b7c9fcdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4916c640 1 --2- 172.21.15.81:0/303872870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fcdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4916c640 1 -- 172.21.15.81:0/303872870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fd2bb0 msgr2=0x55b7c9ff1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4916c640 1 --2- 172.21.15.81:0/303872870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9ff1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.699+0000 7fcf4916c640 1 -- 172.21.15.81:0/303872870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c9fc3d90 con 0x55b7c9fc82f0 2024-09-12T01:27:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.700+0000 7fcf4916c640 1 --2- 172.21.15.81:0/303872870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fce4a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcf340cbfc0 tx=0x7fcf340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621ecb7f9f0abe3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.700+0000 7fcf2f7fe640 1 -- 172.21.15.81:0/303872870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3401e040 con 0x55b7c9fc82f0 2024-09-12T01:27:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.700+0000 7fcf2f7fe640 1 -- 172.21.15.81:0/303872870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf3409f090 con 0x55b7c9fc82f0 2024-09-12T01:27:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.700+0000 7fcf2f7fe640 1 -- 172.21.15.81:0/303872870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf34010e00 con 0x55b7c9fc82f0 2024-09-12T01:27:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.700+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/303872870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc82f0 msgr2=0x55b7c9fce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.700+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/303872870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fce4a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcf340cbfc0 tx=0x7fcf340046c0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.700+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/303872870 shutdown_connections 2024-09-12T01:27:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.700+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/303872870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9ff1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.700+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/303872870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc82f0 0x55b7c9fce4a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.700+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/303872870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc79d0 0x55b7c9fcdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.700+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/303872870 >> 172.21.15.81:0/303872870 conn(0x55b7c9fc3f60 msgr2=0x55b7c9fcf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.700+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/303872870 shutdown_connections 2024-09-12T01:27:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.700+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/303872870 wait complete. 2024-09-12T01:27:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.701+0000 7fcf4dfaa740 1 -- start start 2024-09-12T01:27:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.701+0000 7fcf4dfaa740 1 Processor -- start 2024-09-12T01:27:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.701+0000 7fcf4dfaa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 0x55b7c9ff16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.701+0000 7fcf4dfaa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc82f0 0x55b7c9feaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.701+0000 7fcf4dfaa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9feaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.701+0000 7fcf4dfaa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7c9fe8cf0 con 0x55b7c9fc79d0 2024-09-12T01:27:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.701+0000 7fcf4dfaa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7c9fe8620 con 0x55b7c9fd2bb0 2024-09-12T01:27:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.701+0000 7fcf4dfaa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7c9fe93c0 con 0x55b7c9fc82f0 2024-09-12T01:27:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.701+0000 7fcf4dfaa740 10 client.0 _ll_register_callbacks cb 0x7fcf3c00cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.701+0000 7fcf4996d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 0x55b7c9ff16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.701+0000 7fcf4996d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 0x55b7c9ff16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45742/0 (socket says 172.21.15.81:45742) 2024-09-12T01:27:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.701+0000 7fcf4996d640 1 -- 172.21.15.81:0/2238175214 learned_addr learned my addr 172.21.15.81:0/2238175214 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.701+0000 7fcf4a16e640 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9feaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf4916c640 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc82f0 0x55b7c9feaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf4996d640 1 -- 172.21.15.81:0/2238175214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc82f0 msgr2=0x55b7c9feaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf4996d640 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc82f0 0x55b7c9feaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf4996d640 1 -- 172.21.15.81:0/2238175214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fd2bb0 msgr2=0x55b7c9feaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf4996d640 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9feaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf4996d640 1 -- 172.21.15.81:0/2238175214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c9feb5e0 con 0x55b7c9fc79d0 2024-09-12T01:27:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf4916c640 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc82f0 0x55b7c9feaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf4996d640 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 0x55b7c9ff16d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcf40005310 tx=0x7fcf40009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fec41f5200c13dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf2d7fa640 1 -- 172.21.15.81:0/2238175214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4003f050 con 0x55b7c9fc79d0 2024-09-12T01:27:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf2d7fa640 1 -- 172.21.15.81:0/2238175214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcf40004240 con 0x55b7c9fc79d0 2024-09-12T01:27:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2238175214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf3409f090 con 0x55b7c9fc79d0 2024-09-12T01:27:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf2d7fa640 1 -- 172.21.15.81:0/2238175214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcf40035040 con 0x55b7c9fc79d0 2024-09-12T01:27:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf4dfaa740 10 client.15144 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2238175214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b7ca052110 con 0x55b7c9fc79d0 2024-09-12T01:27:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf2d7fa640 1 -- 172.21.15.81:0/2238175214 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf3409f090 con 0x55b7c9fc79d0 2024-09-12T01:27:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf2d7fa640 1 -- 172.21.15.81:0/2238175214 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fcf4004c460 con 0x55b7c9fc79d0 2024-09-12T01:27:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.702+0000 7fcf4dfaa740 10 client.15144 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.703+0000 7fcf4dfaa740 10 client.15144 resolve_mds: resolved name 'k' to daemon mds.k 2024-09-12T01:27:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.703+0000 7fcf4dfaa740 20 client.15144 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.703+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55b7ca056740 0x55b7ca055450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.703+0000 7fcf4dfaa740 4 client.15144 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:27:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.703+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2238175214 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "status"}) -- 0x55b7c9f35b10 con 0x55b7ca056740 2024-09-12T01:27:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.703+0000 7fcf4916c640 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55b7ca056740 0x55b7ca055450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.703+0000 7fcf2d7fa640 10 client.15144 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:27:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.703+0000 7fcf4916c640 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55b7ca056740 0x55b7ca055450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a0e7be5599657774 server_cookie=d2a06eb97b0c56a9 in_seq=0 out_seq=0 2024-09-12T01:27:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf2d7fa640 1 -- 172.21.15.81:0/2238175214 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b7c9f35b10 con 0x55b7ca056740 2024-09-12T01:27:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf2d7fa640 10 client.15144 handle_command_reply: tid=0 2024-09-12T01:27:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4dfaa740 1 client.15144 shutdown 2024-09-12T01:27:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2238175214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 msgr2=0x55b7c9ff16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 0x55b7c9ff16d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcf40005310 tx=0x7fcf40009880 comp rx=0 tx=0).stop 2024-09-12T01:27:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2238175214 shutdown_connections 2024-09-12T01:27:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55b7ca056740 0x55b7ca055450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7c9fd2bb0 0x55b7c9feaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7c9fc82f0 0x55b7c9feaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4dfaa740 1 --2- 172.21.15.81:0/2238175214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7c9fc79d0 0x55b7c9ff16d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf2d7fa640 0 client.15144 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:27:52.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2238175214 >> 172.21.15.81:0/2238175214 conn(0x55b7c9fc3f60 msgr2=0x55b7c9fcdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:52.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2238175214 shutdown_connections 2024-09-12T01:27:52.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4dfaa740 1 -- 172.21.15.81:0/2238175214 wait complete. 2024-09-12T01:27:52.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4dfaa740 20 client.15144 trim_cache size 0 max 16384 2024-09-12T01:27:52.712 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:27:52.712 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:27:52.712 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 3, 2024-09-12T01:27:52.712 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24401, 2024-09-12T01:27:52.712 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:27:52.713 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:27:52.713 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:27:52.713 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 88.448576332000002, 2024-09-12T01:27:52.713 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T01:27:52.713 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-12T01:27:52.713 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:27:52.713 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 135.728399448 2024-09-12T01:27:52.713 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:27:52.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4bbd1640 1 -- 172.21.15.81:0/168798366 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcf300a2c90 msgr2=0x7fcf300a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4bbd1640 1 --2- 172.21.15.81:0/168798366 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcf300a2c90 0x7fcf300a5150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00abc0 tx=0x7fcf3c00c3b0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4bbd1640 1 -- 172.21.15.81:0/168798366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf44101420 msgr2=0x7fcf44198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.704+0000 7fcf4bbd1640 1 --2- 172.21.15.81:0/168798366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf44101420 0x7fcf44198b40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400b4a0 tx=0x7fcf3400b960 comp rx=0 tx=0).stop 2024-09-12T01:27:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.705+0000 7fcf4bbd1640 1 -- 172.21.15.81:0/168798366 shutdown_connections 2024-09-12T01:27:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.705+0000 7fcf4bbd1640 1 --2- 172.21.15.81:0/168798366 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fcf300a2c90 0x7fcf300a5150 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.705+0000 7fcf4bbd1640 1 --2- 172.21.15.81:0/168798366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf44106a80 0x7fcf4419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.705+0000 7fcf4bbd1640 1 --2- 172.21.15.81:0/168798366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf44101420 0x7fcf44198b40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.705+0000 7fcf4bbd1640 1 --2- 172.21.15.81:0/168798366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf44100a80 0x7fcf44198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.705+0000 7fcf4bbd1640 1 -- 172.21.15.81:0/168798366 >> 172.21.15.81:0/168798366 conn(0x7fcf440fc7a0 msgr2=0x7fcf44104970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.705+0000 7fcf4bbd1640 1 -- 172.21.15.81:0/168798366 shutdown_connections 2024-09-12T01:27:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:52.705+0000 7fcf4bbd1640 1 -- 172.21.15.81:0/168798366 wait complete. 2024-09-12T01:27:53.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T01:27:53.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:53 smithi081 ceph-mon[30920]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:53.799 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:54.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:53 smithi100 ceph-mon[35275]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:54.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:53 smithi189 ceph-mon[35357]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:27:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.272+0000 7f278ddce640 1 -- 172.21.15.81:0/3770980316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2788102d30 msgr2=0x7f2788103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.272+0000 7f278ddce640 1 --2- 172.21.15.81:0/3770980316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2788102d30 0x7f2788103110 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2778009930 tx=0x7f277802a420 comp rx=0 tx=0).stop 2024-09-12T01:27:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.272+0000 7f278ddce640 1 -- 172.21.15.81:0/3770980316 shutdown_connections 2024-09-12T01:27:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.272+0000 7f278ddce640 1 --2- 172.21.15.81:0/3770980316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27881082a0 0x7f278810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.272+0000 7f278ddce640 1 --2- 172.21.15.81:0/3770980316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27881036e0 0x7f2788107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.272+0000 7f278ddce640 1 --2- 172.21.15.81:0/3770980316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2788102d30 0x7f2788103110 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.272+0000 7f278ddce640 1 -- 172.21.15.81:0/3770980316 >> 172.21.15.81:0/3770980316 conn(0x7f27880fc7d0 msgr2=0x7f27880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.272+0000 7f278ddce640 1 -- 172.21.15.81:0/3770980316 shutdown_connections 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.272+0000 7f278ddce640 1 -- 172.21.15.81:0/3770980316 wait complete. 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f278ddce640 1 Processor -- start 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f278ddce640 1 -- start start 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f278ddce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2788102d30 0x7f2788198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f278ddce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27881036e0 0x7f2788198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f278ddce640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27881082a0 0x7f278819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f278ddce640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27881120a0 con 0x7f2788102d30 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f278ddce640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2788111f20 con 0x7f27881036e0 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f278ddce640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2788112220 con 0x7f27881082a0 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f27877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2788102d30 0x7f2788198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f27877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2788102d30 0x7f2788198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45756/0 (socket says 172.21.15.81:45756) 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f27877fe640 1 -- 172.21.15.81:0/835992415 learned_addr learned my addr 172.21.15.81:0/835992415 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:54.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f2787fff640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27881082a0 0x7f278819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f2786ffd640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27881036e0 0x7f2788198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f27877fe640 1 -- 172.21.15.81:0/835992415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27881082a0 msgr2=0x7f278819ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:54.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f27877fe640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27881082a0 0x7f278819ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f27877fe640 1 -- 172.21.15.81:0/835992415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27881036e0 msgr2=0x7f2788198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:54.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f27877fe640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27881036e0 0x7f2788198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f27877fe640 1 -- 172.21.15.81:0/835992415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278819d510 con 0x7f2788102d30 2024-09-12T01:27:54.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.273+0000 7f2786ffd640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27881036e0 0x7f2788198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:54.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.274+0000 7f27877fe640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2788102d30 0x7f2788198560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2778009230 tx=0x7f2778004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:54.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.274+0000 7f2784ff9640 1 -- 172.21.15.81:0/835992415 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277803f030 con 0x7f2788102d30 2024-09-12T01:27:54.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.274+0000 7f2784ff9640 1 -- 172.21.15.81:0/835992415 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2778003ad0 con 0x7f2788102d30 2024-09-12T01:27:54.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.274+0000 7f278ddce640 1 -- 172.21.15.81:0/835992415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278819d7a0 con 0x7f2788102d30 2024-09-12T01:27:54.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.274+0000 7f2784ff9640 1 -- 172.21.15.81:0/835992415 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778035070 con 0x7f2788102d30 2024-09-12T01:27:54.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.274+0000 7f278ddce640 1 -- 172.21.15.81:0/835992415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27881a50e0 con 0x7f2788102d30 2024-09-12T01:27:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.276+0000 7f2784ff9640 1 -- 172.21.15.81:0/835992415 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2778042030 con 0x7f2788102d30 2024-09-12T01:27:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.276+0000 7f27901a7740 1 Processor -- start 2024-09-12T01:27:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.276+0000 7f27901a7740 1 -- start start 2024-09-12T01:27:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27901a7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa58b0 0x559bd0aa5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27901a7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 0x559bd0ab4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27901a7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27901a7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559bd0a0c090 con 0x559bd0aa61d0 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27901a7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559bd09b3a70 con 0x559bd0ab4fc0 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27901a7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559bd0a08050 con 0x559bd0aa58b0 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 0x559bd0ab4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 0x559bd0ab4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45766/0 (socket says 172.21.15.81:45766) 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27877fe640 1 -- 172.21.15.81:0/1075522200 learned_addr learned my addr 172.21.15.81:0/1075522200 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f2784ff9640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f27700a2c10 0x7f27700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f2787fff640 1 --2- 172.21.15.81:0/1075522200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa58b0 0x559bd0aa5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f2786ffd640 1 --2- 172.21.15.81:0/1075522200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f2787fff640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f27700a2c10 0x7f27700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f2784ff9640 1 -- 172.21.15.81:0/835992415 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f27780ef760 con 0x7f2788102d30 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27877fe640 1 -- 172.21.15.81:0/1075522200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa58b0 msgr2=0x559bd0aa5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27877fe640 1 --2- 172.21.15.81:0/1075522200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa58b0 0x559bd0aa5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27877fe640 1 -- 172.21.15.81:0/1075522200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 msgr2=0x559bd0ab73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:54.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27877fe640 1 --2- 172.21.15.81:0/1075522200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.277+0000 7f27877fe640 1 -- 172.21.15.81:0/1075522200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bd09c0130 con 0x559bd0aa61d0 2024-09-12T01:27:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.278+0000 7f27877fe640 1 --2- 172.21.15.81:0/1075522200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 0x559bd0ab4a80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f27780bbb70 tx=0x7f2778005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b019e6de28a317ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.278+0000 7f2787fff640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f27700a2c10 0x7f27700a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f278000bfd0 tx=0x7f2780004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.278+0000 7f276dffb640 1 -- 172.21.15.81:0/1075522200 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778049070 con 0x559bd0aa61d0 2024-09-12T01:27:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.278+0000 7f276dffb640 1 -- 172.21.15.81:0/1075522200 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27780bbe70 con 0x559bd0aa61d0 2024-09-12T01:27:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.278+0000 7f276dffb640 1 -- 172.21.15.81:0/1075522200 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27780b84e0 con 0x559bd0aa61d0 2024-09-12T01:27:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.278+0000 7f27901a7740 1 -- 172.21.15.81:0/1075522200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 msgr2=0x559bd0ab4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.278+0000 7f27901a7740 1 --2- 172.21.15.81:0/1075522200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 0x559bd0ab4a80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f27780bbb70 tx=0x7f2778005e50 comp rx=0 tx=0).stop 2024-09-12T01:27:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.278+0000 7f27901a7740 1 -- 172.21.15.81:0/1075522200 shutdown_connections 2024-09-12T01:27:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.278+0000 7f27901a7740 1 --2- 172.21.15.81:0/1075522200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.278+0000 7f27901a7740 1 --2- 172.21.15.81:0/1075522200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 0x559bd0ab4a80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.278+0000 7f27901a7740 1 --2- 172.21.15.81:0/1075522200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa58b0 0x559bd0aa5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.279+0000 7f27901a7740 1 -- 172.21.15.81:0/1075522200 >> 172.21.15.81:0/1075522200 conn(0x559bd0aa1f60 msgr2=0x559bd0aa2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.279+0000 7f27901a7740 1 -- 172.21.15.81:0/1075522200 shutdown_connections 2024-09-12T01:27:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.279+0000 7f27901a7740 1 -- 172.21.15.81:0/1075522200 wait complete. 2024-09-12T01:27:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.279+0000 7f27901a7740 1 -- start start 2024-09-12T01:27:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.279+0000 7f27901a7740 1 Processor -- start 2024-09-12T01:27:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.279+0000 7f27901a7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0aa58b0 0x559bd0ab4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.279+0000 7f27901a7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa61d0 0x559bd0ab1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.279+0000 7f27901a7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.279+0000 7f27901a7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559bd0ab7950 con 0x559bd0ab4fc0 2024-09-12T01:27:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.279+0000 7f27901a7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559bd09c6f20 con 0x559bd0aa58b0 2024-09-12T01:27:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.279+0000 7f27901a7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559bd0ab7ad0 con 0x559bd0aa61d0 2024-09-12T01:27:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.279+0000 7f27901a7740 10 client.0 _ll_register_callbacks cb 0x559bd0990030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2787fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2787fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45772/0 (socket says 172.21.15.81:45772) 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2787fff640 1 -- 172.21.15.81:0/316222172 learned_addr learned my addr 172.21.15.81:0/316222172 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2786ffd640 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa61d0 0x559bd0ab1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2787fff640 1 -- 172.21.15.81:0/316222172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa61d0 msgr2=0x559bd0ab1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f27877fe640 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0aa58b0 0x559bd0ab4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2787fff640 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa61d0 0x559bd0ab1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2787fff640 1 -- 172.21.15.81:0/316222172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0aa58b0 msgr2=0x559bd0ab4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2787fff640 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0aa58b0 0x559bd0ab4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2787fff640 1 -- 172.21.15.81:0/316222172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bd077d2b0 con 0x559bd0ab4fc0 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2786ffd640 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa61d0 0x559bd0ab1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2787fff640 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab21e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2780013820 tx=0x7f2780004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15cbf491ab5e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2766ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2766ffd640 1 -- 172.21.15.81:0/316222172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278001f650 con 0x559bd0ab4fc0 2024-09-12T01:27:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2766ffd640 1 -- 172.21.15.81:0/316222172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f278001f7f0 con 0x559bd0ab4fc0 2024-09-12T01:27:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f27901a7740 1 -- 172.21.15.81:0/316222172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27780bbe70 con 0x559bd0ab4fc0 2024-09-12T01:27:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2766ffd640 1 -- 172.21.15.81:0/316222172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f278001f9f0 con 0x559bd0ab4fc0 2024-09-12T01:27:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f27901a7740 10 client.15156 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f27901a7740 1 -- 172.21.15.81:0/316222172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559bd0ac32b0 con 0x559bd0ab4fc0 2024-09-12T01:27:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.280+0000 7f2766ffd640 1 -- 172.21.15.81:0/316222172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27780bbe70 con 0x559bd0ab4fc0 2024-09-12T01:27:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.281+0000 7f2766ffd640 1 -- 172.21.15.81:0/316222172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f278001c040 con 0x559bd0ab4fc0 2024-09-12T01:27:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.281+0000 7f27901a7740 10 client.15156 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.281+0000 7f27901a7740 10 client.15156 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:27:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.281+0000 7f27901a7740 20 client.15156 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.281+0000 7f27901a7740 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x559bd0ac58f0 0x559bd0ac6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.281+0000 7f27901a7740 4 client.15156 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:27:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.281+0000 7f27901a7740 1 -- 172.21.15.81:0/316222172 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bd0a19600 con 0x559bd0ac58f0 2024-09-12T01:27:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.281+0000 7f27877fe640 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x559bd0ac58f0 0x559bd0ac6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.281+0000 7f2766ffd640 10 client.15156 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:27:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.281+0000 7f27877fe640 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x559bd0ac58f0 0x559bd0ac6d60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bdb2ad8c4477dfe3 server_cookie=925bc1be42acde3d in_seq=0 out_seq=0 2024-09-12T01:27:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f2766ffd640 1 -- 172.21.15.81:0/316222172 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559bd0a19600 con 0x559bd0ac58f0 2024-09-12T01:27:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f2766ffd640 10 client.15156 handle_command_reply: tid=0 2024-09-12T01:27:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f27901a7740 1 client.15156 shutdown 2024-09-12T01:27:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f27901a7740 1 -- 172.21.15.81:0/316222172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0ab4fc0 msgr2=0x559bd0ab21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f27901a7740 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab21e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2780013820 tx=0x7f2780004ab0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f27901a7740 1 -- 172.21.15.81:0/316222172 shutdown_connections 2024-09-12T01:27:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f27901a7740 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x559bd0ac58f0 0x559bd0ac6d60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f27901a7740 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab21e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f27901a7740 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa61d0 0x559bd0ab1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f27901a7740 1 --2- 172.21.15.81:0/316222172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0aa58b0 0x559bd0ab4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f2766ffd640 0 client.15156 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:27:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f27901a7740 1 -- 172.21.15.81:0/316222172 >> 172.21.15.81:0/316222172 conn(0x559bd0aa1f60 msgr2=0x559bd0aa7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f27901a7740 1 -- 172.21.15.81:0/316222172 shutdown_connections 2024-09-12T01:27:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.282+0000 7f27901a7740 1 -- 172.21.15.81:0/316222172 wait complete. 2024-09-12T01:27:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.283+0000 7f27901a7740 20 client.15156 trim_cache size 0 max 16384 2024-09-12T01:27:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f27901a7740 1 Processor -- start 2024-09-12T01:27:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f27901a7740 1 -- start start 2024-09-12T01:27:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f27901a7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa58b0 0x559bd0ab21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f27901a7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 0x559bd0ac6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f27901a7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f27901a7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559bd0ac50a0 con 0x559bd0aa61d0 2024-09-12T01:27:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f27901a7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559bd0ac5770 con 0x559bd0ab4fc0 2024-09-12T01:27:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f27901a7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559bd0ac5e40 con 0x559bd0aa58b0 2024-09-12T01:27:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f2786ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 0x559bd0ac6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f2786ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 0x559bd0ac6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45784/0 (socket says 172.21.15.81:45784) 2024-09-12T01:27:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f2786ffd640 1 -- 172.21.15.81:0/2966204504 learned_addr learned my addr 172.21.15.81:0/2966204504 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f2787fff640 1 --2- 172.21.15.81:0/2966204504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f2786ffd640 1 -- 172.21.15.81:0/2966204504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa58b0 msgr2=0x559bd0ab21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f2786ffd640 1 --2- 172.21.15.81:0/2966204504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa58b0 0x559bd0ab21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f2786ffd640 1 -- 172.21.15.81:0/2966204504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 msgr2=0x559bd0ab0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f2786ffd640 1 --2- 172.21.15.81:0/2966204504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f2786ffd640 1 -- 172.21.15.81:0/2966204504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bd0ab0c30 con 0x559bd0aa61d0 2024-09-12T01:27:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.300+0000 7f2786ffd640 1 --2- 172.21.15.81:0/2966204504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 0x559bd0ac6d60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f277c005fd0 tx=0x7f277c00bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46869ddcc5b2c62d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.301+0000 7f276d7fa640 1 -- 172.21.15.81:0/2966204504 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c00bdf0 con 0x559bd0aa61d0 2024-09-12T01:27:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.301+0000 7f276d7fa640 1 -- 172.21.15.81:0/2966204504 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f277c005020 con 0x559bd0aa61d0 2024-09-12T01:27:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.301+0000 7f276d7fa640 1 -- 172.21.15.81:0/2966204504 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c004d20 con 0x559bd0aa61d0 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.301+0000 7f27901a7740 1 -- 172.21.15.81:0/2966204504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 msgr2=0x559bd0ac6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.301+0000 7f27901a7740 1 --2- 172.21.15.81:0/2966204504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 0x559bd0ac6d60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f277c005fd0 tx=0x7f277c00bc60 comp rx=0 tx=0).stop 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.301+0000 7f27901a7740 1 -- 172.21.15.81:0/2966204504 shutdown_connections 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.301+0000 7f27901a7740 1 --2- 172.21.15.81:0/2966204504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 0x559bd0ab0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.301+0000 7f27901a7740 1 --2- 172.21.15.81:0/2966204504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa61d0 0x559bd0ac6d60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.301+0000 7f27901a7740 1 --2- 172.21.15.81:0/2966204504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa58b0 0x559bd0ab21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.301+0000 7f27901a7740 1 -- 172.21.15.81:0/2966204504 >> 172.21.15.81:0/2966204504 conn(0x559bd0aa1f60 msgr2=0x559bd0aad240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.301+0000 7f27901a7740 1 -- 172.21.15.81:0/2966204504 shutdown_connections 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.301+0000 7f27901a7740 1 -- 172.21.15.81:0/2966204504 wait complete. 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27901a7740 1 -- start start 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27901a7740 1 Processor -- start 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27901a7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa58b0 0x559bd0acf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27901a7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa61d0 0x559bd0ac8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27901a7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 0x559bd0ac8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27901a7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559bd0ac6be0 con 0x559bd0aa58b0 2024-09-12T01:27:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27901a7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559bd0ac6510 con 0x559bd0ab4fc0 2024-09-12T01:27:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27901a7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559bd0ac72b0 con 0x559bd0aa61d0 2024-09-12T01:27:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27901a7740 10 client.0 _ll_register_callbacks cb 0x7f2780010ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa58b0 0x559bd0acf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa58b0 0x559bd0acf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45800/0 (socket says 172.21.15.81:45800) 2024-09-12T01:27:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27877fe640 1 -- 172.21.15.81:0/827265473 learned_addr learned my addr 172.21.15.81:0/827265473 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f2786ffd640 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa61d0 0x559bd0ac8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f2787fff640 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 0x559bd0ac8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27877fe640 1 -- 172.21.15.81:0/827265473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa61d0 msgr2=0x559bd0ac8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27877fe640 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa61d0 0x559bd0ac8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27877fe640 1 -- 172.21.15.81:0/827265473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 msgr2=0x559bd0ac8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27877fe640 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 0x559bd0ac8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f27877fe640 1 -- 172.21.15.81:0/827265473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bd0aa6000 con 0x559bd0aa58b0 2024-09-12T01:27:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.302+0000 7f2787fff640 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 0x559bd0ac8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.303+0000 7f27877fe640 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa58b0 0x559bd0acf6c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f27780b6910 tx=0x7f277802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6450e475e44bd99b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.303+0000 7f2766ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.303+0000 7f2766ffd640 1 -- 172.21.15.81:0/827265473 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778049040 con 0x559bd0aa58b0 2024-09-12T01:27:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.303+0000 7f2766ffd640 1 -- 172.21.15.81:0/827265473 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2778003c80 con 0x559bd0aa58b0 2024-09-12T01:27:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.303+0000 7f27901a7740 1 -- 172.21.15.81:0/827265473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f277c005020 con 0x559bd0aa58b0 2024-09-12T01:27:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.303+0000 7f2766ffd640 1 -- 172.21.15.81:0/827265473 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f27780b8110 con 0x559bd0aa58b0 2024-09-12T01:27:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.303+0000 7f27901a7740 10 client.15162 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.303+0000 7f27901a7740 1 -- 172.21.15.81:0/827265473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559bd0aa6000 con 0x559bd0aa58b0 2024-09-12T01:27:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.303+0000 7f2766ffd640 1 -- 172.21.15.81:0/827265473 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f277c005020 con 0x559bd0aa58b0 2024-09-12T01:27:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.303+0000 7f2766ffd640 1 -- 172.21.15.81:0/827265473 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f277809ace0 con 0x559bd0aa58b0 2024-09-12T01:27:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.303+0000 7f27901a7740 10 client.15162 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.303+0000 7f27901a7740 10 client.15162 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:27:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.303+0000 7f27901a7740 20 client.15162 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.304+0000 7f27901a7740 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x559bd0b344c0 0x559bd0b331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.304+0000 7f27901a7740 4 client.15162 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:27:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.304+0000 7f27901a7740 1 -- 172.21.15.81:0/827265473 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "status"}) -- 0x559bd0a13b10 con 0x559bd0b344c0 2024-09-12T01:27:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.304+0000 7f2786ffd640 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x559bd0b344c0 0x559bd0b331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.304+0000 7f2786ffd640 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x559bd0b344c0 0x559bd0b331d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=144308372894db55 server_cookie=1635aa66e1b64f35 in_seq=0 out_seq=0 2024-09-12T01:27:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.304+0000 7f2766ffd640 10 client.15162 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:27:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.304+0000 7f2766ffd640 1 -- 172.21.15.81:0/827265473 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559bd0a13b10 con 0x559bd0b344c0 2024-09-12T01:27:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.304+0000 7f2766ffd640 10 client.15162 handle_command_reply: tid=0 2024-09-12T01:27:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.304+0000 7f27901a7740 1 client.15162 shutdown 2024-09-12T01:27:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.304+0000 7f27901a7740 1 -- 172.21.15.81:0/827265473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa58b0 msgr2=0x559bd0acf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.304+0000 7f27901a7740 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa58b0 0x559bd0acf6c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f27780b6910 tx=0x7f277802a420 comp rx=0 tx=0).stop 2024-09-12T01:27:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f27901a7740 1 -- 172.21.15.81:0/827265473 shutdown_connections 2024-09-12T01:27:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f27901a7740 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x559bd0b344c0 0x559bd0b331d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f27901a7740 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559bd0ab4fc0 0x559bd0ac8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f27901a7740 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559bd0aa61d0 0x559bd0ac8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f27901a7740 1 --2- 172.21.15.81:0/827265473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559bd0aa58b0 0x559bd0acf6c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f27901a7740 1 -- 172.21.15.81:0/827265473 >> 172.21.15.81:0/827265473 conn(0x559bd0aa1f60 msgr2=0x559bd0aad240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f2766ffd640 0 client.15162 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:27:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f27901a7740 1 -- 172.21.15.81:0/827265473 shutdown_connections 2024-09-12T01:27:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f27901a7740 1 -- 172.21.15.81:0/827265473 wait complete. 2024-09-12T01:27:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f27901a7740 20 client.15162 trim_cache size 0 max 16384 2024-09-12T01:27:54.311 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:27:54.311 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:27:54.311 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-12T01:27:54.311 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24446, 2024-09-12T01:27:54.311 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:27:54.311 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:27:54.311 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:27:54.311 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 90.833030688999997, 2024-09-12T01:27:54.311 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T01:27:54.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-12T01:27:54.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:27:54.312 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 120.938889557 2024-09-12T01:27:54.312 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:27:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f278ddce640 1 -- 172.21.15.81:0/835992415 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f27700a2c10 msgr2=0x7f27700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f278ddce640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f27700a2c10 0x7f27700a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f278000bfd0 tx=0x7f2780004a40 comp rx=0 tx=0).stop 2024-09-12T01:27:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f278ddce640 1 -- 172.21.15.81:0/835992415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2788102d30 msgr2=0x7f2788198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f278ddce640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2788102d30 0x7f2788198560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2778009230 tx=0x7f2778004270 comp rx=0 tx=0).stop 2024-09-12T01:27:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f278ddce640 1 -- 172.21.15.81:0/835992415 shutdown_connections 2024-09-12T01:27:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f278ddce640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f27700a2c10 0x7f27700a50d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f278ddce640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27881082a0 0x7f278819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f278ddce640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27881036e0 0x7f2788198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f278ddce640 1 --2- 172.21.15.81:0/835992415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2788102d30 0x7f2788198560 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f278ddce640 1 -- 172.21.15.81:0/835992415 >> 172.21.15.81:0/835992415 conn(0x7f27880fc7d0 msgr2=0x7f2788105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f278ddce640 1 -- 172.21.15.81:0/835992415 shutdown_connections 2024-09-12T01:27:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:54.305+0000 7f278ddce640 1 -- 172.21.15.81:0/835992415 wait complete. 2024-09-12T01:27:55.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T01:27:55.277 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:55.668 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:55 smithi081 ceph-mon[30920]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:55.668 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:55 smithi081 ceph-mon[30920]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T01:27:55.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.749+0000 7f932853e640 1 -- 172.21.15.81:0/1329254514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93201036a0 msgr2=0x7f932010bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:55.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.749+0000 7f932853e640 1 --2- 172.21.15.81:0/1329254514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93201036a0 0x7f932010bb90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f931c009900 tx=0x7f931c02a480 comp rx=0 tx=0).stop 2024-09-12T01:27:55.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.749+0000 7f932853e640 1 -- 172.21.15.81:0/1329254514 shutdown_connections 2024-09-12T01:27:55.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.749+0000 7f932853e640 1 --2- 172.21.15.81:0/1329254514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f932010c160 0x7f932010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.749+0000 7f932853e640 1 --2- 172.21.15.81:0/1329254514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93201036a0 0x7f932010bb90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.749+0000 7f932853e640 1 --2- 172.21.15.81:0/1329254514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9320102d80 0x7f9320103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.749+0000 7f932853e640 1 -- 172.21.15.81:0/1329254514 >> 172.21.15.81:0/1329254514 conn(0x7f93200fc7a0 msgr2=0x7f93200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.749+0000 7f932853e640 1 -- 172.21.15.81:0/1329254514 shutdown_connections 2024-09-12T01:27:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.749+0000 7f932853e640 1 -- 172.21.15.81:0/1329254514 wait complete. 2024-09-12T01:27:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.749+0000 7f932853e640 1 Processor -- start 2024-09-12T01:27:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f932853e640 1 -- start start 2024-09-12T01:27:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f932853e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9320102d80 0x7f9320198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f932853e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93201036a0 0x7f9320198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f932853e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932010c160 0x7f932019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f932853e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9320111f60 con 0x7f932010c160 2024-09-12T01:27:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f932853e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9320111de0 con 0x7f93201036a0 2024-09-12T01:27:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f932853e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f93201120e0 con 0x7f9320102d80 2024-09-12T01:27:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f9326adb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932010c160 0x7f932019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f9326adb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932010c160 0x7f932019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45818/0 (socket says 172.21.15.81:45818) 2024-09-12T01:27:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f9326adb640 1 -- 172.21.15.81:0/3381356864 learned_addr learned my addr 172.21.15.81:0/3381356864 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f93262da640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9320102d80 0x7f9320198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f9325ad9640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93201036a0 0x7f9320198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f9326adb640 1 -- 172.21.15.81:0/3381356864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9320102d80 msgr2=0x7f9320198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f9326adb640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9320102d80 0x7f9320198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f9326adb640 1 -- 172.21.15.81:0/3381356864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93201036a0 msgr2=0x7f9320198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f9326adb640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93201036a0 0x7f9320198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f9326adb640 1 -- 172.21.15.81:0/3381356864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932019d3f0 con 0x7f932010c160 2024-09-12T01:27:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f9325ad9640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93201036a0 0x7f9320198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f93262da640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9320102d80 0x7f9320198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f9326adb640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932010c160 0x7f932019cd10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f931800eaa0 tx=0x7f931800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f93137fe640 1 -- 172.21.15.81:0/3381356864 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931800cdb0 con 0x7f932010c160 2024-09-12T01:27:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.750+0000 7f932853e640 1 -- 172.21.15.81:0/3381356864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932019d6e0 con 0x7f932010c160 2024-09-12T01:27:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.751+0000 7f93137fe640 1 -- 172.21.15.81:0/3381356864 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9318005020 con 0x7f932010c160 2024-09-12T01:27:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.751+0000 7f93137fe640 1 -- 172.21.15.81:0/3381356864 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93180116d0 con 0x7f932010c160 2024-09-12T01:27:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.751+0000 7f932853e640 1 -- 172.21.15.81:0/3381356864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93201a4fc0 con 0x7f932010c160 2024-09-12T01:27:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.753+0000 7f93137fe640 1 -- 172.21.15.81:0/3381356864 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f93180054d0 con 0x7f932010c160 2024-09-12T01:27:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f932a917740 1 Processor -- start 2024-09-12T01:27:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f932a917740 1 -- start start 2024-09-12T01:27:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f932a917740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fcff9d0 0x55923fcffdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f932a917740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fd002f0 0x55923fd0a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f932a917740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fd0abb0 0x55923fd0cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f932a917740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55923fc66090 con 0x55923fcff9d0 2024-09-12T01:27:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f932a917740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55923fc0da70 con 0x55923fd0abb0 2024-09-12T01:27:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f932a917740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55923fc62050 con 0x55923fd002f0 2024-09-12T01:27:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f9325ad9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fcff9d0 0x55923fcffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f9325ad9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fcff9d0 0x55923fcffdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45822/0 (socket says 172.21.15.81:45822) 2024-09-12T01:27:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f9325ad9640 1 -- 172.21.15.81:0/1699237954 learned_addr learned my addr 172.21.15.81:0/1699237954 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f93262da640 1 --2- 172.21.15.81:0/1699237954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fd002f0 0x55923fd0a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f93137fe640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f930c0a2b80 0x7f930c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f9325ad9640 1 -- 172.21.15.81:0/1699237954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fd002f0 msgr2=0x55923fd0a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f9325ad9640 1 --2- 172.21.15.81:0/1699237954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fd002f0 0x55923fd0a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f9325ad9640 1 -- 172.21.15.81:0/1699237954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fd0abb0 msgr2=0x55923fd0cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f9325ad9640 1 --2- 172.21.15.81:0/1699237954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fd0abb0 0x55923fd0cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.754+0000 7f9325ad9640 1 -- 172.21.15.81:0/1699237954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923fc1a130 con 0x55923fcff9d0 2024-09-12T01:27:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.755+0000 7f9326adb640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f930c0a2b80 0x7f930c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.755+0000 7f9325ad9640 1 --2- 172.21.15.81:0/1699237954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fcff9d0 0x55923fcffdb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f931c005940 tx=0x7f931c032f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c181656d27155b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.755+0000 7f93137fe640 1 -- 172.21.15.81:0/3381356864 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f93180cf2c0 con 0x7f932010c160 2024-09-12T01:27:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.755+0000 7f9310ff9640 1 -- 172.21.15.81:0/1699237954 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c035050 con 0x55923fcff9d0 2024-09-12T01:27:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.755+0000 7f9310ff9640 1 -- 172.21.15.81:0/1699237954 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f931c0317b0 con 0x55923fcff9d0 2024-09-12T01:27:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.755+0000 7f9310ff9640 1 -- 172.21.15.81:0/1699237954 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c0046c0 con 0x55923fcff9d0 2024-09-12T01:27:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.756+0000 7f932a917740 1 -- 172.21.15.81:0/1699237954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fcff9d0 msgr2=0x55923fcffdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.756+0000 7f9326adb640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f930c0a2b80 0x7f930c0a5040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f931809b830 tx=0x7f931806ebf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.756+0000 7f932a917740 1 --2- 172.21.15.81:0/1699237954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fcff9d0 0x55923fcffdb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f931c005940 tx=0x7f931c032f00 comp rx=0 tx=0).stop 2024-09-12T01:27:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.756+0000 7f932a917740 1 -- 172.21.15.81:0/1699237954 shutdown_connections 2024-09-12T01:27:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.756+0000 7f932a917740 1 --2- 172.21.15.81:0/1699237954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fd0abb0 0x55923fd0cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.756+0000 7f932a917740 1 --2- 172.21.15.81:0/1699237954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fd002f0 0x55923fd0a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.756+0000 7f932a917740 1 --2- 172.21.15.81:0/1699237954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fcff9d0 0x55923fcffdb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.756+0000 7f932a917740 1 -- 172.21.15.81:0/1699237954 >> 172.21.15.81:0/1699237954 conn(0x55923fcfbf60 msgr2=0x55923fcfc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.756+0000 7f932a917740 1 -- 172.21.15.81:0/1699237954 shutdown_connections 2024-09-12T01:27:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.756+0000 7f932a917740 1 -- 172.21.15.81:0/1699237954 wait complete. 2024-09-12T01:27:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.756+0000 7f932a917740 1 -- start start 2024-09-12T01:27:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.756+0000 7f932a917740 1 Processor -- start 2024-09-12T01:27:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f932a917740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fcff9d0 0x55923fd0a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f932a917740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd002f0 0x55923fd07780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f932a917740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fd0abb0 0x55923fd07cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f932a917740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55923fd11b90 con 0x55923fd002f0 2024-09-12T01:27:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f932a917740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55923fc20f20 con 0x55923fd0abb0 2024-09-12T01:27:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f932a917740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55923fd11d10 con 0x55923fcff9d0 2024-09-12T01:27:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f932a917740 10 client.0 _ll_register_callbacks cb 0x55923fbea030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f93262da640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd002f0 0x55923fd07780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f93262da640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd002f0 0x55923fd07780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45830/0 (socket says 172.21.15.81:45830) 2024-09-12T01:27:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f93262da640 1 -- 172.21.15.81:0/921188441 learned_addr learned my addr 172.21.15.81:0/921188441 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:55.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f9325ad9640 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fcff9d0 0x55923fd0a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f9325ad9640 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fd0abb0 0x55923fd07cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f93262da640 1 -- 172.21.15.81:0/921188441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fcff9d0 msgr2=0x55923fd0a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:55.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f93262da640 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fcff9d0 0x55923fd0a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f93262da640 1 -- 172.21.15.81:0/921188441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fd0abb0 msgr2=0x55923fd07cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:55.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f93262da640 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fd0abb0 0x55923fd07cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f93262da640 1 -- 172.21.15.81:0/921188441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55923f9d72b0 con 0x55923fd002f0 2024-09-12T01:27:55.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f9325ad9640 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fcff9d0 0x55923fd0a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:27:55.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f93262da640 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd002f0 0x55923fd07780 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f93140106a0 tx=0x7f9314010b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4147d5a4a14f5b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:55.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f9309ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:55.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f9309ffb640 1 -- 172.21.15.81:0/921188441 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314010ea0 con 0x55923fd002f0 2024-09-12T01:27:55.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.757+0000 7f9309ffb640 1 -- 172.21.15.81:0/921188441 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9314004230 con 0x55923fd002f0 2024-09-12T01:27:55.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.758+0000 7f932a917740 1 -- 172.21.15.81:0/921188441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f931c0317b0 con 0x55923fd002f0 2024-09-12T01:27:55.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.758+0000 7f9309ffb640 1 -- 172.21.15.81:0/921188441 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9314004430 con 0x55923fd002f0 2024-09-12T01:27:55.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.758+0000 7f932a917740 10 client.15174 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:55.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.758+0000 7f932a917740 1 -- 172.21.15.81:0/921188441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55923fd1d530 con 0x55923fd002f0 2024-09-12T01:27:55.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.758+0000 7f9309ffb640 1 -- 172.21.15.81:0/921188441 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f931c0317b0 con 0x55923fd002f0 2024-09-12T01:27:55.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.758+0000 7f9309ffb640 1 -- 172.21.15.81:0/921188441 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f931400f040 con 0x55923fd002f0 2024-09-12T01:27:55.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.758+0000 7f932a917740 10 client.15174 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:55.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.758+0000 7f932a917740 10 client.15174 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:27:55.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.758+0000 7f932a917740 20 client.15174 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:55.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.758+0000 7f932a917740 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55923fd1fb80 0x55923fd20ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.758+0000 7f932a917740 4 client.15174 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:27:55.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.758+0000 7f932a917740 1 -- 172.21.15.81:0/921188441 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55923fc73600 con 0x55923fd1fb80 2024-09-12T01:27:55.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.759+0000 7f9325ad9640 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55923fd1fb80 0x55923fd20ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.759+0000 7f9309ffb640 10 client.15174 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:27:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.759+0000 7f9325ad9640 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55923fd1fb80 0x55923fd20ff0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ba1fa0357c227c12 server_cookie=44f74d8b7c2c1a2a in_seq=0 out_seq=0 2024-09-12T01:27:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f9309ffb640 1 -- 172.21.15.81:0/921188441 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55923fc73600 con 0x55923fd1fb80 2024-09-12T01:27:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f9309ffb640 10 client.15174 handle_command_reply: tid=0 2024-09-12T01:27:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f932a917740 1 client.15174 shutdown 2024-09-12T01:27:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f932a917740 1 -- 172.21.15.81:0/921188441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd002f0 msgr2=0x55923fd07780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f932a917740 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd002f0 0x55923fd07780 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f93140106a0 tx=0x7f9314010b60 comp rx=0 tx=0).stop 2024-09-12T01:27:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f932a917740 1 -- 172.21.15.81:0/921188441 shutdown_connections 2024-09-12T01:27:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f932a917740 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fd0abb0 0x55923fd07cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f932a917740 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55923fd1fb80 0x55923fd20ff0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f932a917740 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd002f0 0x55923fd07780 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f932a917740 1 --2- 172.21.15.81:0/921188441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fcff9d0 0x55923fd0a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f9309ffb640 0 client.15174 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:27:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f932a917740 1 -- 172.21.15.81:0/921188441 >> 172.21.15.81:0/921188441 conn(0x55923fcfbf60 msgr2=0x55923fd01c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f932a917740 1 -- 172.21.15.81:0/921188441 shutdown_connections 2024-09-12T01:27:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f932a917740 1 -- 172.21.15.81:0/921188441 wait complete. 2024-09-12T01:27:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.760+0000 7f932a917740 20 client.15174 trim_cache size 0 max 16384 2024-09-12T01:27:55.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.777+0000 7f932a917740 1 Processor -- start 2024-09-12T01:27:55.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.777+0000 7f932a917740 1 -- start start 2024-09-12T01:27:55.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f932a917740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fcff9d0 0x55923fd20ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f932a917740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fd002f0 0x55923fcfc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f932a917740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 0x55923fd095e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f932a917740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55923fd1f330 con 0x55923fd0abb0 2024-09-12T01:27:55.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f932a917740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55923fd1fa00 con 0x55923fd002f0 2024-09-12T01:27:55.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f932a917740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55923fd200d0 con 0x55923fcff9d0 2024-09-12T01:27:55.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f9325ad9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 0x55923fd095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f9325ad9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 0x55923fd095e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45846/0 (socket says 172.21.15.81:45846) 2024-09-12T01:27:55.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f9325ad9640 1 -- 172.21.15.81:0/543173160 learned_addr learned my addr 172.21.15.81:0/543173160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:55.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f9325ad9640 1 -- 172.21.15.81:0/543173160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fcff9d0 msgr2=0x55923fd20ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:55.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f9325ad9640 1 --2- 172.21.15.81:0/543173160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fcff9d0 0x55923fd20ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f9325ad9640 1 -- 172.21.15.81:0/543173160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fd002f0 msgr2=0x55923fcfc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:55.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f9325ad9640 1 --2- 172.21.15.81:0/543173160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fd002f0 0x55923fcfc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f9325ad9640 1 -- 172.21.15.81:0/543173160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923fd08790 con 0x55923fd0abb0 2024-09-12T01:27:55.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f9325ad9640 1 --2- 172.21.15.81:0/543173160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 0x55923fd095e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f931c033000 tx=0x7f931c0053b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6accc94daa368eb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:55.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f930bfff640 1 -- 172.21.15.81:0/543173160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c055070 con 0x55923fd0abb0 2024-09-12T01:27:55.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f930bfff640 1 -- 172.21.15.81:0/543173160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f931c0046c0 con 0x55923fd0abb0 2024-09-12T01:27:55.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.778+0000 7f930bfff640 1 -- 172.21.15.81:0/543173160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c035040 con 0x55923fd0abb0 2024-09-12T01:27:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.779+0000 7f932a917740 1 -- 172.21.15.81:0/543173160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 msgr2=0x55923fd095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.779+0000 7f932a917740 1 --2- 172.21.15.81:0/543173160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 0x55923fd095e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f931c033000 tx=0x7f931c0053b0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.779+0000 7f932a917740 1 -- 172.21.15.81:0/543173160 shutdown_connections 2024-09-12T01:27:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.779+0000 7f932a917740 1 --2- 172.21.15.81:0/543173160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 0x55923fd095e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.779+0000 7f932a917740 1 --2- 172.21.15.81:0/543173160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fd002f0 0x55923fcfc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.779+0000 7f932a917740 1 --2- 172.21.15.81:0/543173160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fcff9d0 0x55923fd20ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.779+0000 7f932a917740 1 -- 172.21.15.81:0/543173160 >> 172.21.15.81:0/543173160 conn(0x55923fcfbf60 msgr2=0x55923fd08ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.779+0000 7f932a917740 1 -- 172.21.15.81:0/543173160 shutdown_connections 2024-09-12T01:27:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.779+0000 7f932a917740 1 -- 172.21.15.81:0/543173160 wait complete. 2024-09-12T01:27:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.779+0000 7f932a917740 1 -- start start 2024-09-12T01:27:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.779+0000 7f932a917740 1 Processor -- start 2024-09-12T01:27:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f932a917740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fcff9d0 0x55923fd825a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f932a917740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fd002f0 0x55923fd82ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f932a917740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 0x55923fd24780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f932a917740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55923fd20e70 con 0x55923fd0abb0 2024-09-12T01:27:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f932a917740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55923fd207a0 con 0x55923fcff9d0 2024-09-12T01:27:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f932a917740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55923fd21540 con 0x55923fd002f0 2024-09-12T01:27:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f932a917740 10 client.0 _ll_register_callbacks cb 0x7f931400b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9325ad9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 0x55923fd24780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9325ad9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 0x55923fd24780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45858/0 (socket says 172.21.15.81:45858) 2024-09-12T01:27:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9325ad9640 1 -- 172.21.15.81:0/125163284 learned_addr learned my addr 172.21.15.81:0/125163284 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9325ad9640 1 --2- 172.21.15.81:0/125163284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fcff9d0 0x55923fd825a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f93262da640 1 --2- 172.21.15.81:0/125163284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fd002f0 0x55923fd82ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9325ad9640 1 -- 172.21.15.81:0/125163284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fd002f0 msgr2=0x55923fd82ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9325ad9640 1 --2- 172.21.15.81:0/125163284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fd002f0 0x55923fd82ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9325ad9640 1 -- 172.21.15.81:0/125163284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fcff9d0 msgr2=0x55923fd825a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9325ad9640 1 --2- 172.21.15.81:0/125163284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fcff9d0 0x55923fd825a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9325ad9640 1 -- 172.21.15.81:0/125163284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55923fd24f80 con 0x55923fd0abb0 2024-09-12T01:27:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9325ad9640 1 --2- 172.21.15.81:0/125163284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 0x55923fd24780 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f931c005380 tx=0x7f931c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2adeaa9855d458e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9309ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9309ffb640 1 -- 172.21.15.81:0/125163284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c055040 con 0x55923fd0abb0 2024-09-12T01:27:55.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9309ffb640 1 -- 172.21.15.81:0/125163284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f931c004a70 con 0x55923fd0abb0 2024-09-12T01:27:55.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f932a917740 1 -- 172.21.15.81:0/125163284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f931c0046c0 con 0x55923fd0abb0 2024-09-12T01:27:55.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f9309ffb640 1 -- 172.21.15.81:0/125163284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f931c035040 con 0x55923fd0abb0 2024-09-12T01:27:55.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f932a917740 10 client.15180 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:55.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.780+0000 7f932a917740 1 -- 172.21.15.81:0/125163284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55923fd89d40 con 0x55923fd0abb0 2024-09-12T01:27:55.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.781+0000 7f9309ffb640 1 -- 172.21.15.81:0/125163284 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f931c0046c0 con 0x55923fd0abb0 2024-09-12T01:27:55.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.781+0000 7f9309ffb640 1 -- 172.21.15.81:0/125163284 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f931c05b030 con 0x55923fd0abb0 2024-09-12T01:27:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.781+0000 7f932a917740 10 client.15180 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.781+0000 7f932a917740 10 client.15180 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:27:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.781+0000 7f932a917740 20 client.15180 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.781+0000 7f932a917740 1 --2- 172.21.15.81:0/125163284 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55923fd8e1e0 0x55923fd8cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.781+0000 7f932a917740 4 client.15180 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:27:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.781+0000 7f932a917740 1 -- 172.21.15.81:0/125163284 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "status"}) -- 0x55923fc6db10 con 0x55923fd8e1e0 2024-09-12T01:27:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.781+0000 7f93262da640 1 --2- 172.21.15.81:0/125163284 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55923fd8e1e0 0x55923fd8cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f93262da640 1 --2- 172.21.15.81:0/125163284 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55923fd8e1e0 0x55923fd8cef0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d91ea1a3ef95149b server_cookie=d1febfc78fc9ee0f in_seq=0 out_seq=0 2024-09-12T01:27:55.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f9309ffb640 10 client.15180 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:27:55.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f9309ffb640 1 -- 172.21.15.81:0/125163284 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55923fc6db10 con 0x55923fd8e1e0 2024-09-12T01:27:55.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f9309ffb640 10 client.15180 handle_command_reply: tid=0 2024-09-12T01:27:55.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f932a917740 1 client.15180 shutdown 2024-09-12T01:27:55.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f932a917740 1 -- 172.21.15.81:0/125163284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 msgr2=0x55923fd24780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:55.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f932a917740 1 --2- 172.21.15.81:0/125163284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 0x55923fd24780 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f931c005380 tx=0x7f931c02a480 comp rx=0 tx=0).stop 2024-09-12T01:27:55.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f932a917740 1 -- 172.21.15.81:0/125163284 shutdown_connections 2024-09-12T01:27:55.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f932a917740 1 --2- 172.21.15.81:0/125163284 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55923fd8e1e0 0x55923fd8cef0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f9309ffb640 0 client.15180 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:27:55.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f932a917740 1 --2- 172.21.15.81:0/125163284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55923fd0abb0 0x55923fd24780 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f932a917740 1 --2- 172.21.15.81:0/125163284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55923fd002f0 0x55923fd82ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f932a917740 1 --2- 172.21.15.81:0/125163284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55923fcff9d0 0x55923fd825a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f932a917740 1 -- 172.21.15.81:0/125163284 >> 172.21.15.81:0/125163284 conn(0x55923fcfbf60 msgr2=0x55923fcfb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:55.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f932a917740 1 -- 172.21.15.81:0/125163284 shutdown_connections 2024-09-12T01:27:55.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f932a917740 1 -- 172.21.15.81:0/125163284 wait complete. 2024-09-12T01:27:55.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.782+0000 7f932a917740 20 client.15180 trim_cache size 0 max 16384 2024-09-12T01:27:55.790 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:27:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:27:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-12T01:27:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24448, 2024-09-12T01:27:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:27:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:27:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:27:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 93.317256176000001, 2024-09-12T01:27:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T01:27:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-12T01:27:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:27:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 119.966501425 2024-09-12T01:27:55.792 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:27:55.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.783+0000 7f932853e640 1 -- 172.21.15.81:0/3381356864 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f930c0a2b80 msgr2=0x7f930c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:55.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.783+0000 7f932853e640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f930c0a2b80 0x7f930c0a5040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f931809b830 tx=0x7f931806ebf0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.783+0000 7f932853e640 1 -- 172.21.15.81:0/3381356864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932010c160 msgr2=0x7f932019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:55.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.783+0000 7f932853e640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932010c160 0x7f932019cd10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f931800eaa0 tx=0x7f931800ef60 comp rx=0 tx=0).stop 2024-09-12T01:27:55.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.783+0000 7f932853e640 1 -- 172.21.15.81:0/3381356864 shutdown_connections 2024-09-12T01:27:55.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.783+0000 7f932853e640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f930c0a2b80 0x7f930c0a5040 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.783+0000 7f932853e640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932010c160 0x7f932019cd10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.783+0000 7f932853e640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93201036a0 0x7f9320198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.783+0000 7f932853e640 1 --2- 172.21.15.81:0/3381356864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9320102d80 0x7f9320198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:55.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.783+0000 7f932853e640 1 -- 172.21.15.81:0/3381356864 >> 172.21.15.81:0/3381356864 conn(0x7f93200fc7a0 msgr2=0x7f93200fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:55.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.783+0000 7f932853e640 1 -- 172.21.15.81:0/3381356864 shutdown_connections 2024-09-12T01:27:55.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:55.783+0000 7f932853e640 1 -- 172.21.15.81:0/3381356864 wait complete. 2024-09-12T01:27:56.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:55 smithi100 ceph-mon[35275]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:56.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:55 smithi100 ceph-mon[35275]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T01:27:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:55 smithi189 ceph-mon[35357]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:27:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:55 smithi189 ceph-mon[35357]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T01:27:56.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T01:27:56.795 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.244+0000 7fefe2f02640 1 -- 172.21.15.81:0/1342209656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc102ef0 msgr2=0x7fefdc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.244+0000 7fefe2f02640 1 --2- 172.21.15.81:0/1342209656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc102ef0 0x7fefdc10da40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009ca0 tx=0x7fefd402a950 comp rx=0 tx=0).stop 2024-09-12T01:27:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.244+0000 7fefe2f02640 1 -- 172.21.15.81:0/1342209656 shutdown_connections 2024-09-12T01:27:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.244+0000 7fefe2f02640 1 --2- 172.21.15.81:0/1342209656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc102ef0 0x7fefdc10da40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.244+0000 7fefe2f02640 1 --2- 172.21.15.81:0/1342209656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefdc102570 0x7fefdc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.244+0000 7fefe2f02640 1 --2- 172.21.15.81:0/1342209656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefdc100e20 0x7fefdc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.244+0000 7fefe2f02640 1 -- 172.21.15.81:0/1342209656 >> 172.21.15.81:0/1342209656 conn(0x7fefdc0fc7d0 msgr2=0x7fefdc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.244+0000 7fefe2f02640 1 -- 172.21.15.81:0/1342209656 shutdown_connections 2024-09-12T01:27:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.244+0000 7fefe2f02640 1 -- 172.21.15.81:0/1342209656 wait complete. 2024-09-12T01:27:57.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe2f02640 1 Processor -- start 2024-09-12T01:27:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe2f02640 1 -- start start 2024-09-12T01:27:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe2f02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc100e20 0x7fefdc0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe2f02640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefdc102570 0x7fefdc0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe2f02640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefdc102ef0 0x7fefdc0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe2f02640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fefdc110fa0 con 0x7fefdc100e20 2024-09-12T01:27:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe2f02640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fefdc110e20 con 0x7fefdc102570 2024-09-12T01:27:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe2f02640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fefdc111120 con 0x7fefdc102ef0 2024-09-12T01:27:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe0c9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc100e20 0x7fefdc0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe0c9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc100e20 0x7fefdc0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45862/0 (socket says 172.21.15.81:45862) 2024-09-12T01:27:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe0c9e640 1 -- 172.21.15.81:0/614024553 learned_addr learned my addr 172.21.15.81:0/614024553 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefdbfff640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefdc102570 0x7fefdc0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe149f640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefdc102ef0 0x7fefdc0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe0c9e640 1 -- 172.21.15.81:0/614024553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefdc102ef0 msgr2=0x7fefdc0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe0c9e640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefdc102ef0 0x7fefdc0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe0c9e640 1 -- 172.21.15.81:0/614024553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefdc102570 msgr2=0x7fefdc0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe0c9e640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefdc102570 0x7fefdc0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe0c9e640 1 -- 172.21.15.81:0/614024553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefdc1a6a50 con 0x7fefdc100e20 2024-09-12T01:27:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe149f640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefdc102ef0 0x7fefdc0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.245+0000 7fefe0c9e640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc100e20 0x7fefdc0fcc80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fefd000b4a0 tx=0x7fefd000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.246+0000 7fefd9ffb640 1 -- 172.21.15.81:0/614024553 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd0014070 con 0x7fefdc100e20 2024-09-12T01:27:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.246+0000 7fefd9ffb640 1 -- 172.21.15.81:0/614024553 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd0010af0 con 0x7fefdc100e20 2024-09-12T01:27:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.246+0000 7fefe2f02640 1 -- 172.21.15.81:0/614024553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefdc1a6d40 con 0x7fefdc100e20 2024-09-12T01:27:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.246+0000 7fefd9ffb640 1 -- 172.21.15.81:0/614024553 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd0017d10 con 0x7fefdc100e20 2024-09-12T01:27:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.246+0000 7fefe2f02640 1 -- 172.21.15.81:0/614024553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefdc1a7220 con 0x7fefdc100e20 2024-09-12T01:27:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.248+0000 7fefd9ffb640 1 -- 172.21.15.81:0/614024553 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fefd0017070 con 0x7fefdc100e20 2024-09-12T01:27:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.248+0000 7fefe52db740 1 Processor -- start 2024-09-12T01:27:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.248+0000 7fefe52db740 1 -- start start 2024-09-12T01:27:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.248+0000 7fefd9ffb640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fefcc0a2b80 0x7fefcc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.248+0000 7fefe52db740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b49d0 0x55b7916b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefe52db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 0x55b7916bf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefe52db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916bfbb0 0x55b7916c1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefe52db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b79161b090 con 0x55b7916b52f0 2024-09-12T01:27:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefe52db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7915c2a70 con 0x55b7916bfbb0 2024-09-12T01:27:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefe52db740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b791617050 con 0x55b7916b49d0 2024-09-12T01:27:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefe149f640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fefcc0a2b80 0x7fefcc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefdbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 0x55b7916bf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefdbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 0x55b7916bf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45872/0 (socket says 172.21.15.81:45872) 2024-09-12T01:27:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefdbfff640 1 -- 172.21.15.81:0/3160462150 learned_addr learned my addr 172.21.15.81:0/3160462150 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefd9ffb640 1 -- 172.21.15.81:0/614024553 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fefd00ce3a0 con 0x7fefdc100e20 2024-09-12T01:27:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefe0c9e640 1 --2- 172.21.15.81:0/3160462150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b49d0 0x55b7916b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefe149f640 1 --2- 172.21.15.81:0/3160462150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916bfbb0 0x55b7916c1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefdbfff640 1 -- 172.21.15.81:0/3160462150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b49d0 msgr2=0x55b7916b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefdbfff640 1 --2- 172.21.15.81:0/3160462150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b49d0 0x55b7916b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefdbfff640 1 -- 172.21.15.81:0/3160462150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916bfbb0 msgr2=0x55b7916c1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefdbfff640 1 --2- 172.21.15.81:0/3160462150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916bfbb0 0x55b7916c1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefdbfff640 1 -- 172.21.15.81:0/3160462150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7915cf130 con 0x55b7916b52f0 2024-09-12T01:27:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefe149f640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fefcc0a2b80 0x7fefcc0a5040 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fefd4005e30 tx=0x7fefd402fa10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefdbfff640 1 --2- 172.21.15.81:0/3160462150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 0x55b7916bf670 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fefc800bc90 tx=0x7fefc80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ce31481ad26fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefc6ffd640 1 -- 172.21.15.81:0/3160462150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc8005220 con 0x55b7916b52f0 2024-09-12T01:27:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefc6ffd640 1 -- 172.21.15.81:0/3160462150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc800be40 con 0x55b7916b52f0 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.249+0000 7fefc6ffd640 1 -- 172.21.15.81:0/3160462150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc80116a0 con 0x55b7916b52f0 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.250+0000 7fefe52db740 1 -- 172.21.15.81:0/3160462150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 msgr2=0x55b7916bf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.250+0000 7fefe52db740 1 --2- 172.21.15.81:0/3160462150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 0x55b7916bf670 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fefc800bc90 tx=0x7fefc80107a0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.250+0000 7fefe52db740 1 -- 172.21.15.81:0/3160462150 shutdown_connections 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.250+0000 7fefe52db740 1 --2- 172.21.15.81:0/3160462150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916bfbb0 0x55b7916c1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.250+0000 7fefe52db740 1 --2- 172.21.15.81:0/3160462150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 0x55b7916bf670 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.250+0000 7fefe52db740 1 --2- 172.21.15.81:0/3160462150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b49d0 0x55b7916b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.250+0000 7fefe52db740 1 -- 172.21.15.81:0/3160462150 >> 172.21.15.81:0/3160462150 conn(0x55b7916b0f60 msgr2=0x55b7916b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.250+0000 7fefe52db740 1 -- 172.21.15.81:0/3160462150 shutdown_connections 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.250+0000 7fefe52db740 1 -- 172.21.15.81:0/3160462150 wait complete. 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.250+0000 7fefe52db740 1 -- start start 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe52db740 1 Processor -- start 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe52db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b49d0 0x55b7916bf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe52db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916b52f0 0x55b7916bc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe52db740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916bfbb0 0x55b7916bcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe52db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7916c2780 con 0x55b7916b49d0 2024-09-12T01:27:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe52db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7915d5f20 con 0x55b7916b52f0 2024-09-12T01:27:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe52db740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7916c2900 con 0x55b7916bfbb0 2024-09-12T01:27:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe52db740 10 client.0 _ll_register_callbacks cb 0x55b79159f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe0c9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b49d0 0x55b7916bf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe0c9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b49d0 0x55b7916bf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45882/0 (socket says 172.21.15.81:45882) 2024-09-12T01:27:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe0c9e640 1 -- 172.21.15.81:0/3917652038 learned_addr learned my addr 172.21.15.81:0/3917652038 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe149f640 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916bfbb0 0x55b7916bcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefdbfff640 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916b52f0 0x55b7916bc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe0c9e640 1 -- 172.21.15.81:0/3917652038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916bfbb0 msgr2=0x55b7916bcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe0c9e640 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916bfbb0 0x55b7916bcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe0c9e640 1 -- 172.21.15.81:0/3917652038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916b52f0 msgr2=0x55b7916bc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe0c9e640 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916b52f0 0x55b7916bc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefe0c9e640 1 -- 172.21.15.81:0/3917652038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b79138c2b0 con 0x55b7916b49d0 2024-09-12T01:27:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.251+0000 7fefdbfff640 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916b52f0 0x55b7916bc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefe0c9e640 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b49d0 0x55b7916bf370 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fefd00975e0 tx=0x7fefd009a850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6480a839e347bc74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefbbfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefbbfff640 1 -- 172.21.15.81:0/3917652038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd001e070 con 0x55b7916b49d0 2024-09-12T01:27:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefbbfff640 1 -- 172.21.15.81:0/3917652038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fefd00bc0b0 con 0x55b7916b49d0 2024-09-12T01:27:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefe52db740 1 -- 172.21.15.81:0/3917652038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b791628600 con 0x55b7916b49d0 2024-09-12T01:27:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefbbfff640 1 -- 172.21.15.81:0/3917652038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fefd009efc0 con 0x55b7916b49d0 2024-09-12T01:27:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefe52db740 10 client.15192 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefe52db740 1 -- 172.21.15.81:0/3917652038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b7916ce010 con 0x55b7916b49d0 2024-09-12T01:27:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefbbfff640 1 -- 172.21.15.81:0/3917652038 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b791628600 con 0x55b7916b49d0 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefbbfff640 1 -- 172.21.15.81:0/3917652038 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fefd0097280 con 0x55b7916b49d0 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefe52db740 10 client.15192 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefe52db740 10 client.15192 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefe52db740 20 client.15192 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefe52db740 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7916d06f0 0x55b7916d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefe52db740 4 client.15192 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.252+0000 7fefe52db740 1 -- 172.21.15.81:0/3917652038 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b791622b10 con 0x55b7916d06f0 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.253+0000 7fefdbfff640 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7916d06f0 0x55b7916d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.253+0000 7fefbbfff640 10 client.15192 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.253+0000 7fefdbfff640 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7916d06f0 0x55b7916d1b60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9f35afa87e9ebf6 server_cookie=3bf908b345711f34 in_seq=0 out_seq=0 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefbbfff640 1 -- 172.21.15.81:0/3917652038 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b791622b10 con 0x55b7916d06f0 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefbbfff640 10 client.15192 handle_command_reply: tid=0 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefe52db740 1 client.15192 shutdown 2024-09-12T01:27:57.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefe52db740 1 -- 172.21.15.81:0/3917652038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b49d0 msgr2=0x55b7916bf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:57.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefe52db740 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b49d0 0x55b7916bf370 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fefd00975e0 tx=0x7fefd009a850 comp rx=0 tx=0).stop 2024-09-12T01:27:57.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefe52db740 1 -- 172.21.15.81:0/3917652038 shutdown_connections 2024-09-12T01:27:57.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefe52db740 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7916d06f0 0x55b7916d1b60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefe52db740 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916bfbb0 0x55b7916bcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefe52db740 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916b52f0 0x55b7916bc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefe52db740 1 --2- 172.21.15.81:0/3917652038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b49d0 0x55b7916bf370 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefbbfff640 0 client.15192 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:27:57.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefe52db740 1 -- 172.21.15.81:0/3917652038 >> 172.21.15.81:0/3917652038 conn(0x55b7916b0f60 msgr2=0x55b7916b6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:57.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefe52db740 1 -- 172.21.15.81:0/3917652038 shutdown_connections 2024-09-12T01:27:57.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefe52db740 1 -- 172.21.15.81:0/3917652038 wait complete. 2024-09-12T01:27:57.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.254+0000 7fefe52db740 20 client.15192 trim_cache size 0 max 16384 2024-09-12T01:27:57.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.272+0000 7fefe52db740 1 Processor -- start 2024-09-12T01:27:57.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.272+0000 7fefe52db740 1 -- start start 2024-09-12T01:27:57.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.272+0000 7fefe52db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916b49d0 0x55b7916d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.272+0000 7fefe52db740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b52f0 0x55b7916d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.272+0000 7fefe52db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916bfbb0 0x55b7916b9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.272+0000 7fefe52db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7916cfea0 con 0x55b7916bfbb0 2024-09-12T01:27:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.272+0000 7fefe52db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7916d0570 con 0x55b7916b49d0 2024-09-12T01:27:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.272+0000 7fefe52db740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7916d0c40 con 0x55b7916b52f0 2024-09-12T01:27:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefe149f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916bfbb0 0x55b7916b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefe149f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916bfbb0 0x55b7916b9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45886/0 (socket says 172.21.15.81:45886) 2024-09-12T01:27:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefe149f640 1 -- 172.21.15.81:0/2955315420 learned_addr learned my addr 172.21.15.81:0/2955315420 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefe0c9e640 1 --2- 172.21.15.81:0/2955315420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916b49d0 0x55b7916d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefdbfff640 1 --2- 172.21.15.81:0/2955315420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b52f0 0x55b7916d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefe149f640 1 -- 172.21.15.81:0/2955315420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b52f0 msgr2=0x55b7916d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefe149f640 1 --2- 172.21.15.81:0/2955315420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b52f0 0x55b7916d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefe149f640 1 -- 172.21.15.81:0/2955315420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916b49d0 msgr2=0x55b7916d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefe149f640 1 --2- 172.21.15.81:0/2955315420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916b49d0 0x55b7916d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefe149f640 1 -- 172.21.15.81:0/2955315420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7916b5120 con 0x55b7916bfbb0 2024-09-12T01:27:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefe149f640 1 --2- 172.21.15.81:0/2955315420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916bfbb0 0x55b7916b9940 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fefd4005c20 tx=0x7fefd4005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2d2f04ba21f3a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefc67fc640 1 -- 172.21.15.81:0/2955315420 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd404d070 con 0x55b7916bfbb0 2024-09-12T01:27:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefc67fc640 1 -- 172.21.15.81:0/2955315420 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd4003e50 con 0x55b7916bfbb0 2024-09-12T01:27:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.273+0000 7fefc67fc640 1 -- 172.21.15.81:0/2955315420 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd4034050 con 0x55b7916bfbb0 2024-09-12T01:27:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.274+0000 7fefe52db740 1 -- 172.21.15.81:0/2955315420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916bfbb0 msgr2=0x55b7916b9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.274+0000 7fefe52db740 1 --2- 172.21.15.81:0/2955315420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916bfbb0 0x55b7916b9940 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fefd4005c20 tx=0x7fefd4005d80 comp rx=0 tx=0).stop 2024-09-12T01:27:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.274+0000 7fefe52db740 1 -- 172.21.15.81:0/2955315420 shutdown_connections 2024-09-12T01:27:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.274+0000 7fefe52db740 1 --2- 172.21.15.81:0/2955315420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916bfbb0 0x55b7916b9940 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.274+0000 7fefe52db740 1 --2- 172.21.15.81:0/2955315420 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b52f0 0x55b7916d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.274+0000 7fefe52db740 1 --2- 172.21.15.81:0/2955315420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916b49d0 0x55b7916d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.274+0000 7fefe52db740 1 -- 172.21.15.81:0/2955315420 >> 172.21.15.81:0/2955315420 conn(0x55b7916b0f60 msgr2=0x55b7916abce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.274+0000 7fefe52db740 1 -- 172.21.15.81:0/2955315420 shutdown_connections 2024-09-12T01:27:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.274+0000 7fefe52db740 1 -- 172.21.15.81:0/2955315420 wait complete. 2024-09-12T01:27:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.274+0000 7fefe52db740 1 -- start start 2024-09-12T01:27:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.274+0000 7fefe52db740 1 Processor -- start 2024-09-12T01:27:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefe52db740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b49d0 0x55b7916d9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefe52db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 0x55b7916da500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefe52db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916bfbb0 0x55b7916d3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefe52db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7916d19e0 con 0x55b7916b52f0 2024-09-12T01:27:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefe52db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7916d1310 con 0x55b7916bfbb0 2024-09-12T01:27:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefe52db740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7916d20b0 con 0x55b7916b49d0 2024-09-12T01:27:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefe52db740 10 client.0 _ll_register_callbacks cb 0x7fefd0017ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:27:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefdbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 0x55b7916da500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefdbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 0x55b7916da500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45900/0 (socket says 172.21.15.81:45900) 2024-09-12T01:27:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefdbfff640 1 -- 172.21.15.81:0/3877048517 learned_addr learned my addr 172.21.15.81:0/3877048517 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefe149f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916bfbb0 0x55b7916d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefe0c9e640 1 --2- 172.21.15.81:0/3877048517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b49d0 0x55b7916d9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefdbfff640 1 -- 172.21.15.81:0/3877048517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b49d0 msgr2=0x55b7916d9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefdbfff640 1 --2- 172.21.15.81:0/3877048517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b49d0 0x55b7916d9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefdbfff640 1 -- 172.21.15.81:0/3877048517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916bfbb0 msgr2=0x55b7916d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:27:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefdbfff640 1 --2- 172.21.15.81:0/3877048517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916bfbb0 0x55b7916d3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefdbfff640 1 -- 172.21.15.81:0/3877048517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7916d3b50 con 0x55b7916b52f0 2024-09-12T01:27:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefdbfff640 1 --2- 172.21.15.81:0/3877048517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 0x55b7916da500 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fefc8005d00 tx=0x7fefc8010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c693c7a905ecb5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefbbfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:27:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefbbfff640 1 -- 172.21.15.81:0/3877048517 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc802f020 con 0x55b7916b52f0 2024-09-12T01:27:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.276+0000 7fefe52db740 1 -- 172.21.15.81:0/3877048517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefd4003e50 con 0x55b7916b52f0 2024-09-12T01:27:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.275+0000 7fefbbfff640 1 -- 172.21.15.81:0/3877048517 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fefc8005240 con 0x55b7916b52f0 2024-09-12T01:27:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.276+0000 7fefbbfff640 1 -- 172.21.15.81:0/3877048517 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fefc8005440 con 0x55b7916b52f0 2024-09-12T01:27:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.276+0000 7fefe52db740 10 client.15198 fetch_fsmap learned FSMap version 27 2024-09-12T01:27:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.276+0000 7fefe52db740 1 -- 172.21.15.81:0/3877048517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b7916d85c0 con 0x55b7916b52f0 2024-09-12T01:27:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.276+0000 7fefbbfff640 1 -- 172.21.15.81:0/3877048517 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd4003e50 con 0x55b7916b52f0 2024-09-12T01:27:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.276+0000 7fefbbfff640 1 -- 172.21.15.81:0/3877048517 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fefc802a700 con 0x55b7916b52f0 2024-09-12T01:27:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.276+0000 7fefe52db740 10 client.15198 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:27:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.276+0000 7fefe52db740 10 client.15198 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:27:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.276+0000 7fefe52db740 20 client.15198 populate_metadata read hostname 'smithi081' 2024-09-12T01:27:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.276+0000 7fefe52db740 1 --2- 172.21.15.81:0/3877048517 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b79173f160 0x55b79173de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.276+0000 7fefe52db740 4 client.15198 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:27:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.276+0000 7fefe52db740 1 -- 172.21.15.81:0/3877048517 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "status"}) -- 0x55b79159f0e0 con 0x55b79173f160 2024-09-12T01:27:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.276+0000 7fefe0c9e640 1 --2- 172.21.15.81:0/3877048517 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b79173f160 0x55b79173de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefbbfff640 10 client.15198 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:27:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefe0c9e640 1 --2- 172.21.15.81:0/3877048517 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b79173f160 0x55b79173de70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9c86e1164462507 server_cookie=f62f8b11fdec37dd in_seq=0 out_seq=0 2024-09-12T01:27:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefbbfff640 1 -- 172.21.15.81:0/3877048517 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b79159f0e0 con 0x55b79173f160 2024-09-12T01:27:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefbbfff640 10 client.15198 handle_command_reply: tid=0 2024-09-12T01:27:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefe52db740 1 client.15198 shutdown 2024-09-12T01:27:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefe52db740 1 -- 172.21.15.81:0/3877048517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 msgr2=0x55b7916da500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefe52db740 1 --2- 172.21.15.81:0/3877048517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 0x55b7916da500 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fefc8005d00 tx=0x7fefc8010d50 comp rx=0 tx=0).stop 2024-09-12T01:27:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefe52db740 1 -- 172.21.15.81:0/3877048517 shutdown_connections 2024-09-12T01:27:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefe52db740 1 --2- 172.21.15.81:0/3877048517 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b79173f160 0x55b79173de70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefe52db740 1 --2- 172.21.15.81:0/3877048517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7916bfbb0 0x55b7916d3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefe52db740 1 --2- 172.21.15.81:0/3877048517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7916b52f0 0x55b7916da500 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefe52db740 1 --2- 172.21.15.81:0/3877048517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7916b49d0 0x55b7916d9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefbbfff640 0 client.15198 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:27:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefe52db740 1 -- 172.21.15.81:0/3877048517 >> 172.21.15.81:0/3877048517 conn(0x55b7916b0f60 msgr2=0x55b7916af800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefe52db740 1 -- 172.21.15.81:0/3877048517 shutdown_connections 2024-09-12T01:27:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefe52db740 1 -- 172.21.15.81:0/3877048517 wait complete. 2024-09-12T01:27:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.277+0000 7fefe52db740 20 client.15198 trim_cache size 0 max 16384 2024-09-12T01:27:57.284 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:27:57.284 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:27:57.284 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-12T01:27:57.284 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24473, 2024-09-12T01:27:57.284 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:27:57.285 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:27:57.285 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:27:57.285 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 101.842850059, 2024-09-12T01:27:57.285 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T01:27:57.285 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-12T01:27:57.285 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:27:57.285 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 112.72410525799999 2024-09-12T01:27:57.285 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:27:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.278+0000 7fefe2f02640 1 -- 172.21.15.81:0/614024553 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fefcc0a2b80 msgr2=0x7fefcc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.278+0000 7fefe2f02640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fefcc0a2b80 0x7fefcc0a5040 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fefd4005e30 tx=0x7fefd402fa10 comp rx=0 tx=0).stop 2024-09-12T01:27:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.278+0000 7fefe2f02640 1 -- 172.21.15.81:0/614024553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc100e20 msgr2=0x7fefdc0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.278+0000 7fefe2f02640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc100e20 0x7fefdc0fcc80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fefd000b4a0 tx=0x7fefd000b960 comp rx=0 tx=0).stop 2024-09-12T01:27:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.278+0000 7fefe2f02640 1 -- 172.21.15.81:0/614024553 shutdown_connections 2024-09-12T01:27:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.278+0000 7fefe2f02640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fefcc0a2b80 0x7fefcc0a5040 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.278+0000 7fefe2f02640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefdc102ef0 0x7fefdc0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.278+0000 7fefe2f02640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefdc102570 0x7fefdc0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.278+0000 7fefe2f02640 1 --2- 172.21.15.81:0/614024553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefdc100e20 0x7fefdc0fcc80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.278+0000 7fefe2f02640 1 -- 172.21.15.81:0/614024553 >> 172.21.15.81:0/614024553 conn(0x7fefdc0fc7d0 msgr2=0x7fefdc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.278+0000 7fefe2f02640 1 -- 172.21.15.81:0/614024553 shutdown_connections 2024-09-12T01:27:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:57.278+0000 7fefe2f02640 1 -- 172.21.15.81:0/614024553 wait complete. 2024-09-12T01:27:57.897 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:57 smithi081 ceph-mon[30920]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T01:27:57.938 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T01:27:57.948 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T01:27:57.948 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T01:27:57.948 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T01:27:57.949 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-12T01:27:57.949 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T01:27:57.950 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T01:27:57.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-12T01:27:58.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:57 smithi100 ceph-mon[35275]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T01:27:58.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:57 smithi189 ceph-mon[35357]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T01:27:58.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.054+0000 7fb80694b640 1 -- 172.21.15.81:0/2616011563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8001016d0 msgr2=0x7fb800108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:58.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.054+0000 7fb80694b640 1 --2- 172.21.15.81:0/2616011563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8001016d0 0x7fb800108f70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009ca0 tx=0x7fb7f802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:27:58.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.054+0000 7fb80694b640 1 -- 172.21.15.81:0/2616011563 shutdown_connections 2024-09-12T01:27:58.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.054+0000 7fb80694b640 1 --2- 172.21.15.81:0/2616011563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8001016d0 0x7fb800108f70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:58.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.054+0000 7fb80694b640 1 --2- 172.21.15.81:0/2616011563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb800100d10 0x7fb800101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.054+0000 7fb80694b640 1 --2- 172.21.15.81:0/2616011563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb800101fe0 0x7fb8001023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.054+0000 7fb80694b640 1 -- 172.21.15.81:0/2616011563 >> 172.21.15.81:0/2616011563 conn(0x7fb8000fb970 msgr2=0x7fb8000fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.054+0000 7fb80694b640 1 -- 172.21.15.81:0/2616011563 shutdown_connections 2024-09-12T01:27:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.054+0000 7fb80694b640 1 -- 172.21.15.81:0/2616011563 wait complete. 2024-09-12T01:27:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.054+0000 7fb80694b640 1 Processor -- start 2024-09-12T01:27:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.054+0000 7fb80694b640 1 -- start start 2024-09-12T01:27:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb80694b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb800100d10 0x7fb800100770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb80694b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8001016d0 0x7fb80019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb80694b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb800101fe0 0x7fb80019f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb80694b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb80010c7e0 con 0x7fb800100d10 2024-09-12T01:27:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb80694b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb80010c660 con 0x7fb800101fe0 2024-09-12T01:27:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb80694b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb80010c960 con 0x7fb8001016d0 2024-09-12T01:27:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb7fffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb800100d10 0x7fb800100770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb7fffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb800100d10 0x7fb800100770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45926/0 (socket says 172.21.15.81:45926) 2024-09-12T01:27:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb7fffff640 1 -- 172.21.15.81:0/1845760417 learned_addr learned my addr 172.21.15.81:0/1845760417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb804ee8640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb800101fe0 0x7fb80019f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb7fffff640 1 -- 172.21.15.81:0/1845760417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8001016d0 msgr2=0x7fb80019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb7fffff640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8001016d0 0x7fb80019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb7fffff640 1 -- 172.21.15.81:0/1845760417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb800101fe0 msgr2=0x7fb80019f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb7fffff640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb800101fe0 0x7fb80019f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb7fffff640 1 -- 172.21.15.81:0/1845760417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80019fb30 con 0x7fb800100d10 2024-09-12T01:27:58.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb804ee8640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb800101fe0 0x7fb80019f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:27:58.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb7fffff640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb800100d10 0x7fb800100770 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000b450 tx=0x7fb7f000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:58.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb7fdffb640 1 -- 172.21.15.81:0/1845760417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0015020 con 0x7fb800100d10 2024-09-12T01:27:58.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb7fdffb640 1 -- 172.21.15.81:0/1845760417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7f0011d70 con 0x7fb800100d10 2024-09-12T01:27:58.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb80694b640 1 -- 172.21.15.81:0/1845760417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80019fdc0 con 0x7fb800100d10 2024-09-12T01:27:58.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb7fdffb640 1 -- 172.21.15.81:0/1845760417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000f340 con 0x7fb800100d10 2024-09-12T01:27:58.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.055+0000 7fb80694b640 1 -- 172.21.15.81:0/1845760417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8001a0300 con 0x7fb800100d10 2024-09-12T01:27:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.056+0000 7fb80694b640 1 -- 172.21.15.81:0/1845760417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb800107e50 con 0x7fb800100d10 2024-09-12T01:27:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.057+0000 7fb7fdffb640 1 -- 172.21.15.81:0/1845760417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb7f0018020 con 0x7fb800100d10 2024-09-12T01:27:58.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.058+0000 7fb7fdffb640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb7ec0a2cb0 0x7fb7ec0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:58.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.058+0000 7fb7f7fff640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb7ec0a2cb0 0x7fb7ec0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:58.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.058+0000 7fb7fdffb640 1 -- 172.21.15.81:0/1845760417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb7f00ceb30 con 0x7fb800100d10 2024-09-12T01:27:58.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.058+0000 7fb7f7fff640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb7ec0a2cb0 0x7fb7ec0a5170 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb8001004e0 tx=0x7fb7e8006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:58.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.062+0000 7fb7fdffb640 1 -- 172.21.15.81:0/1845760417 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb7f001f020 con 0x7fb800100d10 2024-09-12T01:27:58.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.274+0000 7fb80694b640 1 -- 172.21.15.81:0/1845760417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fb800062df0 con 0x7fb800100d10 2024-09-12T01:27:58.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.597+0000 7fb7fdffb640 1 -- 172.21.15.81:0/1845760417 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7fb7f000d040 con 0x7fb800100d10 2024-09-12T01:27:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.600+0000 7fb80694b640 1 -- 172.21.15.81:0/1845760417 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb7ec0a2cb0 msgr2=0x7fb7ec0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.600+0000 7fb80694b640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb7ec0a2cb0 0x7fb7ec0a5170 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb8001004e0 tx=0x7fb7e8006c90 comp rx=0 tx=0).stop 2024-09-12T01:27:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.600+0000 7fb80694b640 1 -- 172.21.15.81:0/1845760417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb800100d10 msgr2=0x7fb800100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.600+0000 7fb80694b640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb800100d10 0x7fb800100770 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000b450 tx=0x7fb7f000b910 comp rx=0 tx=0).stop 2024-09-12T01:27:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.600+0000 7fb80694b640 1 -- 172.21.15.81:0/1845760417 shutdown_connections 2024-09-12T01:27:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.600+0000 7fb80694b640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7fb7ec0a2cb0 0x7fb7ec0a5170 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.600+0000 7fb80694b640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb800101fe0 0x7fb80019f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.600+0000 7fb80694b640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8001016d0 0x7fb80019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.600+0000 7fb80694b640 1 --2- 172.21.15.81:0/1845760417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb800100d10 0x7fb800100770 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.600+0000 7fb80694b640 1 -- 172.21.15.81:0/1845760417 >> 172.21.15.81:0/1845760417 conn(0x7fb8000fb970 msgr2=0x7fb800105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.600+0000 7fb80694b640 1 -- 172.21.15.81:0/1845760417 shutdown_connections 2024-09-12T01:27:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:58.600+0000 7fb80694b640 1 -- 172.21.15.81:0/1845760417 wait complete. 2024-09-12T01:27:58.618 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T01:27:58.644 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T01:27:58.644 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T01:27:58.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:27:58.644 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-12T01:27:58.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:27:58.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-12T01:27:58.729 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-09-12T01:27:58.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:27:58.731 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-12T01:27:58.732 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:27:58.732 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:27:58.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T01:27:58.950 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:58 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1845760417' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T01:27:58.951 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:27:58 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: ignoring --setuser ceph since I am not root 2024-09-12T01:27:58.951 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:27:58 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: ignoring --setgroup ceph since I am not root 2024-09-12T01:27:58.951 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:27:58 smithi100 ceph-mgr[36644]: -- 172.21.15.100:0/2524369655 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c1eb6c30e0 con 0x55c1eb6a1000 2024-09-12T01:27:58.951 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:27:58 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:27:58.746+0000 7f9687b99040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:27:58.951 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:27:58 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:27:58.804+0000 7f9687b99040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:27:58.951 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:27:58 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:27:58.951+0000 7f9687b99040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:27:58.959 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:58 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1845760417' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T01:27:58.959 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:27:58 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: ignoring --setuser ceph since I am not root 2024-09-12T01:27:58.959 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:27:58 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: ignoring --setgroup ceph since I am not root 2024-09-12T01:27:58.959 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:27:58 smithi189 ceph-mgr[37171]: -- 172.21.15.189:0/3604423938 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5573e36c90e0 con 0x5573e36a7000 2024-09-12T01:27:58.959 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:27:58 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:27:58.753+0000 7fd2c2431040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:27:58.959 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:27:58 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:27:58.810+0000 7fd2c2431040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:27:58.959 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:27:58 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:27:58.960+0000 7fd2c2431040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:27:58.970 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:58 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1845760417' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T01:27:58.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:27:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: ignoring --setuser ceph since I am not root 2024-09-12T01:27:58.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:27:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: ignoring --setgroup ceph since I am not root 2024-09-12T01:27:58.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:27:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:27:58.755+0000 7ff082642040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:27:58.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:27:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:27:58.815+0000 7ff082642040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:27:58.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:27:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:27:58.971+0000 7ff082642040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:27:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:27:59.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:27:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:27:59.049+0000 7ff082642040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:27:59.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:27:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:27:59.201+0000 7ff082642040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:27:59.268 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:27:59 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:27:59.017+0000 7f9687b99040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:27:59.269 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:27:59 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:27:59.162+0000 7f9687b99040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:27:59.281 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:27:59 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:27:59.026+0000 7fd2c2431040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:27:59.282 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:27:59 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:27:59.172+0000 7fd2c2431040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:27:59.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.504+0000 7f60e7a22640 1 -- 172.21.15.81:0/3240457020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60e0102ef0 msgr2=0x7f60e010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:59.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.504+0000 7f60e7a22640 1 --2- 172.21.15.81:0/3240457020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60e0102ef0 0x7f60e010da40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009ca0 tx=0x7f60d802a950 comp rx=0 tx=0).stop 2024-09-12T01:27:59.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.504+0000 7f60e7a22640 1 -- 172.21.15.81:0/3240457020 shutdown_connections 2024-09-12T01:27:59.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.504+0000 7f60e7a22640 1 --2- 172.21.15.81:0/3240457020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60e0102ef0 0x7f60e010da40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.504+0000 7f60e7a22640 1 --2- 172.21.15.81:0/3240457020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60e0102570 0x7f60e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.504+0000 7f60e7a22640 1 --2- 172.21.15.81:0/3240457020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60e0100e20 0x7f60e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.504+0000 7f60e7a22640 1 -- 172.21.15.81:0/3240457020 >> 172.21.15.81:0/3240457020 conn(0x7f60e00fc7d0 msgr2=0x7f60e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.504+0000 7f60e7a22640 1 -- 172.21.15.81:0/3240457020 shutdown_connections 2024-09-12T01:27:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.504+0000 7f60e7a22640 1 -- 172.21.15.81:0/3240457020 wait complete. 2024-09-12T01:27:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.504+0000 7f60e7a22640 1 Processor -- start 2024-09-12T01:27:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.504+0000 7f60e7a22640 1 -- start start 2024-09-12T01:27:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e7a22640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60e0100e20 0x7f60e01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e7a22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60e0102570 0x7f60e0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e7a22640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60e0102ef0 0x7f60e019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e7a22640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60e0110f80 con 0x7f60e0100e20 2024-09-12T01:27:59.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e7a22640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f60e0110e00 con 0x7f60e0102570 2024-09-12T01:27:59.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e7a22640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f60e0111100 con 0x7f60e0102ef0 2024-09-12T01:27:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e57be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60e0100e20 0x7f60e01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e5fbf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60e0102ef0 0x7f60e019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e5fbf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60e0102ef0 0x7f60e019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.81:57324/0 (socket says 172.21.15.81:57324) 2024-09-12T01:27:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e5fbf640 1 -- 172.21.15.81:0/2314520772 learned_addr learned my addr 172.21.15.81:0/2314520772 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:27:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e57be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60e0100e20 0x7f60e01983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45984/0 (socket says 172.21.15.81:45984) 2024-09-12T01:27:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e4fbd640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60e0102570 0x7f60e0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:27:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e57be640 1 -- 172.21.15.81:0/2314520772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60e0102ef0 msgr2=0x7f60e019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e57be640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60e0102ef0 0x7f60e019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e57be640 1 -- 172.21.15.81:0/2314520772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60e0102570 msgr2=0x7f60e0198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e57be640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60e0102570 0x7f60e0198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e57be640 1 -- 172.21.15.81:0/2314520772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e019d380 con 0x7f60e0100e20 2024-09-12T01:27:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e5fbf640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60e0102ef0 0x7f60e019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:27:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.505+0000 7f60e57be640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60e0100e20 0x7f60e01983d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00c970 tx=0x7f60dc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:27:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.506+0000 7f60d67fc640 1 -- 172.21.15.81:0/2314520772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc007bb0 con 0x7f60e0100e20 2024-09-12T01:27:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.506+0000 7f60d67fc640 1 -- 172.21.15.81:0/2314520772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60dc007d50 con 0x7f60e0100e20 2024-09-12T01:27:59.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.506+0000 7f60e7a22640 1 -- 172.21.15.81:0/2314520772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e019d670 con 0x7f60e0100e20 2024-09-12T01:27:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.506+0000 7f60d67fc640 1 -- 172.21.15.81:0/2314520772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc018820 con 0x7f60e0100e20 2024-09-12T01:27:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.506+0000 7f60e7a22640 1 -- 172.21.15.81:0/2314520772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e01a4f50 con 0x7f60e0100e20 2024-09-12T01:27:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.507+0000 7f60e7a22640 1 -- 172.21.15.81:0/2314520772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e0101200 con 0x7f60e0100e20 2024-09-12T01:27:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.508+0000 7f60d67fc640 1 -- 172.21.15.81:0/2314520772 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f60dc0189c0 con 0x7f60e0100e20 2024-09-12T01:27:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.509+0000 7f60d67fc640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f60cc0a2bd0 0x7f60cc0a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:27:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.509+0000 7f60e4fbd640 1 -- 172.21.15.81:0/2314520772 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f60cc0a2bd0 msgr2=0x7f60cc0a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2591597081 2024-09-12T01:27:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.509+0000 7f60d67fc640 1 -- 172.21.15.81:0/2314520772 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f60dc0cf300 con 0x7f60e0100e20 2024-09-12T01:27:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.509+0000 7f60e4fbd640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f60cc0a2bd0 0x7f60cc0a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:27:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.512+0000 7f60d67fc640 1 -- 172.21.15.81:0/2314520772 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60dc014030 con 0x7f60e0100e20 2024-09-12T01:27:59.600 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:27:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:27:59.349+0000 7ff082642040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:27:59.600 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:27:59 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:27:59.315+0000 7fd2c2431040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:27:59.601 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:27:59 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:27:59.304+0000 7f9687b99040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:27:59.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.710+0000 7f60e4fbd640 1 -- 172.21.15.81:0/2314520772 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f60cc0a2bd0 msgr2=0x7f60cc0a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2591597081 2024-09-12T01:27:59.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.710+0000 7f60e4fbd640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f60cc0a2bd0 0x7f60cc0a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:27:59.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.723+0000 7f60e7a22640 1 -- 172.21.15.81:0/2314520772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f60e010a0a0 con 0x7f60e0100e20 2024-09-12T01:27:59.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.723+0000 7f60d67fc640 1 -- 172.21.15.81:0/2314520772 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f60dc09c300 con 0x7f60e0100e20 2024-09-12T01:27:59.723 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:27:59.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.726+0000 7f60e7a22640 1 -- 172.21.15.81:0/2314520772 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f60cc0a2bd0 msgr2=0x7f60cc0a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:27:59.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.726+0000 7f60e7a22640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f60cc0a2bd0 0x7f60cc0a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:59.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.726+0000 7f60e7a22640 1 -- 172.21.15.81:0/2314520772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60e0100e20 msgr2=0x7f60e01983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:27:59.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.726+0000 7f60e7a22640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60e0100e20 0x7f60e01983d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00c970 tx=0x7f60dc00ce30 comp rx=0 tx=0).stop 2024-09-12T01:27:59.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.726+0000 7f60e7a22640 1 -- 172.21.15.81:0/2314520772 shutdown_connections 2024-09-12T01:27:59.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.726+0000 7f60e7a22640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f60cc0a2bd0 0x7f60cc0a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:59.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.726+0000 7f60e7a22640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60e0102ef0 0x7f60e019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:59.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.726+0000 7f60e7a22640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60e0102570 0x7f60e0198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:59.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.726+0000 7f60e7a22640 1 --2- 172.21.15.81:0/2314520772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60e0100e20 0x7f60e01983d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:27:59.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.726+0000 7f60e7a22640 1 -- 172.21.15.81:0/2314520772 >> 172.21.15.81:0/2314520772 conn(0x7f60e00fc7d0 msgr2=0x7f60e006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:27:59.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.726+0000 7f60e7a22640 1 -- 172.21.15.81:0/2314520772 shutdown_connections 2024-09-12T01:27:59.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:27:59.726+0000 7f60e7a22640 1 -- 172.21.15.81:0/2314520772 wait complete. 2024-09-12T01:27:59.861 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:59 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1845760417' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T01:27:59.861 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:27:59 smithi100 ceph-mon[35275]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-12T01:27:59.861 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:27:59 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:27:59.618+0000 7f9687b99040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:27:59.861 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:27:59 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:27:59.678+0000 7f9687b99040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:27:59.861 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:27:59 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:27:59.860+0000 7f9687b99040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:27:59.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:59 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1845760417' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T01:27:59.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:27:59 smithi189 ceph-mon[35357]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-12T01:27:59.876 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:27:59 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:27:59.632+0000 7fd2c2431040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:27:59.876 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:27:59 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:27:59.692+0000 7fd2c2431040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:27:59.929 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:59 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1845760417' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T01:27:59.930 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:27:59 smithi081 ceph-mon[30920]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-12T01:27:59.930 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:27:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:27:59.677+0000 7ff082642040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:27:59.930 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:27:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:27:59.742+0000 7ff082642040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:28:00.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:27:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:27:59.930+0000 7ff082642040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:28:00.282 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:27:59 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:27:59.876+0000 7fd2c2431040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:28:00.364 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:28:00.364 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:28:00.364 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-12T01:28:00.364 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:28:00.364 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:28:00.365 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:28:00.365 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:28:00.365 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:28:00.365 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:28:00.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:28:00.365 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-12T01:28:00.381 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:28:00.381 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:28:00.381 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:28:00.381 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:28:00.381 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-12T01:28:00.381 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:28:00.381 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:28:00.381 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:28:00.381 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-12T01:28:00.381 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:28:00.381 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:28:00.381 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-12T01:28:00.381 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:28:00.382 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:28:00.382 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:28:00.382 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:28:00.382 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:28:00.382 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42187sec preferred_lft 42187sec 2024-09-12T01:28:00.382 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-12T01:28:00.382 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:28:00.382 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T01:28:00.383 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:28:00.383 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-12T01:28:00.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-12T01:28:00.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-12T01:28:00.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-12T01:28:00.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T01:28:00.383 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-12T01:28:00.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:28:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:28:00.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:28:00.591 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:28:00.616 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-12T01:28:00.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:28:00.618 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-12T01:28:00.686 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-12T01:28:00.686 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:28:00.686 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:28:00.686 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:28:00.686 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:28:00.687 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:28:00.687 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-12T01:28:00.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:28:00.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:28:00.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:28:00.687 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-12T01:28:00.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:28:00.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:00 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2314520772' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:28:00.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:28:00.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:28:00.981 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-12T01:28:00.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:28:00.996 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-12T01:28:01.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:00 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2314520772' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:28:01.018 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:00 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:00.744+0000 7f9687b99040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:28:01.019 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:00 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:00.810+0000 7f9687b99040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:28:01.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:00 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2314520772' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:28:01.032 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:00 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:00.761+0000 7fd2c2431040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:28:01.032 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:00 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:00.828+0000 7fd2c2431040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:28:01.052 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:28:01.052 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-12T01:28:01.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:28:01.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T01:28:01.052 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-12T01:28:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:28:01.149 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:00.861+0000 7ff082642040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:28:01.149 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:00.934+0000 7ff082642040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:28:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:28:01.171 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T01:28:01.171 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:28:01.171 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-12T01:28:01.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T01:28:01.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T01:28:01.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T01:28:01.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T01:28:01.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T01:28:01.172 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-12T01:28:01.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:28:01.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:28:01.298 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:28:01.299 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-12T01:28:01.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-12T01:28:01.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T01:28:01.299 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-12T01:28:01.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:28:01.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:28:01.383 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:28:01.383 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:28:01.398 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:28:01.399 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:28:01.399 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:28:01.454 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-12T01:28:01.454 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-12T01:28:01.454 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/49c92736-5bb8-485f-a741-b07875337467 2024-09-12T01:28:01.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:28:01.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/49c92736-5bb8-485f-a741-b07875337467 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-12T01:28:01.556 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-12T01:28:01.556 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-12T01:28:01.556 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-12T01:28:01.681 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-12T01:28:01.682 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-12T01:28:01.682 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-12T01:28:01.682 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.100:3300,172.21.15.189:3300" 2024-09-12T01:28:01.682 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:3300,172.21.15.100:3300,172.21.15.189:3300:/volumes/qa/sv_1/49c92736-5bb8-485f-a741-b07875337467 2024-09-12T01:28:01.682 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=c1ee9932-70a4-11ef-bcea-c7b262605968" will pass to kernel 2024-09-12T01:28:01.683 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:28:01.683 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:28:01.683 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:28:01.683 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:28:01.683 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:28:01.684 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:28:01.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:28:01.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:28:01.712 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:28:01.768 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:01 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:01.516+0000 7f9687b99040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:28:01.768 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:01 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:01.630+0000 7f9687b99040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:28:01.800 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:01 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:01.540+0000 7fd2c2431040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:28:01.800 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:01 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:01.656+0000 7fd2c2431040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:28:01.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:28:01.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:28:01.811 INFO:teuthology.orchestra.run.smithi081.stdout:client24763 2024-09-12T01:28:01.811 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:28:01.811 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:28:01.826 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:01 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:01.703+0000 7ff082642040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:28:01.826 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:01 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:01.827+0000 7ff082642040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:28:01.828 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:28:01.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:28:01.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:28:01.926 INFO:teuthology.orchestra.run.smithi081.stdout:client24763 2024-09-12T01:28:01.926 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:28:01.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:28:01.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:28:01.983 INFO:teuthology.orchestra.run.smithi081.stdout:client24763 2024-09-12T01:28:01.983 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968.client24763/status') 2024-09-12T01:28:02.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:28:02.042 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.24763 (3)172.21.15.81:0/639224507 2024-09-12T01:28:02.042 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2024-09-12T01:28:02.042 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2024-09-12T01:28:02.043 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2024-09-12T01:28:02.043 INFO:teuthology.orchestra.run.smithi081.stderr:70 bytes copied, 2.3411e-05 s, 3.0 MB/s 2024-09-12T01:28:02.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:28:02.050 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T01:28:02.059 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T01:28:02.059 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T01:28:02.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-12T01:28:02.060 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:01 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:01.776+0000 7f9687b99040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:28:02.060 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:01 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:01.837+0000 7f9687b99040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:28:02.060 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:01 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:01.986+0000 7f9687b99040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:28:02.060 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:02 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:02.053+0000 7f9687b99040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:28:02.077 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:01 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:01.801+0000 7fd2c2431040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:28:02.077 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:01 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:01.862+0000 7fd2c2431040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:28:02.077 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:02.010+0000 7fd2c2431040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:28:02.081 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:01 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:01.978+0000 7ff082642040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:28:02.081 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:02.044+0000 7ff082642040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:28:02.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.163+0000 7f8deaad0640 1 -- 172.21.15.81:0/2301546000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de4100a40 msgr2=0x7f8de4100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.163+0000 7f8deaad0640 1 --2- 172.21.15.81:0/2301546000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de4100a40 0x7f8de4100e40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009900 tx=0x7f8dd802a410 comp rx=0 tx=0).stop 2024-09-12T01:28:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.163+0000 7f8deaad0640 1 -- 172.21.15.81:0/2301546000 shutdown_connections 2024-09-12T01:28:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.163+0000 7f8deaad0640 1 --2- 172.21.15.81:0/2301546000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8de41025f0 0x7f8de4108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.163+0000 7f8deaad0640 1 --2- 172.21.15.81:0/2301546000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8de4101c30 0x7f8de41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.163+0000 7f8deaad0640 1 --2- 172.21.15.81:0/2301546000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de4100a40 0x7f8de4100e40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.163+0000 7f8deaad0640 1 -- 172.21.15.81:0/2301546000 >> 172.21.15.81:0/2301546000 conn(0x7f8de40fc1e0 msgr2=0x7f8de40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.163+0000 7f8deaad0640 1 -- 172.21.15.81:0/2301546000 shutdown_connections 2024-09-12T01:28:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.163+0000 7f8deaad0640 1 -- 172.21.15.81:0/2301546000 wait complete. 2024-09-12T01:28:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8deaad0640 1 Processor -- start 2024-09-12T01:28:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8deaad0640 1 -- start start 2024-09-12T01:28:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8deaad0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8de4100a40 0x7f8de406a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8deaad0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8de4101c30 0x7f8de419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8deaad0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de41025f0 0x7f8de419f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8deaad0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8de410c6f0 con 0x7f8de41025f0 2024-09-12T01:28:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8deaad0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8de410c570 con 0x7f8de4101c30 2024-09-12T01:28:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8deaad0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8de410c870 con 0x7f8de4100a40 2024-09-12T01:28:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de906d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de41025f0 0x7f8de419f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de906d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de41025f0 0x7f8de419f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39918/0 (socket says 172.21.15.81:39918) 2024-09-12T01:28:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de906d640 1 -- 172.21.15.81:0/1309694404 learned_addr learned my addr 172.21.15.81:0/1309694404 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de886c640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8de4100a40 0x7f8de406a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de3fff640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8de4101c30 0x7f8de419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de906d640 1 -- 172.21.15.81:0/1309694404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8de4100a40 msgr2=0x7f8de406a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de906d640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8de4100a40 0x7f8de406a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de906d640 1 -- 172.21.15.81:0/1309694404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8de4101c30 msgr2=0x7f8de419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de906d640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8de4101c30 0x7f8de419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de906d640 1 -- 172.21.15.81:0/1309694404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de419fa70 con 0x7f8de41025f0 2024-09-12T01:28:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de906d640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de41025f0 0x7f8de419f160 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00eaa0 tx=0x7f8ddc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de1ffb640 1 -- 172.21.15.81:0/1309694404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc00cdb0 con 0x7f8de41025f0 2024-09-12T01:28:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de1ffb640 1 -- 172.21.15.81:0/1309694404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ddc005020 con 0x7f8de41025f0 2024-09-12T01:28:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8de1ffb640 1 -- 172.21.15.81:0/1309694404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0116b0 con 0x7f8de41025f0 2024-09-12T01:28:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.164+0000 7f8deaad0640 1 -- 172.21.15.81:0/1309694404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de419fd00 con 0x7f8de41025f0 2024-09-12T01:28:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.165+0000 7f8deaad0640 1 -- 172.21.15.81:0/1309694404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de41a01f0 con 0x7f8de41025f0 2024-09-12T01:28:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.166+0000 7f8deaad0640 1 -- 172.21.15.81:0/1309694404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de4107d60 con 0x7f8de41025f0 2024-09-12T01:28:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.167+0000 7f8de1ffb640 1 -- 172.21.15.81:0/1309694404 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f8ddc005560 con 0x7f8de41025f0 2024-09-12T01:28:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.167+0000 7f8de1ffb640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8dd40a2d00 0x7f8dd40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.167+0000 7f8de886c640 1 -- 172.21.15.81:0/1309694404 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8dd40a2d00 msgr2=0x7f8dd40a51c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2591597081 2024-09-12T01:28:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.168+0000 7f8de1ffb640 1 -- 172.21.15.81:0/1309694404 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8ddc0cf170 con 0x7f8de41025f0 2024-09-12T01:28:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.168+0000 7f8de886c640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8dd40a2d00 0x7f8dd40a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:28:02.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.172+0000 7f8de1ffb640 1 -- 172.21.15.81:0/1309694404 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ddc016030 con 0x7f8de41025f0 2024-09-12T01:28:02.335 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:02.202+0000 7ff082642040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:28:02.335 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:02.273+0000 7ff082642040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:28:02.339 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:02 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:02.113+0000 7f9687b99040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:28:02.339 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:02 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:02.272+0000 7f9687b99040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:28:02.339 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:02 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:02.338+0000 7f9687b99040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:28:02.365 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:02.078+0000 7fd2c2431040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:28:02.365 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:02.138+0000 7fd2c2431040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:28:02.365 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:02.300+0000 7fd2c2431040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:28:02.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.369+0000 7f8de886c640 1 -- 172.21.15.81:0/1309694404 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8dd40a2d00 msgr2=0x7f8dd40a51c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2591597081 2024-09-12T01:28:02.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.369+0000 7f8de886c640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8dd40a2d00 0x7f8dd40a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:28:02.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.382+0000 7f8deaad0640 1 -- 172.21.15.81:0/1309694404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f8de4062ef0 con 0x7f8de41025f0 2024-09-12T01:28:02.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.435+0000 7f8de1ffb640 1 -- 172.21.15.81:0/1309694404 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f8ddc09ba90 con 0x7f8de41025f0 2024-09-12T01:28:02.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.438+0000 7f8deaad0640 1 -- 172.21.15.81:0/1309694404 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8dd40a2d00 msgr2=0x7f8dd40a51c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:28:02.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.438+0000 7f8deaad0640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8dd40a2d00 0x7f8dd40a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.438+0000 7f8deaad0640 1 -- 172.21.15.81:0/1309694404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de41025f0 msgr2=0x7f8de419f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:02.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.438+0000 7f8deaad0640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de41025f0 0x7f8de419f160 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00eaa0 tx=0x7f8ddc00ef60 comp rx=0 tx=0).stop 2024-09-12T01:28:02.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.438+0000 7f8deaad0640 1 -- 172.21.15.81:0/1309694404 shutdown_connections 2024-09-12T01:28:02.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.438+0000 7f8deaad0640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f8dd40a2d00 0x7f8dd40a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.438+0000 7f8deaad0640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8de41025f0 0x7f8de419f160 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.438+0000 7f8deaad0640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8de4101c30 0x7f8de419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.438+0000 7f8deaad0640 1 --2- 172.21.15.81:0/1309694404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8de4100a40 0x7f8de406a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.438+0000 7f8deaad0640 1 -- 172.21.15.81:0/1309694404 >> 172.21.15.81:0/1309694404 conn(0x7f8de40fc1e0 msgr2=0x7f8de4104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:02.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.438+0000 7f8deaad0640 1 -- 172.21.15.81:0/1309694404 shutdown_connections 2024-09-12T01:28:02.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.438+0000 7f8deaad0640 1 -- 172.21.15.81:0/1309694404 wait complete. 2024-09-12T01:28:02.452 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T01:28:02.462 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-12T01:28:02.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:28:02.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.595+0000 7f77f3dfd640 1 -- 172.21.15.81:0/2651504240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec1077f0 msgr2=0x7f77ec109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.595+0000 7f77f3dfd640 1 --2- 172.21.15.81:0/2651504240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec1077f0 0x7f77ec109c60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009ca0 tx=0x7f77e402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.595+0000 7f77f3dfd640 1 -- 172.21.15.81:0/2651504240 shutdown_connections 2024-09-12T01:28:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.595+0000 7f77f3dfd640 1 --2- 172.21.15.81:0/2651504240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec1077f0 0x7f77ec109c60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.595+0000 7f77f3dfd640 1 --2- 172.21.15.81:0/2651504240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec104ec0 0x7f77ec1072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.595+0000 7f77f3dfd640 1 --2- 172.21.15.81:0/2651504240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77ec102590 0x7f77ec104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.595+0000 7f77f3dfd640 1 -- 172.21.15.81:0/2651504240 >> 172.21.15.81:0/2651504240 conn(0x7f77ec0fc170 msgr2=0x7f77ec0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.595+0000 7f77f3dfd640 1 -- 172.21.15.81:0/2651504240 shutdown_connections 2024-09-12T01:28:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.595+0000 7f77f3dfd640 1 -- 172.21.15.81:0/2651504240 wait complete. 2024-09-12T01:28:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.595+0000 7f77f3dfd640 1 Processor -- start 2024-09-12T01:28:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f3dfd640 1 -- start start 2024-09-12T01:28:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f3dfd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec102590 0x7f77ec197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f3dfd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77ec104ec0 0x7f77ec198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f3dfd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec1077f0 0x7f77ec19f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f3dfd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec10d800 con 0x7f77ec1077f0 2024-09-12T01:28:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f3dfd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec10d680 con 0x7f77ec102590 2024-09-12T01:28:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f3dfd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec10d980 con 0x7f77ec104ec0 2024-09-12T01:28:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f239a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec1077f0 0x7f77ec19f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f1b99640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec102590 0x7f77ec197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f239a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec1077f0 0x7f77ec19f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39934/0 (socket says 172.21.15.81:39934) 2024-09-12T01:28:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f239a640 1 -- 172.21.15.81:0/595839653 learned_addr learned my addr 172.21.15.81:0/595839653 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f1398640 1 --2- 172.21.15.81:0/595839653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77ec104ec0 0x7f77ec198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f239a640 1 -- 172.21.15.81:0/595839653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77ec104ec0 msgr2=0x7f77ec198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f239a640 1 --2- 172.21.15.81:0/595839653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77ec104ec0 0x7f77ec198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f239a640 1 -- 172.21.15.81:0/595839653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec102590 msgr2=0x7f77ec197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f239a640 1 --2- 172.21.15.81:0/595839653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec102590 0x7f77ec197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f239a640 1 -- 172.21.15.81:0/595839653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec19fa70 con 0x7f77ec1077f0 2024-09-12T01:28:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f1b99640 1 --2- 172.21.15.81:0/595839653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec102590 0x7f77ec197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.596+0000 7f77f239a640 1 --2- 172.21.15.81:0/595839653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec1077f0 0x7f77ec19f400 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f77e4031ae0 tx=0x7f77e40319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.597+0000 7f77e2ffd640 1 -- 172.21.15.81:0/595839653 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4003b70 con 0x7f77ec1077f0 2024-09-12T01:28:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.597+0000 7f77e2ffd640 1 -- 172.21.15.81:0/595839653 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77e4003d10 con 0x7f77ec1077f0 2024-09-12T01:28:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.597+0000 7f77e2ffd640 1 -- 172.21.15.81:0/595839653 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e402fc00 con 0x7f77ec1077f0 2024-09-12T01:28:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.597+0000 7f77f3dfd640 1 -- 172.21.15.81:0/595839653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ec19fd00 con 0x7f77ec1077f0 2024-09-12T01:28:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.597+0000 7f77f3dfd640 1 -- 172.21.15.81:0/595839653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ec1a01f0 con 0x7f77ec1077f0 2024-09-12T01:28:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.598+0000 7f77f3dfd640 1 -- 172.21.15.81:0/595839653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ec0fdc60 con 0x7f77ec1077f0 2024-09-12T01:28:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.599+0000 7f77e2ffd640 1 -- 172.21.15.81:0/595839653 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f77e4004690 con 0x7f77ec1077f0 2024-09-12T01:28:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.599+0000 7f77e2ffd640 1 --2- 172.21.15.81:0/595839653 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f77d80a2be0 0x7f77d80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.599+0000 7f77f1b99640 1 -- 172.21.15.81:0/595839653 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f77d80a2be0 msgr2=0x7f77d80a50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2591597081 2024-09-12T01:28:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.600+0000 7f77e2ffd640 1 -- 172.21.15.81:0/595839653 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f77e40f0520 con 0x7f77ec1077f0 2024-09-12T01:28:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.600+0000 7f77f1b99640 1 --2- 172.21.15.81:0/595839653 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f77d80a2be0 0x7f77d80a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:28:02.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.604+0000 7f77e2ffd640 1 -- 172.21.15.81:0/595839653 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77e40bd490 con 0x7f77ec1077f0 2024-09-12T01:28:02.609 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:02 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1309694404' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T01:28:02.609 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:02 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:02.405+0000 7f9687b99040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:28:02.609 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:02 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:02.490+0000 7f9687b99040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:28:02.610 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:02 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:02.550+0000 7f9687b99040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:28:02.610 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:02 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:02.609+0000 7f9687b99040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:28:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:02 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1309694404' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T01:28:02.638 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:02.366+0000 7fd2c2431040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:28:02.638 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:02.434+0000 7fd2c2431040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:28:02.638 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:02.520+0000 7fd2c2431040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:28:02.638 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:02.579+0000 7fd2c2431040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:28:02.644 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:02 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1309694404' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T01:28:02.644 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:02.335+0000 7ff082642040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:28:02.644 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:02.505+0000 7ff082642040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:28:02.644 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:02.574+0000 7ff082642040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:28:02.644 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:02.645+0000 7ff082642040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:28:02.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.778+0000 7f77f3dfd640 1 -- 172.21.15.81:0/595839653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77ec062e90 con 0x7f77ec1077f0 2024-09-12T01:28:02.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.780+0000 7f77e2ffd640 1 -- 172.21.15.81:0/595839653 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22714 (secure 0 0 0) 0x7f77e40bcd90 con 0x7f77ec1077f0 2024-09-12T01:28:02.779 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:02.779 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","created":"2024-09-12T01:18:28.404285+0000","modified":"2024-09-12T01:26:26.256495+0000","last_up_change":"2024-09-12T01:25:26.326110+0000","last_in_change":"2024-09-12T01:25:02.138698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:21:40.649584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:26:10.753723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:26:13.254837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc857dd4-eedc-4c48-89a0-4e69662e8e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6803","nonce":3870994528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6805","nonce":3870994528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6809","nonce":3870994528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6807","nonce":3870994528}]},"public_addr":"172.21.15.81:6803/3870994528","cluster_addr":"172.21.15.81:6805/3870994528","heartbeat_back_addr":"172.21.15.81:6809/3870994528","heartbeat_front_addr":"172.21.15.81:6807/3870994528","state":["exists","up"]},{"osd":1,"uuid":"04b8111b-d677-4fc8-8285-90683621ccf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6801","nonce":2098299652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6803","nonce":2098299652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6807","nonce":2098299652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6805","nonce":2098299652}]},"public_addr":"172.21.15.100:6801/2098299652","cluster_addr":"172.21.15.100:6803/2098299652","heartbeat_back_addr":"172.21.15.100:6807/2098299652","heartbeat_front_addr":"172.21.15.100:6805/2098299652","state":["exists","up"]},{"osd":2,"uuid":"763e357e-5a04-45ff-95e8-bc1abfeac056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6801","nonce":1353548110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6803","nonce":1353548110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6807","nonce":1353548110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6805","nonce":1353548110}]},"public_addr":"172.21.15.189:6801/1353548110","cluster_addr":"172.21.15.189:6803/1353548110","heartbeat_back_addr":"172.21.15.189:6807/1353548110","heartbeat_front_addr":"172.21.15.189:6805/1353548110","state":["exists","up"]},{"osd":3,"uuid":"99843578-1b9e-4ee0-91f1-ba419d07897e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6811","nonce":1064869637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6813","nonce":1064869637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6817","nonce":1064869637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6815","nonce":1064869637}]},"public_addr":"172.21.15.81:6811/1064869637","cluster_addr":"172.21.15.81:6813/1064869637","heartbeat_back_addr":"172.21.15.81:6817/1064869637","heartbeat_front_addr":"172.21.15.81:6815/1064869637","state":["exists","up"]},{"osd":4,"uuid":"a5787415-0905-420e-9ce8-eb6902727561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6809","nonce":1687792282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6811","nonce":1687792282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6815","nonce":1687792282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6813","nonce":1687792282}]},"public_addr":"172.21.15.100:6809/1687792282","cluster_addr":"172.21.15.100:6811/1687792282","heartbeat_back_addr":"172.21.15.100:6815/1687792282","heartbeat_front_addr":"172.21.15.100:6813/1687792282","state":["exists","up"]},{"osd":5,"uuid":"879548b5-5516-407c-8517-bbdbf356c0e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6809","nonce":823474396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6811","nonce":823474396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6815","nonce":823474396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6813","nonce":823474396}]},"public_addr":"172.21.15.189:6809/823474396","cluster_addr":"172.21.15.189:6811/823474396","heartbeat_back_addr":"172.21.15.189:6815/823474396","heartbeat_front_addr":"172.21.15.189:6813/823474396","state":["exists","up"]},{"osd":6,"uuid":"b665b97c-a9d3-475f-93f3-8a920cbb37d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6819","nonce":1522854005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6821","nonce":1522854005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6825","nonce":1522854005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6823","nonce":1522854005}]},"public_addr":"172.21.15.81:6819/1522854005","cluster_addr":"172.21.15.81:6821/1522854005","heartbeat_back_addr":"172.21.15.81:6825/1522854005","heartbeat_front_addr":"172.21.15.81:6823/1522854005","state":["exists","up"]},{"osd":7,"uuid":"46e082c8-d071-471a-8c86-ce5b5700cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6817","nonce":41478541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6819","nonce":41478541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6823","nonce":41478541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6821","nonce":41478541}]},"public_addr":"172.21.15.100:6817/41478541","cluster_addr":"172.21.15.100:6819/41478541","heartbeat_back_addr":"172.21.15.100:6823/41478541","heartbeat_front_addr":"172.21.15.100:6821/41478541","state":["exists","up"]},{"osd":8,"uuid":"fb9b93ef-5a33-4ffc-926e-a78c101bbbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6817","nonce":180766860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6819","nonce":180766860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6823","nonce":180766860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6821","nonce":180766860}]},"public_addr":"172.21.15.189:6817/180766860","cluster_addr":"172.21.15.189:6819/180766860","heartbeat_back_addr":"172.21.15.189:6823/180766860","heartbeat_front_addr":"172.21.15.189:6821/180766860","state":["exists","up"]},{"osd":9,"uuid":"0b7ec1a1-5ab9-4075-acfb-e0d82f018656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6827","nonce":1651232782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6829","nonce":1651232782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6833","nonce":1651232782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6831","nonce":1651232782}]},"public_addr":"172.21.15.81:6827/1651232782","cluster_addr":"172.21.15.81:6829/1651232782","heartbeat_back_addr":"172.21.15.81:6833/1651232782","heartbeat_front_addr":"172.21.15.81:6831/1651232782","state":["exists","up"]},{"osd":10,"uuid":"996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6825","nonce":3295868568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6827","nonce":3295868568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6831","nonce":3295868568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6829","nonce":3295868568}]},"public_addr":"172.21.15.100:6825/3295868568","cluster_addr":"172.21.15.100:6827/3295868568","heartbeat_back_addr":"172.21.15.100:6831/3295868568","heartbeat_front_addr":"172.21.15.100:6829/3295868568","state":["exists","up"]},{"osd":11,"uuid":"f051e2b2-fc58-489a-ab7c-8c1ff5448553","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6825","nonce":3852230978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6827","nonce":3852230978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6831","nonce":3852230978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6829","nonce":3852230978}]},"public_addr":"172.21.15.189:6825/3852230978","cluster_addr":"172.21.15.189:6827/3852230978","heartbeat_back_addr":"172.21.15.189:6831/3852230978","heartbeat_front_addr":"172.21.15.189:6829/3852230978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:20:47.371696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:12.762376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:37.936648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:03.950352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:28.922754+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:54.252149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:18.421479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:43.989505+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:08.789671+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:34.336367+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:59.089601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:25:23.761934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/4128337402":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/1460332159":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2577694203":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2393807982":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6800/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/2162789959":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/4219073331":"2024-09-13T01:19:00.926419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:28:02.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.782+0000 7f77f3dfd640 1 -- 172.21.15.81:0/595839653 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f77d80a2be0 msgr2=0x7f77d80a50a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:28:02.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.782+0000 7f77f3dfd640 1 --2- 172.21.15.81:0/595839653 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f77d80a2be0 0x7f77d80a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.782+0000 7f77f3dfd640 1 -- 172.21.15.81:0/595839653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec1077f0 msgr2=0x7f77ec19f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:02.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.782+0000 7f77f3dfd640 1 --2- 172.21.15.81:0/595839653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec1077f0 0x7f77ec19f400 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f77e4031ae0 tx=0x7f77e40319f0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.782+0000 7f77f3dfd640 1 -- 172.21.15.81:0/595839653 shutdown_connections 2024-09-12T01:28:02.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.782+0000 7f77f3dfd640 1 --2- 172.21.15.81:0/595839653 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f77d80a2be0 0x7f77d80a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.782+0000 7f77f3dfd640 1 --2- 172.21.15.81:0/595839653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec1077f0 0x7f77ec19f400 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.782+0000 7f77f3dfd640 1 --2- 172.21.15.81:0/595839653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77ec104ec0 0x7f77ec198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.782+0000 7f77f3dfd640 1 --2- 172.21.15.81:0/595839653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec102590 0x7f77ec197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.782+0000 7f77f3dfd640 1 -- 172.21.15.81:0/595839653 >> 172.21.15.81:0/595839653 conn(0x7f77ec0fc170 msgr2=0x7f77ec102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:02.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.782+0000 7f77f3dfd640 1 -- 172.21.15.81:0/595839653 shutdown_connections 2024-09-12T01:28:02.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.782+0000 7f77f3dfd640 1 -- 172.21.15.81:0/595839653 wait complete. 2024-09-12T01:28:02.793 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:21:40.649584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T01:26:10.753723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T01:26:13.254837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:28:02.794 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:28:02.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.899+0000 7ffad6bb9640 1 -- 172.21.15.81:0/2536567271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffad0101bf0 msgr2=0x7ffad0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.899+0000 7ffad6bb9640 1 --2- 172.21.15.81:0/2536567271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffad0101bf0 0x7ffad0102070 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009860 tx=0x7ffabc02a340 comp rx=0 tx=0).stop 2024-09-12T01:28:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.899+0000 7ffad6bb9640 1 -- 172.21.15.81:0/2536567271 shutdown_connections 2024-09-12T01:28:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.899+0000 7ffad6bb9640 1 --2- 172.21.15.81:0/2536567271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad01025b0 0x7ffad0108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.899+0000 7ffad6bb9640 1 --2- 172.21.15.81:0/2536567271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffad0101bf0 0x7ffad0102070 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.899+0000 7ffad6bb9640 1 --2- 172.21.15.81:0/2536567271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffad0100a00 0x7ffad0100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.899+0000 7ffad6bb9640 1 -- 172.21.15.81:0/2536567271 >> 172.21.15.81:0/2536567271 conn(0x7ffad00fc140 msgr2=0x7ffad00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.899+0000 7ffad6bb9640 1 -- 172.21.15.81:0/2536567271 shutdown_connections 2024-09-12T01:28:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.899+0000 7ffad6bb9640 1 -- 172.21.15.81:0/2536567271 wait complete. 2024-09-12T01:28:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffad6bb9640 1 Processor -- start 2024-09-12T01:28:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffad6bb9640 1 -- start start 2024-09-12T01:28:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffad6bb9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffad0100a00 0x7ffad0069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffad6bb9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad0101bf0 0x7ffad019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffad6bb9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffad01025b0 0x7ffad019f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffad6bb9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffad010c660 con 0x7ffad0101bf0 2024-09-12T01:28:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffad6bb9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffad010c4e0 con 0x7ffad01025b0 2024-09-12T01:28:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffad6bb9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffad010c7e0 con 0x7ffad0100a00 2024-09-12T01:28:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffacffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad0101bf0 0x7ffad019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffacffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad0101bf0 0x7ffad019cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39942/0 (socket says 172.21.15.81:39942) 2024-09-12T01:28:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffacffff640 1 -- 172.21.15.81:0/1683828847 learned_addr learned my addr 172.21.15.81:0/1683828847 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffad4955640 1 --2- 172.21.15.81:0/1683828847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffad0100a00 0x7ffad0069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffad5156640 1 --2- 172.21.15.81:0/1683828847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffad01025b0 0x7ffad019f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffacffff640 1 -- 172.21.15.81:0/1683828847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffad0100a00 msgr2=0x7ffad0069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:02.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.900+0000 7ffacffff640 1 --2- 172.21.15.81:0/1683828847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffad0100a00 0x7ffad0069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.901+0000 7ffacffff640 1 -- 172.21.15.81:0/1683828847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffad01025b0 msgr2=0x7ffad019f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.901+0000 7ffacffff640 1 --2- 172.21.15.81:0/1683828847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffad01025b0 0x7ffad019f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.901+0000 7ffacffff640 1 -- 172.21.15.81:0/1683828847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad019fb10 con 0x7ffad0101bf0 2024-09-12T01:28:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.901+0000 7ffacffff640 1 --2- 172.21.15.81:0/1683828847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad0101bf0 0x7ffad019cbe0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffabc005940 tx=0x7ffabc033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.901+0000 7ffacdffb640 1 -- 172.21.15.81:0/1683828847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc03f020 con 0x7ffad0101bf0 2024-09-12T01:28:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.901+0000 7ffad6bb9640 1 -- 172.21.15.81:0/1683828847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad019fd40 con 0x7ffad0101bf0 2024-09-12T01:28:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.901+0000 7ffacdffb640 1 -- 172.21.15.81:0/1683828847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffabc030850 con 0x7ffad0101bf0 2024-09-12T01:28:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.901+0000 7ffacdffb640 1 -- 172.21.15.81:0/1683828847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc037040 con 0x7ffad0101bf0 2024-09-12T01:28:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.901+0000 7ffad6bb9640 1 -- 172.21.15.81:0/1683828847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad01a0220 con 0x7ffad0101bf0 2024-09-12T01:28:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.902+0000 7ffad6bb9640 1 -- 172.21.15.81:0/1683828847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad0107e80 con 0x7ffad0101bf0 2024-09-12T01:28:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.903+0000 7ffacdffb640 1 -- 172.21.15.81:0/1683828847 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7ffabc042020 con 0x7ffad0101bf0 2024-09-12T01:28:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.904+0000 7ffacdffb640 1 --2- 172.21.15.81:0/1683828847 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ffac00a2be0 0x7ffac00a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.904+0000 7ffad4955640 1 -- 172.21.15.81:0/1683828847 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ffac00a2be0 msgr2=0x7ffac00a50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2591597081 2024-09-12T01:28:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.904+0000 7ffacdffb640 1 -- 172.21.15.81:0/1683828847 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ffabc0ef780 con 0x7ffad0101bf0 2024-09-12T01:28:02.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.904+0000 7ffad4955640 1 --2- 172.21.15.81:0/1683828847 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ffac00a2be0 0x7ffac00a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:28:02.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:02.908+0000 7ffacdffb640 1 -- 172.21.15.81:0/1683828847 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffabc049020 con 0x7ffad0101bf0 2024-09-12T01:28:02.988 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:02.731+0000 7ff082642040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:28:02.988 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:02.794+0000 7ff082642040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:28:02.988 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:02.857+0000 7ff082642040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:28:03.031 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:02.638+0000 7fd2c2431040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:28:03.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.082+0000 7ffad6bb9640 1 -- 172.21.15.81:0/1683828847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ffad002d7c0 con 0x7ffad0101bf0 2024-09-12T01:28:03.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.082+0000 7ffacdffb640 1 -- 172.21.15.81:0/1683828847 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7ffabc0bc6f0 con 0x7ffad0101bf0 2024-09-12T01:28:03.082 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-12T01:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.084+0000 7ffad6bb9640 1 -- 172.21.15.81:0/1683828847 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ffac00a2be0 msgr2=0x7ffac00a50a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.084+0000 7ffad6bb9640 1 --2- 172.21.15.81:0/1683828847 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ffac00a2be0 0x7ffac00a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.084+0000 7ffad6bb9640 1 -- 172.21.15.81:0/1683828847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad0101bf0 msgr2=0x7ffad019cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.084+0000 7ffad6bb9640 1 --2- 172.21.15.81:0/1683828847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad0101bf0 0x7ffad019cbe0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffabc005940 tx=0x7ffabc033d90 comp rx=0 tx=0).stop 2024-09-12T01:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.084+0000 7ffad6bb9640 1 -- 172.21.15.81:0/1683828847 shutdown_connections 2024-09-12T01:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.084+0000 7ffad6bb9640 1 --2- 172.21.15.81:0/1683828847 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7ffac00a2be0 0x7ffac00a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.084+0000 7ffad6bb9640 1 --2- 172.21.15.81:0/1683828847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffad01025b0 0x7ffad019f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.084+0000 7ffad6bb9640 1 --2- 172.21.15.81:0/1683828847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad0101bf0 0x7ffad019cbe0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.084+0000 7ffad6bb9640 1 --2- 172.21.15.81:0/1683828847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffad0100a00 0x7ffad0069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.084+0000 7ffad6bb9640 1 -- 172.21.15.81:0/1683828847 >> 172.21.15.81:0/1683828847 conn(0x7ffad00fc140 msgr2=0x7ffad0105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.085+0000 7ffad6bb9640 1 -- 172.21.15.81:0/1683828847 shutdown_connections 2024-09-12T01:28:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.085+0000 7ffad6bb9640 1 -- 172.21.15.81:0/1683828847 wait complete. 2024-09-12T01:28:03.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T01:28:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.200+0000 7f522380a640 1 -- 172.21.15.81:0/876460196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100a00 msgr2=0x7f521c100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.200+0000 7f522380a640 1 --2- 172.21.15.81:0/876460196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100a00 0x7f521c100e00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5218009900 tx=0x7f521802a410 comp rx=0 tx=0).stop 2024-09-12T01:28:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.200+0000 7f522380a640 1 -- 172.21.15.81:0/876460196 shutdown_connections 2024-09-12T01:28:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.200+0000 7f522380a640 1 --2- 172.21.15.81:0/876460196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f521c1025b0 0x7f521c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.200+0000 7f522380a640 1 --2- 172.21.15.81:0/876460196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f521c101bf0 0x7f521c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.200+0000 7f522380a640 1 --2- 172.21.15.81:0/876460196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100a00 0x7f521c100e00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.200+0000 7f522380a640 1 -- 172.21.15.81:0/876460196 >> 172.21.15.81:0/876460196 conn(0x7f521c0fc140 msgr2=0x7f521c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.200+0000 7f522380a640 1 -- 172.21.15.81:0/876460196 shutdown_connections 2024-09-12T01:28:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.200+0000 7f522380a640 1 -- 172.21.15.81:0/876460196 wait complete. 2024-09-12T01:28:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f522380a640 1 Processor -- start 2024-09-12T01:28:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f522380a640 1 -- start start 2024-09-12T01:28:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f522380a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100a00 0x7f521c19a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f522380a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f521c101bf0 0x7f521c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f522380a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f521c1025b0 0x7f521c1a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f522380a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f521c10c680 con 0x7f521c1025b0 2024-09-12T01:28:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f522380a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f521c10c500 con 0x7f521c100a00 2024-09-12T01:28:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f522380a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f521c10c800 con 0x7f521c101bf0 2024-09-12T01:28:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f5221da7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f521c1025b0 0x7f521c1a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f5221da7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f521c1025b0 0x7f521c1a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39958/0 (socket says 172.21.15.81:39958) 2024-09-12T01:28:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f52215a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100a00 0x7f521c19a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f5221da7640 1 -- 172.21.15.81:0/978441096 learned_addr learned my addr 172.21.15.81:0/978441096 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f5220da5640 1 --2- 172.21.15.81:0/978441096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f521c101bf0 0x7f521c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f5221da7640 1 -- 172.21.15.81:0/978441096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f521c101bf0 msgr2=0x7f521c19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f5221da7640 1 --2- 172.21.15.81:0/978441096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f521c101bf0 0x7f521c19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f5221da7640 1 -- 172.21.15.81:0/978441096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100a00 msgr2=0x7f521c19a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f5221da7640 1 --2- 172.21.15.81:0/978441096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100a00 0x7f521c19a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f5221da7640 1 -- 172.21.15.81:0/978441096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c1a1d10 con 0x7f521c1025b0 2024-09-12T01:28:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f5221da7640 1 --2- 172.21.15.81:0/978441096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f521c1025b0 0x7f521c1a16a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f521400eb10 tx=0x7f521400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.201+0000 7f520e7fc640 1 -- 172.21.15.81:0/978441096 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214004b20 con 0x7f521c1025b0 2024-09-12T01:28:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.202+0000 7f522380a640 1 -- 172.21.15.81:0/978441096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521c1a1fa0 con 0x7f521c1025b0 2024-09-12T01:28:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.202+0000 7f520e7fc640 1 -- 172.21.15.81:0/978441096 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5214004cc0 con 0x7f521c1025b0 2024-09-12T01:28:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.202+0000 7f520e7fc640 1 -- 172.21.15.81:0/978441096 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214010760 con 0x7f521c1025b0 2024-09-12T01:28:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.202+0000 7f522380a640 1 -- 172.21.15.81:0/978441096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521c1a24c0 con 0x7f521c1025b0 2024-09-12T01:28:03.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.202+0000 7f522380a640 1 -- 172.21.15.81:0/978441096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f521c1a2780 con 0x7f521c1025b0 2024-09-12T01:28:03.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.205+0000 7f520e7fc640 1 -- 172.21.15.81:0/978441096 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f5214010900 con 0x7f521c1025b0 2024-09-12T01:28:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.205+0000 7f520e7fc640 1 --2- 172.21.15.81:0/978441096 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f52080a2c60 0x7f52080a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.206+0000 7f52215a6640 1 -- 172.21.15.81:0/978441096 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f52080a2c60 msgr2=0x7f52080a5120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2591597081 2024-09-12T01:28:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.206+0000 7f520e7fc640 1 -- 172.21.15.81:0/978441096 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f52140cf7a0 con 0x7f521c1025b0 2024-09-12T01:28:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.206+0000 7f52215a6640 1 --2- 172.21.15.81:0/978441096 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f52080a2c60 0x7f52080a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:28:03.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.208+0000 7f520e7fc640 1 -- 172.21.15.81:0/978441096 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52140541b0 con 0x7f521c1025b0 2024-09-12T01:28:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.379+0000 7f522380a640 1 -- 172.21.15.81:0/978441096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f521c1a2b10 con 0x7f521c1025b0 2024-09-12T01:28:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.380+0000 7f520e7fc640 1 -- 172.21.15.81:0/978441096 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7f521409c710 con 0x7f521c1025b0 2024-09-12T01:28:03.380 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-12T01:28:03.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.382+0000 7f522380a640 1 -- 172.21.15.81:0/978441096 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f52080a2c60 msgr2=0x7f52080a5120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:28:03.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.382+0000 7f522380a640 1 --2- 172.21.15.81:0/978441096 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f52080a2c60 0x7f52080a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.382+0000 7f522380a640 1 -- 172.21.15.81:0/978441096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f521c1025b0 msgr2=0x7f521c1a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:03.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.382+0000 7f522380a640 1 --2- 172.21.15.81:0/978441096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f521c1025b0 0x7f521c1a16a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f521400eb10 tx=0x7f521400c2d0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.382+0000 7f522380a640 1 -- 172.21.15.81:0/978441096 shutdown_connections 2024-09-12T01:28:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.382+0000 7f522380a640 1 --2- 172.21.15.81:0/978441096 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f52080a2c60 0x7f52080a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.382+0000 7f522380a640 1 --2- 172.21.15.81:0/978441096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f521c1025b0 0x7f521c1a16a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.382+0000 7f522380a640 1 --2- 172.21.15.81:0/978441096 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f521c101bf0 0x7f521c19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.382+0000 7f522380a640 1 --2- 172.21.15.81:0/978441096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100a00 0x7f521c19a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.382+0000 7f522380a640 1 -- 172.21.15.81:0/978441096 >> 172.21.15.81:0/978441096 conn(0x7f521c0fc140 msgr2=0x7f521c0693b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.382+0000 7f522380a640 1 -- 172.21.15.81:0/978441096 shutdown_connections 2024-09-12T01:28:03.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.382+0000 7f522380a640 1 -- 172.21.15.81:0/978441096 wait complete. 2024-09-12T01:28:03.393 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T01:28:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.501+0000 7f65e883c640 1 -- 172.21.15.81:0/1610720698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e4100a00 msgr2=0x7f65e4100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.501+0000 7f65e883c640 1 --2- 172.21.15.81:0/1610720698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e4100a00 0x7f65e4100e00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009900 tx=0x7f65d402a410 comp rx=0 tx=0).stop 2024-09-12T01:28:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.501+0000 7f65e883c640 1 -- 172.21.15.81:0/1610720698 shutdown_connections 2024-09-12T01:28:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.501+0000 7f65e883c640 1 --2- 172.21.15.81:0/1610720698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65e41025b0 0x7f65e4108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.501+0000 7f65e883c640 1 --2- 172.21.15.81:0/1610720698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e4101bf0 0x7f65e4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.501+0000 7f65e883c640 1 --2- 172.21.15.81:0/1610720698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e4100a00 0x7f65e4100e00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.501+0000 7f65e883c640 1 -- 172.21.15.81:0/1610720698 >> 172.21.15.81:0/1610720698 conn(0x7f65e40fc140 msgr2=0x7f65e40fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.501+0000 7f65e883c640 1 -- 172.21.15.81:0/1610720698 shutdown_connections 2024-09-12T01:28:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.501+0000 7f65e883c640 1 -- 172.21.15.81:0/1610720698 wait complete. 2024-09-12T01:28:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.502+0000 7f65e883c640 1 Processor -- start 2024-09-12T01:28:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.502+0000 7f65e883c640 1 -- start start 2024-09-12T01:28:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.502+0000 7f65e883c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e4100a00 0x7f65e4069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.502+0000 7f65e883c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65e4101bf0 0x7f65e419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.502+0000 7f65e883c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e41025b0 0x7f65e41a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.502+0000 7f65e883c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65e410c660 con 0x7f65e4100a00 2024-09-12T01:28:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.502+0000 7f65e883c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f65e410c4e0 con 0x7f65e41025b0 2024-09-12T01:28:03.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.502+0000 7f65e883c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f65e410c7e0 con 0x7f65e4101bf0 2024-09-12T01:28:03.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.502+0000 7f65e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e4100a00 0x7f65e4069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:03.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.502+0000 7f65e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e4100a00 0x7f65e4069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39972/0 (socket says 172.21.15.81:39972) 2024-09-12T01:28:03.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.502+0000 7f65e259c640 1 -- 172.21.15.81:0/686029762 learned_addr learned my addr 172.21.15.81:0/686029762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:03.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65e1d9b640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65e4101bf0 0x7f65e419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:03.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65e2d9d640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e41025b0 0x7f65e41a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:03.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65e259c640 1 -- 172.21.15.81:0/686029762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65e4101bf0 msgr2=0x7f65e419efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:03.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65e259c640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65e4101bf0 0x7f65e419efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65e259c640 1 -- 172.21.15.81:0/686029762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e41025b0 msgr2=0x7f65e41a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:03.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65e259c640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e41025b0 0x7f65e41a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65e259c640 1 -- 172.21.15.81:0/686029762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e41a1cf0 con 0x7f65e4100a00 2024-09-12T01:28:03.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65e2d9d640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e41025b0 0x7f65e41a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:03.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65e259c640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e4100a00 0x7f65e4069ef0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f65d4031610 tx=0x7f65d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65d37fe640 1 -- 172.21.15.81:0/686029762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d403f030 con 0x7f65e4100a00 2024-09-12T01:28:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65d37fe640 1 -- 172.21.15.81:0/686029762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65d4003ad0 con 0x7f65e4100a00 2024-09-12T01:28:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65e883c640 1 -- 172.21.15.81:0/686029762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e41a1f20 con 0x7f65e4100a00 2024-09-12T01:28:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65d37fe640 1 -- 172.21.15.81:0/686029762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4035070 con 0x7f65e4100a00 2024-09-12T01:28:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.503+0000 7f65e883c640 1 -- 172.21.15.81:0/686029762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e41a2380 con 0x7f65e4100a00 2024-09-12T01:28:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.505+0000 7f65e883c640 1 -- 172.21.15.81:0/686029762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e4100e00 con 0x7f65e4100a00 2024-09-12T01:28:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.505+0000 7f65d37fe640 1 -- 172.21.15.81:0/686029762 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 137850+0+0 (secure 0 0 0) 0x7f65d4042030 con 0x7f65e4100a00 2024-09-12T01:28:03.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.506+0000 7f65d37fe640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f65cc0a2c10 0x7f65cc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:03.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.506+0000 7f65e1d9b640 1 -- 172.21.15.81:0/686029762 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f65cc0a2c10 msgr2=0x7f65cc0a50d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2591597081 2024-09-12T01:28:03.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.506+0000 7f65d37fe640 1 -- 172.21.15.81:0/686029762 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f65d40ef6f0 con 0x7f65e4100a00 2024-09-12T01:28:03.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.506+0000 7f65e1d9b640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f65cc0a2c10 0x7f65cc0a50d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:28:03.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.511+0000 7f65d37fe640 1 -- 172.21.15.81:0/686029762 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f65d40bc660 con 0x7f65e4100a00 2024-09-12T01:28:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.699+0000 7f65e883c640 1 -- 172.21.15.81:0/686029762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f65e4062df0 con 0x7f65e4100a00 2024-09-12T01:28:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.699+0000 7f65d37fe640 1 -- 172.21.15.81:0/686029762 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f65d40bbf60 con 0x7f65e4100a00 2024-09-12T01:28:03.699 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-12T01:28:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.701+0000 7f65e883c640 1 -- 172.21.15.81:0/686029762 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f65cc0a2c10 msgr2=0x7f65cc0a50d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:28:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.701+0000 7f65e883c640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f65cc0a2c10 0x7f65cc0a50d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.701+0000 7f65e883c640 1 -- 172.21.15.81:0/686029762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e4100a00 msgr2=0x7f65e4069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.701+0000 7f65e883c640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e4100a00 0x7f65e4069ef0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f65d4031610 tx=0x7f65d4004270 comp rx=0 tx=0).stop 2024-09-12T01:28:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.701+0000 7f65e883c640 1 -- 172.21.15.81:0/686029762 shutdown_connections 2024-09-12T01:28:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.701+0000 7f65e883c640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.81:6800/2591597081,v1:172.21.15.81:6801/2591597081] conn(0x7f65cc0a2c10 0x7f65cc0a50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.701+0000 7f65e883c640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e41025b0 0x7f65e41a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.701+0000 7f65e883c640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65e4101bf0 0x7f65e419efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.701+0000 7f65e883c640 1 --2- 172.21.15.81:0/686029762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e4100a00 0x7f65e4069ef0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.701+0000 7f65e883c640 1 -- 172.21.15.81:0/686029762 >> 172.21.15.81:0/686029762 conn(0x7f65e40fc140 msgr2=0x7f65e41050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.701+0000 7f65e883c640 1 -- 172.21.15.81:0/686029762 shutdown_connections 2024-09-12T01:28:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:03.701+0000 7f65e883c640 1 -- 172.21.15.81:0/686029762 wait complete. 2024-09-12T01:28:03.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1309694404' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T01:28:03.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-mon[30920]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:28:03.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/595839653' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:28:03.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1683828847' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:28:03.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/978441096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:28:03.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-mon[30920]: Standby manager daemon y restarted 2024-09-12T01:28:03.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-mon[30920]: Standby manager daemon y started 2024-09-12T01:28:03.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.100:0/2813100829' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:28:03.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.100:0/2813100829' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:28:03.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.100:0/2813100829' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:28:03.710 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.100:0/2813100829' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:28:03.714 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-12T01:28:03.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:28:03.768 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:28:03 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y[36640]: 2024-09-12T01:28:03.400+0000 7f9687b99040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:28:03.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:03 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1309694404' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T01:28:03.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:03 smithi100 ceph-mon[35275]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:28:03.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:03 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/595839653' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:28:03.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:03 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1683828847' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:28:03.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:03 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/978441096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:28:03.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:03 smithi100 ceph-mon[35275]: Standby manager daemon y restarted 2024-09-12T01:28:03.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:03 smithi100 ceph-mon[35275]: Standby manager daemon y started 2024-09-12T01:28:03.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:03 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.100:0/2813100829' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:28:03.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:03 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.100:0/2813100829' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:28:03.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:03 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.100:0/2813100829' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:28:03.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:03 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.100:0/2813100829' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:28:03.781 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:28:03 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z[37167]: 2024-09-12T01:28:03.439+0000 7fd2c2431040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:28:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:03 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1309694404' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T01:28:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:03 smithi189 ceph-mon[35357]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:28:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:03 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/595839653' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:28:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:03 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1683828847' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:28:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:03 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/978441096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:28:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:03 smithi189 ceph-mon[35357]: Standby manager daemon y restarted 2024-09-12T01:28:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:03 smithi189 ceph-mon[35357]: Standby manager daemon y started 2024-09-12T01:28:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:03 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.100:0/2813100829' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:28:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:03 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.100:0/2813100829' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:28:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:03 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.100:0/2813100829' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:28:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:03 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.100:0/2813100829' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:28:03.968 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:03.708+0000 7ff082642040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:28:03.968 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:03.967+0000 7fefe9693640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:28:03.968 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:03.967+0000 7fefe9693640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:28:03.968 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:03.967+0000 7fefe9693640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:28:03.968 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:03.967+0000 7fefe9693640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:28:03.969 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:03.967+0000 7fefe9693640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:28:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:04.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:03.968+0000 7fefeceda640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:28:04.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:03.968+0000 7fefeceda640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:28:04.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:03.968+0000 7fefeceda640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:28:04.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:03.968+0000 7fefeceda640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:28:04.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:03.969+0000 7fefeceda640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:28:04.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.189:0/2255098994' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:28:04.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.189:0/2255098994' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:28:04.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.189:0/2255098994' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:28:04.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.? 172.21.15.189:0/2255098994' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:28:04.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: Standby manager daemon z restarted 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: Standby manager daemon z started 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/686029762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: Active manager daemon x restarted 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: Activating manager daemon x 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: mgrmap e21: x(active, starting, since 0.0124208s), standbys: z, y 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:28:04.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:28:04.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: Manager daemon x is now available 2024-09-12T01:28:04.572 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:04.573 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:28:04.573 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:04 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:28:04.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.565+0000 7f90e8337640 1 -- 172.21.15.81:0/581196959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e0108300 msgr2=0x7f90e010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:04.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.565+0000 7f90e8337640 1 --2- 172.21.15.81:0/581196959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e0108300 0x7f90e010ec70 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009cd0 tx=0x7f90d802a8d0 comp rx=0 tx=0).stop 2024-09-12T01:28:04.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.566+0000 7f90e8337640 1 -- 172.21.15.81:0/581196959 shutdown_connections 2024-09-12T01:28:04.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.566+0000 7f90e8337640 1 --2- 172.21.15.81:0/581196959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e0108300 0x7f90e010ec70 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:04.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.566+0000 7f90e8337640 1 --2- 172.21.15.81:0/581196959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e0103780 0x7f90e0107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:04.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.566+0000 7f90e8337640 1 --2- 172.21.15.81:0/581196959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90e0102dd0 0x7f90e01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:04.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.566+0000 7f90e8337640 1 -- 172.21.15.81:0/581196959 >> 172.21.15.81:0/581196959 conn(0x7f90e00fc7d0 msgr2=0x7f90e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:04.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.566+0000 7f90e8337640 1 -- 172.21.15.81:0/581196959 shutdown_connections 2024-09-12T01:28:04.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.566+0000 7f90e8337640 1 -- 172.21.15.81:0/581196959 wait complete. 2024-09-12T01:28:04.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.566+0000 7f90e8337640 1 Processor -- start 2024-09-12T01:28:04.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.566+0000 7f90e8337640 1 -- start start 2024-09-12T01:28:04.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e8337640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e0102dd0 0x7f90e0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:04.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e8337640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e0103780 0x7f90e0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:04.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e8337640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90e0108300 0x7f90e019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:04.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e8337640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90e01120d0 con 0x7f90e0102dd0 2024-09-12T01:28:04.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e8337640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0111f50 con 0x7f90e0108300 2024-09-12T01:28:04.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e8337640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0112250 con 0x7f90e0103780 2024-09-12T01:28:04.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e60d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e0102dd0 0x7f90e0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e60d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e0102dd0 0x7f90e0198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40076/0 (socket says 172.21.15.81:40076) 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e60d3640 1 -- 172.21.15.81:0/4097216910 learned_addr learned my addr 172.21.15.81:0/4097216910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e58d2640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e0103780 0x7f90e0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e68d4640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90e0108300 0x7f90e019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e60d3640 1 -- 172.21.15.81:0/4097216910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e0103780 msgr2=0x7f90e0198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e60d3640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e0103780 0x7f90e0198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e60d3640 1 -- 172.21.15.81:0/4097216910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90e0108300 msgr2=0x7f90e019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e60d3640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90e0108300 0x7f90e019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e60d3640 1 -- 172.21.15.81:0/4097216910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e019d540 con 0x7f90e0102dd0 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e68d4640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90e0108300 0x7f90e019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e60d3640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e0102dd0 0x7f90e0198590 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f90d000d950 tx=0x7f90d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90d77fe640 1 -- 172.21.15.81:0/4097216910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0017030 con 0x7f90e0102dd0 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90e8337640 1 -- 172.21.15.81:0/4097216910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e019d830 con 0x7f90e0102dd0 2024-09-12T01:28:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90d77fe640 1 -- 172.21.15.81:0/4097216910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90d0004020 con 0x7f90e0102dd0 2024-09-12T01:28:04.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.567+0000 7f90d77fe640 1 -- 172.21.15.81:0/4097216910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d00047a0 con 0x7f90e0102dd0 2024-09-12T01:28:04.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.568+0000 7f90e8337640 1 -- 172.21.15.81:0/4097216910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e01a5110 con 0x7f90e0102dd0 2024-09-12T01:28:04.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.569+0000 7f90e8337640 1 -- 172.21.15.81:0/4097216910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e01031b0 con 0x7f90e0102dd0 2024-09-12T01:28:04.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.570+0000 7f90d77fe640 1 -- 172.21.15.81:0/4097216910 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 21) ==== 137518+0+0 (secure 0 0 0) 0x7f90d00041d0 con 0x7f90e0102dd0 2024-09-12T01:28:04.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.571+0000 7f90d77fe640 1 -- 172.21.15.81:0/4097216910 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f90d00cebe0 con 0x7f90e0102dd0 2024-09-12T01:28:04.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.574+0000 7f90d77fe640 1 -- 172.21.15.81:0/4097216910 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90d009be50 con 0x7f90e0102dd0 2024-09-12T01:28:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.738+0000 7f90d77fe640 1 -- 172.21.15.81:0/4097216910 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f90d00974a0 con 0x7f90e0102dd0 2024-09-12T01:28:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.738+0000 7f90d77fe640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f90cc0a9880 0x7f90cc0abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.738+0000 7f90e58d2640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f90cc0a9880 0x7f90cc0abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.739+0000 7f90e58d2640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f90cc0a9880 0x7f90cc0abc70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f90e00fee00 tx=0x7f90dc005f90 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.189:0/2255098994' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:28:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.189:0/2255098994' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:28:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.189:0/2255098994' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:28:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.? 172.21.15.189:0/2255098994' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:28:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: Standby manager daemon z restarted 2024-09-12T01:28:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: Standby manager daemon z started 2024-09-12T01:28:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-09-12T01:28:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/686029762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:28:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: Active manager daemon x restarted 2024-09-12T01:28:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: Activating manager daemon x 2024-09-12T01:28:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T01:28:04.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: mgrmap e21: x(active, starting, since 0.0124208s), standbys: z, y 2024-09-12T01:28:04.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:28:04.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:28:04.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:28:04.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:28:04.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:28:04.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:28:04.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:28:04.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:28:04.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:28:04.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:28:04.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:28:04.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:28:04.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:28:04.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:28:04.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:28:04.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:28:04.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:28:04.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:28:04.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:28:04.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:28:04.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:28:04.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:28:04.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:28:04.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:28:04.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:28:04.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:28:04.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:28:04.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:28:04.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:28:04.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:28:04.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:28:04.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:28:04.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:28:04.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: Manager daemon x is now available 2024-09-12T01:28:04.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:04.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:28:04.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:04 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:28:04.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.189:0/2255098994' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:28:04.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.189:0/2255098994' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:28:04.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.189:0/2255098994' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:28:04.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.? 172.21.15.189:0/2255098994' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:28:04.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: Standby manager daemon z restarted 2024-09-12T01:28:04.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: Standby manager daemon z started 2024-09-12T01:28:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-09-12T01:28:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/686029762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:28:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: Active manager daemon x restarted 2024-09-12T01:28:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: Activating manager daemon x 2024-09-12T01:28:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T01:28:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: mgrmap e21: x(active, starting, since 0.0124208s), standbys: z, y 2024-09-12T01:28:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:28:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:28:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:28:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:28:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:28:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:28:04.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:28:04.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:28:04.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:28:04.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:28:04.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:28:04.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:28:04.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:28:04.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:28:04.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:28:04.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:28:04.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:28:04.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:28:04.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:28:04.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:28:04.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: Manager daemon x is now available 2024-09-12T01:28:04.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:04.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:28:04.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:04 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:28:04.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.802+0000 7f90e8337640 1 -- 172.21.15.81:0/4097216910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90e010a290 con 0x7f90e0102dd0 2024-09-12T01:28:04.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.802+0000 7f90d77fe640 1 -- 172.21.15.81:0/4097216910 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f90d0092350 con 0x7f90e0102dd0 2024-09-12T01:28:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:04.803 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:28:04.803 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:28:04.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.805+0000 7f90e8337640 1 -- 172.21.15.81:0/4097216910 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f90cc0a9880 msgr2=0x7f90cc0abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:04.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.805+0000 7f90e8337640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f90cc0a9880 0x7f90cc0abc70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f90e00fee00 tx=0x7f90dc005f90 comp rx=0 tx=0).stop 2024-09-12T01:28:04.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.805+0000 7f90e8337640 1 -- 172.21.15.81:0/4097216910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e0102dd0 msgr2=0x7f90e0198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:04.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.805+0000 7f90e8337640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e0102dd0 0x7f90e0198590 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f90d000d950 tx=0x7f90d000de10 comp rx=0 tx=0).stop 2024-09-12T01:28:04.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.805+0000 7f90e8337640 1 -- 172.21.15.81:0/4097216910 shutdown_connections 2024-09-12T01:28:04.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.805+0000 7f90e8337640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f90cc0a9880 0x7f90cc0abc70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:04.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.805+0000 7f90e8337640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90e0108300 0x7f90e019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:04.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.805+0000 7f90e8337640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90e0103780 0x7f90e0198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:04.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.805+0000 7f90e8337640 1 --2- 172.21.15.81:0/4097216910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e0102dd0 0x7f90e0198590 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:04.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.805+0000 7f90e8337640 1 -- 172.21.15.81:0/4097216910 >> 172.21.15.81:0/4097216910 conn(0x7f90e00fc7d0 msgr2=0x7f90e0105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:04.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.805+0000 7f90e8337640 1 -- 172.21.15.81:0/4097216910 shutdown_connections 2024-09-12T01:28:04.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:04.805+0000 7f90e8337640 1 -- 172.21.15.81:0/4097216910 wait complete. 2024-09-12T01:28:05.726 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:05.651+0000 7fefd0662640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:01:28:05] ENGINE Error in HTTPServer.serve 2024-09-12T01:28:05.726 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: Traceback (most recent call last): 2024-09-12T01:28:05.727 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:28:05.727 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: self._connections.run(self.expiration_interval) 2024-09-12T01:28:05.727 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:28:05.727 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: self._run(expiration_interval) 2024-09-12T01:28:05.727 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:28:05.727 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:28:05.727 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:28:05.727 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:28:05.727 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:28:05.727 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: s = self.context.wrap_socket( 2024-09-12T01:28:05.727 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:28:05.727 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: return self.sslsocket_class._create( 2024-09-12T01:28:05.727 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:28:05.728 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: self.do_handshake() 2024-09-12T01:28:05.728 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:28:05.728 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: self._sslobj.do_handshake() 2024-09-12T01:28:05.728 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:28:05.728 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:28:05.962 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:05 smithi100 ceph-mon[35275]: mgrmap e22: x(active, since 1.02786s), standbys: z, y 2024-09-12T01:28:05.962 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:05 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/4097216910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:05.962 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:05 smithi100 ceph-mon[35275]: [12/Sep/2024:01:28:05] ENGINE Bus STARTING 2024-09-12T01:28:05.962 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:05 smithi100 ceph-mon[35275]: [12/Sep/2024:01:28:05] ENGINE Serving on http://172.21.15.81:8765 2024-09-12T01:28:05.962 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:05 smithi100 ceph-mon[35275]: [12/Sep/2024:01:28:05] ENGINE Serving on https://172.21.15.81:7150 2024-09-12T01:28:05.963 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:05 smithi100 ceph-mon[35275]: [12/Sep/2024:01:28:05] ENGINE Bus STARTED 2024-09-12T01:28:05.963 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:05 smithi100 ceph-mon[35275]: [12/Sep/2024:01:28:05] ENGINE Error in HTTPServer.serve 2024-09-12T01:28:05.963 INFO:journalctl@ceph.mon.b.smithi100.stdout: Traceback (most recent call last): 2024-09-12T01:28:05.963 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:28:05.963 INFO:journalctl@ceph.mon.b.smithi100.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:28:05.963 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:28:05.963 INFO:journalctl@ceph.mon.b.smithi100.stdout: self._run(expiration_interval) 2024-09-12T01:28:05.963 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:28:05.963 INFO:journalctl@ceph.mon.b.smithi100.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:28:05.963 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:28:05.963 INFO:journalctl@ceph.mon.b.smithi100.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:28:05.963 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:28:05.963 INFO:journalctl@ceph.mon.b.smithi100.stdout: s = self.context.wrap_socket( 2024-09-12T01:28:05.964 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:28:05.964 INFO:journalctl@ceph.mon.b.smithi100.stdout: return self.sslsocket_class._create( 2024-09-12T01:28:05.964 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:28:05.964 INFO:journalctl@ceph.mon.b.smithi100.stdout: self.do_handshake() 2024-09-12T01:28:05.964 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:28:05.964 INFO:journalctl@ceph.mon.b.smithi100.stdout: self._sslobj.do_handshake() 2024-09-12T01:28:05.964 INFO:journalctl@ceph.mon.b.smithi100.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:28:05.964 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:05 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:05.964 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:05 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:05.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-mon[30920]: mgrmap e22: x(active, since 1.02786s), standbys: z, y 2024-09-12T01:28:05.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/4097216910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:05.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-mon[30920]: [12/Sep/2024:01:28:05] ENGINE Bus STARTING 2024-09-12T01:28:05.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-mon[30920]: [12/Sep/2024:01:28:05] ENGINE Serving on http://172.21.15.81:8765 2024-09-12T01:28:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-mon[30920]: [12/Sep/2024:01:28:05] ENGINE Serving on https://172.21.15.81:7150 2024-09-12T01:28:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-mon[30920]: [12/Sep/2024:01:28:05] ENGINE Bus STARTED 2024-09-12T01:28:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-mon[30920]: [12/Sep/2024:01:28:05] ENGINE Error in HTTPServer.serve 2024-09-12T01:28:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout: Traceback (most recent call last): 2024-09-12T01:28:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:28:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:28:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:28:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._run(expiration_interval) 2024-09-12T01:28:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:28:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:28:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:28:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:28:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:28:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout: s = self.context.wrap_socket( 2024-09-12T01:28:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:28:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout: return self.sslsocket_class._create( 2024-09-12T01:28:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:28:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout: self.do_handshake() 2024-09-12T01:28:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:28:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._sslobj.do_handshake() 2024-09-12T01:28:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:28:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:05.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:05 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:05 smithi189 ceph-mon[35357]: mgrmap e22: x(active, since 1.02786s), standbys: z, y 2024-09-12T01:28:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:05 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/4097216910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:05 smithi189 ceph-mon[35357]: [12/Sep/2024:01:28:05] ENGINE Bus STARTING 2024-09-12T01:28:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:05 smithi189 ceph-mon[35357]: [12/Sep/2024:01:28:05] ENGINE Serving on http://172.21.15.81:8765 2024-09-12T01:28:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:05 smithi189 ceph-mon[35357]: [12/Sep/2024:01:28:05] ENGINE Serving on https://172.21.15.81:7150 2024-09-12T01:28:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:05 smithi189 ceph-mon[35357]: [12/Sep/2024:01:28:05] ENGINE Bus STARTED 2024-09-12T01:28:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:05 smithi189 ceph-mon[35357]: [12/Sep/2024:01:28:05] ENGINE Error in HTTPServer.serve 2024-09-12T01:28:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout: Traceback (most recent call last): 2024-09-12T01:28:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:28:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:28:06.033 INFO:journalctl@ceph.mon.c.smithi189.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:28:06.033 INFO:journalctl@ceph.mon.c.smithi189.stdout: self._run(expiration_interval) 2024-09-12T01:28:06.033 INFO:journalctl@ceph.mon.c.smithi189.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:28:06.033 INFO:journalctl@ceph.mon.c.smithi189.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:28:06.033 INFO:journalctl@ceph.mon.c.smithi189.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:28:06.033 INFO:journalctl@ceph.mon.c.smithi189.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:28:06.033 INFO:journalctl@ceph.mon.c.smithi189.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:28:06.033 INFO:journalctl@ceph.mon.c.smithi189.stdout: s = self.context.wrap_socket( 2024-09-12T01:28:06.033 INFO:journalctl@ceph.mon.c.smithi189.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:28:06.033 INFO:journalctl@ceph.mon.c.smithi189.stdout: return self.sslsocket_class._create( 2024-09-12T01:28:06.033 INFO:journalctl@ceph.mon.c.smithi189.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:28:06.033 INFO:journalctl@ceph.mon.c.smithi189.stdout: self.do_handshake() 2024-09-12T01:28:06.033 INFO:journalctl@ceph.mon.c.smithi189.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:28:06.034 INFO:journalctl@ceph.mon.c.smithi189.stdout: self._sslobj.do_handshake() 2024-09-12T01:28:06.034 INFO:journalctl@ceph.mon.c.smithi189.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:28:06.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:05 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:06.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:05 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:06.195 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-12T01:28:06.195 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-12T01:28:06.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:28:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.303+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/739672473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d0103840 msgr2=0x7fe5d010a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.303+0000 7fe5d7b8d640 1 --2- 172.21.15.81:0/739672473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d0103840 0x7fe5d010a0d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009ca0 tx=0x7fe5c802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.303+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/739672473 shutdown_connections 2024-09-12T01:28:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.303+0000 7fe5d7b8d640 1 --2- 172.21.15.81:0/739672473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d0103840 0x7fe5d010a0d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.303+0000 7fe5d7b8d640 1 --2- 172.21.15.81:0/739672473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d0102e80 0x7fe5d0103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.303+0000 7fe5d7b8d640 1 --2- 172.21.15.81:0/739672473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d00ffe10 0x7fe5d0100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.303+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/739672473 >> 172.21.15.81:0/739672473 conn(0x7fe5d00fb950 msgr2=0x7fe5d00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.303+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/739672473 shutdown_connections 2024-09-12T01:28:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.303+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/739672473 wait complete. 2024-09-12T01:28:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.303+0000 7fe5d7b8d640 1 Processor -- start 2024-09-12T01:28:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.303+0000 7fe5d7b8d640 1 -- start start 2024-09-12T01:28:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d7b8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d00ffe10 0x7fe5d01027f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d7b8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d0102e80 0x7fe5d0100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d7b8d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d0103840 0x7fe5d0101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d7b8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d010d7b0 con 0x7fe5d00ffe10 2024-09-12T01:28:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d7b8d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d010d630 con 0x7fe5d0102e80 2024-09-12T01:28:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d7b8d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d010d930 con 0x7fe5d0103840 2024-09-12T01:28:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d5929640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d00ffe10 0x7fe5d01027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d5929640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d00ffe10 0x7fe5d01027f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40112/0 (socket says 172.21.15.81:40112) 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d5929640 1 -- 172.21.15.81:0/4178750169 learned_addr learned my addr 172.21.15.81:0/4178750169 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d5128640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d0102e80 0x7fe5d0100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d612a640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d0103840 0x7fe5d0101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d5929640 1 -- 172.21.15.81:0/4178750169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d0103840 msgr2=0x7fe5d0101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d5929640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d0103840 0x7fe5d0101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d5929640 1 -- 172.21.15.81:0/4178750169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d0102e80 msgr2=0x7fe5d0100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d5929640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d0102e80 0x7fe5d0100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d5929640 1 -- 172.21.15.81:0/4178750169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d0101c00 con 0x7fe5d00ffe10 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.304+0000 7fe5d5929640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d00ffe10 0x7fe5d01027f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00e9c0 tx=0x7fe5cc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.305+0000 7fe5c6ffd640 1 -- 172.21.15.81:0/4178750169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc00cd80 con 0x7fe5d00ffe10 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.305+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/4178750169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d01a1f20 con 0x7fe5d00ffe10 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.305+0000 7fe5c6ffd640 1 -- 172.21.15.81:0/4178750169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5cc0035f0 con 0x7fe5d00ffe10 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.305+0000 7fe5c6ffd640 1 -- 172.21.15.81:0/4178750169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc010690 con 0x7fe5d00ffe10 2024-09-12T01:28:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.305+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/4178750169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d01a2380 con 0x7fe5d00ffe10 2024-09-12T01:28:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.306+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/4178750169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d0109070 con 0x7fe5d00ffe10 2024-09-12T01:28:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.307+0000 7fe5c6ffd640 1 -- 172.21.15.81:0/4178750169 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7fe5cc0037a0 con 0x7fe5d00ffe10 2024-09-12T01:28:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.307+0000 7fe5c6ffd640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe5bc0a2a10 0x7fe5bc0a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.308+0000 7fe5c6ffd640 1 -- 172.21.15.81:0/4178750169 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe5cc0cf040 con 0x7fe5d00ffe10 2024-09-12T01:28:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.308+0000 7fe5d5128640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe5bc0a2a10 0x7fe5bc0a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.308+0000 7fe5d5128640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe5bc0a2a10 0x7fe5bc0a4ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0102560 tx=0x7fe5c0005f90 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.312+0000 7fe5c6ffd640 1 -- 172.21.15.81:0/4178750169 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe5cc09c1a0 con 0x7fe5d00ffe10 2024-09-12T01:28:06.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.531+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/4178750169 --> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5d0062630 con 0x7fe5bc0a2a10 2024-09-12T01:28:06.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.539+0000 7fe5c6ffd640 1 -- 172.21.15.81:0/4178750169 <== mgr.15222 v2:172.21.15.81:6800/1379528564 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257783 (secure 0 0 0) 0x7fe5d0062630 con 0x7fe5bc0a2a10 2024-09-12T01:28:06.543 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:06.544 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T01:28:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.542+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/4178750169 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe5bc0a2a10 msgr2=0x7fe5bc0a4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.542+0000 7fe5d7b8d640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe5bc0a2a10 0x7fe5bc0a4ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0102560 tx=0x7fe5c0005f90 comp rx=0 tx=0).stop 2024-09-12T01:28:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.543+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/4178750169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d00ffe10 msgr2=0x7fe5d01027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.543+0000 7fe5d7b8d640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d00ffe10 0x7fe5d01027f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00e9c0 tx=0x7fe5cc00ee80 comp rx=0 tx=0).stop 2024-09-12T01:28:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.543+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/4178750169 shutdown_connections 2024-09-12T01:28:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.543+0000 7fe5d7b8d640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe5bc0a2a10 0x7fe5bc0a4ed0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.543+0000 7fe5d7b8d640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5d0103840 0x7fe5d0101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.543+0000 7fe5d7b8d640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d0102e80 0x7fe5d0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.543+0000 7fe5d7b8d640 1 --2- 172.21.15.81:0/4178750169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d00ffe10 0x7fe5d01027f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.543+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/4178750169 >> 172.21.15.81:0/4178750169 conn(0x7fe5d00fb950 msgr2=0x7fe5d0106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.543+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/4178750169 shutdown_connections 2024-09-12T01:28:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.543+0000 7fe5d7b8d640 1 -- 172.21.15.81:0/4178750169 wait complete. 2024-09-12T01:28:06.555 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-12T01:28:05.729931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191127,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1277,"num_read_kb":806,"num_write":555,"num_write_kb":4402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180758,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":938,"ondisk_log_size":938,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380408,"kb_used_data":14488,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124561416,"statfs":{"total":1151940427776,"available":1151550889984,"internally_reserved":0,"allocated":14835712,"data_stored":8896584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.987671"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881117+0000","last_change":"2024-09-12T01:26:14.433907+0000","last_active":"2024-09-12T01:28:03.881117+0000","last_peered":"2024-09-12T01:28:03.881117+0000","last_clean":"2024-09-12T01:28:03.881117+0000","last_became_active":"2024-09-12T01:26:14.433495+0000","last_became_peered":"2024-09-12T01:26:14.433495+0000","last_unstale":"2024-09-12T01:28:03.881117+0000","last_undegraded":"2024-09-12T01:28:03.881117+0000","last_fullsized":"2024-09-12T01:28:03.881117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:12.836491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883125+0000","last_change":"2024-09-12T01:26:14.430873+0000","last_active":"2024-09-12T01:28:03.883125+0000","last_peered":"2024-09-12T01:28:03.883125+0000","last_clean":"2024-09-12T01:28:03.883125+0000","last_became_active":"2024-09-12T01:26:14.430572+0000","last_became_peered":"2024-09-12T01:26:14.430572+0000","last_unstale":"2024-09-12T01:28:03.883125+0000","last_undegraded":"2024-09-12T01:28:03.883125+0000","last_fullsized":"2024-09-12T01:28:03.883125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:15.160712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882818+0000","last_change":"2024-09-12T01:26:14.426117+0000","last_active":"2024-09-12T01:28:03.882818+0000","last_peered":"2024-09-12T01:28:03.882818+0000","last_clean":"2024-09-12T01:28:03.882818+0000","last_became_active":"2024-09-12T01:26:14.425831+0000","last_became_peered":"2024-09-12T01:26:14.425831+0000","last_unstale":"2024-09-12T01:28:03.882818+0000","last_undegraded":"2024-09-12T01:28:03.882818+0000","last_fullsized":"2024-09-12T01:28:03.882818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:15.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825114+0000","last_change":"2024-09-12T01:26:14.434545+0000","last_active":"2024-09-12T01:28:03.825114+0000","last_peered":"2024-09-12T01:28:03.825114+0000","last_clean":"2024-09-12T01:28:03.825114+0000","last_became_active":"2024-09-12T01:26:14.434222+0000","last_became_peered":"2024-09-12T01:26:14.434222+0000","last_unstale":"2024-09-12T01:28:03.825114+0000","last_undegraded":"2024-09-12T01:28:03.825114+0000","last_fullsized":"2024-09-12T01:28:03.825114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:36.789145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801925+0000","last_change":"2024-09-12T01:26:14.421900+0000","last_active":"2024-09-12T01:28:03.801925+0000","last_peered":"2024-09-12T01:28:03.801925+0000","last_clean":"2024-09-12T01:28:03.801925+0000","last_became_active":"2024-09-12T01:26:14.421558+0000","last_became_peered":"2024-09-12T01:26:14.421558+0000","last_unstale":"2024-09-12T01:28:03.801925+0000","last_undegraded":"2024-09-12T01:28:03.801925+0000","last_fullsized":"2024-09-12T01:28:03.801925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814207+0000","last_change":"2024-09-12T01:26:14.436641+0000","last_active":"2024-09-12T01:28:03.814207+0000","last_peered":"2024-09-12T01:28:03.814207+0000","last_clean":"2024-09-12T01:28:03.814207+0000","last_became_active":"2024-09-12T01:26:14.436347+0000","last_became_peered":"2024-09-12T01:26:14.436347+0000","last_unstale":"2024-09-12T01:28:03.814207+0000","last_undegraded":"2024-09-12T01:28:03.814207+0000","last_fullsized":"2024-09-12T01:28:03.814207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:52.756035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940185+0000","last_change":"2024-09-12T01:26:14.438676+0000","last_active":"2024-09-12T01:28:03.940185+0000","last_peered":"2024-09-12T01:28:03.940185+0000","last_clean":"2024-09-12T01:28:03.940185+0000","last_became_active":"2024-09-12T01:26:14.438332+0000","last_became_peered":"2024-09-12T01:26:14.438332+0000","last_unstale":"2024-09-12T01:28:03.940185+0000","last_undegraded":"2024-09-12T01:28:03.940185+0000","last_fullsized":"2024-09-12T01:28:03.940185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:06.459830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802047+0000","last_change":"2024-09-12T01:26:14.431676+0000","last_active":"2024-09-12T01:28:03.802047+0000","last_peered":"2024-09-12T01:28:03.802047+0000","last_clean":"2024-09-12T01:28:03.802047+0000","last_became_active":"2024-09-12T01:26:14.431378+0000","last_became_peered":"2024-09-12T01:26:14.431378+0000","last_unstale":"2024-09-12T01:28:03.802047+0000","last_undegraded":"2024-09-12T01:28:03.802047+0000","last_fullsized":"2024-09-12T01:28:03.802047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:23.523350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717979+0000","last_change":"2024-09-12T01:26:14.428381+0000","last_active":"2024-09-12T01:28:03.717979+0000","last_peered":"2024-09-12T01:28:03.717979+0000","last_clean":"2024-09-12T01:28:03.717979+0000","last_became_active":"2024-09-12T01:26:14.428031+0000","last_became_peered":"2024-09-12T01:26:14.428031+0000","last_unstale":"2024-09-12T01:28:03.717979+0000","last_undegraded":"2024-09-12T01:28:03.717979+0000","last_fullsized":"2024-09-12T01:28:03.717979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:40.920911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814620+0000","last_change":"2024-09-12T01:26:14.438849+0000","last_active":"2024-09-12T01:28:03.814620+0000","last_peered":"2024-09-12T01:28:03.814620+0000","last_clean":"2024-09-12T01:28:03.814620+0000","last_became_active":"2024-09-12T01:26:14.438510+0000","last_became_peered":"2024-09-12T01:26:14.438510+0000","last_unstale":"2024-09-12T01:28:03.814620+0000","last_undegraded":"2024-09-12T01:28:03.814620+0000","last_fullsized":"2024-09-12T01:28:03.814620+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:12.257292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940484+0000","last_change":"2024-09-12T01:26:14.436468+0000","last_active":"2024-09-12T01:28:03.940484+0000","last_peered":"2024-09-12T01:28:03.940484+0000","last_clean":"2024-09-12T01:28:03.940484+0000","last_became_active":"2024-09-12T01:26:14.436095+0000","last_became_peered":"2024-09-12T01:26:14.436095+0000","last_unstale":"2024-09-12T01:28:03.940484+0000","last_undegraded":"2024-09-12T01:28:03.940484+0000","last_fullsized":"2024-09-12T01:28:03.940484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:43.441358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825119+0000","last_change":"2024-09-12T01:26:14.431384+0000","last_active":"2024-09-12T01:28:03.825119+0000","last_peered":"2024-09-12T01:28:03.825119+0000","last_clean":"2024-09-12T01:28:03.825119+0000","last_became_active":"2024-09-12T01:26:14.431079+0000","last_became_peered":"2024-09-12T01:26:14.431079+0000","last_unstale":"2024-09-12T01:28:03.825119+0000","last_undegraded":"2024-09-12T01:28:03.825119+0000","last_fullsized":"2024-09-12T01:28:03.825119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.178038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882393+0000","last_change":"2024-09-12T01:26:14.430163+0000","last_active":"2024-09-12T01:28:03.882393+0000","last_peered":"2024-09-12T01:28:03.882393+0000","last_clean":"2024-09-12T01:28:03.882393+0000","last_became_active":"2024-09-12T01:26:14.429863+0000","last_became_peered":"2024-09-12T01:26:14.429863+0000","last_unstale":"2024-09-12T01:28:03.882393+0000","last_undegraded":"2024-09-12T01:28:03.882393+0000","last_fullsized":"2024-09-12T01:28:03.882393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:44.432677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882103+0000","last_change":"2024-09-12T01:26:14.427304+0000","last_active":"2024-09-12T01:28:03.882103+0000","last_peered":"2024-09-12T01:28:03.882103+0000","last_clean":"2024-09-12T01:28:03.882103+0000","last_became_active":"2024-09-12T01:26:14.427006+0000","last_became_peered":"2024-09-12T01:26:14.427006+0000","last_unstale":"2024-09-12T01:28:03.882103+0000","last_undegraded":"2024-09-12T01:28:03.882103+0000","last_fullsized":"2024-09-12T01:28:03.882103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.930959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881815+0000","last_change":"2024-09-12T01:26:14.431018+0000","last_active":"2024-09-12T01:28:03.881815+0000","last_peered":"2024-09-12T01:28:03.881815+0000","last_clean":"2024-09-12T01:28:03.881815+0000","last_became_active":"2024-09-12T01:26:14.429518+0000","last_became_peered":"2024-09-12T01:26:14.429518+0000","last_unstale":"2024-09-12T01:28:03.881815+0000","last_undegraded":"2024-09-12T01:28:03.881815+0000","last_fullsized":"2024-09-12T01:28:03.881815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.504814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717400+0000","last_change":"2024-09-12T01:26:14.430601+0000","last_active":"2024-09-12T01:28:03.717400+0000","last_peered":"2024-09-12T01:28:03.717400+0000","last_clean":"2024-09-12T01:28:03.717400+0000","last_became_active":"2024-09-12T01:26:14.430304+0000","last_became_peered":"2024-09-12T01:26:14.430304+0000","last_unstale":"2024-09-12T01:28:03.717400+0000","last_undegraded":"2024-09-12T01:28:03.717400+0000","last_fullsized":"2024-09-12T01:28:03.717400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.414767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881148+0000","last_change":"2024-09-12T01:26:14.432934+0000","last_active":"2024-09-12T01:28:03.881148+0000","last_peered":"2024-09-12T01:28:03.881148+0000","last_clean":"2024-09-12T01:28:03.881148+0000","last_became_active":"2024-09-12T01:26:14.432417+0000","last_became_peered":"2024-09-12T01:26:14.432417+0000","last_unstale":"2024-09-12T01:28:03.881148+0000","last_undegraded":"2024-09-12T01:28:03.881148+0000","last_fullsized":"2024-09-12T01:28:03.881148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.964880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716779+0000","last_change":"2024-09-12T01:26:14.429956+0000","last_active":"2024-09-12T01:28:03.716779+0000","last_peered":"2024-09-12T01:28:03.716779+0000","last_clean":"2024-09-12T01:28:03.716779+0000","last_became_active":"2024-09-12T01:26:14.429610+0000","last_became_peered":"2024-09-12T01:26:14.429610+0000","last_unstale":"2024-09-12T01:28:03.716779+0000","last_undegraded":"2024-09-12T01:28:03.716779+0000","last_fullsized":"2024-09-12T01:28:03.716779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:51.453221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720646+0000","last_change":"2024-09-12T01:26:14.423624+0000","last_active":"2024-09-12T01:28:03.720646+0000","last_peered":"2024-09-12T01:28:03.720646+0000","last_clean":"2024-09-12T01:28:03.720646+0000","last_became_active":"2024-09-12T01:26:14.423314+0000","last_became_peered":"2024-09-12T01:26:14.423314+0000","last_unstale":"2024-09-12T01:28:03.720646+0000","last_undegraded":"2024-09-12T01:28:03.720646+0000","last_fullsized":"2024-09-12T01:28:03.720646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.414323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880810+0000","last_change":"2024-09-12T01:26:14.433548+0000","last_active":"2024-09-12T01:28:03.880810+0000","last_peered":"2024-09-12T01:28:03.880810+0000","last_clean":"2024-09-12T01:28:03.880810+0000","last_became_active":"2024-09-12T01:26:14.433223+0000","last_became_peered":"2024-09-12T01:26:14.433223+0000","last_unstale":"2024-09-12T01:28:03.880810+0000","last_undegraded":"2024-09-12T01:28:03.880810+0000","last_fullsized":"2024-09-12T01:28:03.880810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.247354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882535+0000","last_change":"2024-09-12T01:26:14.431715+0000","last_active":"2024-09-12T01:28:03.882535+0000","last_peered":"2024-09-12T01:28:03.882535+0000","last_clean":"2024-09-12T01:28:03.882535+0000","last_became_active":"2024-09-12T01:26:14.430839+0000","last_became_peered":"2024-09-12T01:26:14.430839+0000","last_unstale":"2024-09-12T01:28:03.882535+0000","last_undegraded":"2024-09-12T01:28:03.882535+0000","last_fullsized":"2024-09-12T01:28:03.882535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:04.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717611+0000","last_change":"2024-09-12T01:26:14.431385+0000","last_active":"2024-09-12T01:28:03.717611+0000","last_peered":"2024-09-12T01:28:03.717611+0000","last_clean":"2024-09-12T01:28:03.717611+0000","last_became_active":"2024-09-12T01:26:14.431046+0000","last_became_peered":"2024-09-12T01:26:14.431046+0000","last_unstale":"2024-09-12T01:28:03.717611+0000","last_undegraded":"2024-09-12T01:28:03.717611+0000","last_fullsized":"2024-09-12T01:28:03.717611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:42.495019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802146+0000","last_change":"2024-09-12T01:26:14.427737+0000","last_active":"2024-09-12T01:28:03.802146+0000","last_peered":"2024-09-12T01:28:03.802146+0000","last_clean":"2024-09-12T01:28:03.802146+0000","last_became_active":"2024-09-12T01:26:14.427409+0000","last_became_peered":"2024-09-12T01:26:14.427409+0000","last_unstale":"2024-09-12T01:28:03.802146+0000","last_undegraded":"2024-09-12T01:28:03.802146+0000","last_fullsized":"2024-09-12T01:28:03.802146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:02.632914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811345+0000","last_change":"2024-09-12T01:26:14.433426+0000","last_active":"2024-09-12T01:28:03.811345+0000","last_peered":"2024-09-12T01:28:03.811345+0000","last_clean":"2024-09-12T01:28:03.811345+0000","last_became_active":"2024-09-12T01:26:14.431918+0000","last_became_peered":"2024-09-12T01:26:14.431918+0000","last_unstale":"2024-09-12T01:28:03.811345+0000","last_undegraded":"2024-09-12T01:28:03.811345+0000","last_fullsized":"2024-09-12T01:28:03.811345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.946072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716825+0000","last_change":"2024-09-12T01:26:26.268358+0000","last_active":"2024-09-12T01:28:03.716825+0000","last_peered":"2024-09-12T01:28:03.716825+0000","last_clean":"2024-09-12T01:28:03.716825+0000","last_became_active":"2024-09-12T01:26:26.268005+0000","last_became_peered":"2024-09-12T01:26:26.268005+0000","last_unstale":"2024-09-12T01:28:03.716825+0000","last_undegraded":"2024-09-12T01:28:03.716825+0000","last_fullsized":"2024-09-12T01:28:03.716825+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:53.977249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720710+0000","last_change":"2024-09-12T01:26:14.434536+0000","last_active":"2024-09-12T01:28:03.720710+0000","last_peered":"2024-09-12T01:28:03.720710+0000","last_clean":"2024-09-12T01:28:03.720710+0000","last_became_active":"2024-09-12T01:26:14.434148+0000","last_became_peered":"2024-09-12T01:26:14.434148+0000","last_unstale":"2024-09-12T01:28:03.720710+0000","last_undegraded":"2024-09-12T01:28:03.720710+0000","last_fullsized":"2024-09-12T01:28:03.720710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:47.576827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880923+0000","last_change":"2024-09-12T01:26:14.428040+0000","last_active":"2024-09-12T01:28:03.880923+0000","last_peered":"2024-09-12T01:28:03.880923+0000","last_clean":"2024-09-12T01:28:03.880923+0000","last_became_active":"2024-09-12T01:26:14.427709+0000","last_became_peered":"2024-09-12T01:26:14.427709+0000","last_unstale":"2024-09-12T01:28:03.880923+0000","last_undegraded":"2024-09-12T01:28:03.880923+0000","last_fullsized":"2024-09-12T01:28:03.880923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.256097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882750+0000","last_change":"2024-09-12T01:26:26.265649+0000","last_active":"2024-09-12T01:28:03.882750+0000","last_peered":"2024-09-12T01:28:03.882750+0000","last_clean":"2024-09-12T01:28:03.882750+0000","last_became_active":"2024-09-12T01:26:26.265251+0000","last_became_peered":"2024-09-12T01:26:26.265251+0000","last_unstale":"2024-09-12T01:28:03.882750+0000","last_undegraded":"2024-09-12T01:28:03.882750+0000","last_fullsized":"2024-09-12T01:28:03.882750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:31.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882448+0000","last_change":"2024-09-12T01:26:14.427596+0000","last_active":"2024-09-12T01:28:03.882448+0000","last_peered":"2024-09-12T01:28:03.882448+0000","last_clean":"2024-09-12T01:28:03.882448+0000","last_became_active":"2024-09-12T01:26:14.427291+0000","last_became_peered":"2024-09-12T01:26:14.427291+0000","last_unstale":"2024-09-12T01:28:03.882448+0000","last_undegraded":"2024-09-12T01:28:03.882448+0000","last_fullsized":"2024-09-12T01:28:03.882448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:51.529835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720369+0000","last_change":"2024-09-12T01:26:14.424197+0000","last_active":"2024-09-12T01:28:03.720369+0000","last_peered":"2024-09-12T01:28:03.720369+0000","last_clean":"2024-09-12T01:28:03.720369+0000","last_became_active":"2024-09-12T01:26:14.423422+0000","last_became_peered":"2024-09-12T01:26:14.423422+0000","last_unstale":"2024-09-12T01:28:03.720369+0000","last_undegraded":"2024-09-12T01:28:03.720369+0000","last_fullsized":"2024-09-12T01:28:03.720369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.725623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720421+0000","last_change":"2024-09-12T01:26:14.428116+0000","last_active":"2024-09-12T01:28:03.720421+0000","last_peered":"2024-09-12T01:28:03.720421+0000","last_clean":"2024-09-12T01:28:03.720421+0000","last_became_active":"2024-09-12T01:26:14.427804+0000","last_became_peered":"2024-09-12T01:26:14.427804+0000","last_unstale":"2024-09-12T01:28:03.720421+0000","last_undegraded":"2024-09-12T01:28:03.720421+0000","last_fullsized":"2024-09-12T01:28:03.720421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:02.271305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880755+0000","last_change":"2024-09-12T01:26:14.432659+0000","last_active":"2024-09-12T01:28:03.880755+0000","last_peered":"2024-09-12T01:28:03.880755+0000","last_clean":"2024-09-12T01:28:03.880755+0000","last_became_active":"2024-09-12T01:26:14.432331+0000","last_became_peered":"2024-09-12T01:26:14.432331+0000","last_unstale":"2024-09-12T01:28:03.880755+0000","last_undegraded":"2024-09-12T01:28:03.880755+0000","last_fullsized":"2024-09-12T01:28:03.880755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.868909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801888+0000","last_change":"2024-09-12T01:26:14.426167+0000","last_active":"2024-09-12T01:28:03.801888+0000","last_peered":"2024-09-12T01:28:03.801888+0000","last_clean":"2024-09-12T01:28:03.801888+0000","last_became_active":"2024-09-12T01:26:14.425847+0000","last_became_peered":"2024-09-12T01:26:14.425847+0000","last_unstale":"2024-09-12T01:28:03.801888+0000","last_undegraded":"2024-09-12T01:28:03.801888+0000","last_fullsized":"2024-09-12T01:28:03.801888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:39.481527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.399114+0000","last_change":"2024-09-12T01:26:12.421487+0000","last_active":"2024-09-12T01:28:04.399114+0000","last_peered":"2024-09-12T01:28:04.399114+0000","last_clean":"2024-09-12T01:28:04.399114+0000","last_became_active":"2024-09-12T01:26:12.421096+0000","last_became_peered":"2024-09-12T01:26:12.421096+0000","last_unstale":"2024-09-12T01:28:04.399114+0000","last_undegraded":"2024-09-12T01:28:04.399114+0000","last_fullsized":"2024-09-12T01:28:04.399114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:12.410280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811514+0000","last_change":"2024-09-12T01:26:26.270310+0000","last_active":"2024-09-12T01:28:03.811514+0000","last_peered":"2024-09-12T01:28:03.811514+0000","last_clean":"2024-09-12T01:28:03.811514+0000","last_became_active":"2024-09-12T01:26:26.269917+0000","last_became_peered":"2024-09-12T01:26:26.269917+0000","last_unstale":"2024-09-12T01:28:03.811514+0000","last_undegraded":"2024-09-12T01:28:03.811514+0000","last_fullsized":"2024-09-12T01:28:03.811514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:29.549456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814260+0000","last_change":"2024-09-12T01:26:26.287218+0000","last_active":"2024-09-12T01:28:03.814260+0000","last_peered":"2024-09-12T01:28:03.814260+0000","last_clean":"2024-09-12T01:28:03.814260+0000","last_became_active":"2024-09-12T01:26:26.282251+0000","last_became_peered":"2024-09-12T01:26:26.282251+0000","last_unstale":"2024-09-12T01:28:03.814260+0000","last_undegraded":"2024-09-12T01:28:03.814260+0000","last_fullsized":"2024-09-12T01:28:03.814260+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:53.888064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883469+0000","last_change":"2024-09-12T01:26:12.416100+0000","last_active":"2024-09-12T01:28:03.883469+0000","last_peered":"2024-09-12T01:28:03.883469+0000","last_clean":"2024-09-12T01:28:03.883469+0000","last_became_active":"2024-09-12T01:26:12.415799+0000","last_became_peered":"2024-09-12T01:26:12.415799+0000","last_unstale":"2024-09-12T01:28:03.883469+0000","last_undegraded":"2024-09-12T01:28:03.883469+0000","last_fullsized":"2024-09-12T01:28:03.883469+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:41.826537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802089+0000","last_change":"2024-09-12T01:26:14.424922+0000","last_active":"2024-09-12T01:28:03.802089+0000","last_peered":"2024-09-12T01:28:03.802089+0000","last_clean":"2024-09-12T01:28:03.802089+0000","last_became_active":"2024-09-12T01:26:14.424580+0000","last_became_peered":"2024-09-12T01:26:14.424580+0000","last_unstale":"2024-09-12T01:28:03.802089+0000","last_undegraded":"2024-09-12T01:28:03.802089+0000","last_fullsized":"2024-09-12T01:28:03.802089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:05.697287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811489+0000","last_change":"2024-09-12T01:26:12.419339+0000","last_active":"2024-09-12T01:28:03.811489+0000","last_peered":"2024-09-12T01:28:03.811489+0000","last_clean":"2024-09-12T01:28:03.811489+0000","last_became_active":"2024-09-12T01:26:12.418925+0000","last_became_peered":"2024-09-12T01:26:12.418925+0000","last_unstale":"2024-09-12T01:28:03.811489+0000","last_undegraded":"2024-09-12T01:28:03.811489+0000","last_fullsized":"2024-09-12T01:28:03.811489+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.390691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716540+0000","last_change":"2024-09-12T01:26:14.426611+0000","last_active":"2024-09-12T01:28:03.716540+0000","last_peered":"2024-09-12T01:28:03.716540+0000","last_clean":"2024-09-12T01:28:03.716540+0000","last_became_active":"2024-09-12T01:26:14.426268+0000","last_became_peered":"2024-09-12T01:26:14.426268+0000","last_unstale":"2024-09-12T01:28:03.716540+0000","last_undegraded":"2024-09-12T01:28:03.716540+0000","last_fullsized":"2024-09-12T01:28:03.716540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:34.676841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":230,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.398504+0000","last_change":"2024-09-12T01:26:12.420302+0000","last_active":"2024-09-12T01:28:04.398504+0000","last_peered":"2024-09-12T01:28:04.398504+0000","last_clean":"2024-09-12T01:28:04.398504+0000","last_became_active":"2024-09-12T01:26:12.419943+0000","last_became_peered":"2024-09-12T01:26:12.419943+0000","last_unstale":"2024-09-12T01:28:04.398504+0000","last_undegraded":"2024-09-12T01:28:04.398504+0000","last_fullsized":"2024-09-12T01:28:04.398504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:30.704272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717828+0000","last_change":"2024-09-12T01:26:14.433112+0000","last_active":"2024-09-12T01:28:03.717828+0000","last_peered":"2024-09-12T01:28:03.717828+0000","last_clean":"2024-09-12T01:28:03.717828+0000","last_became_active":"2024-09-12T01:26:14.432803+0000","last_became_peered":"2024-09-12T01:26:14.432803+0000","last_unstale":"2024-09-12T01:28:03.717828+0000","last_undegraded":"2024-09-12T01:28:03.717828+0000","last_fullsized":"2024-09-12T01:28:03.717828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:33.670485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940319+0000","last_change":"2024-09-12T01:26:12.424854+0000","last_active":"2024-09-12T01:28:03.940319+0000","last_peered":"2024-09-12T01:28:03.940319+0000","last_clean":"2024-09-12T01:28:03.940319+0000","last_became_active":"2024-09-12T01:26:12.424476+0000","last_became_peered":"2024-09-12T01:26:12.424476+0000","last_unstale":"2024-09-12T01:28:03.940319+0000","last_undegraded":"2024-09-12T01:28:03.940319+0000","last_fullsized":"2024-09-12T01:28:03.940319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:03.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883795+0000","last_change":"2024-09-12T01:26:14.431580+0000","last_active":"2024-09-12T01:28:03.883795+0000","last_peered":"2024-09-12T01:28:03.883795+0000","last_clean":"2024-09-12T01:28:03.883795+0000","last_became_active":"2024-09-12T01:26:14.431237+0000","last_became_peered":"2024-09-12T01:26:14.431237+0000","last_unstale":"2024-09-12T01:28:03.883795+0000","last_undegraded":"2024-09-12T01:28:03.883795+0000","last_fullsized":"2024-09-12T01:28:03.883795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:32.562156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811710+0000","last_change":"2024-09-12T01:26:12.802015+0000","last_active":"2024-09-12T01:28:03.811710+0000","last_peered":"2024-09-12T01:28:03.811710+0000","last_clean":"2024-09-12T01:28:03.811710+0000","last_became_active":"2024-09-12T01:26:12.801605+0000","last_became_peered":"2024-09-12T01:26:12.801605+0000","last_unstale":"2024-09-12T01:28:03.811710+0000","last_undegraded":"2024-09-12T01:28:03.811710+0000","last_fullsized":"2024-09-12T01:28:03.811710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:24.703911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717615+0000","last_change":"2024-09-12T01:26:14.433305+0000","last_active":"2024-09-12T01:28:03.717615+0000","last_peered":"2024-09-12T01:28:03.717615+0000","last_clean":"2024-09-12T01:28:03.717615+0000","last_became_active":"2024-09-12T01:26:14.432989+0000","last_became_peered":"2024-09-12T01:26:14.432989+0000","last_unstale":"2024-09-12T01:28:03.717615+0000","last_undegraded":"2024-09-12T01:28:03.717615+0000","last_fullsized":"2024-09-12T01:28:03.717615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:45.741460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":273,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.399459+0000","last_change":"2024-09-12T01:26:12.423148+0000","last_active":"2024-09-12T01:28:04.399459+0000","last_peered":"2024-09-12T01:28:04.399459+0000","last_clean":"2024-09-12T01:28:04.399459+0000","last_became_active":"2024-09-12T01:26:12.422754+0000","last_became_peered":"2024-09-12T01:26:12.422754+0000","last_unstale":"2024-09-12T01:28:04.399459+0000","last_undegraded":"2024-09-12T01:28:04.399459+0000","last_fullsized":"2024-09-12T01:28:04.399459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:01.017125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":172,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802221+0000","last_change":"2024-09-12T01:26:14.431568+0000","last_active":"2024-09-12T01:28:03.802221+0000","last_peered":"2024-09-12T01:28:03.802221+0000","last_clean":"2024-09-12T01:28:03.802221+0000","last_became_active":"2024-09-12T01:26:14.431215+0000","last_became_peered":"2024-09-12T01:26:14.431215+0000","last_unstale":"2024-09-12T01:28:03.802221+0000","last_undegraded":"2024-09-12T01:28:03.802221+0000","last_fullsized":"2024-09-12T01:28:03.802221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.552147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720527+0000","last_change":"2024-09-12T01:26:12.421986+0000","last_active":"2024-09-12T01:28:03.720527+0000","last_peered":"2024-09-12T01:28:03.720527+0000","last_clean":"2024-09-12T01:28:03.720527+0000","last_became_active":"2024-09-12T01:26:12.421391+0000","last_became_peered":"2024-09-12T01:26:12.421391+0000","last_unstale":"2024-09-12T01:28:03.720527+0000","last_undegraded":"2024-09-12T01:28:03.720527+0000","last_fullsized":"2024-09-12T01:28:03.720527+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:20.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881940+0000","last_change":"2024-09-12T01:26:14.431435+0000","last_active":"2024-09-12T01:28:03.881940+0000","last_peered":"2024-09-12T01:28:03.881940+0000","last_clean":"2024-09-12T01:28:03.881940+0000","last_became_active":"2024-09-12T01:26:14.431143+0000","last_became_peered":"2024-09-12T01:26:14.431143+0000","last_unstale":"2024-09-12T01:28:03.881940+0000","last_undegraded":"2024-09-12T01:28:03.881940+0000","last_fullsized":"2024-09-12T01:28:03.881940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:58.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811440+0000","last_change":"2024-09-12T01:26:12.423972+0000","last_active":"2024-09-12T01:28:03.811440+0000","last_peered":"2024-09-12T01:28:03.811440+0000","last_clean":"2024-09-12T01:28:03.811440+0000","last_became_active":"2024-09-12T01:26:12.423594+0000","last_became_peered":"2024-09-12T01:26:12.423594+0000","last_unstale":"2024-09-12T01:28:03.811440+0000","last_undegraded":"2024-09-12T01:28:03.811440+0000","last_fullsized":"2024-09-12T01:28:03.811440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:37.783478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940307+0000","last_change":"2024-09-12T01:26:14.437207+0000","last_active":"2024-09-12T01:28:03.940307+0000","last_peered":"2024-09-12T01:28:03.940307+0000","last_clean":"2024-09-12T01:28:03.940307+0000","last_became_active":"2024-09-12T01:26:14.436940+0000","last_became_peered":"2024-09-12T01:26:14.436940+0000","last_unstale":"2024-09-12T01:28:03.940307+0000","last_undegraded":"2024-09-12T01:28:03.940307+0000","last_fullsized":"2024-09-12T01:28:03.940307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:34.454446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'9","reported_seq":139,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.401958+0000","last_change":"2024-09-12T01:26:12.420247+0000","last_active":"2024-09-12T01:28:04.401958+0000","last_peered":"2024-09-12T01:28:04.401958+0000","last_clean":"2024-09-12T01:28:04.401958+0000","last_became_active":"2024-09-12T01:26:12.419825+0000","last_became_peered":"2024-09-12T01:26:12.419825+0000","last_unstale":"2024-09-12T01:28:04.401958+0000","last_undegraded":"2024-09-12T01:28:04.401958+0000","last_fullsized":"2024-09-12T01:28:04.401958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:26.746225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":6,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940127+0000","last_change":"2024-09-12T01:26:14.439019+0000","last_active":"2024-09-12T01:28:03.940127+0000","last_peered":"2024-09-12T01:28:03.940127+0000","last_clean":"2024-09-12T01:28:03.940127+0000","last_became_active":"2024-09-12T01:26:14.438714+0000","last_became_peered":"2024-09-12T01:26:14.438714+0000","last_unstale":"2024-09-12T01:28:03.940127+0000","last_undegraded":"2024-09-12T01:28:03.940127+0000","last_fullsized":"2024-09-12T01:28:03.940127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.321464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801873+0000","last_change":"2024-09-12T01:26:12.800529+0000","last_active":"2024-09-12T01:28:03.801873+0000","last_peered":"2024-09-12T01:28:03.801873+0000","last_clean":"2024-09-12T01:28:03.801873+0000","last_became_active":"2024-09-12T01:26:12.800104+0000","last_became_peered":"2024-09-12T01:26:12.800104+0000","last_unstale":"2024-09-12T01:28:03.801873+0000","last_undegraded":"2024-09-12T01:28:03.801873+0000","last_fullsized":"2024-09-12T01:28:03.801873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.624321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811417+0000","last_change":"2024-09-12T01:26:14.435283+0000","last_active":"2024-09-12T01:28:03.811417+0000","last_peered":"2024-09-12T01:28:03.811417+0000","last_clean":"2024-09-12T01:28:03.811417+0000","last_became_active":"2024-09-12T01:26:14.434414+0000","last_became_peered":"2024-09-12T01:26:14.434414+0000","last_unstale":"2024-09-12T01:28:03.811417+0000","last_undegraded":"2024-09-12T01:28:03.811417+0000","last_fullsized":"2024-09-12T01:28:03.811417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.959405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'3","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881086+0000","last_change":"2024-09-12T01:26:26.273053+0000","last_active":"2024-09-12T01:28:03.881086+0000","last_peered":"2024-09-12T01:28:03.881086+0000","last_clean":"2024-09-12T01:28:03.881086+0000","last_became_active":"2024-09-12T01:26:26.267178+0000","last_became_peered":"2024-09-12T01:26:26.267178+0000","last_unstale":"2024-09-12T01:28:03.881086+0000","last_undegraded":"2024-09-12T01:28:03.881086+0000","last_fullsized":"2024-09-12T01:28:03.881086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:08.138485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880948+0000","last_change":"2024-09-12T01:26:14.433527+0000","last_active":"2024-09-12T01:28:03.880948+0000","last_peered":"2024-09-12T01:28:03.880948+0000","last_clean":"2024-09-12T01:28:03.880948+0000","last_became_active":"2024-09-12T01:26:14.433204+0000","last_became_peered":"2024-09-12T01:26:14.433204+0000","last_unstale":"2024-09-12T01:28:03.880948+0000","last_undegraded":"2024-09-12T01:28:03.880948+0000","last_fullsized":"2024-09-12T01:28:03.880948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:26.883916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883147+0000","last_change":"2024-09-12T01:26:12.420795+0000","last_active":"2024-09-12T01:28:03.883147+0000","last_peered":"2024-09-12T01:28:03.883147+0000","last_clean":"2024-09-12T01:28:03.883147+0000","last_became_active":"2024-09-12T01:26:12.420409+0000","last_became_peered":"2024-09-12T01:26:12.420409+0000","last_unstale":"2024-09-12T01:28:03.883147+0000","last_undegraded":"2024-09-12T01:28:03.883147+0000","last_fullsized":"2024-09-12T01:28:03.883147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:36.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940454+0000","last_change":"2024-09-12T01:26:14.440994+0000","last_active":"2024-09-12T01:28:03.940454+0000","last_peered":"2024-09-12T01:28:03.940454+0000","last_clean":"2024-09-12T01:28:03.940454+0000","last_became_active":"2024-09-12T01:26:14.440602+0000","last_became_peered":"2024-09-12T01:26:14.440602+0000","last_unstale":"2024-09-12T01:28:03.940454+0000","last_undegraded":"2024-09-12T01:28:03.940454+0000","last_fullsized":"2024-09-12T01:28:03.940454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.998991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'41","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.934193+0000","last_change":"2024-09-12T01:26:12.419448+0000","last_active":"2024-09-12T01:28:03.934193+0000","last_peered":"2024-09-12T01:28:03.934193+0000","last_clean":"2024-09-12T01:28:03.934193+0000","last_became_active":"2024-09-12T01:26:12.419000+0000","last_became_peered":"2024-09-12T01:26:12.419000+0000","last_unstale":"2024-09-12T01:28:03.934193+0000","last_undegraded":"2024-09-12T01:28:03.934193+0000","last_fullsized":"2024-09-12T01:28:03.934193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:37.818833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940268+0000","last_change":"2024-09-12T01:26:14.437818+0000","last_active":"2024-09-12T01:28:03.940268+0000","last_peered":"2024-09-12T01:28:03.940268+0000","last_clean":"2024-09-12T01:28:03.940268+0000","last_became_active":"2024-09-12T01:26:14.437497+0000","last_became_peered":"2024-09-12T01:26:14.437497+0000","last_unstale":"2024-09-12T01:28:03.940268+0000","last_undegraded":"2024-09-12T01:28:03.940268+0000","last_fullsized":"2024-09-12T01:28:03.940268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:57.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'7","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.663652+0000","last_change":"2024-09-12T01:26:12.855850+0000","last_active":"2024-09-12T01:28:04.663652+0000","last_peered":"2024-09-12T01:28:04.663652+0000","last_clean":"2024-09-12T01:28:04.663652+0000","last_became_active":"2024-09-12T01:26:12.855400+0000","last_became_peered":"2024-09-12T01:26:12.855400+0000","last_unstale":"2024-09-12T01:28:04.663652+0000","last_undegraded":"2024-09-12T01:28:04.663652+0000","last_fullsized":"2024-09-12T01:28:04.663652+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:32.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940460+0000","last_change":"2024-09-12T01:26:14.435982+0000","last_active":"2024-09-12T01:28:03.940460+0000","last_peered":"2024-09-12T01:28:03.940460+0000","last_clean":"2024-09-12T01:28:03.940460+0000","last_became_active":"2024-09-12T01:26:14.435595+0000","last_became_peered":"2024-09-12T01:26:14.435595+0000","last_unstale":"2024-09-12T01:28:03.940460+0000","last_undegraded":"2024-09-12T01:28:03.940460+0000","last_fullsized":"2024-09-12T01:28:03.940460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:31.101890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940390+0000","last_change":"2024-09-12T01:25:04.588449+0000","last_active":"2024-09-12T01:28:03.940390+0000","last_peered":"2024-09-12T01:28:03.940390+0000","last_clean":"2024-09-12T01:28:03.940390+0000","last_became_active":"2024-09-12T01:25:04.587949+0000","last_became_peered":"2024-09-12T01:25:04.587949+0000","last_unstale":"2024-09-12T01:28:03.940390+0000","last_undegraded":"2024-09-12T01:28:03.940390+0000","last_fullsized":"2024-09-12T01:28:03.940390+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_clean_scrub_stamp":"2024-09-12T01:21:41.345624+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:41.015289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825092+0000","last_change":"2024-09-12T01:26:12.421379+0000","last_active":"2024-09-12T01:28:03.825092+0000","last_peered":"2024-09-12T01:28:03.825092+0000","last_clean":"2024-09-12T01:28:03.825092+0000","last_became_active":"2024-09-12T01:26:12.421059+0000","last_became_peered":"2024-09-12T01:26:12.421059+0000","last_unstale":"2024-09-12T01:28:03.825092+0000","last_undegraded":"2024-09-12T01:28:03.825092+0000","last_fullsized":"2024-09-12T01:28:03.825092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802270+0000","last_change":"2024-09-12T01:26:14.430510+0000","last_active":"2024-09-12T01:28:03.802270+0000","last_peered":"2024-09-12T01:28:03.802270+0000","last_clean":"2024-09-12T01:28:03.802270+0000","last_became_active":"2024-09-12T01:26:14.430232+0000","last_became_peered":"2024-09-12T01:26:14.430232+0000","last_unstale":"2024-09-12T01:28:03.802270+0000","last_undegraded":"2024-09-12T01:28:03.802270+0000","last_fullsized":"2024-09-12T01:28:03.802270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:55.114616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940253+0000","last_change":"2024-09-12T01:26:12.420938+0000","last_active":"2024-09-12T01:28:03.940253+0000","last_peered":"2024-09-12T01:28:03.940253+0000","last_clean":"2024-09-12T01:28:03.940253+0000","last_became_active":"2024-09-12T01:26:12.420599+0000","last_became_peered":"2024-09-12T01:26:12.420599+0000","last_unstale":"2024-09-12T01:28:03.940253+0000","last_undegraded":"2024-09-12T01:28:03.940253+0000","last_fullsized":"2024-09-12T01:28:03.940253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.593237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883352+0000","last_change":"2024-09-12T01:26:14.428684+0000","last_active":"2024-09-12T01:28:03.883352+0000","last_peered":"2024-09-12T01:28:03.883352+0000","last_clean":"2024-09-12T01:28:03.883352+0000","last_became_active":"2024-09-12T01:26:14.428380+0000","last_became_peered":"2024-09-12T01:26:14.428380+0000","last_unstale":"2024-09-12T01:28:03.883352+0000","last_undegraded":"2024-09-12T01:28:03.883352+0000","last_fullsized":"2024-09-12T01:28:03.883352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:21.542122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883611+0000","last_change":"2024-09-12T01:26:12.800048+0000","last_active":"2024-09-12T01:28:03.883611+0000","last_peered":"2024-09-12T01:28:03.883611+0000","last_clean":"2024-09-12T01:28:03.883611+0000","last_became_active":"2024-09-12T01:26:12.799646+0000","last_became_peered":"2024-09-12T01:26:12.799646+0000","last_unstale":"2024-09-12T01:28:03.883611+0000","last_undegraded":"2024-09-12T01:28:03.883611+0000","last_fullsized":"2024-09-12T01:28:03.883611+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:39.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716527+0000","last_change":"2024-09-12T01:26:26.268110+0000","last_active":"2024-09-12T01:28:03.716527+0000","last_peered":"2024-09-12T01:28:03.716527+0000","last_clean":"2024-09-12T01:28:03.716527+0000","last_became_active":"2024-09-12T01:26:26.267764+0000","last_became_peered":"2024-09-12T01:26:26.267764+0000","last_unstale":"2024-09-12T01:28:03.716527+0000","last_undegraded":"2024-09-12T01:28:03.716527+0000","last_fullsized":"2024-09-12T01:28:03.716527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:37.009529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":131,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.618358+0000","last_change":"2024-09-12T01:26:12.424189+0000","last_active":"2024-09-12T01:28:04.618358+0000","last_peered":"2024-09-12T01:28:04.618358+0000","last_clean":"2024-09-12T01:28:04.618358+0000","last_became_active":"2024-09-12T01:26:12.423785+0000","last_became_peered":"2024-09-12T01:26:12.423785+0000","last_unstale":"2024-09-12T01:28:04.618358+0000","last_undegraded":"2024-09-12T01:28:04.618358+0000","last_fullsized":"2024-09-12T01:28:04.618358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:20.069821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814343+0000","last_change":"2024-09-12T01:26:14.437874+0000","last_active":"2024-09-12T01:28:03.814343+0000","last_peered":"2024-09-12T01:28:03.814343+0000","last_clean":"2024-09-12T01:28:03.814343+0000","last_became_active":"2024-09-12T01:26:14.437578+0000","last_became_peered":"2024-09-12T01:26:14.437578+0000","last_unstale":"2024-09-12T01:28:03.814343+0000","last_undegraded":"2024-09-12T01:28:03.814343+0000","last_fullsized":"2024-09-12T01:28:03.814343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:55.817763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716704+0000","last_change":"2024-09-12T01:26:26.267861+0000","last_active":"2024-09-12T01:28:03.716704+0000","last_peered":"2024-09-12T01:28:03.716704+0000","last_clean":"2024-09-12T01:28:03.716704+0000","last_became_active":"2024-09-12T01:26:26.267244+0000","last_became_peered":"2024-09-12T01:26:26.267244+0000","last_unstale":"2024-09-12T01:28:03.716704+0000","last_undegraded":"2024-09-12T01:28:03.716704+0000","last_fullsized":"2024-09-12T01:28:03.716704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:50.623916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814419+0000","last_change":"2024-09-12T01:26:14.434708+0000","last_active":"2024-09-12T01:28:03.814419+0000","last_peered":"2024-09-12T01:28:03.814419+0000","last_clean":"2024-09-12T01:28:03.814419+0000","last_became_active":"2024-09-12T01:26:14.434420+0000","last_became_peered":"2024-09-12T01:26:14.434420+0000","last_unstale":"2024-09-12T01:28:03.814419+0000","last_undegraded":"2024-09-12T01:28:03.814419+0000","last_fullsized":"2024-09-12T01:28:03.814419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:58.626769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802334+0000","last_change":"2024-09-12T01:26:12.800678+0000","last_active":"2024-09-12T01:28:03.802334+0000","last_peered":"2024-09-12T01:28:03.802334+0000","last_clean":"2024-09-12T01:28:03.802334+0000","last_became_active":"2024-09-12T01:26:12.800063+0000","last_became_peered":"2024-09-12T01:26:12.800063+0000","last_unstale":"2024-09-12T01:28:03.802334+0000","last_undegraded":"2024-09-12T01:28:03.802334+0000","last_fullsized":"2024-09-12T01:28:03.802334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:01.110686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882869+0000","last_change":"2024-09-12T01:26:14.425695+0000","last_active":"2024-09-12T01:28:03.882869+0000","last_peered":"2024-09-12T01:28:03.882869+0000","last_clean":"2024-09-12T01:28:03.882869+0000","last_became_active":"2024-09-12T01:26:14.425435+0000","last_became_peered":"2024-09-12T01:26:14.425435+0000","last_unstale":"2024-09-12T01:28:03.882869+0000","last_undegraded":"2024-09-12T01:28:03.882869+0000","last_fullsized":"2024-09-12T01:28:03.882869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:19.193669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'50","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.938195+0000","last_change":"2024-09-12T01:26:12.412743+0000","last_active":"2024-09-12T01:28:03.938195+0000","last_peered":"2024-09-12T01:28:03.938195+0000","last_clean":"2024-09-12T01:28:03.938195+0000","last_became_active":"2024-09-12T01:26:12.412376+0000","last_became_peered":"2024-09-12T01:26:12.412376+0000","last_unstale":"2024-09-12T01:28:03.938195+0000","last_undegraded":"2024-09-12T01:28:03.938195+0000","last_fullsized":"2024-09-12T01:28:03.938195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.542370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":89,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802661+0000","last_change":"2024-09-12T01:26:14.429727+0000","last_active":"2024-09-12T01:28:03.802661+0000","last_peered":"2024-09-12T01:28:03.802661+0000","last_clean":"2024-09-12T01:28:03.802661+0000","last_became_active":"2024-09-12T01:26:14.429385+0000","last_became_peered":"2024-09-12T01:26:14.429385+0000","last_unstale":"2024-09-12T01:28:03.802661+0000","last_undegraded":"2024-09-12T01:28:03.802661+0000","last_fullsized":"2024-09-12T01:28:03.802661+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:43.855786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825282+0000","last_change":"2024-09-12T01:26:12.855632+0000","last_active":"2024-09-12T01:28:03.825282+0000","last_peered":"2024-09-12T01:28:03.825282+0000","last_clean":"2024-09-12T01:28:03.825282+0000","last_became_active":"2024-09-12T01:26:12.855305+0000","last_became_peered":"2024-09-12T01:26:12.855305+0000","last_unstale":"2024-09-12T01:28:03.825282+0000","last_undegraded":"2024-09-12T01:28:03.825282+0000","last_fullsized":"2024-09-12T01:28:03.825282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.893689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883266+0000","last_change":"2024-09-12T01:26:14.428498+0000","last_active":"2024-09-12T01:28:03.883266+0000","last_peered":"2024-09-12T01:28:03.883266+0000","last_clean":"2024-09-12T01:28:03.883266+0000","last_became_active":"2024-09-12T01:26:14.428022+0000","last_became_peered":"2024-09-12T01:26:14.428022+0000","last_unstale":"2024-09-12T01:28:03.883266+0000","last_undegraded":"2024-09-12T01:28:03.883266+0000","last_fullsized":"2024-09-12T01:28:03.883266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.325399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717493+0000","last_change":"2024-09-12T01:26:12.800038+0000","last_active":"2024-09-12T01:28:03.717493+0000","last_peered":"2024-09-12T01:28:03.717493+0000","last_clean":"2024-09-12T01:28:03.717493+0000","last_became_active":"2024-09-12T01:26:12.799717+0000","last_became_peered":"2024-09-12T01:26:12.799717+0000","last_unstale":"2024-09-12T01:28:03.717493+0000","last_undegraded":"2024-09-12T01:28:03.717493+0000","last_fullsized":"2024-09-12T01:28:03.717493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.362437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801873+0000","last_change":"2024-09-12T01:26:14.430518+0000","last_active":"2024-09-12T01:28:03.801873+0000","last_peered":"2024-09-12T01:28:03.801873+0000","last_clean":"2024-09-12T01:28:03.801873+0000","last_became_active":"2024-09-12T01:26:14.430158+0000","last_became_peered":"2024-09-12T01:26:14.430158+0000","last_unstale":"2024-09-12T01:28:03.801873+0000","last_undegraded":"2024-09-12T01:28:03.801873+0000","last_fullsized":"2024-09-12T01:28:03.801873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:55.696101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802299+0000","last_change":"2024-09-12T01:26:12.418427+0000","last_active":"2024-09-12T01:28:03.802299+0000","last_peered":"2024-09-12T01:28:03.802299+0000","last_clean":"2024-09-12T01:28:03.802299+0000","last_became_active":"2024-09-12T01:26:12.418135+0000","last_became_peered":"2024-09-12T01:26:12.418135+0000","last_unstale":"2024-09-12T01:28:03.802299+0000","last_undegraded":"2024-09-12T01:28:03.802299+0000","last_fullsized":"2024-09-12T01:28:03.802299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:32.946485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880813+0000","last_change":"2024-09-12T01:26:14.425817+0000","last_active":"2024-09-12T01:28:03.880813+0000","last_peered":"2024-09-12T01:28:03.880813+0000","last_clean":"2024-09-12T01:28:03.880813+0000","last_became_active":"2024-09-12T01:26:14.425443+0000","last_became_peered":"2024-09-12T01:26:14.425443+0000","last_unstale":"2024-09-12T01:28:03.880813+0000","last_undegraded":"2024-09-12T01:28:03.880813+0000","last_fullsized":"2024-09-12T01:28:03.880813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720390+0000","last_change":"2024-09-12T01:26:12.422742+0000","last_active":"2024-09-12T01:28:03.720390+0000","last_peered":"2024-09-12T01:28:03.720390+0000","last_clean":"2024-09-12T01:28:03.720390+0000","last_became_active":"2024-09-12T01:26:12.421914+0000","last_became_peered":"2024-09-12T01:26:12.421914+0000","last_unstale":"2024-09-12T01:28:03.720390+0000","last_undegraded":"2024-09-12T01:28:03.720390+0000","last_fullsized":"2024-09-12T01:28:03.720390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:53.427112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802223+0000","last_change":"2024-09-12T01:26:14.430425+0000","last_active":"2024-09-12T01:28:03.802223+0000","last_peered":"2024-09-12T01:28:03.802223+0000","last_clean":"2024-09-12T01:28:03.802223+0000","last_became_active":"2024-09-12T01:26:14.430128+0000","last_became_peered":"2024-09-12T01:26:14.430128+0000","last_unstale":"2024-09-12T01:28:03.802223+0000","last_undegraded":"2024-09-12T01:28:03.802223+0000","last_fullsized":"2024-09-12T01:28:03.802223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:17.653908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802061+0000","last_change":"2024-09-12T01:26:12.421463+0000","last_active":"2024-09-12T01:28:03.802061+0000","last_peered":"2024-09-12T01:28:03.802061+0000","last_clean":"2024-09-12T01:28:03.802061+0000","last_became_active":"2024-09-12T01:26:12.421143+0000","last_became_peered":"2024-09-12T01:26:12.421143+0000","last_unstale":"2024-09-12T01:28:03.802061+0000","last_undegraded":"2024-09-12T01:28:03.802061+0000","last_fullsized":"2024-09-12T01:28:03.802061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:09.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940259+0000","last_change":"2024-09-12T01:26:14.428643+0000","last_active":"2024-09-12T01:28:03.940259+0000","last_peered":"2024-09-12T01:28:03.940259+0000","last_clean":"2024-09-12T01:28:03.940259+0000","last_became_active":"2024-09-12T01:26:14.428344+0000","last_became_peered":"2024-09-12T01:26:14.428344+0000","last_unstale":"2024-09-12T01:28:03.940259+0000","last_undegraded":"2024-09-12T01:28:03.940259+0000","last_fullsized":"2024-09-12T01:28:03.940259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:17.213238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811637+0000","last_change":"2024-09-12T01:26:14.435108+0000","last_active":"2024-09-12T01:28:03.811637+0000","last_peered":"2024-09-12T01:28:03.811637+0000","last_clean":"2024-09-12T01:28:03.811637+0000","last_became_active":"2024-09-12T01:26:14.434806+0000","last_became_peered":"2024-09-12T01:26:14.434806+0000","last_unstale":"2024-09-12T01:28:03.811637+0000","last_undegraded":"2024-09-12T01:28:03.811637+0000","last_fullsized":"2024-09-12T01:28:03.811637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:01.188981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802171+0000","last_change":"2024-09-12T01:26:12.419027+0000","last_active":"2024-09-12T01:28:03.802171+0000","last_peered":"2024-09-12T01:28:03.802171+0000","last_clean":"2024-09-12T01:28:03.802171+0000","last_became_active":"2024-09-12T01:26:12.418579+0000","last_became_peered":"2024-09-12T01:26:12.418579+0000","last_unstale":"2024-09-12T01:28:03.802171+0000","last_undegraded":"2024-09-12T01:28:03.802171+0000","last_fullsized":"2024-09-12T01:28:03.802171+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.119864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717484+0000","last_change":"2024-09-12T01:26:14.429532+0000","last_active":"2024-09-12T01:28:03.717484+0000","last_peered":"2024-09-12T01:28:03.717484+0000","last_clean":"2024-09-12T01:28:03.717484+0000","last_became_active":"2024-09-12T01:26:14.429134+0000","last_became_peered":"2024-09-12T01:26:14.429134+0000","last_unstale":"2024-09-12T01:28:03.717484+0000","last_undegraded":"2024-09-12T01:28:03.717484+0000","last_fullsized":"2024-09-12T01:28:03.717484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:47.403388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802252+0000","last_change":"2024-09-12T01:26:26.279322+0000","last_active":"2024-09-12T01:28:03.802252+0000","last_peered":"2024-09-12T01:28:03.802252+0000","last_clean":"2024-09-12T01:28:03.802252+0000","last_became_active":"2024-09-12T01:26:26.268752+0000","last_became_peered":"2024-09-12T01:26:26.268752+0000","last_unstale":"2024-09-12T01:28:03.802252+0000","last_undegraded":"2024-09-12T01:28:03.802252+0000","last_fullsized":"2024-09-12T01:28:03.802252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.411144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883645+0000","last_change":"2024-09-12T01:26:14.430831+0000","last_active":"2024-09-12T01:28:03.883645+0000","last_peered":"2024-09-12T01:28:03.883645+0000","last_clean":"2024-09-12T01:28:03.883645+0000","last_became_active":"2024-09-12T01:26:14.430531+0000","last_became_peered":"2024-09-12T01:26:14.430531+0000","last_unstale":"2024-09-12T01:28:03.883645+0000","last_undegraded":"2024-09-12T01:28:03.883645+0000","last_fullsized":"2024-09-12T01:28:03.883645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:02.522283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802763+0000","last_change":"2024-09-12T01:26:12.799921+0000","last_active":"2024-09-12T01:28:03.802763+0000","last_peered":"2024-09-12T01:28:03.802763+0000","last_clean":"2024-09-12T01:28:03.802763+0000","last_became_active":"2024-09-12T01:26:12.799608+0000","last_became_peered":"2024-09-12T01:26:12.799608+0000","last_unstale":"2024-09-12T01:28:03.802763+0000","last_undegraded":"2024-09-12T01:28:03.802763+0000","last_fullsized":"2024-09-12T01:28:03.802763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:00.821261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802625+0000","last_change":"2024-09-12T01:26:14.430937+0000","last_active":"2024-09-12T01:28:03.802625+0000","last_peered":"2024-09-12T01:28:03.802625+0000","last_clean":"2024-09-12T01:28:03.802625+0000","last_became_active":"2024-09-12T01:26:14.430656+0000","last_became_peered":"2024-09-12T01:26:14.430656+0000","last_unstale":"2024-09-12T01:28:03.802625+0000","last_undegraded":"2024-09-12T01:28:03.802625+0000","last_fullsized":"2024-09-12T01:28:03.802625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.874150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.001748+0000","last_change":"2024-09-12T01:26:12.419000+0000","last_active":"2024-09-12T01:28:04.001748+0000","last_peered":"2024-09-12T01:28:04.001748+0000","last_clean":"2024-09-12T01:28:04.001748+0000","last_became_active":"2024-09-12T01:26:12.418736+0000","last_became_peered":"2024-09-12T01:26:12.418736+0000","last_unstale":"2024-09-12T01:28:04.001748+0000","last_undegraded":"2024-09-12T01:28:04.001748+0000","last_fullsized":"2024-09-12T01:28:04.001748+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:31.586983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600525,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1141,"num_read_kb":687,"num_write":372,"num_write_kb":1462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1801575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":446094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37064,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708088,"statfs":{"total":95995035648,"available":95957082112,"internally_reserved":0,"allocated":1761280,"data_stored":1235800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972397,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28328,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716824,"statfs":{"total":95995035648,"available":95966027776,"internally_reserved":0,"allocated":1335296,"data_stored":838517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201330,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32484,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712668,"statfs":{"total":95995035648,"available":95961772032,"internally_reserved":0,"allocated":1327104,"data_stored":838873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28528,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716624,"statfs":{"total":95995035648,"available":95965822976,"internally_reserved":0,"allocated":1536000,"data_stored":1039912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":445411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1683456,"data_stored":1169477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":446199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36780,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708372,"statfs":{"total":95995035648,"available":95957372928,"internally_reserved":0,"allocated":1470464,"data_stored":969659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1007616,"data_stored":506780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":995328,"data_stored":512804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":447058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":134813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":394694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":201136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:28:06.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:28:06.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.713+0000 7f1b7a027640 1 -- 172.21.15.81:0/1351281671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b741025c0 msgr2=0x7f1b74108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:06.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.713+0000 7f1b7a027640 1 --2- 172.21.15.81:0/1351281671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b741025c0 0x7f1b74108e50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009ca0 tx=0x7f1b6c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.713+0000 7f1b7a027640 1 -- 172.21.15.81:0/1351281671 shutdown_connections 2024-09-12T01:28:06.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.713+0000 7f1b7a027640 1 --2- 172.21.15.81:0/1351281671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b741025c0 0x7f1b74108e50 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.713+0000 7f1b7a027640 1 --2- 172.21.15.81:0/1351281671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b74101c00 0x7f1b74102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.713+0000 7f1b7a027640 1 --2- 172.21.15.81:0/1351281671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b74100a10 0x7f1b74100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.713+0000 7f1b7a027640 1 -- 172.21.15.81:0/1351281671 >> 172.21.15.81:0/1351281671 conn(0x7f1b740fc170 msgr2=0x7f1b740fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:06.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.713+0000 7f1b7a027640 1 -- 172.21.15.81:0/1351281671 shutdown_connections 2024-09-12T01:28:06.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.713+0000 7f1b7a027640 1 -- 172.21.15.81:0/1351281671 wait complete. 2024-09-12T01:28:06.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.714+0000 7f1b7a027640 1 Processor -- start 2024-09-12T01:28:06.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.714+0000 7f1b7a027640 1 -- start start 2024-09-12T01:28:06.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.714+0000 7f1b7a027640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b74100a10 0x7f1b74069f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:06.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.714+0000 7f1b7a027640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b74101c00 0x7f1b7419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:06.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.714+0000 7f1b7a027640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b741025c0 0x7f1b7419f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:06.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.714+0000 7f1b7a027640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7410c670 con 0x7f1b74101c00 2024-09-12T01:28:06.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.714+0000 7f1b7a027640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7410c4f0 con 0x7f1b74100a10 2024-09-12T01:28:06.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.714+0000 7f1b7a027640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7410c7f0 con 0x7f1b741025c0 2024-09-12T01:28:06.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b72ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b74101c00 0x7f1b7419cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:06.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b72ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b74101c00 0x7f1b7419cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40126/0 (socket says 172.21.15.81:40126) 2024-09-12T01:28:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b72ffd640 1 -- 172.21.15.81:0/2351492621 learned_addr learned my addr 172.21.15.81:0/2351492621 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b737fe640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b74100a10 0x7f1b74069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b73fff640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b741025c0 0x7f1b7419f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b72ffd640 1 -- 172.21.15.81:0/2351492621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b741025c0 msgr2=0x7f1b7419f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b72ffd640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b741025c0 0x7f1b7419f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b72ffd640 1 -- 172.21.15.81:0/2351492621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b74100a10 msgr2=0x7f1b74069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b72ffd640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b74100a10 0x7f1b74069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b72ffd640 1 -- 172.21.15.81:0/2351492621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7419f9f0 con 0x7f1b74101c00 2024-09-12T01:28:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b72ffd640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b74101c00 0x7f1b7419cae0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800d950 tx=0x7f1b6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b70ff9640 1 -- 172.21.15.81:0/2351492621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68017070 con 0x7f1b74101c00 2024-09-12T01:28:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b7a027640 1 -- 172.21.15.81:0/2351492621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7419fce0 con 0x7f1b74101c00 2024-09-12T01:28:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b70ff9640 1 -- 172.21.15.81:0/2351492621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b68009c30 con 0x7f1b74101c00 2024-09-12T01:28:06.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b70ff9640 1 -- 172.21.15.81:0/2351492621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6800f6b0 con 0x7f1b74101c00 2024-09-12T01:28:06.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.715+0000 7f1b7a027640 1 -- 172.21.15.81:0/2351492621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b741a01d0 con 0x7f1b74101c00 2024-09-12T01:28:06.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.716+0000 7f1b7a027640 1 -- 172.21.15.81:0/2351492621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b74107e50 con 0x7f1b74101c00 2024-09-12T01:28:06.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.718+0000 7f1b70ff9640 1 -- 172.21.15.81:0/2351492621 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 137953+0+0 (secure 0 0 0) 0x7f1b680109d0 con 0x7f1b74101c00 2024-09-12T01:28:06.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.718+0000 7f1b70ff9640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1b5c0a2d00 0x7f1b5c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:06.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.718+0000 7f1b737fe640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1b5c0a2d00 0x7f1b5c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:06.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.718+0000 7f1b70ff9640 1 -- 172.21.15.81:0/2351492621 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1b680cf030 con 0x7f1b74101c00 2024-09-12T01:28:06.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.719+0000 7f1b737fe640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1b5c0a2d00 0x7f1b5c0a51c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1b74101a60 tx=0x7f1b64005f90 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:06.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.722+0000 7f1b70ff9640 1 -- 172.21.15.81:0/2351492621 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b68009de0 con 0x7f1b74101c00 2024-09-12T01:28:06.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.896+0000 7f1b7a027640 1 -- 172.21.15.81:0/2351492621 --> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b74062630 con 0x7f1b5c0a2d00 2024-09-12T01:28:06.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.903+0000 7f1b70ff9640 1 -- 172.21.15.81:0/2351492621 <== mgr.15222 v2:172.21.15.81:6800/1379528564 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257783 (secure 0 0 0) 0x7f1b74062630 con 0x7f1b5c0a2d00 2024-09-12T01:28:06.906 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T01:28:06.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.906+0000 7f1b7a027640 1 -- 172.21.15.81:0/2351492621 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1b5c0a2d00 msgr2=0x7f1b5c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:06.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.906+0000 7f1b7a027640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1b5c0a2d00 0x7f1b5c0a51c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1b74101a60 tx=0x7f1b64005f90 comp rx=0 tx=0).stop 2024-09-12T01:28:06.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.906+0000 7f1b7a027640 1 -- 172.21.15.81:0/2351492621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b74101c00 msgr2=0x7f1b7419cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:06.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.906+0000 7f1b7a027640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b74101c00 0x7f1b7419cae0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800d950 tx=0x7f1b6800de10 comp rx=0 tx=0).stop 2024-09-12T01:28:06.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.906+0000 7f1b7a027640 1 -- 172.21.15.81:0/2351492621 shutdown_connections 2024-09-12T01:28:06.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.906+0000 7f1b7a027640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1b5c0a2d00 0x7f1b5c0a51c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.906+0000 7f1b7a027640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b741025c0 0x7f1b7419f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.906+0000 7f1b7a027640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b74101c00 0x7f1b7419cae0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.906+0000 7f1b7a027640 1 --2- 172.21.15.81:0/2351492621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b74100a10 0x7f1b74069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:06.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.906+0000 7f1b7a027640 1 -- 172.21.15.81:0/2351492621 >> 172.21.15.81:0/2351492621 conn(0x7f1b740fc170 msgr2=0x7f1b74105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:06.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.906+0000 7f1b7a027640 1 -- 172.21.15.81:0/2351492621 shutdown_connections 2024-09-12T01:28:06.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:06.906+0000 7f1b7a027640 1 -- 172.21.15.81:0/2351492621 wait complete. 2024-09-12T01:28:06.917 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-12T01:28:05.729931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191127,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1277,"num_read_kb":806,"num_write":555,"num_write_kb":4402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180758,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":938,"ondisk_log_size":938,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380408,"kb_used_data":14488,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124561416,"statfs":{"total":1151940427776,"available":1151550889984,"internally_reserved":0,"allocated":14835712,"data_stored":8896584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.987671"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881117+0000","last_change":"2024-09-12T01:26:14.433907+0000","last_active":"2024-09-12T01:28:03.881117+0000","last_peered":"2024-09-12T01:28:03.881117+0000","last_clean":"2024-09-12T01:28:03.881117+0000","last_became_active":"2024-09-12T01:26:14.433495+0000","last_became_peered":"2024-09-12T01:26:14.433495+0000","last_unstale":"2024-09-12T01:28:03.881117+0000","last_undegraded":"2024-09-12T01:28:03.881117+0000","last_fullsized":"2024-09-12T01:28:03.881117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:12.836491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883125+0000","last_change":"2024-09-12T01:26:14.430873+0000","last_active":"2024-09-12T01:28:03.883125+0000","last_peered":"2024-09-12T01:28:03.883125+0000","last_clean":"2024-09-12T01:28:03.883125+0000","last_became_active":"2024-09-12T01:26:14.430572+0000","last_became_peered":"2024-09-12T01:26:14.430572+0000","last_unstale":"2024-09-12T01:28:03.883125+0000","last_undegraded":"2024-09-12T01:28:03.883125+0000","last_fullsized":"2024-09-12T01:28:03.883125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:15.160712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882818+0000","last_change":"2024-09-12T01:26:14.426117+0000","last_active":"2024-09-12T01:28:03.882818+0000","last_peered":"2024-09-12T01:28:03.882818+0000","last_clean":"2024-09-12T01:28:03.882818+0000","last_became_active":"2024-09-12T01:26:14.425831+0000","last_became_peered":"2024-09-12T01:26:14.425831+0000","last_unstale":"2024-09-12T01:28:03.882818+0000","last_undegraded":"2024-09-12T01:28:03.882818+0000","last_fullsized":"2024-09-12T01:28:03.882818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:15.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825114+0000","last_change":"2024-09-12T01:26:14.434545+0000","last_active":"2024-09-12T01:28:03.825114+0000","last_peered":"2024-09-12T01:28:03.825114+0000","last_clean":"2024-09-12T01:28:03.825114+0000","last_became_active":"2024-09-12T01:26:14.434222+0000","last_became_peered":"2024-09-12T01:26:14.434222+0000","last_unstale":"2024-09-12T01:28:03.825114+0000","last_undegraded":"2024-09-12T01:28:03.825114+0000","last_fullsized":"2024-09-12T01:28:03.825114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:36.789145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801925+0000","last_change":"2024-09-12T01:26:14.421900+0000","last_active":"2024-09-12T01:28:03.801925+0000","last_peered":"2024-09-12T01:28:03.801925+0000","last_clean":"2024-09-12T01:28:03.801925+0000","last_became_active":"2024-09-12T01:26:14.421558+0000","last_became_peered":"2024-09-12T01:26:14.421558+0000","last_unstale":"2024-09-12T01:28:03.801925+0000","last_undegraded":"2024-09-12T01:28:03.801925+0000","last_fullsized":"2024-09-12T01:28:03.801925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814207+0000","last_change":"2024-09-12T01:26:14.436641+0000","last_active":"2024-09-12T01:28:03.814207+0000","last_peered":"2024-09-12T01:28:03.814207+0000","last_clean":"2024-09-12T01:28:03.814207+0000","last_became_active":"2024-09-12T01:26:14.436347+0000","last_became_peered":"2024-09-12T01:26:14.436347+0000","last_unstale":"2024-09-12T01:28:03.814207+0000","last_undegraded":"2024-09-12T01:28:03.814207+0000","last_fullsized":"2024-09-12T01:28:03.814207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:52.756035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940185+0000","last_change":"2024-09-12T01:26:14.438676+0000","last_active":"2024-09-12T01:28:03.940185+0000","last_peered":"2024-09-12T01:28:03.940185+0000","last_clean":"2024-09-12T01:28:03.940185+0000","last_became_active":"2024-09-12T01:26:14.438332+0000","last_became_peered":"2024-09-12T01:26:14.438332+0000","last_unstale":"2024-09-12T01:28:03.940185+0000","last_undegraded":"2024-09-12T01:28:03.940185+0000","last_fullsized":"2024-09-12T01:28:03.940185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:06.459830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802047+0000","last_change":"2024-09-12T01:26:14.431676+0000","last_active":"2024-09-12T01:28:03.802047+0000","last_peered":"2024-09-12T01:28:03.802047+0000","last_clean":"2024-09-12T01:28:03.802047+0000","last_became_active":"2024-09-12T01:26:14.431378+0000","last_became_peered":"2024-09-12T01:26:14.431378+0000","last_unstale":"2024-09-12T01:28:03.802047+0000","last_undegraded":"2024-09-12T01:28:03.802047+0000","last_fullsized":"2024-09-12T01:28:03.802047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:23.523350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717979+0000","last_change":"2024-09-12T01:26:14.428381+0000","last_active":"2024-09-12T01:28:03.717979+0000","last_peered":"2024-09-12T01:28:03.717979+0000","last_clean":"2024-09-12T01:28:03.717979+0000","last_became_active":"2024-09-12T01:26:14.428031+0000","last_became_peered":"2024-09-12T01:26:14.428031+0000","last_unstale":"2024-09-12T01:28:03.717979+0000","last_undegraded":"2024-09-12T01:28:03.717979+0000","last_fullsized":"2024-09-12T01:28:03.717979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:40.920911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814620+0000","last_change":"2024-09-12T01:26:14.438849+0000","last_active":"2024-09-12T01:28:03.814620+0000","last_peered":"2024-09-12T01:28:03.814620+0000","last_clean":"2024-09-12T01:28:03.814620+0000","last_became_active":"2024-09-12T01:26:14.438510+0000","last_became_peered":"2024-09-12T01:26:14.438510+0000","last_unstale":"2024-09-12T01:28:03.814620+0000","last_undegraded":"2024-09-12T01:28:03.814620+0000","last_fullsized":"2024-09-12T01:28:03.814620+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:12.257292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940484+0000","last_change":"2024-09-12T01:26:14.436468+0000","last_active":"2024-09-12T01:28:03.940484+0000","last_peered":"2024-09-12T01:28:03.940484+0000","last_clean":"2024-09-12T01:28:03.940484+0000","last_became_active":"2024-09-12T01:26:14.436095+0000","last_became_peered":"2024-09-12T01:26:14.436095+0000","last_unstale":"2024-09-12T01:28:03.940484+0000","last_undegraded":"2024-09-12T01:28:03.940484+0000","last_fullsized":"2024-09-12T01:28:03.940484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:43.441358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825119+0000","last_change":"2024-09-12T01:26:14.431384+0000","last_active":"2024-09-12T01:28:03.825119+0000","last_peered":"2024-09-12T01:28:03.825119+0000","last_clean":"2024-09-12T01:28:03.825119+0000","last_became_active":"2024-09-12T01:26:14.431079+0000","last_became_peered":"2024-09-12T01:26:14.431079+0000","last_unstale":"2024-09-12T01:28:03.825119+0000","last_undegraded":"2024-09-12T01:28:03.825119+0000","last_fullsized":"2024-09-12T01:28:03.825119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.178038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882393+0000","last_change":"2024-09-12T01:26:14.430163+0000","last_active":"2024-09-12T01:28:03.882393+0000","last_peered":"2024-09-12T01:28:03.882393+0000","last_clean":"2024-09-12T01:28:03.882393+0000","last_became_active":"2024-09-12T01:26:14.429863+0000","last_became_peered":"2024-09-12T01:26:14.429863+0000","last_unstale":"2024-09-12T01:28:03.882393+0000","last_undegraded":"2024-09-12T01:28:03.882393+0000","last_fullsized":"2024-09-12T01:28:03.882393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:44.432677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882103+0000","last_change":"2024-09-12T01:26:14.427304+0000","last_active":"2024-09-12T01:28:03.882103+0000","last_peered":"2024-09-12T01:28:03.882103+0000","last_clean":"2024-09-12T01:28:03.882103+0000","last_became_active":"2024-09-12T01:26:14.427006+0000","last_became_peered":"2024-09-12T01:26:14.427006+0000","last_unstale":"2024-09-12T01:28:03.882103+0000","last_undegraded":"2024-09-12T01:28:03.882103+0000","last_fullsized":"2024-09-12T01:28:03.882103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.930959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881815+0000","last_change":"2024-09-12T01:26:14.431018+0000","last_active":"2024-09-12T01:28:03.881815+0000","last_peered":"2024-09-12T01:28:03.881815+0000","last_clean":"2024-09-12T01:28:03.881815+0000","last_became_active":"2024-09-12T01:26:14.429518+0000","last_became_peered":"2024-09-12T01:26:14.429518+0000","last_unstale":"2024-09-12T01:28:03.881815+0000","last_undegraded":"2024-09-12T01:28:03.881815+0000","last_fullsized":"2024-09-12T01:28:03.881815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.504814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717400+0000","last_change":"2024-09-12T01:26:14.430601+0000","last_active":"2024-09-12T01:28:03.717400+0000","last_peered":"2024-09-12T01:28:03.717400+0000","last_clean":"2024-09-12T01:28:03.717400+0000","last_became_active":"2024-09-12T01:26:14.430304+0000","last_became_peered":"2024-09-12T01:26:14.430304+0000","last_unstale":"2024-09-12T01:28:03.717400+0000","last_undegraded":"2024-09-12T01:28:03.717400+0000","last_fullsized":"2024-09-12T01:28:03.717400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.414767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881148+0000","last_change":"2024-09-12T01:26:14.432934+0000","last_active":"2024-09-12T01:28:03.881148+0000","last_peered":"2024-09-12T01:28:03.881148+0000","last_clean":"2024-09-12T01:28:03.881148+0000","last_became_active":"2024-09-12T01:26:14.432417+0000","last_became_peered":"2024-09-12T01:26:14.432417+0000","last_unstale":"2024-09-12T01:28:03.881148+0000","last_undegraded":"2024-09-12T01:28:03.881148+0000","last_fullsized":"2024-09-12T01:28:03.881148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.964880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716779+0000","last_change":"2024-09-12T01:26:14.429956+0000","last_active":"2024-09-12T01:28:03.716779+0000","last_peered":"2024-09-12T01:28:03.716779+0000","last_clean":"2024-09-12T01:28:03.716779+0000","last_became_active":"2024-09-12T01:26:14.429610+0000","last_became_peered":"2024-09-12T01:26:14.429610+0000","last_unstale":"2024-09-12T01:28:03.716779+0000","last_undegraded":"2024-09-12T01:28:03.716779+0000","last_fullsized":"2024-09-12T01:28:03.716779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:51.453221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720646+0000","last_change":"2024-09-12T01:26:14.423624+0000","last_active":"2024-09-12T01:28:03.720646+0000","last_peered":"2024-09-12T01:28:03.720646+0000","last_clean":"2024-09-12T01:28:03.720646+0000","last_became_active":"2024-09-12T01:26:14.423314+0000","last_became_peered":"2024-09-12T01:26:14.423314+0000","last_unstale":"2024-09-12T01:28:03.720646+0000","last_undegraded":"2024-09-12T01:28:03.720646+0000","last_fullsized":"2024-09-12T01:28:03.720646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.414323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880810+0000","last_change":"2024-09-12T01:26:14.433548+0000","last_active":"2024-09-12T01:28:03.880810+0000","last_peered":"2024-09-12T01:28:03.880810+0000","last_clean":"2024-09-12T01:28:03.880810+0000","last_became_active":"2024-09-12T01:26:14.433223+0000","last_became_peered":"2024-09-12T01:26:14.433223+0000","last_unstale":"2024-09-12T01:28:03.880810+0000","last_undegraded":"2024-09-12T01:28:03.880810+0000","last_fullsized":"2024-09-12T01:28:03.880810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.247354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882535+0000","last_change":"2024-09-12T01:26:14.431715+0000","last_active":"2024-09-12T01:28:03.882535+0000","last_peered":"2024-09-12T01:28:03.882535+0000","last_clean":"2024-09-12T01:28:03.882535+0000","last_became_active":"2024-09-12T01:26:14.430839+0000","last_became_peered":"2024-09-12T01:26:14.430839+0000","last_unstale":"2024-09-12T01:28:03.882535+0000","last_undegraded":"2024-09-12T01:28:03.882535+0000","last_fullsized":"2024-09-12T01:28:03.882535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:04.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717611+0000","last_change":"2024-09-12T01:26:14.431385+0000","last_active":"2024-09-12T01:28:03.717611+0000","last_peered":"2024-09-12T01:28:03.717611+0000","last_clean":"2024-09-12T01:28:03.717611+0000","last_became_active":"2024-09-12T01:26:14.431046+0000","last_became_peered":"2024-09-12T01:26:14.431046+0000","last_unstale":"2024-09-12T01:28:03.717611+0000","last_undegraded":"2024-09-12T01:28:03.717611+0000","last_fullsized":"2024-09-12T01:28:03.717611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:42.495019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802146+0000","last_change":"2024-09-12T01:26:14.427737+0000","last_active":"2024-09-12T01:28:03.802146+0000","last_peered":"2024-09-12T01:28:03.802146+0000","last_clean":"2024-09-12T01:28:03.802146+0000","last_became_active":"2024-09-12T01:26:14.427409+0000","last_became_peered":"2024-09-12T01:26:14.427409+0000","last_unstale":"2024-09-12T01:28:03.802146+0000","last_undegraded":"2024-09-12T01:28:03.802146+0000","last_fullsized":"2024-09-12T01:28:03.802146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:02.632914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811345+0000","last_change":"2024-09-12T01:26:14.433426+0000","last_active":"2024-09-12T01:28:03.811345+0000","last_peered":"2024-09-12T01:28:03.811345+0000","last_clean":"2024-09-12T01:28:03.811345+0000","last_became_active":"2024-09-12T01:26:14.431918+0000","last_became_peered":"2024-09-12T01:26:14.431918+0000","last_unstale":"2024-09-12T01:28:03.811345+0000","last_undegraded":"2024-09-12T01:28:03.811345+0000","last_fullsized":"2024-09-12T01:28:03.811345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.946072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716825+0000","last_change":"2024-09-12T01:26:26.268358+0000","last_active":"2024-09-12T01:28:03.716825+0000","last_peered":"2024-09-12T01:28:03.716825+0000","last_clean":"2024-09-12T01:28:03.716825+0000","last_became_active":"2024-09-12T01:26:26.268005+0000","last_became_peered":"2024-09-12T01:26:26.268005+0000","last_unstale":"2024-09-12T01:28:03.716825+0000","last_undegraded":"2024-09-12T01:28:03.716825+0000","last_fullsized":"2024-09-12T01:28:03.716825+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:53.977249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720710+0000","last_change":"2024-09-12T01:26:14.434536+0000","last_active":"2024-09-12T01:28:03.720710+0000","last_peered":"2024-09-12T01:28:03.720710+0000","last_clean":"2024-09-12T01:28:03.720710+0000","last_became_active":"2024-09-12T01:26:14.434148+0000","last_became_peered":"2024-09-12T01:26:14.434148+0000","last_unstale":"2024-09-12T01:28:03.720710+0000","last_undegraded":"2024-09-12T01:28:03.720710+0000","last_fullsized":"2024-09-12T01:28:03.720710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:47.576827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880923+0000","last_change":"2024-09-12T01:26:14.428040+0000","last_active":"2024-09-12T01:28:03.880923+0000","last_peered":"2024-09-12T01:28:03.880923+0000","last_clean":"2024-09-12T01:28:03.880923+0000","last_became_active":"2024-09-12T01:26:14.427709+0000","last_became_peered":"2024-09-12T01:26:14.427709+0000","last_unstale":"2024-09-12T01:28:03.880923+0000","last_undegraded":"2024-09-12T01:28:03.880923+0000","last_fullsized":"2024-09-12T01:28:03.880923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.256097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882750+0000","last_change":"2024-09-12T01:26:26.265649+0000","last_active":"2024-09-12T01:28:03.882750+0000","last_peered":"2024-09-12T01:28:03.882750+0000","last_clean":"2024-09-12T01:28:03.882750+0000","last_became_active":"2024-09-12T01:26:26.265251+0000","last_became_peered":"2024-09-12T01:26:26.265251+0000","last_unstale":"2024-09-12T01:28:03.882750+0000","last_undegraded":"2024-09-12T01:28:03.882750+0000","last_fullsized":"2024-09-12T01:28:03.882750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:31.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882448+0000","last_change":"2024-09-12T01:26:14.427596+0000","last_active":"2024-09-12T01:28:03.882448+0000","last_peered":"2024-09-12T01:28:03.882448+0000","last_clean":"2024-09-12T01:28:03.882448+0000","last_became_active":"2024-09-12T01:26:14.427291+0000","last_became_peered":"2024-09-12T01:26:14.427291+0000","last_unstale":"2024-09-12T01:28:03.882448+0000","last_undegraded":"2024-09-12T01:28:03.882448+0000","last_fullsized":"2024-09-12T01:28:03.882448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:51.529835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720369+0000","last_change":"2024-09-12T01:26:14.424197+0000","last_active":"2024-09-12T01:28:03.720369+0000","last_peered":"2024-09-12T01:28:03.720369+0000","last_clean":"2024-09-12T01:28:03.720369+0000","last_became_active":"2024-09-12T01:26:14.423422+0000","last_became_peered":"2024-09-12T01:26:14.423422+0000","last_unstale":"2024-09-12T01:28:03.720369+0000","last_undegraded":"2024-09-12T01:28:03.720369+0000","last_fullsized":"2024-09-12T01:28:03.720369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.725623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720421+0000","last_change":"2024-09-12T01:26:14.428116+0000","last_active":"2024-09-12T01:28:03.720421+0000","last_peered":"2024-09-12T01:28:03.720421+0000","last_clean":"2024-09-12T01:28:03.720421+0000","last_became_active":"2024-09-12T01:26:14.427804+0000","last_became_peered":"2024-09-12T01:26:14.427804+0000","last_unstale":"2024-09-12T01:28:03.720421+0000","last_undegraded":"2024-09-12T01:28:03.720421+0000","last_fullsized":"2024-09-12T01:28:03.720421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:02.271305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880755+0000","last_change":"2024-09-12T01:26:14.432659+0000","last_active":"2024-09-12T01:28:03.880755+0000","last_peered":"2024-09-12T01:28:03.880755+0000","last_clean":"2024-09-12T01:28:03.880755+0000","last_became_active":"2024-09-12T01:26:14.432331+0000","last_became_peered":"2024-09-12T01:26:14.432331+0000","last_unstale":"2024-09-12T01:28:03.880755+0000","last_undegraded":"2024-09-12T01:28:03.880755+0000","last_fullsized":"2024-09-12T01:28:03.880755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.868909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801888+0000","last_change":"2024-09-12T01:26:14.426167+0000","last_active":"2024-09-12T01:28:03.801888+0000","last_peered":"2024-09-12T01:28:03.801888+0000","last_clean":"2024-09-12T01:28:03.801888+0000","last_became_active":"2024-09-12T01:26:14.425847+0000","last_became_peered":"2024-09-12T01:26:14.425847+0000","last_unstale":"2024-09-12T01:28:03.801888+0000","last_undegraded":"2024-09-12T01:28:03.801888+0000","last_fullsized":"2024-09-12T01:28:03.801888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:39.481527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.399114+0000","last_change":"2024-09-12T01:26:12.421487+0000","last_active":"2024-09-12T01:28:04.399114+0000","last_peered":"2024-09-12T01:28:04.399114+0000","last_clean":"2024-09-12T01:28:04.399114+0000","last_became_active":"2024-09-12T01:26:12.421096+0000","last_became_peered":"2024-09-12T01:26:12.421096+0000","last_unstale":"2024-09-12T01:28:04.399114+0000","last_undegraded":"2024-09-12T01:28:04.399114+0000","last_fullsized":"2024-09-12T01:28:04.399114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:12.410280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811514+0000","last_change":"2024-09-12T01:26:26.270310+0000","last_active":"2024-09-12T01:28:03.811514+0000","last_peered":"2024-09-12T01:28:03.811514+0000","last_clean":"2024-09-12T01:28:03.811514+0000","last_became_active":"2024-09-12T01:26:26.269917+0000","last_became_peered":"2024-09-12T01:26:26.269917+0000","last_unstale":"2024-09-12T01:28:03.811514+0000","last_undegraded":"2024-09-12T01:28:03.811514+0000","last_fullsized":"2024-09-12T01:28:03.811514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:29.549456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814260+0000","last_change":"2024-09-12T01:26:26.287218+0000","last_active":"2024-09-12T01:28:03.814260+0000","last_peered":"2024-09-12T01:28:03.814260+0000","last_clean":"2024-09-12T01:28:03.814260+0000","last_became_active":"2024-09-12T01:26:26.282251+0000","last_became_peered":"2024-09-12T01:26:26.282251+0000","last_unstale":"2024-09-12T01:28:03.814260+0000","last_undegraded":"2024-09-12T01:28:03.814260+0000","last_fullsized":"2024-09-12T01:28:03.814260+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:53.888064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883469+0000","last_change":"2024-09-12T01:26:12.416100+0000","last_active":"2024-09-12T01:28:03.883469+0000","last_peered":"2024-09-12T01:28:03.883469+0000","last_clean":"2024-09-12T01:28:03.883469+0000","last_became_active":"2024-09-12T01:26:12.415799+0000","last_became_peered":"2024-09-12T01:26:12.415799+0000","last_unstale":"2024-09-12T01:28:03.883469+0000","last_undegraded":"2024-09-12T01:28:03.883469+0000","last_fullsized":"2024-09-12T01:28:03.883469+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:41.826537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802089+0000","last_change":"2024-09-12T01:26:14.424922+0000","last_active":"2024-09-12T01:28:03.802089+0000","last_peered":"2024-09-12T01:28:03.802089+0000","last_clean":"2024-09-12T01:28:03.802089+0000","last_became_active":"2024-09-12T01:26:14.424580+0000","last_became_peered":"2024-09-12T01:26:14.424580+0000","last_unstale":"2024-09-12T01:28:03.802089+0000","last_undegraded":"2024-09-12T01:28:03.802089+0000","last_fullsized":"2024-09-12T01:28:03.802089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:05.697287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811489+0000","last_change":"2024-09-12T01:26:12.419339+0000","last_active":"2024-09-12T01:28:03.811489+0000","last_peered":"2024-09-12T01:28:03.811489+0000","last_clean":"2024-09-12T01:28:03.811489+0000","last_became_active":"2024-09-12T01:26:12.418925+0000","last_became_peered":"2024-09-12T01:26:12.418925+0000","last_unstale":"2024-09-12T01:28:03.811489+0000","last_undegraded":"2024-09-12T01:28:03.811489+0000","last_fullsized":"2024-09-12T01:28:03.811489+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.390691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716540+0000","last_change":"2024-09-12T01:26:14.426611+0000","last_active":"2024-09-12T01:28:03.716540+0000","last_peered":"2024-09-12T01:28:03.716540+0000","last_clean":"2024-09-12T01:28:03.716540+0000","last_became_active":"2024-09-12T01:26:14.426268+0000","last_became_peered":"2024-09-12T01:26:14.426268+0000","last_unstale":"2024-09-12T01:28:03.716540+0000","last_undegraded":"2024-09-12T01:28:03.716540+0000","last_fullsized":"2024-09-12T01:28:03.716540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:34.676841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":230,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.398504+0000","last_change":"2024-09-12T01:26:12.420302+0000","last_active":"2024-09-12T01:28:04.398504+0000","last_peered":"2024-09-12T01:28:04.398504+0000","last_clean":"2024-09-12T01:28:04.398504+0000","last_became_active":"2024-09-12T01:26:12.419943+0000","last_became_peered":"2024-09-12T01:26:12.419943+0000","last_unstale":"2024-09-12T01:28:04.398504+0000","last_undegraded":"2024-09-12T01:28:04.398504+0000","last_fullsized":"2024-09-12T01:28:04.398504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:30.704272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717828+0000","last_change":"2024-09-12T01:26:14.433112+0000","last_active":"2024-09-12T01:28:03.717828+0000","last_peered":"2024-09-12T01:28:03.717828+0000","last_clean":"2024-09-12T01:28:03.717828+0000","last_became_active":"2024-09-12T01:26:14.432803+0000","last_became_peered":"2024-09-12T01:26:14.432803+0000","last_unstale":"2024-09-12T01:28:03.717828+0000","last_undegraded":"2024-09-12T01:28:03.717828+0000","last_fullsized":"2024-09-12T01:28:03.717828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:33.670485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940319+0000","last_change":"2024-09-12T01:26:12.424854+0000","last_active":"2024-09-12T01:28:03.940319+0000","last_peered":"2024-09-12T01:28:03.940319+0000","last_clean":"2024-09-12T01:28:03.940319+0000","last_became_active":"2024-09-12T01:26:12.424476+0000","last_became_peered":"2024-09-12T01:26:12.424476+0000","last_unstale":"2024-09-12T01:28:03.940319+0000","last_undegraded":"2024-09-12T01:28:03.940319+0000","last_fullsized":"2024-09-12T01:28:03.940319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:03.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883795+0000","last_change":"2024-09-12T01:26:14.431580+0000","last_active":"2024-09-12T01:28:03.883795+0000","last_peered":"2024-09-12T01:28:03.883795+0000","last_clean":"2024-09-12T01:28:03.883795+0000","last_became_active":"2024-09-12T01:26:14.431237+0000","last_became_peered":"2024-09-12T01:26:14.431237+0000","last_unstale":"2024-09-12T01:28:03.883795+0000","last_undegraded":"2024-09-12T01:28:03.883795+0000","last_fullsized":"2024-09-12T01:28:03.883795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:32.562156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811710+0000","last_change":"2024-09-12T01:26:12.802015+0000","last_active":"2024-09-12T01:28:03.811710+0000","last_peered":"2024-09-12T01:28:03.811710+0000","last_clean":"2024-09-12T01:28:03.811710+0000","last_became_active":"2024-09-12T01:26:12.801605+0000","last_became_peered":"2024-09-12T01:26:12.801605+0000","last_unstale":"2024-09-12T01:28:03.811710+0000","last_undegraded":"2024-09-12T01:28:03.811710+0000","last_fullsized":"2024-09-12T01:28:03.811710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:24.703911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717615+0000","last_change":"2024-09-12T01:26:14.433305+0000","last_active":"2024-09-12T01:28:03.717615+0000","last_peered":"2024-09-12T01:28:03.717615+0000","last_clean":"2024-09-12T01:28:03.717615+0000","last_became_active":"2024-09-12T01:26:14.432989+0000","last_became_peered":"2024-09-12T01:26:14.432989+0000","last_unstale":"2024-09-12T01:28:03.717615+0000","last_undegraded":"2024-09-12T01:28:03.717615+0000","last_fullsized":"2024-09-12T01:28:03.717615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:45.741460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":273,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.399459+0000","last_change":"2024-09-12T01:26:12.423148+0000","last_active":"2024-09-12T01:28:04.399459+0000","last_peered":"2024-09-12T01:28:04.399459+0000","last_clean":"2024-09-12T01:28:04.399459+0000","last_became_active":"2024-09-12T01:26:12.422754+0000","last_became_peered":"2024-09-12T01:26:12.422754+0000","last_unstale":"2024-09-12T01:28:04.399459+0000","last_undegraded":"2024-09-12T01:28:04.399459+0000","last_fullsized":"2024-09-12T01:28:04.399459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:01.017125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":172,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802221+0000","last_change":"2024-09-12T01:26:14.431568+0000","last_active":"2024-09-12T01:28:03.802221+0000","last_peered":"2024-09-12T01:28:03.802221+0000","last_clean":"2024-09-12T01:28:03.802221+0000","last_became_active":"2024-09-12T01:26:14.431215+0000","last_became_peered":"2024-09-12T01:26:14.431215+0000","last_unstale":"2024-09-12T01:28:03.802221+0000","last_undegraded":"2024-09-12T01:28:03.802221+0000","last_fullsized":"2024-09-12T01:28:03.802221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.552147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720527+0000","last_change":"2024-09-12T01:26:12.421986+0000","last_active":"2024-09-12T01:28:03.720527+0000","last_peered":"2024-09-12T01:28:03.720527+0000","last_clean":"2024-09-12T01:28:03.720527+0000","last_became_active":"2024-09-12T01:26:12.421391+0000","last_became_peered":"2024-09-12T01:26:12.421391+0000","last_unstale":"2024-09-12T01:28:03.720527+0000","last_undegraded":"2024-09-12T01:28:03.720527+0000","last_fullsized":"2024-09-12T01:28:03.720527+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:20.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881940+0000","last_change":"2024-09-12T01:26:14.431435+0000","last_active":"2024-09-12T01:28:03.881940+0000","last_peered":"2024-09-12T01:28:03.881940+0000","last_clean":"2024-09-12T01:28:03.881940+0000","last_became_active":"2024-09-12T01:26:14.431143+0000","last_became_peered":"2024-09-12T01:26:14.431143+0000","last_unstale":"2024-09-12T01:28:03.881940+0000","last_undegraded":"2024-09-12T01:28:03.881940+0000","last_fullsized":"2024-09-12T01:28:03.881940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:58.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811440+0000","last_change":"2024-09-12T01:26:12.423972+0000","last_active":"2024-09-12T01:28:03.811440+0000","last_peered":"2024-09-12T01:28:03.811440+0000","last_clean":"2024-09-12T01:28:03.811440+0000","last_became_active":"2024-09-12T01:26:12.423594+0000","last_became_peered":"2024-09-12T01:26:12.423594+0000","last_unstale":"2024-09-12T01:28:03.811440+0000","last_undegraded":"2024-09-12T01:28:03.811440+0000","last_fullsized":"2024-09-12T01:28:03.811440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:37.783478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940307+0000","last_change":"2024-09-12T01:26:14.437207+0000","last_active":"2024-09-12T01:28:03.940307+0000","last_peered":"2024-09-12T01:28:03.940307+0000","last_clean":"2024-09-12T01:28:03.940307+0000","last_became_active":"2024-09-12T01:26:14.436940+0000","last_became_peered":"2024-09-12T01:26:14.436940+0000","last_unstale":"2024-09-12T01:28:03.940307+0000","last_undegraded":"2024-09-12T01:28:03.940307+0000","last_fullsized":"2024-09-12T01:28:03.940307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:34.454446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'9","reported_seq":139,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.401958+0000","last_change":"2024-09-12T01:26:12.420247+0000","last_active":"2024-09-12T01:28:04.401958+0000","last_peered":"2024-09-12T01:28:04.401958+0000","last_clean":"2024-09-12T01:28:04.401958+0000","last_became_active":"2024-09-12T01:26:12.419825+0000","last_became_peered":"2024-09-12T01:26:12.419825+0000","last_unstale":"2024-09-12T01:28:04.401958+0000","last_undegraded":"2024-09-12T01:28:04.401958+0000","last_fullsized":"2024-09-12T01:28:04.401958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:26.746225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":6,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940127+0000","last_change":"2024-09-12T01:26:14.439019+0000","last_active":"2024-09-12T01:28:03.940127+0000","last_peered":"2024-09-12T01:28:03.940127+0000","last_clean":"2024-09-12T01:28:03.940127+0000","last_became_active":"2024-09-12T01:26:14.438714+0000","last_became_peered":"2024-09-12T01:26:14.438714+0000","last_unstale":"2024-09-12T01:28:03.940127+0000","last_undegraded":"2024-09-12T01:28:03.940127+0000","last_fullsized":"2024-09-12T01:28:03.940127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.321464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801873+0000","last_change":"2024-09-12T01:26:12.800529+0000","last_active":"2024-09-12T01:28:03.801873+0000","last_peered":"2024-09-12T01:28:03.801873+0000","last_clean":"2024-09-12T01:28:03.801873+0000","last_became_active":"2024-09-12T01:26:12.800104+0000","last_became_peered":"2024-09-12T01:26:12.800104+0000","last_unstale":"2024-09-12T01:28:03.801873+0000","last_undegraded":"2024-09-12T01:28:03.801873+0000","last_fullsized":"2024-09-12T01:28:03.801873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.624321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811417+0000","last_change":"2024-09-12T01:26:14.435283+0000","last_active":"2024-09-12T01:28:03.811417+0000","last_peered":"2024-09-12T01:28:03.811417+0000","last_clean":"2024-09-12T01:28:03.811417+0000","last_became_active":"2024-09-12T01:26:14.434414+0000","last_became_peered":"2024-09-12T01:26:14.434414+0000","last_unstale":"2024-09-12T01:28:03.811417+0000","last_undegraded":"2024-09-12T01:28:03.811417+0000","last_fullsized":"2024-09-12T01:28:03.811417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.959405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'3","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881086+0000","last_change":"2024-09-12T01:26:26.273053+0000","last_active":"2024-09-12T01:28:03.881086+0000","last_peered":"2024-09-12T01:28:03.881086+0000","last_clean":"2024-09-12T01:28:03.881086+0000","last_became_active":"2024-09-12T01:26:26.267178+0000","last_became_peered":"2024-09-12T01:26:26.267178+0000","last_unstale":"2024-09-12T01:28:03.881086+0000","last_undegraded":"2024-09-12T01:28:03.881086+0000","last_fullsized":"2024-09-12T01:28:03.881086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:08.138485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880948+0000","last_change":"2024-09-12T01:26:14.433527+0000","last_active":"2024-09-12T01:28:03.880948+0000","last_peered":"2024-09-12T01:28:03.880948+0000","last_clean":"2024-09-12T01:28:03.880948+0000","last_became_active":"2024-09-12T01:26:14.433204+0000","last_became_peered":"2024-09-12T01:26:14.433204+0000","last_unstale":"2024-09-12T01:28:03.880948+0000","last_undegraded":"2024-09-12T01:28:03.880948+0000","last_fullsized":"2024-09-12T01:28:03.880948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:26.883916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883147+0000","last_change":"2024-09-12T01:26:12.420795+0000","last_active":"2024-09-12T01:28:03.883147+0000","last_peered":"2024-09-12T01:28:03.883147+0000","last_clean":"2024-09-12T01:28:03.883147+0000","last_became_active":"2024-09-12T01:26:12.420409+0000","last_became_peered":"2024-09-12T01:26:12.420409+0000","last_unstale":"2024-09-12T01:28:03.883147+0000","last_undegraded":"2024-09-12T01:28:03.883147+0000","last_fullsized":"2024-09-12T01:28:03.883147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:36.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940454+0000","last_change":"2024-09-12T01:26:14.440994+0000","last_active":"2024-09-12T01:28:03.940454+0000","last_peered":"2024-09-12T01:28:03.940454+0000","last_clean":"2024-09-12T01:28:03.940454+0000","last_became_active":"2024-09-12T01:26:14.440602+0000","last_became_peered":"2024-09-12T01:26:14.440602+0000","last_unstale":"2024-09-12T01:28:03.940454+0000","last_undegraded":"2024-09-12T01:28:03.940454+0000","last_fullsized":"2024-09-12T01:28:03.940454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.998991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'41","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.934193+0000","last_change":"2024-09-12T01:26:12.419448+0000","last_active":"2024-09-12T01:28:03.934193+0000","last_peered":"2024-09-12T01:28:03.934193+0000","last_clean":"2024-09-12T01:28:03.934193+0000","last_became_active":"2024-09-12T01:26:12.419000+0000","last_became_peered":"2024-09-12T01:26:12.419000+0000","last_unstale":"2024-09-12T01:28:03.934193+0000","last_undegraded":"2024-09-12T01:28:03.934193+0000","last_fullsized":"2024-09-12T01:28:03.934193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:37.818833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940268+0000","last_change":"2024-09-12T01:26:14.437818+0000","last_active":"2024-09-12T01:28:03.940268+0000","last_peered":"2024-09-12T01:28:03.940268+0000","last_clean":"2024-09-12T01:28:03.940268+0000","last_became_active":"2024-09-12T01:26:14.437497+0000","last_became_peered":"2024-09-12T01:26:14.437497+0000","last_unstale":"2024-09-12T01:28:03.940268+0000","last_undegraded":"2024-09-12T01:28:03.940268+0000","last_fullsized":"2024-09-12T01:28:03.940268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:57.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'7","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.663652+0000","last_change":"2024-09-12T01:26:12.855850+0000","last_active":"2024-09-12T01:28:04.663652+0000","last_peered":"2024-09-12T01:28:04.663652+0000","last_clean":"2024-09-12T01:28:04.663652+0000","last_became_active":"2024-09-12T01:26:12.855400+0000","last_became_peered":"2024-09-12T01:26:12.855400+0000","last_unstale":"2024-09-12T01:28:04.663652+0000","last_undegraded":"2024-09-12T01:28:04.663652+0000","last_fullsized":"2024-09-12T01:28:04.663652+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:32.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940460+0000","last_change":"2024-09-12T01:26:14.435982+0000","last_active":"2024-09-12T01:28:03.940460+0000","last_peered":"2024-09-12T01:28:03.940460+0000","last_clean":"2024-09-12T01:28:03.940460+0000","last_became_active":"2024-09-12T01:26:14.435595+0000","last_became_peered":"2024-09-12T01:26:14.435595+0000","last_unstale":"2024-09-12T01:28:03.940460+0000","last_undegraded":"2024-09-12T01:28:03.940460+0000","last_fullsized":"2024-09-12T01:28:03.940460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:31.101890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940390+0000","last_change":"2024-09-12T01:25:04.588449+0000","last_active":"2024-09-12T01:28:03.940390+0000","last_peered":"2024-09-12T01:28:03.940390+0000","last_clean":"2024-09-12T01:28:03.940390+0000","last_became_active":"2024-09-12T01:25:04.587949+0000","last_became_peered":"2024-09-12T01:25:04.587949+0000","last_unstale":"2024-09-12T01:28:03.940390+0000","last_undegraded":"2024-09-12T01:28:03.940390+0000","last_fullsized":"2024-09-12T01:28:03.940390+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_clean_scrub_stamp":"2024-09-12T01:21:41.345624+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:41.015289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825092+0000","last_change":"2024-09-12T01:26:12.421379+0000","last_active":"2024-09-12T01:28:03.825092+0000","last_peered":"2024-09-12T01:28:03.825092+0000","last_clean":"2024-09-12T01:28:03.825092+0000","last_became_active":"2024-09-12T01:26:12.421059+0000","last_became_peered":"2024-09-12T01:26:12.421059+0000","last_unstale":"2024-09-12T01:28:03.825092+0000","last_undegraded":"2024-09-12T01:28:03.825092+0000","last_fullsized":"2024-09-12T01:28:03.825092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802270+0000","last_change":"2024-09-12T01:26:14.430510+0000","last_active":"2024-09-12T01:28:03.802270+0000","last_peered":"2024-09-12T01:28:03.802270+0000","last_clean":"2024-09-12T01:28:03.802270+0000","last_became_active":"2024-09-12T01:26:14.430232+0000","last_became_peered":"2024-09-12T01:26:14.430232+0000","last_unstale":"2024-09-12T01:28:03.802270+0000","last_undegraded":"2024-09-12T01:28:03.802270+0000","last_fullsized":"2024-09-12T01:28:03.802270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:55.114616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940253+0000","last_change":"2024-09-12T01:26:12.420938+0000","last_active":"2024-09-12T01:28:03.940253+0000","last_peered":"2024-09-12T01:28:03.940253+0000","last_clean":"2024-09-12T01:28:03.940253+0000","last_became_active":"2024-09-12T01:26:12.420599+0000","last_became_peered":"2024-09-12T01:26:12.420599+0000","last_unstale":"2024-09-12T01:28:03.940253+0000","last_undegraded":"2024-09-12T01:28:03.940253+0000","last_fullsized":"2024-09-12T01:28:03.940253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.593237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883352+0000","last_change":"2024-09-12T01:26:14.428684+0000","last_active":"2024-09-12T01:28:03.883352+0000","last_peered":"2024-09-12T01:28:03.883352+0000","last_clean":"2024-09-12T01:28:03.883352+0000","last_became_active":"2024-09-12T01:26:14.428380+0000","last_became_peered":"2024-09-12T01:26:14.428380+0000","last_unstale":"2024-09-12T01:28:03.883352+0000","last_undegraded":"2024-09-12T01:28:03.883352+0000","last_fullsized":"2024-09-12T01:28:03.883352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:21.542122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883611+0000","last_change":"2024-09-12T01:26:12.800048+0000","last_active":"2024-09-12T01:28:03.883611+0000","last_peered":"2024-09-12T01:28:03.883611+0000","last_clean":"2024-09-12T01:28:03.883611+0000","last_became_active":"2024-09-12T01:26:12.799646+0000","last_became_peered":"2024-09-12T01:26:12.799646+0000","last_unstale":"2024-09-12T01:28:03.883611+0000","last_undegraded":"2024-09-12T01:28:03.883611+0000","last_fullsized":"2024-09-12T01:28:03.883611+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:39.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716527+0000","last_change":"2024-09-12T01:26:26.268110+0000","last_active":"2024-09-12T01:28:03.716527+0000","last_peered":"2024-09-12T01:28:03.716527+0000","last_clean":"2024-09-12T01:28:03.716527+0000","last_became_active":"2024-09-12T01:26:26.267764+0000","last_became_peered":"2024-09-12T01:26:26.267764+0000","last_unstale":"2024-09-12T01:28:03.716527+0000","last_undegraded":"2024-09-12T01:28:03.716527+0000","last_fullsized":"2024-09-12T01:28:03.716527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:37.009529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":131,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.618358+0000","last_change":"2024-09-12T01:26:12.424189+0000","last_active":"2024-09-12T01:28:04.618358+0000","last_peered":"2024-09-12T01:28:04.618358+0000","last_clean":"2024-09-12T01:28:04.618358+0000","last_became_active":"2024-09-12T01:26:12.423785+0000","last_became_peered":"2024-09-12T01:26:12.423785+0000","last_unstale":"2024-09-12T01:28:04.618358+0000","last_undegraded":"2024-09-12T01:28:04.618358+0000","last_fullsized":"2024-09-12T01:28:04.618358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:20.069821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814343+0000","last_change":"2024-09-12T01:26:14.437874+0000","last_active":"2024-09-12T01:28:03.814343+0000","last_peered":"2024-09-12T01:28:03.814343+0000","last_clean":"2024-09-12T01:28:03.814343+0000","last_became_active":"2024-09-12T01:26:14.437578+0000","last_became_peered":"2024-09-12T01:26:14.437578+0000","last_unstale":"2024-09-12T01:28:03.814343+0000","last_undegraded":"2024-09-12T01:28:03.814343+0000","last_fullsized":"2024-09-12T01:28:03.814343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:55.817763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716704+0000","last_change":"2024-09-12T01:26:26.267861+0000","last_active":"2024-09-12T01:28:03.716704+0000","last_peered":"2024-09-12T01:28:03.716704+0000","last_clean":"2024-09-12T01:28:03.716704+0000","last_became_active":"2024-09-12T01:26:26.267244+0000","last_became_peered":"2024-09-12T01:26:26.267244+0000","last_unstale":"2024-09-12T01:28:03.716704+0000","last_undegraded":"2024-09-12T01:28:03.716704+0000","last_fullsized":"2024-09-12T01:28:03.716704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:50.623916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814419+0000","last_change":"2024-09-12T01:26:14.434708+0000","last_active":"2024-09-12T01:28:03.814419+0000","last_peered":"2024-09-12T01:28:03.814419+0000","last_clean":"2024-09-12T01:28:03.814419+0000","last_became_active":"2024-09-12T01:26:14.434420+0000","last_became_peered":"2024-09-12T01:26:14.434420+0000","last_unstale":"2024-09-12T01:28:03.814419+0000","last_undegraded":"2024-09-12T01:28:03.814419+0000","last_fullsized":"2024-09-12T01:28:03.814419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:58.626769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802334+0000","last_change":"2024-09-12T01:26:12.800678+0000","last_active":"2024-09-12T01:28:03.802334+0000","last_peered":"2024-09-12T01:28:03.802334+0000","last_clean":"2024-09-12T01:28:03.802334+0000","last_became_active":"2024-09-12T01:26:12.800063+0000","last_became_peered":"2024-09-12T01:26:12.800063+0000","last_unstale":"2024-09-12T01:28:03.802334+0000","last_undegraded":"2024-09-12T01:28:03.802334+0000","last_fullsized":"2024-09-12T01:28:03.802334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:01.110686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882869+0000","last_change":"2024-09-12T01:26:14.425695+0000","last_active":"2024-09-12T01:28:03.882869+0000","last_peered":"2024-09-12T01:28:03.882869+0000","last_clean":"2024-09-12T01:28:03.882869+0000","last_became_active":"2024-09-12T01:26:14.425435+0000","last_became_peered":"2024-09-12T01:26:14.425435+0000","last_unstale":"2024-09-12T01:28:03.882869+0000","last_undegraded":"2024-09-12T01:28:03.882869+0000","last_fullsized":"2024-09-12T01:28:03.882869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:19.193669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'50","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.938195+0000","last_change":"2024-09-12T01:26:12.412743+0000","last_active":"2024-09-12T01:28:03.938195+0000","last_peered":"2024-09-12T01:28:03.938195+0000","last_clean":"2024-09-12T01:28:03.938195+0000","last_became_active":"2024-09-12T01:26:12.412376+0000","last_became_peered":"2024-09-12T01:26:12.412376+0000","last_unstale":"2024-09-12T01:28:03.938195+0000","last_undegraded":"2024-09-12T01:28:03.938195+0000","last_fullsized":"2024-09-12T01:28:03.938195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.542370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":89,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802661+0000","last_change":"2024-09-12T01:26:14.429727+0000","last_active":"2024-09-12T01:28:03.802661+0000","last_peered":"2024-09-12T01:28:03.802661+0000","last_clean":"2024-09-12T01:28:03.802661+0000","last_became_active":"2024-09-12T01:26:14.429385+0000","last_became_peered":"2024-09-12T01:26:14.429385+0000","last_unstale":"2024-09-12T01:28:03.802661+0000","last_undegraded":"2024-09-12T01:28:03.802661+0000","last_fullsized":"2024-09-12T01:28:03.802661+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:43.855786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825282+0000","last_change":"2024-09-12T01:26:12.855632+0000","last_active":"2024-09-12T01:28:03.825282+0000","last_peered":"2024-09-12T01:28:03.825282+0000","last_clean":"2024-09-12T01:28:03.825282+0000","last_became_active":"2024-09-12T01:26:12.855305+0000","last_became_peered":"2024-09-12T01:26:12.855305+0000","last_unstale":"2024-09-12T01:28:03.825282+0000","last_undegraded":"2024-09-12T01:28:03.825282+0000","last_fullsized":"2024-09-12T01:28:03.825282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.893689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883266+0000","last_change":"2024-09-12T01:26:14.428498+0000","last_active":"2024-09-12T01:28:03.883266+0000","last_peered":"2024-09-12T01:28:03.883266+0000","last_clean":"2024-09-12T01:28:03.883266+0000","last_became_active":"2024-09-12T01:26:14.428022+0000","last_became_peered":"2024-09-12T01:26:14.428022+0000","last_unstale":"2024-09-12T01:28:03.883266+0000","last_undegraded":"2024-09-12T01:28:03.883266+0000","last_fullsized":"2024-09-12T01:28:03.883266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.325399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717493+0000","last_change":"2024-09-12T01:26:12.800038+0000","last_active":"2024-09-12T01:28:03.717493+0000","last_peered":"2024-09-12T01:28:03.717493+0000","last_clean":"2024-09-12T01:28:03.717493+0000","last_became_active":"2024-09-12T01:26:12.799717+0000","last_became_peered":"2024-09-12T01:26:12.799717+0000","last_unstale":"2024-09-12T01:28:03.717493+0000","last_undegraded":"2024-09-12T01:28:03.717493+0000","last_fullsized":"2024-09-12T01:28:03.717493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.362437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801873+0000","last_change":"2024-09-12T01:26:14.430518+0000","last_active":"2024-09-12T01:28:03.801873+0000","last_peered":"2024-09-12T01:28:03.801873+0000","last_clean":"2024-09-12T01:28:03.801873+0000","last_became_active":"2024-09-12T01:26:14.430158+0000","last_became_peered":"2024-09-12T01:26:14.430158+0000","last_unstale":"2024-09-12T01:28:03.801873+0000","last_undegraded":"2024-09-12T01:28:03.801873+0000","last_fullsized":"2024-09-12T01:28:03.801873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:55.696101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802299+0000","last_change":"2024-09-12T01:26:12.418427+0000","last_active":"2024-09-12T01:28:03.802299+0000","last_peered":"2024-09-12T01:28:03.802299+0000","last_clean":"2024-09-12T01:28:03.802299+0000","last_became_active":"2024-09-12T01:26:12.418135+0000","last_became_peered":"2024-09-12T01:26:12.418135+0000","last_unstale":"2024-09-12T01:28:03.802299+0000","last_undegraded":"2024-09-12T01:28:03.802299+0000","last_fullsized":"2024-09-12T01:28:03.802299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:32.946485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880813+0000","last_change":"2024-09-12T01:26:14.425817+0000","last_active":"2024-09-12T01:28:03.880813+0000","last_peered":"2024-09-12T01:28:03.880813+0000","last_clean":"2024-09-12T01:28:03.880813+0000","last_became_active":"2024-09-12T01:26:14.425443+0000","last_became_peered":"2024-09-12T01:26:14.425443+0000","last_unstale":"2024-09-12T01:28:03.880813+0000","last_undegraded":"2024-09-12T01:28:03.880813+0000","last_fullsized":"2024-09-12T01:28:03.880813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720390+0000","last_change":"2024-09-12T01:26:12.422742+0000","last_active":"2024-09-12T01:28:03.720390+0000","last_peered":"2024-09-12T01:28:03.720390+0000","last_clean":"2024-09-12T01:28:03.720390+0000","last_became_active":"2024-09-12T01:26:12.421914+0000","last_became_peered":"2024-09-12T01:26:12.421914+0000","last_unstale":"2024-09-12T01:28:03.720390+0000","last_undegraded":"2024-09-12T01:28:03.720390+0000","last_fullsized":"2024-09-12T01:28:03.720390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:53.427112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802223+0000","last_change":"2024-09-12T01:26:14.430425+0000","last_active":"2024-09-12T01:28:03.802223+0000","last_peered":"2024-09-12T01:28:03.802223+0000","last_clean":"2024-09-12T01:28:03.802223+0000","last_became_active":"2024-09-12T01:26:14.430128+0000","last_became_peered":"2024-09-12T01:26:14.430128+0000","last_unstale":"2024-09-12T01:28:03.802223+0000","last_undegraded":"2024-09-12T01:28:03.802223+0000","last_fullsized":"2024-09-12T01:28:03.802223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:17.653908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802061+0000","last_change":"2024-09-12T01:26:12.421463+0000","last_active":"2024-09-12T01:28:03.802061+0000","last_peered":"2024-09-12T01:28:03.802061+0000","last_clean":"2024-09-12T01:28:03.802061+0000","last_became_active":"2024-09-12T01:26:12.421143+0000","last_became_peered":"2024-09-12T01:26:12.421143+0000","last_unstale":"2024-09-12T01:28:03.802061+0000","last_undegraded":"2024-09-12T01:28:03.802061+0000","last_fullsized":"2024-09-12T01:28:03.802061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:09.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940259+0000","last_change":"2024-09-12T01:26:14.428643+0000","last_active":"2024-09-12T01:28:03.940259+0000","last_peered":"2024-09-12T01:28:03.940259+0000","last_clean":"2024-09-12T01:28:03.940259+0000","last_became_active":"2024-09-12T01:26:14.428344+0000","last_became_peered":"2024-09-12T01:26:14.428344+0000","last_unstale":"2024-09-12T01:28:03.940259+0000","last_undegraded":"2024-09-12T01:28:03.940259+0000","last_fullsized":"2024-09-12T01:28:03.940259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:17.213238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811637+0000","last_change":"2024-09-12T01:26:14.435108+0000","last_active":"2024-09-12T01:28:03.811637+0000","last_peered":"2024-09-12T01:28:03.811637+0000","last_clean":"2024-09-12T01:28:03.811637+0000","last_became_active":"2024-09-12T01:26:14.434806+0000","last_became_peered":"2024-09-12T01:26:14.434806+0000","last_unstale":"2024-09-12T01:28:03.811637+0000","last_undegraded":"2024-09-12T01:28:03.811637+0000","last_fullsized":"2024-09-12T01:28:03.811637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:01.188981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802171+0000","last_change":"2024-09-12T01:26:12.419027+0000","last_active":"2024-09-12T01:28:03.802171+0000","last_peered":"2024-09-12T01:28:03.802171+0000","last_clean":"2024-09-12T01:28:03.802171+0000","last_became_active":"2024-09-12T01:26:12.418579+0000","last_became_peered":"2024-09-12T01:26:12.418579+0000","last_unstale":"2024-09-12T01:28:03.802171+0000","last_undegraded":"2024-09-12T01:28:03.802171+0000","last_fullsized":"2024-09-12T01:28:03.802171+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.119864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717484+0000","last_change":"2024-09-12T01:26:14.429532+0000","last_active":"2024-09-12T01:28:03.717484+0000","last_peered":"2024-09-12T01:28:03.717484+0000","last_clean":"2024-09-12T01:28:03.717484+0000","last_became_active":"2024-09-12T01:26:14.429134+0000","last_became_peered":"2024-09-12T01:26:14.429134+0000","last_unstale":"2024-09-12T01:28:03.717484+0000","last_undegraded":"2024-09-12T01:28:03.717484+0000","last_fullsized":"2024-09-12T01:28:03.717484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:47.403388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802252+0000","last_change":"2024-09-12T01:26:26.279322+0000","last_active":"2024-09-12T01:28:03.802252+0000","last_peered":"2024-09-12T01:28:03.802252+0000","last_clean":"2024-09-12T01:28:03.802252+0000","last_became_active":"2024-09-12T01:26:26.268752+0000","last_became_peered":"2024-09-12T01:26:26.268752+0000","last_unstale":"2024-09-12T01:28:03.802252+0000","last_undegraded":"2024-09-12T01:28:03.802252+0000","last_fullsized":"2024-09-12T01:28:03.802252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.411144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883645+0000","last_change":"2024-09-12T01:26:14.430831+0000","last_active":"2024-09-12T01:28:03.883645+0000","last_peered":"2024-09-12T01:28:03.883645+0000","last_clean":"2024-09-12T01:28:03.883645+0000","last_became_active":"2024-09-12T01:26:14.430531+0000","last_became_peered":"2024-09-12T01:26:14.430531+0000","last_unstale":"2024-09-12T01:28:03.883645+0000","last_undegraded":"2024-09-12T01:28:03.883645+0000","last_fullsized":"2024-09-12T01:28:03.883645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:02.522283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802763+0000","last_change":"2024-09-12T01:26:12.799921+0000","last_active":"2024-09-12T01:28:03.802763+0000","last_peered":"2024-09-12T01:28:03.802763+0000","last_clean":"2024-09-12T01:28:03.802763+0000","last_became_active":"2024-09-12T01:26:12.799608+0000","last_became_peered":"2024-09-12T01:26:12.799608+0000","last_unstale":"2024-09-12T01:28:03.802763+0000","last_undegraded":"2024-09-12T01:28:03.802763+0000","last_fullsized":"2024-09-12T01:28:03.802763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:00.821261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802625+0000","last_change":"2024-09-12T01:26:14.430937+0000","last_active":"2024-09-12T01:28:03.802625+0000","last_peered":"2024-09-12T01:28:03.802625+0000","last_clean":"2024-09-12T01:28:03.802625+0000","last_became_active":"2024-09-12T01:26:14.430656+0000","last_became_peered":"2024-09-12T01:26:14.430656+0000","last_unstale":"2024-09-12T01:28:03.802625+0000","last_undegraded":"2024-09-12T01:28:03.802625+0000","last_fullsized":"2024-09-12T01:28:03.802625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.874150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.001748+0000","last_change":"2024-09-12T01:26:12.419000+0000","last_active":"2024-09-12T01:28:04.001748+0000","last_peered":"2024-09-12T01:28:04.001748+0000","last_clean":"2024-09-12T01:28:04.001748+0000","last_became_active":"2024-09-12T01:26:12.418736+0000","last_became_peered":"2024-09-12T01:26:12.418736+0000","last_unstale":"2024-09-12T01:28:04.001748+0000","last_undegraded":"2024-09-12T01:28:04.001748+0000","last_fullsized":"2024-09-12T01:28:04.001748+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:31.586983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600525,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1141,"num_read_kb":687,"num_write":372,"num_write_kb":1462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1801575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":446094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37064,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708088,"statfs":{"total":95995035648,"available":95957082112,"internally_reserved":0,"allocated":1761280,"data_stored":1235800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972397,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28328,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716824,"statfs":{"total":95995035648,"available":95966027776,"internally_reserved":0,"allocated":1335296,"data_stored":838517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201330,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32484,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712668,"statfs":{"total":95995035648,"available":95961772032,"internally_reserved":0,"allocated":1327104,"data_stored":838873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28528,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716624,"statfs":{"total":95995035648,"available":95965822976,"internally_reserved":0,"allocated":1536000,"data_stored":1039912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":445411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1683456,"data_stored":1169477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":446199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36780,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708372,"statfs":{"total":95995035648,"available":95957372928,"internally_reserved":0,"allocated":1470464,"data_stored":969659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1007616,"data_stored":506780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":995328,"data_stored":512804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":447058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":134813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":394694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":201136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:28:06.921 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-12T01:28:06.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:28:07.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.060+0000 7f7e428c9640 1 -- 172.21.15.81:0/3413995707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c102610 msgr2=0x7f7e3c104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:07.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.060+0000 7f7e428c9640 1 --2- 172.21.15.81:0/3413995707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c102610 0x7f7e3c104a00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c009900 tx=0x7f7e2c02a410 comp rx=0 tx=0).stop 2024-09-12T01:28:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.061+0000 7f7e428c9640 1 -- 172.21.15.81:0/3413995707 shutdown_connections 2024-09-12T01:28:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.061+0000 7f7e428c9640 1 --2- 172.21.15.81:0/3413995707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e3c107870 0x7f7e3c109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.061+0000 7f7e428c9640 1 --2- 172.21.15.81:0/3413995707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e3c104f40 0x7f7e3c107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.061+0000 7f7e428c9640 1 --2- 172.21.15.81:0/3413995707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c102610 0x7f7e3c104a00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.061+0000 7f7e428c9640 1 -- 172.21.15.81:0/3413995707 >> 172.21.15.81:0/3413995707 conn(0x7f7e3c0fc170 msgr2=0x7f7e3c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.061+0000 7f7e428c9640 1 -- 172.21.15.81:0/3413995707 shutdown_connections 2024-09-12T01:28:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.061+0000 7f7e428c9640 1 -- 172.21.15.81:0/3413995707 wait complete. 2024-09-12T01:28:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.061+0000 7f7e428c9640 1 Processor -- start 2024-09-12T01:28:07.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.061+0000 7f7e428c9640 1 -- start start 2024-09-12T01:28:07.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e428c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e3c102610 0x7f7e3c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:07.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e428c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c104f40 0x7f7e3c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:07.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e428c9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e3c107870 0x7f7e3c19f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:07.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e428c9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c10d7f0 con 0x7f7e3c104f40 2024-09-12T01:28:07.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e428c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c10d670 con 0x7f7e3c102610 2024-09-12T01:28:07.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e428c9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c10d970 con 0x7f7e3c107870 2024-09-12T01:28:07.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e3b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c104f40 0x7f7e3c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:07.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e3b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c104f40 0x7f7e3c1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40144/0 (socket says 172.21.15.81:40144) 2024-09-12T01:28:07.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e3b7fe640 1 -- 172.21.15.81:0/2347052289 learned_addr learned my addr 172.21.15.81:0/2347052289 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:07.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e3bfff640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e3c102610 0x7f7e3c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:07.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e40e66640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e3c107870 0x7f7e3c19f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:07.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e3b7fe640 1 -- 172.21.15.81:0/2347052289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e3c107870 msgr2=0x7f7e3c19f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:07.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e3b7fe640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e3c107870 0x7f7e3c19f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:07.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e3b7fe640 1 -- 172.21.15.81:0/2347052289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e3c102610 msgr2=0x7f7e3c197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:07.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e3b7fe640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e3c102610 0x7f7e3c197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:07.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e3b7fe640 1 -- 172.21.15.81:0/2347052289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3c19fac0 con 0x7f7e3c104f40 2024-09-12T01:28:07.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e3bfff640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e3c102610 0x7f7e3c197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:07.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.062+0000 7f7e3b7fe640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c104f40 0x7f7e3c1983e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000d740 tx=0x7f7e3000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:07.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.063+0000 7f7e397fa640 1 -- 172.21.15.81:0/2347052289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e30017070 con 0x7f7e3c104f40 2024-09-12T01:28:07.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.063+0000 7f7e397fa640 1 -- 172.21.15.81:0/2347052289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e3000de50 con 0x7f7e3c104f40 2024-09-12T01:28:07.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.063+0000 7f7e397fa640 1 -- 172.21.15.81:0/2347052289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e30004e00 con 0x7f7e3c104f40 2024-09-12T01:28:07.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.063+0000 7f7e428c9640 1 -- 172.21.15.81:0/2347052289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e3c19fdb0 con 0x7f7e3c104f40 2024-09-12T01:28:07.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.063+0000 7f7e428c9640 1 -- 172.21.15.81:0/2347052289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e3c1a0270 con 0x7f7e3c104f40 2024-09-12T01:28:07.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.064+0000 7f7e428c9640 1 -- 172.21.15.81:0/2347052289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e3c0fdc60 con 0x7f7e3c104f40 2024-09-12T01:28:07.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.065+0000 7f7e397fa640 1 -- 172.21.15.81:0/2347052289 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 137953+0+0 (secure 0 0 0) 0x7f7e30004fa0 con 0x7f7e3c104f40 2024-09-12T01:28:07.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.066+0000 7f7e397fa640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7e240a2d80 0x7f7e240a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:07.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.066+0000 7f7e3bfff640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7e240a2d80 0x7f7e240a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:07.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.066+0000 7f7e397fa640 1 -- 172.21.15.81:0/2347052289 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7e300cf210 con 0x7f7e3c104f40 2024-09-12T01:28:07.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.066+0000 7f7e3bfff640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7e240a2d80 0x7f7e240a5240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c000c00 tx=0x7f7e2c0095f0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:07.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.069+0000 7f7e397fa640 1 -- 172.21.15.81:0/2347052289 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e3009be80 con 0x7f7e3c104f40 2024-09-12T01:28:07.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:28:07.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-12T01:28:07.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: Unable to set osd_memory_target on smithi100 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-12T01:28:07.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-12T01:28:07.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: Unable to set osd_memory_target on smithi189 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-12T01:28:07.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:07.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.240 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:06 smithi081 ceph-mon[30920]: mgrmap e23: x(active, since 3s), standbys: z, y 2024-09-12T01:28:07.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.240+0000 7f7e428c9640 1 -- 172.21.15.81:0/2347052289 --> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e3c062630 con 0x7f7e240a2d80 2024-09-12T01:28:07.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.247+0000 7f7e397fa640 1 -- 172.21.15.81:0/2347052289 <== mgr.15222 v2:172.21.15.81:6800/1379528564 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257783 (secure 0 0 0) 0x7f7e3c062630 con 0x7f7e240a2d80 2024-09-12T01:28:07.250 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:07.251 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T01:28:07.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.250+0000 7f7e428c9640 1 -- 172.21.15.81:0/2347052289 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7e240a2d80 msgr2=0x7f7e240a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:07.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.250+0000 7f7e428c9640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7e240a2d80 0x7f7e240a5240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c000c00 tx=0x7f7e2c0095f0 comp rx=0 tx=0).stop 2024-09-12T01:28:07.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.250+0000 7f7e428c9640 1 -- 172.21.15.81:0/2347052289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c104f40 msgr2=0x7f7e3c1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.250+0000 7f7e428c9640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c104f40 0x7f7e3c1983e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000d740 tx=0x7f7e3000dc00 comp rx=0 tx=0).stop 2024-09-12T01:28:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.251+0000 7f7e428c9640 1 -- 172.21.15.81:0/2347052289 shutdown_connections 2024-09-12T01:28:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.251+0000 7f7e428c9640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7e240a2d80 0x7f7e240a5240 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.251+0000 7f7e428c9640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e3c107870 0x7f7e3c19f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.251+0000 7f7e428c9640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e3c104f40 0x7f7e3c1983e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.251+0000 7f7e428c9640 1 --2- 172.21.15.81:0/2347052289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e3c102610 0x7f7e3c197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.251+0000 7f7e428c9640 1 -- 172.21.15.81:0/2347052289 >> 172.21.15.81:0/2347052289 conn(0x7f7e3c0fc170 msgr2=0x7f7e3c102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.251+0000 7f7e428c9640 1 -- 172.21.15.81:0/2347052289 shutdown_connections 2024-09-12T01:28:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:07.251+0000 7f7e428c9640 1 -- 172.21.15.81:0/2347052289 wait complete. 2024-09-12T01:28:07.263 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-12T01:28:05.729931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191127,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1277,"num_read_kb":806,"num_write":555,"num_write_kb":4402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180758,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":938,"ondisk_log_size":938,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380408,"kb_used_data":14488,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124561416,"statfs":{"total":1151940427776,"available":1151550889984,"internally_reserved":0,"allocated":14835712,"data_stored":8896584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.987671"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881117+0000","last_change":"2024-09-12T01:26:14.433907+0000","last_active":"2024-09-12T01:28:03.881117+0000","last_peered":"2024-09-12T01:28:03.881117+0000","last_clean":"2024-09-12T01:28:03.881117+0000","last_became_active":"2024-09-12T01:26:14.433495+0000","last_became_peered":"2024-09-12T01:26:14.433495+0000","last_unstale":"2024-09-12T01:28:03.881117+0000","last_undegraded":"2024-09-12T01:28:03.881117+0000","last_fullsized":"2024-09-12T01:28:03.881117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:12.836491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883125+0000","last_change":"2024-09-12T01:26:14.430873+0000","last_active":"2024-09-12T01:28:03.883125+0000","last_peered":"2024-09-12T01:28:03.883125+0000","last_clean":"2024-09-12T01:28:03.883125+0000","last_became_active":"2024-09-12T01:26:14.430572+0000","last_became_peered":"2024-09-12T01:26:14.430572+0000","last_unstale":"2024-09-12T01:28:03.883125+0000","last_undegraded":"2024-09-12T01:28:03.883125+0000","last_fullsized":"2024-09-12T01:28:03.883125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:15.160712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882818+0000","last_change":"2024-09-12T01:26:14.426117+0000","last_active":"2024-09-12T01:28:03.882818+0000","last_peered":"2024-09-12T01:28:03.882818+0000","last_clean":"2024-09-12T01:28:03.882818+0000","last_became_active":"2024-09-12T01:26:14.425831+0000","last_became_peered":"2024-09-12T01:26:14.425831+0000","last_unstale":"2024-09-12T01:28:03.882818+0000","last_undegraded":"2024-09-12T01:28:03.882818+0000","last_fullsized":"2024-09-12T01:28:03.882818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:15.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825114+0000","last_change":"2024-09-12T01:26:14.434545+0000","last_active":"2024-09-12T01:28:03.825114+0000","last_peered":"2024-09-12T01:28:03.825114+0000","last_clean":"2024-09-12T01:28:03.825114+0000","last_became_active":"2024-09-12T01:26:14.434222+0000","last_became_peered":"2024-09-12T01:26:14.434222+0000","last_unstale":"2024-09-12T01:28:03.825114+0000","last_undegraded":"2024-09-12T01:28:03.825114+0000","last_fullsized":"2024-09-12T01:28:03.825114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:36.789145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801925+0000","last_change":"2024-09-12T01:26:14.421900+0000","last_active":"2024-09-12T01:28:03.801925+0000","last_peered":"2024-09-12T01:28:03.801925+0000","last_clean":"2024-09-12T01:28:03.801925+0000","last_became_active":"2024-09-12T01:26:14.421558+0000","last_became_peered":"2024-09-12T01:26:14.421558+0000","last_unstale":"2024-09-12T01:28:03.801925+0000","last_undegraded":"2024-09-12T01:28:03.801925+0000","last_fullsized":"2024-09-12T01:28:03.801925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814207+0000","last_change":"2024-09-12T01:26:14.436641+0000","last_active":"2024-09-12T01:28:03.814207+0000","last_peered":"2024-09-12T01:28:03.814207+0000","last_clean":"2024-09-12T01:28:03.814207+0000","last_became_active":"2024-09-12T01:26:14.436347+0000","last_became_peered":"2024-09-12T01:26:14.436347+0000","last_unstale":"2024-09-12T01:28:03.814207+0000","last_undegraded":"2024-09-12T01:28:03.814207+0000","last_fullsized":"2024-09-12T01:28:03.814207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:52.756035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940185+0000","last_change":"2024-09-12T01:26:14.438676+0000","last_active":"2024-09-12T01:28:03.940185+0000","last_peered":"2024-09-12T01:28:03.940185+0000","last_clean":"2024-09-12T01:28:03.940185+0000","last_became_active":"2024-09-12T01:26:14.438332+0000","last_became_peered":"2024-09-12T01:26:14.438332+0000","last_unstale":"2024-09-12T01:28:03.940185+0000","last_undegraded":"2024-09-12T01:28:03.940185+0000","last_fullsized":"2024-09-12T01:28:03.940185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:06.459830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802047+0000","last_change":"2024-09-12T01:26:14.431676+0000","last_active":"2024-09-12T01:28:03.802047+0000","last_peered":"2024-09-12T01:28:03.802047+0000","last_clean":"2024-09-12T01:28:03.802047+0000","last_became_active":"2024-09-12T01:26:14.431378+0000","last_became_peered":"2024-09-12T01:26:14.431378+0000","last_unstale":"2024-09-12T01:28:03.802047+0000","last_undegraded":"2024-09-12T01:28:03.802047+0000","last_fullsized":"2024-09-12T01:28:03.802047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:23.523350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717979+0000","last_change":"2024-09-12T01:26:14.428381+0000","last_active":"2024-09-12T01:28:03.717979+0000","last_peered":"2024-09-12T01:28:03.717979+0000","last_clean":"2024-09-12T01:28:03.717979+0000","last_became_active":"2024-09-12T01:26:14.428031+0000","last_became_peered":"2024-09-12T01:26:14.428031+0000","last_unstale":"2024-09-12T01:28:03.717979+0000","last_undegraded":"2024-09-12T01:28:03.717979+0000","last_fullsized":"2024-09-12T01:28:03.717979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:40.920911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814620+0000","last_change":"2024-09-12T01:26:14.438849+0000","last_active":"2024-09-12T01:28:03.814620+0000","last_peered":"2024-09-12T01:28:03.814620+0000","last_clean":"2024-09-12T01:28:03.814620+0000","last_became_active":"2024-09-12T01:26:14.438510+0000","last_became_peered":"2024-09-12T01:26:14.438510+0000","last_unstale":"2024-09-12T01:28:03.814620+0000","last_undegraded":"2024-09-12T01:28:03.814620+0000","last_fullsized":"2024-09-12T01:28:03.814620+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:12.257292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940484+0000","last_change":"2024-09-12T01:26:14.436468+0000","last_active":"2024-09-12T01:28:03.940484+0000","last_peered":"2024-09-12T01:28:03.940484+0000","last_clean":"2024-09-12T01:28:03.940484+0000","last_became_active":"2024-09-12T01:26:14.436095+0000","last_became_peered":"2024-09-12T01:26:14.436095+0000","last_unstale":"2024-09-12T01:28:03.940484+0000","last_undegraded":"2024-09-12T01:28:03.940484+0000","last_fullsized":"2024-09-12T01:28:03.940484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:43.441358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825119+0000","last_change":"2024-09-12T01:26:14.431384+0000","last_active":"2024-09-12T01:28:03.825119+0000","last_peered":"2024-09-12T01:28:03.825119+0000","last_clean":"2024-09-12T01:28:03.825119+0000","last_became_active":"2024-09-12T01:26:14.431079+0000","last_became_peered":"2024-09-12T01:26:14.431079+0000","last_unstale":"2024-09-12T01:28:03.825119+0000","last_undegraded":"2024-09-12T01:28:03.825119+0000","last_fullsized":"2024-09-12T01:28:03.825119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.178038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882393+0000","last_change":"2024-09-12T01:26:14.430163+0000","last_active":"2024-09-12T01:28:03.882393+0000","last_peered":"2024-09-12T01:28:03.882393+0000","last_clean":"2024-09-12T01:28:03.882393+0000","last_became_active":"2024-09-12T01:26:14.429863+0000","last_became_peered":"2024-09-12T01:26:14.429863+0000","last_unstale":"2024-09-12T01:28:03.882393+0000","last_undegraded":"2024-09-12T01:28:03.882393+0000","last_fullsized":"2024-09-12T01:28:03.882393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:44.432677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882103+0000","last_change":"2024-09-12T01:26:14.427304+0000","last_active":"2024-09-12T01:28:03.882103+0000","last_peered":"2024-09-12T01:28:03.882103+0000","last_clean":"2024-09-12T01:28:03.882103+0000","last_became_active":"2024-09-12T01:26:14.427006+0000","last_became_peered":"2024-09-12T01:26:14.427006+0000","last_unstale":"2024-09-12T01:28:03.882103+0000","last_undegraded":"2024-09-12T01:28:03.882103+0000","last_fullsized":"2024-09-12T01:28:03.882103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.930959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881815+0000","last_change":"2024-09-12T01:26:14.431018+0000","last_active":"2024-09-12T01:28:03.881815+0000","last_peered":"2024-09-12T01:28:03.881815+0000","last_clean":"2024-09-12T01:28:03.881815+0000","last_became_active":"2024-09-12T01:26:14.429518+0000","last_became_peered":"2024-09-12T01:26:14.429518+0000","last_unstale":"2024-09-12T01:28:03.881815+0000","last_undegraded":"2024-09-12T01:28:03.881815+0000","last_fullsized":"2024-09-12T01:28:03.881815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.504814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717400+0000","last_change":"2024-09-12T01:26:14.430601+0000","last_active":"2024-09-12T01:28:03.717400+0000","last_peered":"2024-09-12T01:28:03.717400+0000","last_clean":"2024-09-12T01:28:03.717400+0000","last_became_active":"2024-09-12T01:26:14.430304+0000","last_became_peered":"2024-09-12T01:26:14.430304+0000","last_unstale":"2024-09-12T01:28:03.717400+0000","last_undegraded":"2024-09-12T01:28:03.717400+0000","last_fullsized":"2024-09-12T01:28:03.717400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.414767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881148+0000","last_change":"2024-09-12T01:26:14.432934+0000","last_active":"2024-09-12T01:28:03.881148+0000","last_peered":"2024-09-12T01:28:03.881148+0000","last_clean":"2024-09-12T01:28:03.881148+0000","last_became_active":"2024-09-12T01:26:14.432417+0000","last_became_peered":"2024-09-12T01:26:14.432417+0000","last_unstale":"2024-09-12T01:28:03.881148+0000","last_undegraded":"2024-09-12T01:28:03.881148+0000","last_fullsized":"2024-09-12T01:28:03.881148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.964880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716779+0000","last_change":"2024-09-12T01:26:14.429956+0000","last_active":"2024-09-12T01:28:03.716779+0000","last_peered":"2024-09-12T01:28:03.716779+0000","last_clean":"2024-09-12T01:28:03.716779+0000","last_became_active":"2024-09-12T01:26:14.429610+0000","last_became_peered":"2024-09-12T01:26:14.429610+0000","last_unstale":"2024-09-12T01:28:03.716779+0000","last_undegraded":"2024-09-12T01:28:03.716779+0000","last_fullsized":"2024-09-12T01:28:03.716779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:51.453221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720646+0000","last_change":"2024-09-12T01:26:14.423624+0000","last_active":"2024-09-12T01:28:03.720646+0000","last_peered":"2024-09-12T01:28:03.720646+0000","last_clean":"2024-09-12T01:28:03.720646+0000","last_became_active":"2024-09-12T01:26:14.423314+0000","last_became_peered":"2024-09-12T01:26:14.423314+0000","last_unstale":"2024-09-12T01:28:03.720646+0000","last_undegraded":"2024-09-12T01:28:03.720646+0000","last_fullsized":"2024-09-12T01:28:03.720646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.414323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880810+0000","last_change":"2024-09-12T01:26:14.433548+0000","last_active":"2024-09-12T01:28:03.880810+0000","last_peered":"2024-09-12T01:28:03.880810+0000","last_clean":"2024-09-12T01:28:03.880810+0000","last_became_active":"2024-09-12T01:26:14.433223+0000","last_became_peered":"2024-09-12T01:26:14.433223+0000","last_unstale":"2024-09-12T01:28:03.880810+0000","last_undegraded":"2024-09-12T01:28:03.880810+0000","last_fullsized":"2024-09-12T01:28:03.880810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.247354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882535+0000","last_change":"2024-09-12T01:26:14.431715+0000","last_active":"2024-09-12T01:28:03.882535+0000","last_peered":"2024-09-12T01:28:03.882535+0000","last_clean":"2024-09-12T01:28:03.882535+0000","last_became_active":"2024-09-12T01:26:14.430839+0000","last_became_peered":"2024-09-12T01:26:14.430839+0000","last_unstale":"2024-09-12T01:28:03.882535+0000","last_undegraded":"2024-09-12T01:28:03.882535+0000","last_fullsized":"2024-09-12T01:28:03.882535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:04.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717611+0000","last_change":"2024-09-12T01:26:14.431385+0000","last_active":"2024-09-12T01:28:03.717611+0000","last_peered":"2024-09-12T01:28:03.717611+0000","last_clean":"2024-09-12T01:28:03.717611+0000","last_became_active":"2024-09-12T01:26:14.431046+0000","last_became_peered":"2024-09-12T01:26:14.431046+0000","last_unstale":"2024-09-12T01:28:03.717611+0000","last_undegraded":"2024-09-12T01:28:03.717611+0000","last_fullsized":"2024-09-12T01:28:03.717611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:42.495019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802146+0000","last_change":"2024-09-12T01:26:14.427737+0000","last_active":"2024-09-12T01:28:03.802146+0000","last_peered":"2024-09-12T01:28:03.802146+0000","last_clean":"2024-09-12T01:28:03.802146+0000","last_became_active":"2024-09-12T01:26:14.427409+0000","last_became_peered":"2024-09-12T01:26:14.427409+0000","last_unstale":"2024-09-12T01:28:03.802146+0000","last_undegraded":"2024-09-12T01:28:03.802146+0000","last_fullsized":"2024-09-12T01:28:03.802146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:02.632914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811345+0000","last_change":"2024-09-12T01:26:14.433426+0000","last_active":"2024-09-12T01:28:03.811345+0000","last_peered":"2024-09-12T01:28:03.811345+0000","last_clean":"2024-09-12T01:28:03.811345+0000","last_became_active":"2024-09-12T01:26:14.431918+0000","last_became_peered":"2024-09-12T01:26:14.431918+0000","last_unstale":"2024-09-12T01:28:03.811345+0000","last_undegraded":"2024-09-12T01:28:03.811345+0000","last_fullsized":"2024-09-12T01:28:03.811345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.946072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716825+0000","last_change":"2024-09-12T01:26:26.268358+0000","last_active":"2024-09-12T01:28:03.716825+0000","last_peered":"2024-09-12T01:28:03.716825+0000","last_clean":"2024-09-12T01:28:03.716825+0000","last_became_active":"2024-09-12T01:26:26.268005+0000","last_became_peered":"2024-09-12T01:26:26.268005+0000","last_unstale":"2024-09-12T01:28:03.716825+0000","last_undegraded":"2024-09-12T01:28:03.716825+0000","last_fullsized":"2024-09-12T01:28:03.716825+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:53.977249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720710+0000","last_change":"2024-09-12T01:26:14.434536+0000","last_active":"2024-09-12T01:28:03.720710+0000","last_peered":"2024-09-12T01:28:03.720710+0000","last_clean":"2024-09-12T01:28:03.720710+0000","last_became_active":"2024-09-12T01:26:14.434148+0000","last_became_peered":"2024-09-12T01:26:14.434148+0000","last_unstale":"2024-09-12T01:28:03.720710+0000","last_undegraded":"2024-09-12T01:28:03.720710+0000","last_fullsized":"2024-09-12T01:28:03.720710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:47.576827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880923+0000","last_change":"2024-09-12T01:26:14.428040+0000","last_active":"2024-09-12T01:28:03.880923+0000","last_peered":"2024-09-12T01:28:03.880923+0000","last_clean":"2024-09-12T01:28:03.880923+0000","last_became_active":"2024-09-12T01:26:14.427709+0000","last_became_peered":"2024-09-12T01:26:14.427709+0000","last_unstale":"2024-09-12T01:28:03.880923+0000","last_undegraded":"2024-09-12T01:28:03.880923+0000","last_fullsized":"2024-09-12T01:28:03.880923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.256097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882750+0000","last_change":"2024-09-12T01:26:26.265649+0000","last_active":"2024-09-12T01:28:03.882750+0000","last_peered":"2024-09-12T01:28:03.882750+0000","last_clean":"2024-09-12T01:28:03.882750+0000","last_became_active":"2024-09-12T01:26:26.265251+0000","last_became_peered":"2024-09-12T01:26:26.265251+0000","last_unstale":"2024-09-12T01:28:03.882750+0000","last_undegraded":"2024-09-12T01:28:03.882750+0000","last_fullsized":"2024-09-12T01:28:03.882750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:31.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882448+0000","last_change":"2024-09-12T01:26:14.427596+0000","last_active":"2024-09-12T01:28:03.882448+0000","last_peered":"2024-09-12T01:28:03.882448+0000","last_clean":"2024-09-12T01:28:03.882448+0000","last_became_active":"2024-09-12T01:26:14.427291+0000","last_became_peered":"2024-09-12T01:26:14.427291+0000","last_unstale":"2024-09-12T01:28:03.882448+0000","last_undegraded":"2024-09-12T01:28:03.882448+0000","last_fullsized":"2024-09-12T01:28:03.882448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:51.529835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720369+0000","last_change":"2024-09-12T01:26:14.424197+0000","last_active":"2024-09-12T01:28:03.720369+0000","last_peered":"2024-09-12T01:28:03.720369+0000","last_clean":"2024-09-12T01:28:03.720369+0000","last_became_active":"2024-09-12T01:26:14.423422+0000","last_became_peered":"2024-09-12T01:26:14.423422+0000","last_unstale":"2024-09-12T01:28:03.720369+0000","last_undegraded":"2024-09-12T01:28:03.720369+0000","last_fullsized":"2024-09-12T01:28:03.720369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.725623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720421+0000","last_change":"2024-09-12T01:26:14.428116+0000","last_active":"2024-09-12T01:28:03.720421+0000","last_peered":"2024-09-12T01:28:03.720421+0000","last_clean":"2024-09-12T01:28:03.720421+0000","last_became_active":"2024-09-12T01:26:14.427804+0000","last_became_peered":"2024-09-12T01:26:14.427804+0000","last_unstale":"2024-09-12T01:28:03.720421+0000","last_undegraded":"2024-09-12T01:28:03.720421+0000","last_fullsized":"2024-09-12T01:28:03.720421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:02.271305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880755+0000","last_change":"2024-09-12T01:26:14.432659+0000","last_active":"2024-09-12T01:28:03.880755+0000","last_peered":"2024-09-12T01:28:03.880755+0000","last_clean":"2024-09-12T01:28:03.880755+0000","last_became_active":"2024-09-12T01:26:14.432331+0000","last_became_peered":"2024-09-12T01:26:14.432331+0000","last_unstale":"2024-09-12T01:28:03.880755+0000","last_undegraded":"2024-09-12T01:28:03.880755+0000","last_fullsized":"2024-09-12T01:28:03.880755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.868909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801888+0000","last_change":"2024-09-12T01:26:14.426167+0000","last_active":"2024-09-12T01:28:03.801888+0000","last_peered":"2024-09-12T01:28:03.801888+0000","last_clean":"2024-09-12T01:28:03.801888+0000","last_became_active":"2024-09-12T01:26:14.425847+0000","last_became_peered":"2024-09-12T01:26:14.425847+0000","last_unstale":"2024-09-12T01:28:03.801888+0000","last_undegraded":"2024-09-12T01:28:03.801888+0000","last_fullsized":"2024-09-12T01:28:03.801888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:39.481527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.399114+0000","last_change":"2024-09-12T01:26:12.421487+0000","last_active":"2024-09-12T01:28:04.399114+0000","last_peered":"2024-09-12T01:28:04.399114+0000","last_clean":"2024-09-12T01:28:04.399114+0000","last_became_active":"2024-09-12T01:26:12.421096+0000","last_became_peered":"2024-09-12T01:26:12.421096+0000","last_unstale":"2024-09-12T01:28:04.399114+0000","last_undegraded":"2024-09-12T01:28:04.399114+0000","last_fullsized":"2024-09-12T01:28:04.399114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:12.410280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811514+0000","last_change":"2024-09-12T01:26:26.270310+0000","last_active":"2024-09-12T01:28:03.811514+0000","last_peered":"2024-09-12T01:28:03.811514+0000","last_clean":"2024-09-12T01:28:03.811514+0000","last_became_active":"2024-09-12T01:26:26.269917+0000","last_became_peered":"2024-09-12T01:26:26.269917+0000","last_unstale":"2024-09-12T01:28:03.811514+0000","last_undegraded":"2024-09-12T01:28:03.811514+0000","last_fullsized":"2024-09-12T01:28:03.811514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:29.549456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814260+0000","last_change":"2024-09-12T01:26:26.287218+0000","last_active":"2024-09-12T01:28:03.814260+0000","last_peered":"2024-09-12T01:28:03.814260+0000","last_clean":"2024-09-12T01:28:03.814260+0000","last_became_active":"2024-09-12T01:26:26.282251+0000","last_became_peered":"2024-09-12T01:26:26.282251+0000","last_unstale":"2024-09-12T01:28:03.814260+0000","last_undegraded":"2024-09-12T01:28:03.814260+0000","last_fullsized":"2024-09-12T01:28:03.814260+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:53.888064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883469+0000","last_change":"2024-09-12T01:26:12.416100+0000","last_active":"2024-09-12T01:28:03.883469+0000","last_peered":"2024-09-12T01:28:03.883469+0000","last_clean":"2024-09-12T01:28:03.883469+0000","last_became_active":"2024-09-12T01:26:12.415799+0000","last_became_peered":"2024-09-12T01:26:12.415799+0000","last_unstale":"2024-09-12T01:28:03.883469+0000","last_undegraded":"2024-09-12T01:28:03.883469+0000","last_fullsized":"2024-09-12T01:28:03.883469+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:41.826537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802089+0000","last_change":"2024-09-12T01:26:14.424922+0000","last_active":"2024-09-12T01:28:03.802089+0000","last_peered":"2024-09-12T01:28:03.802089+0000","last_clean":"2024-09-12T01:28:03.802089+0000","last_became_active":"2024-09-12T01:26:14.424580+0000","last_became_peered":"2024-09-12T01:26:14.424580+0000","last_unstale":"2024-09-12T01:28:03.802089+0000","last_undegraded":"2024-09-12T01:28:03.802089+0000","last_fullsized":"2024-09-12T01:28:03.802089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:05.697287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811489+0000","last_change":"2024-09-12T01:26:12.419339+0000","last_active":"2024-09-12T01:28:03.811489+0000","last_peered":"2024-09-12T01:28:03.811489+0000","last_clean":"2024-09-12T01:28:03.811489+0000","last_became_active":"2024-09-12T01:26:12.418925+0000","last_became_peered":"2024-09-12T01:26:12.418925+0000","last_unstale":"2024-09-12T01:28:03.811489+0000","last_undegraded":"2024-09-12T01:28:03.811489+0000","last_fullsized":"2024-09-12T01:28:03.811489+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.390691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716540+0000","last_change":"2024-09-12T01:26:14.426611+0000","last_active":"2024-09-12T01:28:03.716540+0000","last_peered":"2024-09-12T01:28:03.716540+0000","last_clean":"2024-09-12T01:28:03.716540+0000","last_became_active":"2024-09-12T01:26:14.426268+0000","last_became_peered":"2024-09-12T01:26:14.426268+0000","last_unstale":"2024-09-12T01:28:03.716540+0000","last_undegraded":"2024-09-12T01:28:03.716540+0000","last_fullsized":"2024-09-12T01:28:03.716540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:34.676841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":230,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.398504+0000","last_change":"2024-09-12T01:26:12.420302+0000","last_active":"2024-09-12T01:28:04.398504+0000","last_peered":"2024-09-12T01:28:04.398504+0000","last_clean":"2024-09-12T01:28:04.398504+0000","last_became_active":"2024-09-12T01:26:12.419943+0000","last_became_peered":"2024-09-12T01:26:12.419943+0000","last_unstale":"2024-09-12T01:28:04.398504+0000","last_undegraded":"2024-09-12T01:28:04.398504+0000","last_fullsized":"2024-09-12T01:28:04.398504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:30.704272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717828+0000","last_change":"2024-09-12T01:26:14.433112+0000","last_active":"2024-09-12T01:28:03.717828+0000","last_peered":"2024-09-12T01:28:03.717828+0000","last_clean":"2024-09-12T01:28:03.717828+0000","last_became_active":"2024-09-12T01:26:14.432803+0000","last_became_peered":"2024-09-12T01:26:14.432803+0000","last_unstale":"2024-09-12T01:28:03.717828+0000","last_undegraded":"2024-09-12T01:28:03.717828+0000","last_fullsized":"2024-09-12T01:28:03.717828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:33.670485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940319+0000","last_change":"2024-09-12T01:26:12.424854+0000","last_active":"2024-09-12T01:28:03.940319+0000","last_peered":"2024-09-12T01:28:03.940319+0000","last_clean":"2024-09-12T01:28:03.940319+0000","last_became_active":"2024-09-12T01:26:12.424476+0000","last_became_peered":"2024-09-12T01:26:12.424476+0000","last_unstale":"2024-09-12T01:28:03.940319+0000","last_undegraded":"2024-09-12T01:28:03.940319+0000","last_fullsized":"2024-09-12T01:28:03.940319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:03.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883795+0000","last_change":"2024-09-12T01:26:14.431580+0000","last_active":"2024-09-12T01:28:03.883795+0000","last_peered":"2024-09-12T01:28:03.883795+0000","last_clean":"2024-09-12T01:28:03.883795+0000","last_became_active":"2024-09-12T01:26:14.431237+0000","last_became_peered":"2024-09-12T01:26:14.431237+0000","last_unstale":"2024-09-12T01:28:03.883795+0000","last_undegraded":"2024-09-12T01:28:03.883795+0000","last_fullsized":"2024-09-12T01:28:03.883795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:32.562156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811710+0000","last_change":"2024-09-12T01:26:12.802015+0000","last_active":"2024-09-12T01:28:03.811710+0000","last_peered":"2024-09-12T01:28:03.811710+0000","last_clean":"2024-09-12T01:28:03.811710+0000","last_became_active":"2024-09-12T01:26:12.801605+0000","last_became_peered":"2024-09-12T01:26:12.801605+0000","last_unstale":"2024-09-12T01:28:03.811710+0000","last_undegraded":"2024-09-12T01:28:03.811710+0000","last_fullsized":"2024-09-12T01:28:03.811710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:24.703911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717615+0000","last_change":"2024-09-12T01:26:14.433305+0000","last_active":"2024-09-12T01:28:03.717615+0000","last_peered":"2024-09-12T01:28:03.717615+0000","last_clean":"2024-09-12T01:28:03.717615+0000","last_became_active":"2024-09-12T01:26:14.432989+0000","last_became_peered":"2024-09-12T01:26:14.432989+0000","last_unstale":"2024-09-12T01:28:03.717615+0000","last_undegraded":"2024-09-12T01:28:03.717615+0000","last_fullsized":"2024-09-12T01:28:03.717615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:45.741460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":273,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.399459+0000","last_change":"2024-09-12T01:26:12.423148+0000","last_active":"2024-09-12T01:28:04.399459+0000","last_peered":"2024-09-12T01:28:04.399459+0000","last_clean":"2024-09-12T01:28:04.399459+0000","last_became_active":"2024-09-12T01:26:12.422754+0000","last_became_peered":"2024-09-12T01:26:12.422754+0000","last_unstale":"2024-09-12T01:28:04.399459+0000","last_undegraded":"2024-09-12T01:28:04.399459+0000","last_fullsized":"2024-09-12T01:28:04.399459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:01.017125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":172,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802221+0000","last_change":"2024-09-12T01:26:14.431568+0000","last_active":"2024-09-12T01:28:03.802221+0000","last_peered":"2024-09-12T01:28:03.802221+0000","last_clean":"2024-09-12T01:28:03.802221+0000","last_became_active":"2024-09-12T01:26:14.431215+0000","last_became_peered":"2024-09-12T01:26:14.431215+0000","last_unstale":"2024-09-12T01:28:03.802221+0000","last_undegraded":"2024-09-12T01:28:03.802221+0000","last_fullsized":"2024-09-12T01:28:03.802221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.552147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720527+0000","last_change":"2024-09-12T01:26:12.421986+0000","last_active":"2024-09-12T01:28:03.720527+0000","last_peered":"2024-09-12T01:28:03.720527+0000","last_clean":"2024-09-12T01:28:03.720527+0000","last_became_active":"2024-09-12T01:26:12.421391+0000","last_became_peered":"2024-09-12T01:26:12.421391+0000","last_unstale":"2024-09-12T01:28:03.720527+0000","last_undegraded":"2024-09-12T01:28:03.720527+0000","last_fullsized":"2024-09-12T01:28:03.720527+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:20.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881940+0000","last_change":"2024-09-12T01:26:14.431435+0000","last_active":"2024-09-12T01:28:03.881940+0000","last_peered":"2024-09-12T01:28:03.881940+0000","last_clean":"2024-09-12T01:28:03.881940+0000","last_became_active":"2024-09-12T01:26:14.431143+0000","last_became_peered":"2024-09-12T01:26:14.431143+0000","last_unstale":"2024-09-12T01:28:03.881940+0000","last_undegraded":"2024-09-12T01:28:03.881940+0000","last_fullsized":"2024-09-12T01:28:03.881940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:58.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811440+0000","last_change":"2024-09-12T01:26:12.423972+0000","last_active":"2024-09-12T01:28:03.811440+0000","last_peered":"2024-09-12T01:28:03.811440+0000","last_clean":"2024-09-12T01:28:03.811440+0000","last_became_active":"2024-09-12T01:26:12.423594+0000","last_became_peered":"2024-09-12T01:26:12.423594+0000","last_unstale":"2024-09-12T01:28:03.811440+0000","last_undegraded":"2024-09-12T01:28:03.811440+0000","last_fullsized":"2024-09-12T01:28:03.811440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:37.783478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940307+0000","last_change":"2024-09-12T01:26:14.437207+0000","last_active":"2024-09-12T01:28:03.940307+0000","last_peered":"2024-09-12T01:28:03.940307+0000","last_clean":"2024-09-12T01:28:03.940307+0000","last_became_active":"2024-09-12T01:26:14.436940+0000","last_became_peered":"2024-09-12T01:26:14.436940+0000","last_unstale":"2024-09-12T01:28:03.940307+0000","last_undegraded":"2024-09-12T01:28:03.940307+0000","last_fullsized":"2024-09-12T01:28:03.940307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:34.454446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'9","reported_seq":139,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.401958+0000","last_change":"2024-09-12T01:26:12.420247+0000","last_active":"2024-09-12T01:28:04.401958+0000","last_peered":"2024-09-12T01:28:04.401958+0000","last_clean":"2024-09-12T01:28:04.401958+0000","last_became_active":"2024-09-12T01:26:12.419825+0000","last_became_peered":"2024-09-12T01:26:12.419825+0000","last_unstale":"2024-09-12T01:28:04.401958+0000","last_undegraded":"2024-09-12T01:28:04.401958+0000","last_fullsized":"2024-09-12T01:28:04.401958+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:26.746225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":6,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940127+0000","last_change":"2024-09-12T01:26:14.439019+0000","last_active":"2024-09-12T01:28:03.940127+0000","last_peered":"2024-09-12T01:28:03.940127+0000","last_clean":"2024-09-12T01:28:03.940127+0000","last_became_active":"2024-09-12T01:26:14.438714+0000","last_became_peered":"2024-09-12T01:26:14.438714+0000","last_unstale":"2024-09-12T01:28:03.940127+0000","last_undegraded":"2024-09-12T01:28:03.940127+0000","last_fullsized":"2024-09-12T01:28:03.940127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.321464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801873+0000","last_change":"2024-09-12T01:26:12.800529+0000","last_active":"2024-09-12T01:28:03.801873+0000","last_peered":"2024-09-12T01:28:03.801873+0000","last_clean":"2024-09-12T01:28:03.801873+0000","last_became_active":"2024-09-12T01:26:12.800104+0000","last_became_peered":"2024-09-12T01:26:12.800104+0000","last_unstale":"2024-09-12T01:28:03.801873+0000","last_undegraded":"2024-09-12T01:28:03.801873+0000","last_fullsized":"2024-09-12T01:28:03.801873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.624321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811417+0000","last_change":"2024-09-12T01:26:14.435283+0000","last_active":"2024-09-12T01:28:03.811417+0000","last_peered":"2024-09-12T01:28:03.811417+0000","last_clean":"2024-09-12T01:28:03.811417+0000","last_became_active":"2024-09-12T01:26:14.434414+0000","last_became_peered":"2024-09-12T01:26:14.434414+0000","last_unstale":"2024-09-12T01:28:03.811417+0000","last_undegraded":"2024-09-12T01:28:03.811417+0000","last_fullsized":"2024-09-12T01:28:03.811417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.959405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'3","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881086+0000","last_change":"2024-09-12T01:26:26.273053+0000","last_active":"2024-09-12T01:28:03.881086+0000","last_peered":"2024-09-12T01:28:03.881086+0000","last_clean":"2024-09-12T01:28:03.881086+0000","last_became_active":"2024-09-12T01:26:26.267178+0000","last_became_peered":"2024-09-12T01:26:26.267178+0000","last_unstale":"2024-09-12T01:28:03.881086+0000","last_undegraded":"2024-09-12T01:28:03.881086+0000","last_fullsized":"2024-09-12T01:28:03.881086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:08.138485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880948+0000","last_change":"2024-09-12T01:26:14.433527+0000","last_active":"2024-09-12T01:28:03.880948+0000","last_peered":"2024-09-12T01:28:03.880948+0000","last_clean":"2024-09-12T01:28:03.880948+0000","last_became_active":"2024-09-12T01:26:14.433204+0000","last_became_peered":"2024-09-12T01:26:14.433204+0000","last_unstale":"2024-09-12T01:28:03.880948+0000","last_undegraded":"2024-09-12T01:28:03.880948+0000","last_fullsized":"2024-09-12T01:28:03.880948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:26.883916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883147+0000","last_change":"2024-09-12T01:26:12.420795+0000","last_active":"2024-09-12T01:28:03.883147+0000","last_peered":"2024-09-12T01:28:03.883147+0000","last_clean":"2024-09-12T01:28:03.883147+0000","last_became_active":"2024-09-12T01:26:12.420409+0000","last_became_peered":"2024-09-12T01:26:12.420409+0000","last_unstale":"2024-09-12T01:28:03.883147+0000","last_undegraded":"2024-09-12T01:28:03.883147+0000","last_fullsized":"2024-09-12T01:28:03.883147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:36.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940454+0000","last_change":"2024-09-12T01:26:14.440994+0000","last_active":"2024-09-12T01:28:03.940454+0000","last_peered":"2024-09-12T01:28:03.940454+0000","last_clean":"2024-09-12T01:28:03.940454+0000","last_became_active":"2024-09-12T01:26:14.440602+0000","last_became_peered":"2024-09-12T01:26:14.440602+0000","last_unstale":"2024-09-12T01:28:03.940454+0000","last_undegraded":"2024-09-12T01:28:03.940454+0000","last_fullsized":"2024-09-12T01:28:03.940454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.998991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'41","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.934193+0000","last_change":"2024-09-12T01:26:12.419448+0000","last_active":"2024-09-12T01:28:03.934193+0000","last_peered":"2024-09-12T01:28:03.934193+0000","last_clean":"2024-09-12T01:28:03.934193+0000","last_became_active":"2024-09-12T01:26:12.419000+0000","last_became_peered":"2024-09-12T01:26:12.419000+0000","last_unstale":"2024-09-12T01:28:03.934193+0000","last_undegraded":"2024-09-12T01:28:03.934193+0000","last_fullsized":"2024-09-12T01:28:03.934193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:37.818833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940268+0000","last_change":"2024-09-12T01:26:14.437818+0000","last_active":"2024-09-12T01:28:03.940268+0000","last_peered":"2024-09-12T01:28:03.940268+0000","last_clean":"2024-09-12T01:28:03.940268+0000","last_became_active":"2024-09-12T01:26:14.437497+0000","last_became_peered":"2024-09-12T01:26:14.437497+0000","last_unstale":"2024-09-12T01:28:03.940268+0000","last_undegraded":"2024-09-12T01:28:03.940268+0000","last_fullsized":"2024-09-12T01:28:03.940268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:57.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'7","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.663652+0000","last_change":"2024-09-12T01:26:12.855850+0000","last_active":"2024-09-12T01:28:04.663652+0000","last_peered":"2024-09-12T01:28:04.663652+0000","last_clean":"2024-09-12T01:28:04.663652+0000","last_became_active":"2024-09-12T01:26:12.855400+0000","last_became_peered":"2024-09-12T01:26:12.855400+0000","last_unstale":"2024-09-12T01:28:04.663652+0000","last_undegraded":"2024-09-12T01:28:04.663652+0000","last_fullsized":"2024-09-12T01:28:04.663652+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:32.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940460+0000","last_change":"2024-09-12T01:26:14.435982+0000","last_active":"2024-09-12T01:28:03.940460+0000","last_peered":"2024-09-12T01:28:03.940460+0000","last_clean":"2024-09-12T01:28:03.940460+0000","last_became_active":"2024-09-12T01:26:14.435595+0000","last_became_peered":"2024-09-12T01:26:14.435595+0000","last_unstale":"2024-09-12T01:28:03.940460+0000","last_undegraded":"2024-09-12T01:28:03.940460+0000","last_fullsized":"2024-09-12T01:28:03.940460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:31.101890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940390+0000","last_change":"2024-09-12T01:25:04.588449+0000","last_active":"2024-09-12T01:28:03.940390+0000","last_peered":"2024-09-12T01:28:03.940390+0000","last_clean":"2024-09-12T01:28:03.940390+0000","last_became_active":"2024-09-12T01:25:04.587949+0000","last_became_peered":"2024-09-12T01:25:04.587949+0000","last_unstale":"2024-09-12T01:28:03.940390+0000","last_undegraded":"2024-09-12T01:28:03.940390+0000","last_fullsized":"2024-09-12T01:28:03.940390+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_clean_scrub_stamp":"2024-09-12T01:21:41.345624+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:41.015289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825092+0000","last_change":"2024-09-12T01:26:12.421379+0000","last_active":"2024-09-12T01:28:03.825092+0000","last_peered":"2024-09-12T01:28:03.825092+0000","last_clean":"2024-09-12T01:28:03.825092+0000","last_became_active":"2024-09-12T01:26:12.421059+0000","last_became_peered":"2024-09-12T01:26:12.421059+0000","last_unstale":"2024-09-12T01:28:03.825092+0000","last_undegraded":"2024-09-12T01:28:03.825092+0000","last_fullsized":"2024-09-12T01:28:03.825092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802270+0000","last_change":"2024-09-12T01:26:14.430510+0000","last_active":"2024-09-12T01:28:03.802270+0000","last_peered":"2024-09-12T01:28:03.802270+0000","last_clean":"2024-09-12T01:28:03.802270+0000","last_became_active":"2024-09-12T01:26:14.430232+0000","last_became_peered":"2024-09-12T01:26:14.430232+0000","last_unstale":"2024-09-12T01:28:03.802270+0000","last_undegraded":"2024-09-12T01:28:03.802270+0000","last_fullsized":"2024-09-12T01:28:03.802270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:55.114616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940253+0000","last_change":"2024-09-12T01:26:12.420938+0000","last_active":"2024-09-12T01:28:03.940253+0000","last_peered":"2024-09-12T01:28:03.940253+0000","last_clean":"2024-09-12T01:28:03.940253+0000","last_became_active":"2024-09-12T01:26:12.420599+0000","last_became_peered":"2024-09-12T01:26:12.420599+0000","last_unstale":"2024-09-12T01:28:03.940253+0000","last_undegraded":"2024-09-12T01:28:03.940253+0000","last_fullsized":"2024-09-12T01:28:03.940253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.593237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883352+0000","last_change":"2024-09-12T01:26:14.428684+0000","last_active":"2024-09-12T01:28:03.883352+0000","last_peered":"2024-09-12T01:28:03.883352+0000","last_clean":"2024-09-12T01:28:03.883352+0000","last_became_active":"2024-09-12T01:26:14.428380+0000","last_became_peered":"2024-09-12T01:26:14.428380+0000","last_unstale":"2024-09-12T01:28:03.883352+0000","last_undegraded":"2024-09-12T01:28:03.883352+0000","last_fullsized":"2024-09-12T01:28:03.883352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:21.542122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883611+0000","last_change":"2024-09-12T01:26:12.800048+0000","last_active":"2024-09-12T01:28:03.883611+0000","last_peered":"2024-09-12T01:28:03.883611+0000","last_clean":"2024-09-12T01:28:03.883611+0000","last_became_active":"2024-09-12T01:26:12.799646+0000","last_became_peered":"2024-09-12T01:26:12.799646+0000","last_unstale":"2024-09-12T01:28:03.883611+0000","last_undegraded":"2024-09-12T01:28:03.883611+0000","last_fullsized":"2024-09-12T01:28:03.883611+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:39.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716527+0000","last_change":"2024-09-12T01:26:26.268110+0000","last_active":"2024-09-12T01:28:03.716527+0000","last_peered":"2024-09-12T01:28:03.716527+0000","last_clean":"2024-09-12T01:28:03.716527+0000","last_became_active":"2024-09-12T01:26:26.267764+0000","last_became_peered":"2024-09-12T01:26:26.267764+0000","last_unstale":"2024-09-12T01:28:03.716527+0000","last_undegraded":"2024-09-12T01:28:03.716527+0000","last_fullsized":"2024-09-12T01:28:03.716527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:37.009529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":131,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.618358+0000","last_change":"2024-09-12T01:26:12.424189+0000","last_active":"2024-09-12T01:28:04.618358+0000","last_peered":"2024-09-12T01:28:04.618358+0000","last_clean":"2024-09-12T01:28:04.618358+0000","last_became_active":"2024-09-12T01:26:12.423785+0000","last_became_peered":"2024-09-12T01:26:12.423785+0000","last_unstale":"2024-09-12T01:28:04.618358+0000","last_undegraded":"2024-09-12T01:28:04.618358+0000","last_fullsized":"2024-09-12T01:28:04.618358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:20.069821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814343+0000","last_change":"2024-09-12T01:26:14.437874+0000","last_active":"2024-09-12T01:28:03.814343+0000","last_peered":"2024-09-12T01:28:03.814343+0000","last_clean":"2024-09-12T01:28:03.814343+0000","last_became_active":"2024-09-12T01:26:14.437578+0000","last_became_peered":"2024-09-12T01:26:14.437578+0000","last_unstale":"2024-09-12T01:28:03.814343+0000","last_undegraded":"2024-09-12T01:28:03.814343+0000","last_fullsized":"2024-09-12T01:28:03.814343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:55.817763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716704+0000","last_change":"2024-09-12T01:26:26.267861+0000","last_active":"2024-09-12T01:28:03.716704+0000","last_peered":"2024-09-12T01:28:03.716704+0000","last_clean":"2024-09-12T01:28:03.716704+0000","last_became_active":"2024-09-12T01:26:26.267244+0000","last_became_peered":"2024-09-12T01:26:26.267244+0000","last_unstale":"2024-09-12T01:28:03.716704+0000","last_undegraded":"2024-09-12T01:28:03.716704+0000","last_fullsized":"2024-09-12T01:28:03.716704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:50.623916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814419+0000","last_change":"2024-09-12T01:26:14.434708+0000","last_active":"2024-09-12T01:28:03.814419+0000","last_peered":"2024-09-12T01:28:03.814419+0000","last_clean":"2024-09-12T01:28:03.814419+0000","last_became_active":"2024-09-12T01:26:14.434420+0000","last_became_peered":"2024-09-12T01:26:14.434420+0000","last_unstale":"2024-09-12T01:28:03.814419+0000","last_undegraded":"2024-09-12T01:28:03.814419+0000","last_fullsized":"2024-09-12T01:28:03.814419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:58.626769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802334+0000","last_change":"2024-09-12T01:26:12.800678+0000","last_active":"2024-09-12T01:28:03.802334+0000","last_peered":"2024-09-12T01:28:03.802334+0000","last_clean":"2024-09-12T01:28:03.802334+0000","last_became_active":"2024-09-12T01:26:12.800063+0000","last_became_peered":"2024-09-12T01:26:12.800063+0000","last_unstale":"2024-09-12T01:28:03.802334+0000","last_undegraded":"2024-09-12T01:28:03.802334+0000","last_fullsized":"2024-09-12T01:28:03.802334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:01.110686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882869+0000","last_change":"2024-09-12T01:26:14.425695+0000","last_active":"2024-09-12T01:28:03.882869+0000","last_peered":"2024-09-12T01:28:03.882869+0000","last_clean":"2024-09-12T01:28:03.882869+0000","last_became_active":"2024-09-12T01:26:14.425435+0000","last_became_peered":"2024-09-12T01:26:14.425435+0000","last_unstale":"2024-09-12T01:28:03.882869+0000","last_undegraded":"2024-09-12T01:28:03.882869+0000","last_fullsized":"2024-09-12T01:28:03.882869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:19.193669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'50","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.938195+0000","last_change":"2024-09-12T01:26:12.412743+0000","last_active":"2024-09-12T01:28:03.938195+0000","last_peered":"2024-09-12T01:28:03.938195+0000","last_clean":"2024-09-12T01:28:03.938195+0000","last_became_active":"2024-09-12T01:26:12.412376+0000","last_became_peered":"2024-09-12T01:26:12.412376+0000","last_unstale":"2024-09-12T01:28:03.938195+0000","last_undegraded":"2024-09-12T01:28:03.938195+0000","last_fullsized":"2024-09-12T01:28:03.938195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.542370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":89,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802661+0000","last_change":"2024-09-12T01:26:14.429727+0000","last_active":"2024-09-12T01:28:03.802661+0000","last_peered":"2024-09-12T01:28:03.802661+0000","last_clean":"2024-09-12T01:28:03.802661+0000","last_became_active":"2024-09-12T01:26:14.429385+0000","last_became_peered":"2024-09-12T01:26:14.429385+0000","last_unstale":"2024-09-12T01:28:03.802661+0000","last_undegraded":"2024-09-12T01:28:03.802661+0000","last_fullsized":"2024-09-12T01:28:03.802661+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:43.855786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825282+0000","last_change":"2024-09-12T01:26:12.855632+0000","last_active":"2024-09-12T01:28:03.825282+0000","last_peered":"2024-09-12T01:28:03.825282+0000","last_clean":"2024-09-12T01:28:03.825282+0000","last_became_active":"2024-09-12T01:26:12.855305+0000","last_became_peered":"2024-09-12T01:26:12.855305+0000","last_unstale":"2024-09-12T01:28:03.825282+0000","last_undegraded":"2024-09-12T01:28:03.825282+0000","last_fullsized":"2024-09-12T01:28:03.825282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.893689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883266+0000","last_change":"2024-09-12T01:26:14.428498+0000","last_active":"2024-09-12T01:28:03.883266+0000","last_peered":"2024-09-12T01:28:03.883266+0000","last_clean":"2024-09-12T01:28:03.883266+0000","last_became_active":"2024-09-12T01:26:14.428022+0000","last_became_peered":"2024-09-12T01:26:14.428022+0000","last_unstale":"2024-09-12T01:28:03.883266+0000","last_undegraded":"2024-09-12T01:28:03.883266+0000","last_fullsized":"2024-09-12T01:28:03.883266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.325399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717493+0000","last_change":"2024-09-12T01:26:12.800038+0000","last_active":"2024-09-12T01:28:03.717493+0000","last_peered":"2024-09-12T01:28:03.717493+0000","last_clean":"2024-09-12T01:28:03.717493+0000","last_became_active":"2024-09-12T01:26:12.799717+0000","last_became_peered":"2024-09-12T01:26:12.799717+0000","last_unstale":"2024-09-12T01:28:03.717493+0000","last_undegraded":"2024-09-12T01:28:03.717493+0000","last_fullsized":"2024-09-12T01:28:03.717493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.362437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801873+0000","last_change":"2024-09-12T01:26:14.430518+0000","last_active":"2024-09-12T01:28:03.801873+0000","last_peered":"2024-09-12T01:28:03.801873+0000","last_clean":"2024-09-12T01:28:03.801873+0000","last_became_active":"2024-09-12T01:26:14.430158+0000","last_became_peered":"2024-09-12T01:26:14.430158+0000","last_unstale":"2024-09-12T01:28:03.801873+0000","last_undegraded":"2024-09-12T01:28:03.801873+0000","last_fullsized":"2024-09-12T01:28:03.801873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:55.696101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802299+0000","last_change":"2024-09-12T01:26:12.418427+0000","last_active":"2024-09-12T01:28:03.802299+0000","last_peered":"2024-09-12T01:28:03.802299+0000","last_clean":"2024-09-12T01:28:03.802299+0000","last_became_active":"2024-09-12T01:26:12.418135+0000","last_became_peered":"2024-09-12T01:26:12.418135+0000","last_unstale":"2024-09-12T01:28:03.802299+0000","last_undegraded":"2024-09-12T01:28:03.802299+0000","last_fullsized":"2024-09-12T01:28:03.802299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:32.946485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880813+0000","last_change":"2024-09-12T01:26:14.425817+0000","last_active":"2024-09-12T01:28:03.880813+0000","last_peered":"2024-09-12T01:28:03.880813+0000","last_clean":"2024-09-12T01:28:03.880813+0000","last_became_active":"2024-09-12T01:26:14.425443+0000","last_became_peered":"2024-09-12T01:26:14.425443+0000","last_unstale":"2024-09-12T01:28:03.880813+0000","last_undegraded":"2024-09-12T01:28:03.880813+0000","last_fullsized":"2024-09-12T01:28:03.880813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720390+0000","last_change":"2024-09-12T01:26:12.422742+0000","last_active":"2024-09-12T01:28:03.720390+0000","last_peered":"2024-09-12T01:28:03.720390+0000","last_clean":"2024-09-12T01:28:03.720390+0000","last_became_active":"2024-09-12T01:26:12.421914+0000","last_became_peered":"2024-09-12T01:26:12.421914+0000","last_unstale":"2024-09-12T01:28:03.720390+0000","last_undegraded":"2024-09-12T01:28:03.720390+0000","last_fullsized":"2024-09-12T01:28:03.720390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:53.427112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802223+0000","last_change":"2024-09-12T01:26:14.430425+0000","last_active":"2024-09-12T01:28:03.802223+0000","last_peered":"2024-09-12T01:28:03.802223+0000","last_clean":"2024-09-12T01:28:03.802223+0000","last_became_active":"2024-09-12T01:26:14.430128+0000","last_became_peered":"2024-09-12T01:26:14.430128+0000","last_unstale":"2024-09-12T01:28:03.802223+0000","last_undegraded":"2024-09-12T01:28:03.802223+0000","last_fullsized":"2024-09-12T01:28:03.802223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:17.653908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802061+0000","last_change":"2024-09-12T01:26:12.421463+0000","last_active":"2024-09-12T01:28:03.802061+0000","last_peered":"2024-09-12T01:28:03.802061+0000","last_clean":"2024-09-12T01:28:03.802061+0000","last_became_active":"2024-09-12T01:26:12.421143+0000","last_became_peered":"2024-09-12T01:26:12.421143+0000","last_unstale":"2024-09-12T01:28:03.802061+0000","last_undegraded":"2024-09-12T01:28:03.802061+0000","last_fullsized":"2024-09-12T01:28:03.802061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:09.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940259+0000","last_change":"2024-09-12T01:26:14.428643+0000","last_active":"2024-09-12T01:28:03.940259+0000","last_peered":"2024-09-12T01:28:03.940259+0000","last_clean":"2024-09-12T01:28:03.940259+0000","last_became_active":"2024-09-12T01:26:14.428344+0000","last_became_peered":"2024-09-12T01:26:14.428344+0000","last_unstale":"2024-09-12T01:28:03.940259+0000","last_undegraded":"2024-09-12T01:28:03.940259+0000","last_fullsized":"2024-09-12T01:28:03.940259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:17.213238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811637+0000","last_change":"2024-09-12T01:26:14.435108+0000","last_active":"2024-09-12T01:28:03.811637+0000","last_peered":"2024-09-12T01:28:03.811637+0000","last_clean":"2024-09-12T01:28:03.811637+0000","last_became_active":"2024-09-12T01:26:14.434806+0000","last_became_peered":"2024-09-12T01:26:14.434806+0000","last_unstale":"2024-09-12T01:28:03.811637+0000","last_undegraded":"2024-09-12T01:28:03.811637+0000","last_fullsized":"2024-09-12T01:28:03.811637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:01.188981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802171+0000","last_change":"2024-09-12T01:26:12.419027+0000","last_active":"2024-09-12T01:28:03.802171+0000","last_peered":"2024-09-12T01:28:03.802171+0000","last_clean":"2024-09-12T01:28:03.802171+0000","last_became_active":"2024-09-12T01:26:12.418579+0000","last_became_peered":"2024-09-12T01:26:12.418579+0000","last_unstale":"2024-09-12T01:28:03.802171+0000","last_undegraded":"2024-09-12T01:28:03.802171+0000","last_fullsized":"2024-09-12T01:28:03.802171+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.119864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717484+0000","last_change":"2024-09-12T01:26:14.429532+0000","last_active":"2024-09-12T01:28:03.717484+0000","last_peered":"2024-09-12T01:28:03.717484+0000","last_clean":"2024-09-12T01:28:03.717484+0000","last_became_active":"2024-09-12T01:26:14.429134+0000","last_became_peered":"2024-09-12T01:26:14.429134+0000","last_unstale":"2024-09-12T01:28:03.717484+0000","last_undegraded":"2024-09-12T01:28:03.717484+0000","last_fullsized":"2024-09-12T01:28:03.717484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:47.403388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802252+0000","last_change":"2024-09-12T01:26:26.279322+0000","last_active":"2024-09-12T01:28:03.802252+0000","last_peered":"2024-09-12T01:28:03.802252+0000","last_clean":"2024-09-12T01:28:03.802252+0000","last_became_active":"2024-09-12T01:26:26.268752+0000","last_became_peered":"2024-09-12T01:26:26.268752+0000","last_unstale":"2024-09-12T01:28:03.802252+0000","last_undegraded":"2024-09-12T01:28:03.802252+0000","last_fullsized":"2024-09-12T01:28:03.802252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.411144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883645+0000","last_change":"2024-09-12T01:26:14.430831+0000","last_active":"2024-09-12T01:28:03.883645+0000","last_peered":"2024-09-12T01:28:03.883645+0000","last_clean":"2024-09-12T01:28:03.883645+0000","last_became_active":"2024-09-12T01:26:14.430531+0000","last_became_peered":"2024-09-12T01:26:14.430531+0000","last_unstale":"2024-09-12T01:28:03.883645+0000","last_undegraded":"2024-09-12T01:28:03.883645+0000","last_fullsized":"2024-09-12T01:28:03.883645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:02.522283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802763+0000","last_change":"2024-09-12T01:26:12.799921+0000","last_active":"2024-09-12T01:28:03.802763+0000","last_peered":"2024-09-12T01:28:03.802763+0000","last_clean":"2024-09-12T01:28:03.802763+0000","last_became_active":"2024-09-12T01:26:12.799608+0000","last_became_peered":"2024-09-12T01:26:12.799608+0000","last_unstale":"2024-09-12T01:28:03.802763+0000","last_undegraded":"2024-09-12T01:28:03.802763+0000","last_fullsized":"2024-09-12T01:28:03.802763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:00.821261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802625+0000","last_change":"2024-09-12T01:26:14.430937+0000","last_active":"2024-09-12T01:28:03.802625+0000","last_peered":"2024-09-12T01:28:03.802625+0000","last_clean":"2024-09-12T01:28:03.802625+0000","last_became_active":"2024-09-12T01:26:14.430656+0000","last_became_peered":"2024-09-12T01:26:14.430656+0000","last_unstale":"2024-09-12T01:28:03.802625+0000","last_undegraded":"2024-09-12T01:28:03.802625+0000","last_fullsized":"2024-09-12T01:28:03.802625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.874150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.001748+0000","last_change":"2024-09-12T01:26:12.419000+0000","last_active":"2024-09-12T01:28:04.001748+0000","last_peered":"2024-09-12T01:28:04.001748+0000","last_clean":"2024-09-12T01:28:04.001748+0000","last_became_active":"2024-09-12T01:26:12.418736+0000","last_became_peered":"2024-09-12T01:26:12.418736+0000","last_unstale":"2024-09-12T01:28:04.001748+0000","last_undegraded":"2024-09-12T01:28:04.001748+0000","last_fullsized":"2024-09-12T01:28:04.001748+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:31.586983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600525,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1141,"num_read_kb":687,"num_write":372,"num_write_kb":1462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1801575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":446094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37064,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708088,"statfs":{"total":95995035648,"available":95957082112,"internally_reserved":0,"allocated":1761280,"data_stored":1235800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972397,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28328,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716824,"statfs":{"total":95995035648,"available":95966027776,"internally_reserved":0,"allocated":1335296,"data_stored":838517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201330,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32484,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712668,"statfs":{"total":95995035648,"available":95961772032,"internally_reserved":0,"allocated":1327104,"data_stored":838873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28528,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716624,"statfs":{"total":95995035648,"available":95965822976,"internally_reserved":0,"allocated":1536000,"data_stored":1039912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":445411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1683456,"data_stored":1169477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":446199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36780,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708372,"statfs":{"total":95995035648,"available":95957372928,"internally_reserved":0,"allocated":1470464,"data_stored":969659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1007616,"data_stored":506780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":995328,"data_stored":512804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":447058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":134813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":394694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":201136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:28:07.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:28:07.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:28:07.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-12T01:28:07.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: Unable to set osd_memory_target on smithi100 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-12T01:28:07.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-12T01:28:07.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: Unable to set osd_memory_target on smithi189 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-12T01:28:07.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:07.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:06 smithi100 ceph-mon[35275]: mgrmap e23: x(active, since 3s), standbys: z, y 2024-09-12T01:28:07.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:28:07.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-12T01:28:07.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: Unable to set osd_memory_target on smithi100 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-12T01:28:07.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:07.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-12T01:28:07.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: Unable to set osd_memory_target on smithi189 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-12T01:28:07.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:07.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:07.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:06 smithi189 ceph-mon[35357]: mgrmap e23: x(active, since 3s), standbys: z, y 2024-09-12T01:28:07.564 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:08.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.094+0000 7fe6ef058640 1 -- 172.21.15.81:0/4242987430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e8106f40 msgr2=0x7fe6e810eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:08.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.094+0000 7fe6ef058640 1 --2- 172.21.15.81:0/4242987430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e8106f40 0x7fe6e810eac0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009900 tx=0x7fe6e002a410 comp rx=0 tx=0).stop 2024-09-12T01:28:08.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.094+0000 7fe6ef058640 1 -- 172.21.15.81:0/4242987430 shutdown_connections 2024-09-12T01:28:08.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.094+0000 7fe6ef058640 1 --2- 172.21.15.81:0/4242987430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e8106f40 0x7fe6e810eac0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:08.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.094+0000 7fe6ef058640 1 --2- 172.21.15.81:0/4242987430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6e81027c0 0x7fe6e8106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:08.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.094+0000 7fe6ef058640 1 --2- 172.21.15.81:0/4242987430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e8101e10 0x7fe6e81021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.094+0000 7fe6ef058640 1 -- 172.21.15.81:0/4242987430 >> 172.21.15.81:0/4242987430 conn(0x7fe6e80fd8d0 msgr2=0x7fe6e80ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.094+0000 7fe6ef058640 1 -- 172.21.15.81:0/4242987430 shutdown_connections 2024-09-12T01:28:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.094+0000 7fe6ef058640 1 -- 172.21.15.81:0/4242987430 wait complete. 2024-09-12T01:28:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.094+0000 7fe6ef058640 1 Processor -- start 2024-09-12T01:28:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.094+0000 7fe6ef058640 1 -- start start 2024-09-12T01:28:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ef058640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e8101e10 0x7fe6e80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ef058640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6e81027c0 0x7fe6e8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ef058640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e8106f40 0x7fe6e8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ef058640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e8111fa0 con 0x7fe6e8106f40 2024-09-12T01:28:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ef058640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e8111e20 con 0x7fe6e8101e10 2024-09-12T01:28:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ef058640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e8112120 con 0x7fe6e81027c0 2024-09-12T01:28:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ed5f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e8106f40 0x7fe6e8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ecdf4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e8101e10 0x7fe6e80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6dffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6e81027c0 0x7fe6e8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ecdf4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e8101e10 0x7fe6e80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:51936/0 (socket says 172.21.15.81:51936) 2024-09-12T01:28:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ed5f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e8106f40 0x7fe6e8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40162/0 (socket says 172.21.15.81:40162) 2024-09-12T01:28:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ecdf4640 1 -- 172.21.15.81:0/3823693762 learned_addr learned my addr 172.21.15.81:0/3823693762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ed5f5640 1 -- 172.21.15.81:0/3823693762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6e81027c0 msgr2=0x7fe6e8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ed5f5640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6e81027c0 0x7fe6e8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ed5f5640 1 -- 172.21.15.81:0/3823693762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e8101e10 msgr2=0x7fe6e80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ed5f5640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e8101e10 0x7fe6e80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ed5f5640 1 -- 172.21.15.81:0/3823693762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e81a68c0 con 0x7fe6e8106f40 2024-09-12T01:28:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ecdf4640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e8101e10 0x7fe6e80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6dffff640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6e81027c0 0x7fe6e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.095+0000 7fe6ed5f5640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e8106f40 0x7fe6e8074f70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009230 tx=0x7fe6e0005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.096+0000 7fe6ddffb640 1 -- 172.21.15.81:0/3823693762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e003f030 con 0x7fe6e8106f40 2024-09-12T01:28:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.096+0000 7fe6ddffb640 1 -- 172.21.15.81:0/3823693762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6e0004350 con 0x7fe6e8106f40 2024-09-12T01:28:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.096+0000 7fe6ef058640 1 -- 172.21.15.81:0/3823693762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e81a6b50 con 0x7fe6e8106f40 2024-09-12T01:28:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.096+0000 7fe6ddffb640 1 -- 172.21.15.81:0/3823693762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0035070 con 0x7fe6e8106f40 2024-09-12T01:28:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.096+0000 7fe6ef058640 1 -- 172.21.15.81:0/3823693762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e81a7080 con 0x7fe6e8106f40 2024-09-12T01:28:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.097+0000 7fe6ef058640 1 -- 172.21.15.81:0/3823693762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e81021f0 con 0x7fe6e8106f40 2024-09-12T01:28:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.099+0000 7fe6ddffb640 1 -- 172.21.15.81:0/3823693762 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 137953+0+0 (secure 0 0 0) 0x7fe6e0042030 con 0x7fe6e8106f40 2024-09-12T01:28:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.100+0000 7fe6ddffb640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe6d00a2d70 0x7fe6d00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.100+0000 7fe6ddffb640 1 -- 172.21.15.81:0/3823693762 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe6e00efa80 con 0x7fe6e8106f40 2024-09-12T01:28:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.100+0000 7fe6ecdf4640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe6d00a2d70 0x7fe6d00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.100+0000 7fe6ecdf4640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe6d00a2d70 0x7fe6d00a5230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400f7d0 tx=0x7fe6e4009500 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.102+0000 7fe6ddffb640 1 -- 172.21.15.81:0/3823693762 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe6e00bc080 con 0x7fe6e8106f40 2024-09-12T01:28:08.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.316+0000 7fe6ddffb640 1 -- 172.21.15.81:0/3823693762 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7fe6e00ed480 con 0x7fe6e8106f40 2024-09-12T01:28:08.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.334+0000 7fe6ef058640 1 -- 172.21.15.81:0/3823693762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6e810a180 con 0x7fe6e8106f40 2024-09-12T01:28:08.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.334+0000 7fe6ddffb640 1 -- 172.21.15.81:0/3823693762 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fe6e00e8f30 con 0x7fe6e8106f40 2024-09-12T01:28:08.335 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:08.335 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:28:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:28:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.336+0000 7fe6ef058640 1 -- 172.21.15.81:0/3823693762 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe6d00a2d70 msgr2=0x7fe6d00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.336+0000 7fe6ef058640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe6d00a2d70 0x7fe6d00a5230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400f7d0 tx=0x7fe6e4009500 comp rx=0 tx=0).stop 2024-09-12T01:28:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.336+0000 7fe6ef058640 1 -- 172.21.15.81:0/3823693762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e8106f40 msgr2=0x7fe6e8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.336+0000 7fe6ef058640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e8106f40 0x7fe6e8074f70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009230 tx=0x7fe6e0005e70 comp rx=0 tx=0).stop 2024-09-12T01:28:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.336+0000 7fe6ef058640 1 -- 172.21.15.81:0/3823693762 shutdown_connections 2024-09-12T01:28:08.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.336+0000 7fe6ef058640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe6d00a2d70 0x7fe6d00a5230 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:08.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.336+0000 7fe6ef058640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e8106f40 0x7fe6e8074f70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:08.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.336+0000 7fe6ef058640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6e81027c0 0x7fe6e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:08.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.337+0000 7fe6ef058640 1 --2- 172.21.15.81:0/3823693762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e8101e10 0x7fe6e80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:08.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.337+0000 7fe6ef058640 1 -- 172.21.15.81:0/3823693762 >> 172.21.15.81:0/3823693762 conn(0x7fe6e80fd8d0 msgr2=0x7fe6e80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:08.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.337+0000 7fe6ef058640 1 -- 172.21.15.81:0/3823693762 shutdown_connections 2024-09-12T01:28:08.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:08.337+0000 7fe6ef058640 1 -- 172.21.15.81:0/3823693762 wait complete. 2024-09-12T01:28:08.690 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:08.690 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:08.690 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.690 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.690 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:08.690 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: Unable to set osd_memory_target on smithi081 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: Updating smithi100:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: Updating smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: Updating smithi081:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.692 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.692 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.692 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.692 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:08 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:08.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:08.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:08.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:08.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:08.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:08.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-12T01:28:08.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: Unable to set osd_memory_target on smithi081 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-12T01:28:08.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:08.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:08.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T01:28:08.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T01:28:08.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T01:28:08.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: Updating smithi100:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:28:08.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: Updating smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:28:08.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: Updating smithi081:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:28:08.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:08 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:08.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:08.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:08.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:08.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:08.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:28:08.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-12T01:28:08.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: Unable to set osd_memory_target on smithi081 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-12T01:28:08.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:08.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:08.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T01:28:08.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-12T01:28:08.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-12T01:28:08.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: Updating smithi100:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:28:08.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: Updating smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:28:08.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: Updating smithi081:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:28:08.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:08.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:08 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:09.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:28:09.349 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:09.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:09 smithi081 ceph-mon[30920]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:28:09.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:09 smithi081 ceph-mon[30920]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:28:09.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:09 smithi081 ceph-mon[30920]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:28:09.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:09 smithi081 ceph-mon[30920]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:28:09.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:09 smithi081 ceph-mon[30920]: Updating smithi100:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:28:09.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:09 smithi081 ceph-mon[30920]: Updating smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:28:09.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:09 smithi081 ceph-mon[30920]: Updating smithi081:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:28:09.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:09 smithi081 ceph-mon[30920]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-09-12T01:28:09.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:09 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3823693762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:09.472 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:09 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:09.472 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:09 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:09.472 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:09 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:09.472 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:09 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:09.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:09 smithi100 ceph-mon[35275]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:28:09.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:09 smithi100 ceph-mon[35275]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:28:09.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:09 smithi100 ceph-mon[35275]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:28:09.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:09 smithi100 ceph-mon[35275]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:28:09.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:09 smithi100 ceph-mon[35275]: Updating smithi100:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:28:09.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:09 smithi100 ceph-mon[35275]: Updating smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:28:09.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:09 smithi100 ceph-mon[35275]: Updating smithi081:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:28:09.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:09 smithi100 ceph-mon[35275]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-09-12T01:28:09.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:09 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3823693762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:09.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:09 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:09.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:09 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:09.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:09 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:09.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:09 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:09.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:09 smithi189 ceph-mon[35357]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:28:09.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:09 smithi189 ceph-mon[35357]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:28:09.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:09 smithi189 ceph-mon[35357]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:28:09.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:09 smithi189 ceph-mon[35357]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:28:09.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:09 smithi189 ceph-mon[35357]: Updating smithi100:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:28:09.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:09 smithi189 ceph-mon[35357]: Updating smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:28:09.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:09 smithi189 ceph-mon[35357]: Updating smithi081:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:28:09.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:09 smithi189 ceph-mon[35357]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-09-12T01:28:09.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:09 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3823693762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:09.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:09 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:09.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:09 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:09.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:09 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:09.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:09 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:09.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.806+0000 7f03dba70640 1 -- 172.21.15.81:0/1922343195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d4102790 msgr2=0x7f03d41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:09.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.806+0000 7f03dba70640 1 --2- 172.21.15.81:0/1922343195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d4102790 0x7f03d41067e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009900 tx=0x7f03c402a410 comp rx=0 tx=0).stop 2024-09-12T01:28:09.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.806+0000 7f03dba70640 1 -- 172.21.15.81:0/1922343195 shutdown_connections 2024-09-12T01:28:09.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.806+0000 7f03dba70640 1 --2- 172.21.15.81:0/1922343195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03d4106f10 0x7f03d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:09.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.806+0000 7f03dba70640 1 --2- 172.21.15.81:0/1922343195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d4102790 0x7f03d41067e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:09.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.806+0000 7f03dba70640 1 --2- 172.21.15.81:0/1922343195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03d4101de0 0x7f03d41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:09.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.806+0000 7f03dba70640 1 -- 172.21.15.81:0/1922343195 >> 172.21.15.81:0/1922343195 conn(0x7f03d40fd8c0 msgr2=0x7f03d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:09.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.806+0000 7f03dba70640 1 -- 172.21.15.81:0/1922343195 shutdown_connections 2024-09-12T01:28:09.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.806+0000 7f03dba70640 1 -- 172.21.15.81:0/1922343195 wait complete. 2024-09-12T01:28:09.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.807+0000 7f03dba70640 1 Processor -- start 2024-09-12T01:28:09.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.807+0000 7f03dba70640 1 -- start start 2024-09-12T01:28:09.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.807+0000 7f03dba70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d4101de0 0x7f03d4198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:09.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.807+0000 7f03dba70640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03d4102790 0x7f03d4198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.807+0000 7f03dba70640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03d4106f10 0x7f03d419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.807+0000 7f03dba70640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4111f90 con 0x7f03d4101de0 2024-09-12T01:28:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.807+0000 7f03dba70640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4111e10 con 0x7f03d4102790 2024-09-12T01:28:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.807+0000 7f03dba70640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4112110 con 0x7f03d4106f10 2024-09-12T01:28:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.807+0000 7f03d980c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d4101de0 0x7f03d4198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.807+0000 7f03d980c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d4101de0 0x7f03d4198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40184/0 (socket says 172.21.15.81:40184) 2024-09-12T01:28:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.807+0000 7f03d980c640 1 -- 172.21.15.81:0/3637349084 learned_addr learned my addr 172.21.15.81:0/3637349084 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.808+0000 7f03da00d640 1 --2- 172.21.15.81:0/3637349084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03d4106f10 0x7f03d419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.808+0000 7f03d980c640 1 -- 172.21.15.81:0/3637349084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03d4106f10 msgr2=0x7f03d419ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.808+0000 7f03d980c640 1 --2- 172.21.15.81:0/3637349084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03d4106f10 0x7f03d419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.808+0000 7f03d980c640 1 -- 172.21.15.81:0/3637349084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03d4102790 msgr2=0x7f03d4198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.808+0000 7f03d980c640 1 --2- 172.21.15.81:0/3637349084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03d4102790 0x7f03d4198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.808+0000 7f03d980c640 1 -- 172.21.15.81:0/3637349084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d419d520 con 0x7f03d4101de0 2024-09-12T01:28:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.808+0000 7f03d980c640 1 --2- 172.21.15.81:0/3637349084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d4101de0 0x7f03d4198570 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f03d000d950 tx=0x7f03d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.808+0000 7f03caffd640 1 -- 172.21.15.81:0/3637349084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0017070 con 0x7f03d4101de0 2024-09-12T01:28:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.808+0000 7f03caffd640 1 -- 172.21.15.81:0/3637349084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03d0009c30 con 0x7f03d4101de0 2024-09-12T01:28:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.808+0000 7f03dba70640 1 -- 172.21.15.81:0/3637349084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d419d810 con 0x7f03d4101de0 2024-09-12T01:28:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.808+0000 7f03caffd640 1 -- 172.21.15.81:0/3637349084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d000f6b0 con 0x7f03d4101de0 2024-09-12T01:28:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.808+0000 7f03dba70640 1 -- 172.21.15.81:0/3637349084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d41a50f0 con 0x7f03d4101de0 2024-09-12T01:28:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.809+0000 7f03dba70640 1 -- 172.21.15.81:0/3637349084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d41021c0 con 0x7f03d4101de0 2024-09-12T01:28:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.810+0000 7f03caffd640 1 -- 172.21.15.81:0/3637349084 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f03d00109d0 con 0x7f03d4101de0 2024-09-12T01:28:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.811+0000 7f03caffd640 1 --2- 172.21.15.81:0/3637349084 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f03c00a2d80 0x7f03c00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.811+0000 7f03d900b640 1 --2- 172.21.15.81:0/3637349084 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f03c00a2d80 0x7f03c00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.811+0000 7f03caffd640 1 -- 172.21.15.81:0/3637349084 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f03d00cf2b0 con 0x7f03d4101de0 2024-09-12T01:28:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.811+0000 7f03d900b640 1 --2- 172.21.15.81:0/3637349084 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f03c00a2d80 0x7f03c00a5240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f03c402a930 tx=0x7f03c4000bc0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.814+0000 7f03caffd640 1 -- 172.21.15.81:0/3637349084 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03d0009de0 con 0x7f03d4101de0 2024-09-12T01:28:09.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.982+0000 7f03dba70640 1 -- 172.21.15.81:0/3637349084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03d410a150 con 0x7f03d4101de0 2024-09-12T01:28:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.983+0000 7f03caffd640 1 -- 172.21.15.81:0/3637349084 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+23091 (secure 0 0 0) 0x7f03d009bd90 con 0x7f03d4101de0 2024-09-12T01:28:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:09.984 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","created":"2024-09-12T01:18:28.404285+0000","modified":"2024-09-12T01:28:03.711376+0000","last_up_change":"2024-09-12T01:25:26.326110+0000","last_in_change":"2024-09-12T01:25:02.138698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:21:40.649584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:26:10.753723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:26:13.254837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc857dd4-eedc-4c48-89a0-4e69662e8e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6803","nonce":3870994528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6805","nonce":3870994528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6809","nonce":3870994528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6807","nonce":3870994528}]},"public_addr":"172.21.15.81:6803/3870994528","cluster_addr":"172.21.15.81:6805/3870994528","heartbeat_back_addr":"172.21.15.81:6809/3870994528","heartbeat_front_addr":"172.21.15.81:6807/3870994528","state":["exists","up"]},{"osd":1,"uuid":"04b8111b-d677-4fc8-8285-90683621ccf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6801","nonce":2098299652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6803","nonce":2098299652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6807","nonce":2098299652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6805","nonce":2098299652}]},"public_addr":"172.21.15.100:6801/2098299652","cluster_addr":"172.21.15.100:6803/2098299652","heartbeat_back_addr":"172.21.15.100:6807/2098299652","heartbeat_front_addr":"172.21.15.100:6805/2098299652","state":["exists","up"]},{"osd":2,"uuid":"763e357e-5a04-45ff-95e8-bc1abfeac056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6801","nonce":1353548110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6803","nonce":1353548110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6807","nonce":1353548110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6805","nonce":1353548110}]},"public_addr":"172.21.15.189:6801/1353548110","cluster_addr":"172.21.15.189:6803/1353548110","heartbeat_back_addr":"172.21.15.189:6807/1353548110","heartbeat_front_addr":"172.21.15.189:6805/1353548110","state":["exists","up"]},{"osd":3,"uuid":"99843578-1b9e-4ee0-91f1-ba419d07897e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6811","nonce":1064869637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6813","nonce":1064869637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6817","nonce":1064869637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6815","nonce":1064869637}]},"public_addr":"172.21.15.81:6811/1064869637","cluster_addr":"172.21.15.81:6813/1064869637","heartbeat_back_addr":"172.21.15.81:6817/1064869637","heartbeat_front_addr":"172.21.15.81:6815/1064869637","state":["exists","up"]},{"osd":4,"uuid":"a5787415-0905-420e-9ce8-eb6902727561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6809","nonce":1687792282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6811","nonce":1687792282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6815","nonce":1687792282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6813","nonce":1687792282}]},"public_addr":"172.21.15.100:6809/1687792282","cluster_addr":"172.21.15.100:6811/1687792282","heartbeat_back_addr":"172.21.15.100:6815/1687792282","heartbeat_front_addr":"172.21.15.100:6813/1687792282","state":["exists","up"]},{"osd":5,"uuid":"879548b5-5516-407c-8517-bbdbf356c0e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6809","nonce":823474396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6811","nonce":823474396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6815","nonce":823474396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6813","nonce":823474396}]},"public_addr":"172.21.15.189:6809/823474396","cluster_addr":"172.21.15.189:6811/823474396","heartbeat_back_addr":"172.21.15.189:6815/823474396","heartbeat_front_addr":"172.21.15.189:6813/823474396","state":["exists","up"]},{"osd":6,"uuid":"b665b97c-a9d3-475f-93f3-8a920cbb37d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6819","nonce":1522854005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6821","nonce":1522854005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6825","nonce":1522854005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6823","nonce":1522854005}]},"public_addr":"172.21.15.81:6819/1522854005","cluster_addr":"172.21.15.81:6821/1522854005","heartbeat_back_addr":"172.21.15.81:6825/1522854005","heartbeat_front_addr":"172.21.15.81:6823/1522854005","state":["exists","up"]},{"osd":7,"uuid":"46e082c8-d071-471a-8c86-ce5b5700cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6817","nonce":41478541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6819","nonce":41478541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6823","nonce":41478541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6821","nonce":41478541}]},"public_addr":"172.21.15.100:6817/41478541","cluster_addr":"172.21.15.100:6819/41478541","heartbeat_back_addr":"172.21.15.100:6823/41478541","heartbeat_front_addr":"172.21.15.100:6821/41478541","state":["exists","up"]},{"osd":8,"uuid":"fb9b93ef-5a33-4ffc-926e-a78c101bbbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6817","nonce":180766860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6819","nonce":180766860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6823","nonce":180766860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6821","nonce":180766860}]},"public_addr":"172.21.15.189:6817/180766860","cluster_addr":"172.21.15.189:6819/180766860","heartbeat_back_addr":"172.21.15.189:6823/180766860","heartbeat_front_addr":"172.21.15.189:6821/180766860","state":["exists","up"]},{"osd":9,"uuid":"0b7ec1a1-5ab9-4075-acfb-e0d82f018656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6827","nonce":1651232782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6829","nonce":1651232782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6833","nonce":1651232782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6831","nonce":1651232782}]},"public_addr":"172.21.15.81:6827/1651232782","cluster_addr":"172.21.15.81:6829/1651232782","heartbeat_back_addr":"172.21.15.81:6833/1651232782","heartbeat_front_addr":"172.21.15.81:6831/1651232782","state":["exists","up"]},{"osd":10,"uuid":"996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6825","nonce":3295868568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6827","nonce":3295868568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6831","nonce":3295868568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6829","nonce":3295868568}]},"public_addr":"172.21.15.100:6825/3295868568","cluster_addr":"172.21.15.100:6827/3295868568","heartbeat_back_addr":"172.21.15.100:6831/3295868568","heartbeat_front_addr":"172.21.15.100:6829/3295868568","state":["exists","up"]},{"osd":11,"uuid":"f051e2b2-fc58-489a-ab7c-8c1ff5448553","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6825","nonce":3852230978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6827","nonce":3852230978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6831","nonce":3852230978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6829","nonce":3852230978}]},"public_addr":"172.21.15.189:6825/3852230978","cluster_addr":"172.21.15.189:6827/3852230978","heartbeat_back_addr":"172.21.15.189:6831/3852230978","heartbeat_front_addr":"172.21.15.189:6829/3852230978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:20:47.371696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:12.762376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:37.936648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:03.950352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:28.922754+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:54.252149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:18.421479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:43.989505+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:08.789671+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:34.336367+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:59.089601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:25:23.761934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/1193015276":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/3474474725":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/682685112":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/4219073331":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/2162789959":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6800/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2577694203":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6800/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/4128337402":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2393807982":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6801/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6800/2591597081":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/1460332159":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6801/2591597081":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/1806419627":"2024-09-13T01:28:03.711343+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:28:09.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.985+0000 7f03dba70640 1 -- 172.21.15.81:0/3637349084 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f03c00a2d80 msgr2=0x7f03c00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:09.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.985+0000 7f03dba70640 1 --2- 172.21.15.81:0/3637349084 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f03c00a2d80 0x7f03c00a5240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f03c402a930 tx=0x7f03c4000bc0 comp rx=0 tx=0).stop 2024-09-12T01:28:09.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.985+0000 7f03dba70640 1 -- 172.21.15.81:0/3637349084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d4101de0 msgr2=0x7f03d4198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:09.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.985+0000 7f03dba70640 1 --2- 172.21.15.81:0/3637349084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d4101de0 0x7f03d4198570 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f03d000d950 tx=0x7f03d000de10 comp rx=0 tx=0).stop 2024-09-12T01:28:09.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.986+0000 7f03dba70640 1 -- 172.21.15.81:0/3637349084 shutdown_connections 2024-09-12T01:28:09.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.986+0000 7f03dba70640 1 --2- 172.21.15.81:0/3637349084 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f03c00a2d80 0x7f03c00a5240 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:09.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.986+0000 7f03dba70640 1 --2- 172.21.15.81:0/3637349084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03d4106f10 0x7f03d419ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:09.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.986+0000 7f03dba70640 1 --2- 172.21.15.81:0/3637349084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03d4102790 0x7f03d4198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:09.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.986+0000 7f03dba70640 1 --2- 172.21.15.81:0/3637349084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d4101de0 0x7f03d4198570 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:09.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.986+0000 7f03dba70640 1 -- 172.21.15.81:0/3637349084 >> 172.21.15.81:0/3637349084 conn(0x7f03d40fd8c0 msgr2=0x7f03d40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:09.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.986+0000 7f03dba70640 1 -- 172.21.15.81:0/3637349084 shutdown_connections 2024-09-12T01:28:09.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:09.986+0000 7f03dba70640 1 -- 172.21.15.81:0/3637349084 wait complete. 2024-09-12T01:28:10.633 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:10 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3637349084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:28:10.762 DEBUG:tasks.fwd_scrub:Yielding 2024-09-12T01:28:10.762 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T01:28:10.773 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T01:28:10.773 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T01:28:10.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-12T01:28:10.774 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-12T01:28:10.774 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:28:10.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:28:10.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:10 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3637349084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:28:10.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:10 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3637349084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:28:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.879+0000 7f482608d640 1 -- 172.21.15.81:0/2536841324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48201009b0 msgr2=0x7f4820100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.879+0000 7f482608d640 1 --2- 172.21.15.81:0/2536841324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48201009b0 0x7f4820100e10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4808009930 tx=0x7f480802a420 comp rx=0 tx=0).stop 2024-09-12T01:28:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.879+0000 7f482608d640 1 -- 172.21.15.81:0/2536841324 shutdown_connections 2024-09-12T01:28:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.879+0000 7f482608d640 1 --2- 172.21.15.81:0/2536841324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4820101350 0x7f482010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.879+0000 7f482608d640 1 --2- 172.21.15.81:0/2536841324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48201009b0 0x7f4820100e10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.879+0000 7f482608d640 1 --2- 172.21.15.81:0/2536841324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48201069c0 0x7f4820106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.879+0000 7f482608d640 1 -- 172.21.15.81:0/2536841324 >> 172.21.15.81:0/2536841324 conn(0x7f4820077990 msgr2=0x7f48200fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.880+0000 7f482608d640 1 -- 172.21.15.81:0/2536841324 shutdown_connections 2024-09-12T01:28:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.880+0000 7f482608d640 1 -- 172.21.15.81:0/2536841324 wait complete. 2024-09-12T01:28:10.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.880+0000 7f482608d640 1 Processor -- start 2024-09-12T01:28:10.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.880+0000 7f482608d640 1 -- start start 2024-09-12T01:28:10.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.880+0000 7f482608d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48201009b0 0x7f48200fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:10.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.880+0000 7f482608d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4820101350 0x7f48200fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:10.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.880+0000 7f482608d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48201069c0 0x7f48200fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:10.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.880+0000 7f482608d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4820110e00 con 0x7f48201009b0 2024-09-12T01:28:10.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f482608d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4820110c80 con 0x7f48201069c0 2024-09-12T01:28:10.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f482608d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4820110f80 con 0x7f4820101350 2024-09-12T01:28:10.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48201009b0 0x7f48200fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:10.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48201009b0 0x7f48200fcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40212/0 (socket says 172.21.15.81:40212) 2024-09-12T01:28:10.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481f7fe640 1 -- 172.21.15.81:0/3676231555 learned_addr learned my addr 172.21.15.81:0/3676231555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:10.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481effd640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4820101350 0x7f48200fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481ffff640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48201069c0 0x7f48200fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481f7fe640 1 -- 172.21.15.81:0/3676231555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4820101350 msgr2=0x7f48200fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481f7fe640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4820101350 0x7f48200fd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481f7fe640 1 -- 172.21.15.81:0/3676231555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48201069c0 msgr2=0x7f48200fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481f7fe640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48201069c0 0x7f48200fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481f7fe640 1 -- 172.21.15.81:0/3676231555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48201a6860 con 0x7f48201009b0 2024-09-12T01:28:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481f7fe640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48201009b0 0x7f48200fcde0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f481000cce0 tx=0x7f481000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481cff9640 1 -- 172.21.15.81:0/3676231555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4810004b20 con 0x7f48201009b0 2024-09-12T01:28:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481cff9640 1 -- 172.21.15.81:0/3676231555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4810004cc0 con 0x7f48201009b0 2024-09-12T01:28:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f481cff9640 1 -- 172.21.15.81:0/3676231555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481000f8c0 con 0x7f48201009b0 2024-09-12T01:28:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f482608d640 1 -- 172.21.15.81:0/3676231555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48201a6b50 con 0x7f48201009b0 2024-09-12T01:28:10.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.881+0000 7f482608d640 1 -- 172.21.15.81:0/3676231555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48201a7070 con 0x7f48201009b0 2024-09-12T01:28:10.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.882+0000 7f482608d640 1 -- 172.21.15.81:0/3676231555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4820100e10 con 0x7f48201009b0 2024-09-12T01:28:10.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.884+0000 7f481cff9640 1 -- 172.21.15.81:0/3676231555 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f481000fa60 con 0x7f48201009b0 2024-09-12T01:28:10.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.885+0000 7f481cff9640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f480c0a2ec0 0x7f480c0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:10.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.885+0000 7f481effd640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f480c0a2ec0 0x7f480c0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:10.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.885+0000 7f481cff9640 1 -- 172.21.15.81:0/3676231555 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f48100cf880 con 0x7f48201009b0 2024-09-12T01:28:10.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.886+0000 7f481effd640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f480c0a2ec0 0x7f480c0a5380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4808009900 tx=0x7f48080058d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:10.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:10.889+0000 7f481cff9640 1 -- 172.21.15.81:0/3676231555 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4810014030 con 0x7f48201009b0 2024-09-12T01:28:11.033 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:11.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.074+0000 7f482608d640 1 -- 172.21.15.81:0/3676231555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f48200fe310 con 0x7f48201009b0 2024-09-12T01:28:11.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.078+0000 7f481cff9640 1 -- 172.21.15.81:0/3676231555 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v30)=0 v30) ==== 129+0+0 (secure 0 0 0) 0x7f48200fe310 con 0x7f48201009b0 2024-09-12T01:28:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.080+0000 7f482608d640 1 -- 172.21.15.81:0/3676231555 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f480c0a2ec0 msgr2=0x7f480c0a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.080+0000 7f482608d640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f480c0a2ec0 0x7f480c0a5380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4808009900 tx=0x7f48080058d0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.080+0000 7f482608d640 1 -- 172.21.15.81:0/3676231555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48201009b0 msgr2=0x7f48200fcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.080+0000 7f482608d640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48201009b0 0x7f48200fcde0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f481000cce0 tx=0x7f481000a620 comp rx=0 tx=0).stop 2024-09-12T01:28:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.080+0000 7f482608d640 1 -- 172.21.15.81:0/3676231555 shutdown_connections 2024-09-12T01:28:11.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.080+0000 7f482608d640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f480c0a2ec0 0x7f480c0a5380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.080+0000 7f482608d640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48201069c0 0x7f48200fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.080+0000 7f482608d640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4820101350 0x7f48200fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.080+0000 7f482608d640 1 --2- 172.21.15.81:0/3676231555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48201009b0 0x7f48200fcde0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.080+0000 7f482608d640 1 -- 172.21.15.81:0/3676231555 >> 172.21.15.81:0/3676231555 conn(0x7f4820077990 msgr2=0x7f4820069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:11.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.080+0000 7f482608d640 1 -- 172.21.15.81:0/3676231555 shutdown_connections 2024-09-12T01:28:11.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.080+0000 7f482608d640 1 -- 172.21.15.81:0/3676231555 wait complete. 2024-09-12T01:28:11.091 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-12T01:28:11.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.193+0000 7f963fdc0640 1 -- 172.21.15.81:0/1474190294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9638103600 msgr2=0x7f963810bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.193+0000 7f963fdc0640 1 --2- 172.21.15.81:0/1474190294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9638103600 0x7f963810bae0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9628009900 tx=0x7f962802a480 comp rx=0 tx=0).stop 2024-09-12T01:28:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.194+0000 7f963fdc0640 1 -- 172.21.15.81:0/1474190294 shutdown_connections 2024-09-12T01:28:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.194+0000 7f963fdc0640 1 --2- 172.21.15.81:0/1474190294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f963810c0b0 0x7f963810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.194+0000 7f963fdc0640 1 --2- 172.21.15.81:0/1474190294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9638103600 0x7f963810bae0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.194+0000 7f963fdc0640 1 --2- 172.21.15.81:0/1474190294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9638102ce0 0x7f96381030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.194+0000 7f963fdc0640 1 -- 172.21.15.81:0/1474190294 >> 172.21.15.81:0/1474190294 conn(0x7f9638077990 msgr2=0x7f96380fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.194+0000 7f963fdc0640 1 -- 172.21.15.81:0/1474190294 shutdown_connections 2024-09-12T01:28:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.194+0000 7f963fdc0640 1 -- 172.21.15.81:0/1474190294 wait complete. 2024-09-12T01:28:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.194+0000 7f963fdc0640 1 Processor -- start 2024-09-12T01:28:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963fdc0640 1 -- start start 2024-09-12T01:28:11.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963fdc0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9638102ce0 0x7f96381982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963fdc0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9638103600 0x7f9638198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963fdc0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f963810c0b0 0x7f963819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963fdc0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9638111eb0 con 0x7f9638103600 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963fdc0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9638111d30 con 0x7f963810c0b0 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963fdc0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9638112030 con 0x7f9638102ce0 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963d35b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9638103600 0x7f9638198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963d35b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9638103600 0x7f9638198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40232/0 (socket says 172.21.15.81:40232) 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963d35b640 1 -- 172.21.15.81:0/3737869086 learned_addr learned my addr 172.21.15.81:0/3737869086 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963db5c640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9638102ce0 0x7f96381982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963e35d640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f963810c0b0 0x7f963819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963d35b640 1 -- 172.21.15.81:0/3737869086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9638102ce0 msgr2=0x7f96381982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963d35b640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9638102ce0 0x7f96381982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963d35b640 1 -- 172.21.15.81:0/3737869086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f963810c0b0 msgr2=0x7f963819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963d35b640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f963810c0b0 0x7f963819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.195+0000 7f963d35b640 1 -- 172.21.15.81:0/3737869086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963819d2d0 con 0x7f9638103600 2024-09-12T01:28:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.196+0000 7f963d35b640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9638103600 0x7f9638198820 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9628006010 tx=0x7f96280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.196+0000 7f962effd640 1 -- 172.21.15.81:0/3737869086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962803f030 con 0x7f9638103600 2024-09-12T01:28:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.196+0000 7f962effd640 1 -- 172.21.15.81:0/3737869086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9628003ce0 con 0x7f9638103600 2024-09-12T01:28:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.196+0000 7f963fdc0640 1 -- 172.21.15.81:0/3737869086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f963819d560 con 0x7f9638103600 2024-09-12T01:28:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.196+0000 7f962effd640 1 -- 172.21.15.81:0/3737869086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628035070 con 0x7f9638103600 2024-09-12T01:28:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.196+0000 7f963fdc0640 1 -- 172.21.15.81:0/3737869086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96381a4e50 con 0x7f9638103600 2024-09-12T01:28:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.197+0000 7f963fdc0640 1 -- 172.21.15.81:0/3737869086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96381030c0 con 0x7f9638103600 2024-09-12T01:28:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.198+0000 7f962effd640 1 -- 172.21.15.81:0/3737869086 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f9628042030 con 0x7f9638103600 2024-09-12T01:28:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.199+0000 7f962effd640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f96240a2e40 0x7f96240a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.199+0000 7f962effd640 1 -- 172.21.15.81:0/3737869086 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f96280efb20 con 0x7f9638103600 2024-09-12T01:28:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.199+0000 7f963db5c640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f96240a2e40 0x7f96240a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.199+0000 7f963db5c640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f96240a2e40 0x7f96240a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f963400bbe0 tx=0x7f963400b390 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:11.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.203+0000 7f962effd640 1 -- 172.21.15.81:0/3737869086 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f962803b460 con 0x7f9638103600 2024-09-12T01:28:11.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:11 smithi081 ceph-mon[30920]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 0 B/s wr, 31 op/s 2024-09-12T01:28:11.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:11 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3676231555' entity='client.admin' 2024-09-12T01:28:11.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:11 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:11.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:11 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:11.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:11 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:11.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:11 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:11.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.375+0000 7f963fdc0640 1 -- 172.21.15.81:0/3737869086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f96381a5080 con 0x7f9638103600 2024-09-12T01:28:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.379+0000 7f962effd640 1 -- 172.21.15.81:0/3737869086 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) ==== 138+0+0 (secure 0 0 0) 0x7f96280bc070 con 0x7f9638103600 2024-09-12T01:28:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.381+0000 7f963fdc0640 1 -- 172.21.15.81:0/3737869086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f96240a2e40 msgr2=0x7f96240a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.382+0000 7f963fdc0640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f96240a2e40 0x7f96240a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f963400bbe0 tx=0x7f963400b390 comp rx=0 tx=0).stop 2024-09-12T01:28:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.382+0000 7f963fdc0640 1 -- 172.21.15.81:0/3737869086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9638103600 msgr2=0x7f9638198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.382+0000 7f963fdc0640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9638103600 0x7f9638198820 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9628006010 tx=0x7f96280042f0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.382+0000 7f963fdc0640 1 -- 172.21.15.81:0/3737869086 shutdown_connections 2024-09-12T01:28:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.382+0000 7f963fdc0640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f96240a2e40 0x7f96240a5300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.382+0000 7f963fdc0640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f963810c0b0 0x7f963819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.382+0000 7f963fdc0640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9638103600 0x7f9638198820 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.382+0000 7f963fdc0640 1 --2- 172.21.15.81:0/3737869086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9638102ce0 0x7f96381982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.382+0000 7f963fdc0640 1 -- 172.21.15.81:0/3737869086 >> 172.21.15.81:0/3737869086 conn(0x7f9638077990 msgr2=0x7f96380fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:11.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.382+0000 7f963fdc0640 1 -- 172.21.15.81:0/3737869086 shutdown_connections 2024-09-12T01:28:11.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.382+0000 7f963fdc0640 1 -- 172.21.15.81:0/3737869086 wait complete. 2024-09-12T01:28:11.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-12T01:28:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.499+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/4029325130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc100150 msgr2=0x7fa8dc100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.499+0000 7fa8e2f9f640 1 --2- 172.21.15.81:0/4029325130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc100150 0x7fa8dc100590 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009860 tx=0x7fa8d002a340 comp rx=0 tx=0).stop 2024-09-12T01:28:11.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.499+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/4029325130 shutdown_connections 2024-09-12T01:28:11.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.499+0000 7fa8e2f9f640 1 --2- 172.21.15.81:0/4029325130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8dc100ad0 0x7fa8dc10e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.499+0000 7fa8e2f9f640 1 --2- 172.21.15.81:0/4029325130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc100150 0x7fa8dc100590 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.499+0000 7fa8e2f9f640 1 --2- 172.21.15.81:0/4029325130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc107b00 0x7fa8dc107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.499+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/4029325130 >> 172.21.15.81:0/4029325130 conn(0x7fa8dc077200 msgr2=0x7fa8dc077610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:11.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.499+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/4029325130 shutdown_connections 2024-09-12T01:28:11.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.499+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/4029325130 wait complete. 2024-09-12T01:28:11.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.499+0000 7fa8e2f9f640 1 Processor -- start 2024-09-12T01:28:11.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.499+0000 7fa8e2f9f640 1 -- start start 2024-09-12T01:28:11.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e2f9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc100150 0x7fa8dc198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e2f9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc100ad0 0x7fa8dc1987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e2f9f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8dc107b00 0x7fa8dc19cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e2f9f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc111dd0 con 0x7fa8dc100150 2024-09-12T01:28:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e2f9f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc111c50 con 0x7fa8dc100ad0 2024-09-12T01:28:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e2f9f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc111f50 con 0x7fa8dc107b00 2024-09-12T01:28:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e1f9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc100150 0x7fa8dc198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e1f9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc100150 0x7fa8dc198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40244/0 (socket says 172.21.15.81:40244) 2024-09-12T01:28:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e1f9d640 1 -- 172.21.15.81:0/80211886 learned_addr learned my addr 172.21.15.81:0/80211886 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e179c640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc100ad0 0x7fa8dc1987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e279e640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8dc107b00 0x7fa8dc19cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e1f9d640 1 -- 172.21.15.81:0/80211886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8dc107b00 msgr2=0x7fa8dc19cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e1f9d640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8dc107b00 0x7fa8dc19cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e1f9d640 1 -- 172.21.15.81:0/80211886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc100ad0 msgr2=0x7fa8dc1987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e1f9d640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc100ad0 0x7fa8dc1987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e1f9d640 1 -- 172.21.15.81:0/80211886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc19d250 con 0x7fa8dc100150 2024-09-12T01:28:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e179c640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc100ad0 0x7fa8dc1987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.500+0000 7fa8e1f9d640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc100150 0x7fa8dc198260 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800e9f0 tx=0x7fa8d800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.501+0000 7fa8ceffd640 1 -- 172.21.15.81:0/80211886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d800cd80 con 0x7fa8dc100150 2024-09-12T01:28:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.501+0000 7fa8ceffd640 1 -- 172.21.15.81:0/80211886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8d8010910 con 0x7fa8dc100150 2024-09-12T01:28:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.501+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/80211886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8dc19d540 con 0x7fa8dc100150 2024-09-12T01:28:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.501+0000 7fa8ceffd640 1 -- 172.21.15.81:0/80211886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8018990 con 0x7fa8dc100150 2024-09-12T01:28:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.501+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/80211886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8dc1a4dd0 con 0x7fa8dc100150 2024-09-12T01:28:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.502+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/80211886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8dc100590 con 0x7fa8dc100150 2024-09-12T01:28:11.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.503+0000 7fa8ceffd640 1 -- 172.21.15.81:0/80211886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7fa8d8010ac0 con 0x7fa8dc100150 2024-09-12T01:28:11.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.503+0000 7fa8ceffd640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8c80a2d80 0x7fa8c80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.504+0000 7fa8e179c640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8c80a2d80 0x7fa8c80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.504+0000 7fa8ceffd640 1 -- 172.21.15.81:0/80211886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fa8d80cfca0 con 0x7fa8dc100150 2024-09-12T01:28:11.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.504+0000 7fa8e179c640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8c80a2d80 0x7fa8c80a5240 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa8d002a930 tx=0x7fa8d00058d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:11.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.507+0000 7fa8ceffd640 1 -- 172.21.15.81:0/80211886 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8d809c130 con 0x7fa8dc100150 2024-09-12T01:28:11.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.553+0000 7fefb68e1640 1 -- 172.21.15.81:0/3402316238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefb01082e0 msgr2=0x7fefb010ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.553+0000 7fefb68e1640 1 --2- 172.21.15.81:0/3402316238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefb01082e0 0x7fefb010ec50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009cd0 tx=0x7fefa802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.553+0000 7fefb68e1640 1 -- 172.21.15.81:0/3402316238 shutdown_connections 2024-09-12T01:28:11.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.553+0000 7fefb68e1640 1 --2- 172.21.15.81:0/3402316238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefb01082e0 0x7fefb010ec50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.553+0000 7fefb68e1640 1 --2- 172.21.15.81:0/3402316238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0103760 0x7fefb0107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.553+0000 7fefb68e1640 1 --2- 172.21.15.81:0/3402316238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefb0102db0 0x7fefb0103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.553+0000 7fefb68e1640 1 -- 172.21.15.81:0/3402316238 >> 172.21.15.81:0/3402316238 conn(0x7fefb00fc7d0 msgr2=0x7fefb00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:11.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.553+0000 7fefb68e1640 1 -- 172.21.15.81:0/3402316238 shutdown_connections 2024-09-12T01:28:11.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.553+0000 7fefb68e1640 1 -- 172.21.15.81:0/3402316238 wait complete. 2024-09-12T01:28:11.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.554+0000 7fefb68e1640 1 Processor -- start 2024-09-12T01:28:11.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.554+0000 7fefb68e1640 1 -- start start 2024-09-12T01:28:11.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.554+0000 7fefb68e1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0102db0 0x7fefb0100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.554+0000 7fefb68e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefb0103760 0x7fefb0100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.554+0000 7fefb68e1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefb01082e0 0x7fefb0101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.554+0000 7fefb68e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fefb01120b0 con 0x7fefb0103760 2024-09-12T01:28:11.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.554+0000 7fefb68e1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0111f30 con 0x7fefb0102db0 2024-09-12T01:28:11.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.554+0000 7fefb68e1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0112230 con 0x7fefb01082e0 2024-09-12T01:28:11.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.554+0000 7fefa7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefb0103760 0x7fefb0100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.554+0000 7fefa7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefb0103760 0x7fefb0100f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40272/0 (socket says 172.21.15.81:40272) 2024-09-12T01:28:11.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.554+0000 7fefa7fff640 1 -- 172.21.15.81:0/4057248427 learned_addr learned my addr 172.21.15.81:0/4057248427 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:11.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.554+0000 7fefaffff640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0102db0 0x7fefb0100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.555+0000 7fefb4e7e640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefb01082e0 0x7fefb0101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.555+0000 7fefa7fff640 1 -- 172.21.15.81:0/4057248427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefb01082e0 msgr2=0x7fefb0101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.555+0000 7fefa7fff640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefb01082e0 0x7fefb0101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.555+0000 7fefa7fff640 1 -- 172.21.15.81:0/4057248427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0102db0 msgr2=0x7fefb0100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.555+0000 7fefa7fff640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0102db0 0x7fefb0100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.555+0000 7fefa7fff640 1 -- 172.21.15.81:0/4057248427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb01a6a10 con 0x7fefb0103760 2024-09-12T01:28:11.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.555+0000 7fefaffff640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0102db0 0x7fefb0100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:11.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.555+0000 7fefa7fff640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefb0103760 0x7fefb0100f50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fef9800d740 tx=0x7fef9800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:11.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.555+0000 7fefadffb640 1 -- 172.21.15.81:0/4057248427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98017070 con 0x7fefb0103760 2024-09-12T01:28:11.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.555+0000 7fefb68e1640 1 -- 172.21.15.81:0/4057248427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb01a6d00 con 0x7fefb0103760 2024-09-12T01:28:11.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.555+0000 7fefadffb640 1 -- 172.21.15.81:0/4057248427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef9800de50 con 0x7fefb0103760 2024-09-12T01:28:11.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.555+0000 7fefadffb640 1 -- 172.21.15.81:0/4057248427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9800f6b0 con 0x7fefb0103760 2024-09-12T01:28:11.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.555+0000 7fefb68e1640 1 -- 172.21.15.81:0/4057248427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb01a7230 con 0x7fefb0103760 2024-09-12T01:28:11.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.557+0000 7fefadffb640 1 -- 172.21.15.81:0/4057248427 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7fef9801a070 con 0x7fefb0103760 2024-09-12T01:28:11.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.558+0000 7fefadffb640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fef9c0a2d80 0x7fef9c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.558+0000 7fefaffff640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fef9c0a2d80 0x7fef9c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.558+0000 7fefadffb640 1 -- 172.21.15.81:0/4057248427 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fef980cef70 con 0x7fefb0103760 2024-09-12T01:28:11.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.559+0000 7fefaffff640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fef9c0a2d80 0x7fef9c0a5240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fefa00058c0 tx=0x7fefa000a250 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.559+0000 7fefb8cba740 1 Processor -- start 2024-09-12T01:28:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.559+0000 7fefb8cba740 1 -- start start 2024-09-12T01:28:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.559+0000 7fefb8cba740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d7b60 0x562c9e9d7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.559+0000 7fefb8cba740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9d8480 0x562c9e9e2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.559+0000 7fefb8cba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9e2d40 0x562c9e9e5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.559+0000 7fefb8cba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562c9e93d280 con 0x562c9e9e2d40 2024-09-12T01:28:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.559+0000 7fefb8cba740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562c9e8e4b10 con 0x562c9e9d7b60 2024-09-12T01:28:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.559+0000 7fefb8cba740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562c9e939240 con 0x562c9e9d8480 2024-09-12T01:28:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.559+0000 7fefb4e7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9e2d40 0x562c9e9e5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.559+0000 7fefb4e7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9e2d40 0x562c9e9e5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40276/0 (socket says 172.21.15.81:40276) 2024-09-12T01:28:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.559+0000 7fefb4e7e640 1 -- 172.21.15.81:0/1221808055 learned_addr learned my addr 172.21.15.81:0/1221808055 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.559+0000 7fefaffff640 1 --2- 172.21.15.81:0/1221808055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d7b60 0x562c9e9d7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.560+0000 7fefa7fff640 1 --2- 172.21.15.81:0/1221808055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9d8480 0x562c9e9e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.560+0000 7fefb4e7e640 1 -- 172.21.15.81:0/1221808055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9d8480 msgr2=0x562c9e9e2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:11.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.560+0000 7fefb4e7e640 1 --2- 172.21.15.81:0/1221808055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9d8480 0x562c9e9e2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.560+0000 7fefb4e7e640 1 -- 172.21.15.81:0/1221808055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d7b60 msgr2=0x562c9e9d7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:11.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.560+0000 7fefb4e7e640 1 --2- 172.21.15.81:0/1221808055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d7b60 0x562c9e9d7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.560+0000 7fefb4e7e640 1 -- 172.21.15.81:0/1221808055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c9e8f11f0 con 0x562c9e9e2d40 2024-09-12T01:28:11.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.560+0000 7fefb4e7e640 1 --2- 172.21.15.81:0/1221808055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9e2d40 0x562c9e9e5130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fefa8005cc0 tx=0x7fefa8009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5e77e2e0ab942f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:11.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.560+0000 7fefa67fc640 1 -- 172.21.15.81:0/1221808055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8031910 con 0x562c9e9e2d40 2024-09-12T01:28:11.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.560+0000 7fefa67fc640 1 -- 172.21.15.81:0/1221808055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefa8036040 con 0x562c9e9e2d40 2024-09-12T01:28:11.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.560+0000 7fefa67fc640 1 -- 172.21.15.81:0/1221808055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8004600 con 0x562c9e9e2d40 2024-09-12T01:28:11.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.561+0000 7fefb8cba740 1 -- 172.21.15.81:0/1221808055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9e2d40 msgr2=0x562c9e9e5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.561+0000 7fefb8cba740 1 --2- 172.21.15.81:0/1221808055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9e2d40 0x562c9e9e5130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fefa8005cc0 tx=0x7fefa8009a20 comp rx=0 tx=0).stop 2024-09-12T01:28:11.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.561+0000 7fefb8cba740 1 -- 172.21.15.81:0/1221808055 shutdown_connections 2024-09-12T01:28:11.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.561+0000 7fefb8cba740 1 --2- 172.21.15.81:0/1221808055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9e2d40 0x562c9e9e5130 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.561+0000 7fefb8cba740 1 --2- 172.21.15.81:0/1221808055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9d8480 0x562c9e9e2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.561+0000 7fefb8cba740 1 --2- 172.21.15.81:0/1221808055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d7b60 0x562c9e9d7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.561+0000 7fefb8cba740 1 -- 172.21.15.81:0/1221808055 >> 172.21.15.81:0/1221808055 conn(0x562c9e9d40f0 msgr2=0x562c9e9d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:11.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.561+0000 7fefb8cba740 1 -- 172.21.15.81:0/1221808055 shutdown_connections 2024-09-12T01:28:11.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.561+0000 7fefb8cba740 1 -- 172.21.15.81:0/1221808055 wait complete. 2024-09-12T01:28:11.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.561+0000 7fefb8cba740 1 -- start start 2024-09-12T01:28:11.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefb8cba740 1 Processor -- start 2024-09-12T01:28:11.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefb8cba740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d7b60 0x562c9e9dfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefb8cba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 0x562c9e9e0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefb8cba740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9e2d40 0x562c9e9e06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefb8cba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562c9e9e5910 con 0x562c9e9d8480 2024-09-12T01:28:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefb8cba740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562c9e8f7f10 con 0x562c9e9d7b60 2024-09-12T01:28:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefb8cba740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562c9e9e5a90 con 0x562c9e9e2d40 2024-09-12T01:28:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefb8cba740 10 client.0 _ll_register_callbacks cb 0x562c9e8c0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefa7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 0x562c9e9e0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefa7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 0x562c9e9e0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40278/0 (socket says 172.21.15.81:40278) 2024-09-12T01:28:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefa7fff640 1 -- 172.21.15.81:0/3227042272 learned_addr learned my addr 172.21.15.81:0/3227042272 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefaffff640 1 --2- 172.21.15.81:0/3227042272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d7b60 0x562c9e9dfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefb4e7e640 1 --2- 172.21.15.81:0/3227042272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9e2d40 0x562c9e9e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefa7fff640 1 -- 172.21.15.81:0/3227042272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9e2d40 msgr2=0x562c9e9e06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefa7fff640 1 --2- 172.21.15.81:0/3227042272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9e2d40 0x562c9e9e06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefa7fff640 1 -- 172.21.15.81:0/3227042272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d7b60 msgr2=0x562c9e9dfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefa7fff640 1 --2- 172.21.15.81:0/3227042272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d7b60 0x562c9e9dfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefa7fff640 1 -- 172.21.15.81:0/3227042272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c9e6ae6a0 con 0x562c9e9d8480 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fefa7fff640 1 --2- 172.21.15.81:0/3227042272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 0x562c9e9e0160 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fef980977b0 tx=0x7fef9800d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c4aaf95c5a2d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.562+0000 7fef8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fef8f7fe640 1 -- 172.21.15.81:0/3227042272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef980b4060 con 0x562c9e9d8480 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fef8f7fe640 1 -- 172.21.15.81:0/3227042272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fef980cc8e0 con 0x562c9e9d8480 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fefb8cba740 1 -- 172.21.15.81:0/3227042272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefa8036040 con 0x562c9e9d8480 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fef8f7fe640 1 -- 172.21.15.81:0/3227042272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fef9807b020 con 0x562c9e9d8480 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fefb8cba740 10 client.15366 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fefb8cba740 1 -- 172.21.15.81:0/3227042272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562c9e9f1510 con 0x562c9e9d8480 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fef8f7fe640 1 -- 172.21.15.81:0/3227042272 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefa8036040 con 0x562c9e9d8480 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fef8f7fe640 1 -- 172.21.15.81:0/3227042272 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fef9809a830 con 0x562c9e9d8480 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fefb8cba740 10 client.15366 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fefb8cba740 10 client.15366 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:28:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fefb8cba740 20 client.15366 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fefb8cba740 1 --2- 172.21.15.81:0/3227042272 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562c9e9f2920 0x562c9e9f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fefb8cba740 4 client.15366 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.563+0000 7fefb8cba740 1 -- 172.21.15.81:0/3227042272 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c9e94a7f0 con 0x562c9e9f2920 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.564+0000 7fefaffff640 1 --2- 172.21.15.81:0/3227042272 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562c9e9f2920 0x562c9e9f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.564+0000 7fefaffff640 1 --2- 172.21.15.81:0/3227042272 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562c9e9f2920 0x562c9e9f4d10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f333609797645f7 server_cookie=7b49dcb8ef4e3f2f in_seq=0 out_seq=0 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.564+0000 7fef8f7fe640 10 client.15366 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fef8f7fe640 1 -- 172.21.15.81:0/3227042272 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c9e94a7f0 con 0x562c9e9f2920 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fef8f7fe640 10 client.15366 handle_command_reply: tid=0 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fefb8cba740 1 client.15366 shutdown 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fefb8cba740 1 -- 172.21.15.81:0/3227042272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 msgr2=0x562c9e9e0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fefb8cba740 1 --2- 172.21.15.81:0/3227042272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 0x562c9e9e0160 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fef980977b0 tx=0x7fef9800d6c0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fefb8cba740 1 -- 172.21.15.81:0/3227042272 shutdown_connections 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fefb8cba740 1 --2- 172.21.15.81:0/3227042272 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562c9e9f2920 0x562c9e9f4d10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fefb8cba740 1 --2- 172.21.15.81:0/3227042272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9e2d40 0x562c9e9e06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fefb8cba740 1 --2- 172.21.15.81:0/3227042272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 0x562c9e9e0160 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fefb8cba740 1 --2- 172.21.15.81:0/3227042272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d7b60 0x562c9e9dfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fef8f7fe640 0 client.15366 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fefb8cba740 1 -- 172.21.15.81:0/3227042272 >> 172.21.15.81:0/3227042272 conn(0x562c9e9d40f0 msgr2=0x562c9e9d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fefb8cba740 1 -- 172.21.15.81:0/3227042272 shutdown_connections 2024-09-12T01:28:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fefb8cba740 1 -- 172.21.15.81:0/3227042272 wait complete. 2024-09-12T01:28:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.565+0000 7fefb8cba740 20 client.15366 trim_cache size 0 max 16384 2024-09-12T01:28:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.596+0000 7fefb8cba740 1 Processor -- start 2024-09-12T01:28:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.596+0000 7fefb8cba740 1 -- start start 2024-09-12T01:28:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefb8cba740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9d7b60 0x562c9e9fa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefb8cba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 0x562c9e9faaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefb8cba740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9e2d40 0x562c9e9dcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefb8cba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fefb01afaa0 con 0x562c9e9d8480 2024-09-12T01:28:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefb8cba740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fefb01b15e0 con 0x562c9e9e2d40 2024-09-12T01:28:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefb8cba740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fefb01b0170 con 0x562c9e9d7b60 2024-09-12T01:28:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefa7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 0x562c9e9faaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefa7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 0x562c9e9faaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40288/0 (socket says 172.21.15.81:40288) 2024-09-12T01:28:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefa7fff640 1 -- 172.21.15.81:0/821014780 learned_addr learned my addr 172.21.15.81:0/821014780 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefaffff640 1 --2- 172.21.15.81:0/821014780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9d7b60 0x562c9e9fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefa7fff640 1 -- 172.21.15.81:0/821014780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9d7b60 msgr2=0x562c9e9fa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefa7fff640 1 --2- 172.21.15.81:0/821014780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9d7b60 0x562c9e9fa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefa7fff640 1 -- 172.21.15.81:0/821014780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9e2d40 msgr2=0x562c9e9dcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefb4e7e640 1 --2- 172.21.15.81:0/821014780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9e2d40 0x562c9e9dcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefa7fff640 1 --2- 172.21.15.81:0/821014780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9e2d40 0x562c9e9dcea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefa7fff640 1 -- 172.21.15.81:0/821014780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c9e9d3f20 con 0x562c9e9d8480 2024-09-12T01:28:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefaffff640 1 --2- 172.21.15.81:0/821014780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9d7b60 0x562c9e9fa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:28:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefb4e7e640 1 --2- 172.21.15.81:0/821014780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9e2d40 0x562c9e9dcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:28:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefa7fff640 1 --2- 172.21.15.81:0/821014780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 0x562c9e9faaf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fef98009610 tx=0x7fef9809f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476b3a8983f4981a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.597+0000 7fefa5ffb640 1 -- 172.21.15.81:0/821014780 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef980b4040 con 0x562c9e9d8480 2024-09-12T01:28:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.598+0000 7fefa5ffb640 1 -- 172.21.15.81:0/821014780 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef9809f4b0 con 0x562c9e9d8480 2024-09-12T01:28:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.598+0000 7fefa5ffb640 1 -- 172.21.15.81:0/821014780 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98021040 con 0x562c9e9d8480 2024-09-12T01:28:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.598+0000 7fefb8cba740 1 -- 172.21.15.81:0/821014780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 msgr2=0x562c9e9faaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.598+0000 7fefb8cba740 1 --2- 172.21.15.81:0/821014780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 0x562c9e9faaf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fef98009610 tx=0x7fef9809f210 comp rx=0 tx=0).stop 2024-09-12T01:28:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.599+0000 7fefb8cba740 1 -- 172.21.15.81:0/821014780 shutdown_connections 2024-09-12T01:28:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.599+0000 7fefb8cba740 1 --2- 172.21.15.81:0/821014780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9e2d40 0x562c9e9dcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.599+0000 7fefb8cba740 1 --2- 172.21.15.81:0/821014780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d8480 0x562c9e9faaf0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.599+0000 7fefb8cba740 1 --2- 172.21.15.81:0/821014780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9d7b60 0x562c9e9fa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.599+0000 7fefb8cba740 1 -- 172.21.15.81:0/821014780 >> 172.21.15.81:0/821014780 conn(0x562c9e9d40f0 msgr2=0x562c9e9e1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.599+0000 7fefb8cba740 1 -- 172.21.15.81:0/821014780 shutdown_connections 2024-09-12T01:28:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.599+0000 7fefb8cba740 1 -- 172.21.15.81:0/821014780 wait complete. 2024-09-12T01:28:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.599+0000 7fefb8cba740 1 -- start start 2024-09-12T01:28:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.599+0000 7fefb8cba740 1 Processor -- start 2024-09-12T01:28:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefb8cba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d7b60 0x562c9e9eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefb8cba740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d8480 0x562c9e9eb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefb8cba740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9e2d40 0x562c9e9e7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefb8cba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fefb01b0f10 con 0x562c9e9d7b60 2024-09-12T01:28:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefb8cba740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fefb01b0840 con 0x562c9e9d8480 2024-09-12T01:28:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefb8cba740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fefb01ada80 con 0x562c9e9e2d40 2024-09-12T01:28:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefb8cba740 10 client.0 _ll_register_callbacks cb 0x7fef9809af20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefaffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d7b60 0x562c9e9eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefaffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d7b60 0x562c9e9eaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40302/0 (socket says 172.21.15.81:40302) 2024-09-12T01:28:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefaffff640 1 -- 172.21.15.81:0/3416126178 learned_addr learned my addr 172.21.15.81:0/3416126178 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefa7fff640 1 --2- 172.21.15.81:0/3416126178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d8480 0x562c9e9eb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefb4e7e640 1 --2- 172.21.15.81:0/3416126178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9e2d40 0x562c9e9e7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefaffff640 1 -- 172.21.15.81:0/3416126178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9e2d40 msgr2=0x562c9e9e7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefaffff640 1 --2- 172.21.15.81:0/3416126178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9e2d40 0x562c9e9e7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefaffff640 1 -- 172.21.15.81:0/3416126178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d8480 msgr2=0x562c9e9eb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefaffff640 1 --2- 172.21.15.81:0/3416126178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d8480 0x562c9e9eb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefaffff640 1 -- 172.21.15.81:0/3416126178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c9e9e84e0 con 0x562c9e9d7b60 2024-09-12T01:28:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fefaffff640 1 --2- 172.21.15.81:0/3416126178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d7b60 0x562c9e9eaec0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fefa0005d70 tx=0x7fefa0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cc0fc1d70e983b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.600+0000 7fef8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fef8f7fe640 1 -- 172.21.15.81:0/3416126178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa0016070 con 0x562c9e9d7b60 2024-09-12T01:28:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fef8f7fe640 1 -- 172.21.15.81:0/3416126178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fefa001cc00 con 0x562c9e9d7b60 2024-09-12T01:28:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fefb8cba740 1 -- 172.21.15.81:0/3416126178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef9809f4b0 con 0x562c9e9d7b60 2024-09-12T01:28:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fef8f7fe640 1 -- 172.21.15.81:0/3416126178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fefa003e050 con 0x562c9e9d7b60 2024-09-12T01:28:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fefb8cba740 10 client.15372 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fefb8cba740 1 -- 172.21.15.81:0/3416126178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562c9ea5dfa0 con 0x562c9e9d7b60 2024-09-12T01:28:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fef8f7fe640 1 -- 172.21.15.81:0/3416126178 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef9809f4b0 con 0x562c9e9d7b60 2024-09-12T01:28:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fef8f7fe640 1 -- 172.21.15.81:0/3416126178 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fefa00283f0 con 0x562c9e9d7b60 2024-09-12T01:28:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fefb8cba740 10 client.15372 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fefb8cba740 10 client.15372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:28:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fefb8cba740 20 client.15372 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fefb8cba740 1 --2- 172.21.15.81:0/3416126178 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562c9ea5e6f0 0x562c9ea60b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fefb8cba740 4 client.15372 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:28:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.601+0000 7fefb8cba740 1 -- 172.21.15.81:0/3416126178 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562c9e944d00 con 0x562c9ea5e6f0 2024-09-12T01:28:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.602+0000 7fefa7fff640 1 --2- 172.21.15.81:0/3416126178 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562c9ea5e6f0 0x562c9ea60b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.602+0000 7fefa7fff640 1 --2- 172.21.15.81:0/3416126178 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562c9ea5e6f0 0x562c9ea60b10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdb854a24a9b01fb server_cookie=591ae49004bd239f in_seq=0 out_seq=0 2024-09-12T01:28:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.602+0000 7fef8f7fe640 10 client.15372 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fef8f7fe640 1 -- 172.21.15.81:0/3416126178 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562c9e944d00 con 0x562c9ea5e6f0 2024-09-12T01:28:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fef8f7fe640 10 client.15372 handle_command_reply: tid=0 2024-09-12T01:28:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fefb8cba740 1 client.15372 shutdown 2024-09-12T01:28:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fefb8cba740 1 -- 172.21.15.81:0/3416126178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d7b60 msgr2=0x562c9e9eaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fefb8cba740 1 --2- 172.21.15.81:0/3416126178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d7b60 0x562c9e9eaec0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fefa0005d70 tx=0x7fefa0004730 comp rx=0 tx=0).stop 2024-09-12T01:28:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fefb8cba740 1 -- 172.21.15.81:0/3416126178 shutdown_connections 2024-09-12T01:28:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fefb8cba740 1 --2- 172.21.15.81:0/3416126178 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562c9ea5e6f0 0x562c9ea60b10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fefb8cba740 1 --2- 172.21.15.81:0/3416126178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562c9e9e2d40 0x562c9e9e7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fefb8cba740 1 --2- 172.21.15.81:0/3416126178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562c9e9d8480 0x562c9e9eb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fefb8cba740 1 --2- 172.21.15.81:0/3416126178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562c9e9d7b60 0x562c9e9eaec0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fefb8cba740 1 -- 172.21.15.81:0/3416126178 >> 172.21.15.81:0/3416126178 conn(0x562c9e9d40f0 msgr2=0x562c9e9dfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fef8f7fe640 0 client.15372 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fefb8cba740 1 -- 172.21.15.81:0/3416126178 shutdown_connections 2024-09-12T01:28:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.603+0000 7fefb8cba740 1 -- 172.21.15.81:0/3416126178 wait complete. 2024-09-12T01:28:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.604+0000 7fefb8cba740 20 client.15372 trim_cache size 0 max 16384 2024-09-12T01:28:11.611 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:28:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:28:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "e9de0928-8f8c-4f0b-a5d8-247775fd9f3b", 2024-09-12T01:28:11.611 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:28:11.611 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:28:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.604+0000 7fefb68e1640 1 -- 172.21.15.81:0/4057248427 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fef9c0a2d80 msgr2=0x7fef9c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.604+0000 7fefb68e1640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fef9c0a2d80 0x7fef9c0a5240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fefa00058c0 tx=0x7fefa000a250 comp rx=0 tx=0).stop 2024-09-12T01:28:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.604+0000 7fefb68e1640 1 -- 172.21.15.81:0/4057248427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefb0103760 msgr2=0x7fefb0100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.604+0000 7fefb68e1640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefb0103760 0x7fefb0100f50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fef9800d740 tx=0x7fef9800dc00 comp rx=0 tx=0).stop 2024-09-12T01:28:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.604+0000 7fefb68e1640 1 -- 172.21.15.81:0/4057248427 shutdown_connections 2024-09-12T01:28:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.604+0000 7fefb68e1640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fef9c0a2d80 0x7fef9c0a5240 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.604+0000 7fefb68e1640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefb01082e0 0x7fefb0101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.604+0000 7fefb68e1640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefb0103760 0x7fefb0100f50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.604+0000 7fefb68e1640 1 --2- 172.21.15.81:0/4057248427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0102db0 0x7fefb0100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.604+0000 7fefb68e1640 1 -- 172.21.15.81:0/4057248427 >> 172.21.15.81:0/4057248427 conn(0x7fefb00fc7d0 msgr2=0x7fefb0105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.604+0000 7fefb68e1640 1 -- 172.21.15.81:0/4057248427 shutdown_connections 2024-09-12T01:28:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.604+0000 7fefb68e1640 1 -- 172.21.15.81:0/4057248427 wait complete. 2024-09-12T01:28:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.702+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/80211886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fa8dc1a4fa0 con 0x7fa8dc100150 2024-09-12T01:28:11.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.706+0000 7fa8ceffd640 1 -- 172.21.15.81:0/80211886 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v32)=0 v32) ==== 133+0+0 (secure 0 0 0) 0x7fa8d80a0430 con 0x7fa8dc100150 2024-09-12T01:28:11.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.708+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/80211886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8c80a2d80 msgr2=0x7fa8c80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.708+0000 7fa8e2f9f640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8c80a2d80 0x7fa8c80a5240 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa8d002a930 tx=0x7fa8d00058d0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.708+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/80211886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc100150 msgr2=0x7fa8dc198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.708+0000 7fa8e2f9f640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc100150 0x7fa8dc198260 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800e9f0 tx=0x7fa8d800eeb0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.708+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/80211886 shutdown_connections 2024-09-12T01:28:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.708+0000 7fa8e2f9f640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8c80a2d80 0x7fa8c80a5240 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.708+0000 7fa8e2f9f640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8dc107b00 0x7fa8dc19cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.708+0000 7fa8e2f9f640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc100ad0 0x7fa8dc1987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.708+0000 7fa8e2f9f640 1 --2- 172.21.15.81:0/80211886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8dc100150 0x7fa8dc198260 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.708+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/80211886 >> 172.21.15.81:0/80211886 conn(0x7fa8dc077200 msgr2=0x7fa8dc0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.708+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/80211886 shutdown_connections 2024-09-12T01:28:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.708+0000 7fa8e2f9f640 1 -- 172.21.15.81:0/80211886 wait complete. 2024-09-12T01:28:11.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-12T01:28:11.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:11 smithi100 ceph-mon[35275]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 0 B/s wr, 31 op/s 2024-09-12T01:28:11.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:11 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3676231555' entity='client.admin' 2024-09-12T01:28:11.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:11 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:11.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:11 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:11.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:11 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:11.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:11 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:11.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:11 smithi189 ceph-mon[35357]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 0 B/s wr, 31 op/s 2024-09-12T01:28:11.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:11 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3676231555' entity='client.admin' 2024-09-12T01:28:11.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:11 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:11.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:11 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:11.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:11 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:11.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:11 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:11.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.828+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3553355467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d8102ce0 msgr2=0x7ff1d81030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.828+0000 7ff1dcff8640 1 --2- 172.21.15.81:0/3553355467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d8102ce0 0x7ff1d81030c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009900 tx=0x7ff1d002a480 comp rx=0 tx=0).stop 2024-09-12T01:28:11.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.828+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3553355467 shutdown_connections 2024-09-12T01:28:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.828+0000 7ff1dcff8640 1 --2- 172.21.15.81:0/3553355467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d810c0b0 0x7ff1d810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.828+0000 7ff1dcff8640 1 --2- 172.21.15.81:0/3553355467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1d8103600 0x7ff1d810bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.828+0000 7ff1dcff8640 1 --2- 172.21.15.81:0/3553355467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d8102ce0 0x7ff1d81030c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.828+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3553355467 >> 172.21.15.81:0/3553355467 conn(0x7ff1d8077990 msgr2=0x7ff1d80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.828+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3553355467 shutdown_connections 2024-09-12T01:28:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.828+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3553355467 wait complete. 2024-09-12T01:28:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1dcff8640 1 Processor -- start 2024-09-12T01:28:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1dcff8640 1 -- start start 2024-09-12T01:28:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1dcff8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1d8102ce0 0x7ff1d8100930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1dcff8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d8103600 0x7ff1d8100e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1dcff8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d810c0b0 0x7ff1d81013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1dcff8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d8111eb0 con 0x7ff1d810c0b0 2024-09-12T01:28:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1dcff8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d8111d30 con 0x7ff1d8102ce0 2024-09-12T01:28:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1dcff8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d8112030 con 0x7ff1d8103600 2024-09-12T01:28:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1d6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d810c0b0 0x7ff1d81013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1d6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d810c0b0 0x7ff1d81013b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40320/0 (socket says 172.21.15.81:40320) 2024-09-12T01:28:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1d6d9d640 1 -- 172.21.15.81:0/3063025943 learned_addr learned my addr 172.21.15.81:0/3063025943 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1d5d9b640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d8103600 0x7ff1d8100e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1d659c640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1d8102ce0 0x7ff1d8100930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1d6d9d640 1 -- 172.21.15.81:0/3063025943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d8103600 msgr2=0x7ff1d8100e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1d6d9d640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d8103600 0x7ff1d8100e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1d6d9d640 1 -- 172.21.15.81:0/3063025943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1d8102ce0 msgr2=0x7ff1d8100930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1d6d9d640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1d8102ce0 0x7ff1d8100930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1d6d9d640 1 -- 172.21.15.81:0/3063025943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d81a6820 con 0x7ff1d810c0b0 2024-09-12T01:28:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1d5d9b640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d8103600 0x7ff1d8100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.829+0000 7ff1d6d9d640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d810c0b0 0x7ff1d81013b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800eaa0 tx=0x7ff1c800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:11.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.830+0000 7ff1cf7fe640 1 -- 172.21.15.81:0/3063025943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c800cdb0 con 0x7ff1d810c0b0 2024-09-12T01:28:11.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.830+0000 7ff1cf7fe640 1 -- 172.21.15.81:0/3063025943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1c8005020 con 0x7ff1d810c0b0 2024-09-12T01:28:11.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.830+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3063025943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d81a6b10 con 0x7ff1d810c0b0 2024-09-12T01:28:11.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.830+0000 7ff1cf7fe640 1 -- 172.21.15.81:0/3063025943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c80116b0 con 0x7ff1d810c0b0 2024-09-12T01:28:11.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.830+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3063025943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d81a7060 con 0x7ff1d810c0b0 2024-09-12T01:28:11.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.831+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3063025943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d81030c0 con 0x7ff1d810c0b0 2024-09-12T01:28:11.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.832+0000 7ff1cf7fe640 1 -- 172.21.15.81:0/3063025943 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7ff1c8005560 con 0x7ff1d810c0b0 2024-09-12T01:28:11.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.833+0000 7ff1cf7fe640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1c40a2e40 0x7ff1c40a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:11.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.833+0000 7ff1d659c640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1c40a2e40 0x7ff1c40a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:11.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.833+0000 7ff1cf7fe640 1 -- 172.21.15.81:0/3063025943 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff1c80cf850 con 0x7ff1d810c0b0 2024-09-12T01:28:11.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.833+0000 7ff1d659c640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1c40a2e40 0x7ff1c40a5300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0005ab0 tx=0x7ff1d0005a20 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:11.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:11.837+0000 7ff1cf7fe640 1 -- 172.21.15.81:0/3063025943 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff1c8016030 con 0x7ff1d810c0b0 2024-09-12T01:28:12.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.027+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3063025943 --> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7ff1d80fd6f0 con 0x7ff1c40a2e40 2024-09-12T01:28:12.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.095+0000 7ff1cf7fe640 1 -- 172.21.15.81:0/3063025943 <== mgr.15222 v2:172.21.15.81:6800/1379528564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff1d80fd6f0 con 0x7ff1c40a2e40 2024-09-12T01:28:12.095 INFO:teuthology.orchestra.run.smithi081.stdout:Schedule set for path / 2024-09-12T01:28:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.097+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3063025943 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1c40a2e40 msgr2=0x7ff1c40a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.097+0000 7ff1dcff8640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1c40a2e40 0x7ff1c40a5300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0005ab0 tx=0x7ff1d0005a20 comp rx=0 tx=0).stop 2024-09-12T01:28:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.097+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3063025943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d810c0b0 msgr2=0x7ff1d81013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.097+0000 7ff1dcff8640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d810c0b0 0x7ff1d81013b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800eaa0 tx=0x7ff1c800ef60 comp rx=0 tx=0).stop 2024-09-12T01:28:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.097+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3063025943 shutdown_connections 2024-09-12T01:28:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.097+0000 7ff1dcff8640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1c40a2e40 0x7ff1c40a5300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.097+0000 7ff1dcff8640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1d810c0b0 0x7ff1d81013b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.097+0000 7ff1dcff8640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d8103600 0x7ff1d8100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.097+0000 7ff1dcff8640 1 --2- 172.21.15.81:0/3063025943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1d8102ce0 0x7ff1d8100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.097+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3063025943 >> 172.21.15.81:0/3063025943 conn(0x7ff1d8077990 msgr2=0x7ff1d80fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.097+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3063025943 shutdown_connections 2024-09-12T01:28:12.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.097+0000 7ff1dcff8640 1 -- 172.21.15.81:0/3063025943 wait complete. 2024-09-12T01:28:12.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-12T01:28:12.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.210+0000 7f50a3d2c640 1 -- 172.21.15.81:0/14923180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c108110 msgr2=0x7f509c10ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.210+0000 7f50a3d2c640 1 --2- 172.21.15.81:0/14923180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c108110 0x7f509c10ea60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5094009cd0 tx=0x7f509402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.210+0000 7f50a3d2c640 1 -- 172.21.15.81:0/14923180 shutdown_connections 2024-09-12T01:28:12.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.210+0000 7f50a3d2c640 1 --2- 172.21.15.81:0/14923180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c108110 0x7f509c10ea60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.210+0000 7f50a3d2c640 1 --2- 172.21.15.81:0/14923180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f509c101200 0x7f509c1079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.210+0000 7f50a3d2c640 1 --2- 172.21.15.81:0/14923180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f509c100850 0x7f509c100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.210+0000 7f50a3d2c640 1 -- 172.21.15.81:0/14923180 >> 172.21.15.81:0/14923180 conn(0x7f509c075db0 msgr2=0x7f509c0761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:12.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.210+0000 7f50a3d2c640 1 -- 172.21.15.81:0/14923180 shutdown_connections 2024-09-12T01:28:12.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.210+0000 7f50a3d2c640 1 -- 172.21.15.81:0/14923180 wait complete. 2024-09-12T01:28:12.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.210+0000 7f50a3d2c640 1 Processor -- start 2024-09-12T01:28:12.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.210+0000 7f50a3d2c640 1 -- start start 2024-09-12T01:28:12.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a3d2c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f509c100850 0x7f509c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:12.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a3d2c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c108110 0x7f509c1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:12.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a3d2c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f509c19cc50 0x7f509c19d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:12.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a3d2c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f509c111f80 con 0x7f509c108110 2024-09-12T01:28:12.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a3d2c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f509c111e00 con 0x7f509c100850 2024-09-12T01:28:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a3d2c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f509c112100 con 0x7f509c19cc50 2024-09-12T01:28:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a12c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c108110 0x7f509c1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a12c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c108110 0x7f509c1988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41234/0 (socket says 172.21.15.81:41234) 2024-09-12T01:28:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a12c7640 1 -- 172.21.15.81:0/3551078892 learned_addr learned my addr 172.21.15.81:0/3551078892 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a1ac8640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f509c100850 0x7f509c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a22c9640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f509c19cc50 0x7f509c19d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a12c7640 1 -- 172.21.15.81:0/3551078892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f509c19cc50 msgr2=0x7f509c19d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a12c7640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f509c19cc50 0x7f509c19d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a12c7640 1 -- 172.21.15.81:0/3551078892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f509c100850 msgr2=0x7f509c198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a12c7640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f509c100850 0x7f509c198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a12c7640 1 -- 172.21.15.81:0/3551078892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c19d740 con 0x7f509c108110 2024-09-12T01:28:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a12c7640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c108110 0x7f509c1988d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f508c00d950 tx=0x7f508c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f5092ffd640 1 -- 172.21.15.81:0/3551078892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c017070 con 0x7f509c108110 2024-09-12T01:28:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f5092ffd640 1 -- 172.21.15.81:0/3551078892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f508c00de80 con 0x7f509c108110 2024-09-12T01:28:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a3d2c640 1 -- 172.21.15.81:0/3551078892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509c19da30 con 0x7f509c108110 2024-09-12T01:28:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f5092ffd640 1 -- 172.21.15.81:0/3551078892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c00f620 con 0x7f509c108110 2024-09-12T01:28:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.211+0000 7f50a3d2c640 1 -- 172.21.15.81:0/3551078892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509c1a5210 con 0x7f509c108110 2024-09-12T01:28:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.212+0000 7f50a3d2c640 1 -- 172.21.15.81:0/3551078892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f509c069cc0 con 0x7f509c108110 2024-09-12T01:28:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.213+0000 7f5092ffd640 1 -- 172.21.15.81:0/3551078892 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f508c009c30 con 0x7f509c108110 2024-09-12T01:28:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.215+0000 7f5092ffd640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f50880a2ec0 0x7f50880a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.215+0000 7f50a1ac8640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f50880a2ec0 0x7f50880a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.215+0000 7f5092ffd640 1 -- 172.21.15.81:0/3551078892 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f508c0cf100 con 0x7f509c108110 2024-09-12T01:28:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.215+0000 7f50a1ac8640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f50880a2ec0 0x7f50880a5380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5098009990 tx=0x7f5098009110 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:12.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.219+0000 7f5092ffd640 1 -- 172.21.15.81:0/3551078892 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f508c09bbe0 con 0x7f509c108110 2024-09-12T01:28:12.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.409+0000 7f50a3d2c640 1 -- 172.21.15.81:0/3551078892 --> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f509c101350 con 0x7f50880a2ec0 2024-09-12T01:28:12.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.470+0000 7f5092ffd640 1 -- 172.21.15.81:0/3551078892 <== mgr.15222 v2:172.21.15.81:6800/1379528564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f509c101350 con 0x7f50880a2ec0 2024-09-12T01:28:12.471 INFO:teuthology.orchestra.run.smithi081.stdout:Retention added to path / 2024-09-12T01:28:12.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.473+0000 7f50a3d2c640 1 -- 172.21.15.81:0/3551078892 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f50880a2ec0 msgr2=0x7f50880a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.473+0000 7f50a3d2c640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f50880a2ec0 0x7f50880a5380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5098009990 tx=0x7f5098009110 comp rx=0 tx=0).stop 2024-09-12T01:28:12.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.473+0000 7f50a3d2c640 1 -- 172.21.15.81:0/3551078892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c108110 msgr2=0x7f509c1988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.473+0000 7f50a3d2c640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c108110 0x7f509c1988d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f508c00d950 tx=0x7f508c00dd50 comp rx=0 tx=0).stop 2024-09-12T01:28:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.473+0000 7f50a3d2c640 1 -- 172.21.15.81:0/3551078892 shutdown_connections 2024-09-12T01:28:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.473+0000 7f50a3d2c640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f50880a2ec0 0x7f50880a5380 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.473+0000 7f50a3d2c640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f509c19cc50 0x7f509c19d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.473+0000 7f50a3d2c640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c108110 0x7f509c1988d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.473+0000 7f50a3d2c640 1 --2- 172.21.15.81:0/3551078892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f509c100850 0x7f509c198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.473+0000 7f50a3d2c640 1 -- 172.21.15.81:0/3551078892 >> 172.21.15.81:0/3551078892 conn(0x7f509c075db0 msgr2=0x7f509c0ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.473+0000 7f50a3d2c640 1 -- 172.21.15.81:0/3551078892 shutdown_connections 2024-09-12T01:28:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.473+0000 7f50a3d2c640 1 -- 172.21.15.81:0/3551078892 wait complete. 2024-09-12T01:28:12.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T01:28:12.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:28:12.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.587+0000 7f2c973b9640 1 -- 172.21.15.81:0/2683088356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c90106220 msgr2=0x7f2c90106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.587+0000 7f2c973b9640 1 --2- 172.21.15.81:0/2683088356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c90106220 0x7f2c90106600 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00aa40 tx=0x7f2c8c02b750 comp rx=0 tx=0).stop 2024-09-12T01:28:12.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.587+0000 7f2c973b9640 1 -- 172.21.15.81:0/2683088356 shutdown_connections 2024-09-12T01:28:12.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.587+0000 7f2c973b9640 1 --2- 172.21.15.81:0/2683088356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c90100fd0 0x7f2c9010d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.587+0000 7f2c973b9640 1 --2- 172.21.15.81:0/2683088356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c90100630 0x7f2c90100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.587+0000 7f2c973b9640 1 --2- 172.21.15.81:0/2683088356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c90106220 0x7f2c90106600 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.587+0000 7f2c973b9640 1 -- 172.21.15.81:0/2683088356 >> 172.21.15.81:0/2683088356 conn(0x7f2c90075ef0 msgr2=0x7f2c90076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.588+0000 7f2c973b9640 1 -- 172.21.15.81:0/2683088356 shutdown_connections 2024-09-12T01:28:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.588+0000 7f2c973b9640 1 -- 172.21.15.81:0/2683088356 wait complete. 2024-09-12T01:28:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.588+0000 7f2c973b9640 1 Processor -- start 2024-09-12T01:28:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.588+0000 7f2c973b9640 1 -- start start 2024-09-12T01:28:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.588+0000 7f2c973b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c90100630 0x7f2c90198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.588+0000 7f2c973b9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c90100fd0 0x7f2c901989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.588+0000 7f2c973b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c90106220 0x7f2c9019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.588+0000 7f2c973b9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9010fd30 con 0x7f2c90106220 2024-09-12T01:28:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.588+0000 7f2c973b9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9010fbb0 con 0x7f2c90100630 2024-09-12T01:28:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.588+0000 7f2c973b9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9010feb0 con 0x7f2c90100fd0 2024-09-12T01:28:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.588+0000 7f2c95956640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c90106220 0x7f2c9019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c95956640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c90106220 0x7f2c9019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41258/0 (socket says 172.21.15.81:41258) 2024-09-12T01:28:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c95956640 1 -- 172.21.15.81:0/1203830148 learned_addr learned my addr 172.21.15.81:0/1203830148 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c95155640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c90100630 0x7f2c90198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c94954640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c90100fd0 0x7f2c901989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c95956640 1 -- 172.21.15.81:0/1203830148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c90100fd0 msgr2=0x7f2c901989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c95956640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c90100fd0 0x7f2c901989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c95956640 1 -- 172.21.15.81:0/1203830148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c90100630 msgr2=0x7f2c90198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c95956640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c90100630 0x7f2c90198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c95956640 1 -- 172.21.15.81:0/1203830148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9019d470 con 0x7f2c90106220 2024-09-12T01:28:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c95956640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c90106220 0x7f2c9019cd40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800eb10 tx=0x7f2c8800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c867fc640 1 -- 172.21.15.81:0/1203830148 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88004b20 con 0x7f2c90106220 2024-09-12T01:28:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c973b9640 1 -- 172.21.15.81:0/1203830148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9019d760 con 0x7f2c90106220 2024-09-12T01:28:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c867fc640 1 -- 172.21.15.81:0/1203830148 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c88004cc0 con 0x7f2c90106220 2024-09-12T01:28:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c867fc640 1 -- 172.21.15.81:0/1203830148 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88010760 con 0x7f2c90106220 2024-09-12T01:28:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.589+0000 7f2c973b9640 1 -- 172.21.15.81:0/1203830148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c901a4ff0 con 0x7f2c90106220 2024-09-12T01:28:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.590+0000 7f2c973b9640 1 -- 172.21.15.81:0/1203830148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c90100a90 con 0x7f2c90106220 2024-09-12T01:28:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.591+0000 7f2c867fc640 1 -- 172.21.15.81:0/1203830148 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f2c88010900 con 0x7f2c90106220 2024-09-12T01:28:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.592+0000 7f2c867fc640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2c7c0a2e40 0x7f2c7c0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.592+0000 7f2c95155640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2c7c0a2e40 0x7f2c7c0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.592+0000 7f2c867fc640 1 -- 172.21.15.81:0/1203830148 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2c880cfce0 con 0x7f2c90106220 2024-09-12T01:28:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.593+0000 7f2c95155640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2c7c0a2e40 0x7f2c7c0a5300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00aa10 tx=0x7f2c8c0058d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:12.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.595+0000 7f2c867fc640 1 -- 172.21.15.81:0/1203830148 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c880541b0 con 0x7f2c90106220 2024-09-12T01:28:12.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:12 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3737869086' entity='client.admin' 2024-09-12T01:28:12.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:12 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:12.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:12 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:12.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:12 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:12.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:12 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:12.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:12 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/80211886' entity='client.admin' 2024-09-12T01:28:12.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:12 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:12.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:12 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:12.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:12 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:12.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:12 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:12.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:12 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3737869086' entity='client.admin' 2024-09-12T01:28:12.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:12 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:12.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:12 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:12.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:12 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:12.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:12 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:12.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:12 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/80211886' entity='client.admin' 2024-09-12T01:28:12.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:12 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:12.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:12 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:12.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:12 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:12.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:12 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:12 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3737869086' entity='client.admin' 2024-09-12T01:28:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:12 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:12 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:12 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:12 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:12 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/80211886' entity='client.admin' 2024-09-12T01:28:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:12 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:28:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:12 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:28:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:12 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:28:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:12 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:28:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.792+0000 7f2c973b9640 1 -- 172.21.15.81:0/1203830148 --> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f2c90062630 con 0x7f2c7c0a2e40 2024-09-12T01:28:12.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.799+0000 7f2c867fc640 1 -- 172.21.15.81:0/1203830148 <== mgr.15222 v2:172.21.15.81:6800/1379528564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f2c90062630 con 0x7f2c7c0a2e40 2024-09-12T01:28:12.800 INFO:teuthology.orchestra.run.smithi081.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T01:28:12", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-12T01:28:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.801+0000 7f2c973b9640 1 -- 172.21.15.81:0/1203830148 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2c7c0a2e40 msgr2=0x7f2c7c0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.801+0000 7f2c973b9640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2c7c0a2e40 0x7f2c7c0a5300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00aa10 tx=0x7f2c8c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.801+0000 7f2c973b9640 1 -- 172.21.15.81:0/1203830148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c90106220 msgr2=0x7f2c9019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.801+0000 7f2c973b9640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c90106220 0x7f2c9019cd40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800eb10 tx=0x7f2c8800c2d0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.802+0000 7f2c973b9640 1 -- 172.21.15.81:0/1203830148 shutdown_connections 2024-09-12T01:28:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.802+0000 7f2c973b9640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2c7c0a2e40 0x7f2c7c0a5300 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.802+0000 7f2c973b9640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c90106220 0x7f2c9019cd40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.802+0000 7f2c973b9640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c90100fd0 0x7f2c901989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.802+0000 7f2c973b9640 1 --2- 172.21.15.81:0/1203830148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c90100630 0x7f2c90198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.802+0000 7f2c973b9640 1 -- 172.21.15.81:0/1203830148 >> 172.21.15.81:0/1203830148 conn(0x7f2c90075ef0 msgr2=0x7f2c900ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:12.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.802+0000 7f2c973b9640 1 -- 172.21.15.81:0/1203830148 shutdown_connections 2024-09-12T01:28:12.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.802+0000 7f2c973b9640 1 -- 172.21.15.81:0/1203830148 wait complete. 2024-09-12T01:28:12.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T01:28:12.815 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:12.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.956+0000 7f7f9d08d640 1 -- 172.21.15.81:0/3542797558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f981009d0 msgr2=0x7f7f98100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.956+0000 7f7f9d08d640 1 --2- 172.21.15.81:0/3542797558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f981009d0 0x7f7f98100e30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009930 tx=0x7f7f8002a420 comp rx=0 tx=0).stop 2024-09-12T01:28:12.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.956+0000 7f7f9d08d640 1 -- 172.21.15.81:0/3542797558 shutdown_connections 2024-09-12T01:28:12.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.956+0000 7f7f9d08d640 1 --2- 172.21.15.81:0/3542797558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f98101370 0x7f7f9810d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.956+0000 7f7f9d08d640 1 --2- 172.21.15.81:0/3542797558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f981009d0 0x7f7f98100e30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.956+0000 7f7f9d08d640 1 --2- 172.21.15.81:0/3542797558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f981069e0 0x7f7f98106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.956+0000 7f7f9d08d640 1 -- 172.21.15.81:0/3542797558 >> 172.21.15.81:0/3542797558 conn(0x7f7f980fc6f0 msgr2=0x7f7f980feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:12.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.957+0000 7f7f9d08d640 1 -- 172.21.15.81:0/3542797558 shutdown_connections 2024-09-12T01:28:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.957+0000 7f7f9d08d640 1 -- 172.21.15.81:0/3542797558 wait complete. 2024-09-12T01:28:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.957+0000 7f7f9d08d640 1 Processor -- start 2024-09-12T01:28:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.957+0000 7f7f9d08d640 1 -- start start 2024-09-12T01:28:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f9d08d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f981009d0 0x7f7f981992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f9d08d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f98101370 0x7f7f98199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f9d08d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f981069e0 0x7f7f981a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f9d08d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7f98110e80 con 0x7f7f981009d0 2024-09-12T01:28:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f9d08d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7f98110d00 con 0x7f7f981069e0 2024-09-12T01:28:12.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f9d08d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f98111000 con 0x7f7f98101370 2024-09-12T01:28:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f96d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f981009d0 0x7f7f981992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f96d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f981009d0 0x7f7f981992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41276/0 (socket says 172.21.15.81:41276) 2024-09-12T01:28:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f96d9d640 1 -- 172.21.15.81:0/2185174033 learned_addr learned my addr 172.21.15.81:0/2185174033 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f9759e640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f981069e0 0x7f7f981a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f9659c640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f98101370 0x7f7f98199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f96d9d640 1 -- 172.21.15.81:0/2185174033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f98101370 msgr2=0x7f7f98199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f96d9d640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f98101370 0x7f7f98199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f96d9d640 1 -- 172.21.15.81:0/2185174033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f981069e0 msgr2=0x7f7f981a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:12.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f96d9d640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f981069e0 0x7f7f981a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:12.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f96d9d640 1 -- 172.21.15.81:0/2185174033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f981a48b0 con 0x7f7f981009d0 2024-09-12T01:28:12.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f9759e640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f981069e0 0x7f7f981a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:12.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f96d9d640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f981009d0 0x7f7f981992f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800b4a0 tx=0x7f7f8800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:12.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f8ffff640 1 -- 172.21.15.81:0/2185174033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f88014070 con 0x7f7f981009d0 2024-09-12T01:28:12.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f9d08d640 1 -- 172.21.15.81:0/2185174033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f981a4a80 con 0x7f7f981009d0 2024-09-12T01:28:12.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f8ffff640 1 -- 172.21.15.81:0/2185174033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f88010af0 con 0x7f7f981009d0 2024-09-12T01:28:12.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f8ffff640 1 -- 172.21.15.81:0/2185174033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f88017d10 con 0x7f7f981009d0 2024-09-12T01:28:12.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.958+0000 7f7f9d08d640 1 -- 172.21.15.81:0/2185174033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f981a4fa0 con 0x7f7f981009d0 2024-09-12T01:28:12.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.959+0000 7f7f9d08d640 1 -- 172.21.15.81:0/2185174033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f98100eb0 con 0x7f7f981009d0 2024-09-12T01:28:12.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.960+0000 7f7f8ffff640 1 -- 172.21.15.81:0/2185174033 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f7f88017070 con 0x7f7f981009d0 2024-09-12T01:28:12.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.961+0000 7f7f8ffff640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7f840a2e40 0x7f7f840a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:12.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.961+0000 7f7f9659c640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7f840a2e40 0x7f7f840a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:12.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.961+0000 7f7f8ffff640 1 -- 172.21.15.81:0/2185174033 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7f880ce930 con 0x7f7f981009d0 2024-09-12T01:28:12.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.962+0000 7f7f9659c640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7f840a2e40 0x7f7f840a5300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7f80000c00 tx=0x7f7f80031490 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:12.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:12.965+0000 7f7f8ffff640 1 -- 172.21.15.81:0/2185174033 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7f8809b520 con 0x7f7f981009d0 2024-09-12T01:28:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.166+0000 7f7f9d08d640 1 -- 172.21.15.81:0/2185174033 --> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f7f98062630 con 0x7f7f840a2e40 2024-09-12T01:28:13.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.173+0000 7f7f8ffff640 1 -- 172.21.15.81:0/2185174033 <== mgr.15222 v2:172.21.15.81:6800/1379528564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f7f98062630 con 0x7f7f840a2e40 2024-09-12T01:28:13.173 INFO:teuthology.orchestra.run.smithi081.stdout:/ 1m 6m3h 2024-09-12T01:28:13.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.175+0000 7f7f9d08d640 1 -- 172.21.15.81:0/2185174033 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7f840a2e40 msgr2=0x7f7f840a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:13.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.175+0000 7f7f9d08d640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7f840a2e40 0x7f7f840a5300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7f80000c00 tx=0x7f7f80031490 comp rx=0 tx=0).stop 2024-09-12T01:28:13.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.175+0000 7f7f9d08d640 1 -- 172.21.15.81:0/2185174033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f981009d0 msgr2=0x7f7f981992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:13.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.175+0000 7f7f9d08d640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f981009d0 0x7f7f981992f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800b4a0 tx=0x7f7f8800b960 comp rx=0 tx=0).stop 2024-09-12T01:28:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.175+0000 7f7f9d08d640 1 -- 172.21.15.81:0/2185174033 shutdown_connections 2024-09-12T01:28:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.175+0000 7f7f9d08d640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7f840a2e40 0x7f7f840a5300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.175+0000 7f7f9d08d640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f981069e0 0x7f7f981a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.175+0000 7f7f9d08d640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f98101370 0x7f7f98199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.175+0000 7f7f9d08d640 1 --2- 172.21.15.81:0/2185174033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f981009d0 0x7f7f981992f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.175+0000 7f7f9d08d640 1 -- 172.21.15.81:0/2185174033 >> 172.21.15.81:0/2185174033 conn(0x7f7f980fc6f0 msgr2=0x7f7f980fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.175+0000 7f7f9d08d640 1 -- 172.21.15.81:0/2185174033 shutdown_connections 2024-09-12T01:28:13.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.175+0000 7f7f9d08d640 1 -- 172.21.15.81:0/2185174033 wait complete. 2024-09-12T01:28:13.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-12T01:28:13.217 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-12T01:28:13.228 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-12T01:28:13.275 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T01:28:13.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:28:13.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.350+0000 7f556bb92640 1 -- 172.21.15.81:0/2242438889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f556410c160 msgr2=0x7f556410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:13.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.350+0000 7f556bb92640 1 --2- 172.21.15.81:0/2242438889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f556410c160 0x7f556410e600 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f555c009ca0 tx=0x7f555c02a950 comp rx=0 tx=0).stop 2024-09-12T01:28:13.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.350+0000 7f556bb92640 1 -- 172.21.15.81:0/2242438889 shutdown_connections 2024-09-12T01:28:13.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.350+0000 7f556bb92640 1 --2- 172.21.15.81:0/2242438889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f556410c160 0x7f556410e600 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.350+0000 7f556bb92640 1 --2- 172.21.15.81:0/2242438889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5564103650 0x7f556410bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.350+0000 7f556bb92640 1 --2- 172.21.15.81:0/2242438889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5564102d30 0x7f5564103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.350+0000 7f556bb92640 1 -- 172.21.15.81:0/2242438889 >> 172.21.15.81:0/2242438889 conn(0x7f55640fc7d0 msgr2=0x7f55640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.350+0000 7f556bb92640 1 -- 172.21.15.81:0/2242438889 shutdown_connections 2024-09-12T01:28:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.350+0000 7f556bb92640 1 -- 172.21.15.81:0/2242438889 wait complete. 2024-09-12T01:28:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.350+0000 7f556bb92640 1 Processor -- start 2024-09-12T01:28:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556bb92640 1 -- start start 2024-09-12T01:28:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556bb92640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5564102d30 0x7f55641983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556bb92640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5564103650 0x7f55641988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556bb92640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f556410c160 0x7f556419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556bb92640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5564111f40 con 0x7f5564102d30 2024-09-12T01:28:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556bb92640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5564111dc0 con 0x7f5564103650 2024-09-12T01:28:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556bb92640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f55641120c0 con 0x7f556410c160 2024-09-12T01:28:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556992e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5564102d30 0x7f55641983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556992e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5564102d30 0x7f55641983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41298/0 (socket says 172.21.15.81:41298) 2024-09-12T01:28:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556992e640 1 -- 172.21.15.81:0/4061831156 learned_addr learned my addr 172.21.15.81:0/4061831156 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556912d640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5564103650 0x7f55641988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556a12f640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f556410c160 0x7f556419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556992e640 1 -- 172.21.15.81:0/4061831156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f556410c160 msgr2=0x7f556419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556992e640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f556410c160 0x7f556419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556992e640 1 -- 172.21.15.81:0/4061831156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5564103650 msgr2=0x7f55641988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556992e640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5564103650 0x7f55641988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556992e640 1 -- 172.21.15.81:0/4061831156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556419d350 con 0x7f5564102d30 2024-09-12T01:28:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.351+0000 7f556a12f640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f556410c160 0x7f556419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.352+0000 7f556992e640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5564102d30 0x7f55641983a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f556000c920 tx=0x7f556000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.352+0000 7f555affd640 1 -- 172.21.15.81:0/4061831156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560007c70 con 0x7f5564102d30 2024-09-12T01:28:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.352+0000 7f556bb92640 1 -- 172.21.15.81:0/4061831156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556419d640 con 0x7f5564102d30 2024-09-12T01:28:13.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.352+0000 7f555affd640 1 -- 172.21.15.81:0/4061831156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5560007e10 con 0x7f5564102d30 2024-09-12T01:28:13.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.352+0000 7f555affd640 1 -- 172.21.15.81:0/4061831156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560018890 con 0x7f5564102d30 2024-09-12T01:28:13.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.352+0000 7f556bb92640 1 -- 172.21.15.81:0/4061831156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55641a4f20 con 0x7f5564102d30 2024-09-12T01:28:13.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.355+0000 7f556df6b740 1 Processor -- start 2024-09-12T01:28:13.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.355+0000 7f556df6b740 1 -- start start 2024-09-12T01:28:13.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.355+0000 7f555affd640 1 -- 172.21.15.81:0/4061831156 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f5560018a70 con 0x7f5564102d30 2024-09-12T01:28:13.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.355+0000 7f556df6b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 0x5651b3064880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.355+0000 7f556df6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b3064dc0 0x5651b306f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.355+0000 7f556df6b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b306f680 0x5651b3071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.355+0000 7f556df6b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5651b2fca2e0 con 0x5651b30644a0 2024-09-12T01:28:13.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.355+0000 7f556df6b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5651b2f71ce0 con 0x5651b306f680 2024-09-12T01:28:13.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.355+0000 7f556df6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5651b2fc62a0 con 0x5651b3064dc0 2024-09-12T01:28:13.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.356+0000 7f556a12f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 0x5651b3064880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.356+0000 7f556a12f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 0x5651b3064880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41304/0 (socket says 172.21.15.81:41304) 2024-09-12T01:28:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.356+0000 7f556a12f640 1 -- 172.21.15.81:0/1287918667 learned_addr learned my addr 172.21.15.81:0/1287918667 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.356+0000 7f556912d640 1 --2- 172.21.15.81:0/1287918667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b306f680 0x5651b3071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.356+0000 7f556a12f640 1 -- 172.21.15.81:0/1287918667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b3064dc0 msgr2=0x5651b306f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.356+0000 7f556a12f640 1 --2- 172.21.15.81:0/1287918667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b3064dc0 0x5651b306f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.356+0000 7f556a12f640 1 -- 172.21.15.81:0/1287918667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b306f680 msgr2=0x5651b3071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.356+0000 7f556a12f640 1 --2- 172.21.15.81:0/1287918667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b306f680 0x5651b3071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.356+0000 7f556a12f640 1 -- 172.21.15.81:0/1287918667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651b2f56440 con 0x5651b30644a0 2024-09-12T01:28:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.356+0000 7f555affd640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f55500a2d80 0x7f55500a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.356+0000 7f556a12f640 1 --2- 172.21.15.81:0/1287918667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 0x5651b3064880 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f555c009a50 tx=0x7f555c02f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224aaf89a16ac0b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.357+0000 7f556992e640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f55500a2d80 0x7f55500a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.357+0000 7f555affd640 1 -- 172.21.15.81:0/4061831156 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f55600cf700 con 0x7f5564102d30 2024-09-12T01:28:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.357+0000 7f554ffff640 1 -- 172.21.15.81:0/1287918667 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c034040 con 0x5651b30644a0 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.357+0000 7f554ffff640 1 -- 172.21.15.81:0/1287918667 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f555c003970 con 0x5651b30644a0 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.357+0000 7f554ffff640 1 -- 172.21.15.81:0/1287918667 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c004690 con 0x5651b30644a0 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.358+0000 7f556992e640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f55500a2d80 0x7f55500a5240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55600cce20 tx=0x7f556000a600 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.358+0000 7f556df6b740 1 -- 172.21.15.81:0/1287918667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 msgr2=0x5651b3064880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.358+0000 7f556df6b740 1 --2- 172.21.15.81:0/1287918667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 0x5651b3064880 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f555c009a50 tx=0x7f555c02f940 comp rx=0 tx=0).stop 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.358+0000 7f556df6b740 1 -- 172.21.15.81:0/1287918667 shutdown_connections 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.358+0000 7f556df6b740 1 --2- 172.21.15.81:0/1287918667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b306f680 0x5651b3071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.358+0000 7f556df6b740 1 --2- 172.21.15.81:0/1287918667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b3064dc0 0x5651b306f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.358+0000 7f556df6b740 1 --2- 172.21.15.81:0/1287918667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 0x5651b3064880 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.358+0000 7f556df6b740 1 -- 172.21.15.81:0/1287918667 >> 172.21.15.81:0/1287918667 conn(0x5651b3060a30 msgr2=0x5651b3060e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.358+0000 7f556df6b740 1 -- 172.21.15.81:0/1287918667 shutdown_connections 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.358+0000 7f556df6b740 1 -- 172.21.15.81:0/1287918667 wait complete. 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.358+0000 7f556df6b740 1 -- start start 2024-09-12T01:28:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.358+0000 7f556df6b740 1 Processor -- start 2024-09-12T01:28:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556df6b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 0x5651b306f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556df6b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b3064dc0 0x5651b306c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556df6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b306f680 0x5651b306c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556df6b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5651b3072250 con 0x5651b30644a0 2024-09-12T01:28:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556df6b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5651b2f85050 con 0x5651b3064dc0 2024-09-12T01:28:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556df6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5651b30723d0 con 0x5651b306f680 2024-09-12T01:28:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556df6b740 10 client.0 _ll_register_callbacks cb 0x5651b2fc5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556a12f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 0x5651b306f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556a12f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 0x5651b306f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41320/0 (socket says 172.21.15.81:41320) 2024-09-12T01:28:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556a12f640 1 -- 172.21.15.81:0/1730658749 learned_addr learned my addr 172.21.15.81:0/1730658749 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556912d640 1 --2- 172.21.15.81:0/1730658749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b3064dc0 0x5651b306c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556a12f640 1 -- 172.21.15.81:0/1730658749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b306f680 msgr2=0x5651b306c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556a12f640 1 --2- 172.21.15.81:0/1730658749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b306f680 0x5651b306c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556a12f640 1 -- 172.21.15.81:0/1730658749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b3064dc0 msgr2=0x5651b306c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556a12f640 1 --2- 172.21.15.81:0/1730658749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b3064dc0 0x5651b306c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556a12f640 1 -- 172.21.15.81:0/1730658749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651b2d3b3c0 con 0x5651b30644a0 2024-09-12T01:28:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f556a12f640 1 --2- 172.21.15.81:0/1730658749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 0x5651b306f060 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f555c02ae70 tx=0x7f555c005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9641b5db0fd3b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.359+0000 7f554d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f554d7fa640 1 -- 172.21.15.81:0/1730658749 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c04b070 con 0x5651b30644a0 2024-09-12T01:28:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f554d7fa640 1 -- 172.21.15.81:0/1730658749 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f555c003b20 con 0x5651b30644a0 2024-09-12T01:28:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f556df6b740 1 -- 172.21.15.81:0/1730658749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f555c003970 con 0x5651b30644a0 2024-09-12T01:28:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f554d7fa640 1 -- 172.21.15.81:0/1730658749 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f555c057050 con 0x5651b30644a0 2024-09-12T01:28:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f556df6b740 10 client.15408 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f556df6b740 1 -- 172.21.15.81:0/1730658749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5651b3072250 con 0x5651b30644a0 2024-09-12T01:28:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f554d7fa640 1 -- 172.21.15.81:0/1730658749 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f555c003970 con 0x5651b30644a0 2024-09-12T01:28:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f554d7fa640 1 -- 172.21.15.81:0/1730658749 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f555c042020 con 0x5651b30644a0 2024-09-12T01:28:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f556df6b740 10 client.15408 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f556df6b740 10 client.15408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:28:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f556df6b740 20 client.15408 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f556df6b740 1 --2- 172.21.15.81:0/1730658749 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5651b307ee10 0x5651b3081200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f556df6b740 4 client.15408 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.360+0000 7f556df6b740 1 -- 172.21.15.81:0/1730658749 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651b2fd7850 con 0x5651b307ee10 2024-09-12T01:28:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.361+0000 7f556912d640 1 --2- 172.21.15.81:0/1730658749 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5651b307ee10 0x5651b3081200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.361+0000 7f556912d640 1 --2- 172.21.15.81:0/1730658749 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5651b307ee10 0x5651b3081200 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24121a6630be7bc8 server_cookie=c084f85db18af97e in_seq=0 out_seq=0 2024-09-12T01:28:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.361+0000 7f554d7fa640 10 client.15408 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f554d7fa640 1 -- 172.21.15.81:0/1730658749 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651b2fd7850 con 0x5651b307ee10 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f554d7fa640 10 client.15408 handle_command_reply: tid=0 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f556df6b740 1 client.15408 shutdown 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f556df6b740 1 -- 172.21.15.81:0/1730658749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 msgr2=0x5651b306f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f556df6b740 1 --2- 172.21.15.81:0/1730658749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 0x5651b306f060 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f555c02ae70 tx=0x7f555c005f70 comp rx=0 tx=0).stop 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f556df6b740 1 -- 172.21.15.81:0/1730658749 shutdown_connections 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f556df6b740 1 --2- 172.21.15.81:0/1730658749 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5651b307ee10 0x5651b3081200 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f556df6b740 1 --2- 172.21.15.81:0/1730658749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b306f680 0x5651b306c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f556df6b740 1 --2- 172.21.15.81:0/1730658749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b3064dc0 0x5651b306c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f554d7fa640 0 client.15408 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f556df6b740 1 --2- 172.21.15.81:0/1730658749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b30644a0 0x5651b306f060 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f556df6b740 1 -- 172.21.15.81:0/1730658749 >> 172.21.15.81:0/1730658749 conn(0x5651b3060a30 msgr2=0x5651b3066710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f556df6b740 1 -- 172.21.15.81:0/1730658749 shutdown_connections 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f556df6b740 1 -- 172.21.15.81:0/1730658749 wait complete. 2024-09-12T01:28:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.362+0000 7f556df6b740 20 client.15408 trim_cache size 0 max 16384 2024-09-12T01:28:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.380+0000 7f556df6b740 1 Processor -- start 2024-09-12T01:28:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.380+0000 7f556df6b740 1 -- start start 2024-09-12T01:28:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.380+0000 7f556df6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b30644a0 0x5651b307b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.380+0000 7f556df6b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b3064dc0 0x5651b3086890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.380+0000 7f556df6b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b306f680 0x5651b3086dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.380+0000 7f556df6b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f55641ad7b0 con 0x5651b3064dc0 2024-09-12T01:28:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.380+0000 7f556df6b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f55641af2f0 con 0x5651b306f680 2024-09-12T01:28:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.380+0000 7f556df6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f55641ade80 con 0x5651b30644a0 2024-09-12T01:28:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.380+0000 7f556a12f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b306f680 0x5651b3086dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.380+0000 7f556a12f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b306f680 0x5651b3086dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:54260/0 (socket says 172.21.15.81:54260) 2024-09-12T01:28:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.380+0000 7f556a12f640 1 -- 172.21.15.81:0/2296355019 learned_addr learned my addr 172.21.15.81:0/2296355019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.380+0000 7f556a12f640 1 --2- 172.21.15.81:0/2296355019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b30644a0 0x5651b307b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.380+0000 7f556912d640 1 --2- 172.21.15.81:0/2296355019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b3064dc0 0x5651b3086890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.381+0000 7f556a12f640 1 -- 172.21.15.81:0/2296355019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b30644a0 msgr2=0x5651b307b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.381+0000 7f556a12f640 1 --2- 172.21.15.81:0/2296355019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b30644a0 0x5651b307b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.381+0000 7f556a12f640 1 -- 172.21.15.81:0/2296355019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b3064dc0 msgr2=0x5651b3086890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.381+0000 7f556a12f640 1 --2- 172.21.15.81:0/2296355019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b3064dc0 0x5651b3086890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.381+0000 7f556a12f640 1 -- 172.21.15.81:0/2296355019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651b3064bf0 con 0x5651b306f680 2024-09-12T01:28:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.381+0000 7f556912d640 1 --2- 172.21.15.81:0/2296355019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b3064dc0 0x5651b3086890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.381+0000 7f556a12f640 1 --2- 172.21.15.81:0/2296355019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b306f680 0x5651b3086dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f555c000f80 tx=0x7f555c009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81be427c5d06fc78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:13.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.384+0000 7f554f7fe640 1 -- 172.21.15.81:0/2296355019 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c04b040 con 0x5651b306f680 2024-09-12T01:28:13.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.384+0000 7f554f7fe640 1 -- 172.21.15.81:0/2296355019 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f555c044920 con 0x5651b306f680 2024-09-12T01:28:13.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.384+0000 7f554f7fe640 1 -- 172.21.15.81:0/2296355019 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c034040 con 0x5651b306f680 2024-09-12T01:28:13.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.385+0000 7f556df6b740 1 -- 172.21.15.81:0/2296355019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b306f680 msgr2=0x5651b3086dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:13.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.385+0000 7f556df6b740 1 --2- 172.21.15.81:0/2296355019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b306f680 0x5651b3086dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f555c000f80 tx=0x7f555c009360 comp rx=0 tx=0).stop 2024-09-12T01:28:13.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.385+0000 7f556df6b740 1 -- 172.21.15.81:0/2296355019 shutdown_connections 2024-09-12T01:28:13.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.385+0000 7f556df6b740 1 --2- 172.21.15.81:0/2296355019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b306f680 0x5651b3086dd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.385+0000 7f556df6b740 1 --2- 172.21.15.81:0/2296355019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b3064dc0 0x5651b3086890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.385+0000 7f556df6b740 1 --2- 172.21.15.81:0/2296355019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b30644a0 0x5651b307b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.386+0000 7f556df6b740 1 -- 172.21.15.81:0/2296355019 >> 172.21.15.81:0/2296355019 conn(0x5651b3060a30 msgr2=0x5651b3067900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:13.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.386+0000 7f556df6b740 1 -- 172.21.15.81:0/2296355019 shutdown_connections 2024-09-12T01:28:13.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.386+0000 7f556df6b740 1 -- 172.21.15.81:0/2296355019 wait complete. 2024-09-12T01:28:13.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.386+0000 7f556df6b740 1 -- start start 2024-09-12T01:28:13.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.386+0000 7f556df6b740 1 Processor -- start 2024-09-12T01:28:13.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556df6b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b30644a0 0x5651b3073630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556df6b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b3064dc0 0x5651b3073b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556df6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b306f680 0x5651b30740b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556df6b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f55641aec20 con 0x5651b3064dc0 2024-09-12T01:28:13.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556df6b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f55641ae550 con 0x5651b30644a0 2024-09-12T01:28:13.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556df6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f55641ab790 con 0x5651b306f680 2024-09-12T01:28:13.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556df6b740 10 client.0 _ll_register_callbacks cb 0x7f555400a560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:13.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556912d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b3064dc0 0x5651b3073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556a12f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b30644a0 0x5651b3073630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556a12f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b30644a0 0x5651b3073630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:54274/0 (socket says 172.21.15.81:54274) 2024-09-12T01:28:13.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556912d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b3064dc0 0x5651b3073b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41330/0 (socket says 172.21.15.81:41330) 2024-09-12T01:28:13.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556a12f640 1 -- 172.21.15.81:0/3064893261 learned_addr learned my addr 172.21.15.81:0/3064893261 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:13.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556a12f640 1 --2- 172.21.15.81:0/3064893261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b306f680 0x5651b30740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556912d640 1 -- 172.21.15.81:0/3064893261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b306f680 msgr2=0x5651b30740b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:13.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556912d640 1 --2- 172.21.15.81:0/3064893261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b306f680 0x5651b30740b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556912d640 1 -- 172.21.15.81:0/3064893261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b30644a0 msgr2=0x5651b3073630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:13.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556912d640 1 --2- 172.21.15.81:0/3064893261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b30644a0 0x5651b3073630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556912d640 1 -- 172.21.15.81:0/3064893261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651b30f1310 con 0x5651b3064dc0 2024-09-12T01:28:13.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.387+0000 7f556a12f640 1 --2- 172.21.15.81:0/3064893261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b30644a0 0x5651b3073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:13.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.388+0000 7f556912d640 1 --2- 172.21.15.81:0/3064893261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b3064dc0 0x5651b3073b70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x5651b306d950 tx=0x7f5554010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd83861b95a8ee46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:13.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.388+0000 7f554d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:13.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.388+0000 7f554d7fa640 1 -- 172.21.15.81:0/3064893261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554004220 con 0x5651b3064dc0 2024-09-12T01:28:13.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.388+0000 7f554d7fa640 1 -- 172.21.15.81:0/3064893261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f55540043c0 con 0x5651b3064dc0 2024-09-12T01:28:13.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.388+0000 7f556df6b740 1 -- 172.21.15.81:0/3064893261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f555c044920 con 0x5651b3064dc0 2024-09-12T01:28:13.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.388+0000 7f554d7fa640 1 -- 172.21.15.81:0/3064893261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f555400f970 con 0x5651b3064dc0 2024-09-12T01:28:13.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.388+0000 7f556df6b740 10 client.15414 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:13.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.388+0000 7f556df6b740 1 -- 172.21.15.81:0/3064893261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5651b30f2680 con 0x5651b3064dc0 2024-09-12T01:28:13.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.389+0000 7f554d7fa640 1 -- 172.21.15.81:0/3064893261 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55540035f0 con 0x5651b3064dc0 2024-09-12T01:28:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.389+0000 7f554d7fa640 1 -- 172.21.15.81:0/3064893261 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5554026470 con 0x5651b3064dc0 2024-09-12T01:28:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.389+0000 7f556df6b740 10 client.15414 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.389+0000 7f556df6b740 10 client.15414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:28:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.389+0000 7f556df6b740 20 client.15414 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.389+0000 7f556df6b740 1 --2- 172.21.15.81:0/3064893261 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5651b30f2e00 0x5651b30f5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.389+0000 7f556df6b740 4 client.15414 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:28:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.389+0000 7f556df6b740 1 -- 172.21.15.81:0/3064893261 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f555c044920 con 0x5651b30f2e00 2024-09-12T01:28:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.390+0000 7f556a12f640 1 --2- 172.21.15.81:0/3064893261 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5651b30f2e00 0x5651b30f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.390+0000 7f556a12f640 1 --2- 172.21.15.81:0/3064893261 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5651b30f2e00 0x5651b30f5220 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a21672605729c37 server_cookie=177a35dcd2e4029e in_seq=0 out_seq=0 2024-09-12T01:28:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.390+0000 7f554d7fa640 10 client.15414 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.390+0000 7f554d7fa640 1 -- 172.21.15.81:0/3064893261 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f555c044920 con 0x5651b30f2e00 2024-09-12T01:28:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.390+0000 7f554d7fa640 10 client.15414 handle_command_reply: tid=0 2024-09-12T01:28:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.390+0000 7f556df6b740 1 client.15414 shutdown 2024-09-12T01:28:13.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.391+0000 7f556df6b740 1 -- 172.21.15.81:0/3064893261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b3064dc0 msgr2=0x5651b3073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:13.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.391+0000 7f556df6b740 1 --2- 172.21.15.81:0/3064893261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b3064dc0 0x5651b3073b70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x5651b306d950 tx=0x7f5554010af0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.391+0000 7f556df6b740 1 -- 172.21.15.81:0/3064893261 shutdown_connections 2024-09-12T01:28:13.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.391+0000 7f556df6b740 1 --2- 172.21.15.81:0/3064893261 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5651b30f2e00 0x5651b30f5220 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.391+0000 7f556df6b740 1 --2- 172.21.15.81:0/3064893261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5651b306f680 0x5651b30740b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.391+0000 7f556df6b740 1 --2- 172.21.15.81:0/3064893261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5651b3064dc0 0x5651b3073b70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.391+0000 7f556df6b740 1 --2- 172.21.15.81:0/3064893261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651b30644a0 0x5651b3073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.391+0000 7f554d7fa640 0 client.15414 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:13.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.391+0000 7f556df6b740 1 -- 172.21.15.81:0/3064893261 >> 172.21.15.81:0/3064893261 conn(0x5651b3060a30 msgr2=0x5651b305f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:13.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.391+0000 7f556df6b740 1 -- 172.21.15.81:0/3064893261 shutdown_connections 2024-09-12T01:28:13.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.391+0000 7f556df6b740 1 -- 172.21.15.81:0/3064893261 wait complete. 2024-09-12T01:28:13.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.391+0000 7f556df6b740 20 client.15414 trim_cache size 0 max 16384 2024-09-12T01:28:13.404 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:28:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:28:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-12T01:28:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: "e9de0928-8f8c-4f0b-a5d8-247775fd9f3b": { 2024-09-12T01:28:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-09-12T01:28:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "e9de0928-8f8c-4f0b-a5d8-247775fd9f3b", 2024-09-12T01:28:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-12T01:28:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:28:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:28:13.404 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:28:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.392+0000 7f556bb92640 1 -- 172.21.15.81:0/4061831156 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f55500a2d80 msgr2=0x7f55500a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.392+0000 7f556bb92640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f55500a2d80 0x7f55500a5240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55600cce20 tx=0x7f556000a600 comp rx=0 tx=0).stop 2024-09-12T01:28:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.392+0000 7f556bb92640 1 -- 172.21.15.81:0/4061831156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5564102d30 msgr2=0x7f55641983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.392+0000 7f556bb92640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5564102d30 0x7f55641983a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f556000c920 tx=0x7f556000cde0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.392+0000 7f556bb92640 1 -- 172.21.15.81:0/4061831156 shutdown_connections 2024-09-12T01:28:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.392+0000 7f556bb92640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f55500a2d80 0x7f55500a5240 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.392+0000 7f556bb92640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f556410c160 0x7f556419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.392+0000 7f556bb92640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5564103650 0x7f55641988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.392+0000 7f556bb92640 1 --2- 172.21.15.81:0/4061831156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5564102d30 0x7f55641983a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.392+0000 7f556bb92640 1 -- 172.21.15.81:0/4061831156 >> 172.21.15.81:0/4061831156 conn(0x7f55640fc7d0 msgr2=0x7f55640fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.393+0000 7f556bb92640 1 -- 172.21.15.81:0/4061831156 shutdown_connections 2024-09-12T01:28:13.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:13.393+0000 7f556bb92640 1 -- 172.21.15.81:0/4061831156 wait complete. 2024-09-12T01:28:13.608 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:13 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:28:13.608 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:13 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:28:13.608 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:13 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:28:13.608 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:13 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:28:13.608 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:13 smithi081 ceph-mon[30920]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-12T01:28:13.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:13 smithi081 ceph-mon[30920]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:28:13.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:13 smithi081 ceph-mon[30920]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:28:13.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:13 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:28:13.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:13 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:28:13.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:13 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:28:13.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:13 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:28:13.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:13 smithi100 ceph-mon[35275]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-12T01:28:13.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:13 smithi100 ceph-mon[35275]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:28:13.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:13 smithi100 ceph-mon[35275]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:28:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:13 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:28:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:13 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:28:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:13 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:28:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:13 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:28:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:13 smithi189 ceph-mon[35357]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-12T01:28:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:13 smithi189 ceph-mon[35357]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:28:13.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:13 smithi189 ceph-mon[35357]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:28:14.038 INFO:tasks.cephfs.filesystem:scrub status for tag:e9de0928-8f8c-4f0b-a5d8-247775fd9f3b - {'path': '/', 'tag': 'e9de0928-8f8c-4f0b-a5d8-247775fd9f3b', 'options': 'recursive,force'} 2024-09-12T01:28:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.576+0000 7f4419947640 1 -- 172.21.15.81:0/3514351180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4414102d30 msgr2=0x7f4414103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.576+0000 7f4419947640 1 --2- 172.21.15.81:0/3514351180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4414102d30 0x7f4414103110 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4404009900 tx=0x7f440402a480 comp rx=0 tx=0).stop 2024-09-12T01:28:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.576+0000 7f4419947640 1 -- 172.21.15.81:0/3514351180 shutdown_connections 2024-09-12T01:28:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.576+0000 7f4419947640 1 --2- 172.21.15.81:0/3514351180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f441410c160 0x7f441410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.576+0000 7f4419947640 1 --2- 172.21.15.81:0/3514351180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4414103650 0x7f441410bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.576+0000 7f4419947640 1 --2- 172.21.15.81:0/3514351180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4414102d30 0x7f4414103110 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.577+0000 7f4419947640 1 -- 172.21.15.81:0/3514351180 >> 172.21.15.81:0/3514351180 conn(0x7f44140fc790 msgr2=0x7f44140febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.577+0000 7f4419947640 1 -- 172.21.15.81:0/3514351180 shutdown_connections 2024-09-12T01:28:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.577+0000 7f4419947640 1 -- 172.21.15.81:0/3514351180 wait complete. 2024-09-12T01:28:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.577+0000 7f4419947640 1 Processor -- start 2024-09-12T01:28:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.577+0000 7f4419947640 1 -- start start 2024-09-12T01:28:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.577+0000 7f4419947640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4414102d30 0x7f4414198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.577+0000 7f4419947640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4414103650 0x7f4414198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.577+0000 7f4419947640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441410c160 0x7f441419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f4419947640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4414111f60 con 0x7f441410c160 2024-09-12T01:28:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f4419947640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4414111de0 con 0x7f4414103650 2024-09-12T01:28:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f4419947640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f44141120e0 con 0x7f4414102d30 2024-09-12T01:28:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f44137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441410c160 0x7f441419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f44137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441410c160 0x7f441419cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41344/0 (socket says 172.21.15.81:41344) 2024-09-12T01:28:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f44137fe640 1 -- 172.21.15.81:0/866679843 learned_addr learned my addr 172.21.15.81:0/866679843 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f4412ffd640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4414102d30 0x7f4414198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f44127fc640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4414103650 0x7f4414198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f44137fe640 1 -- 172.21.15.81:0/866679843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4414102d30 msgr2=0x7f4414198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f44137fe640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4414102d30 0x7f4414198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f44137fe640 1 -- 172.21.15.81:0/866679843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4414103650 msgr2=0x7f4414198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f44137fe640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4414103650 0x7f4414198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f44137fe640 1 -- 172.21.15.81:0/866679843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441419d3f0 con 0x7f441410c160 2024-09-12T01:28:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f44137fe640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441410c160 0x7f441419cd10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f440c00cce0 tx=0x7f440c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f4418945640 1 -- 172.21.15.81:0/866679843 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c00f450 con 0x7f441410c160 2024-09-12T01:28:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f4418945640 1 -- 172.21.15.81:0/866679843 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f440c00fad0 con 0x7f441410c160 2024-09-12T01:28:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f4419947640 1 -- 172.21.15.81:0/866679843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441419d6e0 con 0x7f441410c160 2024-09-12T01:28:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f4418945640 1 -- 172.21.15.81:0/866679843 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c018c10 con 0x7f441410c160 2024-09-12T01:28:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.578+0000 7f4419947640 1 -- 172.21.15.81:0/866679843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44141a4fc0 con 0x7f441410c160 2024-09-12T01:28:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.580+0000 7f4419947640 1 -- 172.21.15.81:0/866679843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4414103110 con 0x7f441410c160 2024-09-12T01:28:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.581+0000 7f4418945640 1 -- 172.21.15.81:0/866679843 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f440c00f5f0 con 0x7f441410c160 2024-09-12T01:28:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.581+0000 7f4418945640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f43fc0a2d80 0x7f43fc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.581+0000 7f4412ffd640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f43fc0a2d80 0x7f43fc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.581+0000 7f4418945640 1 -- 172.21.15.81:0/866679843 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f440c0cfb40 con 0x7f441410c160 2024-09-12T01:28:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.582+0000 7f4412ffd640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f43fc0a2d80 0x7f43fc0a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4404009230 tx=0x7f44040058d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.586+0000 7f4418945640 1 -- 172.21.15.81:0/866679843 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f440c014030 con 0x7f441410c160 2024-09-12T01:28:14.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:14 smithi081 ceph-mon[30920]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:28:14.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:14 smithi081 ceph-mon[30920]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:28:14.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.750+0000 7f4419947640 1 -- 172.21.15.81:0/866679843 --> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4414062630 con 0x7f43fc0a2d80 2024-09-12T01:28:14.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.756+0000 7f4418945640 1 -- 172.21.15.81:0/866679843 <== mgr.15222 v2:172.21.15.81:6800/1379528564 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257789 (secure 0 0 0) 0x7f4414062630 con 0x7f43fc0a2d80 2024-09-12T01:28:14.759 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:14.760 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T01:28:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.759+0000 7f4419947640 1 -- 172.21.15.81:0/866679843 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f43fc0a2d80 msgr2=0x7f43fc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.759+0000 7f4419947640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f43fc0a2d80 0x7f43fc0a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4404009230 tx=0x7f44040058d0 comp rx=0 tx=0).stop 2024-09-12T01:28:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.759+0000 7f4419947640 1 -- 172.21.15.81:0/866679843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441410c160 msgr2=0x7f441419cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.759+0000 7f4419947640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441410c160 0x7f441419cd10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f440c00cce0 tx=0x7f440c00a620 comp rx=0 tx=0).stop 2024-09-12T01:28:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.759+0000 7f4419947640 1 -- 172.21.15.81:0/866679843 shutdown_connections 2024-09-12T01:28:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.759+0000 7f4419947640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f43fc0a2d80 0x7f43fc0a5240 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.759+0000 7f4419947640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f441410c160 0x7f441419cd10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.759+0000 7f4419947640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4414103650 0x7f4414198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.759+0000 7f4419947640 1 --2- 172.21.15.81:0/866679843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4414102d30 0x7f4414198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.759+0000 7f4419947640 1 -- 172.21.15.81:0/866679843 >> 172.21.15.81:0/866679843 conn(0x7f44140fc790 msgr2=0x7f44140fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.759+0000 7f4419947640 1 -- 172.21.15.81:0/866679843 shutdown_connections 2024-09-12T01:28:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:14.759+0000 7f4419947640 1 -- 172.21.15.81:0/866679843 wait complete. 2024-09-12T01:28:14.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:14 smithi100 ceph-mon[35275]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:28:14.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:14 smithi100 ceph-mon[35275]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:28:14.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:14 smithi189 ceph-mon[35357]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:28:14.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:14 smithi189 ceph-mon[35357]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:28:15.487 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-09-12T01:28:13.731491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191127,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1428,"num_read_kb":1042,"num_write":575,"num_write_kb":4402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180758,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":949,"ondisk_log_size":949,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380412,"kb_used_data":14496,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124561412,"statfs":{"total":1151940427776,"available":1151550885888,"internally_reserved":0,"allocated":14843904,"data_stored":8903529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":236,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.989232"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881117+0000","last_change":"2024-09-12T01:26:14.433907+0000","last_active":"2024-09-12T01:28:03.881117+0000","last_peered":"2024-09-12T01:28:03.881117+0000","last_clean":"2024-09-12T01:28:03.881117+0000","last_became_active":"2024-09-12T01:26:14.433495+0000","last_became_peered":"2024-09-12T01:26:14.433495+0000","last_unstale":"2024-09-12T01:28:03.881117+0000","last_undegraded":"2024-09-12T01:28:03.881117+0000","last_fullsized":"2024-09-12T01:28:03.881117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:12.836491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883125+0000","last_change":"2024-09-12T01:26:14.430873+0000","last_active":"2024-09-12T01:28:03.883125+0000","last_peered":"2024-09-12T01:28:03.883125+0000","last_clean":"2024-09-12T01:28:03.883125+0000","last_became_active":"2024-09-12T01:26:14.430572+0000","last_became_peered":"2024-09-12T01:26:14.430572+0000","last_unstale":"2024-09-12T01:28:03.883125+0000","last_undegraded":"2024-09-12T01:28:03.883125+0000","last_fullsized":"2024-09-12T01:28:03.883125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:15.160712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882818+0000","last_change":"2024-09-12T01:26:14.426117+0000","last_active":"2024-09-12T01:28:03.882818+0000","last_peered":"2024-09-12T01:28:03.882818+0000","last_clean":"2024-09-12T01:28:03.882818+0000","last_became_active":"2024-09-12T01:26:14.425831+0000","last_became_peered":"2024-09-12T01:26:14.425831+0000","last_unstale":"2024-09-12T01:28:03.882818+0000","last_undegraded":"2024-09-12T01:28:03.882818+0000","last_fullsized":"2024-09-12T01:28:03.882818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:15.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825114+0000","last_change":"2024-09-12T01:26:14.434545+0000","last_active":"2024-09-12T01:28:03.825114+0000","last_peered":"2024-09-12T01:28:03.825114+0000","last_clean":"2024-09-12T01:28:03.825114+0000","last_became_active":"2024-09-12T01:26:14.434222+0000","last_became_peered":"2024-09-12T01:26:14.434222+0000","last_unstale":"2024-09-12T01:28:03.825114+0000","last_undegraded":"2024-09-12T01:28:03.825114+0000","last_fullsized":"2024-09-12T01:28:03.825114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:36.789145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801925+0000","last_change":"2024-09-12T01:26:14.421900+0000","last_active":"2024-09-12T01:28:03.801925+0000","last_peered":"2024-09-12T01:28:03.801925+0000","last_clean":"2024-09-12T01:28:03.801925+0000","last_became_active":"2024-09-12T01:26:14.421558+0000","last_became_peered":"2024-09-12T01:26:14.421558+0000","last_unstale":"2024-09-12T01:28:03.801925+0000","last_undegraded":"2024-09-12T01:28:03.801925+0000","last_fullsized":"2024-09-12T01:28:03.801925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814207+0000","last_change":"2024-09-12T01:26:14.436641+0000","last_active":"2024-09-12T01:28:03.814207+0000","last_peered":"2024-09-12T01:28:03.814207+0000","last_clean":"2024-09-12T01:28:03.814207+0000","last_became_active":"2024-09-12T01:26:14.436347+0000","last_became_peered":"2024-09-12T01:26:14.436347+0000","last_unstale":"2024-09-12T01:28:03.814207+0000","last_undegraded":"2024-09-12T01:28:03.814207+0000","last_fullsized":"2024-09-12T01:28:03.814207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:52.756035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940185+0000","last_change":"2024-09-12T01:26:14.438676+0000","last_active":"2024-09-12T01:28:03.940185+0000","last_peered":"2024-09-12T01:28:03.940185+0000","last_clean":"2024-09-12T01:28:03.940185+0000","last_became_active":"2024-09-12T01:26:14.438332+0000","last_became_peered":"2024-09-12T01:26:14.438332+0000","last_unstale":"2024-09-12T01:28:03.940185+0000","last_undegraded":"2024-09-12T01:28:03.940185+0000","last_fullsized":"2024-09-12T01:28:03.940185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:06.459830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802047+0000","last_change":"2024-09-12T01:26:14.431676+0000","last_active":"2024-09-12T01:28:03.802047+0000","last_peered":"2024-09-12T01:28:03.802047+0000","last_clean":"2024-09-12T01:28:03.802047+0000","last_became_active":"2024-09-12T01:26:14.431378+0000","last_became_peered":"2024-09-12T01:26:14.431378+0000","last_unstale":"2024-09-12T01:28:03.802047+0000","last_undegraded":"2024-09-12T01:28:03.802047+0000","last_fullsized":"2024-09-12T01:28:03.802047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:23.523350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717979+0000","last_change":"2024-09-12T01:26:14.428381+0000","last_active":"2024-09-12T01:28:03.717979+0000","last_peered":"2024-09-12T01:28:03.717979+0000","last_clean":"2024-09-12T01:28:03.717979+0000","last_became_active":"2024-09-12T01:26:14.428031+0000","last_became_peered":"2024-09-12T01:26:14.428031+0000","last_unstale":"2024-09-12T01:28:03.717979+0000","last_undegraded":"2024-09-12T01:28:03.717979+0000","last_fullsized":"2024-09-12T01:28:03.717979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:40.920911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814620+0000","last_change":"2024-09-12T01:26:14.438849+0000","last_active":"2024-09-12T01:28:03.814620+0000","last_peered":"2024-09-12T01:28:03.814620+0000","last_clean":"2024-09-12T01:28:03.814620+0000","last_became_active":"2024-09-12T01:26:14.438510+0000","last_became_peered":"2024-09-12T01:26:14.438510+0000","last_unstale":"2024-09-12T01:28:03.814620+0000","last_undegraded":"2024-09-12T01:28:03.814620+0000","last_fullsized":"2024-09-12T01:28:03.814620+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:12.257292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940484+0000","last_change":"2024-09-12T01:26:14.436468+0000","last_active":"2024-09-12T01:28:03.940484+0000","last_peered":"2024-09-12T01:28:03.940484+0000","last_clean":"2024-09-12T01:28:03.940484+0000","last_became_active":"2024-09-12T01:26:14.436095+0000","last_became_peered":"2024-09-12T01:26:14.436095+0000","last_unstale":"2024-09-12T01:28:03.940484+0000","last_undegraded":"2024-09-12T01:28:03.940484+0000","last_fullsized":"2024-09-12T01:28:03.940484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:43.441358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825119+0000","last_change":"2024-09-12T01:26:14.431384+0000","last_active":"2024-09-12T01:28:03.825119+0000","last_peered":"2024-09-12T01:28:03.825119+0000","last_clean":"2024-09-12T01:28:03.825119+0000","last_became_active":"2024-09-12T01:26:14.431079+0000","last_became_peered":"2024-09-12T01:26:14.431079+0000","last_unstale":"2024-09-12T01:28:03.825119+0000","last_undegraded":"2024-09-12T01:28:03.825119+0000","last_fullsized":"2024-09-12T01:28:03.825119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.178038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882393+0000","last_change":"2024-09-12T01:26:14.430163+0000","last_active":"2024-09-12T01:28:03.882393+0000","last_peered":"2024-09-12T01:28:03.882393+0000","last_clean":"2024-09-12T01:28:03.882393+0000","last_became_active":"2024-09-12T01:26:14.429863+0000","last_became_peered":"2024-09-12T01:26:14.429863+0000","last_unstale":"2024-09-12T01:28:03.882393+0000","last_undegraded":"2024-09-12T01:28:03.882393+0000","last_fullsized":"2024-09-12T01:28:03.882393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:44.432677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882103+0000","last_change":"2024-09-12T01:26:14.427304+0000","last_active":"2024-09-12T01:28:03.882103+0000","last_peered":"2024-09-12T01:28:03.882103+0000","last_clean":"2024-09-12T01:28:03.882103+0000","last_became_active":"2024-09-12T01:26:14.427006+0000","last_became_peered":"2024-09-12T01:26:14.427006+0000","last_unstale":"2024-09-12T01:28:03.882103+0000","last_undegraded":"2024-09-12T01:28:03.882103+0000","last_fullsized":"2024-09-12T01:28:03.882103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.930959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881815+0000","last_change":"2024-09-12T01:26:14.431018+0000","last_active":"2024-09-12T01:28:03.881815+0000","last_peered":"2024-09-12T01:28:03.881815+0000","last_clean":"2024-09-12T01:28:03.881815+0000","last_became_active":"2024-09-12T01:26:14.429518+0000","last_became_peered":"2024-09-12T01:26:14.429518+0000","last_unstale":"2024-09-12T01:28:03.881815+0000","last_undegraded":"2024-09-12T01:28:03.881815+0000","last_fullsized":"2024-09-12T01:28:03.881815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.504814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717400+0000","last_change":"2024-09-12T01:26:14.430601+0000","last_active":"2024-09-12T01:28:03.717400+0000","last_peered":"2024-09-12T01:28:03.717400+0000","last_clean":"2024-09-12T01:28:03.717400+0000","last_became_active":"2024-09-12T01:26:14.430304+0000","last_became_peered":"2024-09-12T01:26:14.430304+0000","last_unstale":"2024-09-12T01:28:03.717400+0000","last_undegraded":"2024-09-12T01:28:03.717400+0000","last_fullsized":"2024-09-12T01:28:03.717400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.414767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881148+0000","last_change":"2024-09-12T01:26:14.432934+0000","last_active":"2024-09-12T01:28:03.881148+0000","last_peered":"2024-09-12T01:28:03.881148+0000","last_clean":"2024-09-12T01:28:03.881148+0000","last_became_active":"2024-09-12T01:26:14.432417+0000","last_became_peered":"2024-09-12T01:26:14.432417+0000","last_unstale":"2024-09-12T01:28:03.881148+0000","last_undegraded":"2024-09-12T01:28:03.881148+0000","last_fullsized":"2024-09-12T01:28:03.881148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.964880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716779+0000","last_change":"2024-09-12T01:26:14.429956+0000","last_active":"2024-09-12T01:28:03.716779+0000","last_peered":"2024-09-12T01:28:03.716779+0000","last_clean":"2024-09-12T01:28:03.716779+0000","last_became_active":"2024-09-12T01:26:14.429610+0000","last_became_peered":"2024-09-12T01:26:14.429610+0000","last_unstale":"2024-09-12T01:28:03.716779+0000","last_undegraded":"2024-09-12T01:28:03.716779+0000","last_fullsized":"2024-09-12T01:28:03.716779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:51.453221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720646+0000","last_change":"2024-09-12T01:26:14.423624+0000","last_active":"2024-09-12T01:28:03.720646+0000","last_peered":"2024-09-12T01:28:03.720646+0000","last_clean":"2024-09-12T01:28:03.720646+0000","last_became_active":"2024-09-12T01:26:14.423314+0000","last_became_peered":"2024-09-12T01:26:14.423314+0000","last_unstale":"2024-09-12T01:28:03.720646+0000","last_undegraded":"2024-09-12T01:28:03.720646+0000","last_fullsized":"2024-09-12T01:28:03.720646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.414323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880810+0000","last_change":"2024-09-12T01:26:14.433548+0000","last_active":"2024-09-12T01:28:03.880810+0000","last_peered":"2024-09-12T01:28:03.880810+0000","last_clean":"2024-09-12T01:28:03.880810+0000","last_became_active":"2024-09-12T01:26:14.433223+0000","last_became_peered":"2024-09-12T01:26:14.433223+0000","last_unstale":"2024-09-12T01:28:03.880810+0000","last_undegraded":"2024-09-12T01:28:03.880810+0000","last_fullsized":"2024-09-12T01:28:03.880810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.247354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882535+0000","last_change":"2024-09-12T01:26:14.431715+0000","last_active":"2024-09-12T01:28:03.882535+0000","last_peered":"2024-09-12T01:28:03.882535+0000","last_clean":"2024-09-12T01:28:03.882535+0000","last_became_active":"2024-09-12T01:26:14.430839+0000","last_became_peered":"2024-09-12T01:26:14.430839+0000","last_unstale":"2024-09-12T01:28:03.882535+0000","last_undegraded":"2024-09-12T01:28:03.882535+0000","last_fullsized":"2024-09-12T01:28:03.882535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:04.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717611+0000","last_change":"2024-09-12T01:26:14.431385+0000","last_active":"2024-09-12T01:28:03.717611+0000","last_peered":"2024-09-12T01:28:03.717611+0000","last_clean":"2024-09-12T01:28:03.717611+0000","last_became_active":"2024-09-12T01:26:14.431046+0000","last_became_peered":"2024-09-12T01:26:14.431046+0000","last_unstale":"2024-09-12T01:28:03.717611+0000","last_undegraded":"2024-09-12T01:28:03.717611+0000","last_fullsized":"2024-09-12T01:28:03.717611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:42.495019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802146+0000","last_change":"2024-09-12T01:26:14.427737+0000","last_active":"2024-09-12T01:28:03.802146+0000","last_peered":"2024-09-12T01:28:03.802146+0000","last_clean":"2024-09-12T01:28:03.802146+0000","last_became_active":"2024-09-12T01:26:14.427409+0000","last_became_peered":"2024-09-12T01:26:14.427409+0000","last_unstale":"2024-09-12T01:28:03.802146+0000","last_undegraded":"2024-09-12T01:28:03.802146+0000","last_fullsized":"2024-09-12T01:28:03.802146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:02.632914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811345+0000","last_change":"2024-09-12T01:26:14.433426+0000","last_active":"2024-09-12T01:28:03.811345+0000","last_peered":"2024-09-12T01:28:03.811345+0000","last_clean":"2024-09-12T01:28:03.811345+0000","last_became_active":"2024-09-12T01:26:14.431918+0000","last_became_peered":"2024-09-12T01:26:14.431918+0000","last_unstale":"2024-09-12T01:28:03.811345+0000","last_undegraded":"2024-09-12T01:28:03.811345+0000","last_fullsized":"2024-09-12T01:28:03.811345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.946072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716825+0000","last_change":"2024-09-12T01:26:26.268358+0000","last_active":"2024-09-12T01:28:03.716825+0000","last_peered":"2024-09-12T01:28:03.716825+0000","last_clean":"2024-09-12T01:28:03.716825+0000","last_became_active":"2024-09-12T01:26:26.268005+0000","last_became_peered":"2024-09-12T01:26:26.268005+0000","last_unstale":"2024-09-12T01:28:03.716825+0000","last_undegraded":"2024-09-12T01:28:03.716825+0000","last_fullsized":"2024-09-12T01:28:03.716825+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:53.977249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720710+0000","last_change":"2024-09-12T01:26:14.434536+0000","last_active":"2024-09-12T01:28:03.720710+0000","last_peered":"2024-09-12T01:28:03.720710+0000","last_clean":"2024-09-12T01:28:03.720710+0000","last_became_active":"2024-09-12T01:26:14.434148+0000","last_became_peered":"2024-09-12T01:26:14.434148+0000","last_unstale":"2024-09-12T01:28:03.720710+0000","last_undegraded":"2024-09-12T01:28:03.720710+0000","last_fullsized":"2024-09-12T01:28:03.720710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:47.576827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880923+0000","last_change":"2024-09-12T01:26:14.428040+0000","last_active":"2024-09-12T01:28:03.880923+0000","last_peered":"2024-09-12T01:28:03.880923+0000","last_clean":"2024-09-12T01:28:03.880923+0000","last_became_active":"2024-09-12T01:26:14.427709+0000","last_became_peered":"2024-09-12T01:26:14.427709+0000","last_unstale":"2024-09-12T01:28:03.880923+0000","last_undegraded":"2024-09-12T01:28:03.880923+0000","last_fullsized":"2024-09-12T01:28:03.880923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.256097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882750+0000","last_change":"2024-09-12T01:26:26.265649+0000","last_active":"2024-09-12T01:28:03.882750+0000","last_peered":"2024-09-12T01:28:03.882750+0000","last_clean":"2024-09-12T01:28:03.882750+0000","last_became_active":"2024-09-12T01:26:26.265251+0000","last_became_peered":"2024-09-12T01:26:26.265251+0000","last_unstale":"2024-09-12T01:28:03.882750+0000","last_undegraded":"2024-09-12T01:28:03.882750+0000","last_fullsized":"2024-09-12T01:28:03.882750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:31.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882448+0000","last_change":"2024-09-12T01:26:14.427596+0000","last_active":"2024-09-12T01:28:03.882448+0000","last_peered":"2024-09-12T01:28:03.882448+0000","last_clean":"2024-09-12T01:28:03.882448+0000","last_became_active":"2024-09-12T01:26:14.427291+0000","last_became_peered":"2024-09-12T01:26:14.427291+0000","last_unstale":"2024-09-12T01:28:03.882448+0000","last_undegraded":"2024-09-12T01:28:03.882448+0000","last_fullsized":"2024-09-12T01:28:03.882448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:51.529835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720369+0000","last_change":"2024-09-12T01:26:14.424197+0000","last_active":"2024-09-12T01:28:03.720369+0000","last_peered":"2024-09-12T01:28:03.720369+0000","last_clean":"2024-09-12T01:28:03.720369+0000","last_became_active":"2024-09-12T01:26:14.423422+0000","last_became_peered":"2024-09-12T01:26:14.423422+0000","last_unstale":"2024-09-12T01:28:03.720369+0000","last_undegraded":"2024-09-12T01:28:03.720369+0000","last_fullsized":"2024-09-12T01:28:03.720369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.725623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720421+0000","last_change":"2024-09-12T01:26:14.428116+0000","last_active":"2024-09-12T01:28:03.720421+0000","last_peered":"2024-09-12T01:28:03.720421+0000","last_clean":"2024-09-12T01:28:03.720421+0000","last_became_active":"2024-09-12T01:26:14.427804+0000","last_became_peered":"2024-09-12T01:26:14.427804+0000","last_unstale":"2024-09-12T01:28:03.720421+0000","last_undegraded":"2024-09-12T01:28:03.720421+0000","last_fullsized":"2024-09-12T01:28:03.720421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:02.271305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880755+0000","last_change":"2024-09-12T01:26:14.432659+0000","last_active":"2024-09-12T01:28:03.880755+0000","last_peered":"2024-09-12T01:28:03.880755+0000","last_clean":"2024-09-12T01:28:03.880755+0000","last_became_active":"2024-09-12T01:26:14.432331+0000","last_became_peered":"2024-09-12T01:26:14.432331+0000","last_unstale":"2024-09-12T01:28:03.880755+0000","last_undegraded":"2024-09-12T01:28:03.880755+0000","last_fullsized":"2024-09-12T01:28:03.880755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.868909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801888+0000","last_change":"2024-09-12T01:26:14.426167+0000","last_active":"2024-09-12T01:28:03.801888+0000","last_peered":"2024-09-12T01:28:03.801888+0000","last_clean":"2024-09-12T01:28:03.801888+0000","last_became_active":"2024-09-12T01:26:14.425847+0000","last_became_peered":"2024-09-12T01:26:14.425847+0000","last_unstale":"2024-09-12T01:28:03.801888+0000","last_undegraded":"2024-09-12T01:28:03.801888+0000","last_fullsized":"2024-09-12T01:28:03.801888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:39.481527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":139,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:08.404410+0000","last_change":"2024-09-12T01:26:12.421487+0000","last_active":"2024-09-12T01:28:08.404410+0000","last_peered":"2024-09-12T01:28:08.404410+0000","last_clean":"2024-09-12T01:28:08.404410+0000","last_became_active":"2024-09-12T01:26:12.421096+0000","last_became_peered":"2024-09-12T01:26:12.421096+0000","last_unstale":"2024-09-12T01:28:08.404410+0000","last_undegraded":"2024-09-12T01:28:08.404410+0000","last_fullsized":"2024-09-12T01:28:08.404410+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:12.410280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811514+0000","last_change":"2024-09-12T01:26:26.270310+0000","last_active":"2024-09-12T01:28:03.811514+0000","last_peered":"2024-09-12T01:28:03.811514+0000","last_clean":"2024-09-12T01:28:03.811514+0000","last_became_active":"2024-09-12T01:26:26.269917+0000","last_became_peered":"2024-09-12T01:26:26.269917+0000","last_unstale":"2024-09-12T01:28:03.811514+0000","last_undegraded":"2024-09-12T01:28:03.811514+0000","last_fullsized":"2024-09-12T01:28:03.811514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:29.549456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814260+0000","last_change":"2024-09-12T01:26:26.287218+0000","last_active":"2024-09-12T01:28:03.814260+0000","last_peered":"2024-09-12T01:28:03.814260+0000","last_clean":"2024-09-12T01:28:03.814260+0000","last_became_active":"2024-09-12T01:26:26.282251+0000","last_became_peered":"2024-09-12T01:26:26.282251+0000","last_unstale":"2024-09-12T01:28:03.814260+0000","last_undegraded":"2024-09-12T01:28:03.814260+0000","last_fullsized":"2024-09-12T01:28:03.814260+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:53.888064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883469+0000","last_change":"2024-09-12T01:26:12.416100+0000","last_active":"2024-09-12T01:28:03.883469+0000","last_peered":"2024-09-12T01:28:03.883469+0000","last_clean":"2024-09-12T01:28:03.883469+0000","last_became_active":"2024-09-12T01:26:12.415799+0000","last_became_peered":"2024-09-12T01:26:12.415799+0000","last_unstale":"2024-09-12T01:28:03.883469+0000","last_undegraded":"2024-09-12T01:28:03.883469+0000","last_fullsized":"2024-09-12T01:28:03.883469+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:41.826537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802089+0000","last_change":"2024-09-12T01:26:14.424922+0000","last_active":"2024-09-12T01:28:03.802089+0000","last_peered":"2024-09-12T01:28:03.802089+0000","last_clean":"2024-09-12T01:28:03.802089+0000","last_became_active":"2024-09-12T01:26:14.424580+0000","last_became_peered":"2024-09-12T01:26:14.424580+0000","last_unstale":"2024-09-12T01:28:03.802089+0000","last_undegraded":"2024-09-12T01:28:03.802089+0000","last_fullsized":"2024-09-12T01:28:03.802089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:05.697287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811489+0000","last_change":"2024-09-12T01:26:12.419339+0000","last_active":"2024-09-12T01:28:03.811489+0000","last_peered":"2024-09-12T01:28:03.811489+0000","last_clean":"2024-09-12T01:28:03.811489+0000","last_became_active":"2024-09-12T01:26:12.418925+0000","last_became_peered":"2024-09-12T01:26:12.418925+0000","last_unstale":"2024-09-12T01:28:03.811489+0000","last_undegraded":"2024-09-12T01:28:03.811489+0000","last_fullsized":"2024-09-12T01:28:03.811489+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.390691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716540+0000","last_change":"2024-09-12T01:26:14.426611+0000","last_active":"2024-09-12T01:28:03.716540+0000","last_peered":"2024-09-12T01:28:03.716540+0000","last_clean":"2024-09-12T01:28:03.716540+0000","last_became_active":"2024-09-12T01:26:14.426268+0000","last_became_peered":"2024-09-12T01:26:14.426268+0000","last_unstale":"2024-09-12T01:28:03.716540+0000","last_undegraded":"2024-09-12T01:28:03.716540+0000","last_fullsized":"2024-09-12T01:28:03.716540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:34.676841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":240,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:09.405143+0000","last_change":"2024-09-12T01:26:12.420302+0000","last_active":"2024-09-12T01:28:09.405143+0000","last_peered":"2024-09-12T01:28:09.405143+0000","last_clean":"2024-09-12T01:28:09.405143+0000","last_became_active":"2024-09-12T01:26:12.419943+0000","last_became_peered":"2024-09-12T01:26:12.419943+0000","last_unstale":"2024-09-12T01:28:09.405143+0000","last_undegraded":"2024-09-12T01:28:09.405143+0000","last_fullsized":"2024-09-12T01:28:09.405143+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:30.704272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":210,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717828+0000","last_change":"2024-09-12T01:26:14.433112+0000","last_active":"2024-09-12T01:28:03.717828+0000","last_peered":"2024-09-12T01:28:03.717828+0000","last_clean":"2024-09-12T01:28:03.717828+0000","last_became_active":"2024-09-12T01:26:14.432803+0000","last_became_peered":"2024-09-12T01:26:14.432803+0000","last_unstale":"2024-09-12T01:28:03.717828+0000","last_undegraded":"2024-09-12T01:28:03.717828+0000","last_fullsized":"2024-09-12T01:28:03.717828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:33.670485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940319+0000","last_change":"2024-09-12T01:26:12.424854+0000","last_active":"2024-09-12T01:28:03.940319+0000","last_peered":"2024-09-12T01:28:03.940319+0000","last_clean":"2024-09-12T01:28:03.940319+0000","last_became_active":"2024-09-12T01:26:12.424476+0000","last_became_peered":"2024-09-12T01:26:12.424476+0000","last_unstale":"2024-09-12T01:28:03.940319+0000","last_undegraded":"2024-09-12T01:28:03.940319+0000","last_fullsized":"2024-09-12T01:28:03.940319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:03.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883795+0000","last_change":"2024-09-12T01:26:14.431580+0000","last_active":"2024-09-12T01:28:03.883795+0000","last_peered":"2024-09-12T01:28:03.883795+0000","last_clean":"2024-09-12T01:28:03.883795+0000","last_became_active":"2024-09-12T01:26:14.431237+0000","last_became_peered":"2024-09-12T01:26:14.431237+0000","last_unstale":"2024-09-12T01:28:03.883795+0000","last_undegraded":"2024-09-12T01:28:03.883795+0000","last_fullsized":"2024-09-12T01:28:03.883795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:32.562156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811710+0000","last_change":"2024-09-12T01:26:12.802015+0000","last_active":"2024-09-12T01:28:03.811710+0000","last_peered":"2024-09-12T01:28:03.811710+0000","last_clean":"2024-09-12T01:28:03.811710+0000","last_became_active":"2024-09-12T01:26:12.801605+0000","last_became_peered":"2024-09-12T01:26:12.801605+0000","last_unstale":"2024-09-12T01:28:03.811710+0000","last_undegraded":"2024-09-12T01:28:03.811710+0000","last_fullsized":"2024-09-12T01:28:03.811710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:24.703911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717615+0000","last_change":"2024-09-12T01:26:14.433305+0000","last_active":"2024-09-12T01:28:03.717615+0000","last_peered":"2024-09-12T01:28:03.717615+0000","last_clean":"2024-09-12T01:28:03.717615+0000","last_became_active":"2024-09-12T01:26:14.432989+0000","last_became_peered":"2024-09-12T01:26:14.432989+0000","last_unstale":"2024-09-12T01:28:03.717615+0000","last_undegraded":"2024-09-12T01:28:03.717615+0000","last_fullsized":"2024-09-12T01:28:03.717615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:45.741460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":283,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:09.405172+0000","last_change":"2024-09-12T01:26:12.423148+0000","last_active":"2024-09-12T01:28:09.405172+0000","last_peered":"2024-09-12T01:28:09.405172+0000","last_clean":"2024-09-12T01:28:09.405172+0000","last_became_active":"2024-09-12T01:26:12.422754+0000","last_became_peered":"2024-09-12T01:26:12.422754+0000","last_unstale":"2024-09-12T01:28:09.405172+0000","last_undegraded":"2024-09-12T01:28:09.405172+0000","last_fullsized":"2024-09-12T01:28:09.405172+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:01.017125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":177,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802221+0000","last_change":"2024-09-12T01:26:14.431568+0000","last_active":"2024-09-12T01:28:03.802221+0000","last_peered":"2024-09-12T01:28:03.802221+0000","last_clean":"2024-09-12T01:28:03.802221+0000","last_became_active":"2024-09-12T01:26:14.431215+0000","last_became_peered":"2024-09-12T01:26:14.431215+0000","last_unstale":"2024-09-12T01:28:03.802221+0000","last_undegraded":"2024-09-12T01:28:03.802221+0000","last_fullsized":"2024-09-12T01:28:03.802221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.552147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720527+0000","last_change":"2024-09-12T01:26:12.421986+0000","last_active":"2024-09-12T01:28:03.720527+0000","last_peered":"2024-09-12T01:28:03.720527+0000","last_clean":"2024-09-12T01:28:03.720527+0000","last_became_active":"2024-09-12T01:26:12.421391+0000","last_became_peered":"2024-09-12T01:26:12.421391+0000","last_unstale":"2024-09-12T01:28:03.720527+0000","last_undegraded":"2024-09-12T01:28:03.720527+0000","last_fullsized":"2024-09-12T01:28:03.720527+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:20.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881940+0000","last_change":"2024-09-12T01:26:14.431435+0000","last_active":"2024-09-12T01:28:03.881940+0000","last_peered":"2024-09-12T01:28:03.881940+0000","last_clean":"2024-09-12T01:28:03.881940+0000","last_became_active":"2024-09-12T01:26:14.431143+0000","last_became_peered":"2024-09-12T01:26:14.431143+0000","last_unstale":"2024-09-12T01:28:03.881940+0000","last_undegraded":"2024-09-12T01:28:03.881940+0000","last_fullsized":"2024-09-12T01:28:03.881940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:58.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811440+0000","last_change":"2024-09-12T01:26:12.423972+0000","last_active":"2024-09-12T01:28:03.811440+0000","last_peered":"2024-09-12T01:28:03.811440+0000","last_clean":"2024-09-12T01:28:03.811440+0000","last_became_active":"2024-09-12T01:26:12.423594+0000","last_became_peered":"2024-09-12T01:26:12.423594+0000","last_unstale":"2024-09-12T01:28:03.811440+0000","last_undegraded":"2024-09-12T01:28:03.811440+0000","last_fullsized":"2024-09-12T01:28:03.811440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:37.783478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940307+0000","last_change":"2024-09-12T01:26:14.437207+0000","last_active":"2024-09-12T01:28:03.940307+0000","last_peered":"2024-09-12T01:28:03.940307+0000","last_clean":"2024-09-12T01:28:03.940307+0000","last_became_active":"2024-09-12T01:26:14.436940+0000","last_became_peered":"2024-09-12T01:26:14.436940+0000","last_unstale":"2024-09-12T01:28:03.940307+0000","last_undegraded":"2024-09-12T01:28:03.940307+0000","last_fullsized":"2024-09-12T01:28:03.940307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:34.454446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'9","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:08.406537+0000","last_change":"2024-09-12T01:26:12.420247+0000","last_active":"2024-09-12T01:28:08.406537+0000","last_peered":"2024-09-12T01:28:08.406537+0000","last_clean":"2024-09-12T01:28:08.406537+0000","last_became_active":"2024-09-12T01:26:12.419825+0000","last_became_peered":"2024-09-12T01:26:12.419825+0000","last_unstale":"2024-09-12T01:28:08.406537+0000","last_undegraded":"2024-09-12T01:28:08.406537+0000","last_fullsized":"2024-09-12T01:28:08.406537+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:26.746225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":6,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940127+0000","last_change":"2024-09-12T01:26:14.439019+0000","last_active":"2024-09-12T01:28:03.940127+0000","last_peered":"2024-09-12T01:28:03.940127+0000","last_clean":"2024-09-12T01:28:03.940127+0000","last_became_active":"2024-09-12T01:26:14.438714+0000","last_became_peered":"2024-09-12T01:26:14.438714+0000","last_unstale":"2024-09-12T01:28:03.940127+0000","last_undegraded":"2024-09-12T01:28:03.940127+0000","last_fullsized":"2024-09-12T01:28:03.940127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.321464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801873+0000","last_change":"2024-09-12T01:26:12.800529+0000","last_active":"2024-09-12T01:28:03.801873+0000","last_peered":"2024-09-12T01:28:03.801873+0000","last_clean":"2024-09-12T01:28:03.801873+0000","last_became_active":"2024-09-12T01:26:12.800104+0000","last_became_peered":"2024-09-12T01:26:12.800104+0000","last_unstale":"2024-09-12T01:28:03.801873+0000","last_undegraded":"2024-09-12T01:28:03.801873+0000","last_fullsized":"2024-09-12T01:28:03.801873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.624321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811417+0000","last_change":"2024-09-12T01:26:14.435283+0000","last_active":"2024-09-12T01:28:03.811417+0000","last_peered":"2024-09-12T01:28:03.811417+0000","last_clean":"2024-09-12T01:28:03.811417+0000","last_became_active":"2024-09-12T01:26:14.434414+0000","last_became_peered":"2024-09-12T01:26:14.434414+0000","last_unstale":"2024-09-12T01:28:03.811417+0000","last_undegraded":"2024-09-12T01:28:03.811417+0000","last_fullsized":"2024-09-12T01:28:03.811417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.959405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'3","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881086+0000","last_change":"2024-09-12T01:26:26.273053+0000","last_active":"2024-09-12T01:28:03.881086+0000","last_peered":"2024-09-12T01:28:03.881086+0000","last_clean":"2024-09-12T01:28:03.881086+0000","last_became_active":"2024-09-12T01:26:26.267178+0000","last_became_peered":"2024-09-12T01:26:26.267178+0000","last_unstale":"2024-09-12T01:28:03.881086+0000","last_undegraded":"2024-09-12T01:28:03.881086+0000","last_fullsized":"2024-09-12T01:28:03.881086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:08.138485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880948+0000","last_change":"2024-09-12T01:26:14.433527+0000","last_active":"2024-09-12T01:28:03.880948+0000","last_peered":"2024-09-12T01:28:03.880948+0000","last_clean":"2024-09-12T01:28:03.880948+0000","last_became_active":"2024-09-12T01:26:14.433204+0000","last_became_peered":"2024-09-12T01:26:14.433204+0000","last_unstale":"2024-09-12T01:28:03.880948+0000","last_undegraded":"2024-09-12T01:28:03.880948+0000","last_fullsized":"2024-09-12T01:28:03.880948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:26.883916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883147+0000","last_change":"2024-09-12T01:26:12.420795+0000","last_active":"2024-09-12T01:28:03.883147+0000","last_peered":"2024-09-12T01:28:03.883147+0000","last_clean":"2024-09-12T01:28:03.883147+0000","last_became_active":"2024-09-12T01:26:12.420409+0000","last_became_peered":"2024-09-12T01:26:12.420409+0000","last_unstale":"2024-09-12T01:28:03.883147+0000","last_undegraded":"2024-09-12T01:28:03.883147+0000","last_fullsized":"2024-09-12T01:28:03.883147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:36.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940454+0000","last_change":"2024-09-12T01:26:14.440994+0000","last_active":"2024-09-12T01:28:03.940454+0000","last_peered":"2024-09-12T01:28:03.940454+0000","last_clean":"2024-09-12T01:28:03.940454+0000","last_became_active":"2024-09-12T01:26:14.440602+0000","last_became_peered":"2024-09-12T01:26:14.440602+0000","last_unstale":"2024-09-12T01:28:03.940454+0000","last_undegraded":"2024-09-12T01:28:03.940454+0000","last_fullsized":"2024-09-12T01:28:03.940454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.998991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'41","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.934193+0000","last_change":"2024-09-12T01:26:12.419448+0000","last_active":"2024-09-12T01:28:03.934193+0000","last_peered":"2024-09-12T01:28:03.934193+0000","last_clean":"2024-09-12T01:28:03.934193+0000","last_became_active":"2024-09-12T01:26:12.419000+0000","last_became_peered":"2024-09-12T01:26:12.419000+0000","last_unstale":"2024-09-12T01:28:03.934193+0000","last_undegraded":"2024-09-12T01:28:03.934193+0000","last_fullsized":"2024-09-12T01:28:03.934193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:37.818833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940268+0000","last_change":"2024-09-12T01:26:14.437818+0000","last_active":"2024-09-12T01:28:03.940268+0000","last_peered":"2024-09-12T01:28:03.940268+0000","last_clean":"2024-09-12T01:28:03.940268+0000","last_became_active":"2024-09-12T01:26:14.437497+0000","last_became_peered":"2024-09-12T01:26:14.437497+0000","last_unstale":"2024-09-12T01:28:03.940268+0000","last_undegraded":"2024-09-12T01:28:03.940268+0000","last_fullsized":"2024-09-12T01:28:03.940268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:57.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'7","reported_seq":139,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:08.669226+0000","last_change":"2024-09-12T01:26:12.855850+0000","last_active":"2024-09-12T01:28:08.669226+0000","last_peered":"2024-09-12T01:28:08.669226+0000","last_clean":"2024-09-12T01:28:08.669226+0000","last_became_active":"2024-09-12T01:26:12.855400+0000","last_became_peered":"2024-09-12T01:26:12.855400+0000","last_unstale":"2024-09-12T01:28:08.669226+0000","last_undegraded":"2024-09-12T01:28:08.669226+0000","last_fullsized":"2024-09-12T01:28:08.669226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:32.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940460+0000","last_change":"2024-09-12T01:26:14.435982+0000","last_active":"2024-09-12T01:28:03.940460+0000","last_peered":"2024-09-12T01:28:03.940460+0000","last_clean":"2024-09-12T01:28:03.940460+0000","last_became_active":"2024-09-12T01:26:14.435595+0000","last_became_peered":"2024-09-12T01:26:14.435595+0000","last_unstale":"2024-09-12T01:28:03.940460+0000","last_undegraded":"2024-09-12T01:28:03.940460+0000","last_fullsized":"2024-09-12T01:28:03.940460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:31.101890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"83'148","reported_seq":390,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:05.821001+0000","last_change":"2024-09-12T01:25:04.588449+0000","last_active":"2024-09-12T01:28:05.821001+0000","last_peered":"2024-09-12T01:28:05.821001+0000","last_clean":"2024-09-12T01:28:05.821001+0000","last_became_active":"2024-09-12T01:25:04.587949+0000","last_became_peered":"2024-09-12T01:25:04.587949+0000","last_unstale":"2024-09-12T01:28:05.821001+0000","last_undegraded":"2024-09-12T01:28:05.821001+0000","last_fullsized":"2024-09-12T01:28:05.821001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_clean_scrub_stamp":"2024-09-12T01:21:41.345624+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:41.015289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825092+0000","last_change":"2024-09-12T01:26:12.421379+0000","last_active":"2024-09-12T01:28:03.825092+0000","last_peered":"2024-09-12T01:28:03.825092+0000","last_clean":"2024-09-12T01:28:03.825092+0000","last_became_active":"2024-09-12T01:26:12.421059+0000","last_became_peered":"2024-09-12T01:26:12.421059+0000","last_unstale":"2024-09-12T01:28:03.825092+0000","last_undegraded":"2024-09-12T01:28:03.825092+0000","last_fullsized":"2024-09-12T01:28:03.825092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802270+0000","last_change":"2024-09-12T01:26:14.430510+0000","last_active":"2024-09-12T01:28:03.802270+0000","last_peered":"2024-09-12T01:28:03.802270+0000","last_clean":"2024-09-12T01:28:03.802270+0000","last_became_active":"2024-09-12T01:26:14.430232+0000","last_became_peered":"2024-09-12T01:26:14.430232+0000","last_unstale":"2024-09-12T01:28:03.802270+0000","last_undegraded":"2024-09-12T01:28:03.802270+0000","last_fullsized":"2024-09-12T01:28:03.802270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:55.114616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940253+0000","last_change":"2024-09-12T01:26:12.420938+0000","last_active":"2024-09-12T01:28:03.940253+0000","last_peered":"2024-09-12T01:28:03.940253+0000","last_clean":"2024-09-12T01:28:03.940253+0000","last_became_active":"2024-09-12T01:26:12.420599+0000","last_became_peered":"2024-09-12T01:26:12.420599+0000","last_unstale":"2024-09-12T01:28:03.940253+0000","last_undegraded":"2024-09-12T01:28:03.940253+0000","last_fullsized":"2024-09-12T01:28:03.940253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.593237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883352+0000","last_change":"2024-09-12T01:26:14.428684+0000","last_active":"2024-09-12T01:28:03.883352+0000","last_peered":"2024-09-12T01:28:03.883352+0000","last_clean":"2024-09-12T01:28:03.883352+0000","last_became_active":"2024-09-12T01:26:14.428380+0000","last_became_peered":"2024-09-12T01:26:14.428380+0000","last_unstale":"2024-09-12T01:28:03.883352+0000","last_undegraded":"2024-09-12T01:28:03.883352+0000","last_fullsized":"2024-09-12T01:28:03.883352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:21.542122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:08.406148+0000","last_change":"2024-09-12T01:26:12.800048+0000","last_active":"2024-09-12T01:28:08.406148+0000","last_peered":"2024-09-12T01:28:08.406148+0000","last_clean":"2024-09-12T01:28:08.406148+0000","last_became_active":"2024-09-12T01:26:12.799646+0000","last_became_peered":"2024-09-12T01:26:12.799646+0000","last_unstale":"2024-09-12T01:28:08.406148+0000","last_undegraded":"2024-09-12T01:28:08.406148+0000","last_fullsized":"2024-09-12T01:28:08.406148+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:39.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716527+0000","last_change":"2024-09-12T01:26:26.268110+0000","last_active":"2024-09-12T01:28:03.716527+0000","last_peered":"2024-09-12T01:28:03.716527+0000","last_clean":"2024-09-12T01:28:03.716527+0000","last_became_active":"2024-09-12T01:26:26.267764+0000","last_became_peered":"2024-09-12T01:26:26.267764+0000","last_unstale":"2024-09-12T01:28:03.716527+0000","last_undegraded":"2024-09-12T01:28:03.716527+0000","last_fullsized":"2024-09-12T01:28:03.716527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:37.009529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":136,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:08.623476+0000","last_change":"2024-09-12T01:26:12.424189+0000","last_active":"2024-09-12T01:28:08.623476+0000","last_peered":"2024-09-12T01:28:08.623476+0000","last_clean":"2024-09-12T01:28:08.623476+0000","last_became_active":"2024-09-12T01:26:12.423785+0000","last_became_peered":"2024-09-12T01:26:12.423785+0000","last_unstale":"2024-09-12T01:28:08.623476+0000","last_undegraded":"2024-09-12T01:28:08.623476+0000","last_fullsized":"2024-09-12T01:28:08.623476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:20.069821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814343+0000","last_change":"2024-09-12T01:26:14.437874+0000","last_active":"2024-09-12T01:28:03.814343+0000","last_peered":"2024-09-12T01:28:03.814343+0000","last_clean":"2024-09-12T01:28:03.814343+0000","last_became_active":"2024-09-12T01:26:14.437578+0000","last_became_peered":"2024-09-12T01:26:14.437578+0000","last_unstale":"2024-09-12T01:28:03.814343+0000","last_undegraded":"2024-09-12T01:28:03.814343+0000","last_fullsized":"2024-09-12T01:28:03.814343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:55.817763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716704+0000","last_change":"2024-09-12T01:26:26.267861+0000","last_active":"2024-09-12T01:28:03.716704+0000","last_peered":"2024-09-12T01:28:03.716704+0000","last_clean":"2024-09-12T01:28:03.716704+0000","last_became_active":"2024-09-12T01:26:26.267244+0000","last_became_peered":"2024-09-12T01:26:26.267244+0000","last_unstale":"2024-09-12T01:28:03.716704+0000","last_undegraded":"2024-09-12T01:28:03.716704+0000","last_fullsized":"2024-09-12T01:28:03.716704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:50.623916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814419+0000","last_change":"2024-09-12T01:26:14.434708+0000","last_active":"2024-09-12T01:28:03.814419+0000","last_peered":"2024-09-12T01:28:03.814419+0000","last_clean":"2024-09-12T01:28:03.814419+0000","last_became_active":"2024-09-12T01:26:14.434420+0000","last_became_peered":"2024-09-12T01:26:14.434420+0000","last_unstale":"2024-09-12T01:28:03.814419+0000","last_undegraded":"2024-09-12T01:28:03.814419+0000","last_fullsized":"2024-09-12T01:28:03.814419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:58.626769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802334+0000","last_change":"2024-09-12T01:26:12.800678+0000","last_active":"2024-09-12T01:28:03.802334+0000","last_peered":"2024-09-12T01:28:03.802334+0000","last_clean":"2024-09-12T01:28:03.802334+0000","last_became_active":"2024-09-12T01:26:12.800063+0000","last_became_peered":"2024-09-12T01:26:12.800063+0000","last_unstale":"2024-09-12T01:28:03.802334+0000","last_undegraded":"2024-09-12T01:28:03.802334+0000","last_fullsized":"2024-09-12T01:28:03.802334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:01.110686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882869+0000","last_change":"2024-09-12T01:26:14.425695+0000","last_active":"2024-09-12T01:28:03.882869+0000","last_peered":"2024-09-12T01:28:03.882869+0000","last_clean":"2024-09-12T01:28:03.882869+0000","last_became_active":"2024-09-12T01:26:14.425435+0000","last_became_peered":"2024-09-12T01:26:14.425435+0000","last_unstale":"2024-09-12T01:28:03.882869+0000","last_undegraded":"2024-09-12T01:28:03.882869+0000","last_fullsized":"2024-09-12T01:28:03.882869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:19.193669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'50","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.938195+0000","last_change":"2024-09-12T01:26:12.412743+0000","last_active":"2024-09-12T01:28:03.938195+0000","last_peered":"2024-09-12T01:28:03.938195+0000","last_clean":"2024-09-12T01:28:03.938195+0000","last_became_active":"2024-09-12T01:26:12.412376+0000","last_became_peered":"2024-09-12T01:26:12.412376+0000","last_unstale":"2024-09-12T01:28:03.938195+0000","last_undegraded":"2024-09-12T01:28:03.938195+0000","last_fullsized":"2024-09-12T01:28:03.938195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.542370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":89,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802661+0000","last_change":"2024-09-12T01:26:14.429727+0000","last_active":"2024-09-12T01:28:03.802661+0000","last_peered":"2024-09-12T01:28:03.802661+0000","last_clean":"2024-09-12T01:28:03.802661+0000","last_became_active":"2024-09-12T01:26:14.429385+0000","last_became_peered":"2024-09-12T01:26:14.429385+0000","last_unstale":"2024-09-12T01:28:03.802661+0000","last_undegraded":"2024-09-12T01:28:03.802661+0000","last_fullsized":"2024-09-12T01:28:03.802661+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:43.855786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825282+0000","last_change":"2024-09-12T01:26:12.855632+0000","last_active":"2024-09-12T01:28:03.825282+0000","last_peered":"2024-09-12T01:28:03.825282+0000","last_clean":"2024-09-12T01:28:03.825282+0000","last_became_active":"2024-09-12T01:26:12.855305+0000","last_became_peered":"2024-09-12T01:26:12.855305+0000","last_unstale":"2024-09-12T01:28:03.825282+0000","last_undegraded":"2024-09-12T01:28:03.825282+0000","last_fullsized":"2024-09-12T01:28:03.825282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.893689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883266+0000","last_change":"2024-09-12T01:26:14.428498+0000","last_active":"2024-09-12T01:28:03.883266+0000","last_peered":"2024-09-12T01:28:03.883266+0000","last_clean":"2024-09-12T01:28:03.883266+0000","last_became_active":"2024-09-12T01:26:14.428022+0000","last_became_peered":"2024-09-12T01:26:14.428022+0000","last_unstale":"2024-09-12T01:28:03.883266+0000","last_undegraded":"2024-09-12T01:28:03.883266+0000","last_fullsized":"2024-09-12T01:28:03.883266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.325399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717493+0000","last_change":"2024-09-12T01:26:12.800038+0000","last_active":"2024-09-12T01:28:03.717493+0000","last_peered":"2024-09-12T01:28:03.717493+0000","last_clean":"2024-09-12T01:28:03.717493+0000","last_became_active":"2024-09-12T01:26:12.799717+0000","last_became_peered":"2024-09-12T01:26:12.799717+0000","last_unstale":"2024-09-12T01:28:03.717493+0000","last_undegraded":"2024-09-12T01:28:03.717493+0000","last_fullsized":"2024-09-12T01:28:03.717493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.362437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801873+0000","last_change":"2024-09-12T01:26:14.430518+0000","last_active":"2024-09-12T01:28:03.801873+0000","last_peered":"2024-09-12T01:28:03.801873+0000","last_clean":"2024-09-12T01:28:03.801873+0000","last_became_active":"2024-09-12T01:26:14.430158+0000","last_became_peered":"2024-09-12T01:26:14.430158+0000","last_unstale":"2024-09-12T01:28:03.801873+0000","last_undegraded":"2024-09-12T01:28:03.801873+0000","last_fullsized":"2024-09-12T01:28:03.801873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:55.696101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802299+0000","last_change":"2024-09-12T01:26:12.418427+0000","last_active":"2024-09-12T01:28:03.802299+0000","last_peered":"2024-09-12T01:28:03.802299+0000","last_clean":"2024-09-12T01:28:03.802299+0000","last_became_active":"2024-09-12T01:26:12.418135+0000","last_became_peered":"2024-09-12T01:26:12.418135+0000","last_unstale":"2024-09-12T01:28:03.802299+0000","last_undegraded":"2024-09-12T01:28:03.802299+0000","last_fullsized":"2024-09-12T01:28:03.802299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:32.946485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880813+0000","last_change":"2024-09-12T01:26:14.425817+0000","last_active":"2024-09-12T01:28:03.880813+0000","last_peered":"2024-09-12T01:28:03.880813+0000","last_clean":"2024-09-12T01:28:03.880813+0000","last_became_active":"2024-09-12T01:26:14.425443+0000","last_became_peered":"2024-09-12T01:26:14.425443+0000","last_unstale":"2024-09-12T01:28:03.880813+0000","last_undegraded":"2024-09-12T01:28:03.880813+0000","last_fullsized":"2024-09-12T01:28:03.880813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720390+0000","last_change":"2024-09-12T01:26:12.422742+0000","last_active":"2024-09-12T01:28:03.720390+0000","last_peered":"2024-09-12T01:28:03.720390+0000","last_clean":"2024-09-12T01:28:03.720390+0000","last_became_active":"2024-09-12T01:26:12.421914+0000","last_became_peered":"2024-09-12T01:26:12.421914+0000","last_unstale":"2024-09-12T01:28:03.720390+0000","last_undegraded":"2024-09-12T01:28:03.720390+0000","last_fullsized":"2024-09-12T01:28:03.720390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:53.427112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802223+0000","last_change":"2024-09-12T01:26:14.430425+0000","last_active":"2024-09-12T01:28:03.802223+0000","last_peered":"2024-09-12T01:28:03.802223+0000","last_clean":"2024-09-12T01:28:03.802223+0000","last_became_active":"2024-09-12T01:26:14.430128+0000","last_became_peered":"2024-09-12T01:26:14.430128+0000","last_unstale":"2024-09-12T01:28:03.802223+0000","last_undegraded":"2024-09-12T01:28:03.802223+0000","last_fullsized":"2024-09-12T01:28:03.802223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:17.653908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802061+0000","last_change":"2024-09-12T01:26:12.421463+0000","last_active":"2024-09-12T01:28:03.802061+0000","last_peered":"2024-09-12T01:28:03.802061+0000","last_clean":"2024-09-12T01:28:03.802061+0000","last_became_active":"2024-09-12T01:26:12.421143+0000","last_became_peered":"2024-09-12T01:26:12.421143+0000","last_unstale":"2024-09-12T01:28:03.802061+0000","last_undegraded":"2024-09-12T01:28:03.802061+0000","last_fullsized":"2024-09-12T01:28:03.802061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:09.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940259+0000","last_change":"2024-09-12T01:26:14.428643+0000","last_active":"2024-09-12T01:28:03.940259+0000","last_peered":"2024-09-12T01:28:03.940259+0000","last_clean":"2024-09-12T01:28:03.940259+0000","last_became_active":"2024-09-12T01:26:14.428344+0000","last_became_peered":"2024-09-12T01:26:14.428344+0000","last_unstale":"2024-09-12T01:28:03.940259+0000","last_undegraded":"2024-09-12T01:28:03.940259+0000","last_fullsized":"2024-09-12T01:28:03.940259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:17.213238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811637+0000","last_change":"2024-09-12T01:26:14.435108+0000","last_active":"2024-09-12T01:28:03.811637+0000","last_peered":"2024-09-12T01:28:03.811637+0000","last_clean":"2024-09-12T01:28:03.811637+0000","last_became_active":"2024-09-12T01:26:14.434806+0000","last_became_peered":"2024-09-12T01:26:14.434806+0000","last_unstale":"2024-09-12T01:28:03.811637+0000","last_undegraded":"2024-09-12T01:28:03.811637+0000","last_fullsized":"2024-09-12T01:28:03.811637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:01.188981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802171+0000","last_change":"2024-09-12T01:26:12.419027+0000","last_active":"2024-09-12T01:28:03.802171+0000","last_peered":"2024-09-12T01:28:03.802171+0000","last_clean":"2024-09-12T01:28:03.802171+0000","last_became_active":"2024-09-12T01:26:12.418579+0000","last_became_peered":"2024-09-12T01:26:12.418579+0000","last_unstale":"2024-09-12T01:28:03.802171+0000","last_undegraded":"2024-09-12T01:28:03.802171+0000","last_fullsized":"2024-09-12T01:28:03.802171+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.119864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717484+0000","last_change":"2024-09-12T01:26:14.429532+0000","last_active":"2024-09-12T01:28:03.717484+0000","last_peered":"2024-09-12T01:28:03.717484+0000","last_clean":"2024-09-12T01:28:03.717484+0000","last_became_active":"2024-09-12T01:26:14.429134+0000","last_became_peered":"2024-09-12T01:26:14.429134+0000","last_unstale":"2024-09-12T01:28:03.717484+0000","last_undegraded":"2024-09-12T01:28:03.717484+0000","last_fullsized":"2024-09-12T01:28:03.717484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:47.403388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802252+0000","last_change":"2024-09-12T01:26:26.279322+0000","last_active":"2024-09-12T01:28:03.802252+0000","last_peered":"2024-09-12T01:28:03.802252+0000","last_clean":"2024-09-12T01:28:03.802252+0000","last_became_active":"2024-09-12T01:26:26.268752+0000","last_became_peered":"2024-09-12T01:26:26.268752+0000","last_unstale":"2024-09-12T01:28:03.802252+0000","last_undegraded":"2024-09-12T01:28:03.802252+0000","last_fullsized":"2024-09-12T01:28:03.802252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.411144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883645+0000","last_change":"2024-09-12T01:26:14.430831+0000","last_active":"2024-09-12T01:28:03.883645+0000","last_peered":"2024-09-12T01:28:03.883645+0000","last_clean":"2024-09-12T01:28:03.883645+0000","last_became_active":"2024-09-12T01:26:14.430531+0000","last_became_peered":"2024-09-12T01:26:14.430531+0000","last_unstale":"2024-09-12T01:28:03.883645+0000","last_undegraded":"2024-09-12T01:28:03.883645+0000","last_fullsized":"2024-09-12T01:28:03.883645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:02.522283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802763+0000","last_change":"2024-09-12T01:26:12.799921+0000","last_active":"2024-09-12T01:28:03.802763+0000","last_peered":"2024-09-12T01:28:03.802763+0000","last_clean":"2024-09-12T01:28:03.802763+0000","last_became_active":"2024-09-12T01:26:12.799608+0000","last_became_peered":"2024-09-12T01:26:12.799608+0000","last_unstale":"2024-09-12T01:28:03.802763+0000","last_undegraded":"2024-09-12T01:28:03.802763+0000","last_fullsized":"2024-09-12T01:28:03.802763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:00.821261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802625+0000","last_change":"2024-09-12T01:26:14.430937+0000","last_active":"2024-09-12T01:28:03.802625+0000","last_peered":"2024-09-12T01:28:03.802625+0000","last_clean":"2024-09-12T01:28:03.802625+0000","last_became_active":"2024-09-12T01:26:14.430656+0000","last_became_peered":"2024-09-12T01:26:14.430656+0000","last_unstale":"2024-09-12T01:28:03.802625+0000","last_undegraded":"2024-09-12T01:28:03.802625+0000","last_fullsized":"2024-09-12T01:28:03.802625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.874150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:08.622973+0000","last_change":"2024-09-12T01:26:12.419000+0000","last_active":"2024-09-12T01:28:08.622973+0000","last_peered":"2024-09-12T01:28:08.622973+0000","last_clean":"2024-09-12T01:28:08.622973+0000","last_became_active":"2024-09-12T01:26:12.418736+0000","last_became_peered":"2024-09-12T01:26:12.418736+0000","last_unstale":"2024-09-12T01:28:08.622973+0000","last_undegraded":"2024-09-12T01:28:08.622973+0000","last_fullsized":"2024-09-12T01:28:08.622973+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:31.586983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600525,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1191,"num_read_kb":712,"num_write":372,"num_write_kb":1462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1801575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579940,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":446094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37064,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708088,"statfs":{"total":95995035648,"available":95957082112,"internally_reserved":0,"allocated":1761280,"data_stored":1235800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972398,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28328,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716824,"statfs":{"total":95995035648,"available":95966027776,"internally_reserved":0,"allocated":1335296,"data_stored":838517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201331,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32484,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712668,"statfs":{"total":95995035648,"available":95961772032,"internally_reserved":0,"allocated":1327104,"data_stored":838873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1039912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626493,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":445411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855425,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1683456,"data_stored":1169477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986247,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":446199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215179,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36780,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708372,"statfs":{"total":95995035648,"available":95957372928,"internally_reserved":0,"allocated":1470464,"data_stored":969659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1015808,"data_stored":513725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":995328,"data_stored":512804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":447058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":134813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":394694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":201136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:28:15.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:28:15.516 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:15 smithi081 ceph-mon[30920]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-12T01:28:15.741 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:15.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:15 smithi100 ceph-mon[35275]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-12T01:28:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:15 smithi189 ceph-mon[35357]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-12T01:28:16.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.243+0000 7fc01e4fd640 1 -- 172.21.15.81:0/408304287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01810c170 msgr2=0x7fc01810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:16.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.243+0000 7fc01e4fd640 1 --2- 172.21.15.81:0/408304287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01810c170 0x7fc01810e610 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc010009ca0 tx=0x7fc01002a950 comp rx=0 tx=0).stop 2024-09-12T01:28:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.243+0000 7fc01e4fd640 1 -- 172.21.15.81:0/408304287 shutdown_connections 2024-09-12T01:28:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.243+0000 7fc01e4fd640 1 --2- 172.21.15.81:0/408304287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01810c170 0x7fc01810e610 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.243+0000 7fc01e4fd640 1 --2- 172.21.15.81:0/408304287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc018103660 0x7fc01810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.243+0000 7fc01e4fd640 1 --2- 172.21.15.81:0/408304287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc018102d40 0x7fc018103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.243+0000 7fc01e4fd640 1 -- 172.21.15.81:0/408304287 >> 172.21.15.81:0/408304287 conn(0x7fc0180fc7a0 msgr2=0x7fc0180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.243+0000 7fc01e4fd640 1 -- 172.21.15.81:0/408304287 shutdown_connections 2024-09-12T01:28:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.243+0000 7fc01e4fd640 1 -- 172.21.15.81:0/408304287 wait complete. 2024-09-12T01:28:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.244+0000 7fc01e4fd640 1 Processor -- start 2024-09-12T01:28:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.244+0000 7fc01e4fd640 1 -- start start 2024-09-12T01:28:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.244+0000 7fc01e4fd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc018102d40 0x7fc018198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.244+0000 7fc01e4fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc018103660 0x7fc018198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.244+0000 7fc01e4fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01810c170 0x7fc01819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.244+0000 7fc01e4fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc018112030 con 0x7fc01810c170 2024-09-12T01:28:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.244+0000 7fc01e4fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc018111eb0 con 0x7fc018103660 2024-09-12T01:28:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.244+0000 7fc01e4fd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc0181121b0 con 0x7fc018102d40 2024-09-12T01:28:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.244+0000 7fc01ca9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01810c170 0x7fc01819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.244+0000 7fc01ca9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01810c170 0x7fc01819cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41360/0 (socket says 172.21.15.81:41360) 2024-09-12T01:28:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.244+0000 7fc01ca9a640 1 -- 172.21.15.81:0/3169188179 learned_addr learned my addr 172.21.15.81:0/3169188179 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.245+0000 7fc017fff640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc018102d40 0x7fc018198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.245+0000 7fc0177fe640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc018103660 0x7fc018198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.245+0000 7fc01ca9a640 1 -- 172.21.15.81:0/3169188179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc018102d40 msgr2=0x7fc018198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.245+0000 7fc01ca9a640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc018102d40 0x7fc018198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.245+0000 7fc01ca9a640 1 -- 172.21.15.81:0/3169188179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc018103660 msgr2=0x7fc018198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.245+0000 7fc01ca9a640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc018103660 0x7fc018198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.245+0000 7fc01ca9a640 1 -- 172.21.15.81:0/3169188179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01819d5f0 con 0x7fc01810c170 2024-09-12T01:28:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.245+0000 7fc01ca9a640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01810c170 0x7fc01819cf10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc010006010 tx=0x7fc01002f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.245+0000 7fc0157fa640 1 -- 172.21.15.81:0/3169188179 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc010034040 con 0x7fc01810c170 2024-09-12T01:28:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.245+0000 7fc0157fa640 1 -- 172.21.15.81:0/3169188179 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc010003e00 con 0x7fc01810c170 2024-09-12T01:28:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.245+0000 7fc01e4fd640 1 -- 172.21.15.81:0/3169188179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc01819d880 con 0x7fc01810c170 2024-09-12T01:28:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.245+0000 7fc0157fa640 1 -- 172.21.15.81:0/3169188179 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0100456e0 con 0x7fc01810c170 2024-09-12T01:28:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.245+0000 7fc01e4fd640 1 -- 172.21.15.81:0/3169188179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0181a51c0 con 0x7fc01810c170 2024-09-12T01:28:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.246+0000 7fc01e4fd640 1 -- 172.21.15.81:0/3169188179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc01806b070 con 0x7fc01810c170 2024-09-12T01:28:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.247+0000 7fc0157fa640 1 -- 172.21.15.81:0/3169188179 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7fc010037020 con 0x7fc01810c170 2024-09-12T01:28:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.248+0000 7fc0157fa640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc0000a2d80 0x7fc0000a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.248+0000 7fc017fff640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc0000a2d80 0x7fc0000a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.248+0000 7fc0157fa640 1 -- 172.21.15.81:0/3169188179 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fc0100f0620 con 0x7fc01810c170 2024-09-12T01:28:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.248+0000 7fc017fff640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc0000a2d80 0x7fc0000a5240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc008009890 tx=0x7fc008008040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:16.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.252+0000 7fc0157fa640 1 -- 172.21.15.81:0/3169188179 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc0100bd210 con 0x7fc01810c170 2024-09-12T01:28:16.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.415+0000 7fc01e4fd640 1 -- 172.21.15.81:0/3169188179 --> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc018062630 con 0x7fc0000a2d80 2024-09-12T01:28:16.414 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:16 smithi081 ceph-mon[30920]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:16.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.421+0000 7fc0157fa640 1 -- 172.21.15.81:0/3169188179 <== mgr.15222 v2:172.21.15.81:6800/1379528564 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257810 (secure 0 0 0) 0x7fc018062630 con 0x7fc0000a2d80 2024-09-12T01:28:16.423 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T01:28:16.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.424+0000 7fc01e4fd640 1 -- 172.21.15.81:0/3169188179 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc0000a2d80 msgr2=0x7fc0000a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:16.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.424+0000 7fc01e4fd640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc0000a2d80 0x7fc0000a5240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc008009890 tx=0x7fc008008040 comp rx=0 tx=0).stop 2024-09-12T01:28:16.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.424+0000 7fc01e4fd640 1 -- 172.21.15.81:0/3169188179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01810c170 msgr2=0x7fc01819cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:16.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.424+0000 7fc01e4fd640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01810c170 0x7fc01819cf10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc010006010 tx=0x7fc01002f710 comp rx=0 tx=0).stop 2024-09-12T01:28:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.424+0000 7fc01e4fd640 1 -- 172.21.15.81:0/3169188179 shutdown_connections 2024-09-12T01:28:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.424+0000 7fc01e4fd640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc0000a2d80 0x7fc0000a5240 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.424+0000 7fc01e4fd640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc01810c170 0x7fc01819cf10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.424+0000 7fc01e4fd640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc018103660 0x7fc018198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.424+0000 7fc01e4fd640 1 --2- 172.21.15.81:0/3169188179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc018102d40 0x7fc018198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.424+0000 7fc01e4fd640 1 -- 172.21.15.81:0/3169188179 >> 172.21.15.81:0/3169188179 conn(0x7fc0180fc7a0 msgr2=0x7fc0180fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.424+0000 7fc01e4fd640 1 -- 172.21.15.81:0/3169188179 shutdown_connections 2024-09-12T01:28:16.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:16.424+0000 7fc01e4fd640 1 -- 172.21.15.81:0/3169188179 wait complete. 2024-09-12T01:28:16.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:16 smithi100 ceph-mon[35275]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:16.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:16 smithi189 ceph-mon[35357]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:17.247 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-12T01:28:15.731812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1387759,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1733,"num_read_kb":1299,"num_write":701,"num_write_kb":5316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180758,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1028,"ondisk_log_size":1028,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381344,"kb_used_data":15072,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124560480,"statfs":{"total":1151940427776,"available":1151549931520,"internally_reserved":0,"allocated":15433728,"data_stored":9493425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":456,"num_read_kb":493,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.989553"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881117+0000","last_change":"2024-09-12T01:26:14.433907+0000","last_active":"2024-09-12T01:28:03.881117+0000","last_peered":"2024-09-12T01:28:03.881117+0000","last_clean":"2024-09-12T01:28:03.881117+0000","last_became_active":"2024-09-12T01:26:14.433495+0000","last_became_peered":"2024-09-12T01:26:14.433495+0000","last_unstale":"2024-09-12T01:28:03.881117+0000","last_undegraded":"2024-09-12T01:28:03.881117+0000","last_fullsized":"2024-09-12T01:28:03.881117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:12.836491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883125+0000","last_change":"2024-09-12T01:26:14.430873+0000","last_active":"2024-09-12T01:28:03.883125+0000","last_peered":"2024-09-12T01:28:03.883125+0000","last_clean":"2024-09-12T01:28:03.883125+0000","last_became_active":"2024-09-12T01:26:14.430572+0000","last_became_peered":"2024-09-12T01:26:14.430572+0000","last_unstale":"2024-09-12T01:28:03.883125+0000","last_undegraded":"2024-09-12T01:28:03.883125+0000","last_fullsized":"2024-09-12T01:28:03.883125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:15.160712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882818+0000","last_change":"2024-09-12T01:26:14.426117+0000","last_active":"2024-09-12T01:28:03.882818+0000","last_peered":"2024-09-12T01:28:03.882818+0000","last_clean":"2024-09-12T01:28:03.882818+0000","last_became_active":"2024-09-12T01:26:14.425831+0000","last_became_peered":"2024-09-12T01:26:14.425831+0000","last_unstale":"2024-09-12T01:28:03.882818+0000","last_undegraded":"2024-09-12T01:28:03.882818+0000","last_fullsized":"2024-09-12T01:28:03.882818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:15.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825114+0000","last_change":"2024-09-12T01:26:14.434545+0000","last_active":"2024-09-12T01:28:03.825114+0000","last_peered":"2024-09-12T01:28:03.825114+0000","last_clean":"2024-09-12T01:28:03.825114+0000","last_became_active":"2024-09-12T01:26:14.434222+0000","last_became_peered":"2024-09-12T01:26:14.434222+0000","last_unstale":"2024-09-12T01:28:03.825114+0000","last_undegraded":"2024-09-12T01:28:03.825114+0000","last_fullsized":"2024-09-12T01:28:03.825114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:36.789145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801925+0000","last_change":"2024-09-12T01:26:14.421900+0000","last_active":"2024-09-12T01:28:03.801925+0000","last_peered":"2024-09-12T01:28:03.801925+0000","last_clean":"2024-09-12T01:28:03.801925+0000","last_became_active":"2024-09-12T01:26:14.421558+0000","last_became_peered":"2024-09-12T01:26:14.421558+0000","last_unstale":"2024-09-12T01:28:03.801925+0000","last_undegraded":"2024-09-12T01:28:03.801925+0000","last_fullsized":"2024-09-12T01:28:03.801925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814207+0000","last_change":"2024-09-12T01:26:14.436641+0000","last_active":"2024-09-12T01:28:03.814207+0000","last_peered":"2024-09-12T01:28:03.814207+0000","last_clean":"2024-09-12T01:28:03.814207+0000","last_became_active":"2024-09-12T01:26:14.436347+0000","last_became_peered":"2024-09-12T01:26:14.436347+0000","last_unstale":"2024-09-12T01:28:03.814207+0000","last_undegraded":"2024-09-12T01:28:03.814207+0000","last_fullsized":"2024-09-12T01:28:03.814207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:52.756035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940185+0000","last_change":"2024-09-12T01:26:14.438676+0000","last_active":"2024-09-12T01:28:03.940185+0000","last_peered":"2024-09-12T01:28:03.940185+0000","last_clean":"2024-09-12T01:28:03.940185+0000","last_became_active":"2024-09-12T01:26:14.438332+0000","last_became_peered":"2024-09-12T01:26:14.438332+0000","last_unstale":"2024-09-12T01:28:03.940185+0000","last_undegraded":"2024-09-12T01:28:03.940185+0000","last_fullsized":"2024-09-12T01:28:03.940185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:06.459830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802047+0000","last_change":"2024-09-12T01:26:14.431676+0000","last_active":"2024-09-12T01:28:03.802047+0000","last_peered":"2024-09-12T01:28:03.802047+0000","last_clean":"2024-09-12T01:28:03.802047+0000","last_became_active":"2024-09-12T01:26:14.431378+0000","last_became_peered":"2024-09-12T01:26:14.431378+0000","last_unstale":"2024-09-12T01:28:03.802047+0000","last_undegraded":"2024-09-12T01:28:03.802047+0000","last_fullsized":"2024-09-12T01:28:03.802047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:23.523350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717979+0000","last_change":"2024-09-12T01:26:14.428381+0000","last_active":"2024-09-12T01:28:03.717979+0000","last_peered":"2024-09-12T01:28:03.717979+0000","last_clean":"2024-09-12T01:28:03.717979+0000","last_became_active":"2024-09-12T01:26:14.428031+0000","last_became_peered":"2024-09-12T01:26:14.428031+0000","last_unstale":"2024-09-12T01:28:03.717979+0000","last_undegraded":"2024-09-12T01:28:03.717979+0000","last_fullsized":"2024-09-12T01:28:03.717979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:40.920911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814620+0000","last_change":"2024-09-12T01:26:14.438849+0000","last_active":"2024-09-12T01:28:03.814620+0000","last_peered":"2024-09-12T01:28:03.814620+0000","last_clean":"2024-09-12T01:28:03.814620+0000","last_became_active":"2024-09-12T01:26:14.438510+0000","last_became_peered":"2024-09-12T01:26:14.438510+0000","last_unstale":"2024-09-12T01:28:03.814620+0000","last_undegraded":"2024-09-12T01:28:03.814620+0000","last_fullsized":"2024-09-12T01:28:03.814620+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:12.257292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940484+0000","last_change":"2024-09-12T01:26:14.436468+0000","last_active":"2024-09-12T01:28:03.940484+0000","last_peered":"2024-09-12T01:28:03.940484+0000","last_clean":"2024-09-12T01:28:03.940484+0000","last_became_active":"2024-09-12T01:26:14.436095+0000","last_became_peered":"2024-09-12T01:26:14.436095+0000","last_unstale":"2024-09-12T01:28:03.940484+0000","last_undegraded":"2024-09-12T01:28:03.940484+0000","last_fullsized":"2024-09-12T01:28:03.940484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:43.441358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825119+0000","last_change":"2024-09-12T01:26:14.431384+0000","last_active":"2024-09-12T01:28:03.825119+0000","last_peered":"2024-09-12T01:28:03.825119+0000","last_clean":"2024-09-12T01:28:03.825119+0000","last_became_active":"2024-09-12T01:26:14.431079+0000","last_became_peered":"2024-09-12T01:26:14.431079+0000","last_unstale":"2024-09-12T01:28:03.825119+0000","last_undegraded":"2024-09-12T01:28:03.825119+0000","last_fullsized":"2024-09-12T01:28:03.825119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.178038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882393+0000","last_change":"2024-09-12T01:26:14.430163+0000","last_active":"2024-09-12T01:28:03.882393+0000","last_peered":"2024-09-12T01:28:03.882393+0000","last_clean":"2024-09-12T01:28:03.882393+0000","last_became_active":"2024-09-12T01:26:14.429863+0000","last_became_peered":"2024-09-12T01:26:14.429863+0000","last_unstale":"2024-09-12T01:28:03.882393+0000","last_undegraded":"2024-09-12T01:28:03.882393+0000","last_fullsized":"2024-09-12T01:28:03.882393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:44.432677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882103+0000","last_change":"2024-09-12T01:26:14.427304+0000","last_active":"2024-09-12T01:28:03.882103+0000","last_peered":"2024-09-12T01:28:03.882103+0000","last_clean":"2024-09-12T01:28:03.882103+0000","last_became_active":"2024-09-12T01:26:14.427006+0000","last_became_peered":"2024-09-12T01:26:14.427006+0000","last_unstale":"2024-09-12T01:28:03.882103+0000","last_undegraded":"2024-09-12T01:28:03.882103+0000","last_fullsized":"2024-09-12T01:28:03.882103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.930959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881815+0000","last_change":"2024-09-12T01:26:14.431018+0000","last_active":"2024-09-12T01:28:03.881815+0000","last_peered":"2024-09-12T01:28:03.881815+0000","last_clean":"2024-09-12T01:28:03.881815+0000","last_became_active":"2024-09-12T01:26:14.429518+0000","last_became_peered":"2024-09-12T01:26:14.429518+0000","last_unstale":"2024-09-12T01:28:03.881815+0000","last_undegraded":"2024-09-12T01:28:03.881815+0000","last_fullsized":"2024-09-12T01:28:03.881815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.504814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717400+0000","last_change":"2024-09-12T01:26:14.430601+0000","last_active":"2024-09-12T01:28:03.717400+0000","last_peered":"2024-09-12T01:28:03.717400+0000","last_clean":"2024-09-12T01:28:03.717400+0000","last_became_active":"2024-09-12T01:26:14.430304+0000","last_became_peered":"2024-09-12T01:26:14.430304+0000","last_unstale":"2024-09-12T01:28:03.717400+0000","last_undegraded":"2024-09-12T01:28:03.717400+0000","last_fullsized":"2024-09-12T01:28:03.717400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.414767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881148+0000","last_change":"2024-09-12T01:26:14.432934+0000","last_active":"2024-09-12T01:28:03.881148+0000","last_peered":"2024-09-12T01:28:03.881148+0000","last_clean":"2024-09-12T01:28:03.881148+0000","last_became_active":"2024-09-12T01:26:14.432417+0000","last_became_peered":"2024-09-12T01:26:14.432417+0000","last_unstale":"2024-09-12T01:28:03.881148+0000","last_undegraded":"2024-09-12T01:28:03.881148+0000","last_fullsized":"2024-09-12T01:28:03.881148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.964880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716779+0000","last_change":"2024-09-12T01:26:14.429956+0000","last_active":"2024-09-12T01:28:03.716779+0000","last_peered":"2024-09-12T01:28:03.716779+0000","last_clean":"2024-09-12T01:28:03.716779+0000","last_became_active":"2024-09-12T01:26:14.429610+0000","last_became_peered":"2024-09-12T01:26:14.429610+0000","last_unstale":"2024-09-12T01:28:03.716779+0000","last_undegraded":"2024-09-12T01:28:03.716779+0000","last_fullsized":"2024-09-12T01:28:03.716779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:51.453221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720646+0000","last_change":"2024-09-12T01:26:14.423624+0000","last_active":"2024-09-12T01:28:03.720646+0000","last_peered":"2024-09-12T01:28:03.720646+0000","last_clean":"2024-09-12T01:28:03.720646+0000","last_became_active":"2024-09-12T01:26:14.423314+0000","last_became_peered":"2024-09-12T01:26:14.423314+0000","last_unstale":"2024-09-12T01:28:03.720646+0000","last_undegraded":"2024-09-12T01:28:03.720646+0000","last_fullsized":"2024-09-12T01:28:03.720646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.414323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880810+0000","last_change":"2024-09-12T01:26:14.433548+0000","last_active":"2024-09-12T01:28:03.880810+0000","last_peered":"2024-09-12T01:28:03.880810+0000","last_clean":"2024-09-12T01:28:03.880810+0000","last_became_active":"2024-09-12T01:26:14.433223+0000","last_became_peered":"2024-09-12T01:26:14.433223+0000","last_unstale":"2024-09-12T01:28:03.880810+0000","last_undegraded":"2024-09-12T01:28:03.880810+0000","last_fullsized":"2024-09-12T01:28:03.880810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.247354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882535+0000","last_change":"2024-09-12T01:26:14.431715+0000","last_active":"2024-09-12T01:28:03.882535+0000","last_peered":"2024-09-12T01:28:03.882535+0000","last_clean":"2024-09-12T01:28:03.882535+0000","last_became_active":"2024-09-12T01:26:14.430839+0000","last_became_peered":"2024-09-12T01:26:14.430839+0000","last_unstale":"2024-09-12T01:28:03.882535+0000","last_undegraded":"2024-09-12T01:28:03.882535+0000","last_fullsized":"2024-09-12T01:28:03.882535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:04.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717611+0000","last_change":"2024-09-12T01:26:14.431385+0000","last_active":"2024-09-12T01:28:03.717611+0000","last_peered":"2024-09-12T01:28:03.717611+0000","last_clean":"2024-09-12T01:28:03.717611+0000","last_became_active":"2024-09-12T01:26:14.431046+0000","last_became_peered":"2024-09-12T01:26:14.431046+0000","last_unstale":"2024-09-12T01:28:03.717611+0000","last_undegraded":"2024-09-12T01:28:03.717611+0000","last_fullsized":"2024-09-12T01:28:03.717611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:42.495019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802146+0000","last_change":"2024-09-12T01:26:14.427737+0000","last_active":"2024-09-12T01:28:03.802146+0000","last_peered":"2024-09-12T01:28:03.802146+0000","last_clean":"2024-09-12T01:28:03.802146+0000","last_became_active":"2024-09-12T01:26:14.427409+0000","last_became_peered":"2024-09-12T01:26:14.427409+0000","last_unstale":"2024-09-12T01:28:03.802146+0000","last_undegraded":"2024-09-12T01:28:03.802146+0000","last_fullsized":"2024-09-12T01:28:03.802146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:02.632914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811345+0000","last_change":"2024-09-12T01:26:14.433426+0000","last_active":"2024-09-12T01:28:03.811345+0000","last_peered":"2024-09-12T01:28:03.811345+0000","last_clean":"2024-09-12T01:28:03.811345+0000","last_became_active":"2024-09-12T01:26:14.431918+0000","last_became_peered":"2024-09-12T01:26:14.431918+0000","last_unstale":"2024-09-12T01:28:03.811345+0000","last_undegraded":"2024-09-12T01:28:03.811345+0000","last_fullsized":"2024-09-12T01:28:03.811345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.946072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716825+0000","last_change":"2024-09-12T01:26:26.268358+0000","last_active":"2024-09-12T01:28:03.716825+0000","last_peered":"2024-09-12T01:28:03.716825+0000","last_clean":"2024-09-12T01:28:03.716825+0000","last_became_active":"2024-09-12T01:26:26.268005+0000","last_became_peered":"2024-09-12T01:26:26.268005+0000","last_unstale":"2024-09-12T01:28:03.716825+0000","last_undegraded":"2024-09-12T01:28:03.716825+0000","last_fullsized":"2024-09-12T01:28:03.716825+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:53.977249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720710+0000","last_change":"2024-09-12T01:26:14.434536+0000","last_active":"2024-09-12T01:28:03.720710+0000","last_peered":"2024-09-12T01:28:03.720710+0000","last_clean":"2024-09-12T01:28:03.720710+0000","last_became_active":"2024-09-12T01:26:14.434148+0000","last_became_peered":"2024-09-12T01:26:14.434148+0000","last_unstale":"2024-09-12T01:28:03.720710+0000","last_undegraded":"2024-09-12T01:28:03.720710+0000","last_fullsized":"2024-09-12T01:28:03.720710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:47.576827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880923+0000","last_change":"2024-09-12T01:26:14.428040+0000","last_active":"2024-09-12T01:28:03.880923+0000","last_peered":"2024-09-12T01:28:03.880923+0000","last_clean":"2024-09-12T01:28:03.880923+0000","last_became_active":"2024-09-12T01:26:14.427709+0000","last_became_peered":"2024-09-12T01:26:14.427709+0000","last_unstale":"2024-09-12T01:28:03.880923+0000","last_undegraded":"2024-09-12T01:28:03.880923+0000","last_fullsized":"2024-09-12T01:28:03.880923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.256097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882750+0000","last_change":"2024-09-12T01:26:26.265649+0000","last_active":"2024-09-12T01:28:03.882750+0000","last_peered":"2024-09-12T01:28:03.882750+0000","last_clean":"2024-09-12T01:28:03.882750+0000","last_became_active":"2024-09-12T01:26:26.265251+0000","last_became_peered":"2024-09-12T01:26:26.265251+0000","last_unstale":"2024-09-12T01:28:03.882750+0000","last_undegraded":"2024-09-12T01:28:03.882750+0000","last_fullsized":"2024-09-12T01:28:03.882750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:31.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882448+0000","last_change":"2024-09-12T01:26:14.427596+0000","last_active":"2024-09-12T01:28:03.882448+0000","last_peered":"2024-09-12T01:28:03.882448+0000","last_clean":"2024-09-12T01:28:03.882448+0000","last_became_active":"2024-09-12T01:26:14.427291+0000","last_became_peered":"2024-09-12T01:26:14.427291+0000","last_unstale":"2024-09-12T01:28:03.882448+0000","last_undegraded":"2024-09-12T01:28:03.882448+0000","last_fullsized":"2024-09-12T01:28:03.882448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:51.529835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720369+0000","last_change":"2024-09-12T01:26:14.424197+0000","last_active":"2024-09-12T01:28:03.720369+0000","last_peered":"2024-09-12T01:28:03.720369+0000","last_clean":"2024-09-12T01:28:03.720369+0000","last_became_active":"2024-09-12T01:26:14.423422+0000","last_became_peered":"2024-09-12T01:26:14.423422+0000","last_unstale":"2024-09-12T01:28:03.720369+0000","last_undegraded":"2024-09-12T01:28:03.720369+0000","last_fullsized":"2024-09-12T01:28:03.720369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.725623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720421+0000","last_change":"2024-09-12T01:26:14.428116+0000","last_active":"2024-09-12T01:28:03.720421+0000","last_peered":"2024-09-12T01:28:03.720421+0000","last_clean":"2024-09-12T01:28:03.720421+0000","last_became_active":"2024-09-12T01:26:14.427804+0000","last_became_peered":"2024-09-12T01:26:14.427804+0000","last_unstale":"2024-09-12T01:28:03.720421+0000","last_undegraded":"2024-09-12T01:28:03.720421+0000","last_fullsized":"2024-09-12T01:28:03.720421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:02.271305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880755+0000","last_change":"2024-09-12T01:26:14.432659+0000","last_active":"2024-09-12T01:28:03.880755+0000","last_peered":"2024-09-12T01:28:03.880755+0000","last_clean":"2024-09-12T01:28:03.880755+0000","last_became_active":"2024-09-12T01:26:14.432331+0000","last_became_peered":"2024-09-12T01:26:14.432331+0000","last_unstale":"2024-09-12T01:28:03.880755+0000","last_undegraded":"2024-09-12T01:28:03.880755+0000","last_fullsized":"2024-09-12T01:28:03.880755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.868909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801888+0000","last_change":"2024-09-12T01:26:14.426167+0000","last_active":"2024-09-12T01:28:03.801888+0000","last_peered":"2024-09-12T01:28:03.801888+0000","last_clean":"2024-09-12T01:28:03.801888+0000","last_became_active":"2024-09-12T01:26:14.425847+0000","last_became_peered":"2024-09-12T01:26:14.425847+0000","last_unstale":"2024-09-12T01:28:03.801888+0000","last_undegraded":"2024-09-12T01:28:03.801888+0000","last_fullsized":"2024-09-12T01:28:03.801888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:39.481527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.411843+0000","last_change":"2024-09-12T01:26:12.421487+0000","last_active":"2024-09-12T01:28:13.411843+0000","last_peered":"2024-09-12T01:28:13.411843+0000","last_clean":"2024-09-12T01:28:13.411843+0000","last_became_active":"2024-09-12T01:26:12.421096+0000","last_became_peered":"2024-09-12T01:26:12.421096+0000","last_unstale":"2024-09-12T01:28:13.411843+0000","last_undegraded":"2024-09-12T01:28:13.411843+0000","last_fullsized":"2024-09-12T01:28:13.411843+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:12.410280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811514+0000","last_change":"2024-09-12T01:26:26.270310+0000","last_active":"2024-09-12T01:28:03.811514+0000","last_peered":"2024-09-12T01:28:03.811514+0000","last_clean":"2024-09-12T01:28:03.811514+0000","last_became_active":"2024-09-12T01:26:26.269917+0000","last_became_peered":"2024-09-12T01:26:26.269917+0000","last_unstale":"2024-09-12T01:28:03.811514+0000","last_undegraded":"2024-09-12T01:28:03.811514+0000","last_fullsized":"2024-09-12T01:28:03.811514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:29.549456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814260+0000","last_change":"2024-09-12T01:26:26.287218+0000","last_active":"2024-09-12T01:28:03.814260+0000","last_peered":"2024-09-12T01:28:03.814260+0000","last_clean":"2024-09-12T01:28:03.814260+0000","last_became_active":"2024-09-12T01:26:26.282251+0000","last_became_peered":"2024-09-12T01:26:26.282251+0000","last_unstale":"2024-09-12T01:28:03.814260+0000","last_undegraded":"2024-09-12T01:28:03.814260+0000","last_fullsized":"2024-09-12T01:28:03.814260+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:53.888064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883469+0000","last_change":"2024-09-12T01:26:12.416100+0000","last_active":"2024-09-12T01:28:03.883469+0000","last_peered":"2024-09-12T01:28:03.883469+0000","last_clean":"2024-09-12T01:28:03.883469+0000","last_became_active":"2024-09-12T01:26:12.415799+0000","last_became_peered":"2024-09-12T01:26:12.415799+0000","last_unstale":"2024-09-12T01:28:03.883469+0000","last_undegraded":"2024-09-12T01:28:03.883469+0000","last_fullsized":"2024-09-12T01:28:03.883469+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:41.826537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802089+0000","last_change":"2024-09-12T01:26:14.424922+0000","last_active":"2024-09-12T01:28:03.802089+0000","last_peered":"2024-09-12T01:28:03.802089+0000","last_clean":"2024-09-12T01:28:03.802089+0000","last_became_active":"2024-09-12T01:26:14.424580+0000","last_became_peered":"2024-09-12T01:26:14.424580+0000","last_unstale":"2024-09-12T01:28:03.802089+0000","last_undegraded":"2024-09-12T01:28:03.802089+0000","last_fullsized":"2024-09-12T01:28:03.802089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:05.697287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811489+0000","last_change":"2024-09-12T01:26:12.419339+0000","last_active":"2024-09-12T01:28:03.811489+0000","last_peered":"2024-09-12T01:28:03.811489+0000","last_clean":"2024-09-12T01:28:03.811489+0000","last_became_active":"2024-09-12T01:26:12.418925+0000","last_became_peered":"2024-09-12T01:26:12.418925+0000","last_unstale":"2024-09-12T01:28:03.811489+0000","last_undegraded":"2024-09-12T01:28:03.811489+0000","last_fullsized":"2024-09-12T01:28:03.811489+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.390691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716540+0000","last_change":"2024-09-12T01:26:14.426611+0000","last_active":"2024-09-12T01:28:03.716540+0000","last_peered":"2024-09-12T01:28:03.716540+0000","last_clean":"2024-09-12T01:28:03.716540+0000","last_became_active":"2024-09-12T01:26:14.426268+0000","last_became_peered":"2024-09-12T01:26:14.426268+0000","last_unstale":"2024-09-12T01:28:03.716540+0000","last_undegraded":"2024-09-12T01:28:03.716540+0000","last_fullsized":"2024-09-12T01:28:03.716540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:34.676841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":250,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:14.412674+0000","last_change":"2024-09-12T01:26:12.420302+0000","last_active":"2024-09-12T01:28:14.412674+0000","last_peered":"2024-09-12T01:28:14.412674+0000","last_clean":"2024-09-12T01:28:14.412674+0000","last_became_active":"2024-09-12T01:26:12.419943+0000","last_became_peered":"2024-09-12T01:26:12.419943+0000","last_unstale":"2024-09-12T01:28:14.412674+0000","last_undegraded":"2024-09-12T01:28:14.412674+0000","last_fullsized":"2024-09-12T01:28:14.412674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:30.704272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717828+0000","last_change":"2024-09-12T01:26:14.433112+0000","last_active":"2024-09-12T01:28:03.717828+0000","last_peered":"2024-09-12T01:28:03.717828+0000","last_clean":"2024-09-12T01:28:03.717828+0000","last_became_active":"2024-09-12T01:26:14.432803+0000","last_became_peered":"2024-09-12T01:26:14.432803+0000","last_unstale":"2024-09-12T01:28:03.717828+0000","last_undegraded":"2024-09-12T01:28:03.717828+0000","last_fullsized":"2024-09-12T01:28:03.717828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:33.670485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940319+0000","last_change":"2024-09-12T01:26:12.424854+0000","last_active":"2024-09-12T01:28:03.940319+0000","last_peered":"2024-09-12T01:28:03.940319+0000","last_clean":"2024-09-12T01:28:03.940319+0000","last_became_active":"2024-09-12T01:26:12.424476+0000","last_became_peered":"2024-09-12T01:26:12.424476+0000","last_unstale":"2024-09-12T01:28:03.940319+0000","last_undegraded":"2024-09-12T01:28:03.940319+0000","last_fullsized":"2024-09-12T01:28:03.940319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:03.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883795+0000","last_change":"2024-09-12T01:26:14.431580+0000","last_active":"2024-09-12T01:28:03.883795+0000","last_peered":"2024-09-12T01:28:03.883795+0000","last_clean":"2024-09-12T01:28:03.883795+0000","last_became_active":"2024-09-12T01:26:14.431237+0000","last_became_peered":"2024-09-12T01:26:14.431237+0000","last_unstale":"2024-09-12T01:28:03.883795+0000","last_undegraded":"2024-09-12T01:28:03.883795+0000","last_fullsized":"2024-09-12T01:28:03.883795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:32.562156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811710+0000","last_change":"2024-09-12T01:26:12.802015+0000","last_active":"2024-09-12T01:28:03.811710+0000","last_peered":"2024-09-12T01:28:03.811710+0000","last_clean":"2024-09-12T01:28:03.811710+0000","last_became_active":"2024-09-12T01:26:12.801605+0000","last_became_peered":"2024-09-12T01:26:12.801605+0000","last_unstale":"2024-09-12T01:28:03.811710+0000","last_undegraded":"2024-09-12T01:28:03.811710+0000","last_fullsized":"2024-09-12T01:28:03.811710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:24.703911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717615+0000","last_change":"2024-09-12T01:26:14.433305+0000","last_active":"2024-09-12T01:28:03.717615+0000","last_peered":"2024-09-12T01:28:03.717615+0000","last_clean":"2024-09-12T01:28:03.717615+0000","last_became_active":"2024-09-12T01:26:14.432989+0000","last_became_peered":"2024-09-12T01:26:14.432989+0000","last_unstale":"2024-09-12T01:28:03.717615+0000","last_undegraded":"2024-09-12T01:28:03.717615+0000","last_fullsized":"2024-09-12T01:28:03.717615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:45.741460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":294,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:14.412788+0000","last_change":"2024-09-12T01:26:12.423148+0000","last_active":"2024-09-12T01:28:14.412788+0000","last_peered":"2024-09-12T01:28:14.412788+0000","last_clean":"2024-09-12T01:28:14.412788+0000","last_became_active":"2024-09-12T01:26:12.422754+0000","last_became_peered":"2024-09-12T01:26:12.422754+0000","last_unstale":"2024-09-12T01:28:14.412788+0000","last_undegraded":"2024-09-12T01:28:14.412788+0000","last_fullsized":"2024-09-12T01:28:14.412788+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:01.017125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":234,"num_read_kb":183,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802221+0000","last_change":"2024-09-12T01:26:14.431568+0000","last_active":"2024-09-12T01:28:03.802221+0000","last_peered":"2024-09-12T01:28:03.802221+0000","last_clean":"2024-09-12T01:28:03.802221+0000","last_became_active":"2024-09-12T01:26:14.431215+0000","last_became_peered":"2024-09-12T01:26:14.431215+0000","last_unstale":"2024-09-12T01:28:03.802221+0000","last_undegraded":"2024-09-12T01:28:03.802221+0000","last_fullsized":"2024-09-12T01:28:03.802221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.552147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720527+0000","last_change":"2024-09-12T01:26:12.421986+0000","last_active":"2024-09-12T01:28:03.720527+0000","last_peered":"2024-09-12T01:28:03.720527+0000","last_clean":"2024-09-12T01:28:03.720527+0000","last_became_active":"2024-09-12T01:26:12.421391+0000","last_became_peered":"2024-09-12T01:26:12.421391+0000","last_unstale":"2024-09-12T01:28:03.720527+0000","last_undegraded":"2024-09-12T01:28:03.720527+0000","last_fullsized":"2024-09-12T01:28:03.720527+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:20.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881940+0000","last_change":"2024-09-12T01:26:14.431435+0000","last_active":"2024-09-12T01:28:03.881940+0000","last_peered":"2024-09-12T01:28:03.881940+0000","last_clean":"2024-09-12T01:28:03.881940+0000","last_became_active":"2024-09-12T01:26:14.431143+0000","last_became_peered":"2024-09-12T01:26:14.431143+0000","last_unstale":"2024-09-12T01:28:03.881940+0000","last_undegraded":"2024-09-12T01:28:03.881940+0000","last_fullsized":"2024-09-12T01:28:03.881940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:58.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811440+0000","last_change":"2024-09-12T01:26:12.423972+0000","last_active":"2024-09-12T01:28:03.811440+0000","last_peered":"2024-09-12T01:28:03.811440+0000","last_clean":"2024-09-12T01:28:03.811440+0000","last_became_active":"2024-09-12T01:26:12.423594+0000","last_became_peered":"2024-09-12T01:26:12.423594+0000","last_unstale":"2024-09-12T01:28:03.811440+0000","last_undegraded":"2024-09-12T01:28:03.811440+0000","last_fullsized":"2024-09-12T01:28:03.811440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:37.783478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940307+0000","last_change":"2024-09-12T01:26:14.437207+0000","last_active":"2024-09-12T01:28:03.940307+0000","last_peered":"2024-09-12T01:28:03.940307+0000","last_clean":"2024-09-12T01:28:03.940307+0000","last_became_active":"2024-09-12T01:26:14.436940+0000","last_became_peered":"2024-09-12T01:26:14.436940+0000","last_unstale":"2024-09-12T01:28:03.940307+0000","last_undegraded":"2024-09-12T01:28:03.940307+0000","last_fullsized":"2024-09-12T01:28:03.940307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:34.454446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'9","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.413800+0000","last_change":"2024-09-12T01:26:12.420247+0000","last_active":"2024-09-12T01:28:13.413800+0000","last_peered":"2024-09-12T01:28:13.413800+0000","last_clean":"2024-09-12T01:28:13.413800+0000","last_became_active":"2024-09-12T01:26:12.419825+0000","last_became_peered":"2024-09-12T01:26:12.419825+0000","last_unstale":"2024-09-12T01:28:13.413800+0000","last_undegraded":"2024-09-12T01:28:13.413800+0000","last_fullsized":"2024-09-12T01:28:13.413800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:26.746225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":6,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940127+0000","last_change":"2024-09-12T01:26:14.439019+0000","last_active":"2024-09-12T01:28:03.940127+0000","last_peered":"2024-09-12T01:28:03.940127+0000","last_clean":"2024-09-12T01:28:03.940127+0000","last_became_active":"2024-09-12T01:26:14.438714+0000","last_became_peered":"2024-09-12T01:26:14.438714+0000","last_unstale":"2024-09-12T01:28:03.940127+0000","last_undegraded":"2024-09-12T01:28:03.940127+0000","last_fullsized":"2024-09-12T01:28:03.940127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.321464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801873+0000","last_change":"2024-09-12T01:26:12.800529+0000","last_active":"2024-09-12T01:28:03.801873+0000","last_peered":"2024-09-12T01:28:03.801873+0000","last_clean":"2024-09-12T01:28:03.801873+0000","last_became_active":"2024-09-12T01:26:12.800104+0000","last_became_peered":"2024-09-12T01:26:12.800104+0000","last_unstale":"2024-09-12T01:28:03.801873+0000","last_undegraded":"2024-09-12T01:28:03.801873+0000","last_fullsized":"2024-09-12T01:28:03.801873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.624321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811417+0000","last_change":"2024-09-12T01:26:14.435283+0000","last_active":"2024-09-12T01:28:03.811417+0000","last_peered":"2024-09-12T01:28:03.811417+0000","last_clean":"2024-09-12T01:28:03.811417+0000","last_became_active":"2024-09-12T01:26:14.434414+0000","last_became_peered":"2024-09-12T01:26:14.434414+0000","last_unstale":"2024-09-12T01:28:03.811417+0000","last_undegraded":"2024-09-12T01:28:03.811417+0000","last_fullsized":"2024-09-12T01:28:03.811417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.959405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'3","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881086+0000","last_change":"2024-09-12T01:26:26.273053+0000","last_active":"2024-09-12T01:28:03.881086+0000","last_peered":"2024-09-12T01:28:03.881086+0000","last_clean":"2024-09-12T01:28:03.881086+0000","last_became_active":"2024-09-12T01:26:26.267178+0000","last_became_peered":"2024-09-12T01:26:26.267178+0000","last_unstale":"2024-09-12T01:28:03.881086+0000","last_undegraded":"2024-09-12T01:28:03.881086+0000","last_fullsized":"2024-09-12T01:28:03.881086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:08.138485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880948+0000","last_change":"2024-09-12T01:26:14.433527+0000","last_active":"2024-09-12T01:28:03.880948+0000","last_peered":"2024-09-12T01:28:03.880948+0000","last_clean":"2024-09-12T01:28:03.880948+0000","last_became_active":"2024-09-12T01:26:14.433204+0000","last_became_peered":"2024-09-12T01:26:14.433204+0000","last_unstale":"2024-09-12T01:28:03.880948+0000","last_undegraded":"2024-09-12T01:28:03.880948+0000","last_fullsized":"2024-09-12T01:28:03.880948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:26.883916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883147+0000","last_change":"2024-09-12T01:26:12.420795+0000","last_active":"2024-09-12T01:28:03.883147+0000","last_peered":"2024-09-12T01:28:03.883147+0000","last_clean":"2024-09-12T01:28:03.883147+0000","last_became_active":"2024-09-12T01:26:12.420409+0000","last_became_peered":"2024-09-12T01:26:12.420409+0000","last_unstale":"2024-09-12T01:28:03.883147+0000","last_undegraded":"2024-09-12T01:28:03.883147+0000","last_fullsized":"2024-09-12T01:28:03.883147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:36.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940454+0000","last_change":"2024-09-12T01:26:14.440994+0000","last_active":"2024-09-12T01:28:03.940454+0000","last_peered":"2024-09-12T01:28:03.940454+0000","last_clean":"2024-09-12T01:28:03.940454+0000","last_became_active":"2024-09-12T01:26:14.440602+0000","last_became_peered":"2024-09-12T01:26:14.440602+0000","last_unstale":"2024-09-12T01:28:03.940454+0000","last_undegraded":"2024-09-12T01:28:03.940454+0000","last_fullsized":"2024-09-12T01:28:03.940454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.998991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'67","reported_seq":122,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:12.798180+0000","last_change":"2024-09-12T01:26:12.419448+0000","last_active":"2024-09-12T01:28:12.798180+0000","last_peered":"2024-09-12T01:28:12.798180+0000","last_clean":"2024-09-12T01:28:12.798180+0000","last_became_active":"2024-09-12T01:26:12.419000+0000","last_became_peered":"2024-09-12T01:26:12.419000+0000","last_unstale":"2024-09-12T01:28:12.798180+0000","last_undegraded":"2024-09-12T01:28:12.798180+0000","last_fullsized":"2024-09-12T01:28:12.798180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:37.818833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940268+0000","last_change":"2024-09-12T01:26:14.437818+0000","last_active":"2024-09-12T01:28:03.940268+0000","last_peered":"2024-09-12T01:28:03.940268+0000","last_clean":"2024-09-12T01:28:03.940268+0000","last_became_active":"2024-09-12T01:26:14.437497+0000","last_became_peered":"2024-09-12T01:26:14.437497+0000","last_unstale":"2024-09-12T01:28:03.940268+0000","last_undegraded":"2024-09-12T01:28:03.940268+0000","last_fullsized":"2024-09-12T01:28:03.940268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:57.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'7","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.676738+0000","last_change":"2024-09-12T01:26:12.855850+0000","last_active":"2024-09-12T01:28:13.676738+0000","last_peered":"2024-09-12T01:28:13.676738+0000","last_clean":"2024-09-12T01:28:13.676738+0000","last_became_active":"2024-09-12T01:26:12.855400+0000","last_became_peered":"2024-09-12T01:26:12.855400+0000","last_unstale":"2024-09-12T01:28:13.676738+0000","last_undegraded":"2024-09-12T01:28:13.676738+0000","last_fullsized":"2024-09-12T01:28:13.676738+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:32.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940460+0000","last_change":"2024-09-12T01:26:14.435982+0000","last_active":"2024-09-12T01:28:03.940460+0000","last_peered":"2024-09-12T01:28:03.940460+0000","last_clean":"2024-09-12T01:28:03.940460+0000","last_became_active":"2024-09-12T01:26:14.435595+0000","last_became_peered":"2024-09-12T01:26:14.435595+0000","last_unstale":"2024-09-12T01:28:03.940460+0000","last_undegraded":"2024-09-12T01:28:03.940460+0000","last_fullsized":"2024-09-12T01:28:03.940460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:31.101890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"83'148","reported_seq":390,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:05.821001+0000","last_change":"2024-09-12T01:25:04.588449+0000","last_active":"2024-09-12T01:28:05.821001+0000","last_peered":"2024-09-12T01:28:05.821001+0000","last_clean":"2024-09-12T01:28:05.821001+0000","last_became_active":"2024-09-12T01:25:04.587949+0000","last_became_peered":"2024-09-12T01:25:04.587949+0000","last_unstale":"2024-09-12T01:28:05.821001+0000","last_undegraded":"2024-09-12T01:28:05.821001+0000","last_fullsized":"2024-09-12T01:28:05.821001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_clean_scrub_stamp":"2024-09-12T01:21:41.345624+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:41.015289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825146+0000","last_change":"2024-09-12T01:26:12.421379+0000","last_active":"2024-09-12T01:28:03.825146+0000","last_peered":"2024-09-12T01:28:03.825146+0000","last_clean":"2024-09-12T01:28:03.825146+0000","last_became_active":"2024-09-12T01:26:12.421059+0000","last_became_peered":"2024-09-12T01:26:12.421059+0000","last_unstale":"2024-09-12T01:28:03.825146+0000","last_undegraded":"2024-09-12T01:28:03.825146+0000","last_fullsized":"2024-09-12T01:28:03.825146+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802270+0000","last_change":"2024-09-12T01:26:14.430510+0000","last_active":"2024-09-12T01:28:03.802270+0000","last_peered":"2024-09-12T01:28:03.802270+0000","last_clean":"2024-09-12T01:28:03.802270+0000","last_became_active":"2024-09-12T01:26:14.430232+0000","last_became_peered":"2024-09-12T01:26:14.430232+0000","last_unstale":"2024-09-12T01:28:03.802270+0000","last_undegraded":"2024-09-12T01:28:03.802270+0000","last_fullsized":"2024-09-12T01:28:03.802270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:55.114616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940306+0000","last_change":"2024-09-12T01:26:12.420938+0000","last_active":"2024-09-12T01:28:03.940306+0000","last_peered":"2024-09-12T01:28:03.940306+0000","last_clean":"2024-09-12T01:28:03.940306+0000","last_became_active":"2024-09-12T01:26:12.420599+0000","last_became_peered":"2024-09-12T01:26:12.420599+0000","last_unstale":"2024-09-12T01:28:03.940306+0000","last_undegraded":"2024-09-12T01:28:03.940306+0000","last_fullsized":"2024-09-12T01:28:03.940306+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.593237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883352+0000","last_change":"2024-09-12T01:26:14.428684+0000","last_active":"2024-09-12T01:28:03.883352+0000","last_peered":"2024-09-12T01:28:03.883352+0000","last_clean":"2024-09-12T01:28:03.883352+0000","last_became_active":"2024-09-12T01:26:14.428380+0000","last_became_peered":"2024-09-12T01:26:14.428380+0000","last_unstale":"2024-09-12T01:28:03.883352+0000","last_undegraded":"2024-09-12T01:28:03.883352+0000","last_fullsized":"2024-09-12T01:28:03.883352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:21.542122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":142,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.413211+0000","last_change":"2024-09-12T01:26:12.800048+0000","last_active":"2024-09-12T01:28:13.413211+0000","last_peered":"2024-09-12T01:28:13.413211+0000","last_clean":"2024-09-12T01:28:13.413211+0000","last_became_active":"2024-09-12T01:26:12.799646+0000","last_became_peered":"2024-09-12T01:26:12.799646+0000","last_unstale":"2024-09-12T01:28:13.413211+0000","last_undegraded":"2024-09-12T01:28:13.413211+0000","last_fullsized":"2024-09-12T01:28:13.413211+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:39.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716527+0000","last_change":"2024-09-12T01:26:26.268110+0000","last_active":"2024-09-12T01:28:03.716527+0000","last_peered":"2024-09-12T01:28:03.716527+0000","last_clean":"2024-09-12T01:28:03.716527+0000","last_became_active":"2024-09-12T01:26:26.267764+0000","last_became_peered":"2024-09-12T01:26:26.267764+0000","last_unstale":"2024-09-12T01:28:03.716527+0000","last_undegraded":"2024-09-12T01:28:03.716527+0000","last_fullsized":"2024-09-12T01:28:03.716527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:37.009529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":142,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:14.640950+0000","last_change":"2024-09-12T01:26:12.424189+0000","last_active":"2024-09-12T01:28:14.640950+0000","last_peered":"2024-09-12T01:28:14.640950+0000","last_clean":"2024-09-12T01:28:14.640950+0000","last_became_active":"2024-09-12T01:26:12.423785+0000","last_became_peered":"2024-09-12T01:26:12.423785+0000","last_unstale":"2024-09-12T01:28:14.640950+0000","last_undegraded":"2024-09-12T01:28:14.640950+0000","last_fullsized":"2024-09-12T01:28:14.640950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:20.069821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814343+0000","last_change":"2024-09-12T01:26:14.437874+0000","last_active":"2024-09-12T01:28:03.814343+0000","last_peered":"2024-09-12T01:28:03.814343+0000","last_clean":"2024-09-12T01:28:03.814343+0000","last_became_active":"2024-09-12T01:26:14.437578+0000","last_became_peered":"2024-09-12T01:26:14.437578+0000","last_unstale":"2024-09-12T01:28:03.814343+0000","last_undegraded":"2024-09-12T01:28:03.814343+0000","last_fullsized":"2024-09-12T01:28:03.814343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:55.817763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716704+0000","last_change":"2024-09-12T01:26:26.267861+0000","last_active":"2024-09-12T01:28:03.716704+0000","last_peered":"2024-09-12T01:28:03.716704+0000","last_clean":"2024-09-12T01:28:03.716704+0000","last_became_active":"2024-09-12T01:26:26.267244+0000","last_became_peered":"2024-09-12T01:26:26.267244+0000","last_unstale":"2024-09-12T01:28:03.716704+0000","last_undegraded":"2024-09-12T01:28:03.716704+0000","last_fullsized":"2024-09-12T01:28:03.716704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:50.623916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814419+0000","last_change":"2024-09-12T01:26:14.434708+0000","last_active":"2024-09-12T01:28:03.814419+0000","last_peered":"2024-09-12T01:28:03.814419+0000","last_clean":"2024-09-12T01:28:03.814419+0000","last_became_active":"2024-09-12T01:26:14.434420+0000","last_became_peered":"2024-09-12T01:26:14.434420+0000","last_unstale":"2024-09-12T01:28:03.814419+0000","last_undegraded":"2024-09-12T01:28:03.814419+0000","last_fullsized":"2024-09-12T01:28:03.814419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:58.626769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802334+0000","last_change":"2024-09-12T01:26:12.800678+0000","last_active":"2024-09-12T01:28:03.802334+0000","last_peered":"2024-09-12T01:28:03.802334+0000","last_clean":"2024-09-12T01:28:03.802334+0000","last_became_active":"2024-09-12T01:26:12.800063+0000","last_became_peered":"2024-09-12T01:26:12.800063+0000","last_unstale":"2024-09-12T01:28:03.802334+0000","last_undegraded":"2024-09-12T01:28:03.802334+0000","last_fullsized":"2024-09-12T01:28:03.802334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:01.110686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882869+0000","last_change":"2024-09-12T01:26:14.425695+0000","last_active":"2024-09-12T01:28:03.882869+0000","last_peered":"2024-09-12T01:28:03.882869+0000","last_clean":"2024-09-12T01:28:03.882869+0000","last_became_active":"2024-09-12T01:26:14.425435+0000","last_became_peered":"2024-09-12T01:26:14.425435+0000","last_unstale":"2024-09-12T01:28:03.882869+0000","last_undegraded":"2024-09-12T01:28:03.882869+0000","last_fullsized":"2024-09-12T01:28:03.882869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:19.193669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'103","reported_seq":219,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.172744+0000","last_change":"2024-09-12T01:26:12.412743+0000","last_active":"2024-09-12T01:28:13.172744+0000","last_peered":"2024-09-12T01:28:13.172744+0000","last_clean":"2024-09-12T01:28:13.172744+0000","last_became_active":"2024-09-12T01:26:12.412376+0000","last_became_peered":"2024-09-12T01:26:12.412376+0000","last_unstale":"2024-09-12T01:28:13.172744+0000","last_undegraded":"2024-09-12T01:28:13.172744+0000","last_fullsized":"2024-09-12T01:28:13.172744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.542370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":188,"num_write_kb":1285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802661+0000","last_change":"2024-09-12T01:26:14.429727+0000","last_active":"2024-09-12T01:28:03.802661+0000","last_peered":"2024-09-12T01:28:03.802661+0000","last_clean":"2024-09-12T01:28:03.802661+0000","last_became_active":"2024-09-12T01:26:14.429385+0000","last_became_peered":"2024-09-12T01:26:14.429385+0000","last_unstale":"2024-09-12T01:28:03.802661+0000","last_undegraded":"2024-09-12T01:28:03.802661+0000","last_fullsized":"2024-09-12T01:28:03.802661+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:43.855786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825282+0000","last_change":"2024-09-12T01:26:12.855632+0000","last_active":"2024-09-12T01:28:03.825282+0000","last_peered":"2024-09-12T01:28:03.825282+0000","last_clean":"2024-09-12T01:28:03.825282+0000","last_became_active":"2024-09-12T01:26:12.855305+0000","last_became_peered":"2024-09-12T01:26:12.855305+0000","last_unstale":"2024-09-12T01:28:03.825282+0000","last_undegraded":"2024-09-12T01:28:03.825282+0000","last_fullsized":"2024-09-12T01:28:03.825282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.893689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883266+0000","last_change":"2024-09-12T01:26:14.428498+0000","last_active":"2024-09-12T01:28:03.883266+0000","last_peered":"2024-09-12T01:28:03.883266+0000","last_clean":"2024-09-12T01:28:03.883266+0000","last_became_active":"2024-09-12T01:26:14.428022+0000","last_became_peered":"2024-09-12T01:26:14.428022+0000","last_unstale":"2024-09-12T01:28:03.883266+0000","last_undegraded":"2024-09-12T01:28:03.883266+0000","last_fullsized":"2024-09-12T01:28:03.883266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.325399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717493+0000","last_change":"2024-09-12T01:26:12.800038+0000","last_active":"2024-09-12T01:28:03.717493+0000","last_peered":"2024-09-12T01:28:03.717493+0000","last_clean":"2024-09-12T01:28:03.717493+0000","last_became_active":"2024-09-12T01:26:12.799717+0000","last_became_peered":"2024-09-12T01:26:12.799717+0000","last_unstale":"2024-09-12T01:28:03.717493+0000","last_undegraded":"2024-09-12T01:28:03.717493+0000","last_fullsized":"2024-09-12T01:28:03.717493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.362437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801873+0000","last_change":"2024-09-12T01:26:14.430518+0000","last_active":"2024-09-12T01:28:03.801873+0000","last_peered":"2024-09-12T01:28:03.801873+0000","last_clean":"2024-09-12T01:28:03.801873+0000","last_became_active":"2024-09-12T01:26:14.430158+0000","last_became_peered":"2024-09-12T01:26:14.430158+0000","last_unstale":"2024-09-12T01:28:03.801873+0000","last_undegraded":"2024-09-12T01:28:03.801873+0000","last_fullsized":"2024-09-12T01:28:03.801873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:55.696101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802299+0000","last_change":"2024-09-12T01:26:12.418427+0000","last_active":"2024-09-12T01:28:03.802299+0000","last_peered":"2024-09-12T01:28:03.802299+0000","last_clean":"2024-09-12T01:28:03.802299+0000","last_became_active":"2024-09-12T01:26:12.418135+0000","last_became_peered":"2024-09-12T01:26:12.418135+0000","last_unstale":"2024-09-12T01:28:03.802299+0000","last_undegraded":"2024-09-12T01:28:03.802299+0000","last_fullsized":"2024-09-12T01:28:03.802299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:32.946485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880813+0000","last_change":"2024-09-12T01:26:14.425817+0000","last_active":"2024-09-12T01:28:03.880813+0000","last_peered":"2024-09-12T01:28:03.880813+0000","last_clean":"2024-09-12T01:28:03.880813+0000","last_became_active":"2024-09-12T01:26:14.425443+0000","last_became_peered":"2024-09-12T01:26:14.425443+0000","last_unstale":"2024-09-12T01:28:03.880813+0000","last_undegraded":"2024-09-12T01:28:03.880813+0000","last_fullsized":"2024-09-12T01:28:03.880813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720390+0000","last_change":"2024-09-12T01:26:12.422742+0000","last_active":"2024-09-12T01:28:03.720390+0000","last_peered":"2024-09-12T01:28:03.720390+0000","last_clean":"2024-09-12T01:28:03.720390+0000","last_became_active":"2024-09-12T01:26:12.421914+0000","last_became_peered":"2024-09-12T01:26:12.421914+0000","last_unstale":"2024-09-12T01:28:03.720390+0000","last_undegraded":"2024-09-12T01:28:03.720390+0000","last_fullsized":"2024-09-12T01:28:03.720390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:53.427112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802223+0000","last_change":"2024-09-12T01:26:14.430425+0000","last_active":"2024-09-12T01:28:03.802223+0000","last_peered":"2024-09-12T01:28:03.802223+0000","last_clean":"2024-09-12T01:28:03.802223+0000","last_became_active":"2024-09-12T01:26:14.430128+0000","last_became_peered":"2024-09-12T01:26:14.430128+0000","last_unstale":"2024-09-12T01:28:03.802223+0000","last_undegraded":"2024-09-12T01:28:03.802223+0000","last_fullsized":"2024-09-12T01:28:03.802223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:17.653908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802061+0000","last_change":"2024-09-12T01:26:12.421463+0000","last_active":"2024-09-12T01:28:03.802061+0000","last_peered":"2024-09-12T01:28:03.802061+0000","last_clean":"2024-09-12T01:28:03.802061+0000","last_became_active":"2024-09-12T01:26:12.421143+0000","last_became_peered":"2024-09-12T01:26:12.421143+0000","last_unstale":"2024-09-12T01:28:03.802061+0000","last_undegraded":"2024-09-12T01:28:03.802061+0000","last_fullsized":"2024-09-12T01:28:03.802061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:09.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940259+0000","last_change":"2024-09-12T01:26:14.428643+0000","last_active":"2024-09-12T01:28:03.940259+0000","last_peered":"2024-09-12T01:28:03.940259+0000","last_clean":"2024-09-12T01:28:03.940259+0000","last_became_active":"2024-09-12T01:26:14.428344+0000","last_became_peered":"2024-09-12T01:26:14.428344+0000","last_unstale":"2024-09-12T01:28:03.940259+0000","last_undegraded":"2024-09-12T01:28:03.940259+0000","last_fullsized":"2024-09-12T01:28:03.940259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:17.213238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811637+0000","last_change":"2024-09-12T01:26:14.435108+0000","last_active":"2024-09-12T01:28:03.811637+0000","last_peered":"2024-09-12T01:28:03.811637+0000","last_clean":"2024-09-12T01:28:03.811637+0000","last_became_active":"2024-09-12T01:26:14.434806+0000","last_became_peered":"2024-09-12T01:26:14.434806+0000","last_unstale":"2024-09-12T01:28:03.811637+0000","last_undegraded":"2024-09-12T01:28:03.811637+0000","last_fullsized":"2024-09-12T01:28:03.811637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:01.188981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802171+0000","last_change":"2024-09-12T01:26:12.419027+0000","last_active":"2024-09-12T01:28:03.802171+0000","last_peered":"2024-09-12T01:28:03.802171+0000","last_clean":"2024-09-12T01:28:03.802171+0000","last_became_active":"2024-09-12T01:26:12.418579+0000","last_became_peered":"2024-09-12T01:26:12.418579+0000","last_unstale":"2024-09-12T01:28:03.802171+0000","last_undegraded":"2024-09-12T01:28:03.802171+0000","last_fullsized":"2024-09-12T01:28:03.802171+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.119864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717484+0000","last_change":"2024-09-12T01:26:14.429532+0000","last_active":"2024-09-12T01:28:03.717484+0000","last_peered":"2024-09-12T01:28:03.717484+0000","last_clean":"2024-09-12T01:28:03.717484+0000","last_became_active":"2024-09-12T01:26:14.429134+0000","last_became_peered":"2024-09-12T01:26:14.429134+0000","last_unstale":"2024-09-12T01:28:03.717484+0000","last_undegraded":"2024-09-12T01:28:03.717484+0000","last_fullsized":"2024-09-12T01:28:03.717484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:47.403388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802252+0000","last_change":"2024-09-12T01:26:26.279322+0000","last_active":"2024-09-12T01:28:03.802252+0000","last_peered":"2024-09-12T01:28:03.802252+0000","last_clean":"2024-09-12T01:28:03.802252+0000","last_became_active":"2024-09-12T01:26:26.268752+0000","last_became_peered":"2024-09-12T01:26:26.268752+0000","last_unstale":"2024-09-12T01:28:03.802252+0000","last_undegraded":"2024-09-12T01:28:03.802252+0000","last_fullsized":"2024-09-12T01:28:03.802252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.411144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883645+0000","last_change":"2024-09-12T01:26:14.430831+0000","last_active":"2024-09-12T01:28:03.883645+0000","last_peered":"2024-09-12T01:28:03.883645+0000","last_clean":"2024-09-12T01:28:03.883645+0000","last_became_active":"2024-09-12T01:26:14.430531+0000","last_became_peered":"2024-09-12T01:26:14.430531+0000","last_unstale":"2024-09-12T01:28:03.883645+0000","last_undegraded":"2024-09-12T01:28:03.883645+0000","last_fullsized":"2024-09-12T01:28:03.883645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:02.522283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802763+0000","last_change":"2024-09-12T01:26:12.799921+0000","last_active":"2024-09-12T01:28:03.802763+0000","last_peered":"2024-09-12T01:28:03.802763+0000","last_clean":"2024-09-12T01:28:03.802763+0000","last_became_active":"2024-09-12T01:26:12.799608+0000","last_became_peered":"2024-09-12T01:26:12.799608+0000","last_unstale":"2024-09-12T01:28:03.802763+0000","last_undegraded":"2024-09-12T01:28:03.802763+0000","last_fullsized":"2024-09-12T01:28:03.802763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:00.821261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802625+0000","last_change":"2024-09-12T01:26:14.430937+0000","last_active":"2024-09-12T01:28:03.802625+0000","last_peered":"2024-09-12T01:28:03.802625+0000","last_clean":"2024-09-12T01:28:03.802625+0000","last_became_active":"2024-09-12T01:26:14.430656+0000","last_became_peered":"2024-09-12T01:26:14.430656+0000","last_unstale":"2024-09-12T01:28:03.802625+0000","last_undegraded":"2024-09-12T01:28:03.802625+0000","last_fullsized":"2024-09-12T01:28:03.802625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.874150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:14.640462+0000","last_change":"2024-09-12T01:26:12.419000+0000","last_active":"2024-09-12T01:28:14.640462+0000","last_peered":"2024-09-12T01:28:14.640462+0000","last_clean":"2024-09-12T01:28:14.640462+0000","last_became_active":"2024-09-12T01:26:12.418736+0000","last_became_peered":"2024-09-12T01:26:12.418736+0000","last_unstale":"2024-09-12T01:28:14.640462+0000","last_undegraded":"2024-09-12T01:28:14.640462+0000","last_fullsized":"2024-09-12T01:28:14.640462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:31.586983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797157,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1496,"num_read_kb":969,"num_write":498,"num_write_kb":2376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":2391471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":378,"ondisk_log_size":378,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":446094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37376,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707776,"statfs":{"total":95995035648,"available":95956762624,"internally_reserved":0,"allocated":1957888,"data_stored":1432432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972399,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28328,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716824,"statfs":{"total":95995035648,"available":95966027776,"internally_reserved":0,"allocated":1335296,"data_stored":838517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32480,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712672,"statfs":{"total":95995035648,"available":95961776128,"internally_reserved":0,"allocated":1327104,"data_stored":838873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1039912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626494,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":445411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855426,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28980,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716172,"statfs":{"total":95995035648,"available":95965360128,"internally_reserved":0,"allocated":1880064,"data_stored":1366109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":446199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37092,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708060,"statfs":{"total":95995035648,"available":95957053440,"internally_reserved":0,"allocated":1667072,"data_stored":1166291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1015808,"data_stored":513725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":995328,"data_stored":512804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":447058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":753664,"data_stored":721878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":331445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":394694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":397768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:28:17.251 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T01:28:17.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:28:17.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:17 smithi081 ceph-mon[30920]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 54 op/s 2024-09-12T01:28:17.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:17 smithi081 ceph-mon[30920]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:17.498 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:17.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:17 smithi100 ceph-mon[35275]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 54 op/s 2024-09-12T01:28:17.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:17 smithi100 ceph-mon[35275]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:17.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:17 smithi189 ceph-mon[35357]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 54 op/s 2024-09-12T01:28:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:17 smithi189 ceph-mon[35357]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:18.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.969+0000 7fa07e2d6640 1 -- 172.21.15.81:0/4136099654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa078101de0 msgr2=0x7fa0781021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:18.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.969+0000 7fa07e2d6640 1 --2- 172.21.15.81:0/4136099654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa078101de0 0x7fa0781021c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa068009900 tx=0x7fa06802a410 comp rx=0 tx=0).stop 2024-09-12T01:28:18.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.969+0000 7fa07e2d6640 1 -- 172.21.15.81:0/4136099654 shutdown_connections 2024-09-12T01:28:18.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.969+0000 7fa07e2d6640 1 --2- 172.21.15.81:0/4136099654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa078106f10 0x7fa07810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:18.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.969+0000 7fa07e2d6640 1 --2- 172.21.15.81:0/4136099654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa078102790 0x7fa0781067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:18.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.969+0000 7fa07e2d6640 1 --2- 172.21.15.81:0/4136099654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa078101de0 0x7fa0781021c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:18.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.969+0000 7fa07e2d6640 1 -- 172.21.15.81:0/4136099654 >> 172.21.15.81:0/4136099654 conn(0x7fa0780fd8c0 msgr2=0x7fa0780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:18.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.969+0000 7fa07e2d6640 1 -- 172.21.15.81:0/4136099654 shutdown_connections 2024-09-12T01:28:18.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.969+0000 7fa07e2d6640 1 -- 172.21.15.81:0/4136099654 wait complete. 2024-09-12T01:28:18.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.969+0000 7fa07e2d6640 1 Processor -- start 2024-09-12T01:28:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.969+0000 7fa07e2d6640 1 -- start start 2024-09-12T01:28:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa07e2d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa078101de0 0x7fa0781984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa07e2d6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa078102790 0x7fa0781989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa07e2d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa078106f10 0x7fa07819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa07e2d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa078111f90 con 0x7fa078101de0 2024-09-12T01:28:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa07e2d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa078111e10 con 0x7fa078106f10 2024-09-12T01:28:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa07e2d6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa078112110 con 0x7fa078102790 2024-09-12T01:28:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa077fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa078101de0 0x7fa0781984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:18.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa077fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa078101de0 0x7fa0781984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41380/0 (socket says 172.21.15.81:41380) 2024-09-12T01:28:18.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa077fff640 1 -- 172.21.15.81:0/863714055 learned_addr learned my addr 172.21.15.81:0/863714055 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:18.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa07c873640 1 --2- 172.21.15.81:0/863714055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa078106f10 0x7fa07819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:18.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa077fff640 1 -- 172.21.15.81:0/863714055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa078102790 msgr2=0x7fa0781989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:18.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa077fff640 1 --2- 172.21.15.81:0/863714055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa078102790 0x7fa0781989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:18.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa077fff640 1 -- 172.21.15.81:0/863714055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa078106f10 msgr2=0x7fa07819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:18.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa077fff640 1 --2- 172.21.15.81:0/863714055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa078106f10 0x7fa07819cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:18.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa077fff640 1 -- 172.21.15.81:0/863714055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07819d460 con 0x7fa078101de0 2024-09-12T01:28:18.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.970+0000 7fa077fff640 1 --2- 172.21.15.81:0/863714055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa078101de0 0x7fa0781984b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa068005ab0 tx=0x7fa0680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:18.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.971+0000 7fa0757fa640 1 -- 172.21.15.81:0/863714055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06803f030 con 0x7fa078101de0 2024-09-12T01:28:18.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.971+0000 7fa0757fa640 1 -- 172.21.15.81:0/863714055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa068003ce0 con 0x7fa078101de0 2024-09-12T01:28:18.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.971+0000 7fa07e2d6640 1 -- 172.21.15.81:0/863714055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07819d6f0 con 0x7fa078101de0 2024-09-12T01:28:18.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.971+0000 7fa0757fa640 1 -- 172.21.15.81:0/863714055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068035070 con 0x7fa078101de0 2024-09-12T01:28:18.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.971+0000 7fa07e2d6640 1 -- 172.21.15.81:0/863714055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0781a5030 con 0x7fa078101de0 2024-09-12T01:28:18.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.972+0000 7fa07e2d6640 1 -- 172.21.15.81:0/863714055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0781021c0 con 0x7fa078101de0 2024-09-12T01:28:18.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.973+0000 7fa0757fa640 1 -- 172.21.15.81:0/863714055 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7fa068042030 con 0x7fa078101de0 2024-09-12T01:28:18.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.973+0000 7fa0757fa640 1 --2- 172.21.15.81:0/863714055 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa0600a2d80 0x7fa0600a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:18.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.973+0000 7fa0777fe640 1 --2- 172.21.15.81:0/863714055 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa0600a2d80 0x7fa0600a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:18.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.973+0000 7fa0757fa640 1 -- 172.21.15.81:0/863714055 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fa0680eff40 con 0x7fa078101de0 2024-09-12T01:28:18.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.974+0000 7fa0777fe640 1 --2- 172.21.15.81:0/863714055 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa0600a2d80 0x7fa0600a5240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa0781087d0 tx=0x7fa06c006c90 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:18.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:17.977+0000 7fa0757fa640 1 -- 172.21.15.81:0/863714055 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa0680bca20 con 0x7fa078101de0 2024-09-12T01:28:18.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.141+0000 7fa07e2d6640 1 -- 172.21.15.81:0/863714055 --> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa078062630 con 0x7fa0600a2d80 2024-09-12T01:28:18.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.148+0000 7fa0757fa640 1 -- 172.21.15.81:0/863714055 <== mgr.15222 v2:172.21.15.81:6800/1379528564 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257811 (secure 0 0 0) 0x7fa078062630 con 0x7fa0600a2d80 2024-09-12T01:28:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:18.151 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T01:28:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.152+0000 7fa07e2d6640 1 -- 172.21.15.81:0/863714055 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa0600a2d80 msgr2=0x7fa0600a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.152+0000 7fa07e2d6640 1 --2- 172.21.15.81:0/863714055 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa0600a2d80 0x7fa0600a5240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa0781087d0 tx=0x7fa06c006c90 comp rx=0 tx=0).stop 2024-09-12T01:28:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.152+0000 7fa07e2d6640 1 -- 172.21.15.81:0/863714055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa078101de0 msgr2=0x7fa0781984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:18.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.152+0000 7fa07e2d6640 1 --2- 172.21.15.81:0/863714055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa078101de0 0x7fa0781984b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa068005ab0 tx=0x7fa0680042f0 comp rx=0 tx=0).stop 2024-09-12T01:28:18.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.152+0000 7fa07e2d6640 1 -- 172.21.15.81:0/863714055 shutdown_connections 2024-09-12T01:28:18.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.152+0000 7fa07e2d6640 1 --2- 172.21.15.81:0/863714055 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa0600a2d80 0x7fa0600a5240 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:18.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.152+0000 7fa07e2d6640 1 --2- 172.21.15.81:0/863714055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa078106f10 0x7fa07819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:18.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.152+0000 7fa07e2d6640 1 --2- 172.21.15.81:0/863714055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa078102790 0x7fa0781989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:18.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.152+0000 7fa07e2d6640 1 --2- 172.21.15.81:0/863714055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa078101de0 0x7fa0781984b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:18.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.152+0000 7fa07e2d6640 1 -- 172.21.15.81:0/863714055 >> 172.21.15.81:0/863714055 conn(0x7fa0780fd8c0 msgr2=0x7fa0780feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:18.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.152+0000 7fa07e2d6640 1 -- 172.21.15.81:0/863714055 shutdown_connections 2024-09-12T01:28:18.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:18.152+0000 7fa07e2d6640 1 -- 172.21.15.81:0/863714055 wait complete. 2024-09-12T01:28:18.946 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-12T01:28:17.732332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1387759,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1733,"num_read_kb":1299,"num_write":701,"num_write_kb":5316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180758,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1028,"ondisk_log_size":1028,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381344,"kb_used_data":15072,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124560480,"statfs":{"total":1151940427776,"available":1151549931520,"internally_reserved":0,"allocated":15433728,"data_stored":9493425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":456,"num_read_kb":493,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002401"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881117+0000","last_change":"2024-09-12T01:26:14.433907+0000","last_active":"2024-09-12T01:28:03.881117+0000","last_peered":"2024-09-12T01:28:03.881117+0000","last_clean":"2024-09-12T01:28:03.881117+0000","last_became_active":"2024-09-12T01:26:14.433495+0000","last_became_peered":"2024-09-12T01:26:14.433495+0000","last_unstale":"2024-09-12T01:28:03.881117+0000","last_undegraded":"2024-09-12T01:28:03.881117+0000","last_fullsized":"2024-09-12T01:28:03.881117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:12.836491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883125+0000","last_change":"2024-09-12T01:26:14.430873+0000","last_active":"2024-09-12T01:28:03.883125+0000","last_peered":"2024-09-12T01:28:03.883125+0000","last_clean":"2024-09-12T01:28:03.883125+0000","last_became_active":"2024-09-12T01:26:14.430572+0000","last_became_peered":"2024-09-12T01:26:14.430572+0000","last_unstale":"2024-09-12T01:28:03.883125+0000","last_undegraded":"2024-09-12T01:28:03.883125+0000","last_fullsized":"2024-09-12T01:28:03.883125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:15.160712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882818+0000","last_change":"2024-09-12T01:26:14.426117+0000","last_active":"2024-09-12T01:28:03.882818+0000","last_peered":"2024-09-12T01:28:03.882818+0000","last_clean":"2024-09-12T01:28:03.882818+0000","last_became_active":"2024-09-12T01:26:14.425831+0000","last_became_peered":"2024-09-12T01:26:14.425831+0000","last_unstale":"2024-09-12T01:28:03.882818+0000","last_undegraded":"2024-09-12T01:28:03.882818+0000","last_fullsized":"2024-09-12T01:28:03.882818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:15.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825114+0000","last_change":"2024-09-12T01:26:14.434545+0000","last_active":"2024-09-12T01:28:03.825114+0000","last_peered":"2024-09-12T01:28:03.825114+0000","last_clean":"2024-09-12T01:28:03.825114+0000","last_became_active":"2024-09-12T01:26:14.434222+0000","last_became_peered":"2024-09-12T01:26:14.434222+0000","last_unstale":"2024-09-12T01:28:03.825114+0000","last_undegraded":"2024-09-12T01:28:03.825114+0000","last_fullsized":"2024-09-12T01:28:03.825114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:36.789145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801925+0000","last_change":"2024-09-12T01:26:14.421900+0000","last_active":"2024-09-12T01:28:03.801925+0000","last_peered":"2024-09-12T01:28:03.801925+0000","last_clean":"2024-09-12T01:28:03.801925+0000","last_became_active":"2024-09-12T01:26:14.421558+0000","last_became_peered":"2024-09-12T01:26:14.421558+0000","last_unstale":"2024-09-12T01:28:03.801925+0000","last_undegraded":"2024-09-12T01:28:03.801925+0000","last_fullsized":"2024-09-12T01:28:03.801925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814207+0000","last_change":"2024-09-12T01:26:14.436641+0000","last_active":"2024-09-12T01:28:03.814207+0000","last_peered":"2024-09-12T01:28:03.814207+0000","last_clean":"2024-09-12T01:28:03.814207+0000","last_became_active":"2024-09-12T01:26:14.436347+0000","last_became_peered":"2024-09-12T01:26:14.436347+0000","last_unstale":"2024-09-12T01:28:03.814207+0000","last_undegraded":"2024-09-12T01:28:03.814207+0000","last_fullsized":"2024-09-12T01:28:03.814207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:52.756035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940185+0000","last_change":"2024-09-12T01:26:14.438676+0000","last_active":"2024-09-12T01:28:03.940185+0000","last_peered":"2024-09-12T01:28:03.940185+0000","last_clean":"2024-09-12T01:28:03.940185+0000","last_became_active":"2024-09-12T01:26:14.438332+0000","last_became_peered":"2024-09-12T01:26:14.438332+0000","last_unstale":"2024-09-12T01:28:03.940185+0000","last_undegraded":"2024-09-12T01:28:03.940185+0000","last_fullsized":"2024-09-12T01:28:03.940185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:06.459830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802047+0000","last_change":"2024-09-12T01:26:14.431676+0000","last_active":"2024-09-12T01:28:03.802047+0000","last_peered":"2024-09-12T01:28:03.802047+0000","last_clean":"2024-09-12T01:28:03.802047+0000","last_became_active":"2024-09-12T01:26:14.431378+0000","last_became_peered":"2024-09-12T01:26:14.431378+0000","last_unstale":"2024-09-12T01:28:03.802047+0000","last_undegraded":"2024-09-12T01:28:03.802047+0000","last_fullsized":"2024-09-12T01:28:03.802047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:23.523350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717979+0000","last_change":"2024-09-12T01:26:14.428381+0000","last_active":"2024-09-12T01:28:03.717979+0000","last_peered":"2024-09-12T01:28:03.717979+0000","last_clean":"2024-09-12T01:28:03.717979+0000","last_became_active":"2024-09-12T01:26:14.428031+0000","last_became_peered":"2024-09-12T01:26:14.428031+0000","last_unstale":"2024-09-12T01:28:03.717979+0000","last_undegraded":"2024-09-12T01:28:03.717979+0000","last_fullsized":"2024-09-12T01:28:03.717979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:40.920911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814620+0000","last_change":"2024-09-12T01:26:14.438849+0000","last_active":"2024-09-12T01:28:03.814620+0000","last_peered":"2024-09-12T01:28:03.814620+0000","last_clean":"2024-09-12T01:28:03.814620+0000","last_became_active":"2024-09-12T01:26:14.438510+0000","last_became_peered":"2024-09-12T01:26:14.438510+0000","last_unstale":"2024-09-12T01:28:03.814620+0000","last_undegraded":"2024-09-12T01:28:03.814620+0000","last_fullsized":"2024-09-12T01:28:03.814620+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:12.257292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940484+0000","last_change":"2024-09-12T01:26:14.436468+0000","last_active":"2024-09-12T01:28:03.940484+0000","last_peered":"2024-09-12T01:28:03.940484+0000","last_clean":"2024-09-12T01:28:03.940484+0000","last_became_active":"2024-09-12T01:26:14.436095+0000","last_became_peered":"2024-09-12T01:26:14.436095+0000","last_unstale":"2024-09-12T01:28:03.940484+0000","last_undegraded":"2024-09-12T01:28:03.940484+0000","last_fullsized":"2024-09-12T01:28:03.940484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:43.441358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825119+0000","last_change":"2024-09-12T01:26:14.431384+0000","last_active":"2024-09-12T01:28:03.825119+0000","last_peered":"2024-09-12T01:28:03.825119+0000","last_clean":"2024-09-12T01:28:03.825119+0000","last_became_active":"2024-09-12T01:26:14.431079+0000","last_became_peered":"2024-09-12T01:26:14.431079+0000","last_unstale":"2024-09-12T01:28:03.825119+0000","last_undegraded":"2024-09-12T01:28:03.825119+0000","last_fullsized":"2024-09-12T01:28:03.825119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.178038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882393+0000","last_change":"2024-09-12T01:26:14.430163+0000","last_active":"2024-09-12T01:28:03.882393+0000","last_peered":"2024-09-12T01:28:03.882393+0000","last_clean":"2024-09-12T01:28:03.882393+0000","last_became_active":"2024-09-12T01:26:14.429863+0000","last_became_peered":"2024-09-12T01:26:14.429863+0000","last_unstale":"2024-09-12T01:28:03.882393+0000","last_undegraded":"2024-09-12T01:28:03.882393+0000","last_fullsized":"2024-09-12T01:28:03.882393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:44.432677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882103+0000","last_change":"2024-09-12T01:26:14.427304+0000","last_active":"2024-09-12T01:28:03.882103+0000","last_peered":"2024-09-12T01:28:03.882103+0000","last_clean":"2024-09-12T01:28:03.882103+0000","last_became_active":"2024-09-12T01:26:14.427006+0000","last_became_peered":"2024-09-12T01:26:14.427006+0000","last_unstale":"2024-09-12T01:28:03.882103+0000","last_undegraded":"2024-09-12T01:28:03.882103+0000","last_fullsized":"2024-09-12T01:28:03.882103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.930959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881815+0000","last_change":"2024-09-12T01:26:14.431018+0000","last_active":"2024-09-12T01:28:03.881815+0000","last_peered":"2024-09-12T01:28:03.881815+0000","last_clean":"2024-09-12T01:28:03.881815+0000","last_became_active":"2024-09-12T01:26:14.429518+0000","last_became_peered":"2024-09-12T01:26:14.429518+0000","last_unstale":"2024-09-12T01:28:03.881815+0000","last_undegraded":"2024-09-12T01:28:03.881815+0000","last_fullsized":"2024-09-12T01:28:03.881815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.504814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717400+0000","last_change":"2024-09-12T01:26:14.430601+0000","last_active":"2024-09-12T01:28:03.717400+0000","last_peered":"2024-09-12T01:28:03.717400+0000","last_clean":"2024-09-12T01:28:03.717400+0000","last_became_active":"2024-09-12T01:26:14.430304+0000","last_became_peered":"2024-09-12T01:26:14.430304+0000","last_unstale":"2024-09-12T01:28:03.717400+0000","last_undegraded":"2024-09-12T01:28:03.717400+0000","last_fullsized":"2024-09-12T01:28:03.717400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.414767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881148+0000","last_change":"2024-09-12T01:26:14.432934+0000","last_active":"2024-09-12T01:28:03.881148+0000","last_peered":"2024-09-12T01:28:03.881148+0000","last_clean":"2024-09-12T01:28:03.881148+0000","last_became_active":"2024-09-12T01:26:14.432417+0000","last_became_peered":"2024-09-12T01:26:14.432417+0000","last_unstale":"2024-09-12T01:28:03.881148+0000","last_undegraded":"2024-09-12T01:28:03.881148+0000","last_fullsized":"2024-09-12T01:28:03.881148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:33.964880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716779+0000","last_change":"2024-09-12T01:26:14.429956+0000","last_active":"2024-09-12T01:28:03.716779+0000","last_peered":"2024-09-12T01:28:03.716779+0000","last_clean":"2024-09-12T01:28:03.716779+0000","last_became_active":"2024-09-12T01:26:14.429610+0000","last_became_peered":"2024-09-12T01:26:14.429610+0000","last_unstale":"2024-09-12T01:28:03.716779+0000","last_undegraded":"2024-09-12T01:28:03.716779+0000","last_fullsized":"2024-09-12T01:28:03.716779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:51.453221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720646+0000","last_change":"2024-09-12T01:26:14.423624+0000","last_active":"2024-09-12T01:28:03.720646+0000","last_peered":"2024-09-12T01:28:03.720646+0000","last_clean":"2024-09-12T01:28:03.720646+0000","last_became_active":"2024-09-12T01:26:14.423314+0000","last_became_peered":"2024-09-12T01:26:14.423314+0000","last_unstale":"2024-09-12T01:28:03.720646+0000","last_undegraded":"2024-09-12T01:28:03.720646+0000","last_fullsized":"2024-09-12T01:28:03.720646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.414323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880810+0000","last_change":"2024-09-12T01:26:14.433548+0000","last_active":"2024-09-12T01:28:03.880810+0000","last_peered":"2024-09-12T01:28:03.880810+0000","last_clean":"2024-09-12T01:28:03.880810+0000","last_became_active":"2024-09-12T01:26:14.433223+0000","last_became_peered":"2024-09-12T01:26:14.433223+0000","last_unstale":"2024-09-12T01:28:03.880810+0000","last_undegraded":"2024-09-12T01:28:03.880810+0000","last_fullsized":"2024-09-12T01:28:03.880810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.247354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882535+0000","last_change":"2024-09-12T01:26:14.431715+0000","last_active":"2024-09-12T01:28:03.882535+0000","last_peered":"2024-09-12T01:28:03.882535+0000","last_clean":"2024-09-12T01:28:03.882535+0000","last_became_active":"2024-09-12T01:26:14.430839+0000","last_became_peered":"2024-09-12T01:26:14.430839+0000","last_unstale":"2024-09-12T01:28:03.882535+0000","last_undegraded":"2024-09-12T01:28:03.882535+0000","last_fullsized":"2024-09-12T01:28:03.882535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:04.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717611+0000","last_change":"2024-09-12T01:26:14.431385+0000","last_active":"2024-09-12T01:28:03.717611+0000","last_peered":"2024-09-12T01:28:03.717611+0000","last_clean":"2024-09-12T01:28:03.717611+0000","last_became_active":"2024-09-12T01:26:14.431046+0000","last_became_peered":"2024-09-12T01:26:14.431046+0000","last_unstale":"2024-09-12T01:28:03.717611+0000","last_undegraded":"2024-09-12T01:28:03.717611+0000","last_fullsized":"2024-09-12T01:28:03.717611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:42.495019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802146+0000","last_change":"2024-09-12T01:26:14.427737+0000","last_active":"2024-09-12T01:28:03.802146+0000","last_peered":"2024-09-12T01:28:03.802146+0000","last_clean":"2024-09-12T01:28:03.802146+0000","last_became_active":"2024-09-12T01:26:14.427409+0000","last_became_peered":"2024-09-12T01:26:14.427409+0000","last_unstale":"2024-09-12T01:28:03.802146+0000","last_undegraded":"2024-09-12T01:28:03.802146+0000","last_fullsized":"2024-09-12T01:28:03.802146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:02.632914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811345+0000","last_change":"2024-09-12T01:26:14.433426+0000","last_active":"2024-09-12T01:28:03.811345+0000","last_peered":"2024-09-12T01:28:03.811345+0000","last_clean":"2024-09-12T01:28:03.811345+0000","last_became_active":"2024-09-12T01:26:14.431918+0000","last_became_peered":"2024-09-12T01:26:14.431918+0000","last_unstale":"2024-09-12T01:28:03.811345+0000","last_undegraded":"2024-09-12T01:28:03.811345+0000","last_fullsized":"2024-09-12T01:28:03.811345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.946072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716825+0000","last_change":"2024-09-12T01:26:26.268358+0000","last_active":"2024-09-12T01:28:03.716825+0000","last_peered":"2024-09-12T01:28:03.716825+0000","last_clean":"2024-09-12T01:28:03.716825+0000","last_became_active":"2024-09-12T01:26:26.268005+0000","last_became_peered":"2024-09-12T01:26:26.268005+0000","last_unstale":"2024-09-12T01:28:03.716825+0000","last_undegraded":"2024-09-12T01:28:03.716825+0000","last_fullsized":"2024-09-12T01:28:03.716825+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:53.977249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720710+0000","last_change":"2024-09-12T01:26:14.434536+0000","last_active":"2024-09-12T01:28:03.720710+0000","last_peered":"2024-09-12T01:28:03.720710+0000","last_clean":"2024-09-12T01:28:03.720710+0000","last_became_active":"2024-09-12T01:26:14.434148+0000","last_became_peered":"2024-09-12T01:26:14.434148+0000","last_unstale":"2024-09-12T01:28:03.720710+0000","last_undegraded":"2024-09-12T01:28:03.720710+0000","last_fullsized":"2024-09-12T01:28:03.720710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:47.576827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880923+0000","last_change":"2024-09-12T01:26:14.428040+0000","last_active":"2024-09-12T01:28:03.880923+0000","last_peered":"2024-09-12T01:28:03.880923+0000","last_clean":"2024-09-12T01:28:03.880923+0000","last_became_active":"2024-09-12T01:26:14.427709+0000","last_became_peered":"2024-09-12T01:26:14.427709+0000","last_unstale":"2024-09-12T01:28:03.880923+0000","last_undegraded":"2024-09-12T01:28:03.880923+0000","last_fullsized":"2024-09-12T01:28:03.880923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.256097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882750+0000","last_change":"2024-09-12T01:26:26.265649+0000","last_active":"2024-09-12T01:28:03.882750+0000","last_peered":"2024-09-12T01:28:03.882750+0000","last_clean":"2024-09-12T01:28:03.882750+0000","last_became_active":"2024-09-12T01:26:26.265251+0000","last_became_peered":"2024-09-12T01:26:26.265251+0000","last_unstale":"2024-09-12T01:28:03.882750+0000","last_undegraded":"2024-09-12T01:28:03.882750+0000","last_fullsized":"2024-09-12T01:28:03.882750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:31.787101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882448+0000","last_change":"2024-09-12T01:26:14.427596+0000","last_active":"2024-09-12T01:28:03.882448+0000","last_peered":"2024-09-12T01:28:03.882448+0000","last_clean":"2024-09-12T01:28:03.882448+0000","last_became_active":"2024-09-12T01:26:14.427291+0000","last_became_peered":"2024-09-12T01:26:14.427291+0000","last_unstale":"2024-09-12T01:28:03.882448+0000","last_undegraded":"2024-09-12T01:28:03.882448+0000","last_fullsized":"2024-09-12T01:28:03.882448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:51.529835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720369+0000","last_change":"2024-09-12T01:26:14.424197+0000","last_active":"2024-09-12T01:28:03.720369+0000","last_peered":"2024-09-12T01:28:03.720369+0000","last_clean":"2024-09-12T01:28:03.720369+0000","last_became_active":"2024-09-12T01:26:14.423422+0000","last_became_peered":"2024-09-12T01:26:14.423422+0000","last_unstale":"2024-09-12T01:28:03.720369+0000","last_undegraded":"2024-09-12T01:28:03.720369+0000","last_fullsized":"2024-09-12T01:28:03.720369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.725623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720421+0000","last_change":"2024-09-12T01:26:14.428116+0000","last_active":"2024-09-12T01:28:03.720421+0000","last_peered":"2024-09-12T01:28:03.720421+0000","last_clean":"2024-09-12T01:28:03.720421+0000","last_became_active":"2024-09-12T01:26:14.427804+0000","last_became_peered":"2024-09-12T01:26:14.427804+0000","last_unstale":"2024-09-12T01:28:03.720421+0000","last_undegraded":"2024-09-12T01:28:03.720421+0000","last_fullsized":"2024-09-12T01:28:03.720421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:02.271305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880755+0000","last_change":"2024-09-12T01:26:14.432659+0000","last_active":"2024-09-12T01:28:03.880755+0000","last_peered":"2024-09-12T01:28:03.880755+0000","last_clean":"2024-09-12T01:28:03.880755+0000","last_became_active":"2024-09-12T01:26:14.432331+0000","last_became_peered":"2024-09-12T01:26:14.432331+0000","last_unstale":"2024-09-12T01:28:03.880755+0000","last_undegraded":"2024-09-12T01:28:03.880755+0000","last_fullsized":"2024-09-12T01:28:03.880755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:37.868909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801888+0000","last_change":"2024-09-12T01:26:14.426167+0000","last_active":"2024-09-12T01:28:03.801888+0000","last_peered":"2024-09-12T01:28:03.801888+0000","last_clean":"2024-09-12T01:28:03.801888+0000","last_became_active":"2024-09-12T01:26:14.425847+0000","last_became_peered":"2024-09-12T01:26:14.425847+0000","last_unstale":"2024-09-12T01:28:03.801888+0000","last_undegraded":"2024-09-12T01:28:03.801888+0000","last_fullsized":"2024-09-12T01:28:03.801888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:39.481527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.411843+0000","last_change":"2024-09-12T01:26:12.421487+0000","last_active":"2024-09-12T01:28:13.411843+0000","last_peered":"2024-09-12T01:28:13.411843+0000","last_clean":"2024-09-12T01:28:13.411843+0000","last_became_active":"2024-09-12T01:26:12.421096+0000","last_became_peered":"2024-09-12T01:26:12.421096+0000","last_unstale":"2024-09-12T01:28:13.411843+0000","last_undegraded":"2024-09-12T01:28:13.411843+0000","last_fullsized":"2024-09-12T01:28:13.411843+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:12.410280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811514+0000","last_change":"2024-09-12T01:26:26.270310+0000","last_active":"2024-09-12T01:28:03.811514+0000","last_peered":"2024-09-12T01:28:03.811514+0000","last_clean":"2024-09-12T01:28:03.811514+0000","last_became_active":"2024-09-12T01:26:26.269917+0000","last_became_peered":"2024-09-12T01:26:26.269917+0000","last_unstale":"2024-09-12T01:28:03.811514+0000","last_undegraded":"2024-09-12T01:28:03.811514+0000","last_fullsized":"2024-09-12T01:28:03.811514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:29.549456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814260+0000","last_change":"2024-09-12T01:26:26.287218+0000","last_active":"2024-09-12T01:28:03.814260+0000","last_peered":"2024-09-12T01:28:03.814260+0000","last_clean":"2024-09-12T01:28:03.814260+0000","last_became_active":"2024-09-12T01:26:26.282251+0000","last_became_peered":"2024-09-12T01:26:26.282251+0000","last_unstale":"2024-09-12T01:28:03.814260+0000","last_undegraded":"2024-09-12T01:28:03.814260+0000","last_fullsized":"2024-09-12T01:28:03.814260+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:53.888064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883469+0000","last_change":"2024-09-12T01:26:12.416100+0000","last_active":"2024-09-12T01:28:03.883469+0000","last_peered":"2024-09-12T01:28:03.883469+0000","last_clean":"2024-09-12T01:28:03.883469+0000","last_became_active":"2024-09-12T01:26:12.415799+0000","last_became_peered":"2024-09-12T01:26:12.415799+0000","last_unstale":"2024-09-12T01:28:03.883469+0000","last_undegraded":"2024-09-12T01:28:03.883469+0000","last_fullsized":"2024-09-12T01:28:03.883469+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:41.826537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802089+0000","last_change":"2024-09-12T01:26:14.424922+0000","last_active":"2024-09-12T01:28:03.802089+0000","last_peered":"2024-09-12T01:28:03.802089+0000","last_clean":"2024-09-12T01:28:03.802089+0000","last_became_active":"2024-09-12T01:26:14.424580+0000","last_became_peered":"2024-09-12T01:26:14.424580+0000","last_unstale":"2024-09-12T01:28:03.802089+0000","last_undegraded":"2024-09-12T01:28:03.802089+0000","last_fullsized":"2024-09-12T01:28:03.802089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:05.697287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811489+0000","last_change":"2024-09-12T01:26:12.419339+0000","last_active":"2024-09-12T01:28:03.811489+0000","last_peered":"2024-09-12T01:28:03.811489+0000","last_clean":"2024-09-12T01:28:03.811489+0000","last_became_active":"2024-09-12T01:26:12.418925+0000","last_became_peered":"2024-09-12T01:26:12.418925+0000","last_unstale":"2024-09-12T01:28:03.811489+0000","last_undegraded":"2024-09-12T01:28:03.811489+0000","last_fullsized":"2024-09-12T01:28:03.811489+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.390691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716540+0000","last_change":"2024-09-12T01:26:14.426611+0000","last_active":"2024-09-12T01:28:03.716540+0000","last_peered":"2024-09-12T01:28:03.716540+0000","last_clean":"2024-09-12T01:28:03.716540+0000","last_became_active":"2024-09-12T01:26:14.426268+0000","last_became_peered":"2024-09-12T01:26:14.426268+0000","last_unstale":"2024-09-12T01:28:03.716540+0000","last_undegraded":"2024-09-12T01:28:03.716540+0000","last_fullsized":"2024-09-12T01:28:03.716540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:34.676841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":250,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:14.412674+0000","last_change":"2024-09-12T01:26:12.420302+0000","last_active":"2024-09-12T01:28:14.412674+0000","last_peered":"2024-09-12T01:28:14.412674+0000","last_clean":"2024-09-12T01:28:14.412674+0000","last_became_active":"2024-09-12T01:26:12.419943+0000","last_became_peered":"2024-09-12T01:26:12.419943+0000","last_unstale":"2024-09-12T01:28:14.412674+0000","last_undegraded":"2024-09-12T01:28:14.412674+0000","last_fullsized":"2024-09-12T01:28:14.412674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:30.704272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":220,"num_read_kb":220,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717828+0000","last_change":"2024-09-12T01:26:14.433112+0000","last_active":"2024-09-12T01:28:03.717828+0000","last_peered":"2024-09-12T01:28:03.717828+0000","last_clean":"2024-09-12T01:28:03.717828+0000","last_became_active":"2024-09-12T01:26:14.432803+0000","last_became_peered":"2024-09-12T01:26:14.432803+0000","last_unstale":"2024-09-12T01:28:03.717828+0000","last_undegraded":"2024-09-12T01:28:03.717828+0000","last_fullsized":"2024-09-12T01:28:03.717828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:33.670485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940319+0000","last_change":"2024-09-12T01:26:12.424854+0000","last_active":"2024-09-12T01:28:03.940319+0000","last_peered":"2024-09-12T01:28:03.940319+0000","last_clean":"2024-09-12T01:28:03.940319+0000","last_became_active":"2024-09-12T01:26:12.424476+0000","last_became_peered":"2024-09-12T01:26:12.424476+0000","last_unstale":"2024-09-12T01:28:03.940319+0000","last_undegraded":"2024-09-12T01:28:03.940319+0000","last_fullsized":"2024-09-12T01:28:03.940319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:03.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883795+0000","last_change":"2024-09-12T01:26:14.431580+0000","last_active":"2024-09-12T01:28:03.883795+0000","last_peered":"2024-09-12T01:28:03.883795+0000","last_clean":"2024-09-12T01:28:03.883795+0000","last_became_active":"2024-09-12T01:26:14.431237+0000","last_became_peered":"2024-09-12T01:26:14.431237+0000","last_unstale":"2024-09-12T01:28:03.883795+0000","last_undegraded":"2024-09-12T01:28:03.883795+0000","last_fullsized":"2024-09-12T01:28:03.883795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:32.562156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811710+0000","last_change":"2024-09-12T01:26:12.802015+0000","last_active":"2024-09-12T01:28:03.811710+0000","last_peered":"2024-09-12T01:28:03.811710+0000","last_clean":"2024-09-12T01:28:03.811710+0000","last_became_active":"2024-09-12T01:26:12.801605+0000","last_became_peered":"2024-09-12T01:26:12.801605+0000","last_unstale":"2024-09-12T01:28:03.811710+0000","last_undegraded":"2024-09-12T01:28:03.811710+0000","last_fullsized":"2024-09-12T01:28:03.811710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:24.703911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717615+0000","last_change":"2024-09-12T01:26:14.433305+0000","last_active":"2024-09-12T01:28:03.717615+0000","last_peered":"2024-09-12T01:28:03.717615+0000","last_clean":"2024-09-12T01:28:03.717615+0000","last_became_active":"2024-09-12T01:26:14.432989+0000","last_became_peered":"2024-09-12T01:26:14.432989+0000","last_unstale":"2024-09-12T01:28:03.717615+0000","last_undegraded":"2024-09-12T01:28:03.717615+0000","last_fullsized":"2024-09-12T01:28:03.717615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:45.741460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":294,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:14.412788+0000","last_change":"2024-09-12T01:26:12.423148+0000","last_active":"2024-09-12T01:28:14.412788+0000","last_peered":"2024-09-12T01:28:14.412788+0000","last_clean":"2024-09-12T01:28:14.412788+0000","last_became_active":"2024-09-12T01:26:12.422754+0000","last_became_peered":"2024-09-12T01:26:12.422754+0000","last_unstale":"2024-09-12T01:28:14.412788+0000","last_undegraded":"2024-09-12T01:28:14.412788+0000","last_fullsized":"2024-09-12T01:28:14.412788+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:01.017125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":234,"num_read_kb":183,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802221+0000","last_change":"2024-09-12T01:26:14.431568+0000","last_active":"2024-09-12T01:28:03.802221+0000","last_peered":"2024-09-12T01:28:03.802221+0000","last_clean":"2024-09-12T01:28:03.802221+0000","last_became_active":"2024-09-12T01:26:14.431215+0000","last_became_peered":"2024-09-12T01:26:14.431215+0000","last_unstale":"2024-09-12T01:28:03.802221+0000","last_undegraded":"2024-09-12T01:28:03.802221+0000","last_fullsized":"2024-09-12T01:28:03.802221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.552147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720527+0000","last_change":"2024-09-12T01:26:12.421986+0000","last_active":"2024-09-12T01:28:03.720527+0000","last_peered":"2024-09-12T01:28:03.720527+0000","last_clean":"2024-09-12T01:28:03.720527+0000","last_became_active":"2024-09-12T01:26:12.421391+0000","last_became_peered":"2024-09-12T01:26:12.421391+0000","last_unstale":"2024-09-12T01:28:03.720527+0000","last_undegraded":"2024-09-12T01:28:03.720527+0000","last_fullsized":"2024-09-12T01:28:03.720527+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:20.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881940+0000","last_change":"2024-09-12T01:26:14.431435+0000","last_active":"2024-09-12T01:28:03.881940+0000","last_peered":"2024-09-12T01:28:03.881940+0000","last_clean":"2024-09-12T01:28:03.881940+0000","last_became_active":"2024-09-12T01:26:14.431143+0000","last_became_peered":"2024-09-12T01:26:14.431143+0000","last_unstale":"2024-09-12T01:28:03.881940+0000","last_undegraded":"2024-09-12T01:28:03.881940+0000","last_fullsized":"2024-09-12T01:28:03.881940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:58.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811440+0000","last_change":"2024-09-12T01:26:12.423972+0000","last_active":"2024-09-12T01:28:03.811440+0000","last_peered":"2024-09-12T01:28:03.811440+0000","last_clean":"2024-09-12T01:28:03.811440+0000","last_became_active":"2024-09-12T01:26:12.423594+0000","last_became_peered":"2024-09-12T01:26:12.423594+0000","last_unstale":"2024-09-12T01:28:03.811440+0000","last_undegraded":"2024-09-12T01:28:03.811440+0000","last_fullsized":"2024-09-12T01:28:03.811440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:37.783478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940307+0000","last_change":"2024-09-12T01:26:14.437207+0000","last_active":"2024-09-12T01:28:03.940307+0000","last_peered":"2024-09-12T01:28:03.940307+0000","last_clean":"2024-09-12T01:28:03.940307+0000","last_became_active":"2024-09-12T01:26:14.436940+0000","last_became_peered":"2024-09-12T01:26:14.436940+0000","last_unstale":"2024-09-12T01:28:03.940307+0000","last_undegraded":"2024-09-12T01:28:03.940307+0000","last_fullsized":"2024-09-12T01:28:03.940307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:34.454446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'9","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.413800+0000","last_change":"2024-09-12T01:26:12.420247+0000","last_active":"2024-09-12T01:28:13.413800+0000","last_peered":"2024-09-12T01:28:13.413800+0000","last_clean":"2024-09-12T01:28:13.413800+0000","last_became_active":"2024-09-12T01:26:12.419825+0000","last_became_peered":"2024-09-12T01:26:12.419825+0000","last_unstale":"2024-09-12T01:28:13.413800+0000","last_undegraded":"2024-09-12T01:28:13.413800+0000","last_fullsized":"2024-09-12T01:28:13.413800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:26.746225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1908,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":6,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940127+0000","last_change":"2024-09-12T01:26:14.439019+0000","last_active":"2024-09-12T01:28:03.940127+0000","last_peered":"2024-09-12T01:28:03.940127+0000","last_clean":"2024-09-12T01:28:03.940127+0000","last_became_active":"2024-09-12T01:26:14.438714+0000","last_became_peered":"2024-09-12T01:26:14.438714+0000","last_unstale":"2024-09-12T01:28:03.940127+0000","last_undegraded":"2024-09-12T01:28:03.940127+0000","last_fullsized":"2024-09-12T01:28:03.940127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.321464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801873+0000","last_change":"2024-09-12T01:26:12.800529+0000","last_active":"2024-09-12T01:28:03.801873+0000","last_peered":"2024-09-12T01:28:03.801873+0000","last_clean":"2024-09-12T01:28:03.801873+0000","last_became_active":"2024-09-12T01:26:12.800104+0000","last_became_peered":"2024-09-12T01:26:12.800104+0000","last_unstale":"2024-09-12T01:28:03.801873+0000","last_undegraded":"2024-09-12T01:28:03.801873+0000","last_fullsized":"2024-09-12T01:28:03.801873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.624321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811417+0000","last_change":"2024-09-12T01:26:14.435283+0000","last_active":"2024-09-12T01:28:03.811417+0000","last_peered":"2024-09-12T01:28:03.811417+0000","last_clean":"2024-09-12T01:28:03.811417+0000","last_became_active":"2024-09-12T01:26:14.434414+0000","last_became_peered":"2024-09-12T01:26:14.434414+0000","last_unstale":"2024-09-12T01:28:03.811417+0000","last_undegraded":"2024-09-12T01:28:03.811417+0000","last_fullsized":"2024-09-12T01:28:03.811417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.959405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'3","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.881086+0000","last_change":"2024-09-12T01:26:26.273053+0000","last_active":"2024-09-12T01:28:03.881086+0000","last_peered":"2024-09-12T01:28:03.881086+0000","last_clean":"2024-09-12T01:28:03.881086+0000","last_became_active":"2024-09-12T01:26:26.267178+0000","last_became_peered":"2024-09-12T01:26:26.267178+0000","last_unstale":"2024-09-12T01:28:03.881086+0000","last_undegraded":"2024-09-12T01:28:03.881086+0000","last_fullsized":"2024-09-12T01:28:03.881086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:08.138485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880948+0000","last_change":"2024-09-12T01:26:14.433527+0000","last_active":"2024-09-12T01:28:03.880948+0000","last_peered":"2024-09-12T01:28:03.880948+0000","last_clean":"2024-09-12T01:28:03.880948+0000","last_became_active":"2024-09-12T01:26:14.433204+0000","last_became_peered":"2024-09-12T01:26:14.433204+0000","last_unstale":"2024-09-12T01:28:03.880948+0000","last_undegraded":"2024-09-12T01:28:03.880948+0000","last_fullsized":"2024-09-12T01:28:03.880948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:26.883916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883147+0000","last_change":"2024-09-12T01:26:12.420795+0000","last_active":"2024-09-12T01:28:03.883147+0000","last_peered":"2024-09-12T01:28:03.883147+0000","last_clean":"2024-09-12T01:28:03.883147+0000","last_became_active":"2024-09-12T01:26:12.420409+0000","last_became_peered":"2024-09-12T01:26:12.420409+0000","last_unstale":"2024-09-12T01:28:03.883147+0000","last_undegraded":"2024-09-12T01:28:03.883147+0000","last_fullsized":"2024-09-12T01:28:03.883147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:36.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940454+0000","last_change":"2024-09-12T01:26:14.440994+0000","last_active":"2024-09-12T01:28:03.940454+0000","last_peered":"2024-09-12T01:28:03.940454+0000","last_clean":"2024-09-12T01:28:03.940454+0000","last_became_active":"2024-09-12T01:26:14.440602+0000","last_became_peered":"2024-09-12T01:26:14.440602+0000","last_unstale":"2024-09-12T01:28:03.940454+0000","last_undegraded":"2024-09-12T01:28:03.940454+0000","last_fullsized":"2024-09-12T01:28:03.940454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.998991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'67","reported_seq":122,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:12.798180+0000","last_change":"2024-09-12T01:26:12.419448+0000","last_active":"2024-09-12T01:28:12.798180+0000","last_peered":"2024-09-12T01:28:12.798180+0000","last_clean":"2024-09-12T01:28:12.798180+0000","last_became_active":"2024-09-12T01:26:12.419000+0000","last_became_peered":"2024-09-12T01:26:12.419000+0000","last_unstale":"2024-09-12T01:28:12.798180+0000","last_undegraded":"2024-09-12T01:28:12.798180+0000","last_fullsized":"2024-09-12T01:28:12.798180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:37.818833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940268+0000","last_change":"2024-09-12T01:26:14.437818+0000","last_active":"2024-09-12T01:28:03.940268+0000","last_peered":"2024-09-12T01:28:03.940268+0000","last_clean":"2024-09-12T01:28:03.940268+0000","last_became_active":"2024-09-12T01:26:14.437497+0000","last_became_peered":"2024-09-12T01:26:14.437497+0000","last_unstale":"2024-09-12T01:28:03.940268+0000","last_undegraded":"2024-09-12T01:28:03.940268+0000","last_fullsized":"2024-09-12T01:28:03.940268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:57.876866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'7","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.676738+0000","last_change":"2024-09-12T01:26:12.855850+0000","last_active":"2024-09-12T01:28:13.676738+0000","last_peered":"2024-09-12T01:28:13.676738+0000","last_clean":"2024-09-12T01:28:13.676738+0000","last_became_active":"2024-09-12T01:26:12.855400+0000","last_became_peered":"2024-09-12T01:26:12.855400+0000","last_unstale":"2024-09-12T01:28:13.676738+0000","last_undegraded":"2024-09-12T01:28:13.676738+0000","last_fullsized":"2024-09-12T01:28:13.676738+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:32.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940460+0000","last_change":"2024-09-12T01:26:14.435982+0000","last_active":"2024-09-12T01:28:03.940460+0000","last_peered":"2024-09-12T01:28:03.940460+0000","last_clean":"2024-09-12T01:28:03.940460+0000","last_became_active":"2024-09-12T01:26:14.435595+0000","last_became_peered":"2024-09-12T01:26:14.435595+0000","last_unstale":"2024-09-12T01:28:03.940460+0000","last_undegraded":"2024-09-12T01:28:03.940460+0000","last_fullsized":"2024-09-12T01:28:03.940460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:31.101890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"83'148","reported_seq":390,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:05.821001+0000","last_change":"2024-09-12T01:25:04.588449+0000","last_active":"2024-09-12T01:28:05.821001+0000","last_peered":"2024-09-12T01:28:05.821001+0000","last_clean":"2024-09-12T01:28:05.821001+0000","last_became_active":"2024-09-12T01:25:04.587949+0000","last_became_peered":"2024-09-12T01:25:04.587949+0000","last_unstale":"2024-09-12T01:28:05.821001+0000","last_undegraded":"2024-09-12T01:28:05.821001+0000","last_fullsized":"2024-09-12T01:28:05.821001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:21:41.345624+0000","last_clean_scrub_stamp":"2024-09-12T01:21:41.345624+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:41.015289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825146+0000","last_change":"2024-09-12T01:26:12.421379+0000","last_active":"2024-09-12T01:28:03.825146+0000","last_peered":"2024-09-12T01:28:03.825146+0000","last_clean":"2024-09-12T01:28:03.825146+0000","last_became_active":"2024-09-12T01:26:12.421059+0000","last_became_peered":"2024-09-12T01:26:12.421059+0000","last_unstale":"2024-09-12T01:28:03.825146+0000","last_undegraded":"2024-09-12T01:28:03.825146+0000","last_fullsized":"2024-09-12T01:28:03.825146+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.022685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802270+0000","last_change":"2024-09-12T01:26:14.430510+0000","last_active":"2024-09-12T01:28:03.802270+0000","last_peered":"2024-09-12T01:28:03.802270+0000","last_clean":"2024-09-12T01:28:03.802270+0000","last_became_active":"2024-09-12T01:26:14.430232+0000","last_became_peered":"2024-09-12T01:26:14.430232+0000","last_unstale":"2024-09-12T01:28:03.802270+0000","last_undegraded":"2024-09-12T01:28:03.802270+0000","last_fullsized":"2024-09-12T01:28:03.802270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:55.114616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940306+0000","last_change":"2024-09-12T01:26:12.420938+0000","last_active":"2024-09-12T01:28:03.940306+0000","last_peered":"2024-09-12T01:28:03.940306+0000","last_clean":"2024-09-12T01:28:03.940306+0000","last_became_active":"2024-09-12T01:26:12.420599+0000","last_became_peered":"2024-09-12T01:26:12.420599+0000","last_unstale":"2024-09-12T01:28:03.940306+0000","last_undegraded":"2024-09-12T01:28:03.940306+0000","last_fullsized":"2024-09-12T01:28:03.940306+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.593237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883352+0000","last_change":"2024-09-12T01:26:14.428684+0000","last_active":"2024-09-12T01:28:03.883352+0000","last_peered":"2024-09-12T01:28:03.883352+0000","last_clean":"2024-09-12T01:28:03.883352+0000","last_became_active":"2024-09-12T01:26:14.428380+0000","last_became_peered":"2024-09-12T01:26:14.428380+0000","last_unstale":"2024-09-12T01:28:03.883352+0000","last_undegraded":"2024-09-12T01:28:03.883352+0000","last_fullsized":"2024-09-12T01:28:03.883352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:21.542122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":142,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.413211+0000","last_change":"2024-09-12T01:26:12.800048+0000","last_active":"2024-09-12T01:28:13.413211+0000","last_peered":"2024-09-12T01:28:13.413211+0000","last_clean":"2024-09-12T01:28:13.413211+0000","last_became_active":"2024-09-12T01:26:12.799646+0000","last_became_peered":"2024-09-12T01:26:12.799646+0000","last_unstale":"2024-09-12T01:28:13.413211+0000","last_undegraded":"2024-09-12T01:28:13.413211+0000","last_fullsized":"2024-09-12T01:28:13.413211+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:39.249159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716527+0000","last_change":"2024-09-12T01:26:26.268110+0000","last_active":"2024-09-12T01:28:03.716527+0000","last_peered":"2024-09-12T01:28:03.716527+0000","last_clean":"2024-09-12T01:28:03.716527+0000","last_became_active":"2024-09-12T01:26:26.267764+0000","last_became_peered":"2024-09-12T01:26:26.267764+0000","last_unstale":"2024-09-12T01:28:03.716527+0000","last_undegraded":"2024-09-12T01:28:03.716527+0000","last_fullsized":"2024-09-12T01:28:03.716527+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:37.009529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":142,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:14.640950+0000","last_change":"2024-09-12T01:26:12.424189+0000","last_active":"2024-09-12T01:28:14.640950+0000","last_peered":"2024-09-12T01:28:14.640950+0000","last_clean":"2024-09-12T01:28:14.640950+0000","last_became_active":"2024-09-12T01:26:12.423785+0000","last_became_peered":"2024-09-12T01:26:12.423785+0000","last_unstale":"2024-09-12T01:28:14.640950+0000","last_undegraded":"2024-09-12T01:28:14.640950+0000","last_fullsized":"2024-09-12T01:28:14.640950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:20.069821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814343+0000","last_change":"2024-09-12T01:26:14.437874+0000","last_active":"2024-09-12T01:28:03.814343+0000","last_peered":"2024-09-12T01:28:03.814343+0000","last_clean":"2024-09-12T01:28:03.814343+0000","last_became_active":"2024-09-12T01:26:14.437578+0000","last_became_peered":"2024-09-12T01:26:14.437578+0000","last_unstale":"2024-09-12T01:28:03.814343+0000","last_undegraded":"2024-09-12T01:28:03.814343+0000","last_fullsized":"2024-09-12T01:28:03.814343+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:55.817763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.716704+0000","last_change":"2024-09-12T01:26:26.267861+0000","last_active":"2024-09-12T01:28:03.716704+0000","last_peered":"2024-09-12T01:28:03.716704+0000","last_clean":"2024-09-12T01:28:03.716704+0000","last_became_active":"2024-09-12T01:26:26.267244+0000","last_became_peered":"2024-09-12T01:26:26.267244+0000","last_unstale":"2024-09-12T01:28:03.716704+0000","last_undegraded":"2024-09-12T01:28:03.716704+0000","last_fullsized":"2024-09-12T01:28:03.716704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:50.623916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.814419+0000","last_change":"2024-09-12T01:26:14.434708+0000","last_active":"2024-09-12T01:28:03.814419+0000","last_peered":"2024-09-12T01:28:03.814419+0000","last_clean":"2024-09-12T01:28:03.814419+0000","last_became_active":"2024-09-12T01:26:14.434420+0000","last_became_peered":"2024-09-12T01:26:14.434420+0000","last_unstale":"2024-09-12T01:28:03.814419+0000","last_undegraded":"2024-09-12T01:28:03.814419+0000","last_fullsized":"2024-09-12T01:28:03.814419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:58.626769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802334+0000","last_change":"2024-09-12T01:26:12.800678+0000","last_active":"2024-09-12T01:28:03.802334+0000","last_peered":"2024-09-12T01:28:03.802334+0000","last_clean":"2024-09-12T01:28:03.802334+0000","last_became_active":"2024-09-12T01:26:12.800063+0000","last_became_peered":"2024-09-12T01:26:12.800063+0000","last_unstale":"2024-09-12T01:28:03.802334+0000","last_undegraded":"2024-09-12T01:28:03.802334+0000","last_fullsized":"2024-09-12T01:28:03.802334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:01.110686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.882869+0000","last_change":"2024-09-12T01:26:14.425695+0000","last_active":"2024-09-12T01:28:03.882869+0000","last_peered":"2024-09-12T01:28:03.882869+0000","last_clean":"2024-09-12T01:28:03.882869+0000","last_became_active":"2024-09-12T01:26:14.425435+0000","last_became_peered":"2024-09-12T01:26:14.425435+0000","last_unstale":"2024-09-12T01:28:03.882869+0000","last_undegraded":"2024-09-12T01:28:03.882869+0000","last_fullsized":"2024-09-12T01:28:03.882869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:19.193669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'103","reported_seq":219,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.172744+0000","last_change":"2024-09-12T01:26:12.412743+0000","last_active":"2024-09-12T01:28:13.172744+0000","last_peered":"2024-09-12T01:28:13.172744+0000","last_clean":"2024-09-12T01:28:13.172744+0000","last_became_active":"2024-09-12T01:26:12.412376+0000","last_became_peered":"2024-09-12T01:26:12.412376+0000","last_unstale":"2024-09-12T01:28:13.172744+0000","last_undegraded":"2024-09-12T01:28:13.172744+0000","last_fullsized":"2024-09-12T01:28:13.172744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.542370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":188,"num_write_kb":1285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802661+0000","last_change":"2024-09-12T01:26:14.429727+0000","last_active":"2024-09-12T01:28:03.802661+0000","last_peered":"2024-09-12T01:28:03.802661+0000","last_clean":"2024-09-12T01:28:03.802661+0000","last_became_active":"2024-09-12T01:26:14.429385+0000","last_became_peered":"2024-09-12T01:26:14.429385+0000","last_unstale":"2024-09-12T01:28:03.802661+0000","last_undegraded":"2024-09-12T01:28:03.802661+0000","last_fullsized":"2024-09-12T01:28:03.802661+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:43.855786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.825282+0000","last_change":"2024-09-12T01:26:12.855632+0000","last_active":"2024-09-12T01:28:03.825282+0000","last_peered":"2024-09-12T01:28:03.825282+0000","last_clean":"2024-09-12T01:28:03.825282+0000","last_became_active":"2024-09-12T01:26:12.855305+0000","last_became_peered":"2024-09-12T01:26:12.855305+0000","last_unstale":"2024-09-12T01:28:03.825282+0000","last_undegraded":"2024-09-12T01:28:03.825282+0000","last_fullsized":"2024-09-12T01:28:03.825282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:16.893689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883266+0000","last_change":"2024-09-12T01:26:14.428498+0000","last_active":"2024-09-12T01:28:03.883266+0000","last_peered":"2024-09-12T01:28:03.883266+0000","last_clean":"2024-09-12T01:28:03.883266+0000","last_became_active":"2024-09-12T01:26:14.428022+0000","last_became_peered":"2024-09-12T01:26:14.428022+0000","last_unstale":"2024-09-12T01:28:03.883266+0000","last_undegraded":"2024-09-12T01:28:03.883266+0000","last_fullsized":"2024-09-12T01:28:03.883266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:44.325399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717493+0000","last_change":"2024-09-12T01:26:12.800038+0000","last_active":"2024-09-12T01:28:03.717493+0000","last_peered":"2024-09-12T01:28:03.717493+0000","last_clean":"2024-09-12T01:28:03.717493+0000","last_became_active":"2024-09-12T01:26:12.799717+0000","last_became_peered":"2024-09-12T01:26:12.799717+0000","last_unstale":"2024-09-12T01:28:03.717493+0000","last_undegraded":"2024-09-12T01:28:03.717493+0000","last_fullsized":"2024-09-12T01:28:03.717493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:36.362437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.801873+0000","last_change":"2024-09-12T01:26:14.430518+0000","last_active":"2024-09-12T01:28:03.801873+0000","last_peered":"2024-09-12T01:28:03.801873+0000","last_clean":"2024-09-12T01:28:03.801873+0000","last_became_active":"2024-09-12T01:26:14.430158+0000","last_became_peered":"2024-09-12T01:26:14.430158+0000","last_unstale":"2024-09-12T01:28:03.801873+0000","last_undegraded":"2024-09-12T01:28:03.801873+0000","last_fullsized":"2024-09-12T01:28:03.801873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:55.696101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802299+0000","last_change":"2024-09-12T01:26:12.418427+0000","last_active":"2024-09-12T01:28:03.802299+0000","last_peered":"2024-09-12T01:28:03.802299+0000","last_clean":"2024-09-12T01:28:03.802299+0000","last_became_active":"2024-09-12T01:26:12.418135+0000","last_became_peered":"2024-09-12T01:26:12.418135+0000","last_unstale":"2024-09-12T01:28:03.802299+0000","last_undegraded":"2024-09-12T01:28:03.802299+0000","last_fullsized":"2024-09-12T01:28:03.802299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:32.946485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.880813+0000","last_change":"2024-09-12T01:26:14.425817+0000","last_active":"2024-09-12T01:28:03.880813+0000","last_peered":"2024-09-12T01:28:03.880813+0000","last_clean":"2024-09-12T01:28:03.880813+0000","last_became_active":"2024-09-12T01:26:14.425443+0000","last_became_peered":"2024-09-12T01:26:14.425443+0000","last_unstale":"2024-09-12T01:28:03.880813+0000","last_undegraded":"2024-09-12T01:28:03.880813+0000","last_fullsized":"2024-09-12T01:28:03.880813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:30.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.720390+0000","last_change":"2024-09-12T01:26:12.422742+0000","last_active":"2024-09-12T01:28:03.720390+0000","last_peered":"2024-09-12T01:28:03.720390+0000","last_clean":"2024-09-12T01:28:03.720390+0000","last_became_active":"2024-09-12T01:26:12.421914+0000","last_became_peered":"2024-09-12T01:26:12.421914+0000","last_unstale":"2024-09-12T01:28:03.720390+0000","last_undegraded":"2024-09-12T01:28:03.720390+0000","last_fullsized":"2024-09-12T01:28:03.720390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:53.427112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802223+0000","last_change":"2024-09-12T01:26:14.430425+0000","last_active":"2024-09-12T01:28:03.802223+0000","last_peered":"2024-09-12T01:28:03.802223+0000","last_clean":"2024-09-12T01:28:03.802223+0000","last_became_active":"2024-09-12T01:26:14.430128+0000","last_became_peered":"2024-09-12T01:26:14.430128+0000","last_unstale":"2024-09-12T01:28:03.802223+0000","last_undegraded":"2024-09-12T01:28:03.802223+0000","last_fullsized":"2024-09-12T01:28:03.802223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:17.653908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802061+0000","last_change":"2024-09-12T01:26:12.421463+0000","last_active":"2024-09-12T01:28:03.802061+0000","last_peered":"2024-09-12T01:28:03.802061+0000","last_clean":"2024-09-12T01:28:03.802061+0000","last_became_active":"2024-09-12T01:26:12.421143+0000","last_became_peered":"2024-09-12T01:26:12.421143+0000","last_unstale":"2024-09-12T01:28:03.802061+0000","last_undegraded":"2024-09-12T01:28:03.802061+0000","last_fullsized":"2024-09-12T01:28:03.802061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:09.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.940259+0000","last_change":"2024-09-12T01:26:14.428643+0000","last_active":"2024-09-12T01:28:03.940259+0000","last_peered":"2024-09-12T01:28:03.940259+0000","last_clean":"2024-09-12T01:28:03.940259+0000","last_became_active":"2024-09-12T01:26:14.428344+0000","last_became_peered":"2024-09-12T01:26:14.428344+0000","last_unstale":"2024-09-12T01:28:03.940259+0000","last_undegraded":"2024-09-12T01:28:03.940259+0000","last_fullsized":"2024-09-12T01:28:03.940259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:17.213238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.811637+0000","last_change":"2024-09-12T01:26:14.435108+0000","last_active":"2024-09-12T01:28:03.811637+0000","last_peered":"2024-09-12T01:28:03.811637+0000","last_clean":"2024-09-12T01:28:03.811637+0000","last_became_active":"2024-09-12T01:26:14.434806+0000","last_became_peered":"2024-09-12T01:26:14.434806+0000","last_unstale":"2024-09-12T01:28:03.811637+0000","last_undegraded":"2024-09-12T01:28:03.811637+0000","last_fullsized":"2024-09-12T01:28:03.811637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:01.188981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802171+0000","last_change":"2024-09-12T01:26:12.419027+0000","last_active":"2024-09-12T01:28:03.802171+0000","last_peered":"2024-09-12T01:28:03.802171+0000","last_clean":"2024-09-12T01:28:03.802171+0000","last_became_active":"2024-09-12T01:26:12.418579+0000","last_became_peered":"2024-09-12T01:26:12.418579+0000","last_unstale":"2024-09-12T01:28:03.802171+0000","last_undegraded":"2024-09-12T01:28:03.802171+0000","last_fullsized":"2024-09-12T01:28:03.802171+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.119864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.717484+0000","last_change":"2024-09-12T01:26:14.429532+0000","last_active":"2024-09-12T01:28:03.717484+0000","last_peered":"2024-09-12T01:28:03.717484+0000","last_clean":"2024-09-12T01:28:03.717484+0000","last_became_active":"2024-09-12T01:26:14.429134+0000","last_became_peered":"2024-09-12T01:26:14.429134+0000","last_unstale":"2024-09-12T01:28:03.717484+0000","last_undegraded":"2024-09-12T01:28:03.717484+0000","last_fullsized":"2024-09-12T01:28:03.717484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:47.403388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802252+0000","last_change":"2024-09-12T01:26:26.279322+0000","last_active":"2024-09-12T01:28:03.802252+0000","last_peered":"2024-09-12T01:28:03.802252+0000","last_clean":"2024-09-12T01:28:03.802252+0000","last_became_active":"2024-09-12T01:26:26.268752+0000","last_became_peered":"2024-09-12T01:26:26.268752+0000","last_unstale":"2024-09-12T01:28:03.802252+0000","last_undegraded":"2024-09-12T01:28:03.802252+0000","last_fullsized":"2024-09-12T01:28:03.802252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:24.411144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.883645+0000","last_change":"2024-09-12T01:26:14.430831+0000","last_active":"2024-09-12T01:28:03.883645+0000","last_peered":"2024-09-12T01:28:03.883645+0000","last_clean":"2024-09-12T01:28:03.883645+0000","last_became_active":"2024-09-12T01:26:14.430531+0000","last_became_peered":"2024-09-12T01:26:14.430531+0000","last_unstale":"2024-09-12T01:28:03.883645+0000","last_undegraded":"2024-09-12T01:28:03.883645+0000","last_fullsized":"2024-09-12T01:28:03.883645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:02.522283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802763+0000","last_change":"2024-09-12T01:26:12.799921+0000","last_active":"2024-09-12T01:28:03.802763+0000","last_peered":"2024-09-12T01:28:03.802763+0000","last_clean":"2024-09-12T01:28:03.802763+0000","last_became_active":"2024-09-12T01:26:12.799608+0000","last_became_peered":"2024-09-12T01:26:12.799608+0000","last_unstale":"2024-09-12T01:28:03.802763+0000","last_undegraded":"2024-09-12T01:28:03.802763+0000","last_fullsized":"2024-09-12T01:28:03.802763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:00.821261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:03.802625+0000","last_change":"2024-09-12T01:26:14.430937+0000","last_active":"2024-09-12T01:28:03.802625+0000","last_peered":"2024-09-12T01:28:03.802625+0000","last_clean":"2024-09-12T01:28:03.802625+0000","last_became_active":"2024-09-12T01:26:14.430656+0000","last_became_peered":"2024-09-12T01:26:14.430656+0000","last_unstale":"2024-09-12T01:28:03.802625+0000","last_undegraded":"2024-09-12T01:28:03.802625+0000","last_fullsized":"2024-09-12T01:28:03.802625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:13.407010+0000","last_clean_scrub_stamp":"2024-09-12T01:26:13.407010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.874150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:28:14.640462+0000","last_change":"2024-09-12T01:26:12.419000+0000","last_active":"2024-09-12T01:28:14.640462+0000","last_peered":"2024-09-12T01:28:14.640462+0000","last_clean":"2024-09-12T01:28:14.640462+0000","last_became_active":"2024-09-12T01:26:12.418736+0000","last_became_peered":"2024-09-12T01:26:12.418736+0000","last_unstale":"2024-09-12T01:28:14.640462+0000","last_undegraded":"2024-09-12T01:28:14.640462+0000","last_fullsized":"2024-09-12T01:28:14.640462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:26:11.399875+0000","last_clean_scrub_stamp":"2024-09-12T01:26:11.399875+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:31.586983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797157,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1496,"num_read_kb":969,"num_write":498,"num_write_kb":2376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":2391471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":378,"ondisk_log_size":378,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":446094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37376,"kb_used_data":1912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707776,"statfs":{"total":95995035648,"available":95956762624,"internally_reserved":0,"allocated":1957888,"data_stored":1432432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972399,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28328,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716824,"statfs":{"total":95995035648,"available":95966027776,"internally_reserved":0,"allocated":1335296,"data_stored":838517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32480,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712672,"statfs":{"total":95995035648,"available":95961776128,"internally_reserved":0,"allocated":1327104,"data_stored":838873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1039912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626494,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":445411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855426,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28980,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716172,"statfs":{"total":95995035648,"available":95965360128,"internally_reserved":0,"allocated":1880064,"data_stored":1366109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":446199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37092,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708060,"statfs":{"total":95995035648,"available":95957053440,"internally_reserved":0,"allocated":1667072,"data_stored":1166291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1015808,"data_stored":513725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":995328,"data_stored":512804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":447058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":753664,"data_stored":721878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":331445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":394694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":397768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:28:18.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:28:19.194 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:19.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:19 smithi081 ceph-mon[30920]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-12T01:28:19.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:19 smithi081 ceph-mon[30920]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.685+0000 7ffb25a07640 1 -- 172.21.15.81:0/3861741467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb2010c170 msgr2=0x7ffb2010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.685+0000 7ffb25a07640 1 --2- 172.21.15.81:0/3861741467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb2010c170 0x7ffb2010e610 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009ca0 tx=0x7ffb1802a950 comp rx=0 tx=0).stop 2024-09-12T01:28:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.685+0000 7ffb25a07640 1 -- 172.21.15.81:0/3861741467 shutdown_connections 2024-09-12T01:28:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.685+0000 7ffb25a07640 1 --2- 172.21.15.81:0/3861741467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb2010c170 0x7ffb2010e610 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.685+0000 7ffb25a07640 1 --2- 172.21.15.81:0/3861741467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb20103660 0x7ffb2010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.685+0000 7ffb25a07640 1 --2- 172.21.15.81:0/3861741467 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb20102d40 0x7ffb20103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.685+0000 7ffb25a07640 1 -- 172.21.15.81:0/3861741467 >> 172.21.15.81:0/3861741467 conn(0x7ffb200fc7a0 msgr2=0x7ffb200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.685+0000 7ffb25a07640 1 -- 172.21.15.81:0/3861741467 shutdown_connections 2024-09-12T01:28:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.685+0000 7ffb25a07640 1 -- 172.21.15.81:0/3861741467 wait complete. 2024-09-12T01:28:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.686+0000 7ffb25a07640 1 Processor -- start 2024-09-12T01:28:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.686+0000 7ffb25a07640 1 -- start start 2024-09-12T01:28:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.686+0000 7ffb25a07640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb20102d40 0x7ffb20198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.686+0000 7ffb25a07640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20103660 0x7ffb201989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.686+0000 7ffb25a07640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb2010c170 0x7ffb2019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb25a07640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb20111fb0 con 0x7ffb20103660 2024-09-12T01:28:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb25a07640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffb20111e30 con 0x7ffb20102d40 2024-09-12T01:28:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb25a07640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffb20112130 con 0x7ffb2010c170 2024-09-12T01:28:19.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb1e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20103660 0x7ffb201989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb1e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20103660 0x7ffb201989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41398/0 (socket says 172.21.15.81:41398) 2024-09-12T01:28:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb1e7fc640 1 -- 172.21.15.81:0/3393884887 learned_addr learned my addr 172.21.15.81:0/3393884887 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb1effd640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb20102d40 0x7ffb20198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb1f7fe640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb2010c170 0x7ffb2019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb1e7fc640 1 -- 172.21.15.81:0/3393884887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb2010c170 msgr2=0x7ffb2019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb1e7fc640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb2010c170 0x7ffb2019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb1e7fc640 1 -- 172.21.15.81:0/3393884887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb20102d40 msgr2=0x7ffb20198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb1e7fc640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb20102d40 0x7ffb20198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb1e7fc640 1 -- 172.21.15.81:0/3393884887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2019d420 con 0x7ffb20103660 2024-09-12T01:28:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb1effd640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb20102d40 0x7ffb20198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb1e7fc640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20103660 0x7ffb201989b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400d740 tx=0x7ffb1400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:19.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb24a05640 1 -- 172.21.15.81:0/3393884887 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14017070 con 0x7ffb20103660 2024-09-12T01:28:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb25a07640 1 -- 172.21.15.81:0/3393884887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2019d710 con 0x7ffb20103660 2024-09-12T01:28:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb24a05640 1 -- 172.21.15.81:0/3393884887 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb1400de50 con 0x7ffb20103660 2024-09-12T01:28:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb24a05640 1 -- 172.21.15.81:0/3393884887 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400f620 con 0x7ffb20103660 2024-09-12T01:28:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.687+0000 7ffb25a07640 1 -- 172.21.15.81:0/3393884887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb201a4ff0 con 0x7ffb20103660 2024-09-12T01:28:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.689+0000 7ffb25a07640 1 -- 172.21.15.81:0/3393884887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb20103120 con 0x7ffb20103660 2024-09-12T01:28:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.689+0000 7ffb24a05640 1 -- 172.21.15.81:0/3393884887 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7ffb14009c30 con 0x7ffb20103660 2024-09-12T01:28:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.690+0000 7ffb24a05640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ffb080a2d80 0x7ffb080a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.690+0000 7ffb24a05640 1 -- 172.21.15.81:0/3393884887 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ffb140cf1c0 con 0x7ffb20103660 2024-09-12T01:28:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.690+0000 7ffb1effd640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ffb080a2d80 0x7ffb080a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.691+0000 7ffb1effd640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ffb080a2d80 0x7ffb080a5240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009930 tx=0x7ffb10008040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.694+0000 7ffb24a05640 1 -- 172.21.15.81:0/3393884887 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb1409bca0 con 0x7ffb20103660 2024-09-12T01:28:19.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:19 smithi100 ceph-mon[35275]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-12T01:28:19.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:19 smithi100 ceph-mon[35275]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:19 smithi189 ceph-mon[35357]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-12T01:28:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:19 smithi189 ceph-mon[35357]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:28:19.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.898+0000 7ffb25a07640 1 -- 172.21.15.81:0/3393884887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb201a5250 con 0x7ffb20103660 2024-09-12T01:28:19.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.899+0000 7ffb24a05640 1 -- 172.21.15.81:0/3393884887 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7ffb1409b5a0 con 0x7ffb20103660 2024-09-12T01:28:19.898 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:19.898 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:28:19.899 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:28:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.901+0000 7ffb25a07640 1 -- 172.21.15.81:0/3393884887 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ffb080a2d80 msgr2=0x7ffb080a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.901+0000 7ffb25a07640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ffb080a2d80 0x7ffb080a5240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009930 tx=0x7ffb10008040 comp rx=0 tx=0).stop 2024-09-12T01:28:19.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.901+0000 7ffb25a07640 1 -- 172.21.15.81:0/3393884887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20103660 msgr2=0x7ffb201989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.901+0000 7ffb25a07640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20103660 0x7ffb201989b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400d740 tx=0x7ffb1400dc00 comp rx=0 tx=0).stop 2024-09-12T01:28:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.901+0000 7ffb25a07640 1 -- 172.21.15.81:0/3393884887 shutdown_connections 2024-09-12T01:28:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.901+0000 7ffb25a07640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ffb080a2d80 0x7ffb080a5240 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.901+0000 7ffb25a07640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb2010c170 0x7ffb2019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:19.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.901+0000 7ffb25a07640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20103660 0x7ffb201989b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:19.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.901+0000 7ffb25a07640 1 --2- 172.21.15.81:0/3393884887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb20102d40 0x7ffb20198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:19.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.901+0000 7ffb25a07640 1 -- 172.21.15.81:0/3393884887 >> 172.21.15.81:0/3393884887 conn(0x7ffb200fc7a0 msgr2=0x7ffb200fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:19.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.901+0000 7ffb25a07640 1 -- 172.21.15.81:0/3393884887 shutdown_connections 2024-09-12T01:28:19.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:19.901+0000 7ffb25a07640 1 -- 172.21.15.81:0/3393884887 wait complete. 2024-09-12T01:28:20.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:20 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3393884887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:20.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:28:20.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:20 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3393884887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:20.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:20 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3393884887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.259+0000 7f1bcc809640 1 -- 172.21.15.81:0/1432815517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8105f40 msgr2=0x7f1bc81063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.259+0000 7f1bcc809640 1 --2- 172.21.15.81:0/1432815517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8105f40 0x7f1bc81063d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009ca0 tx=0x7f1bc002a940 comp rx=0 tx=0).stop 2024-09-12T01:28:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.259+0000 7f1bcc809640 1 -- 172.21.15.81:0/1432815517 shutdown_connections 2024-09-12T01:28:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.259+0000 7f1bcc809640 1 --2- 172.21.15.81:0/1432815517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8105f40 0x7f1bc81063d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.259+0000 7f1bcc809640 1 --2- 172.21.15.81:0/1432815517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1bc8101450 0x7f1bc8105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.259+0000 7f1bcc809640 1 --2- 172.21.15.81:0/1432815517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bc8100b30 0x7f1bc8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.259+0000 7f1bcc809640 1 -- 172.21.15.81:0/1432815517 >> 172.21.15.81:0/1432815517 conn(0x7f1bc80fc7a0 msgr2=0x7f1bc80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:21.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.259+0000 7f1bcc809640 1 -- 172.21.15.81:0/1432815517 shutdown_connections 2024-09-12T01:28:21.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.259+0000 7f1bcc809640 1 -- 172.21.15.81:0/1432815517 wait complete. 2024-09-12T01:28:21.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.260+0000 7f1bcc809640 1 Processor -- start 2024-09-12T01:28:21.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.260+0000 7f1bcc809640 1 -- start start 2024-09-12T01:28:21.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.260+0000 7f1bcc809640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8100b30 0x7f1bc81a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:21.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.260+0000 7f1bcc809640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1bc8101450 0x7f1bc81a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:21.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.260+0000 7f1bcc809640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bc8105f40 0x7f1bc819e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.260+0000 7f1bcc809640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc81185c0 con 0x7f1bc8100b30 2024-09-12T01:28:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.260+0000 7f1bcc809640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc8118440 con 0x7f1bc8105f40 2024-09-12T01:28:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.260+0000 7f1bcc809640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc8118740 con 0x7f1bc8101450 2024-09-12T01:28:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.260+0000 7f1bc659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8100b30 0x7f1bc81a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.260+0000 7f1bc659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8100b30 0x7f1bc81a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41416/0 (socket says 172.21.15.81:41416) 2024-09-12T01:28:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.260+0000 7f1bc659c640 1 -- 172.21.15.81:0/3941053786 learned_addr learned my addr 172.21.15.81:0/3941053786 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.260+0000 7f1bc6d9d640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bc8105f40 0x7f1bc819e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:21.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.260+0000 7f1bc5d9b640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1bc8101450 0x7f1bc81a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:21.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.261+0000 7f1bc659c640 1 -- 172.21.15.81:0/3941053786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1bc8101450 msgr2=0x7f1bc81a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:21.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.261+0000 7f1bc659c640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1bc8101450 0x7f1bc81a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.261+0000 7f1bc659c640 1 -- 172.21.15.81:0/3941053786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bc8105f40 msgr2=0x7f1bc819e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.261+0000 7f1bc659c640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bc8105f40 0x7f1bc819e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.261+0000 7f1bc659c640 1 -- 172.21.15.81:0/3941053786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc819f040 con 0x7f1bc8100b30 2024-09-12T01:28:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.261+0000 7f1bc5d9b640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1bc8101450 0x7f1bc81a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.261+0000 7f1bc659c640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8100b30 0x7f1bc81a4750 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c890 tx=0x7f1bbc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.261+0000 7f1bb77fe640 1 -- 172.21.15.81:0/3941053786 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc004220 con 0x7f1bc8100b30 2024-09-12T01:28:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.261+0000 7f1bcc809640 1 -- 172.21.15.81:0/3941053786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc819f330 con 0x7f1bc8100b30 2024-09-12T01:28:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.261+0000 7f1bb77fe640 1 -- 172.21.15.81:0/3941053786 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bbc0043c0 con 0x7f1bc8100b30 2024-09-12T01:28:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.261+0000 7f1bb77fe640 1 -- 172.21.15.81:0/3941053786 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc004a00 con 0x7f1bc8100b30 2024-09-12T01:28:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.261+0000 7f1bcc809640 1 -- 172.21.15.81:0/3941053786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc81ab620 con 0x7f1bc8100b30 2024-09-12T01:28:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.262+0000 7f1bcc809640 1 -- 172.21.15.81:0/3941053786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc8105920 con 0x7f1bc8100b30 2024-09-12T01:28:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.263+0000 7f1bb77fe640 1 -- 172.21.15.81:0/3941053786 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f1bbc0079b0 con 0x7f1bc8100b30 2024-09-12T01:28:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.264+0000 7f1bb77fe640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1bb00a2d80 0x7f1bb00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.264+0000 7f1bc5d9b640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1bb00a2d80 0x7f1bb00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.264+0000 7f1bb77fe640 1 -- 172.21.15.81:0/3941053786 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1bbc0cf2c0 con 0x7f1bc8100b30 2024-09-12T01:28:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.264+0000 7f1bc5d9b640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1bb00a2d80 0x7f1bb00a5240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80ffe20 tx=0x7f1bb8008040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.268+0000 7f1bb77fe640 1 -- 172.21.15.81:0/3941053786 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1bbc014030 con 0x7f1bc8100b30 2024-09-12T01:28:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.471+0000 7f1bcc809640 1 -- 172.21.15.81:0/3941053786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1bc81ab850 con 0x7f1bc8100b30 2024-09-12T01:28:21.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:21 smithi081 ceph-mon[30920]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 76 KiB/s wr, 53 op/s 2024-09-12T01:28:21.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.472+0000 7f1bb77fe640 1 -- 172.21.15.81:0/3941053786 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f1bbc09bda0 con 0x7f1bc8100b30 2024-09-12T01:28:21.471 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:21.472 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:28:21.472 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:28:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.474+0000 7f1bcc809640 1 -- 172.21.15.81:0/3941053786 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1bb00a2d80 msgr2=0x7f1bb00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.474+0000 7f1bcc809640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1bb00a2d80 0x7f1bb00a5240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80ffe20 tx=0x7f1bb8008040 comp rx=0 tx=0).stop 2024-09-12T01:28:21.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.474+0000 7f1bcc809640 1 -- 172.21.15.81:0/3941053786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8100b30 msgr2=0x7f1bc81a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:21.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.474+0000 7f1bcc809640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8100b30 0x7f1bc81a4750 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c890 tx=0x7f1bbc00cd50 comp rx=0 tx=0).stop 2024-09-12T01:28:21.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.474+0000 7f1bcc809640 1 -- 172.21.15.81:0/3941053786 shutdown_connections 2024-09-12T01:28:21.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.474+0000 7f1bcc809640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1bb00a2d80 0x7f1bb00a5240 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:21.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.474+0000 7f1bcc809640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bc8105f40 0x7f1bc819e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:21.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.474+0000 7f1bcc809640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1bc8101450 0x7f1bc81a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:21.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.474+0000 7f1bcc809640 1 --2- 172.21.15.81:0/3941053786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8100b30 0x7f1bc81a4750 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:21.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.474+0000 7f1bcc809640 1 -- 172.21.15.81:0/3941053786 >> 172.21.15.81:0/3941053786 conn(0x7f1bc80fc7a0 msgr2=0x7f1bc81038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:21.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.474+0000 7f1bcc809640 1 -- 172.21.15.81:0/3941053786 shutdown_connections 2024-09-12T01:28:21.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:21.474+0000 7f1bcc809640 1 -- 172.21.15.81:0/3941053786 wait complete. 2024-09-12T01:28:21.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:21 smithi100 ceph-mon[35275]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 76 KiB/s wr, 53 op/s 2024-09-12T01:28:21.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:21 smithi189 ceph-mon[35357]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 76 KiB/s wr, 53 op/s 2024-09-12T01:28:22.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:28:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:22.722 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:22 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3941053786' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:22.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:22 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3941053786' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:22.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:22 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3941053786' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:22.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.801+0000 7f0b40093640 1 -- 172.21.15.81:0/3038429587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38105f40 msgr2=0x7f0b381063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:22.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.801+0000 7f0b40093640 1 --2- 172.21.15.81:0/3038429587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38105f40 0x7f0b381063d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009ca0 tx=0x7f0b3002a940 comp rx=0 tx=0).stop 2024-09-12T01:28:22.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.801+0000 7f0b40093640 1 -- 172.21.15.81:0/3038429587 shutdown_connections 2024-09-12T01:28:22.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.801+0000 7f0b40093640 1 --2- 172.21.15.81:0/3038429587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38105f40 0x7f0b381063d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:22.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.801+0000 7f0b40093640 1 --2- 172.21.15.81:0/3038429587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b38101450 0x7f0b38105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:22.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.801+0000 7f0b40093640 1 --2- 172.21.15.81:0/3038429587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b38100b30 0x7f0b38100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:22.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.801+0000 7f0b40093640 1 -- 172.21.15.81:0/3038429587 >> 172.21.15.81:0/3038429587 conn(0x7f0b380fc7a0 msgr2=0x7f0b380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:22.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.802+0000 7f0b40093640 1 -- 172.21.15.81:0/3038429587 shutdown_connections 2024-09-12T01:28:22.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.802+0000 7f0b40093640 1 -- 172.21.15.81:0/3038429587 wait complete. 2024-09-12T01:28:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.802+0000 7f0b40093640 1 Processor -- start 2024-09-12T01:28:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.802+0000 7f0b40093640 1 -- start start 2024-09-12T01:28:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.802+0000 7f0b40093640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38100b30 0x7f0b381a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.802+0000 7f0b40093640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b38101450 0x7f0b381a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.802+0000 7f0b40093640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b38105f40 0x7f0b3819e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.802+0000 7f0b40093640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b38118560 con 0x7f0b38100b30 2024-09-12T01:28:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.802+0000 7f0b40093640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0b381183e0 con 0x7f0b38101450 2024-09-12T01:28:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.802+0000 7f0b40093640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0b381186e0 con 0x7f0b38105f40 2024-09-12T01:28:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.802+0000 7f0b3de2f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38100b30 0x7f0b381a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b3de2f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38100b30 0x7f0b381a4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60070/0 (socket says 172.21.15.81:60070) 2024-09-12T01:28:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b3de2f640 1 -- 172.21.15.81:0/63641664 learned_addr learned my addr 172.21.15.81:0/63641664 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:22.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b3e630640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b38105f40 0x7f0b3819e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b3d62e640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b38101450 0x7f0b381a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b3de2f640 1 -- 172.21.15.81:0/63641664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b38105f40 msgr2=0x7f0b3819e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b3de2f640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b38105f40 0x7f0b3819e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b3de2f640 1 -- 172.21.15.81:0/63641664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b38101450 msgr2=0x7f0b381a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b3de2f640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b38101450 0x7f0b381a4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b3de2f640 1 -- 172.21.15.81:0/63641664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3819ef50 con 0x7f0b38100b30 2024-09-12T01:28:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b3de2f640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38100b30 0x7f0b381a4630 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400c920 tx=0x7f0b3400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b2effd640 1 -- 172.21.15.81:0/63641664 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34007c70 con 0x7f0b38100b30 2024-09-12T01:28:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b2effd640 1 -- 172.21.15.81:0/63641664 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b34007e10 con 0x7f0b38100b30 2024-09-12T01:28:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b40093640 1 -- 172.21.15.81:0/63641664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3819f240 con 0x7f0b38100b30 2024-09-12T01:28:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b2effd640 1 -- 172.21.15.81:0/63641664 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34018890 con 0x7f0b38100b30 2024-09-12T01:28:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.803+0000 7f0b40093640 1 -- 172.21.15.81:0/63641664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b381ab490 con 0x7f0b38100b30 2024-09-12T01:28:22.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.804+0000 7f0b40093640 1 -- 172.21.15.81:0/63641664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b3806b070 con 0x7f0b38100b30 2024-09-12T01:28:22.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.805+0000 7f0b2effd640 1 -- 172.21.15.81:0/63641664 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f0b34018a50 con 0x7f0b38100b30 2024-09-12T01:28:22.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.806+0000 7f0b2effd640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0b240a2d80 0x7f0b240a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:22.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.806+0000 7f0b3d62e640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0b240a2d80 0x7f0b240a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:22.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.806+0000 7f0b2effd640 1 -- 172.21.15.81:0/63641664 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f0b340cf9a0 con 0x7f0b38100b30 2024-09-12T01:28:22.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.806+0000 7f0b3d62e640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0b240a2d80 0x7f0b240a5240 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0b38106590 tx=0x7f0b28005e50 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:22.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.809+0000 7f0b2effd640 1 -- 172.21.15.81:0/63641664 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b34014030 con 0x7f0b38100b30 2024-09-12T01:28:22.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.976+0000 7f0b40093640 1 -- 172.21.15.81:0/63641664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b381ab7c0 con 0x7f0b38100b30 2024-09-12T01:28:22.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.977+0000 7f0b2effd640 1 -- 172.21.15.81:0/63641664 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+23091 (secure 0 0 0) 0x7f0b3409c510 con 0x7f0b38100b30 2024-09-12T01:28:22.977 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:22.977 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","created":"2024-09-12T01:18:28.404285+0000","modified":"2024-09-12T01:28:03.711376+0000","last_up_change":"2024-09-12T01:25:26.326110+0000","last_in_change":"2024-09-12T01:25:02.138698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:21:40.649584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:26:10.753723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:26:13.254837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc857dd4-eedc-4c48-89a0-4e69662e8e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6803","nonce":3870994528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6805","nonce":3870994528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6809","nonce":3870994528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6807","nonce":3870994528}]},"public_addr":"172.21.15.81:6803/3870994528","cluster_addr":"172.21.15.81:6805/3870994528","heartbeat_back_addr":"172.21.15.81:6809/3870994528","heartbeat_front_addr":"172.21.15.81:6807/3870994528","state":["exists","up"]},{"osd":1,"uuid":"04b8111b-d677-4fc8-8285-90683621ccf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6801","nonce":2098299652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6803","nonce":2098299652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6807","nonce":2098299652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6805","nonce":2098299652}]},"public_addr":"172.21.15.100:6801/2098299652","cluster_addr":"172.21.15.100:6803/2098299652","heartbeat_back_addr":"172.21.15.100:6807/2098299652","heartbeat_front_addr":"172.21.15.100:6805/2098299652","state":["exists","up"]},{"osd":2,"uuid":"763e357e-5a04-45ff-95e8-bc1abfeac056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6801","nonce":1353548110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6803","nonce":1353548110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6807","nonce":1353548110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6805","nonce":1353548110}]},"public_addr":"172.21.15.189:6801/1353548110","cluster_addr":"172.21.15.189:6803/1353548110","heartbeat_back_addr":"172.21.15.189:6807/1353548110","heartbeat_front_addr":"172.21.15.189:6805/1353548110","state":["exists","up"]},{"osd":3,"uuid":"99843578-1b9e-4ee0-91f1-ba419d07897e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6811","nonce":1064869637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6813","nonce":1064869637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6817","nonce":1064869637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6815","nonce":1064869637}]},"public_addr":"172.21.15.81:6811/1064869637","cluster_addr":"172.21.15.81:6813/1064869637","heartbeat_back_addr":"172.21.15.81:6817/1064869637","heartbeat_front_addr":"172.21.15.81:6815/1064869637","state":["exists","up"]},{"osd":4,"uuid":"a5787415-0905-420e-9ce8-eb6902727561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6809","nonce":1687792282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6811","nonce":1687792282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6815","nonce":1687792282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6813","nonce":1687792282}]},"public_addr":"172.21.15.100:6809/1687792282","cluster_addr":"172.21.15.100:6811/1687792282","heartbeat_back_addr":"172.21.15.100:6815/1687792282","heartbeat_front_addr":"172.21.15.100:6813/1687792282","state":["exists","up"]},{"osd":5,"uuid":"879548b5-5516-407c-8517-bbdbf356c0e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6809","nonce":823474396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6811","nonce":823474396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6815","nonce":823474396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6813","nonce":823474396}]},"public_addr":"172.21.15.189:6809/823474396","cluster_addr":"172.21.15.189:6811/823474396","heartbeat_back_addr":"172.21.15.189:6815/823474396","heartbeat_front_addr":"172.21.15.189:6813/823474396","state":["exists","up"]},{"osd":6,"uuid":"b665b97c-a9d3-475f-93f3-8a920cbb37d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6819","nonce":1522854005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6821","nonce":1522854005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6825","nonce":1522854005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6823","nonce":1522854005}]},"public_addr":"172.21.15.81:6819/1522854005","cluster_addr":"172.21.15.81:6821/1522854005","heartbeat_back_addr":"172.21.15.81:6825/1522854005","heartbeat_front_addr":"172.21.15.81:6823/1522854005","state":["exists","up"]},{"osd":7,"uuid":"46e082c8-d071-471a-8c86-ce5b5700cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6817","nonce":41478541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6819","nonce":41478541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6823","nonce":41478541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6821","nonce":41478541}]},"public_addr":"172.21.15.100:6817/41478541","cluster_addr":"172.21.15.100:6819/41478541","heartbeat_back_addr":"172.21.15.100:6823/41478541","heartbeat_front_addr":"172.21.15.100:6821/41478541","state":["exists","up"]},{"osd":8,"uuid":"fb9b93ef-5a33-4ffc-926e-a78c101bbbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6817","nonce":180766860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6819","nonce":180766860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6823","nonce":180766860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6821","nonce":180766860}]},"public_addr":"172.21.15.189:6817/180766860","cluster_addr":"172.21.15.189:6819/180766860","heartbeat_back_addr":"172.21.15.189:6823/180766860","heartbeat_front_addr":"172.21.15.189:6821/180766860","state":["exists","up"]},{"osd":9,"uuid":"0b7ec1a1-5ab9-4075-acfb-e0d82f018656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6827","nonce":1651232782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6829","nonce":1651232782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6833","nonce":1651232782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6831","nonce":1651232782}]},"public_addr":"172.21.15.81:6827/1651232782","cluster_addr":"172.21.15.81:6829/1651232782","heartbeat_back_addr":"172.21.15.81:6833/1651232782","heartbeat_front_addr":"172.21.15.81:6831/1651232782","state":["exists","up"]},{"osd":10,"uuid":"996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6825","nonce":3295868568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6827","nonce":3295868568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6831","nonce":3295868568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6829","nonce":3295868568}]},"public_addr":"172.21.15.100:6825/3295868568","cluster_addr":"172.21.15.100:6827/3295868568","heartbeat_back_addr":"172.21.15.100:6831/3295868568","heartbeat_front_addr":"172.21.15.100:6829/3295868568","state":["exists","up"]},{"osd":11,"uuid":"f051e2b2-fc58-489a-ab7c-8c1ff5448553","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6825","nonce":3852230978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6827","nonce":3852230978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6831","nonce":3852230978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6829","nonce":3852230978}]},"public_addr":"172.21.15.189:6825/3852230978","cluster_addr":"172.21.15.189:6827/3852230978","heartbeat_back_addr":"172.21.15.189:6831/3852230978","heartbeat_front_addr":"172.21.15.189:6829/3852230978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:20:47.371696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:12.762376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:37.936648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:03.950352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:28.922754+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:54.252149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:18.421479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:43.989505+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:08.789671+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:34.336367+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:59.089601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:25:23.761934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/1193015276":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/3474474725":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/682685112":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/4219073331":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/2162789959":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6800/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2577694203":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6800/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/4128337402":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2393807982":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6801/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6800/2591597081":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/1460332159":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6801/2591597081":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/1806419627":"2024-09-13T01:28:03.711343+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:28:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.980+0000 7f0b40093640 1 -- 172.21.15.81:0/63641664 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0b240a2d80 msgr2=0x7f0b240a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.980+0000 7f0b40093640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0b240a2d80 0x7f0b240a5240 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0b38106590 tx=0x7f0b28005e50 comp rx=0 tx=0).stop 2024-09-12T01:28:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.980+0000 7f0b40093640 1 -- 172.21.15.81:0/63641664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38100b30 msgr2=0x7f0b381a4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.980+0000 7f0b40093640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38100b30 0x7f0b381a4630 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400c920 tx=0x7f0b3400cde0 comp rx=0 tx=0).stop 2024-09-12T01:28:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.980+0000 7f0b40093640 1 -- 172.21.15.81:0/63641664 shutdown_connections 2024-09-12T01:28:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.980+0000 7f0b40093640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0b240a2d80 0x7f0b240a5240 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.980+0000 7f0b40093640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b38105f40 0x7f0b3819e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.980+0000 7f0b40093640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b38101450 0x7f0b381a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.980+0000 7f0b40093640 1 --2- 172.21.15.81:0/63641664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b38100b30 0x7f0b381a4630 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.980+0000 7f0b40093640 1 -- 172.21.15.81:0/63641664 >> 172.21.15.81:0/63641664 conn(0x7f0b380fc7a0 msgr2=0x7f0b381038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.980+0000 7f0b40093640 1 -- 172.21.15.81:0/63641664 shutdown_connections 2024-09-12T01:28:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:22.980+0000 7f0b40093640 1 -- 172.21.15.81:0/63641664 wait complete. 2024-09-12T01:28:23.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:23 smithi081 ceph-mon[30920]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 41 op/s 2024-09-12T01:28:23.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:23 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/63641664' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:28:23.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-12T01:28:23.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:23 smithi100 ceph-mon[35275]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 41 op/s 2024-09-12T01:28:23.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:23 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/63641664' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:28:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:23 smithi189 ceph-mon[35357]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 41 op/s 2024-09-12T01:28:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:23 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/63641664' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:28:23.911 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:25.063 INFO:teuthology.orchestra.run.smithi081.stdout:{"run_dir":"/var/run/ceph"} 2024-09-12T01:28:25.063 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-12T01:28:25.063 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 481 2024-09-12T01:28:25.064 DEBUG:tasks.quiescer:Yielding 2024-09-12T01:28:25.064 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:28:25.079 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T01:28:25.080 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:28:25.080 INFO:tasks.workunit:timeout=3h 2024-09-12T01:28:25.080 INFO:tasks.workunit:cleanup=True 2024-09-12T01:28:25.080 DEBUG:teuthology.orchestra.run.smithi081:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:28:25.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:28:25.098 INFO:teuthology.orchestra.run.smithi081.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T01:28:25.098 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-12T01:28:25.098 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-12T01:28:25.098 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:28:25.098 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-12T01:28:25.098 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-12 01:26:32.817747994 +0000 2024-09-12T01:28:25.098 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-12 01:26:32.817747994 +0000 2024-09-12T01:28:25.098 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-12 01:28:01.710032852 +0000 2024-09-12T01:28:25.099 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-12 01:26:32.817747994 +0000 2024-09-12T01:28:25.099 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:28:25.099 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T01:28:25.171 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T01:28:25.227 INFO:tasks.workunit.client.0.smithi081.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:28:25.336 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:25.680 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:25 smithi081 ceph-mon[30920]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-12T01:28:25.680 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:25 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:28:25.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:25 smithi100 ceph-mon[35275]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-12T01:28:25.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:25 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:28:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:25 smithi189 ceph-mon[35357]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-12T01:28:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:25 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:28:25.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.763+0000 7fe96099e640 1 -- 172.21.15.81:0/3195967437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe95c102db0 msgr2=0x7fe95c103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:25.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.763+0000 7fe96099e640 1 --2- 172.21.15.81:0/3195967437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe95c102db0 0x7fe95c103190 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009930 tx=0x7fe94c02a420 comp rx=0 tx=0).stop 2024-09-12T01:28:25.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.763+0000 7fe96099e640 1 -- 172.21.15.81:0/3195967437 shutdown_connections 2024-09-12T01:28:25.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.763+0000 7fe96099e640 1 --2- 172.21.15.81:0/3195967437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe95c1082e0 0x7fe95c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:25.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.763+0000 7fe96099e640 1 --2- 172.21.15.81:0/3195967437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe95c103760 0x7fe95c107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:25.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.763+0000 7fe96099e640 1 --2- 172.21.15.81:0/3195967437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe95c102db0 0x7fe95c103190 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:25.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.763+0000 7fe96099e640 1 -- 172.21.15.81:0/3195967437 >> 172.21.15.81:0/3195967437 conn(0x7fe95c0fc7d0 msgr2=0x7fe95c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:25.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.763+0000 7fe96099e640 1 -- 172.21.15.81:0/3195967437 shutdown_connections 2024-09-12T01:28:25.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.763+0000 7fe96099e640 1 -- 172.21.15.81:0/3195967437 wait complete. 2024-09-12T01:28:25.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.764+0000 7fe96099e640 1 Processor -- start 2024-09-12T01:28:25.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.764+0000 7fe96099e640 1 -- start start 2024-09-12T01:28:25.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.764+0000 7fe96099e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe95c102db0 0x7fe95c100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:25.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.764+0000 7fe96099e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe95c103760 0x7fe95c100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:25.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.764+0000 7fe96099e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe95c1082e0 0x7fe95c101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:25.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.764+0000 7fe96099e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c1120b0 con 0x7fe95c103760 2024-09-12T01:28:25.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.764+0000 7fe96099e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c111f30 con 0x7fe95c1082e0 2024-09-12T01:28:25.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.764+0000 7fe96099e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c112230 con 0x7fe95c102db0 2024-09-12T01:28:25.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.764+0000 7fe959d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe95c103760 0x7fe95c100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:25.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.764+0000 7fe959d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe95c103760 0x7fe95c100f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60086/0 (socket says 172.21.15.81:60086) 2024-09-12T01:28:25.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.764+0000 7fe959d9b640 1 -- 172.21.15.81:0/1438776038 learned_addr learned my addr 172.21.15.81:0/1438776038 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:25.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.764+0000 7fe95a59c640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe95c102db0 0x7fe95c100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:25.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.765+0000 7fe95ad9d640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe95c1082e0 0x7fe95c101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:25.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.765+0000 7fe959d9b640 1 -- 172.21.15.81:0/1438776038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe95c102db0 msgr2=0x7fe95c100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:25.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.765+0000 7fe959d9b640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe95c102db0 0x7fe95c100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:25.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.765+0000 7fe959d9b640 1 -- 172.21.15.81:0/1438776038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe95c1082e0 msgr2=0x7fe95c101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:25.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.765+0000 7fe959d9b640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe95c1082e0 0x7fe95c101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:25.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.765+0000 7fe959d9b640 1 -- 172.21.15.81:0/1438776038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95c1a6b40 con 0x7fe95c103760 2024-09-12T01:28:25.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.765+0000 7fe959d9b640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe95c103760 0x7fe95c100f50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c970 tx=0x7fe95000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:25.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.765+0000 7fe94b7fe640 1 -- 172.21.15.81:0/1438776038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950004220 con 0x7fe95c103760 2024-09-12T01:28:25.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.765+0000 7fe94b7fe640 1 -- 172.21.15.81:0/1438776038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9500043c0 con 0x7fe95c103760 2024-09-12T01:28:25.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.765+0000 7fe96099e640 1 -- 172.21.15.81:0/1438776038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95c1a6e30 con 0x7fe95c103760 2024-09-12T01:28:25.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.765+0000 7fe94b7fe640 1 -- 172.21.15.81:0/1438776038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950004a00 con 0x7fe95c103760 2024-09-12T01:28:25.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.765+0000 7fe96099e640 1 -- 172.21.15.81:0/1438776038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95c1a7290 con 0x7fe95c103760 2024-09-12T01:28:25.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.766+0000 7fe96099e640 1 -- 172.21.15.81:0/1438776038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe95c06a7d0 con 0x7fe95c103760 2024-09-12T01:28:25.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.768+0000 7fe94b7fe640 1 -- 172.21.15.81:0/1438776038 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7fe9500079b0 con 0x7fe95c103760 2024-09-12T01:28:25.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.769+0000 7fe94b7fe640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe9440a2d80 0x7fe9440a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:25.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.769+0000 7fe95a59c640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe9440a2d80 0x7fe9440a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:25.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.769+0000 7fe94b7fe640 1 -- 172.21.15.81:0/1438776038 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe9500cf620 con 0x7fe95c103760 2024-09-12T01:28:25.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.770+0000 7fe95a59c640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe9440a2d80 0x7fe9440a5240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe94c006010 tx=0x7fe94c0058d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:25.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.771+0000 7fe94b7fe640 1 -- 172.21.15.81:0/1438776038 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe950014030 con 0x7fe95c103760 2024-09-12T01:28:25.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.977+0000 7fe96099e640 1 -- 172.21.15.81:0/1438776038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe95c10a2c0 con 0x7fe95c103760 2024-09-12T01:28:25.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.978+0000 7fe94b7fe640 1 -- 172.21.15.81:0/1438776038 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fe95009c100 con 0x7fe95c103760 2024-09-12T01:28:25.977 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:25.977 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:28:25.978 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:28:25.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.980+0000 7fe96099e640 1 -- 172.21.15.81:0/1438776038 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe9440a2d80 msgr2=0x7fe9440a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:25.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.980+0000 7fe96099e640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe9440a2d80 0x7fe9440a5240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe94c006010 tx=0x7fe94c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:28:25.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.980+0000 7fe96099e640 1 -- 172.21.15.81:0/1438776038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe95c103760 msgr2=0x7fe95c100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:25.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.980+0000 7fe96099e640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe95c103760 0x7fe95c100f50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c970 tx=0x7fe95000ce30 comp rx=0 tx=0).stop 2024-09-12T01:28:25.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.980+0000 7fe96099e640 1 -- 172.21.15.81:0/1438776038 shutdown_connections 2024-09-12T01:28:25.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.980+0000 7fe96099e640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe9440a2d80 0x7fe9440a5240 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:25.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.980+0000 7fe96099e640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe95c1082e0 0x7fe95c101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:25.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.980+0000 7fe96099e640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe95c103760 0x7fe95c100f50 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:25.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.980+0000 7fe96099e640 1 --2- 172.21.15.81:0/1438776038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe95c102db0 0x7fe95c100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:25.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.980+0000 7fe96099e640 1 -- 172.21.15.81:0/1438776038 >> 172.21.15.81:0/1438776038 conn(0x7fe95c0fc7d0 msgr2=0x7fe95c105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:25.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.980+0000 7fe96099e640 1 -- 172.21.15.81:0/1438776038 shutdown_connections 2024-09-12T01:28:25.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:25.980+0000 7fe96099e640 1 -- 172.21.15.81:0/1438776038 wait complete. 2024-09-12T01:28:26.604 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T01:26:15.004450+0000', 'modified': '2024-09-12T01:28:02.384135+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24473, 'mds_1': 24448, 'mds_2': 24446, 'mds_3': 24401, 'mds_4': 24391}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14601': {'gid': 14601, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6839/1118446149', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 1118446149}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 1118446149}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14613': {'gid': 14613, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6841/3373717964', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6840', 'nonce': 3373717964}, {'type': 'v1', 'addr': '172.21.15.81:6841', 'nonce': 3373717964}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24391': {'gid': 24391, 'name': 'l', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.189:6833/2998951094', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6832', 'nonce': 2998951094}, {'type': 'v1', 'addr': '172.21.15.189:6833', 'nonce': 2998951094}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24401': {'gid': 24401, 'name': 'k', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.100:6833/2684949307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6832', 'nonce': 2684949307}, {'type': 'v1', 'addr': '172.21.15.100:6833', 'nonce': 2684949307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/79706687', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 79706687}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 79706687}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24425': {'gid': 24425, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.100:6835/3858178529', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6834', 'nonce': 3858178529}, {'type': 'v1', 'addr': '172.21.15.100:6835', 'nonce': 3858178529}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/129654641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 129654641}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 129654641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.100:6837/2276544763', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6836', 'nonce': 2276544763}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 2276544763}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.189:6839/1856874876', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 1856874876}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 1856874876}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6839/3435943351', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 3435943351}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 3435943351}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24473, 'qdb_cluster': [24391, 24401, 24446, 24448, 24473]} 2024-09-12T01:28:26.604 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T01:28:26.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.l status 2024-09-12T01:28:26.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:26 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1438776038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:26.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:26 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1438776038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:26.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:26 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1438776038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.360+0000 7f76652ef640 1 -- 172.21.15.81:0/3505766112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660100a80 msgr2=0x7f7660100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.360+0000 7f76652ef640 1 --2- 172.21.15.81:0/3505766112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660100a80 0x7f7660100ee0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7654009930 tx=0x7f765402a420 comp rx=0 tx=0).stop 2024-09-12T01:28:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.360+0000 7f76652ef640 1 -- 172.21.15.81:0/3505766112 shutdown_connections 2024-09-12T01:28:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.360+0000 7f76652ef640 1 --2- 172.21.15.81:0/3505766112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7660101420 0x7f766010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.360+0000 7f76652ef640 1 --2- 172.21.15.81:0/3505766112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660100a80 0x7f7660100ee0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.360+0000 7f76652ef640 1 --2- 172.21.15.81:0/3505766112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7660106a80 0x7f7660106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.360+0000 7f76652ef640 1 -- 172.21.15.81:0/3505766112 >> 172.21.15.81:0/3505766112 conn(0x7f76600fc7a0 msgr2=0x7f76600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.360+0000 7f76652ef640 1 -- 172.21.15.81:0/3505766112 shutdown_connections 2024-09-12T01:28:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.360+0000 7f76652ef640 1 -- 172.21.15.81:0/3505766112 wait complete. 2024-09-12T01:28:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.361+0000 7f76652ef640 1 Processor -- start 2024-09-12T01:28:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.361+0000 7f76652ef640 1 -- start start 2024-09-12T01:28:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.361+0000 7f76652ef640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7660100a80 0x7f76601983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.361+0000 7f76652ef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7660101420 0x7f7660198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.361+0000 7f76652ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660106a80 0x7f766019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.361+0000 7f76652ef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f766006b690 con 0x7f7660106a80 2024-09-12T01:28:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.361+0000 7f76652ef640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f766006b510 con 0x7f7660101420 2024-09-12T01:28:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.361+0000 7f76652ef640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7660112150 con 0x7f7660100a80 2024-09-12T01:28:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f765f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660106a80 0x7f766019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f765f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660106a80 0x7f766019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60110/0 (socket says 172.21.15.81:60110) 2024-09-12T01:28:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f765f7fe640 1 -- 172.21.15.81:0/3383935271 learned_addr learned my addr 172.21.15.81:0/3383935271 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f765effd640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7660100a80 0x7f76601983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f765e7fc640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7660101420 0x7f7660198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f765f7fe640 1 -- 172.21.15.81:0/3383935271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7660100a80 msgr2=0x7f76601983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f765f7fe640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7660100a80 0x7f76601983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f765f7fe640 1 -- 172.21.15.81:0/3383935271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7660101420 msgr2=0x7f7660198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f765f7fe640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7660101420 0x7f7660198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f765f7fe640 1 -- 172.21.15.81:0/3383935271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766019d370 con 0x7f7660106a80 2024-09-12T01:28:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f765f7fe640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660106a80 0x7f766019cc90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f765800c970 tx=0x7f765800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f7647fff640 1 -- 172.21.15.81:0/3383935271 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7658007bb0 con 0x7f7660106a80 2024-09-12T01:28:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f76652ef640 1 -- 172.21.15.81:0/3383935271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766019d660 con 0x7f7660106a80 2024-09-12T01:28:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f7647fff640 1 -- 172.21.15.81:0/3383935271 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7658007d50 con 0x7f7660106a80 2024-09-12T01:28:27.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f7647fff640 1 -- 172.21.15.81:0/3383935271 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7658018800 con 0x7f7660106a80 2024-09-12T01:28:27.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.362+0000 7f76652ef640 1 -- 172.21.15.81:0/3383935271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76601a4f40 con 0x7f7660106a80 2024-09-12T01:28:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.364+0000 7f7647fff640 1 -- 172.21.15.81:0/3383935271 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f765800fa50 con 0x7f7660106a80 2024-09-12T01:28:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.365+0000 7f76676c8740 1 Processor -- start 2024-09-12T01:28:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.365+0000 7f76676c8740 1 -- start start 2024-09-12T01:28:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.365+0000 7f76676c8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 0x55f75dbeadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.365+0000 7f76676c8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbeb2f0 0x55f75dbf5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.365+0000 7f76676c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 0x55f75dbf7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.365+0000 7f76676c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f75db51090 con 0x55f75dbf5bb0 2024-09-12T01:28:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.365+0000 7f76676c8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f75daf8a70 con 0x55f75dbea9d0 2024-09-12T01:28:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.365+0000 7f76676c8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f75db4d050 con 0x55f75dbeb2f0 2024-09-12T01:28:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.365+0000 7f7647fff640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f76480a2d80 0x7f76480a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.365+0000 7f765e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 0x55f75dbf7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.365+0000 7f765e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 0x55f75dbf7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60116/0 (socket says 172.21.15.81:60116) 2024-09-12T01:28:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.365+0000 7f765e7fc640 1 -- 172.21.15.81:0/159538933 learned_addr learned my addr 172.21.15.81:0/159538933 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.365+0000 7f765f7fe640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f76480a2d80 0x7f76480a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.366+0000 7f765effd640 1 --2- 172.21.15.81:0/159538933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbeb2f0 0x55f75dbf5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.366+0000 7f765e7fc640 1 --2- 172.21.15.81:0/159538933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 0x55f75dbeadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.366+0000 7f7647fff640 1 -- 172.21.15.81:0/3383935271 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f76580cf5c0 con 0x7f7660106a80 2024-09-12T01:28:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.366+0000 7f765e7fc640 1 -- 172.21.15.81:0/159538933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbeb2f0 msgr2=0x55f75dbf5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.366+0000 7f765e7fc640 1 --2- 172.21.15.81:0/159538933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbeb2f0 0x55f75dbf5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.366+0000 7f765e7fc640 1 -- 172.21.15.81:0/159538933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 msgr2=0x55f75dbeadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.366+0000 7f765e7fc640 1 --2- 172.21.15.81:0/159538933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 0x55f75dbeadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.366+0000 7f765e7fc640 1 -- 172.21.15.81:0/159538933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f75db05130 con 0x55f75dbf5bb0 2024-09-12T01:28:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.366+0000 7f765e7fc640 1 --2- 172.21.15.81:0/159538933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 0x55f75dbf7fa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7654005ec0 tx=0x7f7654005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc07688e24cb97f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.366+0000 7f765f7fe640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f76480a2d80 0x7f76480a5240 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76580ccc80 tx=0x7f7658086040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.366+0000 7f76457fa640 1 -- 172.21.15.81:0/159538933 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7654035070 con 0x55f75dbf5bb0 2024-09-12T01:28:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.366+0000 7f76457fa640 1 -- 172.21.15.81:0/159538933 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7654031800 con 0x55f75dbf5bb0 2024-09-12T01:28:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.366+0000 7f76457fa640 1 -- 172.21.15.81:0/159538933 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76540047a0 con 0x55f75dbf5bb0 2024-09-12T01:28:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.367+0000 7f76676c8740 1 -- 172.21.15.81:0/159538933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 msgr2=0x55f75dbf7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.367+0000 7f76676c8740 1 --2- 172.21.15.81:0/159538933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 0x55f75dbf7fa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7654005ec0 tx=0x7f7654005fd0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.367+0000 7f76676c8740 1 -- 172.21.15.81:0/159538933 shutdown_connections 2024-09-12T01:28:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.367+0000 7f76676c8740 1 --2- 172.21.15.81:0/159538933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 0x55f75dbf7fa0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.367+0000 7f76676c8740 1 --2- 172.21.15.81:0/159538933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbeb2f0 0x55f75dbf5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.367+0000 7f76676c8740 1 --2- 172.21.15.81:0/159538933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 0x55f75dbeadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.367+0000 7f76676c8740 1 -- 172.21.15.81:0/159538933 >> 172.21.15.81:0/159538933 conn(0x55f75dbe6f60 msgr2=0x55f75dbe7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.367+0000 7f76676c8740 1 -- 172.21.15.81:0/159538933 shutdown_connections 2024-09-12T01:28:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.367+0000 7f76676c8740 1 -- 172.21.15.81:0/159538933 wait complete. 2024-09-12T01:28:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.367+0000 7f76676c8740 1 -- start start 2024-09-12T01:28:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.367+0000 7f76676c8740 1 Processor -- start 2024-09-12T01:28:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f76676c8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbea9d0 0x55f75dbf5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f76676c8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbeb2f0 0x55f75dbf27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f76676c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 0x55f75dbf2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f76676c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f75dbf8780 con 0x55f75dbf5bb0 2024-09-12T01:28:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f76676c8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f75db0bf20 con 0x55f75dbeb2f0 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f76676c8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f75dbf8900 con 0x55f75dbea9d0 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f76676c8740 10 client.0 _ll_register_callbacks cb 0x55f75dad5030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f765e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 0x55f75dbf2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f765e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 0x55f75dbf2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60130/0 (socket says 172.21.15.81:60130) 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f765e7fc640 1 -- 172.21.15.81:0/2279184370 learned_addr learned my addr 172.21.15.81:0/2279184370 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f765effd640 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbeb2f0 0x55f75dbf27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f765e7fc640 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbea9d0 0x55f75dbf5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f765e7fc640 1 -- 172.21.15.81:0/2279184370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbea9d0 msgr2=0x55f75dbf5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f765e7fc640 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbea9d0 0x55f75dbf5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f765e7fc640 1 -- 172.21.15.81:0/2279184370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbeb2f0 msgr2=0x55f75dbf27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f765e7fc640 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbeb2f0 0x55f75dbf27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f765e7fc640 1 -- 172.21.15.81:0/2279184370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f75d8c22b0 con 0x55f75dbf5bb0 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f765effd640 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbeb2f0 0x55f75dbf27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f765e7fc640 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 0x55f75dbf2cf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f765402a940 tx=0x7f76540054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9734d891c01bb6d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f7642ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f7642ff5640 1 -- 172.21.15.81:0/2279184370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7654035070 con 0x55f75dbf5bb0 2024-09-12T01:28:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f7642ff5640 1 -- 172.21.15.81:0/2279184370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7654004050 con 0x55f75dbf5bb0 2024-09-12T01:28:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.368+0000 7f76676c8740 1 -- 172.21.15.81:0/2279184370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7654031800 con 0x55f75dbf5bb0 2024-09-12T01:28:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.369+0000 7f7642ff5640 1 -- 172.21.15.81:0/2279184370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7654004250 con 0x55f75dbf5bb0 2024-09-12T01:28:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.369+0000 7f76676c8740 10 client.15468 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.369+0000 7f76676c8740 1 -- 172.21.15.81:0/2279184370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f75dc040a0 con 0x55f75dbf5bb0 2024-09-12T01:28:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.369+0000 7f7642ff5640 1 -- 172.21.15.81:0/2279184370 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7654031800 con 0x55f75dbf5bb0 2024-09-12T01:28:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.369+0000 7f7642ff5640 1 -- 172.21.15.81:0/2279184370 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f76540038c0 con 0x55f75dbf5bb0 2024-09-12T01:28:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.369+0000 7f76676c8740 10 client.15468 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.369+0000 7f76676c8740 10 client.15468 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-12T01:28:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.369+0000 7f76676c8740 20 client.15468 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.369+0000 7f76676c8740 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55f75dc061d0 0x55f75dc07640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.369+0000 7f76676c8740 4 client.15468 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.369+0000 7f76676c8740 1 -- 172.21.15.81:0/2279184370 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f75db5e600 con 0x55f75dc061d0 2024-09-12T01:28:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.369+0000 7f765effd640 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55f75dc061d0 0x55f75dc07640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.370+0000 7f7642ff5640 10 client.15468 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:28:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.370+0000 7f765effd640 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55f75dc061d0 0x55f75dc07640 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f45ac0dd92f0e54f server_cookie=a905332a04b202b4 in_seq=0 out_seq=0 2024-09-12T01:28:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f7642ff5640 1 -- 172.21.15.81:0/2279184370 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f75db5e600 con 0x55f75dc061d0 2024-09-12T01:28:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f7642ff5640 10 client.15468 handle_command_reply: tid=0 2024-09-12T01:28:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f76676c8740 1 client.15468 shutdown 2024-09-12T01:28:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f76676c8740 1 -- 172.21.15.81:0/2279184370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 msgr2=0x55f75dbf2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f76676c8740 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 0x55f75dbf2cf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f765402a940 tx=0x7f76540054e0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f76676c8740 1 -- 172.21.15.81:0/2279184370 shutdown_connections 2024-09-12T01:28:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f76676c8740 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbf5bb0 0x55f75dbf2cf0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f76676c8740 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbeb2f0 0x55f75dbf27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f76676c8740 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55f75dc061d0 0x55f75dc07640 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f76676c8740 1 --2- 172.21.15.81:0/2279184370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbea9d0 0x55f75dbf5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f76676c8740 1 -- 172.21.15.81:0/2279184370 >> 172.21.15.81:0/2279184370 conn(0x55f75dbe6f60 msgr2=0x55f75dbecc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f7642ff5640 0 client.15468 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:28:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f76676c8740 1 -- 172.21.15.81:0/2279184370 shutdown_connections 2024-09-12T01:28:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f76676c8740 1 -- 172.21.15.81:0/2279184370 wait complete. 2024-09-12T01:28:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.371+0000 7f76676c8740 20 client.15468 trim_cache size 0 max 16384 2024-09-12T01:28:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.388+0000 7f76676c8740 1 Processor -- start 2024-09-12T01:28:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.388+0000 7f76676c8740 1 -- start start 2024-09-12T01:28:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f76676c8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 0x55f75dc061d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f76676c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 0x55f75dc06f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f76676c8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbf5bb0 0x55f75dc05b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f76676c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f75dc05980 con 0x55f75dbeb2f0 2024-09-12T01:28:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f76676c8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f75dc06050 con 0x55f75dbea9d0 2024-09-12T01:28:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f76676c8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f75dc06720 con 0x55f75dbf5bb0 2024-09-12T01:28:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f765effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 0x55f75dc06f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f765effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 0x55f75dc06f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60134/0 (socket says 172.21.15.81:60134) 2024-09-12T01:28:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f765effd640 1 -- 172.21.15.81:0/1936287202 learned_addr learned my addr 172.21.15.81:0/1936287202 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f765e7fc640 1 --2- 172.21.15.81:0/1936287202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbf5bb0 0x55f75dc05b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f765effd640 1 -- 172.21.15.81:0/1936287202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbf5bb0 msgr2=0x55f75dc05b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f765effd640 1 --2- 172.21.15.81:0/1936287202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbf5bb0 0x55f75dc05b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f765effd640 1 -- 172.21.15.81:0/1936287202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 msgr2=0x55f75dc061d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f765effd640 1 --2- 172.21.15.81:0/1936287202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 0x55f75dc061d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f765effd640 1 -- 172.21.15.81:0/1936287202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f75dbe7bf0 con 0x55f75dbeb2f0 2024-09-12T01:28:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f765effd640 1 --2- 172.21.15.81:0/1936287202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 0x55f75dc06f70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7650000f80 tx=0x7f76500075b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfaef6bd3114fe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f7644ff9640 1 -- 172.21.15.81:0/1936287202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765001e070 con 0x55f75dbeb2f0 2024-09-12T01:28:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f7644ff9640 1 -- 172.21.15.81:0/1936287202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7650012e40 con 0x55f75dbeb2f0 2024-09-12T01:28:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.389+0000 7f7644ff9640 1 -- 172.21.15.81:0/1936287202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765001a7a0 con 0x55f75dbeb2f0 2024-09-12T01:28:27.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.390+0000 7f76676c8740 1 -- 172.21.15.81:0/1936287202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 msgr2=0x55f75dc06f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:27.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.390+0000 7f76676c8740 1 --2- 172.21.15.81:0/1936287202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 0x55f75dc06f70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7650000f80 tx=0x7f76500075b0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.390+0000 7f76676c8740 1 -- 172.21.15.81:0/1936287202 shutdown_connections 2024-09-12T01:28:27.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.390+0000 7f76676c8740 1 --2- 172.21.15.81:0/1936287202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbf5bb0 0x55f75dc05b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.390+0000 7f76676c8740 1 --2- 172.21.15.81:0/1936287202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 0x55f75dc06f70 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.390+0000 7f76676c8740 1 --2- 172.21.15.81:0/1936287202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 0x55f75dc061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.390+0000 7f76676c8740 1 -- 172.21.15.81:0/1936287202 >> 172.21.15.81:0/1936287202 conn(0x55f75dbe6f60 msgr2=0x55f75dbe1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:27.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.390+0000 7f76676c8740 1 -- 172.21.15.81:0/1936287202 shutdown_connections 2024-09-12T01:28:27.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.390+0000 7f76676c8740 1 -- 172.21.15.81:0/1936287202 wait complete. 2024-09-12T01:28:27.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.390+0000 7f76676c8740 1 -- start start 2024-09-12T01:28:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.390+0000 7f76676c8740 1 Processor -- start 2024-09-12T01:28:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f76676c8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 0x55f75dc0a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f76676c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 0x55f75dc0ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f76676c8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbf5bb0 0x55f75dc0b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f76676c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f75dc074c0 con 0x55f75dbeb2f0 2024-09-12T01:28:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f76676c8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f75dc06df0 con 0x55f75dbea9d0 2024-09-12T01:28:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f76676c8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f75dc07b90 con 0x55f75dbf5bb0 2024-09-12T01:28:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f76676c8740 10 client.0 _ll_register_callbacks cb 0x7f76540315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f765effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 0x55f75dc0ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f765effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 0x55f75dc0ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60144/0 (socket says 172.21.15.81:60144) 2024-09-12T01:28:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f765effd640 1 -- 172.21.15.81:0/3968071213 learned_addr learned my addr 172.21.15.81:0/3968071213 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f765e7fc640 1 --2- 172.21.15.81:0/3968071213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 0x55f75dc0a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f765e7fc640 1 --2- 172.21.15.81:0/3968071213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbf5bb0 0x55f75dc0b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f765effd640 1 -- 172.21.15.81:0/3968071213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbf5bb0 msgr2=0x55f75dc0b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f765effd640 1 --2- 172.21.15.81:0/3968071213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbf5bb0 0x55f75dc0b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f765effd640 1 -- 172.21.15.81:0/3968071213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 msgr2=0x55f75dc0a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f765effd640 1 --2- 172.21.15.81:0/3968071213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 0x55f75dc0a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f765effd640 1 -- 172.21.15.81:0/3968071213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f75dc6e9d0 con 0x55f75dbeb2f0 2024-09-12T01:28:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f765effd640 1 --2- 172.21.15.81:0/3968071213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 0x55f75dc0ac70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f765001a3a0 tx=0x7f76500052b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3735e7d48db6cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f7642ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f7642ff5640 1 -- 172.21.15.81:0/3968071213 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765001e070 con 0x55f75dbeb2f0 2024-09-12T01:28:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f7642ff5640 1 -- 172.21.15.81:0/3968071213 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f765001a400 con 0x55f75dbeb2f0 2024-09-12T01:28:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.391+0000 7f76676c8740 1 -- 172.21.15.81:0/3968071213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f75db58b10 con 0x55f75dbeb2f0 2024-09-12T01:28:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.392+0000 7f7642ff5640 1 -- 172.21.15.81:0/3968071213 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f76500056b0 con 0x55f75dbeb2f0 2024-09-12T01:28:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.392+0000 7f76676c8740 10 client.15474 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.392+0000 7f76676c8740 1 -- 172.21.15.81:0/3968071213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f75dc6fcb0 con 0x55f75dbeb2f0 2024-09-12T01:28:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.392+0000 7f7642ff5640 1 -- 172.21.15.81:0/3968071213 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f75db58b10 con 0x55f75dbeb2f0 2024-09-12T01:28:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.392+0000 7f7642ff5640 1 -- 172.21.15.81:0/3968071213 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f765002a070 con 0x55f75dbeb2f0 2024-09-12T01:28:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.392+0000 7f76676c8740 10 client.15474 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.392+0000 7f76676c8740 10 client.15474 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-12T01:28:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.392+0000 7f76676c8740 20 client.15474 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.392+0000 7f76676c8740 1 --2- 172.21.15.81:0/3968071213 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55f75dc746c0 0x55f75dc733d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.392+0000 7f76676c8740 4 client.15474 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:28:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.392+0000 7f76676c8740 1 -- 172.21.15.81:0/3968071213 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "status"}) -- 0x55f75dad50e0 con 0x55f75dc746c0 2024-09-12T01:28:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.392+0000 7f765e7fc640 1 --2- 172.21.15.81:0/3968071213 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55f75dc746c0 0x55f75dc733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f765e7fc640 1 --2- 172.21.15.81:0/3968071213 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55f75dc746c0 0x55f75dc733d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=30552c180e2fbbd0 server_cookie=1963ba0d5f090c19 in_seq=0 out_seq=0 2024-09-12T01:28:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f7642ff5640 10 client.15474 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:28:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f7642ff5640 1 -- 172.21.15.81:0/3968071213 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55f75dad50e0 con 0x55f75dc746c0 2024-09-12T01:28:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f7642ff5640 10 client.15474 handle_command_reply: tid=0 2024-09-12T01:28:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f76676c8740 1 client.15474 shutdown 2024-09-12T01:28:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f76676c8740 1 -- 172.21.15.81:0/3968071213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 msgr2=0x55f75dc0ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f76676c8740 1 --2- 172.21.15.81:0/3968071213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 0x55f75dc0ac70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f765001a3a0 tx=0x7f76500052b0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f76676c8740 1 -- 172.21.15.81:0/3968071213 shutdown_connections 2024-09-12T01:28:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f76676c8740 1 --2- 172.21.15.81:0/3968071213 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55f75dc746c0 0x55f75dc733d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f76676c8740 1 --2- 172.21.15.81:0/3968071213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f75dbf5bb0 0x55f75dc0b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f76676c8740 1 --2- 172.21.15.81:0/3968071213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f75dbeb2f0 0x55f75dc0ac70 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f76676c8740 1 --2- 172.21.15.81:0/3968071213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f75dbea9d0 0x55f75dc0a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f76676c8740 1 -- 172.21.15.81:0/3968071213 >> 172.21.15.81:0/3968071213 conn(0x55f75dbe6f60 msgr2=0x55f75dbf1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f7642ff5640 0 client.15474 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:28:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f76676c8740 1 -- 172.21.15.81:0/3968071213 shutdown_connections 2024-09-12T01:28:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.393+0000 7f76676c8740 1 -- 172.21.15.81:0/3968071213 wait complete. 2024-09-12T01:28:27.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.394+0000 7f76676c8740 20 client.15474 trim_cache size 0 max 16384 2024-09-12T01:28:27.399 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:28:27.399 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:28:27.399 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 4, 2024-09-12T01:28:27.399 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24391, 2024-09-12T01:28:27.399 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:28:27.399 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:28:27.399 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:28:27.399 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 122.123691519, 2024-09-12T01:28:27.399 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 28, 2024-09-12T01:28:27.399 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 83, 2024-09-12T01:28:27.400 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:28:27.400 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 172.94441806 2024-09-12T01:28:27.400 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:28:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.394+0000 7f76652ef640 1 -- 172.21.15.81:0/3383935271 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f76480a2d80 msgr2=0x7f76480a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.394+0000 7f76652ef640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f76480a2d80 0x7f76480a5240 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76580ccc80 tx=0x7f7658086040 comp rx=0 tx=0).stop 2024-09-12T01:28:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.394+0000 7f76652ef640 1 -- 172.21.15.81:0/3383935271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660106a80 msgr2=0x7f766019cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.394+0000 7f76652ef640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660106a80 0x7f766019cc90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f765800c970 tx=0x7f765800ce30 comp rx=0 tx=0).stop 2024-09-12T01:28:27.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.394+0000 7f76652ef640 1 -- 172.21.15.81:0/3383935271 shutdown_connections 2024-09-12T01:28:27.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.394+0000 7f76652ef640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f76480a2d80 0x7f76480a5240 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.394+0000 7f76652ef640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660106a80 0x7f766019cc90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.394+0000 7f76652ef640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7660101420 0x7f7660198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.394+0000 7f76652ef640 1 --2- 172.21.15.81:0/3383935271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7660100a80 0x7f76601983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:27.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.394+0000 7f76652ef640 1 -- 172.21.15.81:0/3383935271 >> 172.21.15.81:0/3383935271 conn(0x7f76600fc7a0 msgr2=0x7f76600fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:27.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.394+0000 7f76652ef640 1 -- 172.21.15.81:0/3383935271 shutdown_connections 2024-09-12T01:28:27.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:27.394+0000 7f76652ef640 1 -- 172.21.15.81:0/3383935271 wait complete. 2024-09-12T01:28:27.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:27 smithi081 ceph-mon[30920]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-12T01:28:27.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:27 smithi100 ceph-mon[35275]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-12T01:28:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:27 smithi189 ceph-mon[35357]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-12T01:28:28.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.k status 2024-09-12T01:28:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.886+0000 7fcf8e9de640 1 -- 172.21.15.81:0/3492006648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88102ef0 msgr2=0x7fcf8810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.886+0000 7fcf8e9de640 1 --2- 172.21.15.81:0/3492006648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88102ef0 0x7fcf8810da40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009ca0 tx=0x7fcf8002a950 comp rx=0 tx=0).stop 2024-09-12T01:28:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.886+0000 7fcf8e9de640 1 -- 172.21.15.81:0/3492006648 shutdown_connections 2024-09-12T01:28:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.886+0000 7fcf8e9de640 1 --2- 172.21.15.81:0/3492006648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88102ef0 0x7fcf8810da40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.886+0000 7fcf8e9de640 1 --2- 172.21.15.81:0/3492006648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf88102570 0x7fcf881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.886+0000 7fcf8e9de640 1 --2- 172.21.15.81:0/3492006648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf88100e20 0x7fcf88101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.886+0000 7fcf8e9de640 1 -- 172.21.15.81:0/3492006648 >> 172.21.15.81:0/3492006648 conn(0x7fcf880fc7d0 msgr2=0x7fcf880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.886+0000 7fcf8e9de640 1 -- 172.21.15.81:0/3492006648 shutdown_connections 2024-09-12T01:28:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.886+0000 7fcf8e9de640 1 -- 172.21.15.81:0/3492006648 wait complete. 2024-09-12T01:28:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.887+0000 7fcf8e9de640 1 Processor -- start 2024-09-12T01:28:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.887+0000 7fcf8e9de640 1 -- start start 2024-09-12T01:28:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.887+0000 7fcf8e9de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf88100e20 0x7fcf881993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.887+0000 7fcf8e9de640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf88102570 0x7fcf88199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.887+0000 7fcf8e9de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88102ef0 0x7fcf88199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.887+0000 7fcf8e9de640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcf88110f80 con 0x7fcf88102ef0 2024-09-12T01:28:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.887+0000 7fcf8e9de640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcf88110e00 con 0x7fcf88100e20 2024-09-12T01:28:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.887+0000 7fcf8e9de640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcf88111100 con 0x7fcf88102570 2024-09-12T01:28:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.887+0000 7fcf8cf7b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88102ef0 0x7fcf88199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.887+0000 7fcf8cf7b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88102ef0 0x7fcf88199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60164/0 (socket says 172.21.15.81:60164) 2024-09-12T01:28:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.887+0000 7fcf8cf7b640 1 -- 172.21.15.81:0/1842599678 learned_addr learned my addr 172.21.15.81:0/1842599678 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.887+0000 7fcf7ffff640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf88102570 0x7fcf88199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.888+0000 7fcf87fff640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf88100e20 0x7fcf881993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.888+0000 7fcf8cf7b640 1 -- 172.21.15.81:0/1842599678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf88102570 msgr2=0x7fcf88199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.888+0000 7fcf8cf7b640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf88102570 0x7fcf88199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.888+0000 7fcf8cf7b640 1 -- 172.21.15.81:0/1842599678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf88100e20 msgr2=0x7fcf881993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.888+0000 7fcf8cf7b640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf88100e20 0x7fcf881993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.888+0000 7fcf8cf7b640 1 -- 172.21.15.81:0/1842599678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf881a47d0 con 0x7fcf88102ef0 2024-09-12T01:28:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.888+0000 7fcf87fff640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf88100e20 0x7fcf881993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:28:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.888+0000 7fcf8cf7b640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88102ef0 0x7fcf88199e90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcf8002ae70 tx=0x7fcf8002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.888+0000 7fcf85ffb640 1 -- 172.21.15.81:0/1842599678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80034040 con 0x7fcf88102ef0 2024-09-12T01:28:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.888+0000 7fcf85ffb640 1 -- 172.21.15.81:0/1842599678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf80030920 con 0x7fcf88102ef0 2024-09-12T01:28:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.888+0000 7fcf8e9de640 1 -- 172.21.15.81:0/1842599678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf881a4a60 con 0x7fcf88102ef0 2024-09-12T01:28:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.888+0000 7fcf85ffb640 1 -- 172.21.15.81:0/1842599678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80045480 con 0x7fcf88102ef0 2024-09-12T01:28:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.888+0000 7fcf8e9de640 1 -- 172.21.15.81:0/1842599678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf881a4f90 con 0x7fcf88102ef0 2024-09-12T01:28:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.890+0000 7fcf85ffb640 1 -- 172.21.15.81:0/1842599678 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7fcf80037020 con 0x7fcf88102ef0 2024-09-12T01:28:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf90db7740 1 Processor -- start 2024-09-12T01:28:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf90db7740 1 -- start start 2024-09-12T01:28:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf90db7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1d9d0 0x559d4aa1ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf90db7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1e2f0 0x559d4aa28670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf90db7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 0x559d4aa2afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf85ffb640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fcf740a2e00 0x7fcf740a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf90db7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559d4a984090 con 0x559d4aa28bb0 2024-09-12T01:28:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf90db7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559d4a92ba70 con 0x559d4aa1e2f0 2024-09-12T01:28:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf90db7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559d4a980050 con 0x559d4aa1d9d0 2024-09-12T01:28:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf7ffff640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fcf740a2e00 0x7fcf740a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf8cf7b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 0x559d4aa2afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf8cf7b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 0x559d4aa2afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60176/0 (socket says 172.21.15.81:60176) 2024-09-12T01:28:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf8cf7b640 1 -- 172.21.15.81:0/4138935676 learned_addr learned my addr 172.21.15.81:0/4138935676 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf87fff640 1 --2- 172.21.15.81:0/4138935676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1e2f0 0x559d4aa28670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf7ffff640 1 --2- 172.21.15.81:0/4138935676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1d9d0 0x559d4aa1ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf85ffb640 1 -- 172.21.15.81:0/1842599678 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fcf800f0410 con 0x7fcf88102ef0 2024-09-12T01:28:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf8cf7b640 1 -- 172.21.15.81:0/4138935676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1d9d0 msgr2=0x559d4aa1ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.891+0000 7fcf8cf7b640 1 --2- 172.21.15.81:0/4138935676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1d9d0 0x559d4aa1ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.892+0000 7fcf8cf7b640 1 -- 172.21.15.81:0/4138935676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1e2f0 msgr2=0x559d4aa28670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.892+0000 7fcf8cf7b640 1 --2- 172.21.15.81:0/4138935676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1e2f0 0x559d4aa28670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.892+0000 7fcf8cf7b640 1 -- 172.21.15.81:0/4138935676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d4a938130 con 0x559d4aa28bb0 2024-09-12T01:28:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.892+0000 7fcf87fff640 1 --2- 172.21.15.81:0/4138935676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1e2f0 0x559d4aa28670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.892+0000 7fcf7ffff640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fcf740a2e00 0x7fcf740a52c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcf70005d80 tx=0x7fcf7000caf0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.892+0000 7fcf8cf7b640 1 --2- 172.21.15.81:0/4138935676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 0x559d4aa2afa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcf800bc600 tx=0x7fcf8002a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9615a409f534ee62 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.892+0000 7fcf7e7fc640 1 -- 172.21.15.81:0/4138935676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8002c040 con 0x559d4aa28bb0 2024-09-12T01:28:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.892+0000 7fcf7e7fc640 1 -- 172.21.15.81:0/4138935676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf800098d0 con 0x559d4aa28bb0 2024-09-12T01:28:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.892+0000 7fcf7e7fc640 1 -- 172.21.15.81:0/4138935676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf800c5570 con 0x559d4aa28bb0 2024-09-12T01:28:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.893+0000 7fcf90db7740 1 -- 172.21.15.81:0/4138935676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 msgr2=0x559d4aa2afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.893+0000 7fcf90db7740 1 --2- 172.21.15.81:0/4138935676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 0x559d4aa2afa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcf800bc600 tx=0x7fcf8002a950 comp rx=0 tx=0).stop 2024-09-12T01:28:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.893+0000 7fcf90db7740 1 -- 172.21.15.81:0/4138935676 shutdown_connections 2024-09-12T01:28:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.893+0000 7fcf90db7740 1 --2- 172.21.15.81:0/4138935676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 0x559d4aa2afa0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.893+0000 7fcf90db7740 1 --2- 172.21.15.81:0/4138935676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1e2f0 0x559d4aa28670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.893+0000 7fcf90db7740 1 --2- 172.21.15.81:0/4138935676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1d9d0 0x559d4aa1ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.893+0000 7fcf90db7740 1 -- 172.21.15.81:0/4138935676 >> 172.21.15.81:0/4138935676 conn(0x559d4aa19f60 msgr2=0x559d4aa1a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.893+0000 7fcf90db7740 1 -- 172.21.15.81:0/4138935676 shutdown_connections 2024-09-12T01:28:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.893+0000 7fcf90db7740 1 -- 172.21.15.81:0/4138935676 wait complete. 2024-09-12T01:28:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.893+0000 7fcf90db7740 1 -- start start 2024-09-12T01:28:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.893+0000 7fcf90db7740 1 Processor -- start 2024-09-12T01:28:28.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf90db7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1d9d0 0x559d4aa28430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf90db7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1e2f0 0x559d4aa25780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf90db7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 0x559d4aa25cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf90db7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559d4aa2b540 con 0x559d4aa28bb0 2024-09-12T01:28:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf90db7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559d4a93ef20 con 0x559d4aa1e2f0 2024-09-12T01:28:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf90db7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559d4aa2b6c0 con 0x559d4aa1d9d0 2024-09-12T01:28:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf90db7740 10 client.0 _ll_register_callbacks cb 0x559d4a908030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf8cf7b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 0x559d4aa25cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf8cf7b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 0x559d4aa25cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60182/0 (socket says 172.21.15.81:60182) 2024-09-12T01:28:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf8cf7b640 1 -- 172.21.15.81:0/3643934252 learned_addr learned my addr 172.21.15.81:0/3643934252 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf87fff640 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1d9d0 0x559d4aa28430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf7ffff640 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1e2f0 0x559d4aa25780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf8cf7b640 1 -- 172.21.15.81:0/3643934252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1d9d0 msgr2=0x559d4aa28430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf8cf7b640 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1d9d0 0x559d4aa28430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf8cf7b640 1 -- 172.21.15.81:0/3643934252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1e2f0 msgr2=0x559d4aa25780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf8cf7b640 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1e2f0 0x559d4aa25780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf8cf7b640 1 -- 172.21.15.81:0/3643934252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d4a6f52b0 con 0x559d4aa28bb0 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf7ffff640 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1e2f0 0x559d4aa25780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf8cf7b640 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 0x559d4aa25cc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcf80005fa0 tx=0x7fcf800c0e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db33d786e449d35c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf677fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf677fe640 1 -- 172.21.15.81:0/3643934252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8002c040 con 0x559d4aa28bb0 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf677fe640 1 -- 172.21.15.81:0/3643934252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fcf800bac00 con 0x559d4aa28bb0 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf90db7740 1 -- 172.21.15.81:0/3643934252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559d4a991600 con 0x559d4aa28bb0 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf677fe640 1 -- 172.21.15.81:0/3643934252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcf800bd000 con 0x559d4aa28bb0 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf90db7740 10 client.15486 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.894+0000 7fcf90db7740 1 -- 172.21.15.81:0/3643934252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d4aa2b540 con 0x559d4aa28bb0 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.895+0000 7fcf677fe640 1 -- 172.21.15.81:0/3643934252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559d4a991600 con 0x559d4aa28bb0 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.895+0000 7fcf677fe640 1 -- 172.21.15.81:0/3643934252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcf8004d030 con 0x559d4aa28bb0 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.895+0000 7fcf90db7740 10 client.15486 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.895+0000 7fcf90db7740 10 client.15486 resolve_mds: resolved name 'k' to daemon mds.k 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.895+0000 7fcf90db7740 20 client.15486 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.895+0000 7fcf90db7740 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x559d4aa39230 0x559d4aa3a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.895+0000 7fcf90db7740 4 client.15486 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.895+0000 7fcf90db7740 1 -- 172.21.15.81:0/3643934252 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d4a98bb10 con 0x559d4aa39230 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.895+0000 7fcf87fff640 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x559d4aa39230 0x559d4aa3a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.896+0000 7fcf677fe640 10 client.15486 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.896+0000 7fcf87fff640 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x559d4aa39230 0x559d4aa3a6a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=15ad686a808f062c server_cookie=61704e8d22aa87f3 in_seq=0 out_seq=0 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.896+0000 7fcf677fe640 1 -- 172.21.15.81:0/3643934252 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d4a98bb10 con 0x559d4aa39230 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.896+0000 7fcf677fe640 10 client.15486 handle_command_reply: tid=0 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.897+0000 7fcf90db7740 1 client.15486 shutdown 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.897+0000 7fcf90db7740 1 -- 172.21.15.81:0/3643934252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 msgr2=0x559d4aa25cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.897+0000 7fcf90db7740 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 0x559d4aa25cc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcf80005fa0 tx=0x7fcf800c0e00 comp rx=0 tx=0).stop 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.897+0000 7fcf90db7740 1 -- 172.21.15.81:0/3643934252 shutdown_connections 2024-09-12T01:28:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.897+0000 7fcf90db7740 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x559d4aa39230 0x559d4aa3a6a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.897+0000 7fcf90db7740 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa28bb0 0x559d4aa25cc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.897+0000 7fcf90db7740 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1e2f0 0x559d4aa25780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.897+0000 7fcf677fe640 0 client.15486 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:28:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.897+0000 7fcf90db7740 1 --2- 172.21.15.81:0/3643934252 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1d9d0 0x559d4aa28430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.897+0000 7fcf90db7740 1 -- 172.21.15.81:0/3643934252 >> 172.21.15.81:0/3643934252 conn(0x559d4aa19f60 msgr2=0x559d4aa1fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.897+0000 7fcf90db7740 1 -- 172.21.15.81:0/3643934252 shutdown_connections 2024-09-12T01:28:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.897+0000 7fcf90db7740 1 -- 172.21.15.81:0/3643934252 wait complete. 2024-09-12T01:28:28.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.897+0000 7fcf90db7740 20 client.15486 trim_cache size 0 max 16384 2024-09-12T01:28:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.914+0000 7fcf90db7740 1 Processor -- start 2024-09-12T01:28:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.914+0000 7fcf90db7740 1 -- start start 2024-09-12T01:28:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.914+0000 7fcf90db7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1d9d0 0x559d4aa3a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.914+0000 7fcf90db7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1e2f0 0x559d4aa229e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.914+0000 7fcf90db7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa28bb0 0x559d4aa22f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.914+0000 7fcf90db7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559d4aa389e0 con 0x559d4aa1e2f0 2024-09-12T01:28:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.914+0000 7fcf90db7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559d4aa390b0 con 0x559d4aa1d9d0 2024-09-12T01:28:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.914+0000 7fcf90db7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559d4aa39780 con 0x559d4aa28bb0 2024-09-12T01:28:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf7ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1e2f0 0x559d4aa229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf7ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1e2f0 0x559d4aa229e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60188/0 (socket says 172.21.15.81:60188) 2024-09-12T01:28:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf7ffff640 1 -- 172.21.15.81:0/765389837 learned_addr learned my addr 172.21.15.81:0/765389837 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf8cf7b640 1 --2- 172.21.15.81:0/765389837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa28bb0 0x559d4aa22f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf87fff640 1 --2- 172.21.15.81:0/765389837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1d9d0 0x559d4aa3a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf7ffff640 1 -- 172.21.15.81:0/765389837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa28bb0 msgr2=0x559d4aa22f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf7ffff640 1 --2- 172.21.15.81:0/765389837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa28bb0 0x559d4aa22f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf7ffff640 1 -- 172.21.15.81:0/765389837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1d9d0 msgr2=0x559d4aa3a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf7ffff640 1 --2- 172.21.15.81:0/765389837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1d9d0 0x559d4aa3a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf7ffff640 1 -- 172.21.15.81:0/765389837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d4aa19d90 con 0x559d4aa1e2f0 2024-09-12T01:28:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf87fff640 1 --2- 172.21.15.81:0/765389837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1d9d0 0x559d4aa3a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:28:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf7ffff640 1 --2- 172.21.15.81:0/765389837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1e2f0 0x559d4aa229e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcf7000c5f0 tx=0x7fcf70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb0defbcd3edbb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf7dffb640 1 -- 172.21.15.81:0/765389837 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70025070 con 0x559d4aa1e2f0 2024-09-12T01:28:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf7dffb640 1 -- 172.21.15.81:0/765389837 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf7002ab40 con 0x559d4aa1e2f0 2024-09-12T01:28:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.915+0000 7fcf7dffb640 1 -- 172.21.15.81:0/765389837 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf700129d0 con 0x559d4aa1e2f0 2024-09-12T01:28:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.916+0000 7fcf90db7740 1 -- 172.21.15.81:0/765389837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1e2f0 msgr2=0x559d4aa229e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.916+0000 7fcf90db7740 1 --2- 172.21.15.81:0/765389837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1e2f0 0x559d4aa229e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcf7000c5f0 tx=0x7fcf70004730 comp rx=0 tx=0).stop 2024-09-12T01:28:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.916+0000 7fcf90db7740 1 -- 172.21.15.81:0/765389837 shutdown_connections 2024-09-12T01:28:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.916+0000 7fcf90db7740 1 --2- 172.21.15.81:0/765389837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa28bb0 0x559d4aa22f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.916+0000 7fcf90db7740 1 --2- 172.21.15.81:0/765389837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1e2f0 0x559d4aa229e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.916+0000 7fcf90db7740 1 --2- 172.21.15.81:0/765389837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa1d9d0 0x559d4aa3a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.916+0000 7fcf90db7740 1 -- 172.21.15.81:0/765389837 >> 172.21.15.81:0/765389837 conn(0x559d4aa19f60 msgr2=0x559d4aa24050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.916+0000 7fcf90db7740 1 -- 172.21.15.81:0/765389837 shutdown_connections 2024-09-12T01:28:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.916+0000 7fcf90db7740 1 -- 172.21.15.81:0/765389837 wait complete. 2024-09-12T01:28:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.916+0000 7fcf90db7740 1 -- start start 2024-09-12T01:28:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.916+0000 7fcf90db7740 1 Processor -- start 2024-09-12T01:28:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf90db7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1d9d0 0x559d4aa40820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf90db7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1e2f0 0x559d4aa40d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf90db7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa28bb0 0x559d4aa3be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf90db7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559d4aa3a520 con 0x559d4aa1d9d0 2024-09-12T01:28:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf90db7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559d4aa39e50 con 0x559d4aa28bb0 2024-09-12T01:28:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf90db7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559d4aa3abf0 con 0x559d4aa1e2f0 2024-09-12T01:28:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf90db7740 10 client.0 _ll_register_callbacks cb 0x7fcf78009340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf87fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1d9d0 0x559d4aa40820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf87fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1d9d0 0x559d4aa40820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60204/0 (socket says 172.21.15.81:60204) 2024-09-12T01:28:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf87fff640 1 -- 172.21.15.81:0/267088991 learned_addr learned my addr 172.21.15.81:0/267088991 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf8cf7b640 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa28bb0 0x559d4aa3be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf7ffff640 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1e2f0 0x559d4aa40d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf87fff640 1 -- 172.21.15.81:0/267088991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1e2f0 msgr2=0x559d4aa40d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf87fff640 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1e2f0 0x559d4aa40d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf87fff640 1 -- 172.21.15.81:0/267088991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa28bb0 msgr2=0x559d4aa3be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf87fff640 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa28bb0 0x559d4aa3be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf87fff640 1 -- 172.21.15.81:0/267088991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d4aa1b0f0 con 0x559d4aa1d9d0 2024-09-12T01:28:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf8cf7b640 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa28bb0 0x559d4aa3be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf7ffff640 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1e2f0 0x559d4aa40d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:28:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf87fff640 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1d9d0 0x559d4aa40820 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcf78004700 tx=0x7fcf78012a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a5c996f817e5e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf677fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf677fe640 1 -- 172.21.15.81:0/267088991 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf780117d0 con 0x559d4aa1d9d0 2024-09-12T01:28:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf677fe640 1 -- 172.21.15.81:0/267088991 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fcf78011970 con 0x559d4aa1d9d0 2024-09-12T01:28:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.917+0000 7fcf90db7740 1 -- 172.21.15.81:0/267088991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf7002ab40 con 0x559d4aa1d9d0 2024-09-12T01:28:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.918+0000 7fcf677fe640 1 -- 172.21.15.81:0/267088991 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcf78011b70 con 0x559d4aa1d9d0 2024-09-12T01:28:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.918+0000 7fcf90db7740 10 client.15492 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.918+0000 7fcf90db7740 1 -- 172.21.15.81:0/267088991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d4aa3fd70 con 0x559d4aa1d9d0 2024-09-12T01:28:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.918+0000 7fcf677fe640 1 -- 172.21.15.81:0/267088991 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf7002ab40 con 0x559d4aa1d9d0 2024-09-12T01:28:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.918+0000 7fcf677fe640 1 -- 172.21.15.81:0/267088991 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcf7800f040 con 0x559d4aa1d9d0 2024-09-12T01:28:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.918+0000 7fcf90db7740 10 client.15492 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.918+0000 7fcf90db7740 10 client.15492 resolve_mds: resolved name 'k' to daemon mds.k 2024-09-12T01:28:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.918+0000 7fcf90db7740 20 client.15492 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.918+0000 7fcf90db7740 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x559d4aaa7d60 0x559d4aaa6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.918+0000 7fcf90db7740 4 client.15492 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:28:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.918+0000 7fcf90db7740 1 -- 172.21.15.81:0/267088991 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "status"}) -- 0x559d4a9080e0 con 0x559d4aaa7d60 2024-09-12T01:28:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.918+0000 7fcf7ffff640 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x559d4aaa7d60 0x559d4aaa6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf677fe640 10 client.15492 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:28:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf7ffff640 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x559d4aaa7d60 0x559d4aaa6a70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d83a09f6b3e3b4af server_cookie=8f2f8eafb9c56ba5 in_seq=0 out_seq=0 2024-09-12T01:28:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf677fe640 1 -- 172.21.15.81:0/267088991 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x559d4a9080e0 con 0x559d4aaa7d60 2024-09-12T01:28:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf677fe640 10 client.15492 handle_command_reply: tid=0 2024-09-12T01:28:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf90db7740 1 client.15492 shutdown 2024-09-12T01:28:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf90db7740 1 -- 172.21.15.81:0/267088991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1d9d0 msgr2=0x559d4aa40820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf90db7740 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1d9d0 0x559d4aa40820 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcf78004700 tx=0x7fcf78012a40 comp rx=0 tx=0).stop 2024-09-12T01:28:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf90db7740 1 -- 172.21.15.81:0/267088991 shutdown_connections 2024-09-12T01:28:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf90db7740 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x559d4aaa7d60 0x559d4aaa6a70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf90db7740 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d4aa28bb0 0x559d4aa3be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf90db7740 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d4aa1e2f0 0x559d4aa40d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf677fe640 0 client.15492 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:28:28.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf90db7740 1 --2- 172.21.15.81:0/267088991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d4aa1d9d0 0x559d4aa40820 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf90db7740 1 -- 172.21.15.81:0/267088991 >> 172.21.15.81:0/267088991 conn(0x559d4aa19f60 msgr2=0x559d4aa205c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:28.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf90db7740 1 -- 172.21.15.81:0/267088991 shutdown_connections 2024-09-12T01:28:28.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf90db7740 1 -- 172.21.15.81:0/267088991 wait complete. 2024-09-12T01:28:28.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.919+0000 7fcf90db7740 20 client.15492 trim_cache size 0 max 16384 2024-09-12T01:28:28.925 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:28:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:28:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 3, 2024-09-12T01:28:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24401, 2024-09-12T01:28:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:28:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:28:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:28:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 124.66404717, 2024-09-12T01:28:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 28, 2024-09-12T01:28:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 83, 2024-09-12T01:28:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:28:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 171.943869108 2024-09-12T01:28:28.926 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:28:28.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.920+0000 7fcf8e9de640 1 -- 172.21.15.81:0/1842599678 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fcf740a2e00 msgr2=0x7fcf740a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:28.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.920+0000 7fcf8e9de640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fcf740a2e00 0x7fcf740a52c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcf70005d80 tx=0x7fcf7000caf0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.920+0000 7fcf8e9de640 1 -- 172.21.15.81:0/1842599678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88102ef0 msgr2=0x7fcf88199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:28.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.920+0000 7fcf8e9de640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88102ef0 0x7fcf88199e90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcf8002ae70 tx=0x7fcf8002f5d0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.920+0000 7fcf8e9de640 1 -- 172.21.15.81:0/1842599678 shutdown_connections 2024-09-12T01:28:28.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.920+0000 7fcf8e9de640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fcf740a2e00 0x7fcf740a52c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.920+0000 7fcf8e9de640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf88102ef0 0x7fcf88199e90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.920+0000 7fcf8e9de640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcf88102570 0x7fcf88199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.920+0000 7fcf8e9de640 1 --2- 172.21.15.81:0/1842599678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf88100e20 0x7fcf881993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:28.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.920+0000 7fcf8e9de640 1 -- 172.21.15.81:0/1842599678 >> 172.21.15.81:0/1842599678 conn(0x7fcf880fc7d0 msgr2=0x7fcf881068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:28.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.920+0000 7fcf8e9de640 1 -- 172.21.15.81:0/1842599678 shutdown_connections 2024-09-12T01:28:28.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:28.920+0000 7fcf8e9de640 1 -- 172.21.15.81:0/1842599678 wait complete. 2024-09-12T01:28:29.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:29 smithi081 ceph-mon[30920]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:28:29.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:29 smithi100 ceph-mon[35275]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:28:29.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:29 smithi189 ceph-mon[35357]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:28:29.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T01:28:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.629+0000 7fdd96c56640 1 -- 172.21.15.81:0/2482211017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd90103700 msgr2=0x7fdd9010bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.629+0000 7fdd96c56640 1 --2- 172.21.15.81:0/2482211017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd90103700 0x7fdd9010bbf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009900 tx=0x7fdd7c02a480 comp rx=0 tx=0).stop 2024-09-12T01:28:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.629+0000 7fdd96c56640 1 -- 172.21.15.81:0/2482211017 shutdown_connections 2024-09-12T01:28:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.629+0000 7fdd96c56640 1 --2- 172.21.15.81:0/2482211017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd9010c180 0x7fdd9010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.629+0000 7fdd96c56640 1 --2- 172.21.15.81:0/2482211017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd90103700 0x7fdd9010bbf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.629+0000 7fdd96c56640 1 --2- 172.21.15.81:0/2482211017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd90102de0 0x7fdd901031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.629+0000 7fdd96c56640 1 -- 172.21.15.81:0/2482211017 >> 172.21.15.81:0/2482211017 conn(0x7fdd900fc7a0 msgr2=0x7fdd900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.629+0000 7fdd96c56640 1 -- 172.21.15.81:0/2482211017 shutdown_connections 2024-09-12T01:28:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.629+0000 7fdd96c56640 1 -- 172.21.15.81:0/2482211017 wait complete. 2024-09-12T01:28:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd96c56640 1 Processor -- start 2024-09-12T01:28:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd96c56640 1 -- start start 2024-09-12T01:28:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd96c56640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd90102de0 0x7fdd90100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd96c56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd90103700 0x7fdd90100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd96c56640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd9010c180 0x7fdd901014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd96c56640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd90111f70 con 0x7fdd90103700 2024-09-12T01:28:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd96c56640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd90111df0 con 0x7fdd9010c180 2024-09-12T01:28:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd96c56640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd901120f0 con 0x7fdd90102de0 2024-09-12T01:28:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd8ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd90103700 0x7fdd90100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd8ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd90103700 0x7fdd90100f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60212/0 (socket says 172.21.15.81:60212) 2024-09-12T01:28:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd8ffff640 1 -- 172.21.15.81:0/3651351160 learned_addr learned my addr 172.21.15.81:0/3651351160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd951f3640 1 --2- 172.21.15.81:0/3651351160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd9010c180 0x7fdd901014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd8ffff640 1 -- 172.21.15.81:0/3651351160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd90102de0 msgr2=0x7fdd90100a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd8ffff640 1 --2- 172.21.15.81:0/3651351160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd90102de0 0x7fdd90100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd8ffff640 1 -- 172.21.15.81:0/3651351160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd9010c180 msgr2=0x7fdd901014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd8ffff640 1 --2- 172.21.15.81:0/3651351160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd9010c180 0x7fdd901014c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.630+0000 7fdd8ffff640 1 -- 172.21.15.81:0/3651351160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd901a68d0 con 0x7fdd90103700 2024-09-12T01:28:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.631+0000 7fdd8ffff640 1 --2- 172.21.15.81:0/3651351160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd90103700 0x7fdd90100f80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c006010 tx=0x7fdd7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.631+0000 7fdd8dffb640 1 -- 172.21.15.81:0/3651351160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c03f030 con 0x7fdd90103700 2024-09-12T01:28:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.631+0000 7fdd8dffb640 1 -- 172.21.15.81:0/3651351160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd7c003ce0 con 0x7fdd90103700 2024-09-12T01:28:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.631+0000 7fdd96c56640 1 -- 172.21.15.81:0/3651351160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd901a6b60 con 0x7fdd90103700 2024-09-12T01:28:30.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.631+0000 7fdd8dffb640 1 -- 172.21.15.81:0/3651351160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c035070 con 0x7fdd90103700 2024-09-12T01:28:30.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.631+0000 7fdd96c56640 1 -- 172.21.15.81:0/3651351160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd901a7090 con 0x7fdd90103700 2024-09-12T01:28:30.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.633+0000 7fdd8dffb640 1 -- 172.21.15.81:0/3651351160 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7fdd7c042030 con 0x7fdd90103700 2024-09-12T01:28:30.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.633+0000 7fdd9902f740 1 Processor -- start 2024-09-12T01:28:30.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.633+0000 7fdd9902f740 1 -- start start 2024-09-12T01:28:30.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd9902f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 0x5595ab2a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd9902f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2aa2f0 0x5595ab2b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd9902f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd9902f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5595ab210090 con 0x5595ab2a99d0 2024-09-12T01:28:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd9902f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5595ab1b7a70 con 0x5595ab2b4bb0 2024-09-12T01:28:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd9902f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5595ab20c050 con 0x5595ab2aa2f0 2024-09-12T01:28:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd951f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 0x5595ab2a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd951f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 0x5595ab2a9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60228/0 (socket says 172.21.15.81:60228) 2024-09-12T01:28:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd951f3640 1 -- 172.21.15.81:0/1749858811 learned_addr learned my addr 172.21.15.81:0/1749858811 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd8ffff640 1 --2- 172.21.15.81:0/1749858811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd949f2640 1 --2- 172.21.15.81:0/1749858811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2aa2f0 0x5595ab2b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd951f3640 1 -- 172.21.15.81:0/1749858811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2aa2f0 msgr2=0x5595ab2b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd951f3640 1 --2- 172.21.15.81:0/1749858811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2aa2f0 0x5595ab2b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd951f3640 1 -- 172.21.15.81:0/1749858811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 msgr2=0x5595ab2b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd951f3640 1 --2- 172.21.15.81:0/1749858811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd951f3640 1 -- 172.21.15.81:0/1749858811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595ab1c4130 con 0x5595ab2a99d0 2024-09-12T01:28:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd8dffb640 1 --2- 172.21.15.81:0/3651351160 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdd800a2e00 0x7fdd800a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd951f3640 1 --2- 172.21.15.81:0/1749858811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 0x5595ab2a9db0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fdd88007ec0 tx=0x7fdd8800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c678b9392733c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd949f2640 1 --2- 172.21.15.81:0/3651351160 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdd800a2e00 0x7fdd800a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.634+0000 7fdd8dffb640 1 -- 172.21.15.81:0/3651351160 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fdd7c0ef6f0 con 0x7fdd90103700 2024-09-12T01:28:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.635+0000 7fdd7affd640 1 -- 172.21.15.81:0/1749858811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd88010840 con 0x5595ab2a99d0 2024-09-12T01:28:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.635+0000 7fdd7affd640 1 -- 172.21.15.81:0/1749858811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd880183f0 con 0x5595ab2a99d0 2024-09-12T01:28:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.635+0000 7fdd7affd640 1 -- 172.21.15.81:0/1749858811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd88017600 con 0x5595ab2a99d0 2024-09-12T01:28:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.635+0000 7fdd9902f740 1 -- 172.21.15.81:0/1749858811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 msgr2=0x5595ab2a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.635+0000 7fdd949f2640 1 --2- 172.21.15.81:0/3651351160 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdd800a2e00 0x7fdd800a52c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5595ab2a6dc0 tx=0x7fdd84009530 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.635+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1749858811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 0x5595ab2a9db0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fdd88007ec0 tx=0x7fdd8800f790 comp rx=0 tx=0).stop 2024-09-12T01:28:30.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.635+0000 7fdd9902f740 1 -- 172.21.15.81:0/1749858811 shutdown_connections 2024-09-12T01:28:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.635+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1749858811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.635+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1749858811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2aa2f0 0x5595ab2b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.635+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1749858811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 0x5595ab2a9db0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.635+0000 7fdd9902f740 1 -- 172.21.15.81:0/1749858811 >> 172.21.15.81:0/1749858811 conn(0x5595ab2a5f60 msgr2=0x5595ab2a6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.635+0000 7fdd9902f740 1 -- 172.21.15.81:0/1749858811 shutdown_connections 2024-09-12T01:28:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.635+0000 7fdd9902f740 1 -- 172.21.15.81:0/1749858811 wait complete. 2024-09-12T01:28:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.636+0000 7fdd9902f740 1 -- start start 2024-09-12T01:28:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.636+0000 7fdd9902f740 1 Processor -- start 2024-09-12T01:28:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.636+0000 7fdd9902f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 0x5595ab2b4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.636+0000 7fdd9902f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2aa2f0 0x5595ab2b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.636+0000 7fdd9902f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2b4bb0 0x5595ab2b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.636+0000 7fdd9902f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5595ab2b7780 con 0x5595ab2a99d0 2024-09-12T01:28:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.636+0000 7fdd9902f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5595ab1caf20 con 0x5595ab2aa2f0 2024-09-12T01:28:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.636+0000 7fdd9902f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5595ab2b7900 con 0x5595ab2b4bb0 2024-09-12T01:28:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.636+0000 7fdd9902f740 10 client.0 _ll_register_callbacks cb 0x5595ab194030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.636+0000 7fdd949f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 0x5595ab2b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.636+0000 7fdd949f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 0x5595ab2b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60240/0 (socket says 172.21.15.81:60240) 2024-09-12T01:28:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.636+0000 7fdd949f2640 1 -- 172.21.15.81:0/1583497617 learned_addr learned my addr 172.21.15.81:0/1583497617 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd8ffff640 1 --2- 172.21.15.81:0/1583497617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2aa2f0 0x5595ab2b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd951f3640 1 --2- 172.21.15.81:0/1583497617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2b4bb0 0x5595ab2b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd949f2640 1 -- 172.21.15.81:0/1583497617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2b4bb0 msgr2=0x5595ab2b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd949f2640 1 --2- 172.21.15.81:0/1583497617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2b4bb0 0x5595ab2b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd949f2640 1 -- 172.21.15.81:0/1583497617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2aa2f0 msgr2=0x5595ab2b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd949f2640 1 --2- 172.21.15.81:0/1583497617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2aa2f0 0x5595ab2b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd949f2640 1 -- 172.21.15.81:0/1583497617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595aaf812b0 con 0x5595ab2a99d0 2024-09-12T01:28:30.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd949f2640 1 --2- 172.21.15.81:0/1583497617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 0x5595ab2b4400 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fdd840128a0 tx=0x7fdd840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34003491a2f65f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:30.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:30.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd6ffff640 1 -- 172.21.15.81:0/1583497617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400fc60 con 0x5595ab2a99d0 2024-09-12T01:28:30.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd6ffff640 1 -- 172.21.15.81:0/1583497617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fdd8400fe00 con 0x5595ab2a99d0 2024-09-12T01:28:30.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd9902f740 1 -- 172.21.15.81:0/1583497617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd880183f0 con 0x5595ab2a99d0 2024-09-12T01:28:30.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd6ffff640 1 -- 172.21.15.81:0/1583497617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdd84012e20 con 0x5595ab2a99d0 2024-09-12T01:28:30.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd9902f740 10 client.15504 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:30.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd9902f740 1 -- 172.21.15.81:0/1583497617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5595ab2c30b0 con 0x5595ab2a99d0 2024-09-12T01:28:30.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.637+0000 7fdd6ffff640 1 -- 172.21.15.81:0/1583497617 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd880183f0 con 0x5595ab2a99d0 2024-09-12T01:28:30.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.638+0000 7fdd6ffff640 1 -- 172.21.15.81:0/1583497617 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdd84027700 con 0x5595ab2a99d0 2024-09-12T01:28:30.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.638+0000 7fdd9902f740 10 client.15504 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:30.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.638+0000 7fdd9902f740 10 client.15504 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:28:30.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.638+0000 7fdd9902f740 20 client.15504 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.638+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1583497617 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5595ab2c56c0 0x5595ab2c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.638+0000 7fdd9902f740 4 client.15504 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.638+0000 7fdd9902f740 1 -- 172.21.15.81:0/1583497617 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595ab21d600 con 0x5595ab2c56c0 2024-09-12T01:28:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.638+0000 7fdd8ffff640 1 --2- 172.21.15.81:0/1583497617 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5595ab2c56c0 0x5595ab2c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd8ffff640 1 --2- 172.21.15.81:0/1583497617 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5595ab2c56c0 0x5595ab2c6b30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e6f09c4c618bd0fd server_cookie=89f4185ec909bfdd in_seq=0 out_seq=0 2024-09-12T01:28:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd6ffff640 10 client.15504 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:28:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd6ffff640 1 -- 172.21.15.81:0/1583497617 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5595ab21d600 con 0x5595ab2c56c0 2024-09-12T01:28:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd6ffff640 10 client.15504 handle_command_reply: tid=0 2024-09-12T01:28:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd9902f740 1 client.15504 shutdown 2024-09-12T01:28:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd9902f740 1 -- 172.21.15.81:0/1583497617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 msgr2=0x5595ab2b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1583497617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 0x5595ab2b4400 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fdd840128a0 tx=0x7fdd840046c0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd9902f740 1 -- 172.21.15.81:0/1583497617 shutdown_connections 2024-09-12T01:28:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1583497617 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5595ab2c56c0 0x5595ab2c6b30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1583497617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2b4bb0 0x5595ab2b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1583497617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2aa2f0 0x5595ab2b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1583497617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2a99d0 0x5595ab2b4400 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd6ffff640 0 client.15504 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:28:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.639+0000 7fdd9902f740 1 -- 172.21.15.81:0/1583497617 >> 172.21.15.81:0/1583497617 conn(0x5595ab2a5f60 msgr2=0x5595ab2abc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.640+0000 7fdd9902f740 1 -- 172.21.15.81:0/1583497617 shutdown_connections 2024-09-12T01:28:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.640+0000 7fdd9902f740 1 -- 172.21.15.81:0/1583497617 wait complete. 2024-09-12T01:28:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.640+0000 7fdd9902f740 20 client.15504 trim_cache size 0 max 16384 2024-09-12T01:28:30.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd9902f740 1 Processor -- start 2024-09-12T01:28:30.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd9902f740 1 -- start start 2024-09-12T01:28:30.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd9902f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2a99d0 0x5595ab2a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd9902f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 0x5595ab2a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd9902f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd9902f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5595ab2c4e70 con 0x5595ab2aa2f0 2024-09-12T01:28:30.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd9902f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5595ab2c5540 con 0x5595ab2b4bb0 2024-09-12T01:28:30.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd9902f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5595ab2c5c10 con 0x5595ab2a99d0 2024-09-12T01:28:30.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd8ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 0x5595ab2a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd8ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 0x5595ab2a4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60246/0 (socket says 172.21.15.81:60246) 2024-09-12T01:28:30.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd8ffff640 1 -- 172.21.15.81:0/1764235897 learned_addr learned my addr 172.21.15.81:0/1764235897 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:30.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd8ffff640 1 -- 172.21.15.81:0/1764235897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2a99d0 msgr2=0x5595ab2a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:30.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd951f3640 1 --2- 172.21.15.81:0/1764235897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.657+0000 7fdd8ffff640 1 --2- 172.21.15.81:0/1764235897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2a99d0 0x5595ab2a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.658+0000 7fdd8ffff640 1 -- 172.21.15.81:0/1764235897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 msgr2=0x5595ab2ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:30.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.658+0000 7fdd8ffff640 1 --2- 172.21.15.81:0/1764235897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.658+0000 7fdd8ffff640 1 -- 172.21.15.81:0/1764235897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595ab2b4020 con 0x5595ab2aa2f0 2024-09-12T01:28:30.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.658+0000 7fdd951f3640 1 --2- 172.21.15.81:0/1764235897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:28:30.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.658+0000 7fdd8ffff640 1 --2- 172.21.15.81:0/1764235897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 0x5595ab2a4ef0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0b7f30 tx=0x7fdd7c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579186dd4815b4f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:30.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.658+0000 7fdd7a7fc640 1 -- 172.21.15.81:0/1764235897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c049040 con 0x5595ab2aa2f0 2024-09-12T01:28:30.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.658+0000 7fdd7a7fc640 1 -- 172.21.15.81:0/1764235897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd7c0bc1d0 con 0x5595ab2aa2f0 2024-09-12T01:28:30.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.658+0000 7fdd7a7fc640 1 -- 172.21.15.81:0/1764235897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c0b9dd0 con 0x5595ab2aa2f0 2024-09-12T01:28:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.658+0000 7fdd9902f740 1 -- 172.21.15.81:0/1764235897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 msgr2=0x5595ab2a4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.658+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1764235897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 0x5595ab2a4ef0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0b7f30 tx=0x7fdd7c02a480 comp rx=0 tx=0).stop 2024-09-12T01:28:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 -- 172.21.15.81:0/1764235897 shutdown_connections 2024-09-12T01:28:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1764235897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1764235897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 0x5595ab2a4ef0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 --2- 172.21.15.81:0/1764235897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2a99d0 0x5595ab2a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 -- 172.21.15.81:0/1764235897 >> 172.21.15.81:0/1764235897 conn(0x5595ab2a5f60 msgr2=0x5595ab2a47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 -- 172.21.15.81:0/1764235897 shutdown_connections 2024-09-12T01:28:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 -- 172.21.15.81:0/1764235897 wait complete. 2024-09-12T01:28:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 -- start start 2024-09-12T01:28:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 Processor -- start 2024-09-12T01:28:30.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2a99d0 0x5595ab2ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 0x5595ab2caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5595ab2c69b0 con 0x5595ab2aa2f0 2024-09-12T01:28:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5595ab2c62e0 con 0x5595ab2b4bb0 2024-09-12T01:28:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5595ab2c7080 con 0x5595ab2a99d0 2024-09-12T01:28:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.659+0000 7fdd9902f740 10 client.0 _ll_register_callbacks cb 0x7fdd84009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd8ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 0x5595ab2caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd8ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 0x5595ab2caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60258/0 (socket says 172.21.15.81:60258) 2024-09-12T01:28:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd8ffff640 1 -- 172.21.15.81:0/837021729 learned_addr learned my addr 172.21.15.81:0/837021729 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd949f2640 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2a99d0 0x5595ab2ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd951f3640 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd8ffff640 1 -- 172.21.15.81:0/837021729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2a99d0 msgr2=0x5595ab2ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd8ffff640 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2a99d0 0x5595ab2ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd8ffff640 1 -- 172.21.15.81:0/837021729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 msgr2=0x5595ab2cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd8ffff640 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd8ffff640 1 -- 172.21.15.81:0/837021729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595ab2cf300 con 0x5595ab2aa2f0 2024-09-12T01:28:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd951f3640 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:28:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd8ffff640 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 0x5595ab2caad0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c005ab0 tx=0x7fdd7c0c4830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f53797ea56ec37 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd6ffff640 1 -- 172.21.15.81:0/837021729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c049070 con 0x5595ab2aa2f0 2024-09-12T01:28:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd6ffff640 1 -- 172.21.15.81:0/837021729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fdd7c0b8140 con 0x5595ab2aa2f0 2024-09-12T01:28:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd9902f740 1 -- 172.21.15.81:0/837021729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd7c0bc1d0 con 0x5595ab2aa2f0 2024-09-12T01:28:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd6ffff640 1 -- 172.21.15.81:0/837021729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdd7c0bbad0 con 0x5595ab2aa2f0 2024-09-12T01:28:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd9902f740 10 client.15510 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.660+0000 7fdd9902f740 1 -- 172.21.15.81:0/837021729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5595ab32f8e0 con 0x5595ab2aa2f0 2024-09-12T01:28:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.661+0000 7fdd6ffff640 1 -- 172.21.15.81:0/837021729 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd7c0bc1d0 con 0x5595ab2aa2f0 2024-09-12T01:28:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.661+0000 7fdd6ffff640 1 -- 172.21.15.81:0/837021729 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdd7c0c42b0 con 0x5595ab2aa2f0 2024-09-12T01:28:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.661+0000 7fdd9902f740 10 client.15510 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.661+0000 7fdd9902f740 10 client.15510 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:28:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.661+0000 7fdd9902f740 20 client.15510 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.661+0000 7fdd9902f740 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5595ab334230 0x5595ab332f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.661+0000 7fdd9902f740 4 client.15510 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:28:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.661+0000 7fdd9902f740 1 -- 172.21.15.81:0/837021729 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "status"}) -- 0x5595ab217b10 con 0x5595ab334230 2024-09-12T01:28:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.661+0000 7fdd949f2640 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5595ab334230 0x5595ab332f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd6ffff640 10 client.15510 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:28:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd949f2640 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5595ab334230 0x5595ab332f40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a383441b6fce35b7 server_cookie=6958aa06d2a7c4d in_seq=0 out_seq=0 2024-09-12T01:28:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd6ffff640 1 -- 172.21.15.81:0/837021729 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x5595ab217b10 con 0x5595ab334230 2024-09-12T01:28:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd6ffff640 10 client.15510 handle_command_reply: tid=0 2024-09-12T01:28:30.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd9902f740 1 client.15510 shutdown 2024-09-12T01:28:30.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd9902f740 1 -- 172.21.15.81:0/837021729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 msgr2=0x5595ab2caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:30.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd9902f740 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 0x5595ab2caad0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c005ab0 tx=0x7fdd7c0c4830 comp rx=0 tx=0).stop 2024-09-12T01:28:30.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd9902f740 1 -- 172.21.15.81:0/837021729 shutdown_connections 2024-09-12T01:28:30.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd9902f740 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5595ab334230 0x5595ab332f40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd9902f740 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5595ab2b4bb0 0x5595ab2cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd9902f740 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595ab2aa2f0 0x5595ab2caad0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd9902f740 1 --2- 172.21.15.81:0/837021729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5595ab2a99d0 0x5595ab2ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd9902f740 1 -- 172.21.15.81:0/837021729 >> 172.21.15.81:0/837021729 conn(0x5595ab2a5f60 msgr2=0x5595ab2b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:30.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd6ffff640 0 client.15510 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:28:30.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd9902f740 1 -- 172.21.15.81:0/837021729 shutdown_connections 2024-09-12T01:28:30.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd9902f740 1 -- 172.21.15.81:0/837021729 wait complete. 2024-09-12T01:28:30.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.662+0000 7fdd9902f740 20 client.15510 trim_cache size 0 max 16384 2024-09-12T01:28:30.668 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:28:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:28:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-12T01:28:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24446, 2024-09-12T01:28:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:28:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:28:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:28:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 127.19052959, 2024-09-12T01:28:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 28, 2024-09-12T01:28:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 83, 2024-09-12T01:28:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:28:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 157.296388756 2024-09-12T01:28:30.669 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:28:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.663+0000 7fdd96c56640 1 -- 172.21.15.81:0/3651351160 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdd800a2e00 msgr2=0x7fdd800a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.663+0000 7fdd96c56640 1 --2- 172.21.15.81:0/3651351160 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdd800a2e00 0x7fdd800a52c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5595ab2a6dc0 tx=0x7fdd84009530 comp rx=0 tx=0).stop 2024-09-12T01:28:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.663+0000 7fdd96c56640 1 -- 172.21.15.81:0/3651351160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd90103700 msgr2=0x7fdd90100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.663+0000 7fdd96c56640 1 --2- 172.21.15.81:0/3651351160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd90103700 0x7fdd90100f80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c006010 tx=0x7fdd7c0042f0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.663+0000 7fdd96c56640 1 -- 172.21.15.81:0/3651351160 shutdown_connections 2024-09-12T01:28:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.663+0000 7fdd96c56640 1 --2- 172.21.15.81:0/3651351160 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdd800a2e00 0x7fdd800a52c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.663+0000 7fdd96c56640 1 --2- 172.21.15.81:0/3651351160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd9010c180 0x7fdd901014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.663+0000 7fdd96c56640 1 --2- 172.21.15.81:0/3651351160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd90103700 0x7fdd90100f80 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.663+0000 7fdd96c56640 1 --2- 172.21.15.81:0/3651351160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd90102de0 0x7fdd90100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.663+0000 7fdd96c56640 1 -- 172.21.15.81:0/3651351160 >> 172.21.15.81:0/3651351160 conn(0x7fdd900fc7a0 msgr2=0x7fdd900fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.663+0000 7fdd96c56640 1 -- 172.21.15.81:0/3651351160 shutdown_connections 2024-09-12T01:28:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:30.663+0000 7fdd96c56640 1 -- 172.21.15.81:0/3651351160 wait complete. 2024-09-12T01:28:31.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T01:28:31.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:31 smithi081 ceph-mon[30920]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T01:28:31.668 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:31.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:31 smithi100 ceph-mon[35275]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T01:28:31.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:31 smithi189 ceph-mon[35357]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T01:28:32.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.172+0000 7f220d365640 1 -- 172.21.15.81:0/896224587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2208102790 msgr2=0x7f22081067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:32.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.172+0000 7f220d365640 1 --2- 172.21.15.81:0/896224587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2208102790 0x7f22081067e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f21fc009900 tx=0x7f21fc02a410 comp rx=0 tx=0).stop 2024-09-12T01:28:32.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.172+0000 7f220d365640 1 -- 172.21.15.81:0/896224587 shutdown_connections 2024-09-12T01:28:32.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.172+0000 7f220d365640 1 --2- 172.21.15.81:0/896224587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2208106f10 0x7f220810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.172+0000 7f220d365640 1 --2- 172.21.15.81:0/896224587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2208102790 0x7f22081067e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.172+0000 7f220d365640 1 --2- 172.21.15.81:0/896224587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2208101de0 0x7f22081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.172+0000 7f220d365640 1 -- 172.21.15.81:0/896224587 >> 172.21.15.81:0/896224587 conn(0x7f22080fd8c0 msgr2=0x7f22080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:32.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.172+0000 7f220d365640 1 -- 172.21.15.81:0/896224587 shutdown_connections 2024-09-12T01:28:32.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.172+0000 7f220d365640 1 -- 172.21.15.81:0/896224587 wait complete. 2024-09-12T01:28:32.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.173+0000 7f220d365640 1 Processor -- start 2024-09-12T01:28:32.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.173+0000 7f220d365640 1 -- start start 2024-09-12T01:28:32.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.173+0000 7f220d365640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2208101de0 0x7f2208198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.173+0000 7f220d365640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2208102790 0x7f2208198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.173+0000 7f220d365640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2208106f10 0x7f220819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.173+0000 7f220d365640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2208111f70 con 0x7f2208101de0 2024-09-12T01:28:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.173+0000 7f220d365640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2208111df0 con 0x7f2208102790 2024-09-12T01:28:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.173+0000 7f220d365640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f22081120f0 con 0x7f2208106f10 2024-09-12T01:28:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.173+0000 7f2206ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2208101de0 0x7f2208198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.173+0000 7f2206ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2208101de0 0x7f2208198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50484/0 (socket says 172.21.15.81:50484) 2024-09-12T01:28:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.173+0000 7f2206ffd640 1 -- 172.21.15.81:0/2187851385 learned_addr learned my addr 172.21.15.81:0/2187851385 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.174+0000 7f22067fc640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2208102790 0x7f2208198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.174+0000 7f22077fe640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2208106f10 0x7f220819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.174+0000 7f2206ffd640 1 -- 172.21.15.81:0/2187851385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2208106f10 msgr2=0x7f220819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.174+0000 7f2206ffd640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2208106f10 0x7f220819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.174+0000 7f2206ffd640 1 -- 172.21.15.81:0/2187851385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2208102790 msgr2=0x7f2208198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.174+0000 7f2206ffd640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2208102790 0x7f2208198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.174+0000 7f2206ffd640 1 -- 172.21.15.81:0/2187851385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220819d3c0 con 0x7f2208101de0 2024-09-12T01:28:32.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.174+0000 7f2206ffd640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2208101de0 0x7f2208198410 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f21f800d950 tx=0x7f21f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:32.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.174+0000 7f21effff640 1 -- 172.21.15.81:0/2187851385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8017070 con 0x7f2208101de0 2024-09-12T01:28:32.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.174+0000 7f21effff640 1 -- 172.21.15.81:0/2187851385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21f8009c30 con 0x7f2208101de0 2024-09-12T01:28:32.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.174+0000 7f220d365640 1 -- 172.21.15.81:0/2187851385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220819d6b0 con 0x7f2208101de0 2024-09-12T01:28:32.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.174+0000 7f21effff640 1 -- 172.21.15.81:0/2187851385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f800f6b0 con 0x7f2208101de0 2024-09-12T01:28:32.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.174+0000 7f220d365640 1 -- 172.21.15.81:0/2187851385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22081a4f90 con 0x7f2208101de0 2024-09-12T01:28:32.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.177+0000 7f21effff640 1 -- 172.21.15.81:0/2187851385 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f21f80109d0 con 0x7f2208101de0 2024-09-12T01:28:32.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.177+0000 7f220f73e740 1 Processor -- start 2024-09-12T01:28:32.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.177+0000 7f220f73e740 1 -- start start 2024-09-12T01:28:32.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.177+0000 7f220f73e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed559d0 0x5635bed55db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.177+0000 7f220f73e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 0x5635bed60670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.177+0000 7f220f73e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed60bb0 0x5635bed62fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.177+0000 7f220f73e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5635becbc090 con 0x5635bed562f0 2024-09-12T01:28:32.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.177+0000 7f220f73e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5635bec63a70 con 0x5635bed60bb0 2024-09-12T01:28:32.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.177+0000 7f220f73e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5635becb8050 con 0x5635bed559d0 2024-09-12T01:28:32.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f2206ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 0x5635bed60670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f2206ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 0x5635bed60670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50496/0 (socket says 172.21.15.81:50496) 2024-09-12T01:28:32.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f2206ffd640 1 -- 172.21.15.81:0/2508803932 learned_addr learned my addr 172.21.15.81:0/2508803932 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:32.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f22067fc640 1 --2- 172.21.15.81:0/2508803932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed60bb0 0x5635bed62fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f22077fe640 1 --2- 172.21.15.81:0/2508803932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed559d0 0x5635bed55db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f21effff640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f21f00a2d80 0x7f21f00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f2206ffd640 1 -- 172.21.15.81:0/2508803932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed559d0 msgr2=0x5635bed55db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:32.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f2206ffd640 1 --2- 172.21.15.81:0/2508803932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed559d0 0x5635bed55db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f22077fe640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f21f00a2d80 0x7f21f00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f2206ffd640 1 -- 172.21.15.81:0/2508803932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed60bb0 msgr2=0x5635bed62fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:32.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f2206ffd640 1 --2- 172.21.15.81:0/2508803932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed60bb0 0x5635bed62fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f2206ffd640 1 -- 172.21.15.81:0/2508803932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bec70130 con 0x5635bed562f0 2024-09-12T01:28:32.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f21effff640 1 -- 172.21.15.81:0/2187851385 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f21f80cf300 con 0x7f2208101de0 2024-09-12T01:28:32.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f2206ffd640 1 --2- 172.21.15.81:0/2508803932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 0x5635bed60670 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f21f80cc960 tx=0x7f21f8022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5116e0b3a59a2829 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:32.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f22077fe640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f21f00a2d80 0x7f21f00a5240 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2200007fa0 tx=0x7f2200004ab0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:32.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f21ed7fa640 1 -- 172.21.15.81:0/2508803932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f809b220 con 0x5635bed562f0 2024-09-12T01:28:32.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f21ed7fa640 1 -- 172.21.15.81:0/2508803932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21f8009de0 con 0x5635bed562f0 2024-09-12T01:28:32.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.178+0000 7f21ed7fa640 1 -- 172.21.15.81:0/2508803932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f801e9c0 con 0x5635bed562f0 2024-09-12T01:28:32.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.179+0000 7f220f73e740 1 -- 172.21.15.81:0/2508803932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 msgr2=0x5635bed60670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:32.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.179+0000 7f220f73e740 1 --2- 172.21.15.81:0/2508803932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 0x5635bed60670 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f21f80cc960 tx=0x7f21f8022000 comp rx=0 tx=0).stop 2024-09-12T01:28:32.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.179+0000 7f220f73e740 1 -- 172.21.15.81:0/2508803932 shutdown_connections 2024-09-12T01:28:32.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.179+0000 7f220f73e740 1 --2- 172.21.15.81:0/2508803932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed60bb0 0x5635bed62fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.179+0000 7f220f73e740 1 --2- 172.21.15.81:0/2508803932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 0x5635bed60670 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.179+0000 7f220f73e740 1 --2- 172.21.15.81:0/2508803932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed559d0 0x5635bed55db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.179+0000 7f220f73e740 1 -- 172.21.15.81:0/2508803932 >> 172.21.15.81:0/2508803932 conn(0x5635bed51f60 msgr2=0x5635bed52340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:32.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.179+0000 7f220f73e740 1 -- 172.21.15.81:0/2508803932 shutdown_connections 2024-09-12T01:28:32.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.179+0000 7f220f73e740 1 -- 172.21.15.81:0/2508803932 wait complete. 2024-09-12T01:28:32.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.179+0000 7f220f73e740 1 -- start start 2024-09-12T01:28:32.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f220f73e740 1 Processor -- start 2024-09-12T01:28:32.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f220f73e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 0x5635bed60450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f220f73e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed562f0 0x5635bed5d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f220f73e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed60bb0 0x5635bed5dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f220f73e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5635bed63720 con 0x5635bed559d0 2024-09-12T01:28:32.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f220f73e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5635bec76f20 con 0x5635bed60bb0 2024-09-12T01:28:32.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f220f73e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5635bed638a0 con 0x5635bed562f0 2024-09-12T01:28:32.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f220f73e740 10 client.0 _ll_register_callbacks cb 0x5635bec40030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:32.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f2206ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 0x5635bed60450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f2206ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 0x5635bed60450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50506/0 (socket says 172.21.15.81:50506) 2024-09-12T01:28:32.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f2206ffd640 1 -- 172.21.15.81:0/2257794917 learned_addr learned my addr 172.21.15.81:0/2257794917 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:32.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f22067fc640 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed562f0 0x5635bed5d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f22077fe640 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed60bb0 0x5635bed5dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f2206ffd640 1 -- 172.21.15.81:0/2257794917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed562f0 msgr2=0x5635bed5d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:32.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f2206ffd640 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed562f0 0x5635bed5d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f2206ffd640 1 -- 172.21.15.81:0/2257794917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed60bb0 msgr2=0x5635bed5dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:32.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f2206ffd640 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed60bb0 0x5635bed5dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f2206ffd640 1 -- 172.21.15.81:0/2257794917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635bea2d2b0 con 0x5635bed559d0 2024-09-12T01:28:32.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f22077fe640 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed60bb0 0x5635bed5dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:28:32.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f2206ffd640 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 0x5635bed60450 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f21f80cd080 tx=0x7f21f8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35014dd07d32e970 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:32.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f21eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:32.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.180+0000 7f21eaff5640 1 -- 172.21.15.81:0/2257794917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f809b040 con 0x5635bed559d0 2024-09-12T01:28:32.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f21eaff5640 1 -- 172.21.15.81:0/2257794917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f21f8099780 con 0x5635bed559d0 2024-09-12T01:28:32.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f220f73e740 1 -- 172.21.15.81:0/2257794917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21f8009de0 con 0x5635bed559d0 2024-09-12T01:28:32.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f21eaff5640 1 -- 172.21.15.81:0/2257794917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f21f809b220 con 0x5635bed559d0 2024-09-12T01:28:32.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f220f73e740 10 client.15522 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:32.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f220f73e740 1 -- 172.21.15.81:0/2257794917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5635bed6f040 con 0x5635bed559d0 2024-09-12T01:28:32.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f21eaff5640 1 -- 172.21.15.81:0/2257794917 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21f8009de0 con 0x5635bed559d0 2024-09-12T01:28:32.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f21eaff5640 1 -- 172.21.15.81:0/2257794917 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f21f8097d50 con 0x5635bed559d0 2024-09-12T01:28:32.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f220f73e740 10 client.15522 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f220f73e740 10 client.15522 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:28:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f220f73e740 20 client.15522 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f220f73e740 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5635bed71190 0x5635bed72600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f220f73e740 4 client.15522 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f220f73e740 1 -- 172.21.15.81:0/2257794917 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635becc9600 con 0x5635bed71190 2024-09-12T01:28:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.181+0000 7f22067fc640 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5635bed71190 0x5635bed72600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.182+0000 7f21eaff5640 10 client.15522 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:28:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.182+0000 7f22067fc640 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5635bed71190 0x5635bed72600 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6b1ec445b55602b6 server_cookie=62fde86a0b551a6d in_seq=0 out_seq=0 2024-09-12T01:28:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.182+0000 7f21eaff5640 1 -- 172.21.15.81:0/2257794917 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635becc9600 con 0x5635bed71190 2024-09-12T01:28:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.182+0000 7f21eaff5640 10 client.15522 handle_command_reply: tid=0 2024-09-12T01:28:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.182+0000 7f220f73e740 1 client.15522 shutdown 2024-09-12T01:28:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.183+0000 7f220f73e740 1 -- 172.21.15.81:0/2257794917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 msgr2=0x5635bed60450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.183+0000 7f220f73e740 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 0x5635bed60450 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f21f80cd080 tx=0x7f21f8005f90 comp rx=0 tx=0).stop 2024-09-12T01:28:32.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.183+0000 7f220f73e740 1 -- 172.21.15.81:0/2257794917 shutdown_connections 2024-09-12T01:28:32.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.183+0000 7f220f73e740 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed60bb0 0x5635bed5dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.183+0000 7f220f73e740 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed562f0 0x5635bed5d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.183+0000 7f220f73e740 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5635bed71190 0x5635bed72600 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.183+0000 7f220f73e740 1 --2- 172.21.15.81:0/2257794917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 0x5635bed60450 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.183+0000 7f220f73e740 1 -- 172.21.15.81:0/2257794917 >> 172.21.15.81:0/2257794917 conn(0x5635bed51f60 msgr2=0x5635bed57c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:32.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.183+0000 7f21eaff5640 0 client.15522 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:28:32.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.183+0000 7f220f73e740 1 -- 172.21.15.81:0/2257794917 shutdown_connections 2024-09-12T01:28:32.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.183+0000 7f220f73e740 1 -- 172.21.15.81:0/2257794917 wait complete. 2024-09-12T01:28:32.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.183+0000 7f220f73e740 20 client.15522 trim_cache size 0 max 16384 2024-09-12T01:28:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.200+0000 7f220f73e740 1 Processor -- start 2024-09-12T01:28:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.200+0000 7f220f73e740 1 -- start start 2024-09-12T01:28:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f220f73e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed559d0 0x5635bed71190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f220f73e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 0x5635bed5f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f220f73e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed60bb0 0x5635bed5aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f220f73e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5635bed70940 con 0x5635bed562f0 2024-09-12T01:28:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f220f73e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5635bed71010 con 0x5635bed559d0 2024-09-12T01:28:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f220f73e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5635bed716e0 con 0x5635bed60bb0 2024-09-12T01:28:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f22067fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 0x5635bed5f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f22067fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 0x5635bed5f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50508/0 (socket says 172.21.15.81:50508) 2024-09-12T01:28:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f22067fc640 1 -- 172.21.15.81:0/427097266 learned_addr learned my addr 172.21.15.81:0/427097266 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f2206ffd640 1 --2- 172.21.15.81:0/427097266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed559d0 0x5635bed71190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f22067fc640 1 -- 172.21.15.81:0/427097266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed60bb0 msgr2=0x5635bed5aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f22067fc640 1 --2- 172.21.15.81:0/427097266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed60bb0 0x5635bed5aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f22067fc640 1 -- 172.21.15.81:0/427097266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed559d0 msgr2=0x5635bed71190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f22067fc640 1 --2- 172.21.15.81:0/427097266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed559d0 0x5635bed71190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f22067fc640 1 -- 172.21.15.81:0/427097266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bed5ec30 con 0x5635bed562f0 2024-09-12T01:28:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f2206ffd640 1 --2- 172.21.15.81:0/427097266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed559d0 0x5635bed71190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:28:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f22067fc640 1 --2- 172.21.15.81:0/427097266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 0x5635bed5f600 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f21fc02a930 tx=0x7f21fc005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74531fb5a942ca87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f21ecff9640 1 -- 172.21.15.81:0/427097266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc035040 con 0x5635bed562f0 2024-09-12T01:28:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f21ecff9640 1 -- 172.21.15.81:0/427097266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21fc005530 con 0x5635bed562f0 2024-09-12T01:28:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.201+0000 7f21ecff9640 1 -- 172.21.15.81:0/427097266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc0035f0 con 0x5635bed562f0 2024-09-12T01:28:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.202+0000 7f220f73e740 1 -- 172.21.15.81:0/427097266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 msgr2=0x5635bed5f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.202+0000 7f220f73e740 1 --2- 172.21.15.81:0/427097266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 0x5635bed5f600 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f21fc02a930 tx=0x7f21fc005e50 comp rx=0 tx=0).stop 2024-09-12T01:28:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.202+0000 7f220f73e740 1 -- 172.21.15.81:0/427097266 shutdown_connections 2024-09-12T01:28:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.202+0000 7f220f73e740 1 --2- 172.21.15.81:0/427097266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed60bb0 0x5635bed5aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.202+0000 7f220f73e740 1 --2- 172.21.15.81:0/427097266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed562f0 0x5635bed5f600 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.202+0000 7f220f73e740 1 --2- 172.21.15.81:0/427097266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed559d0 0x5635bed71190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.202+0000 7f220f73e740 1 -- 172.21.15.81:0/427097266 >> 172.21.15.81:0/427097266 conn(0x5635bed51f60 msgr2=0x5635bed5eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.202+0000 7f220f73e740 1 -- 172.21.15.81:0/427097266 shutdown_connections 2024-09-12T01:28:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.202+0000 7f220f73e740 1 -- 172.21.15.81:0/427097266 wait complete. 2024-09-12T01:28:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.202+0000 7f220f73e740 1 -- start start 2024-09-12T01:28:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.202+0000 7f220f73e740 1 Processor -- start 2024-09-12T01:28:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f220f73e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 0x5635bedd6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f220f73e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed562f0 0x5635bedd6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f220f73e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed60bb0 0x5635bedd6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f220f73e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5635bed72480 con 0x5635bed559d0 2024-09-12T01:28:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f220f73e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5635bed71db0 con 0x5635bed562f0 2024-09-12T01:28:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f220f73e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5635bed72b50 con 0x5635bed60bb0 2024-09-12T01:28:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f220f73e740 10 client.0 _ll_register_callbacks cb 0x7f21fc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f2206ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 0x5635bedd6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f2206ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 0x5635bedd6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50518/0 (socket says 172.21.15.81:50518) 2024-09-12T01:28:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f2206ffd640 1 -- 172.21.15.81:0/3187080304 learned_addr learned my addr 172.21.15.81:0/3187080304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f22067fc640 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed562f0 0x5635bedd6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f22077fe640 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed60bb0 0x5635bedd6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f2206ffd640 1 -- 172.21.15.81:0/3187080304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed60bb0 msgr2=0x5635bedd6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f2206ffd640 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed60bb0 0x5635bedd6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f2206ffd640 1 -- 172.21.15.81:0/3187080304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed562f0 msgr2=0x5635bedd6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f2206ffd640 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed562f0 0x5635bedd6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f2206ffd640 1 -- 172.21.15.81:0/3187080304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635bed76c70 con 0x5635bed559d0 2024-09-12T01:28:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f22077fe640 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed60bb0 0x5635bedd6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:28:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f2206ffd640 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 0x5635bedd6540 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f21f809b9d0 tx=0x7f21f80999e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd525a0e7e2bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f21eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f21eaff5640 1 -- 172.21.15.81:0/3187080304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f809b040 con 0x5635bed559d0 2024-09-12T01:28:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f21eaff5640 1 -- 172.21.15.81:0/3187080304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f21f8097d50 con 0x5635bed559d0 2024-09-12T01:28:32.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.203+0000 7f220f73e740 1 -- 172.21.15.81:0/3187080304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21fc005530 con 0x5635bed559d0 2024-09-12T01:28:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.204+0000 7f21eaff5640 1 -- 172.21.15.81:0/3187080304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f21f809b4b0 con 0x5635bed559d0 2024-09-12T01:28:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.204+0000 7f220f73e740 10 client.15528 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.204+0000 7f220f73e740 1 -- 172.21.15.81:0/3187080304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5635bed76c70 con 0x5635bed559d0 2024-09-12T01:28:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.204+0000 7f21eaff5640 1 -- 172.21.15.81:0/3187080304 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21fc005530 con 0x5635bed559d0 2024-09-12T01:28:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.204+0000 7f21eaff5640 1 -- 172.21.15.81:0/3187080304 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f21f80cccc0 con 0x5635bed559d0 2024-09-12T01:28:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.204+0000 7f220f73e740 10 client.15528 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.204+0000 7f220f73e740 10 client.15528 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:28:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.204+0000 7f220f73e740 20 client.15528 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.204+0000 7f220f73e740 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5635bede4530 0x5635bede3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.204+0000 7f220f73e740 4 client.15528 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:28:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.204+0000 7f220f73e740 1 -- 172.21.15.81:0/3187080304 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "status"}) -- 0x5635becc3b10 con 0x5635bede4530 2024-09-12T01:28:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f22067fc640 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5635bede4530 0x5635bede3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f22067fc640 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5635bede4530 0x5635bede3240 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e1bbe16264a80602 server_cookie=61bee4f6f059ff42 in_seq=0 out_seq=0 2024-09-12T01:28:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f21eaff5640 10 client.15528 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:28:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f21eaff5640 1 -- 172.21.15.81:0/3187080304 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5635becc3b10 con 0x5635bede4530 2024-09-12T01:28:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f21eaff5640 10 client.15528 handle_command_reply: tid=0 2024-09-12T01:28:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f220f73e740 1 client.15528 shutdown 2024-09-12T01:28:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f220f73e740 1 -- 172.21.15.81:0/3187080304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 msgr2=0x5635bedd6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f220f73e740 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 0x5635bedd6540 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f21f809b9d0 tx=0x7f21f80999e0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f220f73e740 1 -- 172.21.15.81:0/3187080304 shutdown_connections 2024-09-12T01:28:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f220f73e740 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5635bed60bb0 0x5635bedd6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f220f73e740 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5635bed562f0 0x5635bedd6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f220f73e740 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5635bede4530 0x5635bede3240 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f220f73e740 1 --2- 172.21.15.81:0/3187080304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635bed559d0 0x5635bedd6540 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f220f73e740 1 -- 172.21.15.81:0/3187080304 >> 172.21.15.81:0/3187080304 conn(0x5635bed51f60 msgr2=0x5635bed50e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f21eaff5640 0 client.15528 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:28:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f220f73e740 1 -- 172.21.15.81:0/3187080304 shutdown_connections 2024-09-12T01:28:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.205+0000 7f220f73e740 1 -- 172.21.15.81:0/3187080304 wait complete. 2024-09-12T01:28:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.206+0000 7f220f73e740 20 client.15528 trim_cache size 0 max 16384 2024-09-12T01:28:32.213 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:28:32.213 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:28:32.214 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-12T01:28:32.214 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24448, 2024-09-12T01:28:32.214 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:28:32.214 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:28:32.214 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:28:32.214 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 129.74066729200001, 2024-09-12T01:28:32.214 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 28, 2024-09-12T01:28:32.214 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 83, 2024-09-12T01:28:32.214 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:28:32.214 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 156.38991034599999 2024-09-12T01:28:32.214 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:28:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.206+0000 7f220d365640 1 -- 172.21.15.81:0/2187851385 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f21f00a2d80 msgr2=0x7f21f00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.206+0000 7f220d365640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f21f00a2d80 0x7f21f00a5240 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2200007fa0 tx=0x7f2200004ab0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.206+0000 7f220d365640 1 -- 172.21.15.81:0/2187851385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2208101de0 msgr2=0x7f2208198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.206+0000 7f220d365640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2208101de0 0x7f2208198410 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f21f800d950 tx=0x7f21f800de10 comp rx=0 tx=0).stop 2024-09-12T01:28:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.206+0000 7f220d365640 1 -- 172.21.15.81:0/2187851385 shutdown_connections 2024-09-12T01:28:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.206+0000 7f220d365640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f21f00a2d80 0x7f21f00a5240 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.206+0000 7f220d365640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2208106f10 0x7f220819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.206+0000 7f220d365640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2208102790 0x7f2208198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.206+0000 7f220d365640 1 --2- 172.21.15.81:0/2187851385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2208101de0 0x7f2208198410 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.206+0000 7f220d365640 1 -- 172.21.15.81:0/2187851385 >> 172.21.15.81:0/2187851385 conn(0x7f22080fd8c0 msgr2=0x7f22080febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:32.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.206+0000 7f220d365640 1 -- 172.21.15.81:0/2187851385 shutdown_connections 2024-09-12T01:28:32.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:32.206+0000 7f220d365640 1 -- 172.21.15.81:0/2187851385 wait complete. 2024-09-12T01:28:32.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T01:28:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:33.591 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:33 smithi081 ceph-mon[30920]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T01:28:33.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.671+0000 7fb0e0335640 1 -- 172.21.15.81:0/682601466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d8100a80 msgr2=0x7fb0d8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:33.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.671+0000 7fb0e0335640 1 --2- 172.21.15.81:0/682601466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d8100a80 0x7fb0d8100ee0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009930 tx=0x7fb0c802a420 comp rx=0 tx=0).stop 2024-09-12T01:28:33.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.671+0000 7fb0e0335640 1 -- 172.21.15.81:0/682601466 shutdown_connections 2024-09-12T01:28:33.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.671+0000 7fb0e0335640 1 --2- 172.21.15.81:0/682601466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d8101420 0x7fb0d810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.671+0000 7fb0e0335640 1 --2- 172.21.15.81:0/682601466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d8100a80 0x7fb0d8100ee0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.671+0000 7fb0e0335640 1 --2- 172.21.15.81:0/682601466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0d8106a80 0x7fb0d8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.671+0000 7fb0e0335640 1 -- 172.21.15.81:0/682601466 >> 172.21.15.81:0/682601466 conn(0x7fb0d80fc7a0 msgr2=0x7fb0d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:33.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.671+0000 7fb0e0335640 1 -- 172.21.15.81:0/682601466 shutdown_connections 2024-09-12T01:28:33.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.671+0000 7fb0e0335640 1 -- 172.21.15.81:0/682601466 wait complete. 2024-09-12T01:28:33.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0e0335640 1 Processor -- start 2024-09-12T01:28:33.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0e0335640 1 -- start start 2024-09-12T01:28:33.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0e0335640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d8100a80 0x7fb0d81992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0e0335640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d8101420 0x7fb0d8199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0e0335640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0d8106a80 0x7fb0d81a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0e0335640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8110e80 con 0x7fb0d8100a80 2024-09-12T01:28:33.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0e0335640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8110d00 con 0x7fb0d8101420 2024-09-12T01:28:33.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0e0335640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8111000 con 0x7fb0d8106a80 2024-09-12T01:28:33.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0de0d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d8100a80 0x7fb0d81992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0de0d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d8100a80 0x7fb0d81992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50544/0 (socket says 172.21.15.81:50544) 2024-09-12T01:28:33.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0de0d1640 1 -- 172.21.15.81:0/293177424 learned_addr learned my addr 172.21.15.81:0/293177424 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:33.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0dd8d0640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d8101420 0x7fb0d8199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0de8d2640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0d8106a80 0x7fb0d81a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0de0d1640 1 -- 172.21.15.81:0/293177424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0d8106a80 msgr2=0x7fb0d81a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:33.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0de0d1640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0d8106a80 0x7fb0d81a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0de0d1640 1 -- 172.21.15.81:0/293177424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d8101420 msgr2=0x7fb0d8199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:33.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0de0d1640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d8101420 0x7fb0d8199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.672+0000 7fb0de0d1640 1 -- 172.21.15.81:0/293177424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d81a48b0 con 0x7fb0d8100a80 2024-09-12T01:28:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.673+0000 7fb0de0d1640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d8100a80 0x7fb0d81992f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400d770 tx=0x7fb0d400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.673+0000 7fb0cf7fe640 1 -- 172.21.15.81:0/293177424 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4017070 con 0x7fb0d8100a80 2024-09-12T01:28:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.673+0000 7fb0cf7fe640 1 -- 172.21.15.81:0/293177424 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0d4005500 con 0x7fb0d8100a80 2024-09-12T01:28:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.673+0000 7fb0e0335640 1 -- 172.21.15.81:0/293177424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d81a4a80 con 0x7fb0d8100a80 2024-09-12T01:28:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.673+0000 7fb0cf7fe640 1 -- 172.21.15.81:0/293177424 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4004e00 con 0x7fb0d8100a80 2024-09-12T01:28:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.673+0000 7fb0e0335640 1 -- 172.21.15.81:0/293177424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d81a4f40 con 0x7fb0d8100a80 2024-09-12T01:28:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.675+0000 7fb0cf7fe640 1 -- 172.21.15.81:0/293177424 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7fb0d4004fa0 con 0x7fb0d8100a80 2024-09-12T01:28:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.675+0000 7fb0e270e740 1 Processor -- start 2024-09-12T01:28:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0e270e740 1 -- start start 2024-09-12T01:28:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0e270e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 0x559820d97db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0e270e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 0x559820da2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0e270e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820da2bb0 0x559820da4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0e270e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559820cfe090 con 0x559820d979d0 2024-09-12T01:28:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0e270e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559820ca5a70 con 0x559820da2bb0 2024-09-12T01:28:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0e270e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559820cfa050 con 0x559820d982f0 2024-09-12T01:28:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0de8d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 0x559820d97db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0de8d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 0x559820d97db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50548/0 (socket says 172.21.15.81:50548) 2024-09-12T01:28:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0de8d2640 1 -- 172.21.15.81:0/2500148136 learned_addr learned my addr 172.21.15.81:0/2500148136 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0de0d1640 1 --2- 172.21.15.81:0/2500148136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 0x559820da2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0dd8d0640 1 --2- 172.21.15.81:0/2500148136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820da2bb0 0x559820da4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0cf7fe640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb0c40a2e00 0x7fb0c40a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0de8d2640 1 -- 172.21.15.81:0/2500148136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 msgr2=0x559820da2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0de8d2640 1 --2- 172.21.15.81:0/2500148136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 0x559820da2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0de8d2640 1 -- 172.21.15.81:0/2500148136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820da2bb0 msgr2=0x559820da4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0de8d2640 1 --2- 172.21.15.81:0/2500148136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820da2bb0 0x559820da4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.676+0000 7fb0de8d2640 1 -- 172.21.15.81:0/2500148136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559820cb2130 con 0x559820d979d0 2024-09-12T01:28:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.677+0000 7fb0de8d2640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb0c40a2e00 0x7fb0c40a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.677+0000 7fb0cf7fe640 1 -- 172.21.15.81:0/293177424 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb0d40cef60 con 0x7fb0d8100a80 2024-09-12T01:28:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.677+0000 7fb0de8d2640 1 --2- 172.21.15.81:0/2500148136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 0x559820d97db0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00103f0 tx=0x7fb0d00107f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ba5e1df008e7a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.677+0000 7fb0ccdea640 1 -- 172.21.15.81:0/2500148136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d001c900 con 0x559820d979d0 2024-09-12T01:28:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.677+0000 7fb0ccdea640 1 -- 172.21.15.81:0/2500148136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0d00113e0 con 0x559820d979d0 2024-09-12T01:28:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.677+0000 7fb0ccdea640 1 -- 172.21.15.81:0/2500148136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d001b5f0 con 0x559820d979d0 2024-09-12T01:28:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.677+0000 7fb0de8d2640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb0c40a2e00 0x7fb0c40a52c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0020000 tx=0x7fb0d001d000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.678+0000 7fb0e270e740 1 -- 172.21.15.81:0/2500148136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 msgr2=0x559820d97db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.678+0000 7fb0e270e740 1 --2- 172.21.15.81:0/2500148136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 0x559820d97db0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00103f0 tx=0x7fb0d00107f0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.678+0000 7fb0e270e740 1 -- 172.21.15.81:0/2500148136 shutdown_connections 2024-09-12T01:28:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.678+0000 7fb0e270e740 1 --2- 172.21.15.81:0/2500148136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820da2bb0 0x559820da4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.678+0000 7fb0e270e740 1 --2- 172.21.15.81:0/2500148136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 0x559820da2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.678+0000 7fb0e270e740 1 --2- 172.21.15.81:0/2500148136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 0x559820d97db0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.678+0000 7fb0e270e740 1 -- 172.21.15.81:0/2500148136 >> 172.21.15.81:0/2500148136 conn(0x559820d93f60 msgr2=0x559820d94340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.678+0000 7fb0e270e740 1 -- 172.21.15.81:0/2500148136 shutdown_connections 2024-09-12T01:28:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.678+0000 7fb0e270e740 1 -- 172.21.15.81:0/2500148136 wait complete. 2024-09-12T01:28:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.678+0000 7fb0e270e740 1 -- start start 2024-09-12T01:28:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.678+0000 7fb0e270e740 1 Processor -- start 2024-09-12T01:28:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0e270e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820d979d0 0x559820da2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0e270e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 0x559820d9f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0e270e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 0x559820d9fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0e270e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559820da9b90 con 0x559820da2bb0 2024-09-12T01:28:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0e270e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559820cb8f20 con 0x559820d979d0 2024-09-12T01:28:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0e270e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559820da9d10 con 0x559820d982f0 2024-09-12T01:28:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0e270e740 10 client.0 _ll_register_callbacks cb 0x559820c82030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0de8d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 0x559820d9fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0de8d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 0x559820d9fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50556/0 (socket says 172.21.15.81:50556) 2024-09-12T01:28:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0de8d2640 1 -- 172.21.15.81:0/3276916625 learned_addr learned my addr 172.21.15.81:0/3276916625 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0de0d1640 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820d979d0 0x559820da2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0dd8d0640 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 0x559820d9f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0de8d2640 1 -- 172.21.15.81:0/3276916625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 msgr2=0x559820d9f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0de8d2640 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 0x559820d9f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0de8d2640 1 -- 172.21.15.81:0/3276916625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820d979d0 msgr2=0x559820da2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0de8d2640 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820d979d0 0x559820da2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0de8d2640 1 -- 172.21.15.81:0/3276916625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559820a6f2b0 con 0x559820da2bb0 2024-09-12T01:28:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0de0d1640 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820d979d0 0x559820da2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0de8d2640 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 0x559820d9fcc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0005c40 tx=0x7fb0d001b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcf2c36818401aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0c1ffb640 1 -- 172.21.15.81:0/3276916625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0033060 con 0x559820da2bb0 2024-09-12T01:28:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0e270e740 1 -- 172.21.15.81:0/3276916625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0d00113e0 con 0x559820da2bb0 2024-09-12T01:28:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0c1ffb640 1 -- 172.21.15.81:0/3276916625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb0d00117a0 con 0x559820da2bb0 2024-09-12T01:28:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0c1ffb640 1 -- 172.21.15.81:0/3276916625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb0d00135a0 con 0x559820da2bb0 2024-09-12T01:28:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0e270e740 10 client.15540 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.679+0000 7fb0e270e740 1 -- 172.21.15.81:0/3276916625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559820db54a0 con 0x559820da2bb0 2024-09-12T01:28:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.680+0000 7fb0c1ffb640 1 -- 172.21.15.81:0/3276916625 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0d00113e0 con 0x559820da2bb0 2024-09-12T01:28:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.680+0000 7fb0c1ffb640 1 -- 172.21.15.81:0/3276916625 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb0d000f040 con 0x559820da2bb0 2024-09-12T01:28:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.680+0000 7fb0e270e740 10 client.15540 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.680+0000 7fb0e270e740 10 client.15540 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:28:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.680+0000 7fb0e270e740 20 client.15540 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.680+0000 7fb0e270e740 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x559820db7860 0x559820db8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.680+0000 7fb0e270e740 4 client.15540 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.680+0000 7fb0e270e740 1 -- 172.21.15.81:0/3276916625 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559820d0b600 con 0x559820db7860 2024-09-12T01:28:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.680+0000 7fb0de0d1640 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x559820db7860 0x559820db8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.681+0000 7fb0c1ffb640 10 client.15540 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.681+0000 7fb0de0d1640 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x559820db7860 0x559820db8cd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9bd4f9790775a99 server_cookie=e5dc538db0754d51 in_seq=0 out_seq=0 2024-09-12T01:28:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.681+0000 7fb0c1ffb640 1 -- 172.21.15.81:0/3276916625 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559820d0b600 con 0x559820db7860 2024-09-12T01:28:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.681+0000 7fb0c1ffb640 10 client.15540 handle_command_reply: tid=0 2024-09-12T01:28:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.681+0000 7fb0e270e740 1 client.15540 shutdown 2024-09-12T01:28:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.681+0000 7fb0e270e740 1 -- 172.21.15.81:0/3276916625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 msgr2=0x559820d9fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.681+0000 7fb0e270e740 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 0x559820d9fcc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0005c40 tx=0x7fb0d001b680 comp rx=0 tx=0).stop 2024-09-12T01:28:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.682+0000 7fb0e270e740 1 -- 172.21.15.81:0/3276916625 shutdown_connections 2024-09-12T01:28:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.682+0000 7fb0e270e740 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x559820db7860 0x559820db8cd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.682+0000 7fb0e270e740 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 0x559820d9fcc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.682+0000 7fb0e270e740 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 0x559820d9f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.682+0000 7fb0e270e740 1 --2- 172.21.15.81:0/3276916625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820d979d0 0x559820da2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.682+0000 7fb0e270e740 1 -- 172.21.15.81:0/3276916625 >> 172.21.15.81:0/3276916625 conn(0x559820d93f60 msgr2=0x559820d99c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.682+0000 7fb0c1ffb640 0 client.15540 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.682+0000 7fb0e270e740 1 -- 172.21.15.81:0/3276916625 shutdown_connections 2024-09-12T01:28:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.682+0000 7fb0e270e740 1 -- 172.21.15.81:0/3276916625 wait complete. 2024-09-12T01:28:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.682+0000 7fb0e270e740 20 client.15540 trim_cache size 0 max 16384 2024-09-12T01:28:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.699+0000 7fb0e270e740 1 Processor -- start 2024-09-12T01:28:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.699+0000 7fb0e270e740 1 -- start start 2024-09-12T01:28:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.699+0000 7fb0e270e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d979d0 0x559820db7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.699+0000 7fb0e270e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820d982f0 0x559820db7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.699+0000 7fb0e270e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 0x559820da15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.699+0000 7fb0e270e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559820db7010 con 0x559820da2bb0 2024-09-12T01:28:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.699+0000 7fb0e270e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559820db76e0 con 0x559820d982f0 2024-09-12T01:28:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.699+0000 7fb0e270e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559820db7db0 con 0x559820d979d0 2024-09-12T01:28:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.699+0000 7fb0de8d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 0x559820da15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.699+0000 7fb0de8d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 0x559820da15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50566/0 (socket says 172.21.15.81:50566) 2024-09-12T01:28:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.699+0000 7fb0de8d2640 1 -- 172.21.15.81:0/321479857 learned_addr learned my addr 172.21.15.81:0/321479857 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.700+0000 7fb0de0d1640 1 --2- 172.21.15.81:0/321479857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d979d0 0x559820db7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.700+0000 7fb0dd8d0640 1 --2- 172.21.15.81:0/321479857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820d982f0 0x559820db7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.700+0000 7fb0de8d2640 1 -- 172.21.15.81:0/321479857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d979d0 msgr2=0x559820db7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.700+0000 7fb0de8d2640 1 --2- 172.21.15.81:0/321479857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d979d0 0x559820db7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.700+0000 7fb0de8d2640 1 -- 172.21.15.81:0/321479857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820d982f0 msgr2=0x559820db7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.700+0000 7fb0de8d2640 1 --2- 172.21.15.81:0/321479857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820d982f0 0x559820db7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.700+0000 7fb0de8d2640 1 -- 172.21.15.81:0/321479857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559820da9ca0 con 0x559820da2bb0 2024-09-12T01:28:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.700+0000 7fb0de0d1640 1 --2- 172.21.15.81:0/321479857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d979d0 0x559820db7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.700+0000 7fb0de8d2640 1 --2- 172.21.15.81:0/321479857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 0x559820da15e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000a010 tx=0x7fb0d0004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a78c8fbb5c3cc1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.700+0000 7fb0c3fff640 1 -- 172.21.15.81:0/321479857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0033070 con 0x559820da2bb0 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.700+0000 7fb0c3fff640 1 -- 172.21.15.81:0/321479857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0d002a040 con 0x559820da2bb0 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.700+0000 7fb0c3fff640 1 -- 172.21.15.81:0/321479857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d00117a0 con 0x559820da2bb0 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 -- 172.21.15.81:0/321479857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 msgr2=0x559820da15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 --2- 172.21.15.81:0/321479857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 0x559820da15e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000a010 tx=0x7fb0d0004a90 comp rx=0 tx=0).stop 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 -- 172.21.15.81:0/321479857 shutdown_connections 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 --2- 172.21.15.81:0/321479857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820da2bb0 0x559820da15e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 --2- 172.21.15.81:0/321479857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820d982f0 0x559820db7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 --2- 172.21.15.81:0/321479857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d979d0 0x559820db7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 -- 172.21.15.81:0/321479857 >> 172.21.15.81:0/321479857 conn(0x559820d93f60 msgr2=0x559820da0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 -- 172.21.15.81:0/321479857 shutdown_connections 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 -- 172.21.15.81:0/321479857 wait complete. 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 -- start start 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 Processor -- start 2024-09-12T01:28:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 0x559820dbc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 0x559820dbca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820da2bb0 0x559820e19f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559820db8b50 con 0x559820d979d0 2024-09-12T01:28:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559820db8480 con 0x559820da2bb0 2024-09-12T01:28:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.701+0000 7fb0e270e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559820db9220 con 0x559820d982f0 2024-09-12T01:28:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0de0d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 0x559820dbc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0e270e740 10 client.0 _ll_register_callbacks cb 0x7fb0d001f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0de0d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 0x559820dbc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50578/0 (socket says 172.21.15.81:50578) 2024-09-12T01:28:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0de0d1640 1 -- 172.21.15.81:0/2945585184 learned_addr learned my addr 172.21.15.81:0/2945585184 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0dd8d0640 1 --2- 172.21.15.81:0/2945585184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 0x559820dbca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0de8d2640 1 --2- 172.21.15.81:0/2945585184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820da2bb0 0x559820e19f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0de0d1640 1 -- 172.21.15.81:0/2945585184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 msgr2=0x559820dbca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0de0d1640 1 --2- 172.21.15.81:0/2945585184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 0x559820dbca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0de0d1640 1 -- 172.21.15.81:0/2945585184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820da2bb0 msgr2=0x559820e19f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0de0d1640 1 --2- 172.21.15.81:0/2945585184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820da2bb0 0x559820e19f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0de0d1640 1 -- 172.21.15.81:0/2945585184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559820e1a520 con 0x559820d979d0 2024-09-12T01:28:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0de0d1640 1 --2- 172.21.15.81:0/2945585184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 0x559820dbc510 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb0d409b040 tx=0x7fb0d40976e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109c94736d3a5694 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0c1ffb640 1 -- 172.21.15.81:0/2945585184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4020040 con 0x559820d979d0 2024-09-12T01:28:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0e270e740 1 -- 172.21.15.81:0/2945585184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0d002a040 con 0x559820d979d0 2024-09-12T01:28:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0c1ffb640 1 -- 172.21.15.81:0/2945585184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb0d4009cc0 con 0x559820d979d0 2024-09-12T01:28:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0c1ffb640 1 -- 172.21.15.81:0/2945585184 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb0d409aca0 con 0x559820d979d0 2024-09-12T01:28:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0e270e740 10 client.15546 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0e270e740 1 -- 172.21.15.81:0/2945585184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559820e218e0 con 0x559820d979d0 2024-09-12T01:28:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.702+0000 7fb0c1ffb640 1 -- 172.21.15.81:0/2945585184 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0d002a040 con 0x559820d979d0 2024-09-12T01:28:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.703+0000 7fb0c1ffb640 1 -- 172.21.15.81:0/2945585184 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb0d40979b0 con 0x559820d979d0 2024-09-12T01:28:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.703+0000 7fb0e270e740 10 client.15546 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.703+0000 7fb0e270e740 10 client.15546 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:28:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.703+0000 7fb0e270e740 20 client.15546 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.703+0000 7fb0e270e740 1 --2- 172.21.15.81:0/2945585184 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x559820e264b0 0x559820e251c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.703+0000 7fb0e270e740 4 client.15546 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:28:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.703+0000 7fb0e270e740 1 -- 172.21.15.81:0/2945585184 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "status"}) -- 0x559820d05b10 con 0x559820e264b0 2024-09-12T01:28:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.703+0000 7fb0dd8d0640 1 --2- 172.21.15.81:0/2945585184 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x559820e264b0 0x559820e251c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.703+0000 7fb0dd8d0640 1 --2- 172.21.15.81:0/2945585184 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x559820e264b0 0x559820e251c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9f17af091ba0b10 server_cookie=7f39d9ebe13e8cf7 in_seq=0 out_seq=0 2024-09-12T01:28:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.703+0000 7fb0c1ffb640 10 client.15546 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0c1ffb640 1 -- 172.21.15.81:0/2945585184 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559820d05b10 con 0x559820e264b0 2024-09-12T01:28:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0c1ffb640 10 client.15546 handle_command_reply: tid=0 2024-09-12T01:28:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e270e740 1 client.15546 shutdown 2024-09-12T01:28:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e270e740 1 -- 172.21.15.81:0/2945585184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 msgr2=0x559820dbc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e270e740 1 --2- 172.21.15.81:0/2945585184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 0x559820dbc510 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb0d409b040 tx=0x7fb0d40976e0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e270e740 1 -- 172.21.15.81:0/2945585184 shutdown_connections 2024-09-12T01:28:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e270e740 1 --2- 172.21.15.81:0/2945585184 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x559820e264b0 0x559820e251c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e270e740 1 --2- 172.21.15.81:0/2945585184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559820da2bb0 0x559820e19f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e270e740 1 --2- 172.21.15.81:0/2945585184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559820d982f0 0x559820dbca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e270e740 1 --2- 172.21.15.81:0/2945585184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559820d979d0 0x559820dbc510 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0c1ffb640 0 client.15546 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e270e740 1 -- 172.21.15.81:0/2945585184 >> 172.21.15.81:0/2945585184 conn(0x559820d93f60 msgr2=0x559820d93000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e270e740 1 -- 172.21.15.81:0/2945585184 shutdown_connections 2024-09-12T01:28:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e270e740 1 -- 172.21.15.81:0/2945585184 wait complete. 2024-09-12T01:28:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e270e740 20 client.15546 trim_cache size 0 max 16384 2024-09-12T01:28:33.710 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:28:33.710 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c1ee9932-70a4-11ef-bcea-c7b262605968", 2024-09-12T01:28:33.710 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-12T01:28:33.710 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24473, 2024-09-12T01:28:33.710 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T01:28:33.710 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T01:28:33.710 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T01:28:33.710 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 138.269598325, 2024-09-12T01:28:33.710 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 28, 2024-09-12T01:28:33.710 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 83, 2024-09-12T01:28:33.710 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:28:33.710 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 149.15085308499999 2024-09-12T01:28:33.711 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:28:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e0335640 1 -- 172.21.15.81:0/293177424 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb0c40a2e00 msgr2=0x7fb0c40a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e0335640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb0c40a2e00 0x7fb0c40a52c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0020000 tx=0x7fb0d001d000 comp rx=0 tx=0).stop 2024-09-12T01:28:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e0335640 1 -- 172.21.15.81:0/293177424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d8100a80 msgr2=0x7fb0d81992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e0335640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d8100a80 0x7fb0d81992f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400d770 tx=0x7fb0d400dc30 comp rx=0 tx=0).stop 2024-09-12T01:28:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e0335640 1 -- 172.21.15.81:0/293177424 shutdown_connections 2024-09-12T01:28:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e0335640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb0c40a2e00 0x7fb0c40a52c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e0335640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0d8106a80 0x7fb0d81a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e0335640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d8101420 0x7fb0d8199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.704+0000 7fb0e0335640 1 --2- 172.21.15.81:0/293177424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d8100a80 0x7fb0d81992f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.705+0000 7fb0e0335640 1 -- 172.21.15.81:0/293177424 >> 172.21.15.81:0/293177424 conn(0x7fb0d80fc7a0 msgr2=0x7fb0d80fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.705+0000 7fb0e0335640 1 -- 172.21.15.81:0/293177424 shutdown_connections 2024-09-12T01:28:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:33.705+0000 7fb0e0335640 1 -- 172.21.15.81:0/293177424 wait complete. 2024-09-12T01:28:33.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:33 smithi100 ceph-mon[35275]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T01:28:33.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:33 smithi189 ceph-mon[35357]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T01:28:34.506 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-12T01:28:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:35 smithi081 ceph-mon[30920]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T01:28:35.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:35 smithi100 ceph-mon[35275]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T01:28:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:35 smithi189 ceph-mon[35357]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T01:28:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:37 smithi081 ceph-mon[30920]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T01:28:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:37 smithi100 ceph-mon[35275]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T01:28:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:37 smithi189 ceph-mon[35357]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T01:28:39.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:39 smithi081 ceph-mon[30920]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T01:28:39.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:39 smithi100 ceph-mon[35275]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T01:28:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:39 smithi189 ceph-mon[35357]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T01:28:41.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:41 smithi081 ceph-mon[30920]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-12T01:28:41.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:41 smithi100 ceph-mon[35275]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-12T01:28:41.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:41 smithi189 ceph-mon[35357]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-12T01:28:43.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:43 smithi081 ceph-mon[30920]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T01:28:43.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:43 smithi100 ceph-mon[35275]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T01:28:43.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:43 smithi189 ceph-mon[35357]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T01:28:44.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:28:44.329 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.980+0000 7f5262e03640 1 -- 172.21.15.81:0/1769093144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c102570 msgr2=0x7f525c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.980+0000 7f5262e03640 1 --2- 172.21.15.81:0/1769093144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c102570 0x7f525c1029b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5248009900 tx=0x7f524802a480 comp rx=0 tx=0).stop 2024-09-12T01:28:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.981+0000 7f5262e03640 1 -- 172.21.15.81:0/1769093144 shutdown_connections 2024-09-12T01:28:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.981+0000 7f5262e03640 1 --2- 172.21.15.81:0/1769093144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c102ef0 0x7f525c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.981+0000 7f5262e03640 1 --2- 172.21.15.81:0/1769093144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c102570 0x7f525c1029b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.981+0000 7f5262e03640 1 --2- 172.21.15.81:0/1769093144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f525c100e20 0x7f525c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.981+0000 7f5262e03640 1 -- 172.21.15.81:0/1769093144 >> 172.21.15.81:0/1769093144 conn(0x7f525c0fc7d0 msgr2=0x7f525c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.981+0000 7f5262e03640 1 -- 172.21.15.81:0/1769093144 shutdown_connections 2024-09-12T01:28:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.981+0000 7f5262e03640 1 -- 172.21.15.81:0/1769093144 wait complete. 2024-09-12T01:28:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.981+0000 7f5262e03640 1 Processor -- start 2024-09-12T01:28:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.981+0000 7f5262e03640 1 -- start start 2024-09-12T01:28:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f5262e03640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c100e20 0x7f525c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f5262e03640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f525c102570 0x7f525c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f5262e03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c102ef0 0x7f525c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f5262e03640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f525c110f80 con 0x7f525c102ef0 2024-09-12T01:28:45.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f5262e03640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f525c110e00 con 0x7f525c100e20 2024-09-12T01:28:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f5262e03640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f525c111100 con 0x7f525c102570 2024-09-12T01:28:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f52613a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c102ef0 0x7f525c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f52613a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c102ef0 0x7f525c19cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42404/0 (socket says 172.21.15.81:42404) 2024-09-12T01:28:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f52613a0640 1 -- 172.21.15.81:0/3192599092 learned_addr learned my addr 172.21.15.81:0/3192599092 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f5260b9f640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c100e20 0x7f525c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f525bfff640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f525c102570 0x7f525c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f52613a0640 1 -- 172.21.15.81:0/3192599092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f525c102570 msgr2=0x7f525c198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f52613a0640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f525c102570 0x7f525c198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f52613a0640 1 -- 172.21.15.81:0/3192599092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c100e20 msgr2=0x7f525c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f52613a0640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c100e20 0x7f525c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f52613a0640 1 -- 172.21.15.81:0/3192599092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c19d4a0 con 0x7f525c102ef0 2024-09-12T01:28:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f525bfff640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f525c102570 0x7f525c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f52613a0640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c102ef0 0x7f525c19cdc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f525400cce0 tx=0x7f525400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.982+0000 7f5259ffb640 1 -- 172.21.15.81:0/3192599092 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525400f450 con 0x7f525c102ef0 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.983+0000 7f5259ffb640 1 -- 172.21.15.81:0/3192599092 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f525400fad0 con 0x7f525c102ef0 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.983+0000 7f5262e03640 1 -- 172.21.15.81:0/3192599092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c19d790 con 0x7f525c102ef0 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.983+0000 7f5259ffb640 1 -- 172.21.15.81:0/3192599092 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254018c10 con 0x7f525c102ef0 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.983+0000 7f5262e03640 1 -- 172.21.15.81:0/3192599092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c1a5070 con 0x7f525c102ef0 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.985+0000 7f5259ffb640 1 -- 172.21.15.81:0/3192599092 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f525400f5f0 con 0x7f525c102ef0 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.985+0000 7f5259ffb640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f524c0a2e00 0x7f524c0a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.986+0000 7f5260b9f640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f524c0a2e00 0x7f524c0a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.986+0000 7f5259ffb640 1 -- 172.21.15.81:0/3192599092 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f52540cfb90 con 0x7f525c102ef0 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.986+0000 7f52651dc740 1 Processor -- start 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.986+0000 7f5260b9f640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f524c0a2e00 0x7f524c0a52c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5250005fd0 tx=0x7f525000b390 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.986+0000 7f52651dc740 1 -- start start 2024-09-12T01:28:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.986+0000 7f52651dc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af2404a0 0x55a3af240880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.986+0000 7f52651dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af240dc0 0x55a3af24b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.986+0000 7f52651dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af24b680 0x55a3af24da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.986+0000 7f52651dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a3af1a62e0 con 0x55a3af240dc0 2024-09-12T01:28:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.986+0000 7f52651dc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a3af14dce0 con 0x55a3af2404a0 2024-09-12T01:28:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.986+0000 7f52651dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a3af1a22a0 con 0x55a3af24b680 2024-09-12T01:28:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f525bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af240dc0 0x55a3af24b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f525bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af240dc0 0x55a3af24b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42418/0 (socket says 172.21.15.81:42418) 2024-09-12T01:28:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f525bfff640 1 -- 172.21.15.81:0/2649810567 learned_addr learned my addr 172.21.15.81:0/2649810567 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f5260b9f640 1 --2- 172.21.15.81:0/2649810567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af2404a0 0x55a3af240880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f525bfff640 1 -- 172.21.15.81:0/2649810567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af24b680 msgr2=0x55a3af24da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f52613a0640 1 --2- 172.21.15.81:0/2649810567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af24b680 0x55a3af24da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f525bfff640 1 --2- 172.21.15.81:0/2649810567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af24b680 0x55a3af24da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f525bfff640 1 -- 172.21.15.81:0/2649810567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af2404a0 msgr2=0x55a3af240880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f525bfff640 1 --2- 172.21.15.81:0/2649810567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af2404a0 0x55a3af240880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f525bfff640 1 -- 172.21.15.81:0/2649810567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3af132440 con 0x55a3af240dc0 2024-09-12T01:28:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f5260b9f640 1 --2- 172.21.15.81:0/2649810567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af2404a0 0x55a3af240880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:28:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f525bfff640 1 --2- 172.21.15.81:0/2649810567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af240dc0 0x55a3af24b140 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5248000c00 tx=0x7f5248009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae66f53d1959e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f5246ffd640 1 -- 172.21.15.81:0/2649810567 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524803f070 con 0x55a3af240dc0 2024-09-12T01:28:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f5246ffd640 1 -- 172.21.15.81:0/2649810567 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5248005520 con 0x55a3af240dc0 2024-09-12T01:28:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.987+0000 7f5246ffd640 1 -- 172.21.15.81:0/2649810567 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248035030 con 0x55a3af240dc0 2024-09-12T01:28:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.988+0000 7f52651dc740 1 -- 172.21.15.81:0/2649810567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af240dc0 msgr2=0x55a3af24b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.988+0000 7f52651dc740 1 --2- 172.21.15.81:0/2649810567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af240dc0 0x55a3af24b140 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5248000c00 tx=0x7f5248009680 comp rx=0 tx=0).stop 2024-09-12T01:28:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.988+0000 7f52651dc740 1 -- 172.21.15.81:0/2649810567 shutdown_connections 2024-09-12T01:28:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.988+0000 7f52651dc740 1 --2- 172.21.15.81:0/2649810567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af24b680 0x55a3af24da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.988+0000 7f52651dc740 1 --2- 172.21.15.81:0/2649810567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af240dc0 0x55a3af24b140 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.988+0000 7f52651dc740 1 --2- 172.21.15.81:0/2649810567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af2404a0 0x55a3af240880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.988+0000 7f52651dc740 1 -- 172.21.15.81:0/2649810567 >> 172.21.15.81:0/2649810567 conn(0x55a3af23ca30 msgr2=0x55a3af23ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.988+0000 7f52651dc740 1 -- 172.21.15.81:0/2649810567 shutdown_connections 2024-09-12T01:28:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.988+0000 7f52651dc740 1 -- 172.21.15.81:0/2649810567 wait complete. 2024-09-12T01:28:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.989+0000 7f52651dc740 1 -- start start 2024-09-12T01:28:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.989+0000 7f52651dc740 1 Processor -- start 2024-09-12T01:28:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.989+0000 7f52651dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 0x55a3af24af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.989+0000 7f52651dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 0x55a3af248210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.989+0000 7f52651dc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af24b680 0x55a3af248750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.989+0000 7f52651dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a3af24e250 con 0x55a3af2404a0 2024-09-12T01:28:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.989+0000 7f52651dc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a3af161050 con 0x55a3af24b680 2024-09-12T01:28:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.989+0000 7f52651dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a3af24e3d0 con 0x55a3af240dc0 2024-09-12T01:28:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.989+0000 7f52651dc740 10 client.0 _ll_register_callbacks cb 0x55a3af1a1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.989+0000 7f5260b9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 0x55a3af24af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.989+0000 7f5260b9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 0x55a3af24af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42430/0 (socket says 172.21.15.81:42430) 2024-09-12T01:28:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.989+0000 7f5260b9f640 1 -- 172.21.15.81:0/1980366765 learned_addr learned my addr 172.21.15.81:0/1980366765 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f525bfff640 1 --2- 172.21.15.81:0/1980366765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 0x55a3af248210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f52613a0640 1 --2- 172.21.15.81:0/1980366765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af24b680 0x55a3af248750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f5260b9f640 1 -- 172.21.15.81:0/1980366765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 msgr2=0x55a3af248210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f5260b9f640 1 --2- 172.21.15.81:0/1980366765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 0x55a3af248210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f5260b9f640 1 -- 172.21.15.81:0/1980366765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af24b680 msgr2=0x55a3af248750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f5260b9f640 1 --2- 172.21.15.81:0/1980366765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af24b680 0x55a3af248750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f5260b9f640 1 -- 172.21.15.81:0/1980366765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3aef173c0 con 0x55a3af2404a0 2024-09-12T01:28:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f5260b9f640 1 --2- 172.21.15.81:0/1980366765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 0x55a3af24af60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5250004150 tx=0x7f5250004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7109b9a4aab42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f523bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f523bfff640 1 -- 172.21.15.81:0/1980366765 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250005220 con 0x55a3af2404a0 2024-09-12T01:28:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f52651dc740 1 -- 172.21.15.81:0/1980366765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5248005520 con 0x55a3af2404a0 2024-09-12T01:28:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f523bfff640 1 -- 172.21.15.81:0/1980366765 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f52500053c0 con 0x55a3af2404a0 2024-09-12T01:28:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f523bfff640 1 -- 172.21.15.81:0/1980366765 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5250011e50 con 0x55a3af2404a0 2024-09-12T01:28:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f52651dc740 10 client.15558 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.990+0000 7f52651dc740 1 -- 172.21.15.81:0/1980366765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a3af259b90 con 0x55a3af2404a0 2024-09-12T01:28:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.991+0000 7f523bfff640 1 -- 172.21.15.81:0/1980366765 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5248005520 con 0x55a3af2404a0 2024-09-12T01:28:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.991+0000 7f523bfff640 1 -- 172.21.15.81:0/1980366765 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f525001ea40 con 0x55a3af2404a0 2024-09-12T01:28:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.991+0000 7f52651dc740 10 client.15558 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.991+0000 7f52651dc740 10 client.15558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:28:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.991+0000 7f52651dc740 20 client.15558 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.991+0000 7f52651dc740 1 --2- 172.21.15.81:0/1980366765 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55a3af25afa0 0x55a3af25d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.991+0000 7f52651dc740 4 client.15558 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.991+0000 7f52651dc740 1 -- 172.21.15.81:0/1980366765 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3af1b3850 con 0x55a3af25afa0 2024-09-12T01:28:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.991+0000 7f525bfff640 1 --2- 172.21.15.81:0/1980366765 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55a3af25afa0 0x55a3af25d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.992+0000 7f523bfff640 10 client.15558 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.992+0000 7f525bfff640 1 --2- 172.21.15.81:0/1980366765 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55a3af25afa0 0x55a3af25d3f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a42590b0ac0c7f4 server_cookie=10156d209d097f0b in_seq=0 out_seq=0 2024-09-12T01:28:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.992+0000 7f523bfff640 1 -- 172.21.15.81:0/1980366765 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3af1b3850 con 0x55a3af25afa0 2024-09-12T01:28:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.992+0000 7f523bfff640 10 client.15558 handle_command_reply: tid=0 2024-09-12T01:28:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.992+0000 7f52651dc740 1 client.15558 shutdown 2024-09-12T01:28:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.992+0000 7f52651dc740 1 -- 172.21.15.81:0/1980366765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 msgr2=0x55a3af24af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.992+0000 7f52651dc740 1 --2- 172.21.15.81:0/1980366765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 0x55a3af24af60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5250004150 tx=0x7f5250004730 comp rx=0 tx=0).stop 2024-09-12T01:28:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.993+0000 7f52651dc740 1 -- 172.21.15.81:0/1980366765 shutdown_connections 2024-09-12T01:28:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.993+0000 7f52651dc740 1 --2- 172.21.15.81:0/1980366765 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55a3af25afa0 0x55a3af25d3f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.993+0000 7f52651dc740 1 --2- 172.21.15.81:0/1980366765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af24b680 0x55a3af248750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.993+0000 7f523bfff640 0 client.15558 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:45.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.993+0000 7f52651dc740 1 --2- 172.21.15.81:0/1980366765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 0x55a3af248210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.993+0000 7f52651dc740 1 --2- 172.21.15.81:0/1980366765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 0x55a3af24af60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.993+0000 7f52651dc740 1 -- 172.21.15.81:0/1980366765 >> 172.21.15.81:0/1980366765 conn(0x55a3af23ca30 msgr2=0x55a3af23bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:45.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.993+0000 7f52651dc740 1 -- 172.21.15.81:0/1980366765 shutdown_connections 2024-09-12T01:28:45.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.993+0000 7f52651dc740 1 -- 172.21.15.81:0/1980366765 wait complete. 2024-09-12T01:28:45.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:44.993+0000 7f52651dc740 20 client.15558 trim_cache size 0 max 16384 2024-09-12T01:28:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.011+0000 7f52651dc740 1 Processor -- start 2024-09-12T01:28:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.011+0000 7f52651dc740 1 -- start start 2024-09-12T01:28:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.011+0000 7f52651dc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af2404a0 0x55a3af2574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.011+0000 7f52651dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 0x55a3af23ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.011+0000 7f52651dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af24b680 0x55a3af23ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.011+0000 7f52651dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1ad730 con 0x55a3af24b680 2024-09-12T01:28:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.011+0000 7f52651dc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1af270 con 0x55a3af2404a0 2024-09-12T01:28:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.011+0000 7f52651dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1ade00 con 0x55a3af240dc0 2024-09-12T01:28:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f52613a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af24b680 0x55a3af23ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f52613a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af24b680 0x55a3af23ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42438/0 (socket says 172.21.15.81:42438) 2024-09-12T01:28:45.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f52613a0640 1 -- 172.21.15.81:0/569823385 learned_addr learned my addr 172.21.15.81:0/569823385 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:45.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f525bfff640 1 --2- 172.21.15.81:0/569823385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 0x55a3af23ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f5260b9f640 1 --2- 172.21.15.81:0/569823385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af2404a0 0x55a3af2574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f52613a0640 1 -- 172.21.15.81:0/569823385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 msgr2=0x55a3af23ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:45.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f52613a0640 1 --2- 172.21.15.81:0/569823385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 0x55a3af23ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f52613a0640 1 -- 172.21.15.81:0/569823385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af2404a0 msgr2=0x55a3af2574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:45.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f52613a0640 1 --2- 172.21.15.81:0/569823385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af2404a0 0x55a3af2574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f52613a0640 1 -- 172.21.15.81:0/569823385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3af2471c0 con 0x55a3af24b680 2024-09-12T01:28:45.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f5260b9f640 1 --2- 172.21.15.81:0/569823385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af2404a0 0x55a3af2574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:45.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f52613a0640 1 --2- 172.21.15.81:0/569823385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af24b680 0x55a3af23ba80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5254005cc0 tx=0x7f525409b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d396067cf07696 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:45.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f52467fc640 1 -- 172.21.15.81:0/569823385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52540b6070 con 0x55a3af24b680 2024-09-12T01:28:45.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f52467fc640 1 -- 172.21.15.81:0/569823385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f525409bf70 con 0x55a3af24b680 2024-09-12T01:28:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.012+0000 7f52467fc640 1 -- 172.21.15.81:0/569823385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52540cd500 con 0x55a3af24b680 2024-09-12T01:28:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.013+0000 7f52651dc740 1 -- 172.21.15.81:0/569823385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af24b680 msgr2=0x55a3af23ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.013+0000 7f52651dc740 1 --2- 172.21.15.81:0/569823385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af24b680 0x55a3af23ba80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5254005cc0 tx=0x7f525409b8d0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.013+0000 7f52651dc740 1 -- 172.21.15.81:0/569823385 shutdown_connections 2024-09-12T01:28:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.013+0000 7f52651dc740 1 --2- 172.21.15.81:0/569823385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af24b680 0x55a3af23ba80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.013+0000 7f52651dc740 1 --2- 172.21.15.81:0/569823385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 0x55a3af23ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.013+0000 7f52651dc740 1 --2- 172.21.15.81:0/569823385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af2404a0 0x55a3af2574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.013+0000 7f52651dc740 1 -- 172.21.15.81:0/569823385 >> 172.21.15.81:0/569823385 conn(0x55a3af23ca30 msgr2=0x55a3af23b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.013+0000 7f52651dc740 1 -- 172.21.15.81:0/569823385 shutdown_connections 2024-09-12T01:28:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.013+0000 7f52651dc740 1 -- 172.21.15.81:0/569823385 wait complete. 2024-09-12T01:28:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f52651dc740 1 -- start start 2024-09-12T01:28:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f52651dc740 1 Processor -- start 2024-09-12T01:28:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f52651dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 0x55a3af24f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f52651dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 0x55a3af24fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f52651dc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af24b680 0x55a3af2500c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f52651dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1aeba0 con 0x55a3af2404a0 2024-09-12T01:28:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f52651dc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1ae4d0 con 0x55a3af24b680 2024-09-12T01:28:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f52651dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1ab710 con 0x55a3af240dc0 2024-09-12T01:28:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f52651dc740 10 client.0 _ll_register_callbacks cb 0x7f5250004320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f5260b9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 0x55a3af24f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f5260b9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 0x55a3af24f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42444/0 (socket says 172.21.15.81:42444) 2024-09-12T01:28:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f5260b9f640 1 -- 172.21.15.81:0/1801126657 learned_addr learned my addr 172.21.15.81:0/1801126657 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f52613a0640 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af24b680 0x55a3af2500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.014+0000 7f525bfff640 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 0x55a3af24fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f5260b9f640 1 -- 172.21.15.81:0/1801126657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 msgr2=0x55a3af24fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f5260b9f640 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 0x55a3af24fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f5260b9f640 1 -- 172.21.15.81:0/1801126657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af24b680 msgr2=0x55a3af2500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f5260b9f640 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af24b680 0x55a3af2500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f5260b9f640 1 -- 172.21.15.81:0/1801126657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3af24b2d0 con 0x55a3af2404a0 2024-09-12T01:28:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f52613a0640 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af24b680 0x55a3af2500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f525bfff640 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 0x55a3af24fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f5260b9f640 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 0x55a3af24f640 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5250004010 tx=0x7f5250003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767ce540296c07ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f523bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f523bfff640 1 -- 172.21.15.81:0/1801126657 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250035040 con 0x55a3af2404a0 2024-09-12T01:28:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f523bfff640 1 -- 172.21.15.81:0/1801126657 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f52500053c0 con 0x55a3af2404a0 2024-09-12T01:28:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f52651dc740 1 -- 172.21.15.81:0/1801126657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f525409bf70 con 0x55a3af2404a0 2024-09-12T01:28:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f523bfff640 1 -- 172.21.15.81:0/1801126657 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52500055c0 con 0x55a3af2404a0 2024-09-12T01:28:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f52651dc740 10 client.15564 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f52651dc740 1 -- 172.21.15.81:0/1801126657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a3af2ca4b0 con 0x55a3af2404a0 2024-09-12T01:28:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.015+0000 7f523bfff640 1 -- 172.21.15.81:0/1801126657 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f525409bf70 con 0x55a3af2404a0 2024-09-12T01:28:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.016+0000 7f523bfff640 1 -- 172.21.15.81:0/1801126657 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5250004d70 con 0x55a3af2404a0 2024-09-12T01:28:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.016+0000 7f52651dc740 10 client.15564 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.016+0000 7f52651dc740 10 client.15564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:28:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.016+0000 7f52651dc740 20 client.15564 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.016+0000 7f52651dc740 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55a3af25afa0 0x55a3af2ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.016+0000 7f52651dc740 4 client.15564 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:28:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.016+0000 7f52651dc740 1 -- 172.21.15.81:0/1801126657 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a3af1add60 con 0x55a3af25afa0 2024-09-12T01:28:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.016+0000 7f525bfff640 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55a3af25afa0 0x55a3af2ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.016+0000 7f523bfff640 10 client.15564 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.016+0000 7f525bfff640 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55a3af25afa0 0x55a3af2ccbf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54a6f974e9ec5840 server_cookie=3639d32a43c684b5 in_seq=0 out_seq=0 2024-09-12T01:28:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f523bfff640 1 -- 172.21.15.81:0/1801126657 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a3af1add60 con 0x55a3af25afa0 2024-09-12T01:28:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f523bfff640 10 client.15564 handle_command_reply: tid=0 2024-09-12T01:28:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f52651dc740 1 client.15564 shutdown 2024-09-12T01:28:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f52651dc740 1 -- 172.21.15.81:0/1801126657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 msgr2=0x55a3af24f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f52651dc740 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 0x55a3af24f640 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5250004010 tx=0x7f5250003a90 comp rx=0 tx=0).stop 2024-09-12T01:28:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f52651dc740 1 -- 172.21.15.81:0/1801126657 shutdown_connections 2024-09-12T01:28:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f52651dc740 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55a3af25afa0 0x55a3af2ccbf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f52651dc740 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a3af24b680 0x55a3af2500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f52651dc740 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a3af240dc0 0x55a3af24fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f52651dc740 1 --2- 172.21.15.81:0/1801126657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3af2404a0 0x55a3af24f640 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f52651dc740 1 -- 172.21.15.81:0/1801126657 >> 172.21.15.81:0/1801126657 conn(0x55a3af23ca30 msgr2=0x55a3af23bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f523bfff640 0 client.15564 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:45.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f52651dc740 1 -- 172.21.15.81:0/1801126657 shutdown_connections 2024-09-12T01:28:45.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f52651dc740 1 -- 172.21.15.81:0/1801126657 wait complete. 2024-09-12T01:28:45.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.017+0000 7f52651dc740 20 client.15564 trim_cache size 0 max 16384 2024-09-12T01:28:45.027 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:28:45.027 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:28:45.027 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:28:45.027 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:28:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.018+0000 7f5262e03640 1 -- 172.21.15.81:0/3192599092 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f524c0a2e00 msgr2=0x7f524c0a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.018+0000 7f5262e03640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f524c0a2e00 0x7f524c0a52c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5250005fd0 tx=0x7f525000b390 comp rx=0 tx=0).stop 2024-09-12T01:28:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.018+0000 7f5262e03640 1 -- 172.21.15.81:0/3192599092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c102ef0 msgr2=0x7f525c19cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.018+0000 7f5262e03640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c102ef0 0x7f525c19cdc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f525400cce0 tx=0x7f525400a620 comp rx=0 tx=0).stop 2024-09-12T01:28:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.018+0000 7f5262e03640 1 -- 172.21.15.81:0/3192599092 shutdown_connections 2024-09-12T01:28:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.018+0000 7f5262e03640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f524c0a2e00 0x7f524c0a52c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.018+0000 7f5262e03640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c102ef0 0x7f525c19cdc0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.018+0000 7f5262e03640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f525c102570 0x7f525c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.018+0000 7f5262e03640 1 --2- 172.21.15.81:0/3192599092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c100e20 0x7f525c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.018+0000 7f5262e03640 1 -- 172.21.15.81:0/3192599092 >> 172.21.15.81:0/3192599092 conn(0x7f525c0fc7d0 msgr2=0x7f525c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.018+0000 7f5262e03640 1 -- 172.21.15.81:0/3192599092 shutdown_connections 2024-09-12T01:28:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:45.018+0000 7f5262e03640 1 -- 172.21.15.81:0/3192599092 wait complete. 2024-09-12T01:28:45.691 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:28:45.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:28:45.715 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:45 smithi081 ceph-mon[30920]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:28:45.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:45 smithi100 ceph-mon[35275]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:28:45.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:45 smithi189 ceph-mon[35357]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:28:45.950 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:46.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.443+0000 7f1ae15bd640 1 -- 172.21.15.81:0/411813379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc1027a0 msgr2=0x7f1adc1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:46.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.443+0000 7f1ae15bd640 1 --2- 172.21.15.81:0/411813379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc1027a0 0x7f1adc1067f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009900 tx=0x7f1ad002a410 comp rx=0 tx=0).stop 2024-09-12T01:28:46.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.443+0000 7f1ae15bd640 1 -- 172.21.15.81:0/411813379 shutdown_connections 2024-09-12T01:28:46.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.443+0000 7f1ae15bd640 1 --2- 172.21.15.81:0/411813379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1adc106f20 0x7f1adc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:46.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.443+0000 7f1ae15bd640 1 --2- 172.21.15.81:0/411813379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc1027a0 0x7f1adc1067f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:46.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.443+0000 7f1ae15bd640 1 --2- 172.21.15.81:0/411813379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1adc101df0 0x7f1adc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:46.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.443+0000 7f1ae15bd640 1 -- 172.21.15.81:0/411813379 >> 172.21.15.81:0/411813379 conn(0x7f1adc0fd8f0 msgr2=0x7f1adc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:46.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.443+0000 7f1ae15bd640 1 -- 172.21.15.81:0/411813379 shutdown_connections 2024-09-12T01:28:46.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.443+0000 7f1ae15bd640 1 -- 172.21.15.81:0/411813379 wait complete. 2024-09-12T01:28:46.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.444+0000 7f1ae15bd640 1 Processor -- start 2024-09-12T01:28:46.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.444+0000 7f1ae15bd640 1 -- start start 2024-09-12T01:28:46.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.444+0000 7f1ae15bd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1adc101df0 0x7f1adc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:46.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.444+0000 7f1ae15bd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1adc1027a0 0x7f1adc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:46.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.444+0000 7f1ae15bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc106f20 0x7f1adc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:46.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.444+0000 7f1ae15bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc111f80 con 0x7f1adc106f20 2024-09-12T01:28:46.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.444+0000 7f1ae15bd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc111e00 con 0x7f1adc1027a0 2024-09-12T01:28:46.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.444+0000 7f1ae15bd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc112100 con 0x7f1adc101df0 2024-09-12T01:28:46.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.444+0000 7f1adb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc106f20 0x7f1adc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:46.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.444+0000 7f1ada7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1adc1027a0 0x7f1adc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:46.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1adb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc106f20 0x7f1adc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42450/0 (socket says 172.21.15.81:42450) 2024-09-12T01:28:46.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1ada7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1adc1027a0 0x7f1adc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:38588/0 (socket says 172.21.15.81:38588) 2024-09-12T01:28:46.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1adb7fe640 1 -- 172.21.15.81:0/360594745 learned_addr learned my addr 172.21.15.81:0/360594745 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:46.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1adaffd640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1adc101df0 0x7f1adc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:46.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1adb7fe640 1 -- 172.21.15.81:0/360594745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1adc101df0 msgr2=0x7f1adc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:46.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1adb7fe640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1adc101df0 0x7f1adc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:46.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1adb7fe640 1 -- 172.21.15.81:0/360594745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1adc1027a0 msgr2=0x7f1adc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:46.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1adb7fe640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1adc1027a0 0x7f1adc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:46.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1adb7fe640 1 -- 172.21.15.81:0/360594745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc1a6920 con 0x7f1adc106f20 2024-09-12T01:28:46.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1ada7fc640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1adc1027a0 0x7f1adc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:46.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1adb7fe640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc106f20 0x7f1adc074f70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400eb10 tx=0x7f1ad400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:46.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1ac3fff640 1 -- 172.21.15.81:0/360594745 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4004b20 con 0x7f1adc106f20 2024-09-12T01:28:46.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1ae15bd640 1 -- 172.21.15.81:0/360594745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc1a6c10 con 0x7f1adc106f20 2024-09-12T01:28:46.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1ac3fff640 1 -- 172.21.15.81:0/360594745 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ad4004cc0 con 0x7f1adc106f20 2024-09-12T01:28:46.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1ac3fff640 1 -- 172.21.15.81:0/360594745 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4010760 con 0x7f1adc106f20 2024-09-12T01:28:46.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.445+0000 7f1ae15bd640 1 -- 172.21.15.81:0/360594745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc1a7120 con 0x7f1adc106f20 2024-09-12T01:28:46.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.446+0000 7f1ae15bd640 1 -- 172.21.15.81:0/360594745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1adc1032d0 con 0x7f1adc106f20 2024-09-12T01:28:46.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.447+0000 7f1ac3fff640 1 -- 172.21.15.81:0/360594745 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f1ad4005020 con 0x7f1adc106f20 2024-09-12T01:28:46.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.448+0000 7f1ac3fff640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1ac40a2d80 0x7f1ac40a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:46.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.448+0000 7f1ac3fff640 1 -- 172.21.15.81:0/360594745 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1ad40cfab0 con 0x7f1adc106f20 2024-09-12T01:28:46.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.448+0000 7f1adaffd640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1ac40a2d80 0x7f1ac40a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:46.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.449+0000 7f1adaffd640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1ac40a2d80 0x7f1ac40a5240 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1acc005fd0 tx=0x7f1acc00b390 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:46.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.453+0000 7f1ac3fff640 1 -- 172.21.15.81:0/360594745 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ad409c590 con 0x7f1adc106f20 2024-09-12T01:28:46.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.696+0000 7f1ae15bd640 1 -- 172.21.15.81:0/360594745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1adc10a100 con 0x7f1adc106f20 2024-09-12T01:28:46.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.696+0000 7f1ac3fff640 1 -- 172.21.15.81:0/360594745 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f1ad409be90 con 0x7f1adc106f20 2024-09-12T01:28:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:46.696 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:28:46.696 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:28:46.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.699+0000 7f1ae15bd640 1 -- 172.21.15.81:0/360594745 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1ac40a2d80 msgr2=0x7f1ac40a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:46.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.699+0000 7f1ae15bd640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1ac40a2d80 0x7f1ac40a5240 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1acc005fd0 tx=0x7f1acc00b390 comp rx=0 tx=0).stop 2024-09-12T01:28:46.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.699+0000 7f1ae15bd640 1 -- 172.21.15.81:0/360594745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc106f20 msgr2=0x7f1adc074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:46.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.699+0000 7f1ae15bd640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc106f20 0x7f1adc074f70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400eb10 tx=0x7f1ad400c2d0 comp rx=0 tx=0).stop 2024-09-12T01:28:46.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.699+0000 7f1ae15bd640 1 -- 172.21.15.81:0/360594745 shutdown_connections 2024-09-12T01:28:46.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.699+0000 7f1ae15bd640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1ac40a2d80 0x7f1ac40a5240 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:46.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.699+0000 7f1ae15bd640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc106f20 0x7f1adc074f70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:46.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.699+0000 7f1ae15bd640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1adc1027a0 0x7f1adc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:46.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.699+0000 7f1ae15bd640 1 --2- 172.21.15.81:0/360594745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1adc101df0 0x7f1adc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:46.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.699+0000 7f1ae15bd640 1 -- 172.21.15.81:0/360594745 >> 172.21.15.81:0/360594745 conn(0x7f1adc0fd8f0 msgr2=0x7f1adc0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:46.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.700+0000 7f1ae15bd640 1 -- 172.21.15.81:0/360594745 shutdown_connections 2024-09-12T01:28:46.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:46.700+0000 7f1ae15bd640 1 -- 172.21.15.81:0/360594745 wait complete. 2024-09-12T01:28:47.408 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:28:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:47.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:47 smithi081 ceph-mon[30920]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:28:47.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:47 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/360594745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:47.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:47 smithi100 ceph-mon[35275]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:28:47.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:47 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/360594745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:47 smithi189 ceph-mon[35357]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:28:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:47 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/360594745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:48.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.204+0000 7ff7ad395640 1 -- 172.21.15.81:0/2638703259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a8102ef0 msgr2=0x7ff7a810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:48.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.204+0000 7ff7ad395640 1 --2- 172.21.15.81:0/2638703259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a8102ef0 0x7ff7a810da40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009ca0 tx=0x7ff7a002a950 comp rx=0 tx=0).stop 2024-09-12T01:28:48.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.204+0000 7ff7ad395640 1 -- 172.21.15.81:0/2638703259 shutdown_connections 2024-09-12T01:28:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.204+0000 7ff7ad395640 1 --2- 172.21.15.81:0/2638703259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a8102ef0 0x7ff7a810da40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.204+0000 7ff7ad395640 1 --2- 172.21.15.81:0/2638703259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7a8102570 0x7ff7a81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.204+0000 7ff7ad395640 1 --2- 172.21.15.81:0/2638703259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a8100e20 0x7ff7a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.204+0000 7ff7ad395640 1 -- 172.21.15.81:0/2638703259 >> 172.21.15.81:0/2638703259 conn(0x7ff7a80fc7d0 msgr2=0x7ff7a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.204+0000 7ff7ad395640 1 -- 172.21.15.81:0/2638703259 shutdown_connections 2024-09-12T01:28:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.204+0000 7ff7ad395640 1 -- 172.21.15.81:0/2638703259 wait complete. 2024-09-12T01:28:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.204+0000 7ff7ad395640 1 Processor -- start 2024-09-12T01:28:48.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7ad395640 1 -- start start 2024-09-12T01:28:48.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7ad395640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a8100e20 0x7ff7a81992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7ad395640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a8102570 0x7ff7a81997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7ad395640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7a8102ef0 0x7ff7a81a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7ad395640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a8110f80 con 0x7ff7a8102570 2024-09-12T01:28:48.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7ad395640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a8110e00 con 0x7ff7a8100e20 2024-09-12T01:28:48.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7ad395640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a8111100 con 0x7ff7a8102ef0 2024-09-12T01:28:48.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7a67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a8102570 0x7ff7a81997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7a6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a8100e20 0x7ff7a81992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7a67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a8102570 0x7ff7a81997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42470/0 (socket says 172.21.15.81:42470) 2024-09-12T01:28:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7a67fc640 1 -- 172.21.15.81:0/3993674016 learned_addr learned my addr 172.21.15.81:0/3993674016 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7a77fe640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7a8102ef0 0x7ff7a81a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7a67fc640 1 -- 172.21.15.81:0/3993674016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7a8102ef0 msgr2=0x7ff7a81a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7a67fc640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7a8102ef0 0x7ff7a81a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7a67fc640 1 -- 172.21.15.81:0/3993674016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a8100e20 msgr2=0x7ff7a81992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7a67fc640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a8100e20 0x7ff7a81992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7a67fc640 1 -- 172.21.15.81:0/3993674016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a81a4870 con 0x7ff7a8102570 2024-09-12T01:28:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.205+0000 7ff7a6ffd640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a8100e20 0x7ff7a81992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.206+0000 7ff7a67fc640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a8102570 0x7ff7a81997f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00c890 tx=0x7ff79c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.206+0000 7ff78ffff640 1 -- 172.21.15.81:0/3993674016 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c004220 con 0x7ff7a8102570 2024-09-12T01:28:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.206+0000 7ff7ad395640 1 -- 172.21.15.81:0/3993674016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a81a4a40 con 0x7ff7a8102570 2024-09-12T01:28:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.206+0000 7ff78ffff640 1 -- 172.21.15.81:0/3993674016 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff79c0043c0 con 0x7ff7a8102570 2024-09-12T01:28:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.206+0000 7ff7ad395640 1 -- 172.21.15.81:0/3993674016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a81a4f80 con 0x7ff7a8102570 2024-09-12T01:28:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.206+0000 7ff78ffff640 1 -- 172.21.15.81:0/3993674016 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c004a00 con 0x7ff7a8102570 2024-09-12T01:28:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.208+0000 7ff78ffff640 1 -- 172.21.15.81:0/3993674016 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7ff79c0079b0 con 0x7ff7a8102570 2024-09-12T01:28:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7af76e740 1 Processor -- start 2024-09-12T01:28:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7af76e740 1 -- start start 2024-09-12T01:28:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7af76e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c127682b40 0x55c127681090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7af76e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c1276815d0 0x55c127681a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7af76e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 0x55c12768e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7a67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 0x55c12768e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7a67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 0x55c12768e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42480/0 (socket says 172.21.15.81:42480) 2024-09-12T01:28:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7a67fc640 1 -- 172.21.15.81:0/2634953645 learned_addr learned my addr 172.21.15.81:0/2634953645 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7af76e740 1 -- 172.21.15.81:0/2634953645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c1275e72f0 con 0x55c12768c370 2024-09-12T01:28:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7af76e740 1 -- 172.21.15.81:0/2634953645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c12758ecf0 con 0x55c1276815d0 2024-09-12T01:28:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7af76e740 1 -- 172.21.15.81:0/2634953645 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c1275e32b0 con 0x55c127682b40 2024-09-12T01:28:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7a6ffd640 1 --2- 172.21.15.81:0/2634953645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c1276815d0 0x55c127681a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff78ffff640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff7900a2e00 0x7ff7900a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7a77fe640 1 --2- 172.21.15.81:0/2634953645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c127682b40 0x55c127681090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.209+0000 7ff7a67fc640 1 -- 172.21.15.81:0/2634953645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c127682b40 msgr2=0x55c127681090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.210+0000 7ff7a67fc640 1 --2- 172.21.15.81:0/2634953645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c127682b40 0x55c127681090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.210+0000 7ff7a67fc640 1 -- 172.21.15.81:0/2634953645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c1276815d0 msgr2=0x55c127681a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.210+0000 7ff7a67fc640 1 --2- 172.21.15.81:0/2634953645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c1276815d0 0x55c127681a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.210+0000 7ff7a77fe640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff7900a2e00 0x7ff7900a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.210+0000 7ff7a67fc640 1 -- 172.21.15.81:0/2634953645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1275733a0 con 0x55c12768c370 2024-09-12T01:28:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.210+0000 7ff7a6ffd640 1 --2- 172.21.15.81:0/2634953645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c1276815d0 0x55c127681a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.210+0000 7ff78ffff640 1 -- 172.21.15.81:0/3993674016 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff79c0cf0e0 con 0x7ff7a8102570 2024-09-12T01:28:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.210+0000 7ff7a67fc640 1 --2- 172.21.15.81:0/2634953645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 0x55c12768e760 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0cc880 tx=0x7ff79c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792623a509458135 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.210+0000 7ff7a77fe640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff7900a2e00 0x7ff7900a52c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0005fe0 tx=0x7ff7a002a950 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.210+0000 7ff78d7fa640 1 -- 172.21.15.81:0/2634953645 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c09b0b0 con 0x55c12768c370 2024-09-12T01:28:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.210+0000 7ff78d7fa640 1 -- 172.21.15.81:0/2634953645 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff79c09b570 con 0x55c12768c370 2024-09-12T01:28:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.210+0000 7ff78d7fa640 1 -- 172.21.15.81:0/2634953645 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c09aed0 con 0x55c12768c370 2024-09-12T01:28:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.211+0000 7ff7af76e740 1 -- 172.21.15.81:0/2634953645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 msgr2=0x55c12768e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.211+0000 7ff7af76e740 1 --2- 172.21.15.81:0/2634953645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 0x55c12768e760 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0cc880 tx=0x7ff79c01f000 comp rx=0 tx=0).stop 2024-09-12T01:28:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.211+0000 7ff7af76e740 1 -- 172.21.15.81:0/2634953645 shutdown_connections 2024-09-12T01:28:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.211+0000 7ff7af76e740 1 --2- 172.21.15.81:0/2634953645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 0x55c12768e760 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.211+0000 7ff7af76e740 1 --2- 172.21.15.81:0/2634953645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c1276815d0 0x55c127681a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.211+0000 7ff7af76e740 1 --2- 172.21.15.81:0/2634953645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c127682b40 0x55c127681090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.211+0000 7ff7af76e740 1 -- 172.21.15.81:0/2634953645 >> 172.21.15.81:0/2634953645 conn(0x55c12764a310 msgr2=0x55c12767dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.211+0000 7ff7af76e740 1 -- 172.21.15.81:0/2634953645 shutdown_connections 2024-09-12T01:28:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.211+0000 7ff7af76e740 1 -- 172.21.15.81:0/2634953645 wait complete. 2024-09-12T01:28:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.211+0000 7ff7af76e740 1 -- start start 2024-09-12T01:28:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.211+0000 7ff7af76e740 1 Processor -- start 2024-09-12T01:28:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7af76e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1276815d0 0x55c12768bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7af76e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c127682b40 0x55c127688fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7af76e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 0x55c127689520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7af76e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c12768f010 con 0x55c12768c370 2024-09-12T01:28:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7af76e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c1275a2060 con 0x55c127682b40 2024-09-12T01:28:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7af76e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c12768f190 con 0x55c1276815d0 2024-09-12T01:28:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 0x55c127689520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7a67fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c127682b40 0x55c127688fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 0x55c127689520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42490/0 (socket says 172.21.15.81:42490) 2024-09-12T01:28:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7a77fe640 1 -- 172.21.15.81:0/2980689184 learned_addr learned my addr 172.21.15.81:0/2980689184 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7a6ffd640 1 --2- 172.21.15.81:0/2980689184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1276815d0 0x55c12768bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7af76e740 10 client.0 _ll_register_callbacks cb 0x55c1272f58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7a77fe640 1 -- 172.21.15.81:0/2980689184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1276815d0 msgr2=0x55c12768bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7a77fe640 1 --2- 172.21.15.81:0/2980689184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1276815d0 0x55c12768bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7a77fe640 1 -- 172.21.15.81:0/2980689184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c127682b40 msgr2=0x55c127688fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7a77fe640 1 --2- 172.21.15.81:0/2980689184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c127682b40 0x55c127688fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7a77fe640 1 -- 172.21.15.81:0/2980689184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1273583c0 con 0x55c12768c370 2024-09-12T01:28:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff7a77fe640 1 --2- 172.21.15.81:0/2980689184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 0x55c127689520 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009ca0 tx=0x7ff7a00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4da523a7f3381b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.212+0000 7ff78aff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff78aff5640 1 -- 172.21.15.81:0/2980689184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0034040 con 0x55c12768c370 2024-09-12T01:28:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff7af76e740 1 -- 172.21.15.81:0/2980689184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff79c09b570 con 0x55c12768c370 2024-09-12T01:28:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff78aff5640 1 -- 172.21.15.81:0/2980689184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff7a0004450 con 0x55c12768c370 2024-09-12T01:28:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff78aff5640 1 -- 172.21.15.81:0/2980689184 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff7a0004650 con 0x55c12768c370 2024-09-12T01:28:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff7af76e740 10 client.15582 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:48.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff7af76e740 1 -- 172.21.15.81:0/2980689184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1276a3280 con 0x55c12768c370 2024-09-12T01:28:48.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff78aff5640 1 -- 172.21.15.81:0/2980689184 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff79c09b570 con 0x55c12768c370 2024-09-12T01:28:48.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff78aff5640 1 -- 172.21.15.81:0/2980689184 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff7a003a430 con 0x55c12768c370 2024-09-12T01:28:48.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff7af76e740 10 client.15582 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:48.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff7af76e740 10 client.15582 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:28:48.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff7af76e740 20 client.15582 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:48.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff7af76e740 1 --2- 172.21.15.81:0/2980689184 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55c1276a4690 0x55c1276a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff7af76e740 4 client.15582 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:48.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff7af76e740 1 -- 172.21.15.81:0/2980689184 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1275f4860 con 0x55c1276a4690 2024-09-12T01:28:48.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.213+0000 7ff7a6ffd640 1 --2- 172.21.15.81:0/2980689184 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55c1276a4690 0x55c1276a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.214+0000 7ff7a6ffd640 1 --2- 172.21.15.81:0/2980689184 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55c1276a4690 0x55c1276a6ae0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7a418b62e147b944 server_cookie=d9bb583ece532f0a in_seq=0 out_seq=0 2024-09-12T01:28:48.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.214+0000 7ff78aff5640 10 client.15582 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:28:48.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff78aff5640 1 -- 172.21.15.81:0/2980689184 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1275f4860 con 0x55c1276a4690 2024-09-12T01:28:48.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff78aff5640 10 client.15582 handle_command_reply: tid=0 2024-09-12T01:28:48.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff7af76e740 1 client.15582 shutdown 2024-09-12T01:28:48.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff7af76e740 1 -- 172.21.15.81:0/2980689184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 msgr2=0x55c127689520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:48.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff7af76e740 1 --2- 172.21.15.81:0/2980689184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 0x55c127689520 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009ca0 tx=0x7ff7a00095c0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff7af76e740 1 -- 172.21.15.81:0/2980689184 shutdown_connections 2024-09-12T01:28:48.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff7af76e740 1 --2- 172.21.15.81:0/2980689184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c12768c370 0x55c127689520 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff7af76e740 1 --2- 172.21.15.81:0/2980689184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c127682b40 0x55c127688fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff7af76e740 1 --2- 172.21.15.81:0/2980689184 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55c1276a4690 0x55c1276a6ae0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff7af76e740 1 --2- 172.21.15.81:0/2980689184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c1276815d0 0x55c12768bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff78aff5640 0 client.15582 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:28:48.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff7af76e740 1 -- 172.21.15.81:0/2980689184 >> 172.21.15.81:0/2980689184 conn(0x55c12764a310 msgr2=0x55c127683960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:48.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff7af76e740 1 -- 172.21.15.81:0/2980689184 shutdown_connections 2024-09-12T01:28:48.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff7af76e740 1 -- 172.21.15.81:0/2980689184 wait complete. 2024-09-12T01:28:48.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.215+0000 7ff7af76e740 20 client.15582 trim_cache size 0 max 16384 2024-09-12T01:28:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.228+0000 7ff7af76e740 1 Processor -- start 2024-09-12T01:28:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.228+0000 7ff7af76e740 1 -- start start 2024-09-12T01:28:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.228+0000 7ff7af76e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1276815d0 0x55c1276a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.228+0000 7ff7af76e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c127682b40 0x55c12768d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.228+0000 7ff7af76e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c12768c370 0x55c12768dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.228+0000 7ff7af76e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a81ab690 con 0x55c1276815d0 2024-09-12T01:28:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.228+0000 7ff7af76e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a81ad1d0 con 0x55c127682b40 2024-09-12T01:28:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.228+0000 7ff7af76e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a81abd60 con 0x55c12768c370 2024-09-12T01:28:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.228+0000 7ff7a6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1276815d0 0x55c1276a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.228+0000 7ff7a6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1276815d0 0x55c1276a0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42494/0 (socket says 172.21.15.81:42494) 2024-09-12T01:28:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.228+0000 7ff7a6ffd640 1 -- 172.21.15.81:0/1467842575 learned_addr learned my addr 172.21.15.81:0/1467842575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.229+0000 7ff7a6ffd640 1 -- 172.21.15.81:0/1467842575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c12768c370 msgr2=0x55c12768dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.229+0000 7ff7a6ffd640 1 --2- 172.21.15.81:0/1467842575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c12768c370 0x55c12768dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.229+0000 7ff7a6ffd640 1 -- 172.21.15.81:0/1467842575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c127682b40 msgr2=0x55c12768d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.229+0000 7ff7a67fc640 1 --2- 172.21.15.81:0/1467842575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c127682b40 0x55c12768d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.229+0000 7ff7a6ffd640 1 --2- 172.21.15.81:0/1467842575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c127682b40 0x55c12768d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.229+0000 7ff7a6ffd640 1 -- 172.21.15.81:0/1467842575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c12767ded0 con 0x55c1276815d0 2024-09-12T01:28:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.229+0000 7ff7a6ffd640 1 --2- 172.21.15.81:0/1467842575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1276815d0 0x55c1276a0b40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff798009f50 tx=0x7ff798005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0f38d1107ab50e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.229+0000 7ff78cff9640 1 -- 172.21.15.81:0/1467842575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff798004030 con 0x55c1276815d0 2024-09-12T01:28:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.229+0000 7ff78cff9640 1 -- 172.21.15.81:0/1467842575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff798005500 con 0x55c1276815d0 2024-09-12T01:28:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.229+0000 7ff78cff9640 1 -- 172.21.15.81:0/1467842575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79800fdb0 con 0x55c1276815d0 2024-09-12T01:28:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.230+0000 7ff7af76e740 1 -- 172.21.15.81:0/1467842575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1276815d0 msgr2=0x55c1276a0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.230+0000 7ff7af76e740 1 --2- 172.21.15.81:0/1467842575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1276815d0 0x55c1276a0b40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff798009f50 tx=0x7ff798005f90 comp rx=0 tx=0).stop 2024-09-12T01:28:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.230+0000 7ff7af76e740 1 -- 172.21.15.81:0/1467842575 shutdown_connections 2024-09-12T01:28:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.230+0000 7ff7af76e740 1 --2- 172.21.15.81:0/1467842575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c12768c370 0x55c12768dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.230+0000 7ff7af76e740 1 --2- 172.21.15.81:0/1467842575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c127682b40 0x55c12768d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.230+0000 7ff7af76e740 1 --2- 172.21.15.81:0/1467842575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1276815d0 0x55c1276a0b40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.230+0000 7ff7af76e740 1 -- 172.21.15.81:0/1467842575 >> 172.21.15.81:0/1467842575 conn(0x55c12764a310 msgr2=0x55c127687890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.230+0000 7ff7af76e740 1 -- 172.21.15.81:0/1467842575 shutdown_connections 2024-09-12T01:28:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.230+0000 7ff7af76e740 1 -- 172.21.15.81:0/1467842575 wait complete. 2024-09-12T01:28:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7af76e740 1 -- start start 2024-09-12T01:28:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7af76e740 1 Processor -- start 2024-09-12T01:28:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7af76e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c1276815d0 0x55c127686c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7af76e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c127682b40 0x55c12769ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7af76e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c12768c370 0x55c12769d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7af76e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a81acb00 con 0x55c127682b40 2024-09-12T01:28:48.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7af76e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a81ac430 con 0x55c1276815d0 2024-09-12T01:28:48.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7af76e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a81a9670 con 0x55c12768c370 2024-09-12T01:28:48.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7a67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c127682b40 0x55c12769ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7af76e740 10 client.0 _ll_register_callbacks cb 0x7ff7a0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:48.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7a67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c127682b40 0x55c12769ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42498/0 (socket says 172.21.15.81:42498) 2024-09-12T01:28:48.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7a67fc640 1 -- 172.21.15.81:0/386490110 learned_addr learned my addr 172.21.15.81:0/386490110 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7a6ffd640 1 --2- 172.21.15.81:0/386490110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c1276815d0 0x55c127686c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7a77fe640 1 --2- 172.21.15.81:0/386490110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c12768c370 0x55c12769d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7a67fc640 1 -- 172.21.15.81:0/386490110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c12768c370 msgr2=0x55c12769d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7a67fc640 1 --2- 172.21.15.81:0/386490110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c12768c370 0x55c12769d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7a67fc640 1 -- 172.21.15.81:0/386490110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c1276815d0 msgr2=0x55c127686c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.231+0000 7ff7a67fc640 1 --2- 172.21.15.81:0/386490110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c1276815d0 0x55c127686c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.232+0000 7ff7a67fc640 1 -- 172.21.15.81:0/386490110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1276abfe0 con 0x55c127682b40 2024-09-12T01:28:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.232+0000 7ff7a67fc640 1 --2- 172.21.15.81:0/386490110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c127682b40 0x55c12769ccb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff79c007590 tx=0x7ff79c0054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d1606dc8de9137 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.232+0000 7ff78aff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.232+0000 7ff78aff5640 1 -- 172.21.15.81:0/386490110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c09aed0 con 0x55c127682b40 2024-09-12T01:28:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.232+0000 7ff78aff5640 1 -- 172.21.15.81:0/386490110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff79c007ca0 con 0x55c127682b40 2024-09-12T01:28:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.232+0000 7ff7af76e740 1 -- 172.21.15.81:0/386490110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff798005500 con 0x55c127682b40 2024-09-12T01:28:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.232+0000 7ff78aff5640 1 -- 172.21.15.81:0/386490110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff79c09b0b0 con 0x55c127682b40 2024-09-12T01:28:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.232+0000 7ff7af76e740 10 client.15588 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.232+0000 7ff7af76e740 1 -- 172.21.15.81:0/386490110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c12770f6c0 con 0x55c127682b40 2024-09-12T01:28:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.232+0000 7ff78aff5640 1 -- 172.21.15.81:0/386490110 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff798005500 con 0x55c127682b40 2024-09-12T01:28:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.232+0000 7ff78aff5640 1 -- 172.21.15.81:0/386490110 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff79c0cca50 con 0x55c127682b40 2024-09-12T01:28:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.232+0000 7ff7af76e740 10 client.15588 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.232+0000 7ff7af76e740 10 client.15588 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:28:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.233+0000 7ff7af76e740 20 client.15588 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.233+0000 7ff7af76e740 1 --2- 172.21.15.81:0/386490110 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55c12770fab0 0x55c127711ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.233+0000 7ff7af76e740 4 client.15588 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:28:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.233+0000 7ff7af76e740 1 -- 172.21.15.81:0/386490110 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c1275eed70 con 0x55c12770fab0 2024-09-12T01:28:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.233+0000 7ff7a6ffd640 1 --2- 172.21.15.81:0/386490110 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55c12770fab0 0x55c127711ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.233+0000 7ff7a6ffd640 1 --2- 172.21.15.81:0/386490110 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55c12770fab0 0x55c127711ea0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fb99f666039b3fb3 server_cookie=6c3c73b238af3eb8 in_seq=0 out_seq=0 2024-09-12T01:28:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.233+0000 7ff78aff5640 10 client.15588 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:28:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.233+0000 7ff78aff5640 1 -- 172.21.15.81:0/386490110 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c1275eed70 con 0x55c12770fab0 2024-09-12T01:28:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.233+0000 7ff78aff5640 10 client.15588 handle_command_reply: tid=0 2024-09-12T01:28:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.233+0000 7ff7af76e740 1 client.15588 shutdown 2024-09-12T01:28:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.233+0000 7ff7af76e740 1 -- 172.21.15.81:0/386490110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c127682b40 msgr2=0x55c12769ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7af76e740 1 --2- 172.21.15.81:0/386490110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c127682b40 0x55c12769ccb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff79c007590 tx=0x7ff79c0054a0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7af76e740 1 -- 172.21.15.81:0/386490110 shutdown_connections 2024-09-12T01:28:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7af76e740 1 --2- 172.21.15.81:0/386490110 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55c12770fab0 0x55c127711ea0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7af76e740 1 --2- 172.21.15.81:0/386490110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c12768c370 0x55c12769d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7af76e740 1 --2- 172.21.15.81:0/386490110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c127682b40 0x55c12769ccb0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7af76e740 1 --2- 172.21.15.81:0/386490110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c1276815d0 0x55c127686c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7af76e740 1 -- 172.21.15.81:0/386490110 >> 172.21.15.81:0/386490110 conn(0x55c12764a310 msgr2=0x55c12768a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff78aff5640 0 client.15588 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:28:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7af76e740 1 -- 172.21.15.81:0/386490110 shutdown_connections 2024-09-12T01:28:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7af76e740 1 -- 172.21.15.81:0/386490110 wait complete. 2024-09-12T01:28:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7af76e740 20 client.15588 trim_cache size 0 max 16384 2024-09-12T01:28:48.252 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:28:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7ad395640 1 -- 172.21.15.81:0/3993674016 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff7900a2e00 msgr2=0x7ff7900a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7ad395640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff7900a2e00 0x7ff7900a52c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0005fe0 tx=0x7ff7a002a950 comp rx=0 tx=0).stop 2024-09-12T01:28:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7ad395640 1 -- 172.21.15.81:0/3993674016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a8102570 msgr2=0x7ff7a81997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.234+0000 7ff7ad395640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a8102570 0x7ff7a81997f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00c890 tx=0x7ff79c00cd50 comp rx=0 tx=0).stop 2024-09-12T01:28:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.235+0000 7ff7ad395640 1 -- 172.21.15.81:0/3993674016 shutdown_connections 2024-09-12T01:28:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.235+0000 7ff7ad395640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff7900a2e00 0x7ff7900a52c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.235+0000 7ff7ad395640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff7a8102ef0 0x7ff7a81a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.235+0000 7ff7ad395640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a8102570 0x7ff7a81997f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.235+0000 7ff7ad395640 1 --2- 172.21.15.81:0/3993674016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a8100e20 0x7ff7a81992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:48.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.235+0000 7ff7ad395640 1 -- 172.21.15.81:0/3993674016 >> 172.21.15.81:0/3993674016 conn(0x7ff7a80fc7d0 msgr2=0x7ff7a8106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:48.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.235+0000 7ff7ad395640 1 -- 172.21.15.81:0/3993674016 shutdown_connections 2024-09-12T01:28:48.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:48.235+0000 7ff7ad395640 1 -- 172.21.15.81:0/3993674016 wait complete. 2024-09-12T01:28:49.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:28:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:49.507 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-12T01:28:49.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:28:49.669 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:49 smithi081 ceph-mon[30920]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:28:49.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:49 smithi100 ceph-mon[35275]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:28:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:49 smithi189 ceph-mon[35357]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:28:50.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.758+0000 7f2bcfeb6640 1 -- 172.21.15.81:0/198220507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101df0 msgr2=0x7f2bc81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:50.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.758+0000 7f2bcfeb6640 1 --2- 172.21.15.81:0/198220507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101df0 0x7f2bc81021d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009900 tx=0x7f2bc402a410 comp rx=0 tx=0).stop 2024-09-12T01:28:50.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.758+0000 7f2bcfeb6640 1 -- 172.21.15.81:0/198220507 shutdown_connections 2024-09-12T01:28:50.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.758+0000 7f2bcfeb6640 1 --2- 172.21.15.81:0/198220507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bc8106f20 0x7f2bc810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.758+0000 7f2bcfeb6640 1 --2- 172.21.15.81:0/198220507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bc81027a0 0x7f2bc81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.758+0000 7f2bcfeb6640 1 --2- 172.21.15.81:0/198220507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101df0 0x7f2bc81021d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.758+0000 7f2bcfeb6640 1 -- 172.21.15.81:0/198220507 >> 172.21.15.81:0/198220507 conn(0x7f2bc80fd8f0 msgr2=0x7f2bc80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.759+0000 7f2bcfeb6640 1 -- 172.21.15.81:0/198220507 shutdown_connections 2024-09-12T01:28:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.759+0000 7f2bcfeb6640 1 -- 172.21.15.81:0/198220507 wait complete. 2024-09-12T01:28:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.759+0000 7f2bcfeb6640 1 Processor -- start 2024-09-12T01:28:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.759+0000 7f2bcfeb6640 1 -- start start 2024-09-12T01:28:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.759+0000 7f2bcfeb6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101df0 0x7f2bc8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.759+0000 7f2bcfeb6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bc81027a0 0x7f2bc8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.759+0000 7f2bcfeb6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bc8106f20 0x7f2bc819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.759+0000 7f2bcfeb6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc8111f80 con 0x7f2bc8101df0 2024-09-12T01:28:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.759+0000 7f2bcfeb6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc8111e00 con 0x7f2bc8106f20 2024-09-12T01:28:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.759+0000 7f2bcfeb6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc8112100 con 0x7f2bc81027a0 2024-09-12T01:28:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.759+0000 7f2bcdc52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101df0 0x7f2bc8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bcdc52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101df0 0x7f2bc8198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42528/0 (socket says 172.21.15.81:42528) 2024-09-12T01:28:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bcdc52640 1 -- 172.21.15.81:0/599945149 learned_addr learned my addr 172.21.15.81:0/599945149 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bcd451640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bc81027a0 0x7f2bc8198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bce453640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bc8106f20 0x7f2bc819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bcdc52640 1 -- 172.21.15.81:0/599945149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bc81027a0 msgr2=0x7f2bc8198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bcdc52640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bc81027a0 0x7f2bc8198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bcdc52640 1 -- 172.21.15.81:0/599945149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bc8106f20 msgr2=0x7f2bc819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bcdc52640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bc8106f20 0x7f2bc819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bcdc52640 1 -- 172.21.15.81:0/599945149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc819d3b0 con 0x7f2bc8101df0 2024-09-12T01:28:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bcdc52640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101df0 0x7f2bc8198400 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4006010 tx=0x7f2bc40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bbeffd640 1 -- 172.21.15.81:0/599945149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc403f030 con 0x7f2bc8101df0 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bbeffd640 1 -- 172.21.15.81:0/599945149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bc4003ce0 con 0x7f2bc8101df0 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bcfeb6640 1 -- 172.21.15.81:0/599945149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc819d640 con 0x7f2bc8101df0 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bcfeb6640 1 -- 172.21.15.81:0/599945149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc81a4f80 con 0x7f2bc8101df0 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.760+0000 7f2bbeffd640 1 -- 172.21.15.81:0/599945149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4035070 con 0x7f2bc8101df0 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.763+0000 7f2bd228f740 1 Processor -- start 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.763+0000 7f2bd228f740 1 -- start start 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.763+0000 7f2bd228f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 0x5654091a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.763+0000 7f2bd228f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 0x5654091a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.763+0000 7f2bbeffd640 1 -- 172.21.15.81:0/599945149 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f2bc4042030 con 0x7f2bc8101df0 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.763+0000 7f2bd228f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.763+0000 7f2bd228f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5654091092f0 con 0x5654091ae370 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.763+0000 7f2bd228f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5654090b0cf0 con 0x5654091a35d0 2024-09-12T01:28:50.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.763+0000 7f2bd228f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5654091052b0 con 0x5654091a4b40 2024-09-12T01:28:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.763+0000 7f2bcd451640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.763+0000 7f2bcd451640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42540/0 (socket says 172.21.15.81:42540) 2024-09-12T01:28:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bcd451640 1 -- 172.21.15.81:0/998975344 learned_addr learned my addr 172.21.15.81:0/998975344 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bce453640 1 --2- 172.21.15.81:0/998975344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 0x5654091a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bcdc52640 1 --2- 172.21.15.81:0/998975344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 0x5654091a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bcd451640 1 -- 172.21.15.81:0/998975344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 msgr2=0x5654091a3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bcd451640 1 --2- 172.21.15.81:0/998975344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 0x5654091a3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bcd451640 1 -- 172.21.15.81:0/998975344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 msgr2=0x5654091a3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bcd451640 1 --2- 172.21.15.81:0/998975344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 0x5654091a3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bcd451640 1 -- 172.21.15.81:0/998975344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654090953a0 con 0x5654091ae370 2024-09-12T01:28:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bce453640 1 --2- 172.21.15.81:0/998975344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 0x5654091a3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:50.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bcd451640 1 --2- 172.21.15.81:0/998975344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091b0760 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800abf0 tx=0x7f2bb800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdfd41a623d3e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bb3fff640 1 -- 172.21.15.81:0/998975344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb801d070 con 0x5654091ae370 2024-09-12T01:28:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bbeffd640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2bb40a2e00 0x7f2bb40a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bb3fff640 1 -- 172.21.15.81:0/998975344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bb8018b20 con 0x5654091ae370 2024-09-12T01:28:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bb3fff640 1 -- 172.21.15.81:0/998975344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8010ae0 con 0x5654091ae370 2024-09-12T01:28:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bce453640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2bb40a2e00 0x7f2bb40a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.764+0000 7f2bbeffd640 1 -- 172.21.15.81:0/599945149 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2bc40ef950 con 0x7f2bc8101df0 2024-09-12T01:28:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.765+0000 7f2bd228f740 1 -- 172.21.15.81:0/998975344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 msgr2=0x5654091b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.765+0000 7f2bce453640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2bb40a2e00 0x7f2bb40a52c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0005fd0 tx=0x7f2bc0009500 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.765+0000 7f2bd228f740 1 --2- 172.21.15.81:0/998975344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091b0760 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800abf0 tx=0x7f2bb800f790 comp rx=0 tx=0).stop 2024-09-12T01:28:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.765+0000 7f2bd228f740 1 -- 172.21.15.81:0/998975344 shutdown_connections 2024-09-12T01:28:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.765+0000 7f2bd228f740 1 --2- 172.21.15.81:0/998975344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091b0760 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.765+0000 7f2bd228f740 1 --2- 172.21.15.81:0/998975344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 0x5654091a3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.765+0000 7f2bd228f740 1 --2- 172.21.15.81:0/998975344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 0x5654091a3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.765+0000 7f2bd228f740 1 -- 172.21.15.81:0/998975344 >> 172.21.15.81:0/998975344 conn(0x56540916c310 msgr2=0x56540919fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.765+0000 7f2bd228f740 1 -- 172.21.15.81:0/998975344 shutdown_connections 2024-09-12T01:28:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.765+0000 7f2bd228f740 1 -- 172.21.15.81:0/998975344 wait complete. 2024-09-12T01:28:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.766+0000 7f2bd228f740 1 -- start start 2024-09-12T01:28:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.766+0000 7f2bd228f740 1 Processor -- start 2024-09-12T01:28:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.766+0000 7f2bd228f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 0x5654091adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.766+0000 7f2bd228f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 0x5654091aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.766+0000 7f2bd228f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091ab520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.766+0000 7f2bd228f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5654091b1070 con 0x5654091ae370 2024-09-12T01:28:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.766+0000 7f2bd228f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5654090c4060 con 0x5654091a35d0 2024-09-12T01:28:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.766+0000 7f2bd228f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5654091b11f0 con 0x5654091a4b40 2024-09-12T01:28:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.766+0000 7f2bd228f740 10 client.0 _ll_register_callbacks cb 0x565408e178c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.766+0000 7f2bce453640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.766+0000 7f2bce453640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091ab520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42544/0 (socket says 172.21.15.81:42544) 2024-09-12T01:28:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.766+0000 7f2bce453640 1 -- 172.21.15.81:0/2436067278 learned_addr learned my addr 172.21.15.81:0/2436067278 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bcd451640 1 --2- 172.21.15.81:0/2436067278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 0x5654091aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bcdc52640 1 --2- 172.21.15.81:0/2436067278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 0x5654091adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bce453640 1 -- 172.21.15.81:0/2436067278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 msgr2=0x5654091aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bce453640 1 --2- 172.21.15.81:0/2436067278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 0x5654091aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bce453640 1 -- 172.21.15.81:0/2436067278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 msgr2=0x5654091adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bce453640 1 --2- 172.21.15.81:0/2436067278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 0x5654091adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bce453640 1 -- 172.21.15.81:0/2436067278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565408e7a3c0 con 0x5654091ae370 2024-09-12T01:28:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bce453640 1 --2- 172.21.15.81:0/2436067278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091ab520 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0010bf0 tx=0x7f2bc0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10323c19e346ffc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bb17fa640 1 -- 172.21.15.81:0/2436067278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc002c060 con 0x5654091ae370 2024-09-12T01:28:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bb17fa640 1 -- 172.21.15.81:0/2436067278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2bc0017030 con 0x5654091ae370 2024-09-12T01:28:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bd228f740 1 -- 172.21.15.81:0/2436067278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bb8018b20 con 0x5654091ae370 2024-09-12T01:28:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bb17fa640 1 -- 172.21.15.81:0/2436067278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2bc001fc80 con 0x5654091ae370 2024-09-12T01:28:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bd228f740 10 client.15600 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:50.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bd228f740 1 -- 172.21.15.81:0/2436067278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5654091bcb60 con 0x5654091ae370 2024-09-12T01:28:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.767+0000 7f2bb17fa640 1 -- 172.21.15.81:0/2436067278 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bb8018b20 con 0x5654091ae370 2024-09-12T01:28:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.768+0000 7f2bb17fa640 1 -- 172.21.15.81:0/2436067278 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2bc001c3f0 con 0x5654091ae370 2024-09-12T01:28:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.768+0000 7f2bd228f740 10 client.15600 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.768+0000 7f2bd228f740 10 client.15600 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:28:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.768+0000 7f2bd228f740 20 client.15600 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.768+0000 7f2bd228f740 1 --2- 172.21.15.81:0/2436067278 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5654091be020 0x5654091c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.768+0000 7f2bd228f740 4 client.15600 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.768+0000 7f2bd228f740 1 -- 172.21.15.81:0/2436067278 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565409116860 con 0x5654091be020 2024-09-12T01:28:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.768+0000 7f2bcdc52640 1 --2- 172.21.15.81:0/2436067278 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5654091be020 0x5654091c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.769+0000 7f2bb17fa640 10 client.15600 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:28:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.769+0000 7f2bcdc52640 1 --2- 172.21.15.81:0/2436067278 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5654091be020 0x5654091c04c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=12bcdd540fda4b27 server_cookie=a1565c15d4185165 in_seq=0 out_seq=0 2024-09-12T01:28:50.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.769+0000 7f2bb17fa640 1 -- 172.21.15.81:0/2436067278 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565409116860 con 0x5654091be020 2024-09-12T01:28:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.769+0000 7f2bb17fa640 10 client.15600 handle_command_reply: tid=0 2024-09-12T01:28:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.769+0000 7f2bd228f740 1 client.15600 shutdown 2024-09-12T01:28:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.769+0000 7f2bd228f740 1 -- 172.21.15.81:0/2436067278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 msgr2=0x5654091ab520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.769+0000 7f2bd228f740 1 --2- 172.21.15.81:0/2436067278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091ab520 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0010bf0 tx=0x7f2bc0004ab0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.770+0000 7f2bd228f740 1 -- 172.21.15.81:0/2436067278 shutdown_connections 2024-09-12T01:28:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.770+0000 7f2bd228f740 1 --2- 172.21.15.81:0/2436067278 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5654091be020 0x5654091c04c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.770+0000 7f2bd228f740 1 --2- 172.21.15.81:0/2436067278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091ab520 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.770+0000 7f2bd228f740 1 --2- 172.21.15.81:0/2436067278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 0x5654091aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.770+0000 7f2bb17fa640 0 client.15600 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:28:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.770+0000 7f2bd228f740 1 --2- 172.21.15.81:0/2436067278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 0x5654091adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.770+0000 7f2bd228f740 1 -- 172.21.15.81:0/2436067278 >> 172.21.15.81:0/2436067278 conn(0x56540916c310 msgr2=0x5654091a5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.770+0000 7f2bd228f740 1 -- 172.21.15.81:0/2436067278 shutdown_connections 2024-09-12T01:28:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.770+0000 7f2bd228f740 1 -- 172.21.15.81:0/2436067278 wait complete. 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.770+0000 7f2bd228f740 20 client.15600 trim_cache size 0 max 16384 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bd228f740 1 Processor -- start 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bd228f740 1 -- start start 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bd228f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 0x56540919ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bd228f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 0x5654091a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bd228f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091a6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bd228f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac00e6d0 con 0x5654091ae370 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bd228f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac010210 con 0x5654091a35d0 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bd228f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac00eda0 con 0x5654091a4b40 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bce453640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091a6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bce453640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091a6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42546/0 (socket says 172.21.15.81:42546) 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bce453640 1 -- 172.21.15.81:0/365735881 learned_addr learned my addr 172.21.15.81:0/365735881 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bcdc52640 1 --2- 172.21.15.81:0/365735881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 0x56540919ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bcd451640 1 --2- 172.21.15.81:0/365735881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 0x5654091a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bce453640 1 -- 172.21.15.81:0/365735881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 msgr2=0x5654091a6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bce453640 1 --2- 172.21.15.81:0/365735881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 0x5654091a6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bce453640 1 -- 172.21.15.81:0/365735881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 msgr2=0x56540919ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bce453640 1 --2- 172.21.15.81:0/365735881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 0x56540919ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bce453640 1 -- 172.21.15.81:0/365735881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654091a9f70 con 0x5654091ae370 2024-09-12T01:28:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bcdc52640 1 --2- 172.21.15.81:0/365735881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 0x56540919ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.784+0000 7f2bce453640 1 --2- 172.21.15.81:0/365735881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091a6660 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0011010 tx=0x7f2bc0010410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba7cc4dbc0e0b1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.785+0000 7f2bb37fe640 1 -- 172.21.15.81:0/365735881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00109c0 con 0x5654091ae370 2024-09-12T01:28:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.785+0000 7f2bb37fe640 1 -- 172.21.15.81:0/365735881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bc001c3f0 con 0x5654091ae370 2024-09-12T01:28:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.785+0000 7f2bb37fe640 1 -- 172.21.15.81:0/365735881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0005580 con 0x5654091ae370 2024-09-12T01:28:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.785+0000 7f2bd228f740 1 -- 172.21.15.81:0/365735881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 msgr2=0x5654091a6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.785+0000 7f2bd228f740 1 --2- 172.21.15.81:0/365735881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091a6660 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0011010 tx=0x7f2bc0010410 comp rx=0 tx=0).stop 2024-09-12T01:28:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 -- 172.21.15.81:0/365735881 shutdown_connections 2024-09-12T01:28:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 --2- 172.21.15.81:0/365735881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091ae370 0x5654091a6660 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 --2- 172.21.15.81:0/365735881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091a4b40 0x5654091a6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 --2- 172.21.15.81:0/365735881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a35d0 0x56540919ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 -- 172.21.15.81:0/365735881 >> 172.21.15.81:0/365735881 conn(0x56540916c310 msgr2=0x56540919e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 -- 172.21.15.81:0/365735881 shutdown_connections 2024-09-12T01:28:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 -- 172.21.15.81:0/365735881 wait complete. 2024-09-12T01:28:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 -- start start 2024-09-12T01:28:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 Processor -- start 2024-09-12T01:28:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091a35d0 0x5654091a8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a4b40 0x5654091a86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091ae370 0x5654091a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac00fb40 con 0x5654091a35d0 2024-09-12T01:28:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac00f470 con 0x5654091a4b40 2024-09-12T01:28:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.786+0000 7f2bd228f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac00c6b0 con 0x5654091ae370 2024-09-12T01:28:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bd228f740 10 client.0 _ll_register_callbacks cb 0x7f2bc0009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bcdc52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091a35d0 0x5654091a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bcdc52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091a35d0 0x5654091a8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42548/0 (socket says 172.21.15.81:42548) 2024-09-12T01:28:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bcdc52640 1 -- 172.21.15.81:0/1337484651 learned_addr learned my addr 172.21.15.81:0/1337484651 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bce453640 1 --2- 172.21.15.81:0/1337484651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091ae370 0x5654091a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bcd451640 1 --2- 172.21.15.81:0/1337484651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a4b40 0x5654091a86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bcdc52640 1 -- 172.21.15.81:0/1337484651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091ae370 msgr2=0x5654091a8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bcdc52640 1 --2- 172.21.15.81:0/1337484651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091ae370 0x5654091a8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bcdc52640 1 -- 172.21.15.81:0/1337484651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a4b40 msgr2=0x5654091a86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bcdc52640 1 --2- 172.21.15.81:0/1337484651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a4b40 0x5654091a86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bcdc52640 1 -- 172.21.15.81:0/1337484651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565409227f00 con 0x5654091a35d0 2024-09-12T01:28:50.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bcdc52640 1 --2- 172.21.15.81:0/1337484651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091a35d0 0x5654091a8180 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4000c00 tx=0x7f2bc40045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77a7e611816e405 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bb17fa640 1 -- 172.21.15.81:0/1337484651 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4049040 con 0x5654091a35d0 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bb17fa640 1 -- 172.21.15.81:0/1337484651 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2bc40ba030 con 0x5654091a35d0 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.787+0000 7f2bd228f740 1 -- 172.21.15.81:0/1337484651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bc001c3f0 con 0x5654091a35d0 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.788+0000 7f2bb17fa640 1 -- 172.21.15.81:0/1337484651 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2bc40c00e0 con 0x5654091a35d0 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.788+0000 7f2bd228f740 10 client.15606 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.788+0000 7f2bd228f740 1 -- 172.21.15.81:0/1337484651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565409229200 con 0x5654091a35d0 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.788+0000 7f2bb17fa640 1 -- 172.21.15.81:0/1337484651 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bc001c3f0 con 0x5654091a35d0 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.788+0000 7f2bb17fa640 1 -- 172.21.15.81:0/1337484651 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2bc40bbf90 con 0x5654091a35d0 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.788+0000 7f2bd228f740 10 client.15606 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.788+0000 7f2bd228f740 10 client.15606 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.788+0000 7f2bd228f740 20 client.15606 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.788+0000 7f2bd228f740 1 --2- 172.21.15.81:0/1337484651 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5654092298d0 0x56540922bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.788+0000 7f2bd228f740 4 client.15606 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:28:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.788+0000 7f2bd228f740 1 -- 172.21.15.81:0/1337484651 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565409110d70 con 0x5654092298d0 2024-09-12T01:28:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.788+0000 7f2bcd451640 1 --2- 172.21.15.81:0/1337484651 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5654092298d0 0x56540922bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bcd451640 1 --2- 172.21.15.81:0/1337484651 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5654092298d0 0x56540922bcc0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=264a72fdaa5da05a server_cookie=a837fc01c62656ac in_seq=0 out_seq=0 2024-09-12T01:28:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bb17fa640 10 client.15606 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:28:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bb17fa640 1 -- 172.21.15.81:0/1337484651 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565409110d70 con 0x5654092298d0 2024-09-12T01:28:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bb17fa640 10 client.15606 handle_command_reply: tid=0 2024-09-12T01:28:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bd228f740 1 client.15606 shutdown 2024-09-12T01:28:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bd228f740 1 -- 172.21.15.81:0/1337484651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091a35d0 msgr2=0x5654091a8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bd228f740 1 --2- 172.21.15.81:0/1337484651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091a35d0 0x5654091a8180 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4000c00 tx=0x7f2bc40045a0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bd228f740 1 -- 172.21.15.81:0/1337484651 shutdown_connections 2024-09-12T01:28:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bd228f740 1 --2- 172.21.15.81:0/1337484651 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5654092298d0 0x56540922bcc0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bd228f740 1 --2- 172.21.15.81:0/1337484651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5654091ae370 0x5654091a8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bb17fa640 0 client.15606 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:28:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bd228f740 1 --2- 172.21.15.81:0/1337484651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5654091a4b40 0x5654091a86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bd228f740 1 --2- 172.21.15.81:0/1337484651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654091a35d0 0x5654091a8180 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bd228f740 1 -- 172.21.15.81:0/1337484651 >> 172.21.15.81:0/1337484651 conn(0x56540916c310 msgr2=0x5654091ad020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:50.337 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:28:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bd228f740 1 -- 172.21.15.81:0/1337484651 shutdown_connections 2024-09-12T01:28:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bd228f740 1 -- 172.21.15.81:0/1337484651 wait complete. 2024-09-12T01:28:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.789+0000 7f2bd228f740 20 client.15606 trim_cache size 0 max 16384 2024-09-12T01:28:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.790+0000 7f2bcfeb6640 1 -- 172.21.15.81:0/599945149 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2bb40a2e00 msgr2=0x7f2bb40a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.790+0000 7f2bcfeb6640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2bb40a2e00 0x7f2bb40a52c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0005fd0 tx=0x7f2bc0009500 comp rx=0 tx=0).stop 2024-09-12T01:28:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.790+0000 7f2bcfeb6640 1 -- 172.21.15.81:0/599945149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101df0 msgr2=0x7f2bc8198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.790+0000 7f2bcfeb6640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101df0 0x7f2bc8198400 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4006010 tx=0x7f2bc40042f0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.790+0000 7f2bcfeb6640 1 -- 172.21.15.81:0/599945149 shutdown_connections 2024-09-12T01:28:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.790+0000 7f2bcfeb6640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2bb40a2e00 0x7f2bb40a52c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.790+0000 7f2bcfeb6640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bc8106f20 0x7f2bc819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.790+0000 7f2bcfeb6640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bc81027a0 0x7f2bc8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.790+0000 7f2bcfeb6640 1 --2- 172.21.15.81:0/599945149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bc8101df0 0x7f2bc8198400 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.790+0000 7f2bcfeb6640 1 -- 172.21.15.81:0/599945149 >> 172.21.15.81:0/599945149 conn(0x7f2bc80fd8f0 msgr2=0x7f2bc80fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.790+0000 7f2bcfeb6640 1 -- 172.21.15.81:0/599945149 shutdown_connections 2024-09-12T01:28:50.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:49.790+0000 7f2bcfeb6640 1 -- 172.21.15.81:0/599945149 wait complete. 2024-09-12T01:28:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:51 smithi081 ceph-mon[30920]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T01:28:51.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:51 smithi100 ceph-mon[35275]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T01:28:51.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:51 smithi189 ceph-mon[35357]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T01:28:53.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:53 smithi081 ceph-mon[30920]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:28:53.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:53 smithi100 ceph-mon[35275]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:28:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:53 smithi189 ceph-mon[35357]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:28:54.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:28:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.440+0000 7fc20a8ff640 1 -- 172.21.15.81:0/3242423156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204102570 msgr2=0x7fc2041029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.440+0000 7fc20a8ff640 1 --2- 172.21.15.81:0/3242423156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204102570 0x7fc2041029b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009900 tx=0x7fc1f802a480 comp rx=0 tx=0).stop 2024-09-12T01:28:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.440+0000 7fc20a8ff640 1 -- 172.21.15.81:0/3242423156 shutdown_connections 2024-09-12T01:28:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.440+0000 7fc20a8ff640 1 --2- 172.21.15.81:0/3242423156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204102ef0 0x7fc20410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.440+0000 7fc20a8ff640 1 --2- 172.21.15.81:0/3242423156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204102570 0x7fc2041029b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.440+0000 7fc20a8ff640 1 --2- 172.21.15.81:0/3242423156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc204100e20 0x7fc204101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.440+0000 7fc20a8ff640 1 -- 172.21.15.81:0/3242423156 >> 172.21.15.81:0/3242423156 conn(0x7fc2040fc7d0 msgr2=0x7fc2040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.440+0000 7fc20a8ff640 1 -- 172.21.15.81:0/3242423156 shutdown_connections 2024-09-12T01:28:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.440+0000 7fc20a8ff640 1 -- 172.21.15.81:0/3242423156 wait complete. 2024-09-12T01:28:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.441+0000 7fc20a8ff640 1 Processor -- start 2024-09-12T01:28:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.441+0000 7fc20a8ff640 1 -- start start 2024-09-12T01:28:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc20a8ff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204100e20 0x7fc204198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc20a8ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204102570 0x7fc204198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc20a8ff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc204102ef0 0x7fc20419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc20a8ff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc204110fa0 con 0x7fc204102570 2024-09-12T01:28:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc20a8ff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc204110e20 con 0x7fc204100e20 2024-09-12T01:28:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc20a8ff640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc204111120 con 0x7fc204102ef0 2024-09-12T01:28:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc2037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204102570 0x7fc204198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc2037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204102570 0x7fc204198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59040/0 (socket says 172.21.15.81:59040) 2024-09-12T01:28:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc2037fe640 1 -- 172.21.15.81:0/365840900 learned_addr learned my addr 172.21.15.81:0/365840900 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc203fff640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204100e20 0x7fc204198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:55.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc208e9c640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc204102ef0 0x7fc20419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:55.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc2037fe640 1 -- 172.21.15.81:0/365840900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc204102ef0 msgr2=0x7fc20419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:55.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc2037fe640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc204102ef0 0x7fc20419ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:55.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc2037fe640 1 -- 172.21.15.81:0/365840900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204100e20 msgr2=0x7fc204198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:55.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc2037fe640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204100e20 0x7fc204198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:55.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc2037fe640 1 -- 172.21.15.81:0/365840900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20419d500 con 0x7fc204102570 2024-09-12T01:28:55.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc203fff640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204100e20 0x7fc204198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:55.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.442+0000 7fc2037fe640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204102570 0x7fc204198a90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8006010 tx=0x7fc1f8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:55.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.443+0000 7fc2017fa640 1 -- 172.21.15.81:0/365840900 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f803f070 con 0x7fc204102570 2024-09-12T01:28:55.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.443+0000 7fc2017fa640 1 -- 172.21.15.81:0/365840900 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1f8031e30 con 0x7fc204102570 2024-09-12T01:28:55.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.443+0000 7fc20a8ff640 1 -- 172.21.15.81:0/365840900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20419d790 con 0x7fc204102570 2024-09-12T01:28:55.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.443+0000 7fc2017fa640 1 -- 172.21.15.81:0/365840900 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8035030 con 0x7fc204102570 2024-09-12T01:28:55.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.443+0000 7fc20a8ff640 1 -- 172.21.15.81:0/365840900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2040fcbb0 con 0x7fc204102570 2024-09-12T01:28:55.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.444+0000 7fc20a8ff640 1 -- 172.21.15.81:0/365840900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2041021b0 con 0x7fc204102570 2024-09-12T01:28:55.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.446+0000 7fc2017fa640 1 -- 172.21.15.81:0/365840900 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7fc1f8042070 con 0x7fc204102570 2024-09-12T01:28:55.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.446+0000 7fc2017fa640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc1ec0a2e00 0x7fc1ec0a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:55.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.447+0000 7fc2017fa640 1 -- 172.21.15.81:0/365840900 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fc1f80f0530 con 0x7fc204102570 2024-09-12T01:28:55.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.447+0000 7fc203fff640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc1ec0a2e00 0x7fc1ec0a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:55.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.447+0000 7fc203fff640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc1ec0a2e00 0x7fc1ec0a52c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400abe0 tx=0x7fc1f400a5c0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:55.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.453+0000 7fc2017fa640 1 -- 172.21.15.81:0/365840900 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1f80bd0a0 con 0x7fc204102570 2024-09-12T01:28:55.507 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:55.631 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:55 smithi081 ceph-mon[30920]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:28:55.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:55 smithi100 ceph-mon[35275]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:28:55.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:55 smithi189 ceph-mon[35357]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:28:55.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.843+0000 7fc20a8ff640 1 -- 172.21.15.81:0/365840900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc204101200 con 0x7fc204102570 2024-09-12T01:28:55.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.844+0000 7fc2017fa640 1 -- 172.21.15.81:0/365840900 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fc204101200 con 0x7fc204102570 2024-09-12T01:28:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:28:55.845 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:28:55.845 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:28:55.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.847+0000 7fc20a8ff640 1 -- 172.21.15.81:0/365840900 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc1ec0a2e00 msgr2=0x7fc1ec0a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:55.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.847+0000 7fc20a8ff640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc1ec0a2e00 0x7fc1ec0a52c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400abe0 tx=0x7fc1f400a5c0 comp rx=0 tx=0).stop 2024-09-12T01:28:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.847+0000 7fc20a8ff640 1 -- 172.21.15.81:0/365840900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204102570 msgr2=0x7fc204198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.847+0000 7fc20a8ff640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204102570 0x7fc204198a90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8006010 tx=0x7fc1f8003c80 comp rx=0 tx=0).stop 2024-09-12T01:28:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.847+0000 7fc20a8ff640 1 -- 172.21.15.81:0/365840900 shutdown_connections 2024-09-12T01:28:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.847+0000 7fc20a8ff640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc1ec0a2e00 0x7fc1ec0a52c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.847+0000 7fc20a8ff640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc204102ef0 0x7fc20419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.847+0000 7fc20a8ff640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204102570 0x7fc204198a90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.847+0000 7fc20a8ff640 1 --2- 172.21.15.81:0/365840900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc204100e20 0x7fc204198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.847+0000 7fc20a8ff640 1 -- 172.21.15.81:0/365840900 >> 172.21.15.81:0/365840900 conn(0x7fc2040fc7d0 msgr2=0x7fc20406a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:55.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.848+0000 7fc20a8ff640 1 -- 172.21.15.81:0/365840900 shutdown_connections 2024-09-12T01:28:55.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:55.848+0000 7fc20a8ff640 1 -- 172.21.15.81:0/365840900 wait complete. 2024-09-12T01:28:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.026+0000 7fac46d1a640 1 -- 172.21.15.81:0/2602807732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac40100e20 msgr2=0x7fac40101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.026+0000 7fac46d1a640 1 --2- 172.21.15.81:0/2602807732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac40100e20 0x7fac40101200 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fac3400d910 tx=0x7fac3402c400 comp rx=0 tx=0).stop 2024-09-12T01:28:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.026+0000 7fac46d1a640 1 -- 172.21.15.81:0/2602807732 shutdown_connections 2024-09-12T01:28:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.026+0000 7fac46d1a640 1 --2- 172.21.15.81:0/2602807732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac40102ef0 0x7fac4010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.026+0000 7fac46d1a640 1 --2- 172.21.15.81:0/2602807732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac40102570 0x7fac401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.026+0000 7fac46d1a640 1 --2- 172.21.15.81:0/2602807732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac40100e20 0x7fac40101200 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.026+0000 7fac46d1a640 1 -- 172.21.15.81:0/2602807732 >> 172.21.15.81:0/2602807732 conn(0x7fac400fc7d0 msgr2=0x7fac400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.026+0000 7fac46d1a640 1 -- 172.21.15.81:0/2602807732 shutdown_connections 2024-09-12T01:28:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.026+0000 7fac46d1a640 1 -- 172.21.15.81:0/2602807732 wait complete. 2024-09-12T01:28:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.027+0000 7fac46d1a640 1 Processor -- start 2024-09-12T01:28:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.027+0000 7fac46d1a640 1 -- start start 2024-09-12T01:28:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.027+0000 7fac46d1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac40100e20 0x7fac401a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.027+0000 7fac46d1a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac40102570 0x7fac401a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.027+0000 7fac46d1a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac40102ef0 0x7fac4019e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.027+0000 7fac46d1a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac4010ff00 con 0x7fac40100e20 2024-09-12T01:28:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.027+0000 7fac46d1a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac4010fd80 con 0x7fac40102ef0 2024-09-12T01:28:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.027+0000 7fac46d1a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fac40110080 con 0x7fac40102570 2024-09-12T01:28:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.028+0000 7fac44ab6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac40100e20 0x7fac401a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.028+0000 7fac44ab6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac40100e20 0x7fac401a47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59064/0 (socket says 172.21.15.81:59064) 2024-09-12T01:28:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.028+0000 7fac44ab6640 1 -- 172.21.15.81:0/3040733261 learned_addr learned my addr 172.21.15.81:0/3040733261 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.028+0000 7fac3ffff640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac40102570 0x7fac401a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.028+0000 7fac452b7640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac40102ef0 0x7fac4019e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.029+0000 7fac3ffff640 1 -- 172.21.15.81:0/3040733261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac40102ef0 msgr2=0x7fac4019e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.029+0000 7fac3ffff640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac40102ef0 0x7fac4019e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.029+0000 7fac3ffff640 1 -- 172.21.15.81:0/3040733261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac40100e20 msgr2=0x7fac401a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.029+0000 7fac3ffff640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac40100e20 0x7fac401a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.029+0000 7fac3ffff640 1 -- 172.21.15.81:0/3040733261 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4019f0b0 con 0x7fac40102570 2024-09-12T01:28:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.029+0000 7fac44ab6640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac40100e20 0x7fac401a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.030+0000 7fac3ffff640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac40102570 0x7fac401a4d00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00d720 tx=0x7fac2c00dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.030+0000 7fac3dffb640 1 -- 172.21.15.81:0/3040733261 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c017070 con 0x7fac40102570 2024-09-12T01:28:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.030+0000 7fac3dffb640 1 -- 172.21.15.81:0/3040733261 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac2c00de30 con 0x7fac40102570 2024-09-12T01:28:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.030+0000 7fac46d1a640 1 -- 172.21.15.81:0/3040733261 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4019f3a0 con 0x7fac40102570 2024-09-12T01:28:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.030+0000 7fac3dffb640 1 -- 172.21.15.81:0/3040733261 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0047a0 con 0x7fac40102570 2024-09-12T01:28:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.032+0000 7fac46d1a640 1 -- 172.21.15.81:0/3040733261 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac4006dc20 con 0x7fac40102570 2024-09-12T01:28:56.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.033+0000 7fac3dffb640 1 -- 172.21.15.81:0/3040733261 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7fac2c0099d0 con 0x7fac40102570 2024-09-12T01:28:56.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.034+0000 7fac3dffb640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fac300a2e00 0x7fac300a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.034+0000 7fac3dffb640 1 -- 172.21.15.81:0/3040733261 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fac2c0d2170 con 0x7fac40102570 2024-09-12T01:28:56.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.035+0000 7fac44ab6640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fac300a2e00 0x7fac300a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.035+0000 7fac490f3740 1 Processor -- start 2024-09-12T01:28:56.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.035+0000 7fac490f3740 1 -- start start 2024-09-12T01:28:56.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac490f3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b1010b40 0x5646b100f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac490f3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b100f5d0 0x5646b100fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac490f3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 0x5646b101c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac490f3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5646b0f752f0 con 0x5646b101a370 2024-09-12T01:28:56.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac490f3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5646b0f1ccf0 con 0x5646b1010b40 2024-09-12T01:28:56.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac490f3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5646b0f712b0 con 0x5646b100f5d0 2024-09-12T01:28:56.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac452b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 0x5646b101c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac452b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 0x5646b101c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59072/0 (socket says 172.21.15.81:59072) 2024-09-12T01:28:56.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac452b7640 1 -- 172.21.15.81:0/2941585636 learned_addr learned my addr 172.21.15.81:0/2941585636 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:56.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac452b7640 1 -- 172.21.15.81:0/2941585636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b100f5d0 msgr2=0x5646b100fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:56.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac452b7640 1 --2- 172.21.15.81:0/2941585636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b100f5d0 0x5646b100fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac452b7640 1 -- 172.21.15.81:0/2941585636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b1010b40 msgr2=0x5646b100f090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:28:56.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac452b7640 1 --2- 172.21.15.81:0/2941585636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b1010b40 0x5646b100f090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac452b7640 1 -- 172.21.15.81:0/2941585636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646b0f013a0 con 0x5646b101a370 2024-09-12T01:28:56.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.036+0000 7fac452b7640 1 --2- 172.21.15.81:0/2941585636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 0x5646b101c760 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fac38009f20 tx=0x7fac3800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4761786a02cc5c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:56.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.037+0000 7fac2affd640 1 -- 172.21.15.81:0/2941585636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3801a070 con 0x5646b101a370 2024-09-12T01:28:56.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.037+0000 7fac2affd640 1 -- 172.21.15.81:0/2941585636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac380158f0 con 0x5646b101a370 2024-09-12T01:28:56.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.037+0000 7fac2affd640 1 -- 172.21.15.81:0/2941585636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3800a9f0 con 0x5646b101a370 2024-09-12T01:28:56.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.038+0000 7fac44ab6640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fac300a2e00 0x7fac300a52c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac3402c9f0 tx=0x7fac34005a20 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:56.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.038+0000 7fac490f3740 1 -- 172.21.15.81:0/2941585636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 msgr2=0x5646b101c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:56.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.038+0000 7fac490f3740 1 --2- 172.21.15.81:0/2941585636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 0x5646b101c760 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fac38009f20 tx=0x7fac3800c8b0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.038+0000 7fac490f3740 1 -- 172.21.15.81:0/2941585636 shutdown_connections 2024-09-12T01:28:56.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.038+0000 7fac490f3740 1 --2- 172.21.15.81:0/2941585636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 0x5646b101c760 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.038+0000 7fac490f3740 1 --2- 172.21.15.81:0/2941585636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b100f5d0 0x5646b100fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.038+0000 7fac490f3740 1 --2- 172.21.15.81:0/2941585636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b1010b40 0x5646b100f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.038+0000 7fac490f3740 1 -- 172.21.15.81:0/2941585636 >> 172.21.15.81:0/2941585636 conn(0x5646b0fd8310 msgr2=0x5646b100bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.038+0000 7fac490f3740 1 -- 172.21.15.81:0/2941585636 shutdown_connections 2024-09-12T01:28:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.038+0000 7fac490f3740 1 -- 172.21.15.81:0/2941585636 wait complete. 2024-09-12T01:28:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.038+0000 7fac490f3740 1 -- start start 2024-09-12T01:28:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.038+0000 7fac490f3740 1 Processor -- start 2024-09-12T01:28:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.039+0000 7fac490f3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b100f5d0 0x5646b1019e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.039+0000 7fac490f3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b1010b40 0x5646b10170d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.039+0000 7fac490f3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 0x5646b1017860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.039+0000 7fac490f3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5646b101d070 con 0x5646b101a370 2024-09-12T01:28:56.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.039+0000 7fac490f3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5646b0f30060 con 0x5646b100f5d0 2024-09-12T01:28:56.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.039+0000 7fac490f3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5646b101d1f0 con 0x5646b1010b40 2024-09-12T01:28:56.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.039+0000 7fac490f3740 10 client.0 _ll_register_callbacks cb 0x5646b0c838c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:56.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.039+0000 7fac452b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 0x5646b1017860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.039+0000 7fac452b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 0x5646b1017860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59084/0 (socket says 172.21.15.81:59084) 2024-09-12T01:28:56.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.039+0000 7fac452b7640 1 -- 172.21.15.81:0/2120094150 learned_addr learned my addr 172.21.15.81:0/2120094150 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:56.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.039+0000 7fac3ffff640 1 --2- 172.21.15.81:0/2120094150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b1010b40 0x5646b10170d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.040+0000 7fac452b7640 1 -- 172.21.15.81:0/2120094150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b1010b40 msgr2=0x5646b10170d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:56.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.040+0000 7fac452b7640 1 --2- 172.21.15.81:0/2120094150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b1010b40 0x5646b10170d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.040+0000 7fac452b7640 1 -- 172.21.15.81:0/2120094150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b100f5d0 msgr2=0x5646b1019e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:56.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.040+0000 7fac452b7640 1 --2- 172.21.15.81:0/2120094150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b100f5d0 0x5646b1019e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.040+0000 7fac452b7640 1 -- 172.21.15.81:0/2120094150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646b0ce63c0 con 0x5646b101a370 2024-09-12T01:28:56.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.040+0000 7fac452b7640 1 --2- 172.21.15.81:0/2120094150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 0x5646b1017860 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fac38004b90 tx=0x7fac38015cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1027dfd7134ed21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:56.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.040+0000 7fac1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:56.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.040+0000 7fac1ffff640 1 -- 172.21.15.81:0/2120094150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3801a070 con 0x5646b101a370 2024-09-12T01:28:56.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.040+0000 7fac490f3740 1 -- 172.21.15.81:0/2120094150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac380158f0 con 0x5646b101a370 2024-09-12T01:28:56.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.040+0000 7fac1ffff640 1 -- 172.21.15.81:0/2120094150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fac3800a770 con 0x5646b101a370 2024-09-12T01:28:56.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.040+0000 7fac1ffff640 1 -- 172.21.15.81:0/2120094150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fac38009b90 con 0x5646b101a370 2024-09-12T01:28:56.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.040+0000 7fac490f3740 10 client.15624 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:56.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.040+0000 7fac490f3740 1 -- 172.21.15.81:0/2120094150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5646b101fb80 con 0x5646b101a370 2024-09-12T01:28:56.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.041+0000 7fac1ffff640 1 -- 172.21.15.81:0/2120094150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac380158f0 con 0x5646b101a370 2024-09-12T01:28:56.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.041+0000 7fac1ffff640 1 -- 172.21.15.81:0/2120094150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fac380209a0 con 0x5646b101a370 2024-09-12T01:28:56.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.041+0000 7fac490f3740 10 client.15624 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:56.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.041+0000 7fac490f3740 10 client.15624 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:28:56.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.041+0000 7fac490f3740 20 client.15624 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:56.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.041+0000 7fac490f3740 1 --2- 172.21.15.81:0/2120094150 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5646b1020f90 0x5646b10233c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.041+0000 7fac490f3740 4 client.15624 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:56.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.041+0000 7fac490f3740 1 -- 172.21.15.81:0/2120094150 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646b0f82860 con 0x5646b1020f90 2024-09-12T01:28:56.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.042+0000 7fac44ab6640 1 --2- 172.21.15.81:0/2120094150 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5646b1020f90 0x5646b10233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.042+0000 7fac44ab6640 1 --2- 172.21.15.81:0/2120094150 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5646b1020f90 0x5646b10233c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a15efb7bc02796ea server_cookie=bf749217fe7961c in_seq=0 out_seq=0 2024-09-12T01:28:56.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.042+0000 7fac1ffff640 10 client.15624 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:28:56.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.043+0000 7fac1ffff640 1 -- 172.21.15.81:0/2120094150 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5646b0f82860 con 0x5646b1020f90 2024-09-12T01:28:56.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.043+0000 7fac1ffff640 10 client.15624 handle_command_reply: tid=0 2024-09-12T01:28:56.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.043+0000 7fac490f3740 1 client.15624 shutdown 2024-09-12T01:28:56.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.043+0000 7fac490f3740 1 -- 172.21.15.81:0/2120094150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 msgr2=0x5646b1017860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:56.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.043+0000 7fac490f3740 1 --2- 172.21.15.81:0/2120094150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 0x5646b1017860 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fac38004b90 tx=0x7fac38015cd0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.043+0000 7fac490f3740 1 -- 172.21.15.81:0/2120094150 shutdown_connections 2024-09-12T01:28:56.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.043+0000 7fac490f3740 1 --2- 172.21.15.81:0/2120094150 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5646b1020f90 0x5646b10233c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.043+0000 7fac490f3740 1 --2- 172.21.15.81:0/2120094150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b101a370 0x5646b1017860 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.043+0000 7fac490f3740 1 --2- 172.21.15.81:0/2120094150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b1010b40 0x5646b10170d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.043+0000 7fac490f3740 1 --2- 172.21.15.81:0/2120094150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b100f5d0 0x5646b1019e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.043+0000 7fac490f3740 1 -- 172.21.15.81:0/2120094150 >> 172.21.15.81:0/2120094150 conn(0x5646b0fd8310 msgr2=0x5646b1011960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:56.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.043+0000 7fac1ffff640 0 client.15624 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:28:56.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.043+0000 7fac490f3740 1 -- 172.21.15.81:0/2120094150 shutdown_connections 2024-09-12T01:28:56.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.044+0000 7fac490f3740 1 -- 172.21.15.81:0/2120094150 wait complete. 2024-09-12T01:28:56.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.044+0000 7fac490f3740 20 client.15624 trim_cache size 0 max 16384 2024-09-12T01:28:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.057+0000 7fac490f3740 1 Processor -- start 2024-09-12T01:28:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.057+0000 7fac490f3740 1 -- start start 2024-09-12T01:28:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac490f3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b100f5d0 0x5646b1017000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac490f3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b1010b40 0x5646b1012120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac490f3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b101a370 0x5646b1012660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac490f3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac40199520 con 0x5646b100f5d0 2024-09-12T01:28:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac490f3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac40197310 con 0x5646b1010b40 2024-09-12T01:28:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac490f3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fac40198e50 con 0x5646b101a370 2024-09-12T01:28:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac452b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b101a370 0x5646b1012660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac452b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b101a370 0x5646b1012660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.81:51834/0 (socket says 172.21.15.81:51834) 2024-09-12T01:28:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac452b7640 1 -- 172.21.15.81:0/3685255014 learned_addr learned my addr 172.21.15.81:0/3685255014 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac3ffff640 1 --2- 172.21.15.81:0/3685255014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b1010b40 0x5646b1012120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac44ab6640 1 --2- 172.21.15.81:0/3685255014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b100f5d0 0x5646b1017000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac452b7640 1 -- 172.21.15.81:0/3685255014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b1010b40 msgr2=0x5646b1012120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac452b7640 1 --2- 172.21.15.81:0/3685255014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b1010b40 0x5646b1012120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac452b7640 1 -- 172.21.15.81:0/3685255014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b100f5d0 msgr2=0x5646b1017000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac452b7640 1 --2- 172.21.15.81:0/3685255014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b100f5d0 0x5646b1017000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.058+0000 7fac452b7640 1 -- 172.21.15.81:0/3685255014 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646b100cdd0 con 0x5646b101a370 2024-09-12T01:28:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.059+0000 7fac452b7640 1 --2- 172.21.15.81:0/3685255014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b101a370 0x5646b1012660 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fac3800c8f0 tx=0x7fac3800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=661873f486695325 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.059+0000 7fac2a7fc640 1 -- 172.21.15.81:0/3685255014 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38036070 con 0x5646b101a370 2024-09-12T01:28:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.059+0000 7fac2a7fc640 1 -- 172.21.15.81:0/3685255014 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac38009e70 con 0x5646b101a370 2024-09-12T01:28:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.059+0000 7fac2a7fc640 1 -- 172.21.15.81:0/3685255014 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3801a040 con 0x5646b101a370 2024-09-12T01:28:56.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.060+0000 7fac490f3740 1 -- 172.21.15.81:0/3685255014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b101a370 msgr2=0x5646b1012660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:56.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.060+0000 7fac490f3740 1 --2- 172.21.15.81:0/3685255014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b101a370 0x5646b1012660 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fac3800c8f0 tx=0x7fac3800ce30 comp rx=0 tx=0).stop 2024-09-12T01:28:56.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.060+0000 7fac490f3740 1 -- 172.21.15.81:0/3685255014 shutdown_connections 2024-09-12T01:28:56.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.060+0000 7fac490f3740 1 --2- 172.21.15.81:0/3685255014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b101a370 0x5646b1012660 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.060+0000 7fac490f3740 1 --2- 172.21.15.81:0/3685255014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b1010b40 0x5646b1012120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.060+0000 7fac490f3740 1 --2- 172.21.15.81:0/3685255014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b100f5d0 0x5646b1017000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.060+0000 7fac490f3740 1 -- 172.21.15.81:0/3685255014 >> 172.21.15.81:0/3685255014 conn(0x5646b0fd8310 msgr2=0x5646b10161c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:56.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.060+0000 7fac490f3740 1 -- 172.21.15.81:0/3685255014 shutdown_connections 2024-09-12T01:28:56.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.060+0000 7fac490f3740 1 -- 172.21.15.81:0/3685255014 wait complete. 2024-09-12T01:28:56.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac490f3740 1 -- start start 2024-09-12T01:28:56.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac490f3740 1 Processor -- start 2024-09-12T01:28:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac490f3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b100f5d0 0x5646b1026050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac490f3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b1010b40 0x5646b1026590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac490f3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b101a370 0x5646b1024600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac490f3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac401980b0 con 0x5646b1010b40 2024-09-12T01:28:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac490f3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac401979e0 con 0x5646b101a370 2024-09-12T01:28:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac490f3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fac40198780 con 0x5646b100f5d0 2024-09-12T01:28:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac490f3740 10 client.0 _ll_register_callbacks cb 0x7fac38018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac3ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b1010b40 0x5646b1026590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac3ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b1010b40 0x5646b1026590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59104/0 (socket says 172.21.15.81:59104) 2024-09-12T01:28:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac3ffff640 1 -- 172.21.15.81:0/2056249353 learned_addr learned my addr 172.21.15.81:0/2056249353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac44ab6640 1 --2- 172.21.15.81:0/2056249353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b100f5d0 0x5646b1026050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.061+0000 7fac452b7640 1 --2- 172.21.15.81:0/2056249353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b101a370 0x5646b1024600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.062+0000 7fac3ffff640 1 -- 172.21.15.81:0/2056249353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b100f5d0 msgr2=0x5646b1026050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.062+0000 7fac3ffff640 1 --2- 172.21.15.81:0/2056249353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b100f5d0 0x5646b1026050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.062+0000 7fac3ffff640 1 -- 172.21.15.81:0/2056249353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b101a370 msgr2=0x5646b1024600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.062+0000 7fac3ffff640 1 --2- 172.21.15.81:0/2056249353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b101a370 0x5646b1024600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.062+0000 7fac3ffff640 1 -- 172.21.15.81:0/2056249353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646b1024cc0 con 0x5646b1010b40 2024-09-12T01:28:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.062+0000 7fac3ffff640 1 --2- 172.21.15.81:0/2056249353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b1010b40 0x5646b1026590 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fac2c004770 tx=0x7fac2c09a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4471616bcda17860 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.062+0000 7fac1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.062+0000 7fac1ffff640 1 -- 172.21.15.81:0/2056249353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0b3020 con 0x5646b1010b40 2024-09-12T01:28:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.062+0000 7fac1ffff640 1 -- 172.21.15.81:0/2056249353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fac2c009cc0 con 0x5646b1010b40 2024-09-12T01:28:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.062+0000 7fac490f3740 1 -- 172.21.15.81:0/2056249353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac38009e70 con 0x5646b1010b40 2024-09-12T01:28:56.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.063+0000 7fac1ffff640 1 -- 172.21.15.81:0/2056249353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fac2c0b8050 con 0x5646b1010b40 2024-09-12T01:28:56.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.063+0000 7fac490f3740 10 client.15630 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:56.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.063+0000 7fac490f3740 1 -- 172.21.15.81:0/2056249353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5646b10d81f0 con 0x5646b1010b40 2024-09-12T01:28:56.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.063+0000 7fac1ffff640 1 -- 172.21.15.81:0/2056249353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac38009e70 con 0x5646b1010b40 2024-09-12T01:28:56.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.063+0000 7fac1ffff640 1 -- 172.21.15.81:0/2056249353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fac2c0cbe30 con 0x5646b1010b40 2024-09-12T01:28:56.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.063+0000 7fac490f3740 10 client.15630 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:56.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.063+0000 7fac490f3740 10 client.15630 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:28:56.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.063+0000 7fac490f3740 20 client.15630 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:56.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.063+0000 7fac490f3740 1 --2- 172.21.15.81:0/2056249353 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5646b10d8990 0x5646b10dadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:56.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.063+0000 7fac490f3740 4 client.15630 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:28:56.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.063+0000 7fac490f3740 1 -- 172.21.15.81:0/2056249353 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5646b0f7cd70 con 0x5646b10d8990 2024-09-12T01:28:56.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac44ab6640 1 --2- 172.21.15.81:0/2056249353 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5646b10d8990 0x5646b10dadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac1ffff640 10 client.15630 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac44ab6640 1 --2- 172.21.15.81:0/2056249353 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5646b10d8990 0x5646b10dadb0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2eaf1581169ded79 server_cookie=5a18785c10ab419b in_seq=0 out_seq=0 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac1ffff640 1 -- 172.21.15.81:0/2056249353 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5646b0f7cd70 con 0x5646b10d8990 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac1ffff640 10 client.15630 handle_command_reply: tid=0 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac490f3740 1 client.15630 shutdown 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac490f3740 1 -- 172.21.15.81:0/2056249353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b1010b40 msgr2=0x5646b1026590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac490f3740 1 --2- 172.21.15.81:0/2056249353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b1010b40 0x5646b1026590 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fac2c004770 tx=0x7fac2c09a2f0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac490f3740 1 -- 172.21.15.81:0/2056249353 shutdown_connections 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac490f3740 1 --2- 172.21.15.81:0/2056249353 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5646b10d8990 0x5646b10dadb0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac1ffff640 0 client.15630 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac490f3740 1 --2- 172.21.15.81:0/2056249353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5646b101a370 0x5646b1024600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac490f3740 1 --2- 172.21.15.81:0/2056249353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646b1010b40 0x5646b1026590 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac490f3740 1 --2- 172.21.15.81:0/2056249353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5646b100f5d0 0x5646b1026050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.064+0000 7fac490f3740 1 -- 172.21.15.81:0/2056249353 >> 172.21.15.81:0/2056249353 conn(0x5646b0fd8310 msgr2=0x5646b1018930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:56.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.065+0000 7fac490f3740 1 -- 172.21.15.81:0/2056249353 shutdown_connections 2024-09-12T01:28:56.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.065+0000 7fac490f3740 1 -- 172.21.15.81:0/2056249353 wait complete. 2024-09-12T01:28:56.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.065+0000 7fac490f3740 20 client.15630 trim_cache size 0 max 16384 2024-09-12T01:28:56.068 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:28:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.066+0000 7fac46d1a640 1 -- 172.21.15.81:0/3040733261 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fac300a2e00 msgr2=0x7fac300a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.066+0000 7fac46d1a640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fac300a2e00 0x7fac300a52c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac3402c9f0 tx=0x7fac34005a20 comp rx=0 tx=0).stop 2024-09-12T01:28:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.066+0000 7fac46d1a640 1 -- 172.21.15.81:0/3040733261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac40102570 msgr2=0x7fac401a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.066+0000 7fac46d1a640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac40102570 0x7fac401a4d00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00d720 tx=0x7fac2c00dbe0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.066+0000 7fac46d1a640 1 -- 172.21.15.81:0/3040733261 shutdown_connections 2024-09-12T01:28:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.066+0000 7fac46d1a640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fac300a2e00 0x7fac300a52c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.066+0000 7fac46d1a640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac40102ef0 0x7fac4019e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.066+0000 7fac46d1a640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac40102570 0x7fac401a4d00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.066+0000 7fac46d1a640 1 --2- 172.21.15.81:0/3040733261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac40100e20 0x7fac401a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.066+0000 7fac46d1a640 1 -- 172.21.15.81:0/3040733261 >> 172.21.15.81:0/3040733261 conn(0x7fac400fc7d0 msgr2=0x7fac400fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.066+0000 7fac46d1a640 1 -- 172.21.15.81:0/3040733261 shutdown_connections 2024-09-12T01:28:56.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:56.066+0000 7fac46d1a640 1 -- 172.21.15.81:0/3040733261 wait complete. 2024-09-12T01:28:56.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:56 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/365840900' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:56.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:56 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/365840900' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:56.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:56 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/365840900' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:28:56.908 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:28:57.291 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-12T01:28:57.291 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-12T01:28:57.382 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:57.513 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:57 smithi081 ceph-mon[30920]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:28:57.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:57 smithi100 ceph-mon[35275]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:28:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:57 smithi189 ceph-mon[35357]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:28:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.931+0000 7f6e02710640 1 -- 172.21.15.81:0/1927780300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dfc102570 msgr2=0x7f6dfc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.931+0000 7f6e02710640 1 --2- 172.21.15.81:0/1927780300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dfc102570 0x7f6dfc1029b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009900 tx=0x7f6df002a480 comp rx=0 tx=0).stop 2024-09-12T01:28:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.931+0000 7f6e02710640 1 -- 172.21.15.81:0/1927780300 shutdown_connections 2024-09-12T01:28:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.932+0000 7f6e02710640 1 --2- 172.21.15.81:0/1927780300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc102ef0 0x7f6dfc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.932+0000 7f6e02710640 1 --2- 172.21.15.81:0/1927780300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dfc102570 0x7f6dfc1029b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.932+0000 7f6e02710640 1 --2- 172.21.15.81:0/1927780300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6dfc100e20 0x7f6dfc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.932+0000 7f6e02710640 1 -- 172.21.15.81:0/1927780300 >> 172.21.15.81:0/1927780300 conn(0x7f6dfc0fc7d0 msgr2=0x7f6dfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.932+0000 7f6e02710640 1 -- 172.21.15.81:0/1927780300 shutdown_connections 2024-09-12T01:28:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.932+0000 7f6e02710640 1 -- 172.21.15.81:0/1927780300 wait complete. 2024-09-12T01:28:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.932+0000 7f6e02710640 1 Processor -- start 2024-09-12T01:28:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.933+0000 7f6e02710640 1 -- start start 2024-09-12T01:28:57.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.933+0000 7f6e02710640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc100e20 0x7f6dfc1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.933+0000 7f6e02710640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6dfc102570 0x7f6dfc1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.933+0000 7f6e02710640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dfc102ef0 0x7f6dfc1a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.933+0000 7f6e02710640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc110f50 con 0x7f6dfc102ef0 2024-09-12T01:28:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.933+0000 7f6e02710640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc110dd0 con 0x7f6dfc100e20 2024-09-12T01:28:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.933+0000 7f6e02710640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc1110d0 con 0x7f6dfc102570 2024-09-12T01:28:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.933+0000 7f6e00cad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dfc102ef0 0x7f6dfc1a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.933+0000 7f6e00cad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dfc102ef0 0x7f6dfc1a4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59114/0 (socket says 172.21.15.81:59114) 2024-09-12T01:28:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.933+0000 7f6e00cad640 1 -- 172.21.15.81:0/315002771 learned_addr learned my addr 172.21.15.81:0/315002771 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.933+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc100e20 0x7f6dfc1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.933+0000 7f6dfb7fe640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6dfc102570 0x7f6dfc1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.934+0000 7f6e00cad640 1 -- 172.21.15.81:0/315002771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6dfc102570 msgr2=0x7f6dfc1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.934+0000 7f6e00cad640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6dfc102570 0x7f6dfc1998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.934+0000 7f6e00cad640 1 -- 172.21.15.81:0/315002771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc100e20 msgr2=0x7f6dfc1993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.934+0000 7f6e00cad640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc100e20 0x7f6dfc1993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.934+0000 7f6e00cad640 1 -- 172.21.15.81:0/315002771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc1a4960 con 0x7f6dfc102ef0 2024-09-12T01:28:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.934+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc100e20 0x7f6dfc1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.934+0000 7f6e00cad640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dfc102ef0 0x7f6dfc1a4420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6df400eaa0 tx=0x7f6df400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.934+0000 7f6df97fa640 1 -- 172.21.15.81:0/315002771 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df400cdb0 con 0x7f6dfc102ef0 2024-09-12T01:28:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.934+0000 7f6df97fa640 1 -- 172.21.15.81:0/315002771 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6df4005020 con 0x7f6dfc102ef0 2024-09-12T01:28:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.934+0000 7f6df97fa640 1 -- 172.21.15.81:0/315002771 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df40116b0 con 0x7f6dfc102ef0 2024-09-12T01:28:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.934+0000 7f6e02710640 1 -- 172.21.15.81:0/315002771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dfc1a4b30 con 0x7f6dfc102ef0 2024-09-12T01:28:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.934+0000 7f6e02710640 1 -- 172.21.15.81:0/315002771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dfc1a4ff0 con 0x7f6dfc102ef0 2024-09-12T01:28:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.937+0000 7f6e04ae9740 1 Processor -- start 2024-09-12T01:28:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.937+0000 7f6df97fa640 1 -- 172.21.15.81:0/315002771 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f6df4005560 con 0x7f6dfc102ef0 2024-09-12T01:28:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.937+0000 7f6e04ae9740 1 -- start start 2024-09-12T01:28:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6e04ae9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b6b40 0x5573f22b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6e04ae9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 0x5573f22b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6e04ae9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 0x5573f22c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6e04ae9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5573f221b2f0 con 0x5573f22c0370 2024-09-12T01:28:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6e04ae9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5573f21c2cf0 con 0x5573f22b55d0 2024-09-12T01:28:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6e04ae9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5573f22172b0 con 0x5573f22b6b40 2024-09-12T01:28:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6dfb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 0x5573f22c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 0x5573f22b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6dfb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 0x5573f22c2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59124/0 (socket says 172.21.15.81:59124) 2024-09-12T01:28:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6dfb7fe640 1 -- 172.21.15.81:0/4190457052 learned_addr learned my addr 172.21.15.81:0/4190457052 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6df97fa640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6de40a2d80 0x7f6de40a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6e00cad640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6de40a2d80 0x7f6de40a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6dfbfff640 1 -- 172.21.15.81:0/4190457052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b6b40 msgr2=0x5573f22b5090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/4190457052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b6b40 0x5573f22b5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6dfbfff640 1 -- 172.21.15.81:0/4190457052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 msgr2=0x5573f22c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/4190457052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 0x5573f22c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6df97fa640 1 -- 172.21.15.81:0/315002771 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f6df40cf720 con 0x7f6dfc102ef0 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6dfbfff640 1 -- 172.21.15.81:0/4190457052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573f21a73a0 con 0x5573f22b55d0 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.938+0000 7f6dfb7fe640 1 --2- 172.21.15.81:0/4190457052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 0x5573f22c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.939+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/4190457052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 0x5573f22b5a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009fd0 tx=0x7f6dec0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26c1f7b175d218dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.939+0000 7f6e00cad640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6de40a2d80 0x7f6de40a5240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6df40cce40 tx=0x7f6df4091040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.939+0000 7f6de27fc640 1 -- 172.21.15.81:0/4190457052 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec004030 con 0x5573f22b55d0 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.939+0000 7f6de27fc640 1 -- 172.21.15.81:0/4190457052 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dec005500 con 0x5573f22b55d0 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.939+0000 7f6de27fc640 1 -- 172.21.15.81:0/4190457052 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec004e10 con 0x5573f22b55d0 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.940+0000 7f6e04ae9740 1 -- 172.21.15.81:0/4190457052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 msgr2=0x5573f22b5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.940+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/4190457052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 0x5573f22b5a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009fd0 tx=0x7f6dec0118d0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.940+0000 7f6e04ae9740 1 -- 172.21.15.81:0/4190457052 shutdown_connections 2024-09-12T01:28:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.940+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/4190457052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 0x5573f22c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.940+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/4190457052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 0x5573f22b5a10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.940+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/4190457052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b6b40 0x5573f22b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.940+0000 7f6e04ae9740 1 -- 172.21.15.81:0/4190457052 >> 172.21.15.81:0/4190457052 conn(0x5573f227e310 msgr2=0x5573f22b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.940+0000 7f6e04ae9740 1 -- 172.21.15.81:0/4190457052 shutdown_connections 2024-09-12T01:28:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.940+0000 7f6e04ae9740 1 -- 172.21.15.81:0/4190457052 wait complete. 2024-09-12T01:28:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.941+0000 7f6e04ae9740 1 -- start start 2024-09-12T01:28:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.941+0000 7f6e04ae9740 1 Processor -- start 2024-09-12T01:28:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.941+0000 7f6e04ae9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b55d0 0x5573f22bfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.941+0000 7f6e04ae9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b6b40 0x5573f22bcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.941+0000 7f6e04ae9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22c0370 0x5573f22bd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.941+0000 7f6e04ae9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5573f22c7480 con 0x5573f22b6b40 2024-09-12T01:28:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b6b40 0x5573f22bcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b6b40 0x5573f22bcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59134/0 (socket says 172.21.15.81:59134) 2024-09-12T01:28:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6dfbfff640 1 -- 172.21.15.81:0/3552137972 learned_addr learned my addr 172.21.15.81:0/3552137972 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6dfb7fe640 1 --2- 172.21.15.81:0/3552137972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b55d0 0x5573f22bfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6e04ae9740 1 -- 172.21.15.81:0/3552137972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5573f21d6060 con 0x5573f22c0370 2024-09-12T01:28:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6e04ae9740 1 -- 172.21.15.81:0/3552137972 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5573f22c7600 con 0x5573f22b55d0 2024-09-12T01:28:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6dfb7fe640 1 --2- 172.21.15.81:0/3552137972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22c0370 0x5573f22bd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6e04ae9740 10 client.0 _ll_register_callbacks cb 0x5573f1f298c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6dfbfff640 1 -- 172.21.15.81:0/3552137972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b55d0 msgr2=0x5573f22bfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/3552137972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b55d0 0x5573f22bfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6dfbfff640 1 -- 172.21.15.81:0/3552137972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22c0370 msgr2=0x5573f22bd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:57.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/3552137972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22c0370 0x5573f22bd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6dfbfff640 1 -- 172.21.15.81:0/3552137972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573f1f8c3c0 con 0x5573f22b6b40 2024-09-12T01:28:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/3552137972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b6b40 0x5573f22bcfd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6dec01b040 tx=0x7f6dec004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a25360fb96d441a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6ddb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.942+0000 7f6ddb7fe640 1 -- 172.21.15.81:0/3552137972 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec028020 con 0x5573f22b6b40 2024-09-12T01:28:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.943+0000 7f6ddb7fe640 1 -- 172.21.15.81:0/3552137972 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f6dec016040 con 0x5573f22b6b40 2024-09-12T01:28:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.943+0000 7f6e04ae9740 1 -- 172.21.15.81:0/3552137972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dec005500 con 0x5573f22b6b40 2024-09-12T01:28:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.943+0000 7f6ddb7fe640 1 -- 172.21.15.81:0/3552137972 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6dec033050 con 0x5573f22b6b40 2024-09-12T01:28:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.943+0000 7f6e04ae9740 10 client.15642 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.943+0000 7f6e04ae9740 1 -- 172.21.15.81:0/3552137972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5573f22d2ec0 con 0x5573f22b6b40 2024-09-12T01:28:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.943+0000 7f6ddb7fe640 1 -- 172.21.15.81:0/3552137972 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dec005500 con 0x5573f22b6b40 2024-09-12T01:28:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.944+0000 7f6ddb7fe640 1 -- 172.21.15.81:0/3552137972 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6dec003ad0 con 0x5573f22b6b40 2024-09-12T01:28:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.944+0000 7f6e04ae9740 10 client.15642 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.944+0000 7f6e04ae9740 10 client.15642 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:28:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.944+0000 7f6e04ae9740 20 client.15642 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.944+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/3552137972 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5573f22d4320 0x5573f22d6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.944+0000 7f6e04ae9740 4 client.15642 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.944+0000 7f6e04ae9740 1 -- 172.21.15.81:0/3552137972 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573f2228860 con 0x5573f22d4320 2024-09-12T01:28:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.944+0000 7f6dfb7fe640 1 --2- 172.21.15.81:0/3552137972 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5573f22d4320 0x5573f22d6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.945+0000 7f6ddb7fe640 10 client.15642 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:28:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.945+0000 7f6dfb7fe640 1 --2- 172.21.15.81:0/3552137972 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5573f22d4320 0x5573f22d6710 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=115746ebac855603 server_cookie=3481d1b49bd6b4d5 in_seq=0 out_seq=0 2024-09-12T01:28:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6ddb7fe640 1 -- 172.21.15.81:0/3552137972 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573f2228860 con 0x5573f22d4320 2024-09-12T01:28:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6ddb7fe640 10 client.15642 handle_command_reply: tid=0 2024-09-12T01:28:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6e04ae9740 1 client.15642 shutdown 2024-09-12T01:28:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6e04ae9740 1 -- 172.21.15.81:0/3552137972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b6b40 msgr2=0x5573f22bcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/3552137972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b6b40 0x5573f22bcfd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6dec01b040 tx=0x7f6dec004dc0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6e04ae9740 1 -- 172.21.15.81:0/3552137972 shutdown_connections 2024-09-12T01:28:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/3552137972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22c0370 0x5573f22bd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/3552137972 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5573f22d4320 0x5573f22d6710 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/3552137972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b6b40 0x5573f22bcfd0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/3552137972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b55d0 0x5573f22bfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6e04ae9740 1 -- 172.21.15.81:0/3552137972 >> 172.21.15.81:0/3552137972 conn(0x5573f227e310 msgr2=0x5573f22b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6ddb7fe640 0 client.15642 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:28:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6e04ae9740 1 -- 172.21.15.81:0/3552137972 shutdown_connections 2024-09-12T01:28:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6e04ae9740 1 -- 172.21.15.81:0/3552137972 wait complete. 2024-09-12T01:28:57.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.946+0000 7f6e04ae9740 20 client.15642 trim_cache size 0 max 16384 2024-09-12T01:28:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.970+0000 7f6e04ae9740 1 Processor -- start 2024-09-12T01:28:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.970+0000 7f6e04ae9740 1 -- start start 2024-09-12T01:28:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6e04ae9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 0x5573f22bb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6e04ae9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 0x5573f22b8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6e04ae9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b8660 0x5573f22dbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6e04ae9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc1ab530 con 0x5573f22c0370 2024-09-12T01:28:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6e04ae9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc1ad070 con 0x5573f22b55d0 2024-09-12T01:28:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6e04ae9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc1abc00 con 0x5573f22b8660 2024-09-12T01:28:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 0x5573f22b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 0x5573f22b8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59144/0 (socket says 172.21.15.81:59144) 2024-09-12T01:28:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6dfbfff640 1 -- 172.21.15.81:0/1700486276 learned_addr learned my addr 172.21.15.81:0/1700486276 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6dfb7fe640 1 --2- 172.21.15.81:0/1700486276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b8660 0x5573f22dbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6dfb7fe640 1 --2- 172.21.15.81:0/1700486276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 0x5573f22bb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6dfbfff640 1 -- 172.21.15.81:0/1700486276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b8660 msgr2=0x5573f22dbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/1700486276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b8660 0x5573f22dbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6dfbfff640 1 -- 172.21.15.81:0/1700486276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 msgr2=0x5573f22bb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/1700486276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 0x5573f22bb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.971+0000 7f6dfbfff640 1 -- 172.21.15.81:0/1700486276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573f22bd8e0 con 0x5573f22c0370 2024-09-12T01:28:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.972+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/1700486276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 0x5573f22b8120 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6dec003ec0 tx=0x7f6dec004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fb3705bfc9619d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.972+0000 7f6de1ffb640 1 -- 172.21.15.81:0/1700486276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec028070 con 0x5573f22c0370 2024-09-12T01:28:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.972+0000 7f6de1ffb640 1 -- 172.21.15.81:0/1700486276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dec009b50 con 0x5573f22c0370 2024-09-12T01:28:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.972+0000 7f6de1ffb640 1 -- 172.21.15.81:0/1700486276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0054d0 con 0x5573f22c0370 2024-09-12T01:28:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.973+0000 7f6e04ae9740 1 -- 172.21.15.81:0/1700486276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 msgr2=0x5573f22b8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.973+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/1700486276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 0x5573f22b8120 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6dec003ec0 tx=0x7f6dec004d20 comp rx=0 tx=0).stop 2024-09-12T01:28:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.973+0000 7f6e04ae9740 1 -- 172.21.15.81:0/1700486276 shutdown_connections 2024-09-12T01:28:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.973+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/1700486276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22b8660 0x5573f22dbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.973+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/1700486276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22c0370 0x5573f22b8120 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.973+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/1700486276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 0x5573f22bb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.973+0000 7f6e04ae9740 1 -- 172.21.15.81:0/1700486276 >> 172.21.15.81:0/1700486276 conn(0x5573f227e310 msgr2=0x5573f22b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:57.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.973+0000 7f6e04ae9740 1 -- 172.21.15.81:0/1700486276 shutdown_connections 2024-09-12T01:28:57.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.973+0000 7f6e04ae9740 1 -- 172.21.15.81:0/1700486276 wait complete. 2024-09-12T01:28:57.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.974+0000 7f6e04ae9740 1 -- start start 2024-09-12T01:28:57.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.974+0000 7f6e04ae9740 1 Processor -- start 2024-09-12T01:28:57.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.974+0000 7f6e04ae9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 0x5573f22cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.974+0000 7f6e04ae9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b8660 0x5573f22cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.974+0000 7f6e04ae9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22c0370 0x5573f22c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.974+0000 7f6e04ae9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc1ac9a0 con 0x5573f22b8660 2024-09-12T01:28:57.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.974+0000 7f6e04ae9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc1ac2d0 con 0x5573f22b55d0 2024-09-12T01:28:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.974+0000 7f6e04ae9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc1a95c0 con 0x5573f22c0370 2024-09-12T01:28:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.974+0000 7f6e04ae9740 10 client.0 _ll_register_callbacks cb 0x7f6df0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.974+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b8660 0x5573f22cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.974+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b8660 0x5573f22cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59154/0 (socket says 172.21.15.81:59154) 2024-09-12T01:28:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.974+0000 7f6dfbfff640 1 -- 172.21.15.81:0/2573536325 learned_addr learned my addr 172.21.15.81:0/2573536325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.975+0000 7f6dfb7fe640 1 --2- 172.21.15.81:0/2573536325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 0x5573f22cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.975+0000 7f6dfb7fe640 1 --2- 172.21.15.81:0/2573536325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22c0370 0x5573f22c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.975+0000 7f6dfbfff640 1 -- 172.21.15.81:0/2573536325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22c0370 msgr2=0x5573f22c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.975+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/2573536325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22c0370 0x5573f22c4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.975+0000 7f6dfbfff640 1 -- 172.21.15.81:0/2573536325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 msgr2=0x5573f22cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.975+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/2573536325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 0x5573f22cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.975+0000 7f6dfbfff640 1 -- 172.21.15.81:0/2573536325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573f22c7140 con 0x5573f22b8660 2024-09-12T01:28:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.975+0000 7f6dfbfff640 1 --2- 172.21.15.81:0/2573536325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b8660 0x5573f22cce00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6dec011910 tx=0x7f6dec005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55e914c31b29ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:57.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.975+0000 7f6ddb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:57.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.975+0000 7f6ddb7fe640 1 -- 172.21.15.81:0/2573536325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec028070 con 0x5573f22b8660 2024-09-12T01:28:57.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.975+0000 7f6ddb7fe640 1 -- 172.21.15.81:0/2573536325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f6dec00f5a0 con 0x5573f22b8660 2024-09-12T01:28:57.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.975+0000 7f6e04ae9740 1 -- 172.21.15.81:0/2573536325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dec009b50 con 0x5573f22b8660 2024-09-12T01:28:57.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.977+0000 7f6ddb7fe640 1 -- 172.21.15.81:0/2573536325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6dec047050 con 0x5573f22b8660 2024-09-12T01:28:57.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.977+0000 7f6e04ae9740 10 client.15648 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:57.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.977+0000 7f6e04ae9740 1 -- 172.21.15.81:0/2573536325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5573f233b2e0 con 0x5573f22b8660 2024-09-12T01:28:57.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.977+0000 7f6ddb7fe640 1 -- 172.21.15.81:0/2573536325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dec009b50 con 0x5573f22b8660 2024-09-12T01:28:57.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.977+0000 7f6ddb7fe640 1 -- 172.21.15.81:0/2573536325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6dec003830 con 0x5573f22b8660 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.977+0000 7f6e04ae9740 10 client.15648 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.977+0000 7f6e04ae9740 10 client.15648 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.977+0000 7f6e04ae9740 20 client.15648 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.977+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/2573536325 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5573f233b990 0x5573f233ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.977+0000 7f6e04ae9740 4 client.15648 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.977+0000 7f6e04ae9740 1 -- 172.21.15.81:0/2573536325 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5573f2222d70 con 0x5573f233b990 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.977+0000 7f6dfb7fe640 1 --2- 172.21.15.81:0/2573536325 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5573f233b990 0x5573f233ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.978+0000 7f6dfb7fe640 1 --2- 172.21.15.81:0/2573536325 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5573f233b990 0x5573f233ddb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9670056a4f297624 server_cookie=1b5beaa271a35830 in_seq=0 out_seq=0 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.978+0000 7f6ddb7fe640 10 client.15648 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.978+0000 7f6ddb7fe640 1 -- 172.21.15.81:0/2573536325 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5573f2222d70 con 0x5573f233b990 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.978+0000 7f6ddb7fe640 10 client.15648 handle_command_reply: tid=0 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.978+0000 7f6e04ae9740 1 client.15648 shutdown 2024-09-12T01:28:57.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.978+0000 7f6e04ae9740 1 -- 172.21.15.81:0/2573536325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b8660 msgr2=0x5573f22cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:57.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.978+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/2573536325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b8660 0x5573f22cce00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6dec011910 tx=0x7f6dec005da0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.979+0000 7f6e04ae9740 1 -- 172.21.15.81:0/2573536325 shutdown_connections 2024-09-12T01:28:57.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.979+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/2573536325 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5573f22c0370 0x5573f22c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.979+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/2573536325 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5573f233b990 0x5573f233ddb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.979+0000 7f6ddb7fe640 0 client.15648 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:28:57.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.979+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/2573536325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573f22b8660 0x5573f22cce00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.979+0000 7f6e04ae9740 1 --2- 172.21.15.81:0/2573536325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5573f22b55d0 0x5573f22cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.979+0000 7f6e04ae9740 1 -- 172.21.15.81:0/2573536325 >> 172.21.15.81:0/2573536325 conn(0x5573f227e310 msgr2=0x5573f22be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:57.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.979+0000 7f6e04ae9740 1 -- 172.21.15.81:0/2573536325 shutdown_connections 2024-09-12T01:28:57.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.979+0000 7f6e04ae9740 1 -- 172.21.15.81:0/2573536325 wait complete. 2024-09-12T01:28:57.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.979+0000 7f6e04ae9740 20 client.15648 trim_cache size 0 max 16384 2024-09-12T01:28:57.984 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:28:57.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.980+0000 7f6e02710640 1 -- 172.21.15.81:0/315002771 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6de40a2d80 msgr2=0x7f6de40a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:57.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.980+0000 7f6e02710640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6de40a2d80 0x7f6de40a5240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6df40cce40 tx=0x7f6df4091040 comp rx=0 tx=0).stop 2024-09-12T01:28:57.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.980+0000 7f6e02710640 1 -- 172.21.15.81:0/315002771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dfc102ef0 msgr2=0x7f6dfc1a4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:57.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.980+0000 7f6e02710640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dfc102ef0 0x7f6dfc1a4420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6df400eaa0 tx=0x7f6df400ef60 comp rx=0 tx=0).stop 2024-09-12T01:28:57.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.980+0000 7f6e02710640 1 -- 172.21.15.81:0/315002771 shutdown_connections 2024-09-12T01:28:57.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.980+0000 7f6e02710640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6de40a2d80 0x7f6de40a5240 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.980+0000 7f6e02710640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dfc102ef0 0x7f6dfc1a4420 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.980+0000 7f6e02710640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6dfc102570 0x7f6dfc1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.980+0000 7f6e02710640 1 --2- 172.21.15.81:0/315002771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc100e20 0x7f6dfc1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:57.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.980+0000 7f6e02710640 1 -- 172.21.15.81:0/315002771 >> 172.21.15.81:0/315002771 conn(0x7f6dfc0fc7d0 msgr2=0x7f6dfc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:57.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.980+0000 7f6e02710640 1 -- 172.21.15.81:0/315002771 shutdown_connections 2024-09-12T01:28:57.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:57.980+0000 7f6e02710640 1 -- 172.21.15.81:0/315002771 wait complete. 2024-09-12T01:28:58.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:28:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:59.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.236+0000 7f97f0ed0640 1 -- 172.21.15.81:0/2344626712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97ec102570 msgr2=0x7f97ec1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.236+0000 7f97f0ed0640 1 --2- 172.21.15.81:0/2344626712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97ec102570 0x7f97ec1029b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009900 tx=0x7f97e002a480 comp rx=0 tx=0).stop 2024-09-12T01:28:59.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.237+0000 7f97f0ed0640 1 -- 172.21.15.81:0/2344626712 shutdown_connections 2024-09-12T01:28:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.237+0000 7f97f0ed0640 1 --2- 172.21.15.81:0/2344626712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ec102ef0 0x7f97ec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.237+0000 7f97f0ed0640 1 --2- 172.21.15.81:0/2344626712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97ec102570 0x7f97ec1029b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.237+0000 7f97f0ed0640 1 --2- 172.21.15.81:0/2344626712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97ec100e20 0x7f97ec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.237+0000 7f97f0ed0640 1 -- 172.21.15.81:0/2344626712 >> 172.21.15.81:0/2344626712 conn(0x7f97ec0fc7d0 msgr2=0x7f97ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.238+0000 7f97f0ed0640 1 -- 172.21.15.81:0/2344626712 shutdown_connections 2024-09-12T01:28:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.238+0000 7f97f0ed0640 1 -- 172.21.15.81:0/2344626712 wait complete. 2024-09-12T01:28:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.239+0000 7f97f0ed0640 1 Processor -- start 2024-09-12T01:28:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.239+0000 7f97f0ed0640 1 -- start start 2024-09-12T01:28:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97f0ed0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97ec100e20 0x7f97ec197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97f0ed0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97ec102570 0x7f97ec1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97f0ed0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ec102ef0 0x7f97ec19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97f0ed0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec110f80 con 0x7f97ec102570 2024-09-12T01:28:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97f0ed0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec110e00 con 0x7f97ec102ef0 2024-09-12T01:28:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97f0ed0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec111100 con 0x7f97ec100e20 2024-09-12T01:28:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97e9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97ec102570 0x7f97ec1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97e9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97ec102570 0x7f97ec1978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59174/0 (socket says 172.21.15.81:59174) 2024-09-12T01:28:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97e9d9b640 1 -- 172.21.15.81:0/1747539625 learned_addr learned my addr 172.21.15.81:0/1747539625 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97ea59c640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97ec100e20 0x7f97ec197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97ead9d640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ec102ef0 0x7f97ec19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97e9d9b640 1 -- 172.21.15.81:0/1747539625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97ec100e20 msgr2=0x7f97ec197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97ec100e20 0x7f97ec197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97e9d9b640 1 -- 172.21.15.81:0/1747539625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ec102ef0 msgr2=0x7f97ec19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.240+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ec102ef0 0x7f97ec19bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.241+0000 7f97e9d9b640 1 -- 172.21.15.81:0/1747539625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ec19c350 con 0x7f97ec102570 2024-09-12T01:28:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.241+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97ec102570 0x7f97ec1978c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f97e0006010 tx=0x7f97e0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.241+0000 7f97db7fe640 1 -- 172.21.15.81:0/1747539625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e003f070 con 0x7f97ec102570 2024-09-12T01:28:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.241+0000 7f97db7fe640 1 -- 172.21.15.81:0/1747539625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97e0031c30 con 0x7f97ec102570 2024-09-12T01:28:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.242+0000 7f97db7fe640 1 -- 172.21.15.81:0/1747539625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0035030 con 0x7f97ec102570 2024-09-12T01:28:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.242+0000 7f97f0ed0640 1 -- 172.21.15.81:0/1747539625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ec19c5e0 con 0x7f97ec102570 2024-09-12T01:28:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.242+0000 7f97f0ed0640 1 -- 172.21.15.81:0/1747539625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ec19ca70 con 0x7f97ec102570 2024-09-12T01:28:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.245+0000 7f97db7fe640 1 -- 172.21.15.81:0/1747539625 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f97e0042070 con 0x7f97ec102570 2024-09-12T01:28:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.246+0000 7f97f32a9740 1 Processor -- start 2024-09-12T01:28:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.246+0000 7f97f32a9740 1 -- start start 2024-09-12T01:28:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.246+0000 7f97f32a9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 0x55b795295a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.246+0000 7f97f32a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295f80 0x55b7952a4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.246+0000 7f97f32a9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7952a4d50 0x55b7952a7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.246+0000 7f97f32a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7951fb2a0 con 0x55b795295f80 2024-09-12T01:28:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.246+0000 7f97f32a9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7951a2b10 con 0x55b7952a4d50 2024-09-12T01:28:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.246+0000 7f97f32a9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7951f7260 con 0x55b795295660 2024-09-12T01:28:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.247+0000 7f97e9d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7952a4d50 0x55b7952a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.247+0000 7f97ea59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295f80 0x55b7952a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.247+0000 7f97e9d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7952a4d50 0x55b7952a7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:49538/0 (socket says 172.21.15.81:49538) 2024-09-12T01:28:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.247+0000 7f97e9d9b640 1 -- 172.21.15.81:0/2189811724 learned_addr learned my addr 172.21.15.81:0/2189811724 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:59.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.247+0000 7f97ead9d640 1 --2- 172.21.15.81:0/2189811724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 0x55b795295a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.248+0000 7f97db7fe640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f97d40a2e00 0x7f97d40a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.248+0000 7f97e9d9b640 1 -- 172.21.15.81:0/2189811724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 msgr2=0x55b795295a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.248+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/2189811724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 0x55b795295a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.248+0000 7f97e9d9b640 1 -- 172.21.15.81:0/2189811724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295f80 msgr2=0x55b7952a4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.248+0000 7f97ead9d640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f97d40a2e00 0x7f97d40a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.248+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/2189811724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295f80 0x55b7952a4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.248+0000 7f97e9d9b640 1 -- 172.21.15.81:0/2189811724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b794f6cb90 con 0x55b7952a4d50 2024-09-12T01:28:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.248+0000 7f97ea59c640 1 --2- 172.21.15.81:0/2189811724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295f80 0x55b7952a4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.249+0000 7f97ead9d640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f97d40a2e00 0x7f97d40a52c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97e4005fd0 tx=0x7f97e4014040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.249+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/2189811724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7952a4d50 0x55b7952a7140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f97e00ed0e0 tx=0x7f97e0086b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea49bda3f55f7fdd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.249+0000 7f97db7fe640 1 -- 172.21.15.81:0/1747539625 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f97e00efb10 con 0x7f97ec102570 2024-09-12T01:28:59.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.249+0000 7f97d8ff9640 1 -- 172.21.15.81:0/2189811724 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e00bba80 con 0x55b7952a4d50 2024-09-12T01:28:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.250+0000 7f97d8ff9640 1 -- 172.21.15.81:0/2189811724 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97e00f7040 con 0x55b7952a4d50 2024-09-12T01:28:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.250+0000 7f97d8ff9640 1 -- 172.21.15.81:0/2189811724 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e00bb8a0 con 0x55b7952a4d50 2024-09-12T01:28:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.250+0000 7f97f32a9740 1 -- 172.21.15.81:0/2189811724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7952a4d50 msgr2=0x55b7952a7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.250+0000 7f97f32a9740 1 --2- 172.21.15.81:0/2189811724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7952a4d50 0x55b7952a7140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f97e00ed0e0 tx=0x7f97e0086b70 comp rx=0 tx=0).stop 2024-09-12T01:28:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.251+0000 7f97f32a9740 1 -- 172.21.15.81:0/2189811724 shutdown_connections 2024-09-12T01:28:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.251+0000 7f97f32a9740 1 --2- 172.21.15.81:0/2189811724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7952a4d50 0x55b7952a7140 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.251+0000 7f97f32a9740 1 --2- 172.21.15.81:0/2189811724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295f80 0x55b7952a4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.251+0000 7f97f32a9740 1 --2- 172.21.15.81:0/2189811724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 0x55b795295a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.251+0000 7f97f32a9740 1 -- 172.21.15.81:0/2189811724 >> 172.21.15.81:0/2189811724 conn(0x55b795291cf0 msgr2=0x55b7952920d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.251+0000 7f97f32a9740 1 -- 172.21.15.81:0/2189811724 shutdown_connections 2024-09-12T01:28:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.251+0000 7f97f32a9740 1 -- 172.21.15.81:0/2189811724 wait complete. 2024-09-12T01:28:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.251+0000 7f97f32a9740 1 -- start start 2024-09-12T01:28:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.251+0000 7f97f32a9740 1 Processor -- start 2024-09-12T01:28:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.252+0000 7f97f32a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295660 0x55b7952a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.252+0000 7f97f32a9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b795295f80 0x55b7952a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.252+0000 7f97f32a9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7952a4d50 0x55b7952a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.252+0000 7f97f32a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7952a7740 con 0x55b795295660 2024-09-12T01:28:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.252+0000 7f97f32a9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7951836e0 con 0x55b795295f80 2024-09-12T01:28:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.252+0000 7f97f32a9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7952a78c0 con 0x55b7952a4d50 2024-09-12T01:28:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.252+0000 7f97f32a9740 10 client.0 _ll_register_callbacks cb 0x55b7951a7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.252+0000 7f97ea59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295660 0x55b7952a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.252+0000 7f97ea59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295660 0x55b7952a1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59186/0 (socket says 172.21.15.81:59186) 2024-09-12T01:28:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.252+0000 7f97ea59c640 1 -- 172.21.15.81:0/3754382380 learned_addr learned my addr 172.21.15.81:0/3754382380 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.252+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b795295f80 0x55b7952a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.252+0000 7f97ead9d640 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7952a4d50 0x55b7952a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.253+0000 7f97e9d9b640 1 -- 172.21.15.81:0/3754382380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7952a4d50 msgr2=0x55b7952a27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.253+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7952a4d50 0x55b7952a27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.253+0000 7f97e9d9b640 1 -- 172.21.15.81:0/3754382380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295660 msgr2=0x55b7952a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.253+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295660 0x55b7952a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.253+0000 7f97e9d9b640 1 -- 172.21.15.81:0/3754382380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7952b0cb0 con 0x55b795295f80 2024-09-12T01:28:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.253+0000 7f97ea59c640 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295660 0x55b7952a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:28:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.253+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b795295f80 0x55b7952a22b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97e00b8910 tx=0x7f97e002a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46430d189f19737 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.253+0000 7f97d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T01:28:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.253+0000 7f97d1ffb640 1 -- 172.21.15.81:0/3754382380 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0049070 con 0x55b795295f80 2024-09-12T01:28:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.253+0000 7f97d1ffb640 1 -- 172.21.15.81:0/3754382380 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f97e00b7d10 con 0x55b795295f80 2024-09-12T01:28:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.253+0000 7f97f32a9740 1 -- 172.21.15.81:0/3754382380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97e00f7040 con 0x55b795295f80 2024-09-12T01:28:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.254+0000 7f97d1ffb640 1 -- 172.21.15.81:0/3754382380 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97e00bb8a0 con 0x55b795295f80 2024-09-12T01:28:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.254+0000 7f97f32a9740 10 client.25136 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.254+0000 7f97f32a9740 1 -- 172.21.15.81:0/3754382380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b7952a7740 con 0x55b795295f80 2024-09-12T01:28:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.254+0000 7f97d1ffb640 1 -- 172.21.15.81:0/3754382380 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97e0031de0 con 0x55b795295f80 2024-09-12T01:28:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.254+0000 7f97d1ffb640 1 -- 172.21.15.81:0/3754382380 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f97e00b85b0 con 0x55b795295f80 2024-09-12T01:28:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.254+0000 7f97f32a9740 10 client.25136 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.254+0000 7f97f32a9740 10 client.25136 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T01:28:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.254+0000 7f97f32a9740 20 client.25136 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.255+0000 7f97f32a9740 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7952b49f0 0x55b7952b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.255+0000 7f97f32a9740 4 client.25136 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.255+0000 7f97f32a9740 1 -- 172.21.15.81:0/3754382380 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f97e00f7040 con 0x55b7952b49f0 2024-09-12T01:28:59.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.255+0000 7f97ea59c640 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7952b49f0 0x55b7952b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.255+0000 7f97d1ffb640 10 client.25136 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:59.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.256+0000 7f97ea59c640 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7952b49f0 0x55b7952b6e10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32cf61c74efc1196 server_cookie=fdf6e81e422a8af5 in_seq=0 out_seq=0 2024-09-12T01:28:59.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.257+0000 7f97d1ffb640 1 -- 172.21.15.81:0/3754382380 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f97e00f7040 con 0x55b7952b49f0 2024-09-12T01:28:59.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.257+0000 7f97d1ffb640 10 client.25136 handle_command_reply: tid=0 2024-09-12T01:28:59.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.257+0000 7f97f32a9740 1 client.25136 shutdown 2024-09-12T01:28:59.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.257+0000 7f97f32a9740 1 -- 172.21.15.81:0/3754382380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b795295f80 msgr2=0x55b7952a22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.258+0000 7f97f32a9740 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b795295f80 0x55b7952a22b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97e00b8910 tx=0x7f97e002a480 comp rx=0 tx=0).stop 2024-09-12T01:28:59.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.258+0000 7f97f32a9740 1 -- 172.21.15.81:0/3754382380 shutdown_connections 2024-09-12T01:28:59.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.258+0000 7f97f32a9740 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7952b49f0 0x55b7952b6e10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.258+0000 7f97f32a9740 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7952a4d50 0x55b7952a27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.258+0000 7f97f32a9740 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b795295f80 0x55b7952a22b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.258+0000 7f97f32a9740 1 --2- 172.21.15.81:0/3754382380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295660 0x55b7952a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.258+0000 7f97f32a9740 1 -- 172.21.15.81:0/3754382380 >> 172.21.15.81:0/3754382380 conn(0x55b795291cf0 msgr2=0x55b795297a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.258+0000 7f97d1ffb640 0 client.25136 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.258+0000 7f97f32a9740 1 -- 172.21.15.81:0/3754382380 shutdown_connections 2024-09-12T01:28:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.258+0000 7f97f32a9740 1 -- 172.21.15.81:0/3754382380 wait complete. 2024-09-12T01:28:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.258+0000 7f97f32a9740 20 client.25136 trim_cache size 0 max 16384 2024-09-12T01:28:59.273 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:28:59.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.285+0000 7f97f32a9740 1 Processor -- start 2024-09-12T01:28:59.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.285+0000 7f97f32a9740 1 -- start start 2024-09-12T01:28:59.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.285+0000 7f97f32a9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 0x55b7952a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.285+0000 7f97f32a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295f80 0x55b7952a2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.285+0000 7f97f32a9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7952a4d50 0x55b7952bc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.285+0000 7f97f32a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec1ab5e0 con 0x55b795295f80 2024-09-12T01:28:59.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.285+0000 7f97f32a9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec1ad120 con 0x55b7952a4d50 2024-09-12T01:28:59.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.285+0000 7f97f32a9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec1abcb0 con 0x55b795295660 2024-09-12T01:28:59.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.285+0000 7f97e9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295f80 0x55b7952a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.285+0000 7f97e9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295f80 0x55b7952a2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59192/0 (socket says 172.21.15.81:59192) 2024-09-12T01:28:59.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.285+0000 7f97e9d9b640 1 -- 172.21.15.81:0/1848627770 learned_addr learned my addr 172.21.15.81:0/1848627770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:59.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.285+0000 7f97ead9d640 1 --2- 172.21.15.81:0/1848627770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7952a4d50 0x55b7952bc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.285+0000 7f97ea59c640 1 --2- 172.21.15.81:0/1848627770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 0x55b7952a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.286+0000 7f97e9d9b640 1 -- 172.21.15.81:0/1848627770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 msgr2=0x55b7952a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.286+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/1848627770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 0x55b7952a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.286+0000 7f97e9d9b640 1 -- 172.21.15.81:0/1848627770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7952a4d50 msgr2=0x55b7952bc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.286+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/1848627770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7952a4d50 0x55b7952bc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.286+0000 7f97e9d9b640 1 -- 172.21.15.81:0/1848627770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b79528d260 con 0x55b795295f80 2024-09-12T01:28:59.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.286+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/1848627770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295f80 0x55b7952a2640 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f97e00c45d0 tx=0x7f97e00ba450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf4feb9732e003b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.286+0000 7f97d3fff640 1 -- 172.21.15.81:0/1848627770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0049070 con 0x55b795295f80 2024-09-12T01:28:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.286+0000 7f97d3fff640 1 -- 172.21.15.81:0/1848627770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97e0031de0 con 0x55b795295f80 2024-09-12T01:28:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.286+0000 7f97d3fff640 1 -- 172.21.15.81:0/1848627770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e00bba80 con 0x55b795295f80 2024-09-12T01:28:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.287+0000 7f97f32a9740 1 -- 172.21.15.81:0/1848627770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295f80 msgr2=0x55b7952a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.287+0000 7f97f32a9740 1 --2- 172.21.15.81:0/1848627770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295f80 0x55b7952a2640 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f97e00c45d0 tx=0x7f97e00ba450 comp rx=0 tx=0).stop 2024-09-12T01:28:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.287+0000 7f97f32a9740 1 -- 172.21.15.81:0/1848627770 shutdown_connections 2024-09-12T01:28:59.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.287+0000 7f97f32a9740 1 --2- 172.21.15.81:0/1848627770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7952a4d50 0x55b7952bc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.287+0000 7f97f32a9740 1 --2- 172.21.15.81:0/1848627770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b795295f80 0x55b7952a2640 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.287+0000 7f97f32a9740 1 --2- 172.21.15.81:0/1848627770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 0x55b7952a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.287+0000 7f97f32a9740 1 -- 172.21.15.81:0/1848627770 >> 172.21.15.81:0/1848627770 conn(0x55b795291cf0 msgr2=0x55b7952a3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.288+0000 7f97f32a9740 1 -- 172.21.15.81:0/1848627770 shutdown_connections 2024-09-12T01:28:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.288+0000 7f97f32a9740 1 -- 172.21.15.81:0/1848627770 wait complete. 2024-09-12T01:28:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.288+0000 7f97f32a9740 1 -- start start 2024-09-12T01:28:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.288+0000 7f97f32a9740 1 Processor -- start 2024-09-12T01:28:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.289+0000 7f97f32a9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 0x55b795298d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.289+0000 7f97f32a9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b795295f80 0x55b795299280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.289+0000 7f97f32a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7952a4d50 0x55b7952ab940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.289+0000 7f97ead9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7952a4d50 0x55b7952ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.289+0000 7f97ead9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7952a4d50 0x55b7952ab940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59200/0 (socket says 172.21.15.81:59200) 2024-09-12T01:28:59.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.289+0000 7f97ead9d640 1 -- 172.21.15.81:0/458450304 learned_addr learned my addr 172.21.15.81:0/458450304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:59.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.289+0000 7f97ea59c640 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 0x55b795298d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.289+0000 7f97f32a9740 1 -- 172.21.15.81:0/458450304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec1aca50 con 0x55b7952a4d50 2024-09-12T01:28:59.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.289+0000 7f97f32a9740 1 -- 172.21.15.81:0/458450304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec1ac380 con 0x55b795295f80 2024-09-12T01:28:59.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.290+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b795295f80 0x55b795299280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.290+0000 7f97f32a9740 1 -- 172.21.15.81:0/458450304 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97ec1a95c0 con 0x55b795295660 2024-09-12T01:28:59.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.290+0000 7f97f32a9740 10 client.0 _ll_register_callbacks cb 0x7f97e00f3a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:59.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.290+0000 7f97e9d9b640 1 -- 172.21.15.81:0/458450304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 msgr2=0x55b795298d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.290+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 0x55b795298d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.290+0000 7f97e9d9b640 1 -- 172.21.15.81:0/458450304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7952a4d50 msgr2=0x55b7952ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.290+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7952a4d50 0x55b7952ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.290+0000 7f97e9d9b640 1 -- 172.21.15.81:0/458450304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7952abe80 con 0x55b795295f80 2024-09-12T01:28:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.290+0000 7f97ead9d640 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7952a4d50 0x55b7952ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.290+0000 7f97e9d9b640 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b795295f80 0x55b795299280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97e0000c00 tx=0x7f97e0005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6f59cf99255d57b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.290+0000 7f97d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T01:28:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.291+0000 7f97d1ffb640 1 -- 172.21.15.81:0/458450304 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0049070 con 0x55b795295f80 2024-09-12T01:28:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.291+0000 7f97d1ffb640 1 -- 172.21.15.81:0/458450304 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f97e00bc3a0 con 0x55b795295f80 2024-09-12T01:28:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.291+0000 7f97f32a9740 1 -- 172.21.15.81:0/458450304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97e0031de0 con 0x55b795295f80 2024-09-12T01:28:59.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.291+0000 7f97d1ffb640 1 -- 172.21.15.81:0/458450304 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97e00bba80 con 0x55b795295f80 2024-09-12T01:28:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.291+0000 7f97f32a9740 10 client.25142 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.291+0000 7f97f32a9740 1 -- 172.21.15.81:0/458450304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b7952abe80 con 0x55b795295f80 2024-09-12T01:28:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.291+0000 7f97d1ffb640 1 -- 172.21.15.81:0/458450304 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97e00bbf40 con 0x55b795295f80 2024-09-12T01:28:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.291+0000 7f97d1ffb640 1 -- 172.21.15.81:0/458450304 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f97e00c4670 con 0x55b795295f80 2024-09-12T01:28:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.292+0000 7f97f32a9740 10 client.25142 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.292+0000 7f97f32a9740 10 client.25142 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T01:28:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.292+0000 7f97f32a9740 20 client.25142 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.292+0000 7f97f32a9740 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7952ad3e0 0x55b795325ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.292+0000 7f97f32a9740 4 client.25142 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-12T01:28:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.292+0000 7f97f32a9740 1 -- 172.21.15.81:0/458450304 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x7f97e0031de0 con 0x55b7952ad3e0 2024-09-12T01:28:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.293+0000 7f97ea59c640 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7952ad3e0 0x55b795325ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.293+0000 7f97ea59c640 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7952ad3e0 0x55b795325ef0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee0fc51b626fd2c7 server_cookie=29be70500486153e in_seq=0 out_seq=0 2024-09-12T01:28:59.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.293+0000 7f97d1ffb640 10 client.25142 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:59.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97d1ffb640 1 -- 172.21.15.81:0/458450304 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f97e0031de0 con 0x55b7952ad3e0 2024-09-12T01:28:59.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97d1ffb640 10 client.25142 handle_command_reply: tid=0 2024-09-12T01:28:59.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97f32a9740 1 client.25142 shutdown 2024-09-12T01:28:59.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97f32a9740 1 -- 172.21.15.81:0/458450304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b795295f80 msgr2=0x55b795299280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97f32a9740 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b795295f80 0x55b795299280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97e0000c00 tx=0x7f97e0005d50 comp rx=0 tx=0).stop 2024-09-12T01:28:59.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97f32a9740 1 -- 172.21.15.81:0/458450304 shutdown_connections 2024-09-12T01:28:59.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97f32a9740 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7952ad3e0 0x55b795325ef0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97d1ffb640 0 client.25142 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:59.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97f32a9740 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7952a4d50 0x55b7952ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97f32a9740 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b795295f80 0x55b795299280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97f32a9740 1 --2- 172.21.15.81:0/458450304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b795295660 0x55b795298d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97f32a9740 1 -- 172.21.15.81:0/458450304 >> 172.21.15.81:0/458450304 conn(0x55b795291cf0 msgr2=0x55b795297200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:59.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97f32a9740 1 -- 172.21.15.81:0/458450304 shutdown_connections 2024-09-12T01:28:59.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.302+0000 7f97f32a9740 1 -- 172.21.15.81:0/458450304 wait complete. 2024-09-12T01:28:59.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.303+0000 7f97f32a9740 20 client.25142 trim_cache size 0 max 16384 2024-09-12T01:28:59.305 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:28:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 28, 2024-09-12T01:28:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24473, 2024-09-12T01:28:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 2, 2024-09-12T01:28:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-12T01:28:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "3c3cf9a8": { 2024-09-12T01:28:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 2, 2024-09-12T01:28:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-12T01:28:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T01:28:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-12T01:28:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T01:28:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:28:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-12T01:28:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 144.5, 2024-09-12T01:28:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-12T01:28:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-12T01:28:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-12T01:28:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T01:28:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-12T01:28:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T01:28:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:28:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:28:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:28:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:28:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:28:59.306 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:28:59.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.303+0000 7f97f0ed0640 1 -- 172.21.15.81:0/1747539625 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f97d40a2e00 msgr2=0x7f97d40a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.303+0000 7f97f0ed0640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f97d40a2e00 0x7f97d40a52c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97e4005fd0 tx=0x7f97e4014040 comp rx=0 tx=0).stop 2024-09-12T01:28:59.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.303+0000 7f97f0ed0640 1 -- 172.21.15.81:0/1747539625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97ec102570 msgr2=0x7f97ec1978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.303+0000 7f97f0ed0640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97ec102570 0x7f97ec1978c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f97e0006010 tx=0x7f97e0003c10 comp rx=0 tx=0).stop 2024-09-12T01:28:59.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.304+0000 7f97f0ed0640 1 -- 172.21.15.81:0/1747539625 shutdown_connections 2024-09-12T01:28:59.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.304+0000 7f97f0ed0640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f97d40a2e00 0x7f97d40a52c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.304+0000 7f97f0ed0640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97ec102ef0 0x7f97ec19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.304+0000 7f97f0ed0640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97ec102570 0x7f97ec1978c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.304+0000 7f97f0ed0640 1 --2- 172.21.15.81:0/1747539625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97ec100e20 0x7f97ec197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.304+0000 7f97f0ed0640 1 -- 172.21.15.81:0/1747539625 >> 172.21.15.81:0/1747539625 conn(0x7f97ec0fc7d0 msgr2=0x7f97ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:59.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.304+0000 7f97f0ed0640 1 -- 172.21.15.81:0/1747539625 shutdown_connections 2024-09-12T01:28:59.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.304+0000 7f97f0ed0640 1 -- 172.21.15.81:0/1747539625 wait complete. 2024-09-12T01:28:59.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:28:59 smithi081 ceph-mon[30920]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:28:59.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:28:59 smithi100 ceph-mon[35275]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:28:59.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:28:59 smithi189 ceph-mon[35357]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:28:59.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.798+0000 7f65264c8640 1 -- 172.21.15.81:0/2894324029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65201082a0 msgr2=0x7f652010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.798+0000 7f65264c8640 1 --2- 172.21.15.81:0/2894324029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65201082a0 0x7f652010ec40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6518009cd0 tx=0x7f651802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.798+0000 7f65264c8640 1 -- 172.21.15.81:0/2894324029 shutdown_connections 2024-09-12T01:28:59.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.798+0000 7f65264c8640 1 --2- 172.21.15.81:0/2894324029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65201082a0 0x7f652010ec40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.798+0000 7f65264c8640 1 --2- 172.21.15.81:0/2894324029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65201036e0 0x7f6520107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.798+0000 7f65264c8640 1 --2- 172.21.15.81:0/2894324029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6520102d30 0x7f6520103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.798+0000 7f65264c8640 1 -- 172.21.15.81:0/2894324029 >> 172.21.15.81:0/2894324029 conn(0x7f65200fc7d0 msgr2=0x7f65200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.798+0000 7f65264c8640 1 -- 172.21.15.81:0/2894324029 shutdown_connections 2024-09-12T01:28:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.798+0000 7f65264c8640 1 -- 172.21.15.81:0/2894324029 wait complete. 2024-09-12T01:28:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.798+0000 7f65264c8640 1 Processor -- start 2024-09-12T01:28:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.798+0000 7f65264c8640 1 -- start start 2024-09-12T01:28:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.799+0000 7f65264c8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6520102d30 0x7f65201a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.799+0000 7f65264c8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65201036e0 0x7f65201a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.799+0000 7f65264c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65201082a0 0x7f652010de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.799+0000 7f65264c8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65201120a0 con 0x7f65201082a0 2024-09-12T01:28:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.799+0000 7f65264c8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6520111f20 con 0x7f65201036e0 2024-09-12T01:28:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.799+0000 7f65264c8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6520112220 con 0x7f6520102d30 2024-09-12T01:28:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.799+0000 7f6524a65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65201082a0 0x7f652010de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.799+0000 7f6524a65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65201082a0 0x7f652010de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59222/0 (socket says 172.21.15.81:59222) 2024-09-12T01:28:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.799+0000 7f6524a65640 1 -- 172.21.15.81:0/3107302343 learned_addr learned my addr 172.21.15.81:0/3107302343 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.799+0000 7f651f7fe640 1 --2- 172.21.15.81:0/3107302343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65201036e0 0x7f65201a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.800+0000 7f6524a65640 1 -- 172.21.15.81:0/3107302343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6520102d30 msgr2=0x7f65201a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.800+0000 7f6524a65640 1 --2- 172.21.15.81:0/3107302343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6520102d30 0x7f65201a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.800+0000 7f6524a65640 1 -- 172.21.15.81:0/3107302343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65201036e0 msgr2=0x7f65201a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.800+0000 7f6524a65640 1 --2- 172.21.15.81:0/3107302343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65201036e0 0x7f65201a4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.800+0000 7f6524a65640 1 -- 172.21.15.81:0/3107302343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652010e690 con 0x7f65201082a0 2024-09-12T01:28:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.800+0000 7f6524a65640 1 --2- 172.21.15.81:0/3107302343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65201082a0 0x7f652010de60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6518005cc0 tx=0x7f65180093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.800+0000 7f651d7fa640 1 -- 172.21.15.81:0/3107302343 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518003e00 con 0x7f65201082a0 2024-09-12T01:28:59.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.800+0000 7f65264c8640 1 -- 172.21.15.81:0/3107302343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652010e920 con 0x7f65201082a0 2024-09-12T01:28:59.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.800+0000 7f651d7fa640 1 -- 172.21.15.81:0/3107302343 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6518004520 con 0x7f65201082a0 2024-09-12T01:28:59.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.800+0000 7f651d7fa640 1 -- 172.21.15.81:0/3107302343 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518030db0 con 0x7f65201082a0 2024-09-12T01:28:59.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.800+0000 7f65264c8640 1 -- 172.21.15.81:0/3107302343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65201ab8a0 con 0x7f65201082a0 2024-09-12T01:28:59.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.803+0000 7f65288a1740 1 Processor -- start 2024-09-12T01:28:59.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.803+0000 7f651d7fa640 1 -- 172.21.15.81:0/3107302343 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f65180046d0 con 0x7f65201082a0 2024-09-12T01:28:59.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.803+0000 7f65288a1740 1 -- start start 2024-09-12T01:28:59.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.804+0000 7f65288a1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d407090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.804+0000 7f65288a1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 0x556a7d407a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.804+0000 7f65288a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d412370 0x556a7d414760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.804+0000 7f65288a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556a7d36d2f0 con 0x556a7d412370 2024-09-12T01:28:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.804+0000 7f65288a1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556a7d314cf0 con 0x556a7d4075d0 2024-09-12T01:28:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.804+0000 7f65288a1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556a7d3692b0 con 0x556a7d408b40 2024-09-12T01:28:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.804+0000 7f651f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d412370 0x556a7d414760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.804+0000 7f651f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d412370 0x556a7d414760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59236/0 (socket says 172.21.15.81:59236) 2024-09-12T01:28:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.804+0000 7f651f7fe640 1 -- 172.21.15.81:0/2048336611 learned_addr learned my addr 172.21.15.81:0/2048336611 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.804+0000 7f651ffff640 1 --2- 172.21.15.81:0/2048336611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 0x556a7d407a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.804+0000 7f651f7fe640 1 --2- 172.21.15.81:0/2048336611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d407090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.804+0000 7f651d7fa640 1 --2- 172.21.15.81:0/3107302343 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f65080a2e00 0x7f65080a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.805+0000 7f6524a65640 1 --2- 172.21.15.81:0/3107302343 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f65080a2e00 0x7f65080a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.805+0000 7f651d7fa640 1 -- 172.21.15.81:0/3107302343 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f651802e030 con 0x7f65201082a0 2024-09-12T01:28:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.805+0000 7f651f7fe640 1 -- 172.21.15.81:0/2048336611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 msgr2=0x556a7d407a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.805+0000 7f651f7fe640 1 --2- 172.21.15.81:0/2048336611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 0x556a7d407a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.805+0000 7f651f7fe640 1 -- 172.21.15.81:0/2048336611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d412370 msgr2=0x556a7d414760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.805+0000 7f651f7fe640 1 --2- 172.21.15.81:0/2048336611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d412370 0x556a7d414760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.805+0000 7f651f7fe640 1 -- 172.21.15.81:0/2048336611 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a7d2f93a0 con 0x556a7d408b40 2024-09-12T01:28:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.805+0000 7f651f7fe640 1 --2- 172.21.15.81:0/2048336611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d407090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x556a7d408070 tx=0x7f6514005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a13681137ddc86e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.805+0000 7f6524a65640 1 --2- 172.21.15.81:0/3107302343 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f65080a2e00 0x7f65080a52c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f65180ee3f0 tx=0x7f6518043000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.805+0000 7f65067fc640 1 -- 172.21.15.81:0/2048336611 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514016070 con 0x556a7d408b40 2024-09-12T01:28:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.805+0000 7f65067fc640 1 -- 172.21.15.81:0/2048336611 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f651400e950 con 0x556a7d408b40 2024-09-12T01:28:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.805+0000 7f65067fc640 1 -- 172.21.15.81:0/2048336611 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651400f990 con 0x556a7d408b40 2024-09-12T01:28:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.806+0000 7f65288a1740 1 -- 172.21.15.81:0/2048336611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 msgr2=0x556a7d407090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.806+0000 7f65288a1740 1 --2- 172.21.15.81:0/2048336611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d407090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x556a7d408070 tx=0x7f6514005f90 comp rx=0 tx=0).stop 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.806+0000 7f65288a1740 1 -- 172.21.15.81:0/2048336611 shutdown_connections 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.806+0000 7f65288a1740 1 --2- 172.21.15.81:0/2048336611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d412370 0x556a7d414760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.806+0000 7f65288a1740 1 --2- 172.21.15.81:0/2048336611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 0x556a7d407a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.806+0000 7f65288a1740 1 --2- 172.21.15.81:0/2048336611 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d407090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.806+0000 7f65288a1740 1 -- 172.21.15.81:0/2048336611 >> 172.21.15.81:0/2048336611 conn(0x556a7d3d0310 msgr2=0x556a7d403c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.806+0000 7f65288a1740 1 -- 172.21.15.81:0/2048336611 shutdown_connections 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.806+0000 7f65288a1740 1 -- 172.21.15.81:0/2048336611 wait complete. 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.807+0000 7f65288a1740 1 -- start start 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.807+0000 7f65288a1740 1 Processor -- start 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.807+0000 7f65288a1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 0x556a7d411d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.807+0000 7f65288a1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d40f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.807+0000 7f65288a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d412370 0x556a7d40f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.807+0000 7f65288a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556a7d415070 con 0x556a7d412370 2024-09-12T01:28:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.807+0000 7f651f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d412370 0x556a7d40f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f65288a1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556a7d328060 con 0x556a7d4075d0 2024-09-12T01:28:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f65288a1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556a7d4151f0 con 0x556a7d408b40 2024-09-12T01:28:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f651f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d412370 0x556a7d40f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59244/0 (socket says 172.21.15.81:59244) 2024-09-12T01:28:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f651f7fe640 1 -- 172.21.15.81:0/730279588 learned_addr learned my addr 172.21.15.81:0/730279588 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f651ffff640 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d40f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f65288a1740 10 client.0 _ll_register_callbacks cb 0x556a7d07b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f651f7fe640 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 0x556a7d411d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f651ffff640 1 -- 172.21.15.81:0/730279588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 msgr2=0x556a7d411d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f651ffff640 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 0x556a7d411d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f651ffff640 1 -- 172.21.15.81:0/730279588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d412370 msgr2=0x556a7d40f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f651ffff640 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d412370 0x556a7d40f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f651ffff640 1 -- 172.21.15.81:0/730279588 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a7d0de3c0 con 0x556a7d408b40 2024-09-12T01:28:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f651f7fe640 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d412370 0x556a7d40f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:28:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f651ffff640 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d40f000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f65100114b0 tx=0x7f6510011970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e2bed5753271474 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f64ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T01:28:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f64ff7fe640 1 -- 172.21.15.81:0/730279588 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510005020 con 0x556a7d408b40 2024-09-12T01:28:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f65288a1740 1 -- 172.21.15.81:0/730279588 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f651400e950 con 0x556a7d408b40 2024-09-12T01:28:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.808+0000 7f64ff7fe640 1 -- 172.21.15.81:0/730279588 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f65100051c0 con 0x556a7d408b40 2024-09-12T01:28:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.809+0000 7f64ff7fe640 1 -- 172.21.15.81:0/730279588 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f65100053c0 con 0x556a7d408b40 2024-09-12T01:28:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.809+0000 7f65288a1740 10 client.25087 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.809+0000 7f65288a1740 1 -- 172.21.15.81:0/730279588 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556a7d420b80 con 0x556a7d408b40 2024-09-12T01:28:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.809+0000 7f64ff7fe640 1 -- 172.21.15.81:0/730279588 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f651400e950 con 0x556a7d408b40 2024-09-12T01:28:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.809+0000 7f64ff7fe640 1 -- 172.21.15.81:0/730279588 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6510003830 con 0x556a7d408b40 2024-09-12T01:28:59.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.809+0000 7f65288a1740 10 client.25087 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.809+0000 7f65288a1740 10 client.25087 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:28:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.809+0000 7f65288a1740 20 client.25087 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.809+0000 7f65288a1740 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556a7d422450 0x556a7d424890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.809+0000 7f65288a1740 4 client.25087 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:28:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.809+0000 7f65288a1740 1 -- 172.21.15.81:0/730279588 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a7d37a860 con 0x556a7d422450 2024-09-12T01:28:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.810+0000 7f651f7fe640 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556a7d422450 0x556a7d424890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.810+0000 7f64ff7fe640 10 client.25087 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.810+0000 7f651f7fe640 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556a7d422450 0x556a7d424890 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68ef6a61d8a65890 server_cookie=df555b823c83b0cc in_seq=0 out_seq=0 2024-09-12T01:28:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f64ff7fe640 1 -- 172.21.15.81:0/730279588 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a7d37a860 con 0x556a7d422450 2024-09-12T01:28:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f64ff7fe640 10 client.25087 handle_command_reply: tid=0 2024-09-12T01:28:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f65288a1740 1 client.25087 shutdown 2024-09-12T01:28:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f65288a1740 1 -- 172.21.15.81:0/730279588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 msgr2=0x556a7d40f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f65288a1740 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d40f000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f65100114b0 tx=0x7f6510011970 comp rx=0 tx=0).stop 2024-09-12T01:28:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f65288a1740 1 -- 172.21.15.81:0/730279588 shutdown_connections 2024-09-12T01:28:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f65288a1740 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556a7d422450 0x556a7d424890 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f65288a1740 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d412370 0x556a7d40f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f65288a1740 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d40f000 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f64ff7fe640 0 client.25087 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f65288a1740 1 --2- 172.21.15.81:0/730279588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 0x556a7d411d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f65288a1740 1 -- 172.21.15.81:0/730279588 >> 172.21.15.81:0/730279588 conn(0x556a7d3d0310 msgr2=0x556a7d409960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f65288a1740 1 -- 172.21.15.81:0/730279588 shutdown_connections 2024-09-12T01:28:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.811+0000 7f65288a1740 1 -- 172.21.15.81:0/730279588 wait complete. 2024-09-12T01:28:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.812+0000 7f65288a1740 20 client.25087 trim_cache size 0 max 16384 2024-09-12T01:28:59.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.836+0000 7f65288a1740 1 Processor -- start 2024-09-12T01:28:59.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.836+0000 7f65288a1740 1 -- start start 2024-09-12T01:28:59.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f65288a1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 0x556a7d402c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f65288a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d408b40 0x556a7d40a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f65288a1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d412370 0x556a7d40a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f65288a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65201b3df0 con 0x556a7d408b40 2024-09-12T01:28:59.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f65288a1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f65201b5930 con 0x556a7d4075d0 2024-09-12T01:28:59.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f65288a1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f65201b44c0 con 0x556a7d412370 2024-09-12T01:28:59.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f651ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d408b40 0x556a7d40a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f651ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d408b40 0x556a7d40a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59252/0 (socket says 172.21.15.81:59252) 2024-09-12T01:28:59.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f651ffff640 1 -- 172.21.15.81:0/3447075288 learned_addr learned my addr 172.21.15.81:0/3447075288 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:59.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f651f7fe640 1 --2- 172.21.15.81:0/3447075288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 0x556a7d402c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f651f7fe640 1 --2- 172.21.15.81:0/3447075288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d412370 0x556a7d40a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f651ffff640 1 -- 172.21.15.81:0/3447075288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d412370 msgr2=0x556a7d40a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f651ffff640 1 --2- 172.21.15.81:0/3447075288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d412370 0x556a7d40a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f651ffff640 1 -- 172.21.15.81:0/3447075288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 msgr2=0x556a7d402c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f651ffff640 1 --2- 172.21.15.81:0/3447075288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 0x556a7d402c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.837+0000 7f651ffff640 1 -- 172.21.15.81:0/3447075288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a7d40f900 con 0x556a7d408b40 2024-09-12T01:28:59.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.838+0000 7f651ffff640 1 --2- 172.21.15.81:0/3447075288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d408b40 0x556a7d40a120 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6510003e10 tx=0x7f6510009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829ddf050ac457f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:59.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.838+0000 7f6505ffb640 1 -- 172.21.15.81:0/3447075288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510005c50 con 0x556a7d408b40 2024-09-12T01:28:59.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.838+0000 7f6505ffb640 1 -- 172.21.15.81:0/3447075288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6510030070 con 0x556a7d408b40 2024-09-12T01:28:59.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.838+0000 7f6505ffb640 1 -- 172.21.15.81:0/3447075288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651000fb80 con 0x556a7d408b40 2024-09-12T01:28:59.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.839+0000 7f65288a1740 1 -- 172.21.15.81:0/3447075288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d408b40 msgr2=0x556a7d40a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.839+0000 7f65288a1740 1 --2- 172.21.15.81:0/3447075288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d408b40 0x556a7d40a120 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6510003e10 tx=0x7f6510009c80 comp rx=0 tx=0).stop 2024-09-12T01:28:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.839+0000 7f65288a1740 1 -- 172.21.15.81:0/3447075288 shutdown_connections 2024-09-12T01:28:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.839+0000 7f65288a1740 1 --2- 172.21.15.81:0/3447075288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d412370 0x556a7d40a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.839+0000 7f65288a1740 1 --2- 172.21.15.81:0/3447075288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d408b40 0x556a7d40a120 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.839+0000 7f65288a1740 1 --2- 172.21.15.81:0/3447075288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d4075d0 0x556a7d402c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.839+0000 7f65288a1740 1 -- 172.21.15.81:0/3447075288 >> 172.21.15.81:0/3447075288 conn(0x556a7d3d0310 msgr2=0x556a7d402500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.839+0000 7f65288a1740 1 -- 172.21.15.81:0/3447075288 shutdown_connections 2024-09-12T01:28:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.839+0000 7f65288a1740 1 -- 172.21.15.81:0/3447075288 wait complete. 2024-09-12T01:28:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.839+0000 7f65288a1740 1 -- start start 2024-09-12T01:28:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.840+0000 7f65288a1740 1 Processor -- start 2024-09-12T01:28:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.840+0000 7f65288a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d4075d0 0x556a7d4161f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.840+0000 7f65288a1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d416730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.840+0000 7f65288a1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d412370 0x556a7d416c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.840+0000 7f651f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d4075d0 0x556a7d4161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.840+0000 7f651f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d4075d0 0x556a7d4161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59266/0 (socket says 172.21.15.81:59266) 2024-09-12T01:28:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.840+0000 7f651f7fe640 1 -- 172.21.15.81:0/613529908 learned_addr learned my addr 172.21.15.81:0/613529908 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:28:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.840+0000 7f65288a1740 1 -- 172.21.15.81:0/613529908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65201b5260 con 0x556a7d4075d0 2024-09-12T01:28:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.840+0000 7f65288a1740 1 -- 172.21.15.81:0/613529908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f65201b4b90 con 0x556a7d412370 2024-09-12T01:28:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.840+0000 7f65288a1740 1 -- 172.21.15.81:0/613529908 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f65201b1dd0 con 0x556a7d408b40 2024-09-12T01:28:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.840+0000 7f65288a1740 10 client.0 _ll_register_callbacks cb 0x7f6510009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:28:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.840+0000 7f651ffff640 1 --2- 172.21.15.81:0/613529908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d416730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.841+0000 7f651f7fe640 1 -- 172.21.15.81:0/613529908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 msgr2=0x556a7d416730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.841+0000 7f651f7fe640 1 --2- 172.21.15.81:0/613529908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d416730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.841+0000 7f651f7fe640 1 -- 172.21.15.81:0/613529908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d412370 msgr2=0x556a7d416c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:28:59.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.841+0000 7f651f7fe640 1 --2- 172.21.15.81:0/613529908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d412370 0x556a7d416c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.841+0000 7f651f7fe640 1 -- 172.21.15.81:0/613529908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a7d48c160 con 0x556a7d4075d0 2024-09-12T01:28:59.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.841+0000 7f651f7fe640 1 --2- 172.21.15.81:0/613529908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d4075d0 0x556a7d4161f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f651400f4c0 tx=0x7f6514005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f643f78bf8f7bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:28:59.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.841+0000 7f64ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:28:59.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.841+0000 7f64ff7fe640 1 -- 172.21.15.81:0/613529908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514016040 con 0x556a7d4075d0 2024-09-12T01:28:59.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.841+0000 7f64ff7fe640 1 -- 172.21.15.81:0/613529908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f651400fae0 con 0x556a7d4075d0 2024-09-12T01:28:59.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.841+0000 7f65288a1740 1 -- 172.21.15.81:0/613529908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6510030070 con 0x556a7d4075d0 2024-09-12T01:28:59.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.841+0000 7f64ff7fe640 1 -- 172.21.15.81:0/613529908 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6514034050 con 0x556a7d4075d0 2024-09-12T01:28:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.842+0000 7f65288a1740 10 client.15684 fetch_fsmap learned FSMap version 28 2024-09-12T01:28:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.842+0000 7f65288a1740 1 -- 172.21.15.81:0/613529908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556a7d48d420 con 0x556a7d4075d0 2024-09-12T01:28:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.842+0000 7f64ff7fe640 1 -- 172.21.15.81:0/613529908 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6514005520 con 0x556a7d4075d0 2024-09-12T01:28:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.842+0000 7f64ff7fe640 1 -- 172.21.15.81:0/613529908 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6514004b40 con 0x556a7d4075d0 2024-09-12T01:28:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.842+0000 7f65288a1740 10 client.15684 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:28:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.842+0000 7f65288a1740 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:28:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.842+0000 7f65288a1740 20 client.15684 populate_metadata read hostname 'smithi081' 2024-09-12T01:28:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.842+0000 7f65288a1740 1 --2- 172.21.15.81:0/613529908 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556a7d422450 0x556a7d48f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:28:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.842+0000 7f65288a1740 4 client.15684 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:28:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.842+0000 7f65288a1740 1 -- 172.21.15.81:0/613529908 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f6510030070 con 0x556a7d422450 2024-09-12T01:28:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f651ffff640 1 --2- 172.21.15.81:0/613529908 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556a7d422450 0x556a7d48f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:28:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f64ff7fe640 10 client.15684 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f651ffff640 1 --2- 172.21.15.81:0/613529908 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556a7d422450 0x556a7d48f900 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b711991aec725f2 server_cookie=cf769e1a2b3466cf in_seq=0 out_seq=0 2024-09-12T01:28:59.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f64ff7fe640 1 -- 172.21.15.81:0/613529908 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f6510030070 con 0x556a7d422450 2024-09-12T01:28:59.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f64ff7fe640 10 client.15684 handle_command_reply: tid=0 2024-09-12T01:28:59.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f65288a1740 1 client.15684 shutdown 2024-09-12T01:28:59.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f65288a1740 1 -- 172.21.15.81:0/613529908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d4075d0 msgr2=0x556a7d4161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.848 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:28:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f65288a1740 1 --2- 172.21.15.81:0/613529908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d4075d0 0x556a7d4161f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f651400f4c0 tx=0x7f6514005850 comp rx=0 tx=0).stop 2024-09-12T01:28:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f65288a1740 1 -- 172.21.15.81:0/613529908 shutdown_connections 2024-09-12T01:28:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f65288a1740 1 --2- 172.21.15.81:0/613529908 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556a7d422450 0x556a7d48f900 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f65288a1740 1 --2- 172.21.15.81:0/613529908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556a7d412370 0x556a7d416c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f65288a1740 1 --2- 172.21.15.81:0/613529908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556a7d408b40 0x556a7d416730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f65288a1740 1 --2- 172.21.15.81:0/613529908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a7d4075d0 0x556a7d4161f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f65288a1740 1 -- 172.21.15.81:0/613529908 >> 172.21.15.81:0/613529908 conn(0x556a7d3d0310 msgr2=0x556a7d402d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.843+0000 7f64ff7fe640 0 client.15684 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:28:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65288a1740 1 -- 172.21.15.81:0/613529908 shutdown_connections 2024-09-12T01:28:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65288a1740 1 -- 172.21.15.81:0/613529908 wait complete. 2024-09-12T01:28:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65288a1740 20 client.15684 trim_cache size 0 max 16384 2024-09-12T01:28:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65264c8640 1 -- 172.21.15.81:0/3107302343 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f65080a2e00 msgr2=0x7f65080a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65264c8640 1 --2- 172.21.15.81:0/3107302343 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f65080a2e00 0x7f65080a52c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f65180ee3f0 tx=0x7f6518043000 comp rx=0 tx=0).stop 2024-09-12T01:28:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65264c8640 1 -- 172.21.15.81:0/3107302343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65201082a0 msgr2=0x7f652010de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:28:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65264c8640 1 --2- 172.21.15.81:0/3107302343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65201082a0 0x7f652010de60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6518005cc0 tx=0x7f65180093d0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65264c8640 1 -- 172.21.15.81:0/3107302343 shutdown_connections 2024-09-12T01:28:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65264c8640 1 --2- 172.21.15.81:0/3107302343 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f65080a2e00 0x7f65080a52c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65264c8640 1 --2- 172.21.15.81:0/3107302343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65201082a0 0x7f652010de60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65264c8640 1 --2- 172.21.15.81:0/3107302343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65201036e0 0x7f65201a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65264c8640 1 --2- 172.21.15.81:0/3107302343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6520102d30 0x7f65201a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:28:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65264c8640 1 -- 172.21.15.81:0/3107302343 >> 172.21.15.81:0/3107302343 conn(0x7f65200fc7d0 msgr2=0x7f65200fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:28:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65264c8640 1 -- 172.21.15.81:0/3107302343 shutdown_connections 2024-09-12T01:28:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:28:59.844+0000 7f65264c8640 1 -- 172.21.15.81:0/3107302343 wait complete. 2024-09-12T01:29:00.738 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:29:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:29:00.481+0000 7fefc650e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:29:00.738 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:29:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:29:00.481+0000 7fefc650e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:29:00.739 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:29:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:29:00.481+0000 7fefc650e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:29:00.739 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:29:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:29:00.481+0000 7fefc650e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:29:00.739 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:29:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x[31144]: 2024-09-12T01:29:00.481+0000 7fefc650e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:29:01.310 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3c3cf9a8', quiesce took 11.8 seconds. Will release after: 12.7 2024-09-12T01:29:01.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:01 smithi081 ceph-mon[30920]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T01:29:01.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:01 smithi100 ceph-mon[35275]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T01:29:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:01 smithi189 ceph-mon[35357]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T01:29:01.860 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:29:01.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:29:02.142 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:29:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.698+0000 7f48a49ad640 1 -- 172.21.15.81:0/2118644153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a0106a70 msgr2=0x7f48a0106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.698+0000 7f48a49ad640 1 --2- 172.21.15.81:0/2118644153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a0106a70 0x7f48a0106e50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4890009930 tx=0x7f489002a420 comp rx=0 tx=0).stop 2024-09-12T01:29:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.698+0000 7f48a49ad640 1 -- 172.21.15.81:0/2118644153 shutdown_connections 2024-09-12T01:29:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.698+0000 7f48a49ad640 1 --2- 172.21.15.81:0/2118644153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48a0101410 0x7f48a010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.698+0000 7f48a49ad640 1 --2- 172.21.15.81:0/2118644153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48a0100a70 0x7f48a0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.698+0000 7f48a49ad640 1 --2- 172.21.15.81:0/2118644153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a0106a70 0x7f48a0106e50 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.698+0000 7f48a49ad640 1 -- 172.21.15.81:0/2118644153 >> 172.21.15.81:0/2118644153 conn(0x7f48a00fc790 msgr2=0x7f48a00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.698+0000 7f48a49ad640 1 -- 172.21.15.81:0/2118644153 shutdown_connections 2024-09-12T01:29:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.698+0000 7f48a49ad640 1 -- 172.21.15.81:0/2118644153 wait complete. 2024-09-12T01:29:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.699+0000 7f48a49ad640 1 Processor -- start 2024-09-12T01:29:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.699+0000 7f48a49ad640 1 -- start start 2024-09-12T01:29:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.700+0000 7f48a49ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a0100a70 0x7f48a00fcec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.700+0000 7f48a49ad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48a0101410 0x7f48a00fd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.700+0000 7f489e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a0100a70 0x7f48a00fcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.700+0000 7f489e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a0100a70 0x7f48a00fcec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48868/0 (socket says 172.21.15.81:48868) 2024-09-12T01:29:02.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.700+0000 7f48a49ad640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48a0106a70 0x7f48a00fd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.700+0000 7f4897fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48a0101410 0x7f48a00fd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.700+0000 7f489e59c640 1 -- 172.21.15.81:0/2718099612 learned_addr learned my addr 172.21.15.81:0/2718099612 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:02.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.700+0000 7f48a49ad640 1 -- 172.21.15.81:0/2718099612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48a0110e70 con 0x7f48a0100a70 2024-09-12T01:29:02.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.700+0000 7f48a49ad640 1 -- 172.21.15.81:0/2718099612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48a0110cf0 con 0x7f48a0101410 2024-09-12T01:29:02.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.700+0000 7f48a49ad640 1 -- 172.21.15.81:0/2718099612 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48a0110ff0 con 0x7f48a0106a70 2024-09-12T01:29:02.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.701+0000 7f489e59c640 1 -- 172.21.15.81:0/2718099612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48a0106a70 msgr2=0x7f48a00fd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:02.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.701+0000 7f489ed9d640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48a0106a70 0x7f48a00fd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.701+0000 7f489e59c640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48a0106a70 0x7f48a00fd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.701+0000 7f489e59c640 1 -- 172.21.15.81:0/2718099612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48a0101410 msgr2=0x7f48a00fd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:02.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.701+0000 7f489e59c640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48a0101410 0x7f48a00fd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.701+0000 7f489e59c640 1 -- 172.21.15.81:0/2718099612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a01a6930 con 0x7f48a0100a70 2024-09-12T01:29:02.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.701+0000 7f489e59c640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a0100a70 0x7f48a00fcec0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4890009230 tx=0x7f4890004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:02.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.701+0000 7f48977fe640 1 -- 172.21.15.81:0/2718099612 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489003f030 con 0x7f48a0100a70 2024-09-12T01:29:02.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.701+0000 7f48977fe640 1 -- 172.21.15.81:0/2718099612 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4890003ad0 con 0x7f48a0100a70 2024-09-12T01:29:02.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.701+0000 7f489ed9d640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48a0106a70 0x7f48a00fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:29:02.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.701+0000 7f48977fe640 1 -- 172.21.15.81:0/2718099612 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4890035070 con 0x7f48a0100a70 2024-09-12T01:29:02.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.702+0000 7f48a49ad640 1 -- 172.21.15.81:0/2718099612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a01a6bc0 con 0x7f48a0100a70 2024-09-12T01:29:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.702+0000 7f48a49ad640 1 -- 172.21.15.81:0/2718099612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a01a7050 con 0x7f48a0100a70 2024-09-12T01:29:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.704+0000 7f48977fe640 1 -- 172.21.15.81:0/2718099612 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f4890042030 con 0x7f48a0100a70 2024-09-12T01:29:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.705+0000 7f48977fe640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f488c0a2e90 0x7f488c0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.705+0000 7f48977fe640 1 -- 172.21.15.81:0/2718099612 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f48900efae0 con 0x7f48a0100a70 2024-09-12T01:29:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.705+0000 7f4897fff640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f488c0a2e90 0x7f488c0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.705+0000 7f48a6d86740 1 Processor -- start 2024-09-12T01:29:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.706+0000 7f48a6d86740 1 -- start start 2024-09-12T01:29:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.706+0000 7f4897fff640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f488c0a2e90 0x7f488c0a5350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48a00fe950 tx=0x7f488800b390 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.706+0000 7f48a6d86740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x557056426e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.706+0000 7f48a6d86740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570564273a0 0x55705643a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.706+0000 7f48a6d86740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55705643a550 0x55705643c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.706+0000 7f489e59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x557056426e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.706+0000 7f489e59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x557056426e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.81:55184/0 (socket says 172.21.15.81:55184) 2024-09-12T01:29:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.706+0000 7f489e59c640 1 -- 172.21.15.81:0/2473152417 learned_addr learned my addr 172.21.15.81:0/2473152417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.706+0000 7f4897fff640 1 --2- 172.21.15.81:0/2473152417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570564273a0 0x55705643a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.706+0000 7f48a6d86740 1 -- 172.21.15.81:0/2473152417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55705638c280 con 0x55705643a550 2024-09-12T01:29:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.706+0000 7f48a6d86740 1 -- 172.21.15.81:0/2473152417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557056333b10 con 0x5570564273a0 2024-09-12T01:29:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.706+0000 7f48a6d86740 1 -- 172.21.15.81:0/2473152417 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557056388240 con 0x557056426a80 2024-09-12T01:29:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.707+0000 7f489ed9d640 1 --2- 172.21.15.81:0/2473152417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55705643a550 0x55705643c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.707+0000 7f4897fff640 1 -- 172.21.15.81:0/2473152417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 msgr2=0x557056426e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.707+0000 7f4897fff640 1 --2- 172.21.15.81:0/2473152417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x557056426e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.707+0000 7f4897fff640 1 -- 172.21.15.81:0/2473152417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55705643a550 msgr2=0x55705643c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.707+0000 7f4897fff640 1 --2- 172.21.15.81:0/2473152417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55705643a550 0x55705643c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.707+0000 7f4897fff640 1 -- 172.21.15.81:0/2473152417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570563401f0 con 0x5570564273a0 2024-09-12T01:29:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.707+0000 7f489e59c640 1 --2- 172.21.15.81:0/2473152417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x557056426e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.707+0000 7f489ed9d640 1 --2- 172.21.15.81:0/2473152417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55705643a550 0x55705643c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.707+0000 7f4897fff640 1 --2- 172.21.15.81:0/2473152417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570564273a0 0x55705643a010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4888005fd0 tx=0x7f4888013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6173959c5130e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.707+0000 7f4894ff9640 1 -- 172.21.15.81:0/2473152417 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888011ce0 con 0x5570564273a0 2024-09-12T01:29:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.708+0000 7f4894ff9640 1 -- 172.21.15.81:0/2473152417 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4888005500 con 0x5570564273a0 2024-09-12T01:29:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.708+0000 7f4894ff9640 1 -- 172.21.15.81:0/2473152417 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488801e680 con 0x5570564273a0 2024-09-12T01:29:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.708+0000 7f48a6d86740 1 -- 172.21.15.81:0/2473152417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570564273a0 msgr2=0x55705643a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.708+0000 7f48a6d86740 1 --2- 172.21.15.81:0/2473152417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570564273a0 0x55705643a010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4888005fd0 tx=0x7f4888013000 comp rx=0 tx=0).stop 2024-09-12T01:29:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.708+0000 7f48a6d86740 1 -- 172.21.15.81:0/2473152417 shutdown_connections 2024-09-12T01:29:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.708+0000 7f48a6d86740 1 --2- 172.21.15.81:0/2473152417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55705643a550 0x55705643c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.708+0000 7f48a6d86740 1 --2- 172.21.15.81:0/2473152417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570564273a0 0x55705643a010 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.708+0000 7f48a6d86740 1 --2- 172.21.15.81:0/2473152417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x557056426e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.708+0000 7f48a6d86740 1 -- 172.21.15.81:0/2473152417 >> 172.21.15.81:0/2473152417 conn(0x5570564230f0 msgr2=0x5570564234d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.709+0000 7f48a6d86740 1 -- 172.21.15.81:0/2473152417 shutdown_connections 2024-09-12T01:29:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.709+0000 7f48a6d86740 1 -- 172.21.15.81:0/2473152417 wait complete. 2024-09-12T01:29:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.709+0000 7f48a6d86740 1 -- start start 2024-09-12T01:29:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.709+0000 7f48a6d86740 1 Processor -- start 2024-09-12T01:29:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.710+0000 7f48a6d86740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557056426a80 0x557056437500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.710+0000 7f48a6d86740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570564273a0 0x557056437a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.710+0000 7f48a6d86740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x557056437f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.710+0000 7f48a6d86740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55705643d0c0 con 0x557056426a80 2024-09-12T01:29:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.710+0000 7f48a6d86740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557056346f10 con 0x55705643a550 2024-09-12T01:29:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.710+0000 7f48a6d86740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55705643d240 con 0x5570564273a0 2024-09-12T01:29:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.710+0000 7f489e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557056426a80 0x557056437500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.710+0000 7f48a6d86740 10 client.0 _ll_register_callbacks cb 0x55705630fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.710+0000 7f4897fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570564273a0 0x557056437a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.711+0000 7f4897fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570564273a0 0x557056437a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.81:55198/0 (socket says 172.21.15.81:55198) 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.711+0000 7f4897fff640 1 -- 172.21.15.81:0/1326917709 learned_addr learned my addr 172.21.15.81:0/1326917709 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.711+0000 7f4897fff640 1 -- 172.21.15.81:0/1326917709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 msgr2=0x557056437f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.711+0000 7f4897fff640 1 --2- 172.21.15.81:0/1326917709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x557056437f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.711+0000 7f4897fff640 1 -- 172.21.15.81:0/1326917709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557056426a80 msgr2=0x557056437500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.711+0000 7f4897fff640 1 --2- 172.21.15.81:0/1326917709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557056426a80 0x557056437500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.711+0000 7f4897fff640 1 -- 172.21.15.81:0/1326917709 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570560fd6a0 con 0x5570564273a0 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.711+0000 7f4897fff640 1 --2- 172.21.15.81:0/1326917709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570564273a0 0x557056437a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4888004950 tx=0x7f4888004980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c960f40bd2ebcce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.711+0000 7f4885ffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.711+0000 7f4885ffb640 1 -- 172.21.15.81:0/1326917709 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888036060 con 0x5570564273a0 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.711+0000 7f48a6d86740 1 -- 172.21.15.81:0/1326917709 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4888005500 con 0x5570564273a0 2024-09-12T01:29:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.711+0000 7f4885ffb640 1 -- 172.21.15.81:0/1326917709 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f4888004e90 con 0x5570564273a0 2024-09-12T01:29:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.712+0000 7f4885ffb640 1 -- 172.21.15.81:0/1326917709 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4888004a80 con 0x5570564273a0 2024-09-12T01:29:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.712+0000 7f48a6d86740 10 client.25105 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.712+0000 7f48a6d86740 1 -- 172.21.15.81:0/1326917709 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557056448e60 con 0x5570564273a0 2024-09-12T01:29:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.712+0000 7f4885ffb640 1 -- 172.21.15.81:0/1326917709 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4888005500 con 0x5570564273a0 2024-09-12T01:29:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.712+0000 7f4885ffb640 1 -- 172.21.15.81:0/1326917709 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f488801ec70 con 0x5570564273a0 2024-09-12T01:29:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.712+0000 7f48a6d86740 10 client.25105 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.712+0000 7f48a6d86740 10 client.25105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:29:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.712+0000 7f48a6d86740 20 client.25105 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.712+0000 7f48a6d86740 1 --2- 172.21.15.81:0/1326917709 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55705644a210 0x55705644c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.712+0000 7f48a6d86740 4 client.25105 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:29:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.712+0000 7f48a6d86740 1 -- 172.21.15.81:0/1326917709 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570563997f0 con 0x55705644a210 2024-09-12T01:29:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.713+0000 7f489e59c640 1 --2- 172.21.15.81:0/1326917709 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55705644a210 0x55705644c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.713+0000 7f489e59c640 1 --2- 172.21.15.81:0/1326917709 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55705644a210 0x55705644c600 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e350fbe8265bb43 server_cookie=7b2cc9a38623c10 in_seq=0 out_seq=0 2024-09-12T01:29:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.713+0000 7f4885ffb640 10 client.25105 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f4885ffb640 1 -- 172.21.15.81:0/1326917709 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570563997f0 con 0x55705644a210 2024-09-12T01:29:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f4885ffb640 10 client.25105 handle_command_reply: tid=0 2024-09-12T01:29:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f48a6d86740 1 client.25105 shutdown 2024-09-12T01:29:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f48a6d86740 1 -- 172.21.15.81:0/1326917709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570564273a0 msgr2=0x557056437a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f48a6d86740 1 --2- 172.21.15.81:0/1326917709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570564273a0 0x557056437a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4888004950 tx=0x7f4888004980 comp rx=0 tx=0).stop 2024-09-12T01:29:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f48a6d86740 1 -- 172.21.15.81:0/1326917709 shutdown_connections 2024-09-12T01:29:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f48a6d86740 1 --2- 172.21.15.81:0/1326917709 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55705644a210 0x55705644c600 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f48a6d86740 1 --2- 172.21.15.81:0/1326917709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x557056437f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f48a6d86740 1 --2- 172.21.15.81:0/1326917709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5570564273a0 0x557056437a40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f4885ffb640 0 client.25105 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f48a6d86740 1 --2- 172.21.15.81:0/1326917709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557056426a80 0x557056437500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f48a6d86740 1 -- 172.21.15.81:0/1326917709 >> 172.21.15.81:0/1326917709 conn(0x5570564230f0 msgr2=0x557056422270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f48a6d86740 1 -- 172.21.15.81:0/1326917709 shutdown_connections 2024-09-12T01:29:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f48a6d86740 1 -- 172.21.15.81:0/1326917709 wait complete. 2024-09-12T01:29:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.714+0000 7f48a6d86740 20 client.25105 trim_cache size 0 max 16384 2024-09-12T01:29:02.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.731+0000 7f48a6d86740 1 Processor -- start 2024-09-12T01:29:02.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f48a6d86740 1 -- start start 2024-09-12T01:29:02.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f48a6d86740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x557056439360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f48a6d86740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5570564273a0 0x557056451de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f48a6d86740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x557056452320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f48a6d86740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48a01ab6c0 con 0x5570564273a0 2024-09-12T01:29:02.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f48a6d86740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48a01ad200 con 0x55705643a550 2024-09-12T01:29:02.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f48a6d86740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48a01abd90 con 0x557056426a80 2024-09-12T01:29:02.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f489ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x557056452320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f489e59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x557056439360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f489ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x557056452320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:55316/0 (socket says 172.21.15.81:55316) 2024-09-12T01:29:02.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f489ed9d640 1 -- 172.21.15.81:0/2651696585 learned_addr learned my addr 172.21.15.81:0/2651696585 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:02.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f4897fff640 1 --2- 172.21.15.81:0/2651696585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5570564273a0 0x557056451de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f489ed9d640 1 -- 172.21.15.81:0/2651696585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 msgr2=0x557056439360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:02.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f489ed9d640 1 --2- 172.21.15.81:0/2651696585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x557056439360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f489ed9d640 1 -- 172.21.15.81:0/2651696585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5570564273a0 msgr2=0x557056451de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:02.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f489ed9d640 1 --2- 172.21.15.81:0/2651696585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5570564273a0 0x557056451de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.732+0000 7f489ed9d640 1 -- 172.21.15.81:0/2651696585 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55705644c970 con 0x55705643a550 2024-09-12T01:29:02.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.733+0000 7f489ed9d640 1 --2- 172.21.15.81:0/2651696585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x557056452320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4898009da0 tx=0x7f4898010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b523529cef7eff60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:02.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.733+0000 7f4887fff640 1 -- 172.21.15.81:0/2651696585 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898016070 con 0x55705643a550 2024-09-12T01:29:02.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.733+0000 7f4887fff640 1 -- 172.21.15.81:0/2651696585 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f489801b940 con 0x55705643a550 2024-09-12T01:29:02.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.733+0000 7f4887fff640 1 -- 172.21.15.81:0/2651696585 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898012a40 con 0x55705643a550 2024-09-12T01:29:02.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.734+0000 7f48a6d86740 1 -- 172.21.15.81:0/2651696585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 msgr2=0x557056452320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:02.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.734+0000 7f48a6d86740 1 --2- 172.21.15.81:0/2651696585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x557056452320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4898009da0 tx=0x7f4898010740 comp rx=0 tx=0).stop 2024-09-12T01:29:02.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.734+0000 7f48a6d86740 1 -- 172.21.15.81:0/2651696585 shutdown_connections 2024-09-12T01:29:02.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.734+0000 7f48a6d86740 1 --2- 172.21.15.81:0/2651696585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x557056452320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.734+0000 7f48a6d86740 1 --2- 172.21.15.81:0/2651696585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5570564273a0 0x557056451de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.734+0000 7f48a6d86740 1 --2- 172.21.15.81:0/2651696585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x557056439360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.734+0000 7f48a6d86740 1 -- 172.21.15.81:0/2651696585 >> 172.21.15.81:0/2651696585 conn(0x5570564230f0 msgr2=0x557056438c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.734+0000 7f48a6d86740 1 -- 172.21.15.81:0/2651696585 shutdown_connections 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.734+0000 7f48a6d86740 1 -- 172.21.15.81:0/2651696585 wait complete. 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.734+0000 7f48a6d86740 1 -- start start 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.734+0000 7f48a6d86740 1 Processor -- start 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.734+0000 7f48a6d86740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x55705643e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.734+0000 7f48a6d86740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5570564273a0 0x55705643ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f48a6d86740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x5570564b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f48a6d86740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48a01acb30 con 0x5570564273a0 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f48a6d86740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48a01ac460 con 0x55705643a550 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f48a6d86740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f48a01a96a0 con 0x557056426a80 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f489e59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x55705643e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f48a6d86740 10 client.0 _ll_register_callbacks cb 0x7f4890009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f4897fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5570564273a0 0x55705643ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f4897fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5570564273a0 0x55705643ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48910/0 (socket says 172.21.15.81:48910) 2024-09-12T01:29:02.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f4897fff640 1 -- 172.21.15.81:0/3689507883 learned_addr learned my addr 172.21.15.81:0/3689507883 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:02.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f489ed9d640 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x5570564b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f4897fff640 1 -- 172.21.15.81:0/3689507883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 msgr2=0x55705643e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f4897fff640 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x55705643e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f4897fff640 1 -- 172.21.15.81:0/3689507883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 msgr2=0x5570564b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f4897fff640 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x5570564b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f4897fff640 1 -- 172.21.15.81:0/3689507883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570564b42f0 con 0x5570564273a0 2024-09-12T01:29:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f489ed9d640 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x5570564b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f4897fff640 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5570564273a0 0x55705643ebe0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4888004430 tx=0x7f4888003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1845d8db42295c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f4885ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.735+0000 7f489e59c640 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x55705643e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f4885ffb640 1 -- 172.21.15.81:0/3689507883 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888036050 con 0x5570564273a0 2024-09-12T01:29:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f4885ffb640 1 -- 172.21.15.81:0/3689507883 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f4888004de0 con 0x5570564273a0 2024-09-12T01:29:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f48a6d86740 1 -- 172.21.15.81:0/3689507883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f489801b940 con 0x5570564273a0 2024-09-12T01:29:02.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f4885ffb640 1 -- 172.21.15.81:0/3689507883 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f488804b050 con 0x5570564273a0 2024-09-12T01:29:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f48a6d86740 10 client.15705 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f48a6d86740 1 -- 172.21.15.81:0/3689507883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5570564b5510 con 0x5570564273a0 2024-09-12T01:29:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f4885ffb640 1 -- 172.21.15.81:0/3689507883 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48880035f0 con 0x5570564273a0 2024-09-12T01:29:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f4885ffb640 1 -- 172.21.15.81:0/3689507883 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4888043020 con 0x5570564273a0 2024-09-12T01:29:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f48a6d86740 10 client.15705 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f48a6d86740 10 client.15705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:29:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f48a6d86740 20 client.15705 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f48a6d86740 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5570564b5b90 0x5570564b7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f48a6d86740 4 client.15705 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:29:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.736+0000 7f48a6d86740 1 -- 172.21.15.81:0/3689507883 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f489801b940 con 0x5570564b5b90 2024-09-12T01:29:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.737+0000 7f489e59c640 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5570564b5b90 0x5570564b7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.737+0000 7f4885ffb640 10 client.15705 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:02.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.737+0000 7f489e59c640 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5570564b5b90 0x5570564b7fb0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cf137fd0d61a997 server_cookie=70bad21faf88977b in_seq=0 out_seq=0 2024-09-12T01:29:02.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.738+0000 7f4885ffb640 1 -- 172.21.15.81:0/3689507883 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f489801b940 con 0x5570564b5b90 2024-09-12T01:29:02.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.738+0000 7f4885ffb640 10 client.15705 handle_command_reply: tid=0 2024-09-12T01:29:02.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.738+0000 7f48a6d86740 1 client.15705 shutdown 2024-09-12T01:29:02.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.738+0000 7f48a6d86740 1 -- 172.21.15.81:0/3689507883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5570564273a0 msgr2=0x55705643ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:02.744 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:29:02.744 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:29:02.745 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "8c280b75-142f-41d5-a061-13bed726f2fe", 2024-09-12T01:29:02.745 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:29:02.745 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:29:02.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.738+0000 7f48a6d86740 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5570564273a0 0x55705643ebe0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4888004430 tx=0x7f4888003890 comp rx=0 tx=0).stop 2024-09-12T01:29:02.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.738+0000 7f48a6d86740 1 -- 172.21.15.81:0/3689507883 shutdown_connections 2024-09-12T01:29:02.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.738+0000 7f48a6d86740 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5570564b5b90 0x5570564b7fb0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.738+0000 7f48a6d86740 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55705643a550 0x5570564b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.738+0000 7f48a6d86740 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5570564273a0 0x55705643ebe0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.738+0000 7f48a6d86740 1 --2- 172.21.15.81:0/3689507883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557056426a80 0x55705643e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.738+0000 7f4885ffb640 0 client.15705 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:02.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.738+0000 7f48a6d86740 1 -- 172.21.15.81:0/3689507883 >> 172.21.15.81:0/3689507883 conn(0x5570564230f0 msgr2=0x557056422270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:02.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a6d86740 1 -- 172.21.15.81:0/3689507883 shutdown_connections 2024-09-12T01:29:02.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a6d86740 1 -- 172.21.15.81:0/3689507883 wait complete. 2024-09-12T01:29:02.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a6d86740 20 client.15705 trim_cache size 0 max 16384 2024-09-12T01:29:02.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a49ad640 1 -- 172.21.15.81:0/2718099612 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f488c0a2e90 msgr2=0x7f488c0a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:02.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a49ad640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f488c0a2e90 0x7f488c0a5350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48a00fe950 tx=0x7f488800b390 comp rx=0 tx=0).stop 2024-09-12T01:29:02.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a49ad640 1 -- 172.21.15.81:0/2718099612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a0100a70 msgr2=0x7f48a00fcec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:02.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a49ad640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a0100a70 0x7f48a00fcec0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4890009230 tx=0x7f4890004270 comp rx=0 tx=0).stop 2024-09-12T01:29:02.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a49ad640 1 -- 172.21.15.81:0/2718099612 shutdown_connections 2024-09-12T01:29:02.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a49ad640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f488c0a2e90 0x7f488c0a5350 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a49ad640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f48a0106a70 0x7f48a00fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a49ad640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48a0101410 0x7f48a00fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a49ad640 1 --2- 172.21.15.81:0/2718099612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a0100a70 0x7f48a00fcec0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a49ad640 1 -- 172.21.15.81:0/2718099612 >> 172.21.15.81:0/2718099612 conn(0x7f48a00fc790 msgr2=0x7f48a006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a49ad640 1 -- 172.21.15.81:0/2718099612 shutdown_connections 2024-09-12T01:29:02.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:02.739+0000 7f48a49ad640 1 -- 172.21.15.81:0/2718099612 wait complete. 2024-09-12T01:29:03.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:29:03.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:03 smithi081 ceph-mon[30920]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-12T01:29:03.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:03 smithi081 ceph-mon[30920]: mgrmap e25: x(active, since 58s), standbys: z, y 2024-09-12T01:29:03.743 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:29:03.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:03 smithi100 ceph-mon[35275]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-12T01:29:03.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:03 smithi100 ceph-mon[35275]: mgrmap e25: x(active, since 58s), standbys: z, y 2024-09-12T01:29:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:03 smithi189 ceph-mon[35357]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-12T01:29:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:03 smithi189 ceph-mon[35357]: mgrmap e25: x(active, since 58s), standbys: z, y 2024-09-12T01:29:04.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.258+0000 7fdd1ba55640 1 -- 172.21.15.81:0/998311644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14106f40 msgr2=0x7fdd1410eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:04.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.258+0000 7fdd1ba55640 1 --2- 172.21.15.81:0/998311644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14106f40 0x7fdd1410eac0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009ca0 tx=0x7fdd0c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.258+0000 7fdd1ba55640 1 -- 172.21.15.81:0/998311644 shutdown_connections 2024-09-12T01:29:04.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.258+0000 7fdd1ba55640 1 --2- 172.21.15.81:0/998311644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14106f40 0x7fdd1410eac0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.258+0000 7fdd1ba55640 1 --2- 172.21.15.81:0/998311644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd141027c0 0x7fdd14106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.258+0000 7fdd1ba55640 1 --2- 172.21.15.81:0/998311644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd14101e10 0x7fdd141021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.258+0000 7fdd1ba55640 1 -- 172.21.15.81:0/998311644 >> 172.21.15.81:0/998311644 conn(0x7fdd140fd8d0 msgr2=0x7fdd140ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:04.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.259+0000 7fdd1ba55640 1 -- 172.21.15.81:0/998311644 shutdown_connections 2024-09-12T01:29:04.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.259+0000 7fdd1ba55640 1 -- 172.21.15.81:0/998311644 wait complete. 2024-09-12T01:29:04.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.259+0000 7fdd1ba55640 1 Processor -- start 2024-09-12T01:29:04.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.259+0000 7fdd1ba55640 1 -- start start 2024-09-12T01:29:04.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd1ba55640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd14101e10 0x7fdd14198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd1ba55640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd141027c0 0x7fdd14198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd1ba55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14106f40 0x7fdd1419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd1ba55640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd14111fa0 con 0x7fdd14106f40 2024-09-12T01:29:04.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd1ba55640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd14111e20 con 0x7fdd141027c0 2024-09-12T01:29:04.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd1ba55640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd14112120 con 0x7fdd14101e10 2024-09-12T01:29:04.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd19ff2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14106f40 0x7fdd1419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd19ff2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14106f40 0x7fdd1419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48922/0 (socket says 172.21.15.81:48922) 2024-09-12T01:29:04.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd19ff2640 1 -- 172.21.15.81:0/1369335864 learned_addr learned my addr 172.21.15.81:0/1369335864 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:04.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd18ff0640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd141027c0 0x7fdd14198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd197f1640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd14101e10 0x7fdd14198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd19ff2640 1 -- 172.21.15.81:0/1369335864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd14101e10 msgr2=0x7fdd14198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:04.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd19ff2640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd14101e10 0x7fdd14198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd19ff2640 1 -- 172.21.15.81:0/1369335864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd141027c0 msgr2=0x7fdd14198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:04.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd19ff2640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd141027c0 0x7fdd14198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.260+0000 7fdd19ff2640 1 -- 172.21.15.81:0/1369335864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1419d3b0 con 0x7fdd14106f40 2024-09-12T01:29:04.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.261+0000 7fdd19ff2640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14106f40 0x7fdd1419ccd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c031a20 tx=0x7fdd0c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:04.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.261+0000 7fdd0a7fc640 1 -- 172.21.15.81:0/1369335864 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c003c30 con 0x7fdd14106f40 2024-09-12T01:29:04.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.261+0000 7fdd0a7fc640 1 -- 172.21.15.81:0/1369335864 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd0c003dd0 con 0x7fdd14106f40 2024-09-12T01:29:04.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.261+0000 7fdd0a7fc640 1 -- 172.21.15.81:0/1369335864 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c02fcf0 con 0x7fdd14106f40 2024-09-12T01:29:04.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.261+0000 7fdd1ba55640 1 -- 172.21.15.81:0/1369335864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1419d640 con 0x7fdd14106f40 2024-09-12T01:29:04.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.261+0000 7fdd1ba55640 1 -- 172.21.15.81:0/1369335864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd141a4f80 con 0x7fdd14106f40 2024-09-12T01:29:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.264+0000 7fdd1de2e740 1 Processor -- start 2024-09-12T01:29:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.265+0000 7fdd0a7fc640 1 -- 172.21.15.81:0/1369335864 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7fdd0c004050 con 0x7fdd14106f40 2024-09-12T01:29:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd1de2e740 1 -- start start 2024-09-12T01:29:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd0a7fc640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdd000a2e10 0x7fdd000a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd1de2e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360cc4a0 0x55d6360cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd0a7fc640 1 -- 172.21.15.81:0/1369335864 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fdd0c0f09f0 con 0x7fdd14106f40 2024-09-12T01:29:04.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd1de2e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360ccdc0 0x55d6360d7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd197f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360cc4a0 0x55d6360cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd197f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360cc4a0 0x55d6360cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48936/0 (socket says 172.21.15.81:48936) 2024-09-12T01:29:04.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd1de2e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360d7680 0x55d6360d9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd18ff0640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdd000a2e10 0x7fdd000a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd197f1640 1 -- 172.21.15.81:0/3534919388 learned_addr learned my addr 172.21.15.81:0/3534919388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:04.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3534919388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d6360322e0 con 0x55d6360cc4a0 2024-09-12T01:29:04.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3534919388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d635fd9ce0 con 0x55d6360ccdc0 2024-09-12T01:29:04.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3534919388 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d63602e2a0 con 0x55d6360d7680 2024-09-12T01:29:04.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.266+0000 7fdd18ff0640 1 --2- 172.21.15.81:0/3534919388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360ccdc0 0x55d6360d7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.267+0000 7fdd19ff2640 1 --2- 172.21.15.81:0/3534919388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360d7680 0x55d6360d9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.267+0000 7fdd197f1640 1 -- 172.21.15.81:0/3534919388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360d7680 msgr2=0x55d6360d9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.267+0000 7fdd197f1640 1 --2- 172.21.15.81:0/3534919388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360d7680 0x55d6360d9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.267+0000 7fdd197f1640 1 -- 172.21.15.81:0/3534919388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360ccdc0 msgr2=0x55d6360d7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.267+0000 7fdd197f1640 1 --2- 172.21.15.81:0/3534919388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360ccdc0 0x55d6360d7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.267+0000 7fdd197f1640 1 -- 172.21.15.81:0/3534919388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d635fbe440 con 0x55d6360cc4a0 2024-09-12T01:29:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.267+0000 7fdd197f1640 1 --2- 172.21.15.81:0/3534919388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360cc4a0 0x55d6360cc880 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000bd10 tx=0x7fdd100107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c78bc738355f2be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.267+0000 7fdd18ff0640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdd000a2e10 0x7fdd000a52d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdd141088c0 tx=0x7fdd040041d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.267+0000 7fdcff7fe640 1 -- 172.21.15.81:0/3534919388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd10004030 con 0x55d6360cc4a0 2024-09-12T01:29:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.267+0000 7fdcff7fe640 1 -- 172.21.15.81:0/3534919388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd100041d0 con 0x55d6360cc4a0 2024-09-12T01:29:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.267+0000 7fdcff7fe640 1 -- 172.21.15.81:0/3534919388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd100117e0 con 0x55d6360cc4a0 2024-09-12T01:29:04.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.268+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3534919388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360cc4a0 msgr2=0x55d6360cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.268+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/3534919388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360cc4a0 0x55d6360cc880 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000bd10 tx=0x7fdd100107a0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.268+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3534919388 shutdown_connections 2024-09-12T01:29:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.268+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/3534919388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360d7680 0x55d6360d9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.268+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/3534919388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360ccdc0 0x55d6360d7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.268+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/3534919388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360cc4a0 0x55d6360cc880 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.268+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3534919388 >> 172.21.15.81:0/3534919388 conn(0x55d6360c8a30 msgr2=0x55d6360c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.269+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3534919388 shutdown_connections 2024-09-12T01:29:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.269+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3534919388 wait complete. 2024-09-12T01:29:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.269+0000 7fdd1de2e740 1 -- start start 2024-09-12T01:29:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.269+0000 7fdd1de2e740 1 Processor -- start 2024-09-12T01:29:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.270+0000 7fdd1de2e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360ccdc0 0x55d6360d4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.270+0000 7fdd1de2e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d7680 0x55d6360d49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.270+0000 7fdd1de2e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360d4ee0 0x55d6360e36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.270+0000 7fdd1de2e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d6360da250 con 0x55d6360d4ee0 2024-09-12T01:29:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.270+0000 7fdd1de2e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d635fed050 con 0x55d6360d7680 2024-09-12T01:29:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.270+0000 7fdd1de2e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d6360da3d0 con 0x55d6360ccdc0 2024-09-12T01:29:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.270+0000 7fdd1de2e740 10 client.0 _ll_register_callbacks cb 0x55d63602d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.270+0000 7fdd19ff2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360d4ee0 0x55d6360e36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.270+0000 7fdd19ff2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360d4ee0 0x55d6360e36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48948/0 (socket says 172.21.15.81:48948) 2024-09-12T01:29:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.270+0000 7fdd19ff2640 1 -- 172.21.15.81:0/1699843117 learned_addr learned my addr 172.21.15.81:0/1699843117 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.270+0000 7fdd18ff0640 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d7680 0x55d6360d49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.270+0000 7fdd197f1640 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360ccdc0 0x55d6360d4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.271+0000 7fdd19ff2640 1 -- 172.21.15.81:0/1699843117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360ccdc0 msgr2=0x55d6360d4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.271+0000 7fdd19ff2640 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360ccdc0 0x55d6360d4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.271+0000 7fdd19ff2640 1 -- 172.21.15.81:0/1699843117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d7680 msgr2=0x55d6360d49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.271+0000 7fdd19ff2640 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d7680 0x55d6360d49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.271+0000 7fdd19ff2640 1 -- 172.21.15.81:0/1699843117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d635da33c0 con 0x55d6360d4ee0 2024-09-12T01:29:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.271+0000 7fdd197f1640 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360ccdc0 0x55d6360d4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.271+0000 7fdd19ff2640 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360d4ee0 0x55d6360e36c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0b92f0 tx=0x7fdd0c0bc9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbee168bc86a4f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.271+0000 7fdcfcff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdcfcff9640 1 -- 172.21.15.81:0/1699843117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c02fe90 con 0x55d6360d4ee0 2024-09-12T01:29:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdcfcff9640 1 -- 172.21.15.81:0/1699843117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fdd0c0043c0 con 0x55d6360d4ee0 2024-09-12T01:29:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdd1de2e740 1 -- 172.21.15.81:0/1699843117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd100041d0 con 0x55d6360d4ee0 2024-09-12T01:29:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdcfcff9640 1 -- 172.21.15.81:0/1699843117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdd0c0bce90 con 0x55d6360d4ee0 2024-09-12T01:29:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdd1de2e740 10 client.15717 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdd1de2e740 1 -- 172.21.15.81:0/1699843117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d6360da250 con 0x55d6360d4ee0 2024-09-12T01:29:04.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdcfcff9640 1 -- 172.21.15.81:0/1699843117 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd100041d0 con 0x55d6360d4ee0 2024-09-12T01:29:04.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdcfcff9640 1 -- 172.21.15.81:0/1699843117 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdd0c004b40 con 0x55d6360d4ee0 2024-09-12T01:29:04.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdd1de2e740 10 client.15717 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:04.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdd1de2e740 10 client.15717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:29:04.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdd1de2e740 20 client.15717 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:04.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d6360e75c0 0x55d6360e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdd1de2e740 4 client.15717 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:29:04.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.272+0000 7fdd1de2e740 1 -- 172.21.15.81:0/1699843117 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d63603f850 con 0x55d6360e75c0 2024-09-12T01:29:04.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.273+0000 7fdd197f1640 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d6360e75c0 0x55d6360e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.273+0000 7fdcfcff9640 10 client.15717 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:04.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.273+0000 7fdd197f1640 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d6360e75c0 0x55d6360e9a40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d831feb213f29b0 server_cookie=1f06d7bdf860f866 in_seq=0 out_seq=0 2024-09-12T01:29:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.274+0000 7fdcfcff9640 1 -- 172.21.15.81:0/1699843117 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d63603f850 con 0x55d6360e75c0 2024-09-12T01:29:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.274+0000 7fdcfcff9640 10 client.15717 handle_command_reply: tid=0 2024-09-12T01:29:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.274+0000 7fdd1de2e740 1 client.15717 shutdown 2024-09-12T01:29:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.274+0000 7fdd1de2e740 1 -- 172.21.15.81:0/1699843117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360d4ee0 msgr2=0x55d6360e36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.274+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360d4ee0 0x55d6360e36c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0b92f0 tx=0x7fdd0c0bc9d0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.274+0000 7fdd1de2e740 1 -- 172.21.15.81:0/1699843117 shutdown_connections 2024-09-12T01:29:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.274+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d6360e75c0 0x55d6360e9a40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.274+0000 7fdcfcff9640 0 client.15717 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.274+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360d4ee0 0x55d6360e36c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.274+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d7680 0x55d6360d49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.274+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/1699843117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360ccdc0 0x55d6360d4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.274+0000 7fdd1de2e740 1 -- 172.21.15.81:0/1699843117 >> 172.21.15.81:0/1699843117 conn(0x55d6360c8a30 msgr2=0x55d6360ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:04.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.275+0000 7fdd1de2e740 1 -- 172.21.15.81:0/1699843117 shutdown_connections 2024-09-12T01:29:04.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.275+0000 7fdd1de2e740 1 -- 172.21.15.81:0/1699843117 wait complete. 2024-09-12T01:29:04.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.275+0000 7fdd1de2e740 20 client.15717 trim_cache size 0 max 16384 2024-09-12T01:29:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.308+0000 7fdd1de2e740 1 Processor -- start 2024-09-12T01:29:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.308+0000 7fdd1de2e740 1 -- start start 2024-09-12T01:29:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.308+0000 7fdd1de2e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360ccdc0 0x55d6360ef350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.308+0000 7fdd1de2e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360d4ee0 0x55d6360ef890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.308+0000 7fdd1de2e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d7680 0x55d6360d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.308+0000 7fdd1de2e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141afaf0 con 0x55d6360ccdc0 2024-09-12T01:29:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.308+0000 7fdd1de2e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141b1630 con 0x55d6360d7680 2024-09-12T01:29:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.308+0000 7fdd1de2e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141b01c0 con 0x55d6360d4ee0 2024-09-12T01:29:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.308+0000 7fdd197f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360ccdc0 0x55d6360ef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.309+0000 7fdd197f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360ccdc0 0x55d6360ef350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48956/0 (socket says 172.21.15.81:48956) 2024-09-12T01:29:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.309+0000 7fdd197f1640 1 -- 172.21.15.81:0/41745846 learned_addr learned my addr 172.21.15.81:0/41745846 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.309+0000 7fdd19ff2640 1 --2- 172.21.15.81:0/41745846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d7680 0x55d6360d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.309+0000 7fdd18ff0640 1 --2- 172.21.15.81:0/41745846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360d4ee0 0x55d6360ef890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.309+0000 7fdd197f1640 1 -- 172.21.15.81:0/41745846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360d4ee0 msgr2=0x55d6360ef890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.309+0000 7fdd197f1640 1 --2- 172.21.15.81:0/41745846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360d4ee0 0x55d6360ef890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.309+0000 7fdd197f1640 1 -- 172.21.15.81:0/41745846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d7680 msgr2=0x55d6360d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.309+0000 7fdd197f1640 1 --2- 172.21.15.81:0/41745846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d7680 0x55d6360d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.309+0000 7fdd197f1640 1 -- 172.21.15.81:0/41745846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6360cc2d0 con 0x55d6360ccdc0 2024-09-12T01:29:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.310+0000 7fdd197f1640 1 --2- 172.21.15.81:0/41745846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360ccdc0 0x55d6360ef350 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000bce0 tx=0x7fdd10005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9a1c129eec5629 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.310+0000 7fdcfeffd640 1 -- 172.21.15.81:0/41745846 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd10036030 con 0x55d6360ccdc0 2024-09-12T01:29:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.310+0000 7fdcfeffd640 1 -- 172.21.15.81:0/41745846 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd10032e30 con 0x55d6360ccdc0 2024-09-12T01:29:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.310+0000 7fdcfeffd640 1 -- 172.21.15.81:0/41745846 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd100035f0 con 0x55d6360ccdc0 2024-09-12T01:29:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.311+0000 7fdd1de2e740 1 -- 172.21.15.81:0/41745846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360ccdc0 msgr2=0x55d6360ef350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.311+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/41745846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360ccdc0 0x55d6360ef350 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000bce0 tx=0x7fdd10005c70 comp rx=0 tx=0).stop 2024-09-12T01:29:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.311+0000 7fdd1de2e740 1 -- 172.21.15.81:0/41745846 shutdown_connections 2024-09-12T01:29:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.311+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/41745846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d7680 0x55d6360d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.311+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/41745846 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360d4ee0 0x55d6360ef890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.311+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/41745846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360ccdc0 0x55d6360ef350 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.311+0000 7fdd1de2e740 1 -- 172.21.15.81:0/41745846 >> 172.21.15.81:0/41745846 conn(0x55d6360c8a30 msgr2=0x55d6360d64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.311+0000 7fdd1de2e740 1 -- 172.21.15.81:0/41745846 shutdown_connections 2024-09-12T01:29:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.312+0000 7fdd1de2e740 1 -- 172.21.15.81:0/41745846 wait complete. 2024-09-12T01:29:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.312+0000 7fdd1de2e740 1 -- start start 2024-09-12T01:29:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.312+0000 7fdd1de2e740 1 Processor -- start 2024-09-12T01:29:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd1de2e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d4ee0 0x55d6360dfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd1de2e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360d7680 0x55d6360dcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd1de2e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360e75c0 0x55d6360dd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd1de2e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141b0f60 con 0x55d6360d7680 2024-09-12T01:29:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd1de2e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd141b0890 con 0x55d6360d4ee0 2024-09-12T01:29:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd1de2e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd14074900 con 0x55d6360e75c0 2024-09-12T01:29:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd1de2e740 10 client.0 _ll_register_callbacks cb 0x7fdd0c0b9130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd197f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d4ee0 0x55d6360dfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd197f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d4ee0 0x55d6360dfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:55362/0 (socket says 172.21.15.81:55362) 2024-09-12T01:29:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd197f1640 1 -- 172.21.15.81:0/3948491703 learned_addr learned my addr 172.21.15.81:0/3948491703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd18ff0640 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360d7680 0x55d6360dcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd19ff2640 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360e75c0 0x55d6360dd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd197f1640 1 -- 172.21.15.81:0/3948491703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360e75c0 msgr2=0x55d6360dd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd197f1640 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360e75c0 0x55d6360dd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd197f1640 1 -- 172.21.15.81:0/3948491703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360d7680 msgr2=0x55d6360dcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd197f1640 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360d7680 0x55d6360dcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd197f1640 1 -- 172.21.15.81:0/3948491703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6360ddd20 con 0x55d6360d4ee0 2024-09-12T01:29:04.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.313+0000 7fdd18ff0640 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360d7680 0x55d6360dcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:04.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.314+0000 7fdd197f1640 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d4ee0 0x55d6360dfd00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdd10013040 tx=0x7fdd1000b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3aeb1e2f589ede server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:04.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.314+0000 7fdcfcff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T01:29:04.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.314+0000 7fdcfcff9640 1 -- 172.21.15.81:0/3948491703 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd10040020 con 0x55d6360d4ee0 2024-09-12T01:29:04.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.314+0000 7fdcfcff9640 1 -- 172.21.15.81:0/3948491703 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fdd10005210 con 0x55d6360d4ee0 2024-09-12T01:29:04.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.314+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3948491703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd10032e30 con 0x55d6360d4ee0 2024-09-12T01:29:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.314+0000 7fdcfcff9640 1 -- 172.21.15.81:0/3948491703 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdd1004b050 con 0x55d6360d4ee0 2024-09-12T01:29:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.314+0000 7fdd1de2e740 10 client.25190 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.314+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3948491703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d6361522d0 con 0x55d6360d4ee0 2024-09-12T01:29:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.315+0000 7fdcfcff9640 1 -- 172.21.15.81:0/3948491703 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd100056a0 con 0x55d6360d4ee0 2024-09-12T01:29:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.315+0000 7fdcfcff9640 1 -- 172.21.15.81:0/3948491703 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdd100474b0 con 0x55d6360d4ee0 2024-09-12T01:29:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.315+0000 7fdd1de2e740 10 client.25190 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.315+0000 7fdd1de2e740 10 client.25190 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:29:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.315+0000 7fdd1de2e740 20 client.25190 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.315+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d6361527a0 0x55d636154b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.315+0000 7fdd1de2e740 4 client.25190 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:29:04.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.315+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3948491703 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fdd10032e30 con 0x55d6361527a0 2024-09-12T01:29:04.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.315+0000 7fdd18ff0640 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d6361527a0 0x55d636154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.316+0000 7fdd18ff0640 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d6361527a0 0x55d636154b90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef5d318b614e7c7d server_cookie=266005f6bacf876a in_seq=0 out_seq=0 2024-09-12T01:29:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.316+0000 7fdcfcff9640 10 client.25190 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.316+0000 7fdcfcff9640 1 -- 172.21.15.81:0/3948491703 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fdd10032e30 con 0x55d6361527a0 2024-09-12T01:29:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.316+0000 7fdcfcff9640 10 client.25190 handle_command_reply: tid=0 2024-09-12T01:29:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.317+0000 7fdd1de2e740 1 client.25190 shutdown 2024-09-12T01:29:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.317+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3948491703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d4ee0 msgr2=0x55d6360dfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.317+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d4ee0 0x55d6360dfd00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdd10013040 tx=0x7fdd1000b9d0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.317+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3948491703 shutdown_connections 2024-09-12T01:29:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.317+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d6361527a0 0x55d636154b90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.317+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6360e75c0 0x55d6360dd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.317+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6360d7680 0x55d6360dcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.317+0000 7fdd1de2e740 1 --2- 172.21.15.81:0/3948491703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6360d4ee0 0x55d6360dfd00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.317+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3948491703 >> 172.21.15.81:0/3948491703 conn(0x55d6360c8a30 msgr2=0x55d6360c7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:04.323 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:29:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:29:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-12T01:29:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "8c280b75-142f-41d5-a061-13bed726f2fe": { 2024-09-12T01:29:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-09-12T01:29:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "8c280b75-142f-41d5-a061-13bed726f2fe", 2024-09-12T01:29:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-12T01:29:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:29:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:29:04.324 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:29:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.317+0000 7fdcfcff9640 0 client.25190 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.317+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3948491703 shutdown_connections 2024-09-12T01:29:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.317+0000 7fdd1de2e740 1 -- 172.21.15.81:0/3948491703 wait complete. 2024-09-12T01:29:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.317+0000 7fdd1de2e740 20 client.25190 trim_cache size 0 max 16384 2024-09-12T01:29:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.318+0000 7fdd1ba55640 1 -- 172.21.15.81:0/1369335864 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdd000a2e10 msgr2=0x7fdd000a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.318+0000 7fdd1ba55640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdd000a2e10 0x7fdd000a52d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdd141088c0 tx=0x7fdd040041d0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.318+0000 7fdd1ba55640 1 -- 172.21.15.81:0/1369335864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14106f40 msgr2=0x7fdd1419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:04.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.318+0000 7fdd1ba55640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14106f40 0x7fdd1419ccd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c031a20 tx=0x7fdd0c031a50 comp rx=0 tx=0).stop 2024-09-12T01:29:04.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.318+0000 7fdd1ba55640 1 -- 172.21.15.81:0/1369335864 shutdown_connections 2024-09-12T01:29:04.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.318+0000 7fdd1ba55640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdd000a2e10 0x7fdd000a52d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.318+0000 7fdd1ba55640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd14106f40 0x7fdd1419ccd0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.318+0000 7fdd1ba55640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd141027c0 0x7fdd14198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.318+0000 7fdd1ba55640 1 --2- 172.21.15.81:0/1369335864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd14101e10 0x7fdd14198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:04.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.318+0000 7fdd1ba55640 1 -- 172.21.15.81:0/1369335864 >> 172.21.15.81:0/1369335864 conn(0x7fdd140fd8d0 msgr2=0x7fdd140fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:04.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.318+0000 7fdd1ba55640 1 -- 172.21.15.81:0/1369335864 shutdown_connections 2024-09-12T01:29:04.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:04.318+0000 7fdd1ba55640 1 -- 172.21.15.81:0/1369335864 wait complete. 2024-09-12T01:29:04.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:04 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:29:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:04 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:29:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:04 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:29:04.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:04 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:29:04.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:04 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:29:04.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:04 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:29:04.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:04 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:29:04.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:04 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:29:04.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:04 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:29:04.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:04 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:29:04.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:04 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:29:04.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:04 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:29:04.926 INFO:tasks.cephfs.filesystem:scrub status for tag:8c280b75-142f-41d5-a061-13bed726f2fe - {'path': '/', 'tag': '8c280b75-142f-41d5-a061-13bed726f2fe', 'options': 'recursive,force'} 2024-09-12T01:29:05.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:05 smithi100 ceph-mon[35275]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T01:29:05.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:05 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:29:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:05 smithi189 ceph-mon[35357]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T01:29:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:05 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:29:05.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:05 smithi081 ceph-mon[30920]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T01:29:05.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:05 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:29:07.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:07 smithi100 ceph-mon[35275]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-12T01:29:07.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:07 smithi189 ceph-mon[35357]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-12T01:29:07.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:07 smithi081 ceph-mon[30920]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-12T01:29:09.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:09 smithi100 ceph-mon[35275]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-12T01:29:09.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:09 smithi189 ceph-mon[35357]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-12T01:29:09.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:09 smithi081 ceph-mon[30920]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-12T01:29:11.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:11 smithi100 ceph-mon[35275]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-12T01:29:11.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:11 smithi189 ceph-mon[35357]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-12T01:29:11.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:11 smithi081 ceph-mon[30920]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-12T01:29:12.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:12 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:29:12.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:12 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:29:12.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:12 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:29:12.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:12 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:29:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:12 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:29:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:12 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:29:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:12 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:29:12.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:12 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:29:12.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:12 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:29:12.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:12 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:29:12.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:12 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:29:12.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:12 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:29:13.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:13 smithi100 ceph-mon[35275]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-12T01:29:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:13 smithi189 ceph-mon[35357]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-12T01:29:13.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:13 smithi081 ceph-mon[30920]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-12T01:29:14.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:29:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:29:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.845+0000 7f36b80e4640 1 -- 172.21.15.81:0/182671688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0102110 msgr2=0x7f36b010d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.845+0000 7f36b80e4640 1 --2- 172.21.15.81:0/182671688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0102110 0x7f36b010d890 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009ca0 tx=0x7f36a802a950 comp rx=0 tx=0).stop 2024-09-12T01:29:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.846+0000 7f36b80e4640 1 -- 172.21.15.81:0/182671688 shutdown_connections 2024-09-12T01:29:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.846+0000 7f36b80e4640 1 --2- 172.21.15.81:0/182671688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0102110 0x7f36b010d890 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.846+0000 7f36b80e4640 1 --2- 172.21.15.81:0/182671688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36b0101790 0x7f36b0101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.846+0000 7f36b80e4640 1 --2- 172.21.15.81:0/182671688 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36b0105ba0 0x7f36b0105f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.846+0000 7f36b80e4640 1 -- 172.21.15.81:0/182671688 >> 172.21.15.81:0/182671688 conn(0x7f36b0077210 msgr2=0x7f36b0077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.846+0000 7f36b80e4640 1 -- 172.21.15.81:0/182671688 shutdown_connections 2024-09-12T01:29:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.846+0000 7f36b80e4640 1 -- 172.21.15.81:0/182671688 wait complete. 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.847+0000 7f36b80e4640 1 Processor -- start 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.847+0000 7f36b80e4640 1 -- start start 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.847+0000 7f36b80e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36b0101790 0x7f36b010c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.847+0000 7f36b80e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0102110 0x7f36b010cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.847+0000 7f36b80e4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36b0105ba0 0x7f36b01a3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.847+0000 7f36b567f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0102110 0x7f36b010cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:14.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.848+0000 7f36b567f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0102110 0x7f36b010cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34590/0 (socket says 172.21.15.81:34590) 2024-09-12T01:29:14.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.848+0000 7f36b5e80640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36b0101790 0x7f36b010c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:14.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.848+0000 7f36b5e80640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36b0101790 0x7f36b010c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:37794/0 (socket says 172.21.15.81:37794) 2024-09-12T01:29:14.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.848+0000 7f36b567f640 1 -- 172.21.15.81:0/190430432 learned_addr learned my addr 172.21.15.81:0/190430432 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:14.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.848+0000 7f36b80e4640 1 -- 172.21.15.81:0/190430432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36b0111fc0 con 0x7f36b0102110 2024-09-12T01:29:14.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.848+0000 7f36b80e4640 1 -- 172.21.15.81:0/190430432 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f36b0111e40 con 0x7f36b0101790 2024-09-12T01:29:14.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.848+0000 7f36b80e4640 1 -- 172.21.15.81:0/190430432 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f36b0112140 con 0x7f36b0105ba0 2024-09-12T01:29:14.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.848+0000 7f36b6681640 1 --2- 172.21.15.81:0/190430432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36b0105ba0 0x7f36b01a3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.849+0000 7f36b567f640 1 -- 172.21.15.81:0/190430432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36b0105ba0 msgr2=0x7f36b01a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.849+0000 7f36b567f640 1 --2- 172.21.15.81:0/190430432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36b0105ba0 0x7f36b01a3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.849+0000 7f36b567f640 1 -- 172.21.15.81:0/190430432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36b0101790 msgr2=0x7f36b010c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.849+0000 7f36b567f640 1 --2- 172.21.15.81:0/190430432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36b0101790 0x7f36b010c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.849+0000 7f36b567f640 1 -- 172.21.15.81:0/190430432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b01a38a0 con 0x7f36b0102110 2024-09-12T01:29:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.849+0000 7f36b567f640 1 --2- 172.21.15.81:0/190430432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0102110 0x7f36b010cf30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f36a000e9f0 tx=0x7f36a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.849+0000 7f36a6ffd640 1 -- 172.21.15.81:0/190430432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a000cd80 con 0x7f36b0102110 2024-09-12T01:29:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.849+0000 7f36a6ffd640 1 -- 172.21.15.81:0/190430432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36a0010910 con 0x7f36b0102110 2024-09-12T01:29:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.849+0000 7f36a6ffd640 1 -- 172.21.15.81:0/190430432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a000cd80 con 0x7f36b0102110 2024-09-12T01:29:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.850+0000 7f36b80e4640 1 -- 172.21.15.81:0/190430432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b01a3b90 con 0x7f36b0102110 2024-09-12T01:29:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.850+0000 7f36b80e4640 1 -- 172.21.15.81:0/190430432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b01ab420 con 0x7f36b0102110 2024-09-12T01:29:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.851+0000 7f36a4ff9640 1 -- 172.21.15.81:0/190430432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3698005290 con 0x7f36b0102110 2024-09-12T01:29:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.853+0000 7f36a6ffd640 1 -- 172.21.15.81:0/190430432 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f36a0010ac0 con 0x7f36b0102110 2024-09-12T01:29:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.854+0000 7f36a6ffd640 1 --2- 172.21.15.81:0/190430432 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f369c0a3210 0x7f369c0a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.855+0000 7f36a6ffd640 1 -- 172.21.15.81:0/190430432 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f36a000cb80 con 0x7f36b0102110 2024-09-12T01:29:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.855+0000 7f36b5e80640 1 --2- 172.21.15.81:0/190430432 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f369c0a3210 0x7f369c0a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.856+0000 7f36b5e80640 1 --2- 172.21.15.81:0/190430432 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f369c0a3210 0x7f369c0a56d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f36ac005fd0 tx=0x7f36ac00b390 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:14.863+0000 7f36a6ffd640 1 -- 172.21.15.81:0/190430432 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36a009b810 con 0x7f36b0102110 2024-09-12T01:29:15.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.282+0000 7f36a4ff9640 1 -- 172.21.15.81:0/190430432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3698005850 con 0x7f36b0102110 2024-09-12T01:29:15.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.283+0000 7f36a6ffd640 1 -- 172.21.15.81:0/190430432 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f36a009fb10 con 0x7f36b0102110 2024-09-12T01:29:15.283 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:29:15.283 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:29:15.283 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.286+0000 7f36a4ff9640 1 -- 172.21.15.81:0/190430432 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f369c0a3210 msgr2=0x7f369c0a56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.286+0000 7f36a4ff9640 1 --2- 172.21.15.81:0/190430432 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f369c0a3210 0x7f369c0a56d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f36ac005fd0 tx=0x7f36ac00b390 comp rx=0 tx=0).stop 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.286+0000 7f36a4ff9640 1 -- 172.21.15.81:0/190430432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0102110 msgr2=0x7f36b010cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.286+0000 7f36a4ff9640 1 --2- 172.21.15.81:0/190430432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0102110 0x7f36b010cf30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f36a000e9f0 tx=0x7f36a000eeb0 comp rx=0 tx=0).stop 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.286+0000 7f36a4ff9640 1 -- 172.21.15.81:0/190430432 shutdown_connections 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.286+0000 7f36a4ff9640 1 --2- 172.21.15.81:0/190430432 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f369c0a3210 0x7f369c0a56d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.286+0000 7f36a4ff9640 1 --2- 172.21.15.81:0/190430432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f36b0105ba0 0x7f36b01a3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.286+0000 7f36a4ff9640 1 --2- 172.21.15.81:0/190430432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36b0102110 0x7f36b010cf30 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.286+0000 7f36a4ff9640 1 --2- 172.21.15.81:0/190430432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36b0101790 0x7f36b010c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.286+0000 7f36a4ff9640 1 -- 172.21.15.81:0/190430432 >> 172.21.15.81:0/190430432 conn(0x7f36b0077210 msgr2=0x7f36b00fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.288+0000 7f36a4ff9640 1 -- 172.21.15.81:0/190430432 shutdown_connections 2024-09-12T01:29:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:15.288+0000 7f36a4ff9640 1 -- 172.21.15.81:0/190430432 wait complete. 2024-09-12T01:29:15.575 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:15 smithi081 ceph-mon[30920]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-12T01:29:15.575 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:15 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/190430432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:29:15.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:15 smithi100 ceph-mon[35275]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-12T01:29:15.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:15 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/190430432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:29:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:15 smithi189 ceph-mon[35357]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-12T01:29:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:15 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/190430432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:29:16.140 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 3c3cf9a8 --release --await' 2024-09-12T01:29:16.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 3c3cf9a8 --release --await 2024-09-12T01:29:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:29:17.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.048+0000 7f37af8d2640 1 -- 172.21.15.81:0/12812887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a8100e20 msgr2=0x7f37a8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:17.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.048+0000 7f37af8d2640 1 --2- 172.21.15.81:0/12812887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a8100e20 0x7f37a8101200 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009900 tx=0x7f37a402a480 comp rx=0 tx=0).stop 2024-09-12T01:29:17.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.048+0000 7f37af8d2640 1 -- 172.21.15.81:0/12812887 shutdown_connections 2024-09-12T01:29:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.048+0000 7f37af8d2640 1 --2- 172.21.15.81:0/12812887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37a8102ef0 0x7f37a810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.048+0000 7f37af8d2640 1 --2- 172.21.15.81:0/12812887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37a8102570 0x7f37a81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.048+0000 7f37af8d2640 1 --2- 172.21.15.81:0/12812887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a8100e20 0x7f37a8101200 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.048+0000 7f37af8d2640 1 -- 172.21.15.81:0/12812887 >> 172.21.15.81:0/12812887 conn(0x7f37a80fc7d0 msgr2=0x7f37a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.048+0000 7f37af8d2640 1 -- 172.21.15.81:0/12812887 shutdown_connections 2024-09-12T01:29:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.048+0000 7f37af8d2640 1 -- 172.21.15.81:0/12812887 wait complete. 2024-09-12T01:29:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.049+0000 7f37af8d2640 1 Processor -- start 2024-09-12T01:29:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.049+0000 7f37af8d2640 1 -- start start 2024-09-12T01:29:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37af8d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a8100e20 0x7f37a81993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37af8d2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37a8102570 0x7f37a81998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37af8d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37a8102ef0 0x7f37a81a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37af8d2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37a8110ff0 con 0x7f37a8100e20 2024-09-12T01:29:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37ad66e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a8100e20 0x7f37a81993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37af8d2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f37a8110e70 con 0x7f37a8102ef0 2024-09-12T01:29:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37af8d2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f37a8111170 con 0x7f37a8102570 2024-09-12T01:29:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37ad66e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a8100e20 0x7f37a81993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34606/0 (socket says 172.21.15.81:34606) 2024-09-12T01:29:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37ad66e640 1 -- 172.21.15.81:0/1738249838 learned_addr learned my addr 172.21.15.81:0/1738249838 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37ace6d640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37a8102570 0x7f37a81998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37ade6f640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37a8102ef0 0x7f37a81a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37ace6d640 1 -- 172.21.15.81:0/1738249838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37a8102ef0 msgr2=0x7f37a81a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37ace6d640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37a8102ef0 0x7f37a81a4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37ace6d640 1 -- 172.21.15.81:0/1738249838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a8100e20 msgr2=0x7f37a81993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37ace6d640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a8100e20 0x7f37a81993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37ace6d640 1 -- 172.21.15.81:0/1738249838 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a81a4960 con 0x7f37a8102570 2024-09-12T01:29:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.050+0000 7f37ad66e640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a8100e20 0x7f37a81993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.051+0000 7f37ace6d640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37a8102570 0x7f37a81998e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3798007b50 tx=0x7f3798010420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.051+0000 7f379e7fc640 1 -- 172.21.15.81:0/1738249838 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379801b020 con 0x7f37a8102570 2024-09-12T01:29:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.051+0000 7f379e7fc640 1 -- 172.21.15.81:0/1738249838 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3798010b30 con 0x7f37a8102570 2024-09-12T01:29:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.051+0000 7f37af8d2640 1 -- 172.21.15.81:0/1738249838 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a8197190 con 0x7f37a8102570 2024-09-12T01:29:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.051+0000 7f37af8d2640 1 -- 172.21.15.81:0/1738249838 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a8197680 con 0x7f37a8102570 2024-09-12T01:29:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.052+0000 7f379e7fc640 1 -- 172.21.15.81:0/1738249838 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37980047a0 con 0x7f37a8102570 2024-09-12T01:29:17.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.055+0000 7f379e7fc640 1 -- 172.21.15.81:0/1738249838 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f3798004940 con 0x7f37a8102570 2024-09-12T01:29:17.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.055+0000 7f37b1cab740 1 Processor -- start 2024-09-12T01:29:17.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.055+0000 7f37b1cab740 1 -- start start 2024-09-12T01:29:17.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.055+0000 7f37b1cab740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 0x55d64f6cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.055+0000 7f37b1cab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 0x55d64f6d9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.055+0000 7f37b1cab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6da220 0x55d64f6dc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.055+0000 7f37b1cab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d64f634620 con 0x55d64f6da220 2024-09-12T01:29:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.055+0000 7f37b1cab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d64f5dbe50 con 0x55d64f6cf960 2024-09-12T01:29:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.055+0000 7f37b1cab740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d64f6305e0 con 0x55d64f6cf040 2024-09-12T01:29:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.056+0000 7f37ace6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6da220 0x55d64f6dc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.056+0000 7f37ad66e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 0x55d64f6d9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.056+0000 7f37ad66e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 0x55d64f6d9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:37810/0 (socket says 172.21.15.81:37810) 2024-09-12T01:29:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.056+0000 7f37ad66e640 1 -- 172.21.15.81:0/2441496600 learned_addr learned my addr 172.21.15.81:0/2441496600 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.056+0000 7f37ade6f640 1 --2- 172.21.15.81:0/2441496600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 0x55d64f6cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.056+0000 7f37ad66e640 1 -- 172.21.15.81:0/2441496600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 msgr2=0x55d64f6cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.056+0000 7f37ad66e640 1 --2- 172.21.15.81:0/2441496600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 0x55d64f6cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.056+0000 7f37ad66e640 1 -- 172.21.15.81:0/2441496600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6da220 msgr2=0x55d64f6dc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.056+0000 7f379e7fc640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f37940a2e10 0x7f37940a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.056+0000 7f37ad66e640 1 --2- 172.21.15.81:0/2441496600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6da220 0x55d64f6dc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.056+0000 7f37ad66e640 1 -- 172.21.15.81:0/2441496600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d64f5ccd40 con 0x55d64f6cf960 2024-09-12T01:29:17.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.056+0000 7f37ade6f640 1 --2- 172.21.15.81:0/2441496600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 0x55d64f6cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:17.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.057+0000 7f37ace6d640 1 --2- 172.21.15.81:0/2441496600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6da220 0x55d64f6dc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:17.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.057+0000 7f379e7fc640 1 -- 172.21.15.81:0/1738249838 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f37980d2e00 con 0x7f37a8102570 2024-09-12T01:29:17.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.057+0000 7f37ade6f640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f37940a2e10 0x7f37940a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.057+0000 7f37ad66e640 1 --2- 172.21.15.81:0/2441496600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 0x55d64f6d9ce0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f37a4004640 tx=0x7f37a40035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ecc0c41f1430af9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:17.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.057+0000 7f37937fe640 1 -- 172.21.15.81:0/2441496600 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4040070 con 0x55d64f6cf960 2024-09-12T01:29:17.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.057+0000 7f37937fe640 1 -- 172.21.15.81:0/2441496600 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37a4003810 con 0x55d64f6cf960 2024-09-12T01:29:17.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.057+0000 7f37937fe640 1 -- 172.21.15.81:0/2441496600 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4035040 con 0x55d64f6cf960 2024-09-12T01:29:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.058+0000 7f37b1cab740 1 -- 172.21.15.81:0/2441496600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 msgr2=0x55d64f6d9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.058+0000 7f37ade6f640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f37940a2e10 0x7f37940a52d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009fd0 tx=0x7f37a000d040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.058+0000 7f37b1cab740 1 --2- 172.21.15.81:0/2441496600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 0x55d64f6d9ce0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f37a4004640 tx=0x7f37a40035f0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.058+0000 7f37b1cab740 1 -- 172.21.15.81:0/2441496600 shutdown_connections 2024-09-12T01:29:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.058+0000 7f37b1cab740 1 --2- 172.21.15.81:0/2441496600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6da220 0x55d64f6dc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.058+0000 7f37b1cab740 1 --2- 172.21.15.81:0/2441496600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 0x55d64f6d9ce0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.058+0000 7f37b1cab740 1 --2- 172.21.15.81:0/2441496600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 0x55d64f6cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.058+0000 7f37b1cab740 1 -- 172.21.15.81:0/2441496600 >> 172.21.15.81:0/2441496600 conn(0x55d64f6cb5d0 msgr2=0x55d64f6cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:17.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.058+0000 7f37b1cab740 1 -- 172.21.15.81:0/2441496600 shutdown_connections 2024-09-12T01:29:17.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.058+0000 7f37b1cab740 1 -- 172.21.15.81:0/2441496600 wait complete. 2024-09-12T01:29:17.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.059+0000 7f37b1cab740 1 -- start start 2024-09-12T01:29:17.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.059+0000 7f37b1cab740 1 Processor -- start 2024-09-12T01:29:17.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.059+0000 7f37b1cab740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 0x55d64f6d70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37b1cab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 0x55d64f6d7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37b1cab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6da220 0x55d64f6d7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37b1cab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d64f6e5600 con 0x55d64f6da220 2024-09-12T01:29:17.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37b1cab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d64f5bcf10 con 0x55d64f6cf960 2024-09-12T01:29:17.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37b1cab740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d64f6e5780 con 0x55d64f6cf040 2024-09-12T01:29:17.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37b1cab740 10 client.0 _ll_register_callbacks cb 0x55d64f5e0db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:17.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37ace6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 0x55d64f6d7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37ace6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 0x55d64f6d7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:37818/0 (socket says 172.21.15.81:37818) 2024-09-12T01:29:17.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37ace6d640 1 -- 172.21.15.81:0/1874247157 learned_addr learned my addr 172.21.15.81:0/1874247157 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:17.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37ad66e640 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 0x55d64f6d70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37ade6f640 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6da220 0x55d64f6d7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37ace6d640 1 -- 172.21.15.81:0/1874247157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 msgr2=0x55d64f6d70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:17.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37ace6d640 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 0x55d64f6d70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37ace6d640 1 -- 172.21.15.81:0/1874247157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6da220 msgr2=0x55d64f6d7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:17.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37ace6d640 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6da220 0x55d64f6d7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37ace6d640 1 -- 172.21.15.81:0/1874247157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d64f343580 con 0x55d64f6cf960 2024-09-12T01:29:17.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.060+0000 7f37ade6f640 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6da220 0x55d64f6d7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:17.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.061+0000 7f37ace6d640 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 0x55d64f6d7630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f37980a77e0 tx=0x7f3798005190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9745425a2afbe45f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:17.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.061+0000 7f3790ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T01:29:17.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.061+0000 7f3790ff9640 1 -- 172.21.15.81:0/1874247157 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379809f830 con 0x55d64f6cf960 2024-09-12T01:29:17.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.061+0000 7f37b1cab740 1 -- 172.21.15.81:0/1874247157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37a4003810 con 0x55d64f6cf960 2024-09-12T01:29:17.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.061+0000 7f3790ff9640 1 -- 172.21.15.81:0/1874247157 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f37980a3190 con 0x55d64f6cf960 2024-09-12T01:29:17.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.061+0000 7f3790ff9640 1 -- 172.21.15.81:0/1874247157 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f37980b8050 con 0x55d64f6cf960 2024-09-12T01:29:17.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.061+0000 7f37b1cab740 10 client.25205 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:17.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.061+0000 7f37b1cab740 1 -- 172.21.15.81:0/1874247157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d64f40d960 con 0x55d64f6cf960 2024-09-12T01:29:17.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.062+0000 7f3790ff9640 1 -- 172.21.15.81:0/1874247157 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37a4003810 con 0x55d64f6cf960 2024-09-12T01:29:17.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.062+0000 7f3790ff9640 1 -- 172.21.15.81:0/1874247157 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f37980bdce0 con 0x55d64f6cf960 2024-09-12T01:29:17.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.062+0000 7f37b1cab740 10 client.25205 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:17.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.062+0000 7f37b1cab740 10 client.25205 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T01:29:17.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.062+0000 7f37b1cab740 20 client.25205 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:17.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.062+0000 7f37b1cab740 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d64f6f2520 0x55d64f6f4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.062+0000 7f37b1cab740 4 client.25205 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:29:17.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.062+0000 7f37b1cab740 1 -- 172.21.15.81:0/1874247157 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d64f641b90 con 0x55d64f6f2520 2024-09-12T01:29:17.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.062+0000 7f37ad66e640 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d64f6f2520 0x55d64f6f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.063+0000 7f37ad66e640 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d64f6f2520 0x55d64f6f4910 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b97c1cca248178 server_cookie=bc52ee5a5ff40406 in_seq=0 out_seq=0 2024-09-12T01:29:17.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.063+0000 7f3790ff9640 10 client.25205 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:17.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.063+0000 7f3790ff9640 1 -- 172.21.15.81:0/1874247157 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d64f641b90 con 0x55d64f6f2520 2024-09-12T01:29:17.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.063+0000 7f3790ff9640 10 client.25205 handle_command_reply: tid=0 2024-09-12T01:29:17.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.063+0000 7f37b1cab740 1 client.25205 shutdown 2024-09-12T01:29:17.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.064+0000 7f37b1cab740 1 -- 172.21.15.81:0/1874247157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 msgr2=0x55d64f6d7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:17.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.064+0000 7f37b1cab740 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 0x55d64f6d7630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f37980a77e0 tx=0x7f3798005190 comp rx=0 tx=0).stop 2024-09-12T01:29:17.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.064+0000 7f37b1cab740 1 -- 172.21.15.81:0/1874247157 shutdown_connections 2024-09-12T01:29:17.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.064+0000 7f37b1cab740 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d64f6f2520 0x55d64f6f4910 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.064+0000 7f3790ff9640 0 client.25205 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:17.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.064+0000 7f37b1cab740 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6da220 0x55d64f6d7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.064+0000 7f37b1cab740 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf960 0x55d64f6d7630 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.064+0000 7f37b1cab740 1 --2- 172.21.15.81:0/1874247157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 0x55d64f6d70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.064+0000 7f37b1cab740 1 -- 172.21.15.81:0/1874247157 >> 172.21.15.81:0/1874247157 conn(0x55d64f6cb5d0 msgr2=0x55d64f6d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:17.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.064+0000 7f37b1cab740 1 -- 172.21.15.81:0/1874247157 shutdown_connections 2024-09-12T01:29:17.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.064+0000 7f37b1cab740 1 -- 172.21.15.81:0/1874247157 wait complete. 2024-09-12T01:29:17.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.064+0000 7f37b1cab740 20 client.25205 trim_cache size 0 max 16384 2024-09-12T01:29:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.081+0000 7f37b1cab740 1 Processor -- start 2024-09-12T01:29:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.081+0000 7f37b1cab740 1 -- start start 2024-09-12T01:29:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.081+0000 7f37b1cab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf040 0x55d64f6fa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.081+0000 7f37b1cab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6cf960 0x55d64f6fa720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.081+0000 7f37b1cab740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6da220 0x55d64f6d4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.081+0000 7f37b1cab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37a81ab640 con 0x55d64f6cf960 2024-09-12T01:29:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.081+0000 7f37b1cab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f37a81ad180 con 0x55d64f6cf040 2024-09-12T01:29:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.081+0000 7f37b1cab740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f37a81abd10 con 0x55d64f6da220 2024-09-12T01:29:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.081+0000 7f37ace6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6cf960 0x55d64f6fa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.082+0000 7f37ace6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6cf960 0x55d64f6fa720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34626/0 (socket says 172.21.15.81:34626) 2024-09-12T01:29:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.082+0000 7f37ace6d640 1 -- 172.21.15.81:0/3492777971 learned_addr learned my addr 172.21.15.81:0/3492777971 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.082+0000 7f37ad66e640 1 --2- 172.21.15.81:0/3492777971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf040 0x55d64f6fa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.082+0000 7f37ade6f640 1 --2- 172.21.15.81:0/3492777971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6da220 0x55d64f6d4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.082+0000 7f37ace6d640 1 -- 172.21.15.81:0/3492777971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6da220 msgr2=0x55d64f6d4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.082+0000 7f37ace6d640 1 --2- 172.21.15.81:0/3492777971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6da220 0x55d64f6d4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.082+0000 7f37ace6d640 1 -- 172.21.15.81:0/3492777971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf040 msgr2=0x55d64f6fa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.082+0000 7f37ace6d640 1 --2- 172.21.15.81:0/3492777971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf040 0x55d64f6fa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.082+0000 7f37ace6d640 1 -- 172.21.15.81:0/3492777971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d64f6cf790 con 0x55d64f6cf960 2024-09-12T01:29:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.082+0000 7f37ad66e640 1 --2- 172.21.15.81:0/3492777971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf040 0x55d64f6fa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.082+0000 7f37ace6d640 1 --2- 172.21.15.81:0/3492777971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6cf960 0x55d64f6fa720 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f379800b440 tx=0x7f37980d09c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff325bf289b50e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.082+0000 7f3792ffd640 1 -- 172.21.15.81:0/3492777971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379809ec70 con 0x55d64f6cf960 2024-09-12T01:29:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.083+0000 7f3792ffd640 1 -- 172.21.15.81:0/3492777971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37980d02e0 con 0x55d64f6cf960 2024-09-12T01:29:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.083+0000 7f3792ffd640 1 -- 172.21.15.81:0/3492777971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798004e90 con 0x55d64f6cf960 2024-09-12T01:29:17.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.083+0000 7f37b1cab740 1 -- 172.21.15.81:0/3492777971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6cf960 msgr2=0x55d64f6fa720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:17.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.083+0000 7f37b1cab740 1 --2- 172.21.15.81:0/3492777971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6cf960 0x55d64f6fa720 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f379800b440 tx=0x7f37980d09c0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.083+0000 7f37b1cab740 1 -- 172.21.15.81:0/3492777971 shutdown_connections 2024-09-12T01:29:17.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.083+0000 7f37b1cab740 1 --2- 172.21.15.81:0/3492777971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6da220 0x55d64f6d4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.083+0000 7f37b1cab740 1 --2- 172.21.15.81:0/3492777971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6cf960 0x55d64f6fa720 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.083+0000 7f37b1cab740 1 --2- 172.21.15.81:0/3492777971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6cf040 0x55d64f6fa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.083+0000 7f37b1cab740 1 -- 172.21.15.81:0/3492777971 >> 172.21.15.81:0/3492777971 conn(0x55d64f6cb5d0 msgr2=0x55d64f6d59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.084+0000 7f37b1cab740 1 -- 172.21.15.81:0/3492777971 shutdown_connections 2024-09-12T01:29:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.084+0000 7f37b1cab740 1 -- 172.21.15.81:0/3492777971 wait complete. 2024-09-12T01:29:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.084+0000 7f37b1cab740 1 -- start start 2024-09-12T01:29:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.084+0000 7f37b1cab740 1 Processor -- start 2024-09-12T01:29:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.084+0000 7f37b1cab740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 0x55d64f6e6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.084+0000 7f37b1cab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6da220 0x55d64f6e74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.084+0000 7f37b1cab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6f2520 0x55d64f7561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37b1cab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37a81acab0 con 0x55d64f6f2520 2024-09-12T01:29:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37b1cab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f37a81ac3e0 con 0x55d64f6da220 2024-09-12T01:29:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37b1cab740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f37a81a9620 con 0x55d64f6cf040 2024-09-12T01:29:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37b1cab740 10 client.0 _ll_register_callbacks cb 0x7f37980056f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37ade6f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6f2520 0x55d64f7561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37ade6f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6f2520 0x55d64f7561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34638/0 (socket says 172.21.15.81:34638) 2024-09-12T01:29:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37ade6f640 1 -- 172.21.15.81:0/141531108 learned_addr learned my addr 172.21.15.81:0/141531108 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37ad66e640 1 --2- 172.21.15.81:0/141531108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 0x55d64f6e6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37ade6f640 1 -- 172.21.15.81:0/141531108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 msgr2=0x55d64f6e6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37ade6f640 1 --2- 172.21.15.81:0/141531108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 0x55d64f6e6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37ade6f640 1 -- 172.21.15.81:0/141531108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6da220 msgr2=0x55d64f6e74e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:29:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37ade6f640 1 --2- 172.21.15.81:0/141531108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6da220 0x55d64f6e74e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37ade6f640 1 -- 172.21.15.81:0/141531108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d64f756890 con 0x55d64f6f2520 2024-09-12T01:29:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f37ade6f640 1 --2- 172.21.15.81:0/141531108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6f2520 0x55d64f7561f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f37a0018c50 tx=0x7f37a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc3b38b1572b865 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.085+0000 7f3790ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.086+0000 7f3790ff9640 1 -- 172.21.15.81:0/141531108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a0027020 con 0x55d64f6f2520 2024-09-12T01:29:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.086+0000 7f3790ff9640 1 -- 172.21.15.81:0/141531108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f37a0023650 con 0x55d64f6f2520 2024-09-12T01:29:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.086+0000 7f37b1cab740 1 -- 172.21.15.81:0/141531108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37980d02e0 con 0x55d64f6f2520 2024-09-12T01:29:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.086+0000 7f3790ff9640 1 -- 172.21.15.81:0/141531108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f37a0032050 con 0x55d64f6f2520 2024-09-12T01:29:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.086+0000 7f37b1cab740 10 client.15747 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.086+0000 7f37b1cab740 1 -- 172.21.15.81:0/141531108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d64f75dcc0 con 0x55d64f6f2520 2024-09-12T01:29:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.086+0000 7f3790ff9640 1 -- 172.21.15.81:0/141531108 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37980d02e0 con 0x55d64f6f2520 2024-09-12T01:29:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.086+0000 7f3790ff9640 1 -- 172.21.15.81:0/141531108 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f37a0016880 con 0x55d64f6f2520 2024-09-12T01:29:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.087+0000 7f37b1cab740 10 client.15747 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.087+0000 7f37b1cab740 10 client.15747 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T01:29:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.087+0000 7f37b1cab740 20 client.15747 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.087+0000 7f37b1cab740 1 --2- 172.21.15.81:0/141531108 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d64f75e470 0x55d64f7608b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.087+0000 7f37b1cab740 4 client.15747 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3c3cf9a8", "release": true, "await": true}] 2024-09-12T01:29:17.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.087+0000 7f37b1cab740 1 -- 172.21.15.81:0/141531108 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3c3cf9a8", "release": true, "await": true}) -- 0x55d64f63c0a0 con 0x55d64f75e470 2024-09-12T01:29:17.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.087+0000 7f37ad66e640 1 --2- 172.21.15.81:0/141531108 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d64f75e470 0x55d64f7608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:17.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.088+0000 7f3790ff9640 10 client.15747 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:17.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.088+0000 7f37ad66e640 1 --2- 172.21.15.81:0/141531108 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d64f75e470 0x55d64f7608b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8f0e1ef19415691 server_cookie=7e4d7bbe28ba0a5e in_seq=0 out_seq=0 2024-09-12T01:29:17.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.089+0000 7f3790ff9640 1 -- 172.21.15.81:0/141531108 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55d64f63c0a0 con 0x55d64f75e470 2024-09-12T01:29:17.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.089+0000 7f3790ff9640 10 client.15747 handle_command_reply: tid=0 2024-09-12T01:29:17.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.089+0000 7f37b1cab740 1 client.15747 shutdown 2024-09-12T01:29:17.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.089+0000 7f37b1cab740 1 -- 172.21.15.81:0/141531108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6f2520 msgr2=0x55d64f7561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:17.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.089+0000 7f37b1cab740 1 --2- 172.21.15.81:0/141531108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6f2520 0x55d64f7561f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f37a0018c50 tx=0x7f37a0004a40 comp rx=0 tx=0).stop 2024-09-12T01:29:17.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.089+0000 7f37b1cab740 1 -- 172.21.15.81:0/141531108 shutdown_connections 2024-09-12T01:29:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.089+0000 7f37b1cab740 1 --2- 172.21.15.81:0/141531108 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d64f75e470 0x55d64f7608b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.089+0000 7f37b1cab740 1 --2- 172.21.15.81:0/141531108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d64f6f2520 0x55d64f7561f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.089+0000 7f37b1cab740 1 --2- 172.21.15.81:0/141531108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d64f6da220 0x55d64f6e74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.089+0000 7f37b1cab740 1 --2- 172.21.15.81:0/141531108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d64f6cf040 0x55d64f6e6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.089+0000 7f37b1cab740 1 -- 172.21.15.81:0/141531108 >> 172.21.15.81:0/141531108 conn(0x55d64f6cb5d0 msgr2=0x55d64f6d0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.089+0000 7f3790ff9640 0 client.15747 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.090+0000 7f37b1cab740 1 -- 172.21.15.81:0/141531108 shutdown_connections 2024-09-12T01:29:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.090+0000 7f37b1cab740 1 -- 172.21.15.81:0/141531108 wait complete. 2024-09-12T01:29:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.090+0000 7f37b1cab740 20 client.15747 trim_cache size 0 max 16384 2024-09-12T01:29:17.096 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:29:17.096 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 28, 2024-09-12T01:29:17.096 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24473, 2024-09-12T01:29:17.096 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 4, 2024-09-12T01:29:17.096 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-12T01:29:17.097 INFO:teuthology.orchestra.run.smithi081.stdout: "3c3cf9a8": { 2024-09-12T01:29:17.097 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 4, 2024-09-12T01:29:17.097 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-12T01:29:17.097 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T01:29:17.097 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-12T01:29:17.097 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T01:29:17.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:29:17.097 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-12T01:29:17.097 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 144.5, 2024-09-12T01:29:17.097 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-12T01:29:17.098 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-12T01:29:17.098 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-12T01:29:17.098 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T01:29:17.098 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-12T01:29:17.098 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T01:29:17.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:29:17.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:29:17.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:29:17.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:29:17.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:29:17.099 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:29:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.090+0000 7f37af8d2640 1 -- 172.21.15.81:0/1738249838 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f37940a2e10 msgr2=0x7f37940a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.090+0000 7f37af8d2640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f37940a2e10 0x7f37940a52d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009fd0 tx=0x7f37a000d040 comp rx=0 tx=0).stop 2024-09-12T01:29:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.090+0000 7f37af8d2640 1 -- 172.21.15.81:0/1738249838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37a8102570 msgr2=0x7f37a81998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.090+0000 7f37af8d2640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37a8102570 0x7f37a81998e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3798007b50 tx=0x7f3798010420 comp rx=0 tx=0).stop 2024-09-12T01:29:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.091+0000 7f37af8d2640 1 -- 172.21.15.81:0/1738249838 shutdown_connections 2024-09-12T01:29:17.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.091+0000 7f37af8d2640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f37940a2e10 0x7f37940a52d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.091+0000 7f37af8d2640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37a8102ef0 0x7f37a81a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.091+0000 7f37af8d2640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f37a8102570 0x7f37a81998e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.091+0000 7f37af8d2640 1 --2- 172.21.15.81:0/1738249838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a8100e20 0x7f37a81993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.091+0000 7f37af8d2640 1 -- 172.21.15.81:0/1738249838 >> 172.21.15.81:0/1738249838 conn(0x7f37a80fc7d0 msgr2=0x7f37a8105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.091+0000 7f37af8d2640 1 -- 172.21.15.81:0/1738249838 shutdown_connections 2024-09-12T01:29:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:17.091+0000 7f37af8d2640 1 -- 172.21.15.81:0/1738249838 wait complete. 2024-09-12T01:29:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:17 smithi189 ceph-mon[35357]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-12T01:29:17.836 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:17 smithi081 ceph-mon[30920]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-12T01:29:17.873 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3c3cf9a8', total seconds elapsed: 28.4 2024-09-12T01:29:18.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:17 smithi100 ceph-mon[35275]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-12T01:29:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:19 smithi189 ceph-mon[35357]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T01:29:19.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:19 smithi081 ceph-mon[30920]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T01:29:20.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:19 smithi100 ceph-mon[35275]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T01:29:21.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:21 smithi189 ceph-mon[35357]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-12T01:29:21.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:21 smithi081 ceph-mon[30920]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-12T01:29:22.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:21 smithi100 ceph-mon[35275]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-12T01:29:23.313 INFO:tasks.workunit.client.0.smithi081.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T01:29:23.313 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T01:29:23.313 INFO:tasks.workunit.client.0.smithi081.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:29:23.313 INFO:tasks.workunit.client.0.smithi081.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:29:23.314 INFO:tasks.workunit.client.0.smithi081.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:29:23.314 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T01:29:23.314 INFO:tasks.workunit.client.0.smithi081.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:29:23.314 INFO:tasks.workunit.client.0.smithi081.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:29:23.314 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T01:29:23.314 INFO:tasks.workunit.client.0.smithi081.stderr: git switch -c 2024-09-12T01:29:23.314 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T01:29:23.315 INFO:tasks.workunit.client.0.smithi081.stderr:Or undo this operation with: 2024-09-12T01:29:23.315 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T01:29:23.315 INFO:tasks.workunit.client.0.smithi081.stderr: git switch - 2024-09-12T01:29:23.315 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T01:29:23.315 INFO:tasks.workunit.client.0.smithi081.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:29:23.315 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T01:29:23.316 INFO:tasks.workunit.client.0.smithi081.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T01:29:23.319 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:29:23.348 INFO:tasks.workunit.client.0.smithi081.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:29:23.350 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:29:23.350 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:29:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:23 smithi189 ceph-mon[35357]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T01:29:23.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:23 smithi081 ceph-mon[30920]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T01:29:24.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:23 smithi100 ceph-mon[35275]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T01:29:24.085 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:29:24.149 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:29:24.190 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:29:24.192 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:29:24.192 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:29:24.232 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:29:24.235 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:29:24.235 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:29:24.291 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-09-12T01:29:24.292 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-09-12T01:29:24.292 DEBUG:teuthology.orchestra.run.smithi081:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-12T01:29:24.353 INFO:tasks.workunit.client.0.smithi081.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-09-12T01:29:24.378 INFO:tasks.workunit.client.0.smithi081.stderr:--2024-09-12 01:29:24-- http://download.ceph.com/qa/fsync-tester.c 2024-09-12T01:29:24.379 INFO:tasks.workunit.client.0.smithi081.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-12T01:29:24.400 INFO:tasks.workunit.client.0.smithi081.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-12T01:29:24.421 INFO:tasks.workunit.client.0.smithi081.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T01:29:24.421 INFO:tasks.workunit.client.0.smithi081.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-09-12T01:29:24.422 INFO:tasks.workunit.client.0.smithi081.stderr:Saving to: ‘fsync-tester.c’ 2024-09-12T01:29:24.429 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T01:29:24.429 INFO:tasks.workunit.client.0.smithi081.stderr: 0K .. 100% 220M=0s 2024-09-12T01:29:24.429 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T01:29:24.429 INFO:tasks.workunit.client.0.smithi081.stderr:2024-09-12 01:29:24 (220 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-09-12T01:29:24.430 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T01:29:24.430 INFO:tasks.workunit.client.0.smithi081.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-09-12T01:29:24.498 INFO:tasks.workunit.client.0.smithi081.stderr:+ ./fsync-tester 2024-09-12T01:29:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:25 smithi189 ceph-mon[35357]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:29:25.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:25 smithi081 ceph-mon[30920]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:29:26.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:25 smithi100 ceph-mon[35275]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:29:27.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:27 smithi081 ceph-mon[30920]: pgmap v44: 97 pgs: 97 active+clean; 2.4 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 90 KiB/s wr, 13 op/s 2024-09-12T01:29:28.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:27 smithi100 ceph-mon[35275]: pgmap v44: 97 pgs: 97 active+clean; 2.4 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 90 KiB/s wr, 13 op/s 2024-09-12T01:29:28.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:27 smithi189 ceph-mon[35357]: pgmap v44: 97 pgs: 97 active+clean; 2.4 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 90 KiB/s wr, 13 op/s 2024-09-12T01:29:29.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:29 smithi081 ceph-mon[30920]: pgmap v45: 97 pgs: 97 active+clean; 2.4 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 90 KiB/s wr, 9 op/s 2024-09-12T01:29:30.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:29 smithi100 ceph-mon[35275]: pgmap v45: 97 pgs: 97 active+clean; 2.4 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 90 KiB/s wr, 9 op/s 2024-09-12T01:29:30.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:29 smithi189 ceph-mon[35357]: pgmap v45: 97 pgs: 97 active+clean; 2.4 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 90 KiB/s wr, 9 op/s 2024-09-12T01:29:31.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:31 smithi081 ceph-mon[30920]: pgmap v46: 97 pgs: 97 active+clean; 2.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 521 KiB/s wr, 14 op/s 2024-09-12T01:29:32.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:31 smithi100 ceph-mon[35275]: pgmap v46: 97 pgs: 97 active+clean; 2.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 521 KiB/s wr, 14 op/s 2024-09-12T01:29:32.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:31 smithi189 ceph-mon[35357]: pgmap v46: 97 pgs: 97 active+clean; 2.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 521 KiB/s wr, 14 op/s 2024-09-12T01:29:33.834 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:33 smithi189 ceph-mon[35357]: pgmap v47: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 521 KiB/s wr, 12 op/s 2024-09-12T01:29:33.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:33 smithi081 ceph-mon[30920]: pgmap v47: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 521 KiB/s wr, 12 op/s 2024-09-12T01:29:34.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:33 smithi100 ceph-mon[35275]: pgmap v47: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 521 KiB/s wr, 12 op/s 2024-09-12T01:29:34.927 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:29:35.191 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:29:35.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:35 smithi081 ceph-mon[30920]: pgmap v48: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 521 KiB/s wr, 11 op/s 2024-09-12T01:29:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.715+0000 7f4863f34640 1 -- 172.21.15.81:0/1111760789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485c101420 msgr2=0x7f485c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.715+0000 7f4863f34640 1 --2- 172.21.15.81:0/1111760789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485c101420 0x7f485c10d950 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4854009cd0 tx=0x7f485402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.715+0000 7f4863f34640 1 -- 172.21.15.81:0/1111760789 shutdown_connections 2024-09-12T01:29:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.715+0000 7f4863f34640 1 --2- 172.21.15.81:0/1111760789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485c101420 0x7f485c10d950 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.715+0000 7f4863f34640 1 --2- 172.21.15.81:0/1111760789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f485c100a80 0x7f485c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.715+0000 7f4863f34640 1 --2- 172.21.15.81:0/1111760789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f485c106a80 0x7f485c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.715+0000 7f4863f34640 1 -- 172.21.15.81:0/1111760789 >> 172.21.15.81:0/1111760789 conn(0x7f485c0fc7a0 msgr2=0x7f485c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.715+0000 7f4863f34640 1 -- 172.21.15.81:0/1111760789 shutdown_connections 2024-09-12T01:29:35.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.715+0000 7f4863f34640 1 -- 172.21.15.81:0/1111760789 wait complete. 2024-09-12T01:29:35.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.716+0000 7f4863f34640 1 Processor -- start 2024-09-12T01:29:35.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.716+0000 7f4863f34640 1 -- start start 2024-09-12T01:29:35.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.716+0000 7f4863f34640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f485c100a80 0x7f485c1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.716+0000 7f4863f34640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f485c101420 0x7f485c1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.716+0000 7f4863f34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485c106a80 0x7f485c1a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.716+0000 7f4863f34640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f485c110ed0 con 0x7f485c106a80 2024-09-12T01:29:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.716+0000 7f4863f34640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f485c110d50 con 0x7f485c101420 2024-09-12T01:29:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.716+0000 7f4863f34640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f485c111050 con 0x7f485c100a80 2024-09-12T01:29:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.716+0000 7f48614cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f485c101420 0x7f485c1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.716+0000 7f48624d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485c106a80 0x7f485c1a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f48614cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f485c101420 0x7f485c1996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:56606/0 (socket says 172.21.15.81:56606) 2024-09-12T01:29:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f48614cf640 1 -- 172.21.15.81:0/3002445735 learned_addr learned my addr 172.21.15.81:0/3002445735 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f4861cd0640 1 --2- 172.21.15.81:0/3002445735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f485c100a80 0x7f485c1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f48624d1640 1 -- 172.21.15.81:0/3002445735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f485c100a80 msgr2=0x7f485c1991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f48624d1640 1 --2- 172.21.15.81:0/3002445735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f485c100a80 0x7f485c1991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f48624d1640 1 -- 172.21.15.81:0/3002445735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f485c101420 msgr2=0x7f485c1996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f48624d1640 1 --2- 172.21.15.81:0/3002445735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f485c101420 0x7f485c1996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f48624d1640 1 -- 172.21.15.81:0/3002445735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c1a4760 con 0x7f485c106a80 2024-09-12T01:29:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f48624d1640 1 --2- 172.21.15.81:0/3002445735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485c106a80 0x7f485c1a4220 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4854009ca0 tx=0x7f4854003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f4852ffd640 1 -- 172.21.15.81:0/3002445735 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854004040 con 0x7f485c106a80 2024-09-12T01:29:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f4863f34640 1 -- 172.21.15.81:0/3002445735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f485c1a4930 con 0x7f485c106a80 2024-09-12T01:29:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f4852ffd640 1 -- 172.21.15.81:0/3002445735 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48540046c0 con 0x7f485c106a80 2024-09-12T01:29:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f4852ffd640 1 -- 172.21.15.81:0/3002445735 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854030e40 con 0x7f485c106a80 2024-09-12T01:29:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.717+0000 7f4863f34640 1 -- 172.21.15.81:0/3002445735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f485c1a4de0 con 0x7f485c106a80 2024-09-12T01:29:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.720+0000 7f4852ffd640 1 -- 172.21.15.81:0/3002445735 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f48540464a0 con 0x7f485c106a80 2024-09-12T01:29:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.720+0000 7f486630d740 1 Processor -- start 2024-09-12T01:29:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.720+0000 7f486630d740 1 -- start start 2024-09-12T01:29:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.720+0000 7f486630d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 0x55f180d23740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.720+0000 7f486630d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d32550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.720+0000 7f486630d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d32a90 0x55f180d34e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.720+0000 7f486630d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f180c892e0 con 0x55f180d23360 2024-09-12T01:29:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.720+0000 7f486630d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f180c30ce0 con 0x55f180d32a90 2024-09-12T01:29:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.720+0000 7f486630d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f180c852a0 con 0x55f180d23c80 2024-09-12T01:29:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f48614cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 0x55f180d23740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f48614cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 0x55f180d23740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60834/0 (socket says 172.21.15.81:60834) 2024-09-12T01:29:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f48614cf640 1 -- 172.21.15.81:0/3701121597 learned_addr learned my addr 172.21.15.81:0/3701121597 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f4861cd0640 1 --2- 172.21.15.81:0/3701121597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d32550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f48614cf640 1 --2- 172.21.15.81:0/3701121597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d32a90 0x55f180d34e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f4861cd0640 1 -- 172.21.15.81:0/3701121597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d32a90 msgr2=0x55f180d34e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f4861cd0640 1 --2- 172.21.15.81:0/3701121597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d32a90 0x55f180d34e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f4861cd0640 1 -- 172.21.15.81:0/3701121597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 msgr2=0x55f180d23740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f4861cd0640 1 --2- 172.21.15.81:0/3701121597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 0x55f180d23740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f4861cd0640 1 -- 172.21.15.81:0/3701121597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f180c15440 con 0x55f180d23c80 2024-09-12T01:29:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f48614cf640 1 --2- 172.21.15.81:0/3701121597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 0x55f180d23740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f4852ffd640 1 --2- 172.21.15.81:0/3002445735 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f48480a2e10 0x7f48480a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f4861cd0640 1 --2- 172.21.15.81:0/3701121597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d32550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f485800ab70 tx=0x7f485800af70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2757e31358d5800 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f48614cf640 1 --2- 172.21.15.81:0/3002445735 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f48480a2e10 0x7f48480a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f4852ffd640 1 -- 172.21.15.81:0/3002445735 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f485402e030 con 0x7f485c106a80 2024-09-12T01:29:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.721+0000 7f4847fff640 1 -- 172.21.15.81:0/3701121597 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858005020 con 0x55f180d23c80 2024-09-12T01:29:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.722+0000 7f4847fff640 1 -- 172.21.15.81:0/3701121597 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48580056a0 con 0x55f180d23c80 2024-09-12T01:29:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.722+0000 7f4847fff640 1 -- 172.21.15.81:0/3701121597 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48580186a0 con 0x55f180d23c80 2024-09-12T01:29:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.722+0000 7f486630d740 1 -- 172.21.15.81:0/3701121597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 msgr2=0x55f180d32550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.722+0000 7f486630d740 1 --2- 172.21.15.81:0/3701121597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d32550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f485800ab70 tx=0x7f485800af70 comp rx=0 tx=0).stop 2024-09-12T01:29:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.722+0000 7f48614cf640 1 --2- 172.21.15.81:0/3002445735 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f48480a2e10 0x7f48480a52d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55f180d20b20 tx=0x7f484c00b480 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.722+0000 7f486630d740 1 -- 172.21.15.81:0/3701121597 shutdown_connections 2024-09-12T01:29:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.722+0000 7f486630d740 1 --2- 172.21.15.81:0/3701121597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d32a90 0x55f180d34e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.722+0000 7f486630d740 1 --2- 172.21.15.81:0/3701121597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d32550 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.722+0000 7f486630d740 1 --2- 172.21.15.81:0/3701121597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 0x55f180d23740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.722+0000 7f486630d740 1 -- 172.21.15.81:0/3701121597 >> 172.21.15.81:0/3701121597 conn(0x55f180d1fa30 msgr2=0x55f180d1fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.723+0000 7f486630d740 1 -- 172.21.15.81:0/3701121597 shutdown_connections 2024-09-12T01:29:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.723+0000 7f486630d740 1 -- 172.21.15.81:0/3701121597 wait complete. 2024-09-12T01:29:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.723+0000 7f486630d740 1 -- start start 2024-09-12T01:29:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.723+0000 7f486630d740 1 Processor -- start 2024-09-12T01:29:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.723+0000 7f486630d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 0x55f180d32430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.723+0000 7f486630d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d2f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.723+0000 7f486630d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d32a90 0x55f180d2fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.723+0000 7f486630d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f180d35660 con 0x55f180d23360 2024-09-12T01:29:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.723+0000 7f486630d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f180c44050 con 0x55f180d32a90 2024-09-12T01:29:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.723+0000 7f486630d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f180d357e0 con 0x55f180d23c80 2024-09-12T01:29:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f486630d740 10 client.0 _ll_register_callbacks cb 0x55f180c84160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f4861cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 0x55f180d32430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f48614cf640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d2f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f4861cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 0x55f180d32430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60838/0 (socket says 172.21.15.81:60838) 2024-09-12T01:29:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f4861cd0640 1 -- 172.21.15.81:0/3209782430 learned_addr learned my addr 172.21.15.81:0/3209782430 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f48624d1640 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d32a90 0x55f180d2fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f4861cd0640 1 -- 172.21.15.81:0/3209782430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 msgr2=0x55f180d2f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f4861cd0640 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d2f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f4861cd0640 1 -- 172.21.15.81:0/3209782430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d32a90 msgr2=0x55f180d2fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f4861cd0640 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d32a90 0x55f180d2fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f4861cd0640 1 -- 172.21.15.81:0/3209782430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1809fa3c0 con 0x55f180d23360 2024-09-12T01:29:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f48624d1640 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d32a90 0x55f180d2fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f48614cf640 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d2f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f4861cd0640 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 0x55f180d32430 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4858004ef0 tx=0x7f485800ffc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a2b31c2aafb7b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f48457fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f48457fa640 1 -- 172.21.15.81:0/3209782430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858027070 con 0x55f180d23360 2024-09-12T01:29:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f48457fa640 1 -- 172.21.15.81:0/3209782430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f48580051a0 con 0x55f180d23360 2024-09-12T01:29:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.724+0000 7f486630d740 1 -- 172.21.15.81:0/3209782430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48580056a0 con 0x55f180d23360 2024-09-12T01:29:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.725+0000 7f48457fa640 1 -- 172.21.15.81:0/3209782430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4858033050 con 0x55f180d23360 2024-09-12T01:29:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.725+0000 7f486630d740 10 client.15759 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.725+0000 7f486630d740 1 -- 172.21.15.81:0/3209782430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f180d410b0 con 0x55f180d23360 2024-09-12T01:29:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.725+0000 7f48457fa640 1 -- 172.21.15.81:0/3209782430 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48580056a0 con 0x55f180d23360 2024-09-12T01:29:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.725+0000 7f48457fa640 1 -- 172.21.15.81:0/3209782430 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4858023430 con 0x55f180d23360 2024-09-12T01:29:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.725+0000 7f486630d740 10 client.15759 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.725+0000 7f486630d740 10 client.15759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:29:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.725+0000 7f486630d740 20 client.15759 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.725+0000 7f486630d740 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f180d424c0 0x55f180d448b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.725+0000 7f486630d740 4 client.15759 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:29:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.725+0000 7f486630d740 1 -- 172.21.15.81:0/3209782430 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f180c96850 con 0x55f180d424c0 2024-09-12T01:29:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.726+0000 7f48614cf640 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f180d424c0 0x55f180d448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.726+0000 7f48457fa640 10 client.15759 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.726+0000 7f48614cf640 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f180d424c0 0x55f180d448b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dee0b2196820e98 server_cookie=1539ecbec6e483a3 in_seq=0 out_seq=0 2024-09-12T01:29:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f48457fa640 1 -- 172.21.15.81:0/3209782430 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f180c96850 con 0x55f180d424c0 2024-09-12T01:29:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f48457fa640 10 client.15759 handle_command_reply: tid=0 2024-09-12T01:29:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f486630d740 1 client.15759 shutdown 2024-09-12T01:29:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f486630d740 1 -- 172.21.15.81:0/3209782430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 msgr2=0x55f180d32430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f486630d740 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 0x55f180d32430 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4858004ef0 tx=0x7f485800ffc0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f486630d740 1 -- 172.21.15.81:0/3209782430 shutdown_connections 2024-09-12T01:29:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f486630d740 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f180d424c0 0x55f180d448b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f486630d740 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d32a90 0x55f180d2fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f486630d740 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d2f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f486630d740 1 --2- 172.21.15.81:0/3209782430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d23360 0x55f180d32430 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f48457fa640 0 client.15759 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:35.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f486630d740 1 -- 172.21.15.81:0/3209782430 >> 172.21.15.81:0/3209782430 conn(0x55f180d1fa30 msgr2=0x55f180d25790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:35.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f486630d740 1 -- 172.21.15.81:0/3209782430 shutdown_connections 2024-09-12T01:29:35.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f486630d740 1 -- 172.21.15.81:0/3209782430 wait complete. 2024-09-12T01:29:35.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.727+0000 7f486630d740 20 client.15759 trim_cache size 0 max 16384 2024-09-12T01:29:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.744+0000 7f486630d740 1 Processor -- start 2024-09-12T01:29:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.744+0000 7f486630d740 1 -- start start 2024-09-12T01:29:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f486630d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23360 0x55f180d3e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f486630d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d23c80 0x55f180d49ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f486630d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d32a90 0x55f180d4a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f486630d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1ab3c0 con 0x55f180d32a90 2024-09-12T01:29:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f486630d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1acf00 con 0x55f180d23c80 2024-09-12T01:29:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f486630d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1aba90 con 0x55f180d23360 2024-09-12T01:29:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f48624d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d32a90 0x55f180d4a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f48624d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d32a90 0x55f180d4a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60852/0 (socket says 172.21.15.81:60852) 2024-09-12T01:29:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f48624d1640 1 -- 172.21.15.81:0/1470803060 learned_addr learned my addr 172.21.15.81:0/1470803060 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f48614cf640 1 --2- 172.21.15.81:0/1470803060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d23c80 0x55f180d49ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f4861cd0640 1 --2- 172.21.15.81:0/1470803060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23360 0x55f180d3e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f48624d1640 1 -- 172.21.15.81:0/1470803060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23360 msgr2=0x55f180d3e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f48624d1640 1 --2- 172.21.15.81:0/1470803060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23360 0x55f180d3e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f48624d1640 1 -- 172.21.15.81:0/1470803060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d23c80 msgr2=0x55f180d49ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f48624d1640 1 --2- 172.21.15.81:0/1470803060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d23c80 0x55f180d49ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f48624d1640 1 -- 172.21.15.81:0/1470803060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f180d23ab0 con 0x55f180d32a90 2024-09-12T01:29:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.745+0000 7f48614cf640 1 --2- 172.21.15.81:0/1470803060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d23c80 0x55f180d49ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.746+0000 7f48624d1640 1 --2- 172.21.15.81:0/1470803060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d32a90 0x55f180d4a420 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4854009cd0 tx=0x7f4854003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e9ad737d51abd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.746+0000 7f48477fe640 1 -- 172.21.15.81:0/1470803060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48540d5070 con 0x55f180d32a90 2024-09-12T01:29:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.746+0000 7f48477fe640 1 -- 172.21.15.81:0/1470803060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4854036040 con 0x55f180d32a90 2024-09-12T01:29:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.746+0000 7f48477fe640 1 -- 172.21.15.81:0/1470803060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48540b96c0 con 0x55f180d32a90 2024-09-12T01:29:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.746+0000 7f486630d740 1 -- 172.21.15.81:0/1470803060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d32a90 msgr2=0x55f180d4a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.746+0000 7f486630d740 1 --2- 172.21.15.81:0/1470803060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d32a90 0x55f180d4a420 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4854009cd0 tx=0x7f4854003f70 comp rx=0 tx=0).stop 2024-09-12T01:29:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.747+0000 7f486630d740 1 -- 172.21.15.81:0/1470803060 shutdown_connections 2024-09-12T01:29:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.747+0000 7f486630d740 1 --2- 172.21.15.81:0/1470803060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d32a90 0x55f180d4a420 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.747+0000 7f486630d740 1 --2- 172.21.15.81:0/1470803060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d23c80 0x55f180d49ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.747+0000 7f486630d740 1 --2- 172.21.15.81:0/1470803060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23360 0x55f180d3e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.747+0000 7f486630d740 1 -- 172.21.15.81:0/1470803060 >> 172.21.15.81:0/1470803060 conn(0x55f180d1fa30 msgr2=0x55f180d2ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.747+0000 7f486630d740 1 -- 172.21.15.81:0/1470803060 shutdown_connections 2024-09-12T01:29:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.747+0000 7f486630d740 1 -- 172.21.15.81:0/1470803060 wait complete. 2024-09-12T01:29:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.747+0000 7f486630d740 1 -- start start 2024-09-12T01:29:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.747+0000 7f486630d740 1 Processor -- start 2024-09-12T01:29:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f486630d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d23360 0x55f180d2c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f486630d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d2cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f486630d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d32a90 0x55f180d2d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f486630d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1ac830 con 0x55f180d32a90 2024-09-12T01:29:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f486630d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1ac160 con 0x55f180d23360 2024-09-12T01:29:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f486630d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f485c1a93c0 con 0x55f180d23c80 2024-09-12T01:29:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f486630d740 10 client.0 _ll_register_callbacks cb 0x7f484c00bb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f48624d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d32a90 0x55f180d2d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f48624d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d32a90 0x55f180d2d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60858/0 (socket says 172.21.15.81:60858) 2024-09-12T01:29:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f48624d1640 1 -- 172.21.15.81:0/1557102274 learned_addr learned my addr 172.21.15.81:0/1557102274 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f4861cd0640 1 --2- 172.21.15.81:0/1557102274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d23360 0x55f180d2c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f48614cf640 1 --2- 172.21.15.81:0/1557102274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d2cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f4861cd0640 1 -- 172.21.15.81:0/1557102274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 msgr2=0x55f180d2cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f4861cd0640 1 --2- 172.21.15.81:0/1557102274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d2cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f4861cd0640 1 -- 172.21.15.81:0/1557102274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d32a90 msgr2=0x55f180d2d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f4861cd0640 1 --2- 172.21.15.81:0/1557102274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d32a90 0x55f180d2d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.748+0000 7f4861cd0640 1 -- 172.21.15.81:0/1557102274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f180dabee0 con 0x55f180d23360 2024-09-12T01:29:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.749+0000 7f4861cd0640 1 --2- 172.21.15.81:0/1557102274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d23360 0x55f180d2c6f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f485800f850 tx=0x7f4858023a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e868383e82ebfe18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.749+0000 7f48457fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T01:29:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.749+0000 7f48457fa640 1 -- 172.21.15.81:0/1557102274 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858027040 con 0x55f180d23360 2024-09-12T01:29:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.749+0000 7f48457fa640 1 -- 172.21.15.81:0/1557102274 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f48580051a0 con 0x55f180d23360 2024-09-12T01:29:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.749+0000 7f486630d740 1 -- 172.21.15.81:0/1557102274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4854036040 con 0x55f180d23360 2024-09-12T01:29:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.749+0000 7f48457fa640 1 -- 172.21.15.81:0/1557102274 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4858048050 con 0x55f180d23360 2024-09-12T01:29:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.749+0000 7f486630d740 10 client.25226 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.749+0000 7f486630d740 1 -- 172.21.15.81:0/1557102274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f180dad1b0 con 0x55f180d23360 2024-09-12T01:29:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.749+0000 7f48457fa640 1 -- 172.21.15.81:0/1557102274 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4854036040 con 0x55f180d23360 2024-09-12T01:29:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.749+0000 7f48457fa640 1 -- 172.21.15.81:0/1557102274 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4858018600 con 0x55f180d23360 2024-09-12T01:29:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.749+0000 7f486630d740 10 client.25226 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.749+0000 7f486630d740 10 client.25226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:29:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.749+0000 7f486630d740 20 client.25226 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.750+0000 7f486630d740 1 --2- 172.21.15.81:0/1557102274 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f180dad860 0x55f180dafc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.750+0000 7f486630d740 4 client.25226 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:29:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.750+0000 7f486630d740 1 -- 172.21.15.81:0/1557102274 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f180c90d60 con 0x55f180dad860 2024-09-12T01:29:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.750+0000 7f48614cf640 1 --2- 172.21.15.81:0/1557102274 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f180dad860 0x55f180dafc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.750+0000 7f48457fa640 10 client.25226 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.750+0000 7f48614cf640 1 --2- 172.21.15.81:0/1557102274 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f180dad860 0x55f180dafc50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa519c07fe71ee35 server_cookie=299da21eb187264d in_seq=0 out_seq=0 2024-09-12T01:29:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.750+0000 7f48457fa640 1 -- 172.21.15.81:0/1557102274 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f180c90d60 con 0x55f180dad860 2024-09-12T01:29:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.750+0000 7f48457fa640 10 client.25226 handle_command_reply: tid=0 2024-09-12T01:29:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.750+0000 7f486630d740 1 client.25226 shutdown 2024-09-12T01:29:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.750+0000 7f486630d740 1 -- 172.21.15.81:0/1557102274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d23360 msgr2=0x55f180d2c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.750+0000 7f486630d740 1 --2- 172.21.15.81:0/1557102274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d23360 0x55f180d2c6f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f485800f850 tx=0x7f4858023a30 comp rx=0 tx=0).stop 2024-09-12T01:29:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.751+0000 7f486630d740 1 -- 172.21.15.81:0/1557102274 shutdown_connections 2024-09-12T01:29:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.751+0000 7f486630d740 1 --2- 172.21.15.81:0/1557102274 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f180dad860 0x55f180dafc50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.751+0000 7f486630d740 1 --2- 172.21.15.81:0/1557102274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f180d32a90 0x55f180d2d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.751+0000 7f486630d740 1 --2- 172.21.15.81:0/1557102274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f180d23c80 0x55f180d2cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.751+0000 7f48457fa640 0 client.25226 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.751+0000 7f486630d740 1 --2- 172.21.15.81:0/1557102274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f180d23360 0x55f180d2c6f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.751+0000 7f486630d740 1 -- 172.21.15.81:0/1557102274 >> 172.21.15.81:0/1557102274 conn(0x55f180d1fa30 msgr2=0x55f180d1e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.751+0000 7f486630d740 1 -- 172.21.15.81:0/1557102274 shutdown_connections 2024-09-12T01:29:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.751+0000 7f486630d740 1 -- 172.21.15.81:0/1557102274 wait complete. 2024-09-12T01:29:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.751+0000 7f486630d740 20 client.25226 trim_cache size 0 max 16384 2024-09-12T01:29:35.756 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:29:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:29:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:29:35.757 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:29:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.752+0000 7f4863f34640 1 -- 172.21.15.81:0/3002445735 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f48480a2e10 msgr2=0x7f48480a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.752+0000 7f4863f34640 1 --2- 172.21.15.81:0/3002445735 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f48480a2e10 0x7f48480a52d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55f180d20b20 tx=0x7f484c00b480 comp rx=0 tx=0).stop 2024-09-12T01:29:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.752+0000 7f4863f34640 1 -- 172.21.15.81:0/3002445735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485c106a80 msgr2=0x7f485c1a4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.752+0000 7f4863f34640 1 --2- 172.21.15.81:0/3002445735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485c106a80 0x7f485c1a4220 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4854009ca0 tx=0x7f4854003970 comp rx=0 tx=0).stop 2024-09-12T01:29:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.752+0000 7f4863f34640 1 -- 172.21.15.81:0/3002445735 shutdown_connections 2024-09-12T01:29:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.752+0000 7f4863f34640 1 --2- 172.21.15.81:0/3002445735 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f48480a2e10 0x7f48480a52d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.752+0000 7f4863f34640 1 --2- 172.21.15.81:0/3002445735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485c106a80 0x7f485c1a4220 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.752+0000 7f4863f34640 1 --2- 172.21.15.81:0/3002445735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f485c101420 0x7f485c1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.752+0000 7f4863f34640 1 --2- 172.21.15.81:0/3002445735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f485c100a80 0x7f485c1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.752+0000 7f4863f34640 1 -- 172.21.15.81:0/3002445735 >> 172.21.15.81:0/3002445735 conn(0x7f485c0fc7a0 msgr2=0x7f485c0fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.752+0000 7f4863f34640 1 -- 172.21.15.81:0/3002445735 shutdown_connections 2024-09-12T01:29:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:35.752+0000 7f4863f34640 1 -- 172.21.15.81:0/3002445735 wait complete. 2024-09-12T01:29:35.820 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:35 smithi100 ceph-mon[35275]: pgmap v48: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 521 KiB/s wr, 11 op/s 2024-09-12T01:29:36.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:35 smithi189 ceph-mon[35357]: pgmap v48: 97 pgs: 97 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 521 KiB/s wr, 11 op/s 2024-09-12T01:29:36.544 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:29:36.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:29:36.827 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:29:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.341+0000 7fb68d558640 1 -- 172.21.15.81:0/4082650883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb688101dd0 msgr2=0x7fb6881021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.341+0000 7fb68d558640 1 --2- 172.21.15.81:0/4082650883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb688101dd0 0x7fb6881021b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb678009900 tx=0x7fb67802a410 comp rx=0 tx=0).stop 2024-09-12T01:29:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.341+0000 7fb68d558640 1 -- 172.21.15.81:0/4082650883 shutdown_connections 2024-09-12T01:29:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.341+0000 7fb68d558640 1 --2- 172.21.15.81:0/4082650883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb688106f00 0x7fb68810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.341+0000 7fb68d558640 1 --2- 172.21.15.81:0/4082650883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb688102780 0x7fb6881067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.341+0000 7fb68d558640 1 --2- 172.21.15.81:0/4082650883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb688101dd0 0x7fb6881021b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.341+0000 7fb68d558640 1 -- 172.21.15.81:0/4082650883 >> 172.21.15.81:0/4082650883 conn(0x7fb6880fd8b0 msgr2=0x7fb6880ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.341+0000 7fb68d558640 1 -- 172.21.15.81:0/4082650883 shutdown_connections 2024-09-12T01:29:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.341+0000 7fb68d558640 1 -- 172.21.15.81:0/4082650883 wait complete. 2024-09-12T01:29:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.342+0000 7fb68d558640 1 Processor -- start 2024-09-12T01:29:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.342+0000 7fb68d558640 1 -- start start 2024-09-12T01:29:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.342+0000 7fb68d558640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb688101dd0 0x7fb6880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.342+0000 7fb68d558640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb688102780 0x7fb688074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.342+0000 7fb68d558640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb688106f00 0x7fb688074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.342+0000 7fb68d558640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb688111f80 con 0x7fb688106f00 2024-09-12T01:29:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.342+0000 7fb68d558640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb688111e00 con 0x7fb688101dd0 2024-09-12T01:29:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.342+0000 7fb68d558640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb688112100 con 0x7fb688102780 2024-09-12T01:29:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.342+0000 7fb6877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb688106f00 0x7fb688074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb686ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb688101dd0 0x7fb6880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb6877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb688106f00 0x7fb688074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60868/0 (socket says 172.21.15.81:60868) 2024-09-12T01:29:37.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb6877fe640 1 -- 172.21.15.81:0/1796650573 learned_addr learned my addr 172.21.15.81:0/1796650573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:37.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb6867fc640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb688102780 0x7fb688074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:37.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb6877fe640 1 -- 172.21.15.81:0/1796650573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb688102780 msgr2=0x7fb688074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:37.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb6877fe640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb688102780 0x7fb688074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:37.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb6877fe640 1 -- 172.21.15.81:0/1796650573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb688101dd0 msgr2=0x7fb6880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:37.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb6877fe640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb688101dd0 0x7fb6880744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:37.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb6877fe640 1 -- 172.21.15.81:0/1796650573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6881a6940 con 0x7fb688106f00 2024-09-12T01:29:37.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb686ffd640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb688101dd0 0x7fb6880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:37.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb6877fe640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb688106f00 0x7fb688074f70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb680009fd0 tx=0x7fb68000def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:37.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb66ffff640 1 -- 172.21.15.81:0/1796650573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680017070 con 0x7fb688106f00 2024-09-12T01:29:37.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb68d558640 1 -- 172.21.15.81:0/1796650573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6881a6c30 con 0x7fb688106f00 2024-09-12T01:29:37.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb66ffff640 1 -- 172.21.15.81:0/1796650573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb680003e50 con 0x7fb688106f00 2024-09-12T01:29:37.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb66ffff640 1 -- 172.21.15.81:0/1796650573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680010460 con 0x7fb688106f00 2024-09-12T01:29:37.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.343+0000 7fb68d558640 1 -- 172.21.15.81:0/1796650573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6881a7170 con 0x7fb688106f00 2024-09-12T01:29:37.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.344+0000 7fb68d558640 1 -- 172.21.15.81:0/1796650573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6881021b0 con 0x7fb688106f00 2024-09-12T01:29:37.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.346+0000 7fb66ffff640 1 -- 172.21.15.81:0/1796650573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb680004000 con 0x7fb688106f00 2024-09-12T01:29:37.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.346+0000 7fb66ffff640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb6700a2cf0 0x7fb6700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:37.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.346+0000 7fb686ffd640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb6700a2cf0 0x7fb6700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:37.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.347+0000 7fb66ffff640 1 -- 172.21.15.81:0/1796650573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb6800cf000 con 0x7fb688106f00 2024-09-12T01:29:37.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.347+0000 7fb686ffd640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb6700a2cf0 0x7fb6700a51b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb678009230 tx=0x7fb6780058d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:37.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.350+0000 7fb66ffff640 1 -- 172.21.15.81:0/1796650573 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb68009bc50 con 0x7fb688106f00 2024-09-12T01:29:37.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.560+0000 7fb68d558640 1 -- 172.21.15.81:0/1796650573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb68810a0e0 con 0x7fb688106f00 2024-09-12T01:29:37.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.561+0000 7fb66ffff640 1 -- 172.21.15.81:0/1796650573 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fb68009b550 con 0x7fb688106f00 2024-09-12T01:29:37.560 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:29:37.561 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:29:37.561 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:29:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.563+0000 7fb68d558640 1 -- 172.21.15.81:0/1796650573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb6700a2cf0 msgr2=0x7fb6700a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.563+0000 7fb68d558640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb6700a2cf0 0x7fb6700a51b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb678009230 tx=0x7fb6780058d0 comp rx=0 tx=0).stop 2024-09-12T01:29:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.563+0000 7fb68d558640 1 -- 172.21.15.81:0/1796650573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb688106f00 msgr2=0x7fb688074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.563+0000 7fb68d558640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb688106f00 0x7fb688074f70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb680009fd0 tx=0x7fb68000def0 comp rx=0 tx=0).stop 2024-09-12T01:29:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.563+0000 7fb68d558640 1 -- 172.21.15.81:0/1796650573 shutdown_connections 2024-09-12T01:29:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.563+0000 7fb68d558640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb6700a2cf0 0x7fb6700a51b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.563+0000 7fb68d558640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb688106f00 0x7fb688074f70 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.563+0000 7fb68d558640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb688102780 0x7fb688074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.563+0000 7fb68d558640 1 --2- 172.21.15.81:0/1796650573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb688101dd0 0x7fb6880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:37.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.563+0000 7fb68d558640 1 -- 172.21.15.81:0/1796650573 >> 172.21.15.81:0/1796650573 conn(0x7fb6880fd8b0 msgr2=0x7fb6880fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:37.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.564+0000 7fb68d558640 1 -- 172.21.15.81:0/1796650573 shutdown_connections 2024-09-12T01:29:37.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:37.564+0000 7fb68d558640 1 -- 172.21.15.81:0/1796650573 wait complete. 2024-09-12T01:29:37.940 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:37 smithi081 ceph-mon[30920]: pgmap v49: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 953 KiB/s wr, 17 op/s 2024-09-12T01:29:37.940 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:37 smithi081 ceph-mon[30920]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-09-12T01:29:38.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:37 smithi100 ceph-mon[35275]: pgmap v49: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 953 KiB/s wr, 17 op/s 2024-09-12T01:29:38.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:37 smithi100 ceph-mon[35275]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-09-12T01:29:38.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:37 smithi189 ceph-mon[35357]: pgmap v49: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 953 KiB/s wr, 17 op/s 2024-09-12T01:29:38.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:37 smithi189 ceph-mon[35357]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-09-12T01:29:38.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:29:38.542 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:29:38.811 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:38 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1796650573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:29:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.973+0000 7fb656d75640 1 -- 172.21.15.81:0/644605823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb650102ef0 msgr2=0x7fb65010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.973+0000 7fb656d75640 1 --2- 172.21.15.81:0/644605823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb650102ef0 0x7fb65010da40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb648009ca0 tx=0x7fb64802a950 comp rx=0 tx=0).stop 2024-09-12T01:29:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.973+0000 7fb656d75640 1 -- 172.21.15.81:0/644605823 shutdown_connections 2024-09-12T01:29:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.973+0000 7fb656d75640 1 --2- 172.21.15.81:0/644605823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb650102ef0 0x7fb65010da40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.973+0000 7fb656d75640 1 --2- 172.21.15.81:0/644605823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb650102570 0x7fb6501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.973+0000 7fb656d75640 1 --2- 172.21.15.81:0/644605823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb650100e20 0x7fb650101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.973+0000 7fb656d75640 1 -- 172.21.15.81:0/644605823 >> 172.21.15.81:0/644605823 conn(0x7fb6500fc7d0 msgr2=0x7fb6500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.973+0000 7fb656d75640 1 -- 172.21.15.81:0/644605823 shutdown_connections 2024-09-12T01:29:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.973+0000 7fb656d75640 1 -- 172.21.15.81:0/644605823 wait complete. 2024-09-12T01:29:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb656d75640 1 Processor -- start 2024-09-12T01:29:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb656d75640 1 -- start start 2024-09-12T01:29:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb656d75640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb650100e20 0x7fb650197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb656d75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb650102570 0x7fb650197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb656d75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb650102ef0 0x7fb65019bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb656d75640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb650110f80 con 0x7fb650102570 2024-09-12T01:29:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb656d75640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb650110e00 con 0x7fb650102ef0 2024-09-12T01:29:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb656d75640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb650111100 con 0x7fb650100e20 2024-09-12T01:29:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb64ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb650102570 0x7fb650197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb64ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb650102570 0x7fb650197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60886/0 (socket says 172.21.15.81:60886) 2024-09-12T01:29:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb64ffff640 1 -- 172.21.15.81:0/1599021897 learned_addr learned my addr 172.21.15.81:0/1599021897 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb654b11640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb650100e20 0x7fb650197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb655312640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb650102ef0 0x7fb65019bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb64ffff640 1 -- 172.21.15.81:0/1599021897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb650100e20 msgr2=0x7fb650197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb64ffff640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb650100e20 0x7fb650197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb64ffff640 1 -- 172.21.15.81:0/1599021897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb650102ef0 msgr2=0x7fb65019bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb64ffff640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb650102ef0 0x7fb65019bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.974+0000 7fb64ffff640 1 -- 172.21.15.81:0/1599021897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65019c2d0 con 0x7fb650102570 2024-09-12T01:29:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.975+0000 7fb64ffff640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb650102570 0x7fb650197860 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00d770 tx=0x7fb63c00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.975+0000 7fb64dffb640 1 -- 172.21.15.81:0/1599021897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c017070 con 0x7fb650102570 2024-09-12T01:29:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.975+0000 7fb64dffb640 1 -- 172.21.15.81:0/1599021897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb63c009820 con 0x7fb650102570 2024-09-12T01:29:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.975+0000 7fb656d75640 1 -- 172.21.15.81:0/1599021897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65019c5c0 con 0x7fb650102570 2024-09-12T01:29:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.975+0000 7fb64dffb640 1 -- 172.21.15.81:0/1599021897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c004cd0 con 0x7fb650102570 2024-09-12T01:29:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.975+0000 7fb656d75640 1 -- 172.21.15.81:0/1599021897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6501a3ea0 con 0x7fb650102570 2024-09-12T01:29:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.977+0000 7fb64dffb640 1 -- 172.21.15.81:0/1599021897 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb63c0099d0 con 0x7fb650102570 2024-09-12T01:29:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb65914e740 1 Processor -- start 2024-09-12T01:29:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb64dffb640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb6400a2cf0 0x7fb6400a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb65914e740 1 -- start start 2024-09-12T01:29:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb65914e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f2b40 0x55fa3d7f1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb65914e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb655312640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb6400a2cf0 0x7fb6400a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb65914e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 0x55fa3d800970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb65914e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d7572f0 con 0x55fa3d7f2b40 2024-09-12T01:29:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb64dffb640 1 -- 172.21.15.81:0/1599021897 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb63c0cedb0 con 0x7fb650102570 2024-09-12T01:29:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb65914e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d6fecf0 con 0x55fa3d7fe580 2024-09-12T01:29:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb65914e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d7532b0 con 0x55fa3d7f15d0 2024-09-12T01:29:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb654b11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f2b40 0x55fa3d7f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb654b11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f2b40 0x55fa3d7f1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60892/0 (socket says 172.21.15.81:60892) 2024-09-12T01:29:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.978+0000 7fb654b11640 1 -- 172.21.15.81:0/3948284863 learned_addr learned my addr 172.21.15.81:0/3948284863 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.979+0000 7fb64ffff640 1 --2- 172.21.15.81:0/3948284863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.979+0000 7fb654b11640 1 -- 172.21.15.81:0/3948284863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f15d0 msgr2=0x55fa3d7f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.979+0000 7fb654b11640 1 --2- 172.21.15.81:0/3948284863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7f1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.979+0000 7fb654b11640 1 -- 172.21.15.81:0/3948284863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 msgr2=0x55fa3d800970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.979+0000 7fb654b11640 1 --2- 172.21.15.81:0/3948284863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 0x55fa3d800970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.979+0000 7fb654b11640 1 -- 172.21.15.81:0/3948284863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3d6e33a0 con 0x55fa3d7f2b40 2024-09-12T01:29:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.979+0000 7fb655312640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb6400a2cf0 0x7fb6400a51b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb648005e30 tx=0x7fb648009820 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.979+0000 7fb654b11640 1 --2- 172.21.15.81:0/3948284863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f2b40 0x55fa3d7f1090 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb64400ad00 tx=0x7fb64400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0a5237630f8f8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.979+0000 7fb63affd640 1 -- 172.21.15.81:0/3948284863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64401d070 con 0x55fa3d7f2b40 2024-09-12T01:29:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.979+0000 7fb63affd640 1 -- 172.21.15.81:0/3948284863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb644018b20 con 0x55fa3d7f2b40 2024-09-12T01:29:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.979+0000 7fb63affd640 1 -- 172.21.15.81:0/3948284863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644010bc0 con 0x55fa3d7f2b40 2024-09-12T01:29:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.980+0000 7fb65914e740 1 -- 172.21.15.81:0/3948284863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f2b40 msgr2=0x55fa3d7f1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.980+0000 7fb65914e740 1 --2- 172.21.15.81:0/3948284863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f2b40 0x55fa3d7f1090 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb64400ad00 tx=0x7fb64400f790 comp rx=0 tx=0).stop 2024-09-12T01:29:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.980+0000 7fb65914e740 1 -- 172.21.15.81:0/3948284863 shutdown_connections 2024-09-12T01:29:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.980+0000 7fb65914e740 1 --2- 172.21.15.81:0/3948284863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 0x55fa3d800970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.980+0000 7fb65914e740 1 --2- 172.21.15.81:0/3948284863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.980+0000 7fb65914e740 1 --2- 172.21.15.81:0/3948284863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f2b40 0x55fa3d7f1090 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.980+0000 7fb65914e740 1 -- 172.21.15.81:0/3948284863 >> 172.21.15.81:0/3948284863 conn(0x55fa3d7ba310 msgr2=0x55fa3d7edc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.980+0000 7fb65914e740 1 -- 172.21.15.81:0/3948284863 shutdown_connections 2024-09-12T01:29:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.980+0000 7fb65914e740 1 -- 172.21.15.81:0/3948284863 wait complete. 2024-09-12T01:29:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.980+0000 7fb65914e740 1 -- start start 2024-09-12T01:29:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.980+0000 7fb65914e740 1 Processor -- start 2024-09-12T01:29:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb65914e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7fdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb65914e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7f2b40 0x55fa3d7fb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb65914e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7fe580 0x55fa3d7fba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb65914e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d801280 con 0x55fa3d7f15d0 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb65914e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d712060 con 0x55fa3d7f2b40 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb65914e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fa3d801400 con 0x55fa3d7fe580 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb65914e740 10 client.0 _ll_register_callbacks cb 0x55fa3d4658c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb654b11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7fdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb654b11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7fdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60904/0 (socket says 172.21.15.81:60904) 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb654b11640 1 -- 172.21.15.81:0/1103112930 learned_addr learned my addr 172.21.15.81:0/1103112930 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb64ffff640 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7f2b40 0x55fa3d7fb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb655312640 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7fe580 0x55fa3d7fba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb654b11640 1 -- 172.21.15.81:0/1103112930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7fe580 msgr2=0x55fa3d7fba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb654b11640 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7fe580 0x55fa3d7fba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb654b11640 1 -- 172.21.15.81:0/1103112930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7f2b40 msgr2=0x55fa3d7fb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb654b11640 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7f2b40 0x55fa3d7fb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb654b11640 1 -- 172.21.15.81:0/1103112930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3d4c83c0 con 0x55fa3d7f15d0 2024-09-12T01:29:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.981+0000 7fb64ffff640 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7f2b40 0x55fa3d7fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb654b11640 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7fdfc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb64401b040 tx=0x7fb644018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9563b23f34f229 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb62ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb62ffff640 1 -- 172.21.15.81:0/1103112930 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64401d040 con 0x55fa3d7f15d0 2024-09-12T01:29:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb62ffff640 1 -- 172.21.15.81:0/1103112930 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb644010900 con 0x55fa3d7f15d0 2024-09-12T01:29:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb65914e740 1 -- 172.21.15.81:0/1103112930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb644018b20 con 0x55fa3d7f15d0 2024-09-12T01:29:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb62ffff640 1 -- 172.21.15.81:0/1103112930 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb644031050 con 0x55fa3d7f15d0 2024-09-12T01:29:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb65914e740 10 client.15783 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb65914e740 1 -- 172.21.15.81:0/1103112930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fa3d80cda0 con 0x55fa3d7f15d0 2024-09-12T01:29:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb62ffff640 1 -- 172.21.15.81:0/1103112930 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb644018b20 con 0x55fa3d7f15d0 2024-09-12T01:29:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb62ffff640 1 -- 172.21.15.81:0/1103112930 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb644020030 con 0x55fa3d7f15d0 2024-09-12T01:29:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb65914e740 10 client.15783 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb65914e740 10 client.15783 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:29:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb65914e740 20 client.15783 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb65914e740 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55fa3d80e1a0 0x55fa3d810590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb65914e740 4 client.15783 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:29:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.982+0000 7fb65914e740 1 -- 172.21.15.81:0/1103112930 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa3d764860 con 0x55fa3d80e1a0 2024-09-12T01:29:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.983+0000 7fb64ffff640 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55fa3d80e1a0 0x55fa3d810590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.983+0000 7fb62ffff640 10 client.15783 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:29:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.983+0000 7fb64ffff640 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55fa3d80e1a0 0x55fa3d810590 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c0c99bdee50f8ef server_cookie=b0fcefe997e498bb in_seq=0 out_seq=0 2024-09-12T01:29:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb62ffff640 1 -- 172.21.15.81:0/1103112930 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa3d764860 con 0x55fa3d80e1a0 2024-09-12T01:29:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb62ffff640 10 client.15783 handle_command_reply: tid=0 2024-09-12T01:29:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb65914e740 1 client.15783 shutdown 2024-09-12T01:29:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb65914e740 1 -- 172.21.15.81:0/1103112930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 msgr2=0x55fa3d7fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb65914e740 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7fdfc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb64401b040 tx=0x7fb644018670 comp rx=0 tx=0).stop 2024-09-12T01:29:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb65914e740 1 -- 172.21.15.81:0/1103112930 shutdown_connections 2024-09-12T01:29:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb65914e740 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55fa3d80e1a0 0x55fa3d810590 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb65914e740 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7fe580 0x55fa3d7fba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb65914e740 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7f2b40 0x55fa3d7fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb65914e740 1 --2- 172.21.15.81:0/1103112930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7fdfc0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb65914e740 1 -- 172.21.15.81:0/1103112930 >> 172.21.15.81:0/1103112930 conn(0x55fa3d7ba310 msgr2=0x55fa3d7f3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb62ffff640 0 client.15783 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:29:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb65914e740 1 -- 172.21.15.81:0/1103112930 shutdown_connections 2024-09-12T01:29:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.984+0000 7fb65914e740 1 -- 172.21.15.81:0/1103112930 wait complete. 2024-09-12T01:29:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:38.985+0000 7fb65914e740 20 client.15783 trim_cache size 0 max 16384 2024-09-12T01:29:39.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.009+0000 7fb65914e740 1 Processor -- start 2024-09-12T01:29:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.009+0000 7fb65914e740 1 -- start start 2024-09-12T01:29:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.009+0000 7fb65914e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7ede10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.009+0000 7fb65914e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f2b40 0x55fa3d815bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.009+0000 7fb65914e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 0x55fa3d816130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.009+0000 7fb65914e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501ab580 con 0x55fa3d7f15d0 2024-09-12T01:29:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.009+0000 7fb65914e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501ad0c0 con 0x55fa3d7fe580 2024-09-12T01:29:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.009+0000 7fb65914e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501abc50 con 0x55fa3d7f2b40 2024-09-12T01:29:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb654b11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7ede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb654b11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7ede10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60908/0 (socket says 172.21.15.81:60908) 2024-09-12T01:29:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb654b11640 1 -- 172.21.15.81:0/3341650561 learned_addr learned my addr 172.21.15.81:0/3341650561 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb64ffff640 1 --2- 172.21.15.81:0/3341650561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f2b40 0x55fa3d815bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb655312640 1 --2- 172.21.15.81:0/3341650561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 0x55fa3d816130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb654b11640 1 -- 172.21.15.81:0/3341650561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f2b40 msgr2=0x55fa3d815bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb654b11640 1 --2- 172.21.15.81:0/3341650561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f2b40 0x55fa3d815bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb654b11640 1 -- 172.21.15.81:0/3341650561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 msgr2=0x55fa3d816130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb654b11640 1 --2- 172.21.15.81:0/3341650561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 0x55fa3d816130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb654b11640 1 -- 172.21.15.81:0/3341650561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa3d7f4120 con 0x55fa3d7f15d0 2024-09-12T01:29:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb654b11640 1 --2- 172.21.15.81:0/3341650561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7ede10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb64400fd10 tx=0x7fb64400a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee460a4eb791218 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb63a7fc640 1 -- 172.21.15.81:0/3341650561 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64401d070 con 0x55fa3d7f15d0 2024-09-12T01:29:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb63a7fc640 1 -- 172.21.15.81:0/3341650561 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb64403a070 con 0x55fa3d7f15d0 2024-09-12T01:29:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.010+0000 7fb63a7fc640 1 -- 172.21.15.81:0/3341650561 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644018b40 con 0x55fa3d7f15d0 2024-09-12T01:29:39.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.011+0000 7fb65914e740 1 -- 172.21.15.81:0/3341650561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 msgr2=0x55fa3d7ede10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:39.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.011+0000 7fb65914e740 1 --2- 172.21.15.81:0/3341650561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7ede10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb64400fd10 tx=0x7fb64400a2d0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.011+0000 7fb65914e740 1 -- 172.21.15.81:0/3341650561 shutdown_connections 2024-09-12T01:29:39.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.011+0000 7fb65914e740 1 --2- 172.21.15.81:0/3341650561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 0x55fa3d816130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.011+0000 7fb65914e740 1 --2- 172.21.15.81:0/3341650561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f2b40 0x55fa3d815bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.011+0000 7fb65914e740 1 --2- 172.21.15.81:0/3341650561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d7ede10 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.011+0000 7fb65914e740 1 -- 172.21.15.81:0/3341650561 >> 172.21.15.81:0/3341650561 conn(0x55fa3d7ba310 msgr2=0x55fa3d7ed700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.011+0000 7fb65914e740 1 -- 172.21.15.81:0/3341650561 shutdown_connections 2024-09-12T01:29:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.011+0000 7fb65914e740 1 -- 172.21.15.81:0/3341650561 wait complete. 2024-09-12T01:29:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb65914e740 1 -- start start 2024-09-12T01:29:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb65914e740 1 Processor -- start 2024-09-12T01:29:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb65914e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d801680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb65914e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f2b40 0x55fa3d801bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb65914e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 0x55fa3d802100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb65914e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501ac9f0 con 0x55fa3d7f15d0 2024-09-12T01:29:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb65914e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501ac320 con 0x55fa3d7fe580 2024-09-12T01:29:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb65914e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501a9580 con 0x55fa3d7f2b40 2024-09-12T01:29:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb65914e740 10 client.0 _ll_register_callbacks cb 0x7fb64401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb654b11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d801680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb654b11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d801680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60912/0 (socket says 172.21.15.81:60912) 2024-09-12T01:29:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb654b11640 1 -- 172.21.15.81:0/3683494937 learned_addr learned my addr 172.21.15.81:0/3683494937 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb655312640 1 --2- 172.21.15.81:0/3683494937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 0x55fa3d802100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.012+0000 7fb64ffff640 1 --2- 172.21.15.81:0/3683494937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f2b40 0x55fa3d801bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb654b11640 1 -- 172.21.15.81:0/3683494937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f2b40 msgr2=0x55fa3d801bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb654b11640 1 --2- 172.21.15.81:0/3683494937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f2b40 0x55fa3d801bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb654b11640 1 -- 172.21.15.81:0/3683494937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 msgr2=0x55fa3d802100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb654b11640 1 --2- 172.21.15.81:0/3683494937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 0x55fa3d802100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb654b11640 1 -- 172.21.15.81:0/3683494937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3d876cb0 con 0x55fa3d7f15d0 2024-09-12T01:29:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb654b11640 1 --2- 172.21.15.81:0/3683494937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d801680 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb64400a5c0 tx=0x7fb64400aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e155ae43fb64f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb62ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb62ffff640 1 -- 172.21.15.81:0/3683494937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64401d040 con 0x55fa3d7f15d0 2024-09-12T01:29:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb62ffff640 1 -- 172.21.15.81:0/3683494937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb644018650 con 0x55fa3d7f15d0 2024-09-12T01:29:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb65914e740 1 -- 172.21.15.81:0/3683494937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb64403a070 con 0x55fa3d7f15d0 2024-09-12T01:29:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb62ffff640 1 -- 172.21.15.81:0/3683494937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb644018ad0 con 0x55fa3d7f15d0 2024-09-12T01:29:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb65914e740 10 client.15789 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb65914e740 1 -- 172.21.15.81:0/3683494937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fa3d877fb0 con 0x55fa3d7f15d0 2024-09-12T01:29:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.013+0000 7fb62ffff640 1 -- 172.21.15.81:0/3683494937 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb64403a070 con 0x55fa3d7f15d0 2024-09-12T01:29:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.014+0000 7fb62ffff640 1 -- 172.21.15.81:0/3683494937 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb644020040 con 0x55fa3d7f15d0 2024-09-12T01:29:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.014+0000 7fb65914e740 10 client.15789 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.014+0000 7fb65914e740 10 client.15789 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:29:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.014+0000 7fb65914e740 20 client.15789 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.014+0000 7fb65914e740 1 --2- 172.21.15.81:0/3683494937 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55fa3d878560 0x55fa3d87a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.014+0000 7fb65914e740 4 client.15789 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:29:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.014+0000 7fb65914e740 1 -- 172.21.15.81:0/3683494937 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fa3d75ed70 con 0x55fa3d878560 2024-09-12T01:29:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.014+0000 7fb64ffff640 1 --2- 172.21.15.81:0/3683494937 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55fa3d878560 0x55fa3d87a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.014+0000 7fb62ffff640 10 client.15789 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:29:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.014+0000 7fb64ffff640 1 --2- 172.21.15.81:0/3683494937 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55fa3d878560 0x55fa3d87a980 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d4425877ce7664e7 server_cookie=d01d1edd0f3968d8 in_seq=0 out_seq=0 2024-09-12T01:29:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb62ffff640 1 -- 172.21.15.81:0/3683494937 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fa3d75ed70 con 0x55fa3d878560 2024-09-12T01:29:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb62ffff640 10 client.15789 handle_command_reply: tid=0 2024-09-12T01:29:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb65914e740 1 client.15789 shutdown 2024-09-12T01:29:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb65914e740 1 -- 172.21.15.81:0/3683494937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 msgr2=0x55fa3d801680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb65914e740 1 --2- 172.21.15.81:0/3683494937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d801680 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb64400a5c0 tx=0x7fb64400aa70 comp rx=0 tx=0).stop 2024-09-12T01:29:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb65914e740 1 -- 172.21.15.81:0/3683494937 shutdown_connections 2024-09-12T01:29:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb65914e740 1 --2- 172.21.15.81:0/3683494937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa3d7fe580 0x55fa3d802100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb65914e740 1 --2- 172.21.15.81:0/3683494937 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55fa3d878560 0x55fa3d87a980 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb65914e740 1 --2- 172.21.15.81:0/3683494937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa3d7f2b40 0x55fa3d801bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb65914e740 1 --2- 172.21.15.81:0/3683494937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fa3d7f15d0 0x55fa3d801680 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb62ffff640 0 client.15789 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:29:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb65914e740 1 -- 172.21.15.81:0/3683494937 >> 172.21.15.81:0/3683494937 conn(0x55fa3d7ba310 msgr2=0x55fa3d7f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb65914e740 1 -- 172.21.15.81:0/3683494937 shutdown_connections 2024-09-12T01:29:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb65914e740 1 -- 172.21.15.81:0/3683494937 wait complete. 2024-09-12T01:29:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.015+0000 7fb65914e740 20 client.15789 trim_cache size 0 max 16384 2024-09-12T01:29:39.020 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:29:39.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.016+0000 7fb656d75640 1 -- 172.21.15.81:0/1599021897 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb6400a2cf0 msgr2=0x7fb6400a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:39.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.016+0000 7fb656d75640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb6400a2cf0 0x7fb6400a51b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb648005e30 tx=0x7fb648009820 comp rx=0 tx=0).stop 2024-09-12T01:29:39.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.016+0000 7fb656d75640 1 -- 172.21.15.81:0/1599021897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb650102570 msgr2=0x7fb650197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:39.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.016+0000 7fb656d75640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb650102570 0x7fb650197860 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00d770 tx=0x7fb63c00db70 comp rx=0 tx=0).stop 2024-09-12T01:29:39.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.016+0000 7fb656d75640 1 -- 172.21.15.81:0/1599021897 shutdown_connections 2024-09-12T01:29:39.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.016+0000 7fb656d75640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb6400a2cf0 0x7fb6400a51b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.016+0000 7fb656d75640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb650102ef0 0x7fb65019bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.016+0000 7fb656d75640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb650102570 0x7fb650197860 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.016+0000 7fb656d75640 1 --2- 172.21.15.81:0/1599021897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb650100e20 0x7fb650197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.016+0000 7fb656d75640 1 -- 172.21.15.81:0/1599021897 >> 172.21.15.81:0/1599021897 conn(0x7fb6500fc7d0 msgr2=0x7fb6501067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.016+0000 7fb656d75640 1 -- 172.21.15.81:0/1599021897 shutdown_connections 2024-09-12T01:29:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:39.016+0000 7fb656d75640 1 -- 172.21.15.81:0/1599021897 wait complete. 2024-09-12T01:29:39.022 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:38 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1796650573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:29:39.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:38 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1796650573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:29:39.714 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:39 smithi081 ceph-mon[30920]: pgmap v50: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 862 KiB/s wr, 12 op/s 2024-09-12T01:29:39.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:29:40.014 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:29:40.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:39 smithi100 ceph-mon[35275]: pgmap v50: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 862 KiB/s wr, 12 op/s 2024-09-12T01:29:40.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:39 smithi189 ceph-mon[35357]: pgmap v50: 97 pgs: 97 active+clean; 2.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 862 KiB/s wr, 12 op/s 2024-09-12T01:29:40.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.500+0000 7f92d28b0640 1 -- 172.21.15.81:0/3616156716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1036e0 msgr2=0x7f92cc107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:40.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.500+0000 7f92d28b0640 1 --2- 172.21.15.81:0/3616156716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1036e0 0x7f92cc107b90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f92c0009930 tx=0x7f92c002a420 comp rx=0 tx=0).stop 2024-09-12T01:29:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.500+0000 7f92d28b0640 1 -- 172.21.15.81:0/3616156716 shutdown_connections 2024-09-12T01:29:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.500+0000 7f92d28b0640 1 --2- 172.21.15.81:0/3616156716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92cc1082a0 0x7f92cc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.500+0000 7f92d28b0640 1 --2- 172.21.15.81:0/3616156716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1036e0 0x7f92cc107b90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.500+0000 7f92d28b0640 1 --2- 172.21.15.81:0/3616156716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92cc102d30 0x7f92cc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.500+0000 7f92d28b0640 1 -- 172.21.15.81:0/3616156716 >> 172.21.15.81:0/3616156716 conn(0x7f92cc0fc7d0 msgr2=0x7f92cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.500+0000 7f92d28b0640 1 -- 172.21.15.81:0/3616156716 shutdown_connections 2024-09-12T01:29:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.500+0000 7f92d28b0640 1 -- 172.21.15.81:0/3616156716 wait complete. 2024-09-12T01:29:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.500+0000 7f92d28b0640 1 Processor -- start 2024-09-12T01:29:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92d28b0640 1 -- start start 2024-09-12T01:29:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92d28b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92cc102d30 0x7f92cc100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92d28b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1036e0 0x7f92cc100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92d28b0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92cc1082a0 0x7f92cc101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92d28b0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc112060 con 0x7f92cc1036e0 2024-09-12T01:29:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92d28b0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc111ee0 con 0x7f92cc1082a0 2024-09-12T01:29:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92d28b0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1121e0 con 0x7f92cc102d30 2024-09-12T01:29:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92cb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1036e0 0x7f92cc100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92cb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1036e0 0x7f92cc100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60934/0 (socket says 172.21.15.81:60934) 2024-09-12T01:29:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92cb7fe640 1 -- 172.21.15.81:0/358272071 learned_addr learned my addr 172.21.15.81:0/358272071 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92cbfff640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92cc102d30 0x7f92cc100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92d0e4d640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92cc1082a0 0x7f92cc101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92cb7fe640 1 -- 172.21.15.81:0/358272071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92cc102d30 msgr2=0x7f92cc100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92cb7fe640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92cc102d30 0x7f92cc100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92cb7fe640 1 -- 172.21.15.81:0/358272071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92cc1082a0 msgr2=0x7f92cc101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92cb7fe640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92cc1082a0 0x7f92cc101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.501+0000 7f92cb7fe640 1 -- 172.21.15.81:0/358272071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92cc1a6a80 con 0x7f92cc1036e0 2024-09-12T01:29:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.502+0000 7f92cb7fe640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1036e0 0x7f92cc100ed0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f92c0005940 tx=0x7f92c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.502+0000 7f92c97fa640 1 -- 172.21.15.81:0/358272071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c003f030 con 0x7f92cc1036e0 2024-09-12T01:29:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.502+0000 7f92d28b0640 1 -- 172.21.15.81:0/358272071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92cc1a6d10 con 0x7f92cc1036e0 2024-09-12T01:29:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.502+0000 7f92c97fa640 1 -- 172.21.15.81:0/358272071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92c0003ce0 con 0x7f92cc1036e0 2024-09-12T01:29:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.502+0000 7f92c97fa640 1 -- 172.21.15.81:0/358272071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c0035070 con 0x7f92cc1036e0 2024-09-12T01:29:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.502+0000 7f92d28b0640 1 -- 172.21.15.81:0/358272071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92cc1a71a0 con 0x7f92cc1036e0 2024-09-12T01:29:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.505+0000 7f92c97fa640 1 -- 172.21.15.81:0/358272071 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f92c0042030 con 0x7f92cc1036e0 2024-09-12T01:29:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.505+0000 7f92d4c89740 1 Processor -- start 2024-09-12T01:29:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.505+0000 7f92d4c89740 1 -- start start 2024-09-12T01:29:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.505+0000 7f92d4c89740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 0x55c0f0b20090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.505+0000 7f92d4c89740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 0x55c0f0b20a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.505+0000 7f92d4c89740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 0x55c0f0b2d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.505+0000 7f92d4c89740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c0f0a862f0 con 0x55c0f0b205d0 2024-09-12T01:29:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.505+0000 7f92d4c89740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c0f0a2dcf0 con 0x55c0f0b2b370 2024-09-12T01:29:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.505+0000 7f92d4c89740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c0f0a822b0 con 0x55c0f0b21b40 2024-09-12T01:29:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92c97fa640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f92b40a2cf0 0x7f92b40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 0x55c0f0b20a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 0x55c0f0b20a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60950/0 (socket says 172.21.15.81:60950) 2024-09-12T01:29:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92cbfff640 1 -- 172.21.15.81:0/249924817 learned_addr learned my addr 172.21.15.81:0/249924817 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92d0e4d640 1 --2- 172.21.15.81:0/249924817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 0x55c0f0b20090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92d0e4d640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f92b40a2cf0 0x7f92b40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92cb7fe640 1 --2- 172.21.15.81:0/249924817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 0x55c0f0b2d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92c97fa640 1 -- 172.21.15.81:0/358272071 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f92c00ef7c0 con 0x7f92cc1036e0 2024-09-12T01:29:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92cbfff640 1 -- 172.21.15.81:0/249924817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 msgr2=0x55c0f0b20090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:40.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92cbfff640 1 --2- 172.21.15.81:0/249924817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 0x55c0f0b20090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92cbfff640 1 -- 172.21.15.81:0/249924817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 msgr2=0x55c0f0b2d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:40.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92cbfff640 1 --2- 172.21.15.81:0/249924817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 0x55c0f0b2d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92cbfff640 1 -- 172.21.15.81:0/249924817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0f0a123a0 con 0x55c0f0b205d0 2024-09-12T01:29:40.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92d0e4d640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f92b40a2cf0 0x7f92b40a51b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009fd0 tx=0x7f92c4009600 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:40.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92cbfff640 1 --2- 172.21.15.81:0/249924817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 0x55c0f0b20a10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00bd10 tx=0x7f92bc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45b5f7d844a2cae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:40.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.506+0000 7f92b27fc640 1 -- 172.21.15.81:0/249924817 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc004030 con 0x55c0f0b205d0 2024-09-12T01:29:40.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.507+0000 7f92b27fc640 1 -- 172.21.15.81:0/249924817 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92bc0041d0 con 0x55c0f0b205d0 2024-09-12T01:29:40.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.507+0000 7f92b27fc640 1 -- 172.21.15.81:0/249924817 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc011840 con 0x55c0f0b205d0 2024-09-12T01:29:40.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.507+0000 7f92d4c89740 1 -- 172.21.15.81:0/249924817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 msgr2=0x55c0f0b20a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:40.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.507+0000 7f92d4c89740 1 --2- 172.21.15.81:0/249924817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 0x55c0f0b20a10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00bd10 tx=0x7f92bc0107a0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.507+0000 7f92d4c89740 1 -- 172.21.15.81:0/249924817 shutdown_connections 2024-09-12T01:29:40.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.507+0000 7f92d4c89740 1 --2- 172.21.15.81:0/249924817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 0x55c0f0b2d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.507+0000 7f92d4c89740 1 --2- 172.21.15.81:0/249924817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 0x55c0f0b20a10 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.507+0000 7f92d4c89740 1 --2- 172.21.15.81:0/249924817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 0x55c0f0b20090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.507+0000 7f92d4c89740 1 -- 172.21.15.81:0/249924817 >> 172.21.15.81:0/249924817 conn(0x55c0f0ae9310 msgr2=0x55c0f0b1cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:40.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.507+0000 7f92d4c89740 1 -- 172.21.15.81:0/249924817 shutdown_connections 2024-09-12T01:29:40.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.507+0000 7f92d4c89740 1 -- 172.21.15.81:0/249924817 wait complete. 2024-09-12T01:29:40.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.508+0000 7f92d4c89740 1 -- start start 2024-09-12T01:29:40.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.508+0000 7f92d4c89740 1 Processor -- start 2024-09-12T01:29:40.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.508+0000 7f92d4c89740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 0x55c0f0b2ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.508+0000 7f92d4c89740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 0x55c0f0b27fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.508+0000 7f92d4c89740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 0x55c0f0b28530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.508+0000 7f92d4c89740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c0f0b2e070 con 0x55c0f0b205d0 2024-09-12T01:29:40.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.508+0000 7f92d4c89740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c0f0a41060 con 0x55c0f0b2b370 2024-09-12T01:29:40.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.508+0000 7f92d4c89740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c0f0b2e1f0 con 0x55c0f0b21b40 2024-09-12T01:29:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.508+0000 7f92d4c89740 10 client.0 _ll_register_callbacks cb 0x55c0f07948c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.508+0000 7f92cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 0x55c0f0b2ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.508+0000 7f92cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 0x55c0f0b2ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60966/0 (socket says 172.21.15.81:60966) 2024-09-12T01:29:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.508+0000 7f92cbfff640 1 -- 172.21.15.81:0/3983776777 learned_addr learned my addr 172.21.15.81:0/3983776777 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92d0e4d640 1 --2- 172.21.15.81:0/3983776777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 0x55c0f0b28530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92cb7fe640 1 --2- 172.21.15.81:0/3983776777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 0x55c0f0b27fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92cbfff640 1 -- 172.21.15.81:0/3983776777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 msgr2=0x55c0f0b27fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92cbfff640 1 --2- 172.21.15.81:0/3983776777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 0x55c0f0b27fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92cbfff640 1 -- 172.21.15.81:0/3983776777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 msgr2=0x55c0f0b28530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92cbfff640 1 --2- 172.21.15.81:0/3983776777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 0x55c0f0b28530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92cbfff640 1 -- 172.21.15.81:0/3983776777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0f07f73c0 con 0x55c0f0b205d0 2024-09-12T01:29:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92cbfff640 1 --2- 172.21.15.81:0/3983776777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 0x55c0f0b2ad00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f92bc005c50 tx=0x7f92bc005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c53fba90a3919d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:40.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92ab7fe640 1 -- 172.21.15.81:0/3983776777 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc029060 con 0x55c0f0b205d0 2024-09-12T01:29:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92ab7fe640 1 -- 172.21.15.81:0/3983776777 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f92bc003f10 con 0x55c0f0b205d0 2024-09-12T01:29:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92d4c89740 1 -- 172.21.15.81:0/3983776777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92bc0041d0 con 0x55c0f0b205d0 2024-09-12T01:29:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92ab7fe640 1 -- 172.21.15.81:0/3983776777 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f92bc0035f0 con 0x55c0f0b205d0 2024-09-12T01:29:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92d4c89740 10 client.15801 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.509+0000 7f92d4c89740 1 -- 172.21.15.81:0/3983776777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c0f0b39ad0 con 0x55c0f0b205d0 2024-09-12T01:29:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.510+0000 7f92ab7fe640 1 -- 172.21.15.81:0/3983776777 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92bc0041d0 con 0x55c0f0b205d0 2024-09-12T01:29:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.510+0000 7f92ab7fe640 1 -- 172.21.15.81:0/3983776777 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f92bc0046c0 con 0x55c0f0b205d0 2024-09-12T01:29:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.510+0000 7f92d4c89740 10 client.15801 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:40.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.510+0000 7f92d4c89740 10 client.15801 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:29:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.510+0000 7f92d4c89740 20 client.15801 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.510+0000 7f92d4c89740 1 --2- 172.21.15.81:0/3983776777 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55c0f0b3aed0 0x55c0f0b3d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.510+0000 7f92d4c89740 4 client.15801 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:29:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.510+0000 7f92d4c89740 1 -- 172.21.15.81:0/3983776777 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0f0a93860 con 0x55c0f0b3aed0 2024-09-12T01:29:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.510+0000 7f92cb7fe640 1 --2- 172.21.15.81:0/3983776777 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55c0f0b3aed0 0x55c0f0b3d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.511+0000 7f92cb7fe640 1 --2- 172.21.15.81:0/3983776777 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55c0f0b3aed0 0x55c0f0b3d2c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b700425e880c53b8 server_cookie=5b865d9136b9e50a in_seq=0 out_seq=0 2024-09-12T01:29:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.511+0000 7f92ab7fe640 10 client.15801 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:29:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.511+0000 7f92ab7fe640 1 -- 172.21.15.81:0/3983776777 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c0f0a93860 con 0x55c0f0b3aed0 2024-09-12T01:29:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.511+0000 7f92ab7fe640 10 client.15801 handle_command_reply: tid=0 2024-09-12T01:29:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.511+0000 7f92d4c89740 1 client.15801 shutdown 2024-09-12T01:29:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.511+0000 7f92d4c89740 1 -- 172.21.15.81:0/3983776777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 msgr2=0x55c0f0b2ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.511+0000 7f92d4c89740 1 --2- 172.21.15.81:0/3983776777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 0x55c0f0b2ad00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f92bc005c50 tx=0x7f92bc005c80 comp rx=0 tx=0).stop 2024-09-12T01:29:40.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.511+0000 7f92d4c89740 1 -- 172.21.15.81:0/3983776777 shutdown_connections 2024-09-12T01:29:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.512+0000 7f92d4c89740 1 --2- 172.21.15.81:0/3983776777 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55c0f0b3aed0 0x55c0f0b3d2c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.512+0000 7f92d4c89740 1 --2- 172.21.15.81:0/3983776777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 0x55c0f0b28530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.512+0000 7f92d4c89740 1 --2- 172.21.15.81:0/3983776777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 0x55c0f0b27fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.512+0000 7f92ab7fe640 0 client.15801 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:29:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.512+0000 7f92d4c89740 1 --2- 172.21.15.81:0/3983776777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b205d0 0x55c0f0b2ad00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.512+0000 7f92d4c89740 1 -- 172.21.15.81:0/3983776777 >> 172.21.15.81:0/3983776777 conn(0x55c0f0ae9310 msgr2=0x55c0f0b22930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.512+0000 7f92d4c89740 1 -- 172.21.15.81:0/3983776777 shutdown_connections 2024-09-12T01:29:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.512+0000 7f92d4c89740 1 -- 172.21.15.81:0/3983776777 wait complete. 2024-09-12T01:29:40.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.512+0000 7f92d4c89740 20 client.15801 trim_cache size 0 max 16384 2024-09-12T01:29:40.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d4c89740 1 Processor -- start 2024-09-12T01:29:40.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d4c89740 1 -- start start 2024-09-12T01:29:40.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d4c89740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b205d0 0x55c0f0b37340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d4c89740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 0x55c0f0b26f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d4c89740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b2b370 0x55c0f0b42860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d4c89740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1afac0 con 0x55c0f0b2b370 2024-09-12T01:29:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d4c89740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1b1600 con 0x55c0f0b205d0 2024-09-12T01:29:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d4c89740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1b0190 con 0x55c0f0b21b40 2024-09-12T01:29:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d0e4d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b2b370 0x55c0f0b42860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d0e4d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b2b370 0x55c0f0b42860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60976/0 (socket says 172.21.15.81:60976) 2024-09-12T01:29:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d0e4d640 1 -- 172.21.15.81:0/3493881582 learned_addr learned my addr 172.21.15.81:0/3493881582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92cbfff640 1 --2- 172.21.15.81:0/3493881582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b205d0 0x55c0f0b37340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92cb7fe640 1 --2- 172.21.15.81:0/3493881582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 0x55c0f0b26f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d0e4d640 1 -- 172.21.15.81:0/3493881582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 msgr2=0x55c0f0b26f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d0e4d640 1 --2- 172.21.15.81:0/3493881582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 0x55c0f0b26f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d0e4d640 1 -- 172.21.15.81:0/3493881582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b205d0 msgr2=0x55c0f0b37340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d0e4d640 1 --2- 172.21.15.81:0/3493881582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b205d0 0x55c0f0b37340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92d0e4d640 1 -- 172.21.15.81:0/3493881582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0f0b3d5f0 con 0x55c0f0b2b370 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92cbfff640 1 --2- 172.21.15.81:0/3493881582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b205d0 0x55c0f0b37340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.525+0000 7f92cb7fe640 1 --2- 172.21.15.81:0/3493881582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 0x55c0f0b26f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.526+0000 7f92d0e4d640 1 --2- 172.21.15.81:0/3493881582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b2b370 0x55c0f0b42860 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f92c40129d0 tx=0x7f92c400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d95326d65eefc26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.526+0000 7f92b1ffb640 1 -- 172.21.15.81:0/3493881582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c402e070 con 0x55c0f0b2b370 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.526+0000 7f92b1ffb640 1 -- 172.21.15.81:0/3493881582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92c400ae50 con 0x55c0f0b2b370 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.526+0000 7f92b1ffb640 1 -- 172.21.15.81:0/3493881582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c4029d70 con 0x55c0f0b2b370 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.527+0000 7f92d4c89740 1 -- 172.21.15.81:0/3493881582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b2b370 msgr2=0x55c0f0b42860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.527+0000 7f92d4c89740 1 --2- 172.21.15.81:0/3493881582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b2b370 0x55c0f0b42860 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f92c40129d0 tx=0x7f92c400c000 comp rx=0 tx=0).stop 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.527+0000 7f92d4c89740 1 -- 172.21.15.81:0/3493881582 shutdown_connections 2024-09-12T01:29:40.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.527+0000 7f92d4c89740 1 --2- 172.21.15.81:0/3493881582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b2b370 0x55c0f0b42860 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.527+0000 7f92d4c89740 1 --2- 172.21.15.81:0/3493881582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b21b40 0x55c0f0b26f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.527+0000 7f92d4c89740 1 --2- 172.21.15.81:0/3493881582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b205d0 0x55c0f0b37340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.527+0000 7f92d4c89740 1 -- 172.21.15.81:0/3493881582 >> 172.21.15.81:0/3493881582 conn(0x55c0f0ae9310 msgr2=0x55c0f0b26880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.527+0000 7f92d4c89740 1 -- 172.21.15.81:0/3493881582 shutdown_connections 2024-09-12T01:29:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.527+0000 7f92d4c89740 1 -- 172.21.15.81:0/3493881582 wait complete. 2024-09-12T01:29:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.527+0000 7f92d4c89740 1 -- start start 2024-09-12T01:29:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92d4c89740 1 Processor -- start 2024-09-12T01:29:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92d4c89740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b205d0 0x55c0f0b33bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92d4c89740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b21b40 0x55c0f0b2eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92d4c89740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 0x55c0f0b2f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92d4c89740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1b0f30 con 0x55c0f0b21b40 2024-09-12T01:29:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92d4c89740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1b0860 con 0x55c0f0b2b370 2024-09-12T01:29:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92d4c89740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc1adaa0 con 0x55c0f0b205d0 2024-09-12T01:29:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92d4c89740 10 client.0 _ll_register_callbacks cb 0x7f92c4009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92cb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b21b40 0x55c0f0b2eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92cb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b21b40 0x55c0f0b2eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60992/0 (socket says 172.21.15.81:60992) 2024-09-12T01:29:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92cb7fe640 1 -- 172.21.15.81:0/2505563371 learned_addr learned my addr 172.21.15.81:0/2505563371 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92cbfff640 1 --2- 172.21.15.81:0/2505563371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b205d0 0x55c0f0b33bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92d0e4d640 1 --2- 172.21.15.81:0/2505563371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 0x55c0f0b2f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92cb7fe640 1 -- 172.21.15.81:0/2505563371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b205d0 msgr2=0x55c0f0b33bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92cb7fe640 1 --2- 172.21.15.81:0/2505563371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b205d0 0x55c0f0b33bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92cb7fe640 1 -- 172.21.15.81:0/2505563371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 msgr2=0x55c0f0b2f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92cb7fe640 1 --2- 172.21.15.81:0/2505563371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 0x55c0f0b2f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.528+0000 7f92cb7fe640 1 -- 172.21.15.81:0/2505563371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0f0b2fc00 con 0x55c0f0b21b40 2024-09-12T01:29:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92cb7fe640 1 --2- 172.21.15.81:0/2505563371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b21b40 0x55c0f0b2eee0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f92c00bbd00 tx=0x7f92c0047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1c99422cb3d1d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92ab7fe640 1 -- 172.21.15.81:0/2505563371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c0049040 con 0x55c0f0b21b40 2024-09-12T01:29:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92ab7fe640 1 -- 172.21.15.81:0/2505563371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f92c00ba0c0 con 0x55c0f0b21b40 2024-09-12T01:29:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92d4c89740 1 -- 172.21.15.81:0/2505563371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92c400ae50 con 0x55c0f0b21b40 2024-09-12T01:29:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92ab7fe640 1 -- 172.21.15.81:0/2505563371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f92c00bbdc0 con 0x55c0f0b21b40 2024-09-12T01:29:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92d4c89740 10 client.15807 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92d4c89740 1 -- 172.21.15.81:0/2505563371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c0f0ba5840 con 0x55c0f0b21b40 2024-09-12T01:29:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92ab7fe640 1 -- 172.21.15.81:0/2505563371 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92c400ae50 con 0x55c0f0b21b40 2024-09-12T01:29:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92ab7fe640 1 -- 172.21.15.81:0/2505563371 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f92c00b8430 con 0x55c0f0b21b40 2024-09-12T01:29:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92d4c89740 10 client.15807 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92d4c89740 10 client.15807 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:29:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92d4c89740 20 client.15807 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92d4c89740 1 --2- 172.21.15.81:0/2505563371 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55c0f0ba5f70 0x55c0f0ba8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:40.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92d4c89740 4 client.15807 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:29:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.529+0000 7f92d4c89740 1 -- 172.21.15.81:0/2505563371 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c0f0a8dd70 con 0x55c0f0ba5f70 2024-09-12T01:29:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.530+0000 7f92cbfff640 1 --2- 172.21.15.81:0/2505563371 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55c0f0ba5f70 0x55c0f0ba8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.530+0000 7f92cbfff640 1 --2- 172.21.15.81:0/2505563371 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55c0f0ba5f70 0x55c0f0ba8390 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6aecfea32ed0ba0a server_cookie=555d07e547f01700 in_seq=0 out_seq=0 2024-09-12T01:29:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.530+0000 7f92ab7fe640 10 client.15807 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:29:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.530+0000 7f92ab7fe640 1 -- 172.21.15.81:0/2505563371 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c0f0a8dd70 con 0x55c0f0ba5f70 2024-09-12T01:29:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.530+0000 7f92ab7fe640 10 client.15807 handle_command_reply: tid=0 2024-09-12T01:29:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.530+0000 7f92d4c89740 1 client.15807 shutdown 2024-09-12T01:29:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.531+0000 7f92d4c89740 1 -- 172.21.15.81:0/2505563371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b21b40 msgr2=0x55c0f0b2eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.531+0000 7f92d4c89740 1 --2- 172.21.15.81:0/2505563371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b21b40 0x55c0f0b2eee0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f92c00bbd00 tx=0x7f92c0047000 comp rx=0 tx=0).stop 2024-09-12T01:29:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.531+0000 7f92d4c89740 1 -- 172.21.15.81:0/2505563371 shutdown_connections 2024-09-12T01:29:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.531+0000 7f92d4c89740 1 --2- 172.21.15.81:0/2505563371 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55c0f0ba5f70 0x55c0f0ba8390 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.531+0000 7f92d4c89740 1 --2- 172.21.15.81:0/2505563371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0f0b2b370 0x55c0f0b2f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.531+0000 7f92d4c89740 1 --2- 172.21.15.81:0/2505563371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0f0b21b40 0x55c0f0b2eee0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.531+0000 7f92d4c89740 1 --2- 172.21.15.81:0/2505563371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0f0b205d0 0x55c0f0b33bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.531+0000 7f92d4c89740 1 -- 172.21.15.81:0/2505563371 >> 172.21.15.81:0/2505563371 conn(0x55c0f0ae9310 msgr2=0x55c0f0b270a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:40.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.531+0000 7f92ab7fe640 0 client.15807 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:29:40.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.531+0000 7f92d4c89740 1 -- 172.21.15.81:0/2505563371 shutdown_connections 2024-09-12T01:29:40.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.531+0000 7f92d4c89740 1 -- 172.21.15.81:0/2505563371 wait complete. 2024-09-12T01:29:40.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.531+0000 7f92d4c89740 20 client.15807 trim_cache size 0 max 16384 2024-09-12T01:29:40.540 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:29:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.532+0000 7f92d28b0640 1 -- 172.21.15.81:0/358272071 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f92b40a2cf0 msgr2=0x7f92b40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.532+0000 7f92d28b0640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f92b40a2cf0 0x7f92b40a51b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009fd0 tx=0x7f92c4009600 comp rx=0 tx=0).stop 2024-09-12T01:29:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.532+0000 7f92d28b0640 1 -- 172.21.15.81:0/358272071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1036e0 msgr2=0x7f92cc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.532+0000 7f92d28b0640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1036e0 0x7f92cc100ed0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f92c0005940 tx=0x7f92c00042f0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.532+0000 7f92d28b0640 1 -- 172.21.15.81:0/358272071 shutdown_connections 2024-09-12T01:29:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.532+0000 7f92d28b0640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f92b40a2cf0 0x7f92b40a51b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.532+0000 7f92d28b0640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92cc1082a0 0x7f92cc101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.532+0000 7f92d28b0640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92cc1036e0 0x7f92cc100ed0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.532+0000 7f92d28b0640 1 --2- 172.21.15.81:0/358272071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92cc102d30 0x7f92cc100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.532+0000 7f92d28b0640 1 -- 172.21.15.81:0/358272071 >> 172.21.15.81:0/358272071 conn(0x7f92cc0fc7d0 msgr2=0x7f92cc105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.532+0000 7f92d28b0640 1 -- 172.21.15.81:0/358272071 shutdown_connections 2024-09-12T01:29:40.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:40.532+0000 7f92d28b0640 1 -- 172.21.15.81:0/358272071 wait complete. 2024-09-12T01:29:41.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:29:41.494 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:29:41.877 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:41 smithi081 ceph-mon[30920]: pgmap v51: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-12T01:29:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.963+0000 7f5c20202640 1 -- 172.21.15.81:0/703798106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c18106b80 msgr2=0x7f5c18106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.963+0000 7f5c20202640 1 --2- 172.21.15.81:0/703798106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c18106b80 0x7f5c18106f60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009900 tx=0x7f5c0802a410 comp rx=0 tx=0).stop 2024-09-12T01:29:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.963+0000 7f5c20202640 1 -- 172.21.15.81:0/703798106 shutdown_connections 2024-09-12T01:29:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.963+0000 7f5c20202640 1 --2- 172.21.15.81:0/703798106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c18100aa0 0x7f5c1810ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.963+0000 7f5c20202640 1 --2- 172.21.15.81:0/703798106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c18100100 0x7f5c18100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.963+0000 7f5c20202640 1 --2- 172.21.15.81:0/703798106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c18106b80 0x7f5c18106f60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.963+0000 7f5c20202640 1 -- 172.21.15.81:0/703798106 >> 172.21.15.81:0/703798106 conn(0x7f5c18077230 msgr2=0x7f5c180fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.963+0000 7f5c20202640 1 -- 172.21.15.81:0/703798106 shutdown_connections 2024-09-12T01:29:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.963+0000 7f5c20202640 1 -- 172.21.15.81:0/703798106 wait complete. 2024-09-12T01:29:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c20202640 1 Processor -- start 2024-09-12T01:29:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c20202640 1 -- start start 2024-09-12T01:29:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c20202640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c18100100 0x7f5c18198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c20202640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c18100aa0 0x7f5c18198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c20202640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c18106b80 0x7f5c1819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c20202640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18112070 con 0x7f5c18100aa0 2024-09-12T01:29:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c20202640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18111ef0 con 0x7f5c18106b80 2024-09-12T01:29:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c20202640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181121f0 con 0x7f5c18100100 2024-09-12T01:29:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c1d79d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c18100aa0 0x7f5c18198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c1d79d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c18100aa0 0x7f5c18198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32772/0 (socket says 172.21.15.81:32772) 2024-09-12T01:29:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c1d79d640 1 -- 172.21.15.81:0/1211186297 learned_addr learned my addr 172.21.15.81:0/1211186297 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c1df9e640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c18100100 0x7f5c18198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c1e79f640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c18106b80 0x7f5c1819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c1d79d640 1 -- 172.21.15.81:0/1211186297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c18100100 msgr2=0x7f5c18198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c1d79d640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c18100100 0x7f5c18198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c1d79d640 1 -- 172.21.15.81:0/1211186297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c18106b80 msgr2=0x7f5c1819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c1d79d640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c18106b80 0x7f5c1819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c1d79d640 1 -- 172.21.15.81:0/1211186297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1819d500 con 0x7f5c18100aa0 2024-09-12T01:29:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.964+0000 7f5c1e79f640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c18106b80 0x7f5c1819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.965+0000 7f5c1d79d640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c18100aa0 0x7f5c18198a90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400b4a0 tx=0x7f5c1400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.965+0000 7f5c0effd640 1 -- 172.21.15.81:0/1211186297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14014070 con 0x7f5c18100aa0 2024-09-12T01:29:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.965+0000 7f5c20202640 1 -- 172.21.15.81:0/1211186297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1819d7f0 con 0x7f5c18100aa0 2024-09-12T01:29:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.965+0000 7f5c0effd640 1 -- 172.21.15.81:0/1211186297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c14010af0 con 0x7f5c18100aa0 2024-09-12T01:29:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.965+0000 7f5c20202640 1 -- 172.21.15.81:0/1211186297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c181a50d0 con 0x7f5c18100aa0 2024-09-12T01:29:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.965+0000 7f5c0effd640 1 -- 172.21.15.81:0/1211186297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1401e060 con 0x7f5c18100aa0 2024-09-12T01:29:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.968+0000 7f5c0effd640 1 -- 172.21.15.81:0/1211186297 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5c14017070 con 0x7f5c18100aa0 2024-09-12T01:29:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.968+0000 7f5c225db740 1 Processor -- start 2024-09-12T01:29:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.968+0000 7f5c225db740 1 -- start start 2024-09-12T01:29:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.968+0000 7f5c225db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 0x55f1f5437090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.968+0000 7f5c225db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 0x55f1f5437a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.968+0000 7f5c225db740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f5442370 0x55f1f5444760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.968+0000 7f5c225db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f1f539d2f0 con 0x55f1f54375d0 2024-09-12T01:29:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.968+0000 7f5c225db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f1f5344cf0 con 0x55f1f5438b40 2024-09-12T01:29:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.968+0000 7f5c225db740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f1f53992b0 con 0x55f1f5442370 2024-09-12T01:29:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c1df9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 0x55f1f5437a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c1df9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 0x55f1f5437a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32784/0 (socket says 172.21.15.81:32784) 2024-09-12T01:29:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c1df9e640 1 -- 172.21.15.81:0/352920727 learned_addr learned my addr 172.21.15.81:0/352920727 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c1d79d640 1 --2- 172.21.15.81:0/352920727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f5442370 0x55f1f5444760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c1e79f640 1 --2- 172.21.15.81:0/352920727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 0x55f1f5437090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c1df9e640 1 -- 172.21.15.81:0/352920727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f5442370 msgr2=0x55f1f5444760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c1df9e640 1 --2- 172.21.15.81:0/352920727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f5442370 0x55f1f5444760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c1df9e640 1 -- 172.21.15.81:0/352920727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 msgr2=0x55f1f5437090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c1df9e640 1 --2- 172.21.15.81:0/352920727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 0x55f1f5437090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c1df9e640 1 -- 172.21.15.81:0/352920727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f53293a0 con 0x55f1f54375d0 2024-09-12T01:29:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c1d79d640 1 --2- 172.21.15.81:0/352920727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f5442370 0x55f1f5444760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c0effd640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f5c040a2cf0 0x7f5c040a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c1df9e640 1 --2- 172.21.15.81:0/352920727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 0x55f1f5437a10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009900 tx=0x7f5c08031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc2b2683b94727b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c1e79f640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f5c040a2cf0 0x7f5c040a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c0effd640 1 -- 172.21.15.81:0/1211186297 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f5c140cea60 con 0x7f5c18100aa0 2024-09-12T01:29:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.969+0000 7f5c03fff640 1 -- 172.21.15.81:0/352920727 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08040070 con 0x55f1f54375d0 2024-09-12T01:29:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.970+0000 7f5c03fff640 1 -- 172.21.15.81:0/352920727 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c08005020 con 0x55f1f54375d0 2024-09-12T01:29:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.970+0000 7f5c03fff640 1 -- 172.21.15.81:0/352920727 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08035040 con 0x55f1f54375d0 2024-09-12T01:29:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.970+0000 7f5c225db740 1 -- 172.21.15.81:0/352920727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 msgr2=0x55f1f5437a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.970+0000 7f5c1e79f640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f5c040a2cf0 0x7f5c040a51b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5c181077c0 tx=0x7f5c10009580 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.970+0000 7f5c225db740 1 --2- 172.21.15.81:0/352920727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 0x55f1f5437a10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009900 tx=0x7f5c08031630 comp rx=0 tx=0).stop 2024-09-12T01:29:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.970+0000 7f5c225db740 1 -- 172.21.15.81:0/352920727 shutdown_connections 2024-09-12T01:29:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.970+0000 7f5c225db740 1 --2- 172.21.15.81:0/352920727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f5442370 0x55f1f5444760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.970+0000 7f5c225db740 1 --2- 172.21.15.81:0/352920727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 0x55f1f5437a10 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.970+0000 7f5c225db740 1 --2- 172.21.15.81:0/352920727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 0x55f1f5437090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.970+0000 7f5c225db740 1 -- 172.21.15.81:0/352920727 >> 172.21.15.81:0/352920727 conn(0x55f1f5400310 msgr2=0x55f1f5433c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.970+0000 7f5c225db740 1 -- 172.21.15.81:0/352920727 shutdown_connections 2024-09-12T01:29:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.970+0000 7f5c225db740 1 -- 172.21.15.81:0/352920727 wait complete. 2024-09-12T01:29:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.971+0000 7f5c225db740 1 -- start start 2024-09-12T01:29:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.971+0000 7f5c225db740 1 Processor -- start 2024-09-12T01:29:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.971+0000 7f5c225db740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f54375d0 0x55f1f5441cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.971+0000 7f5c225db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 0x55f1f543efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.971+0000 7f5c225db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5442370 0x55f1f543f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.971+0000 7f5c225db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f1f5445010 con 0x55f1f5442370 2024-09-12T01:29:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.971+0000 7f5c225db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f1f5358060 con 0x55f1f5438b40 2024-09-12T01:29:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.971+0000 7f5c225db740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f1f5445190 con 0x55f1f54375d0 2024-09-12T01:29:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.971+0000 7f5c225db740 10 client.0 _ll_register_callbacks cb 0x55f1f50ab8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c1e79f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5442370 0x55f1f543f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c1e79f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5442370 0x55f1f543f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32800/0 (socket says 172.21.15.81:32800) 2024-09-12T01:29:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c1e79f640 1 -- 172.21.15.81:0/2315174507 learned_addr learned my addr 172.21.15.81:0/2315174507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c1df9e640 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f54375d0 0x55f1f5441cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c1d79d640 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 0x55f1f543efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c1e79f640 1 -- 172.21.15.81:0/2315174507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f54375d0 msgr2=0x55f1f5441cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c1e79f640 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f54375d0 0x55f1f5441cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c1e79f640 1 -- 172.21.15.81:0/2315174507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 msgr2=0x55f1f543efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c1e79f640 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 0x55f1f543efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c1e79f640 1 -- 172.21.15.81:0/2315174507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f510e3c0 con 0x55f1f5442370 2024-09-12T01:29:42.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c1df9e640 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f54375d0 0x55f1f5441cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:42.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c1e79f640 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5442370 0x55f1f543f520 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009d50 tx=0x7f5c10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5437f1e2f8f4719a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:42.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c017fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:42.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c017fa640 1 -- 172.21.15.81:0/2315174507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1000fae0 con 0x55f1f5442370 2024-09-12T01:29:42.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c017fa640 1 -- 172.21.15.81:0/2315174507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f5c1000fc80 con 0x55f1f5442370 2024-09-12T01:29:42.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.972+0000 7f5c225db740 1 -- 172.21.15.81:0/2315174507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c08005020 con 0x55f1f5442370 2024-09-12T01:29:42.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.973+0000 7f5c017fa640 1 -- 172.21.15.81:0/2315174507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5c1000fe80 con 0x55f1f5442370 2024-09-12T01:29:42.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.973+0000 7f5c225db740 10 client.15819 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:42.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.973+0000 7f5c225db740 1 -- 172.21.15.81:0/2315174507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f1f5450aa0 con 0x55f1f5442370 2024-09-12T01:29:42.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.973+0000 7f5c017fa640 1 -- 172.21.15.81:0/2315174507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c08005020 con 0x55f1f5442370 2024-09-12T01:29:42.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.973+0000 7f5c017fa640 1 -- 172.21.15.81:0/2315174507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5c1000f040 con 0x55f1f5442370 2024-09-12T01:29:42.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.973+0000 7f5c225db740 10 client.15819 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:42.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.973+0000 7f5c225db740 10 client.15819 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:29:42.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.973+0000 7f5c225db740 20 client.15819 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.973+0000 7f5c225db740 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55f1f5451eb0 0x55f1f5454300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.973+0000 7f5c225db740 4 client.15819 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:29:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.973+0000 7f5c225db740 1 -- 172.21.15.81:0/2315174507 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1f53aa860 con 0x55f1f5451eb0 2024-09-12T01:29:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.973+0000 7f5c1df9e640 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55f1f5451eb0 0x55f1f5454300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.974+0000 7f5c1df9e640 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55f1f5451eb0 0x55f1f5454300 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c6ae706931f595a3 server_cookie=7c799e15b70ebc49 in_seq=0 out_seq=0 2024-09-12T01:29:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.974+0000 7f5c017fa640 10 client.15819 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:29:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c017fa640 1 -- 172.21.15.81:0/2315174507 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1f53aa860 con 0x55f1f5451eb0 2024-09-12T01:29:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c017fa640 10 client.15819 handle_command_reply: tid=0 2024-09-12T01:29:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c225db740 1 client.15819 shutdown 2024-09-12T01:29:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c225db740 1 -- 172.21.15.81:0/2315174507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5442370 msgr2=0x55f1f543f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c225db740 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5442370 0x55f1f543f520 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009d50 tx=0x7f5c10004a40 comp rx=0 tx=0).stop 2024-09-12T01:29:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c225db740 1 -- 172.21.15.81:0/2315174507 shutdown_connections 2024-09-12T01:29:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c225db740 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55f1f5451eb0 0x55f1f5454300 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c225db740 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5442370 0x55f1f543f520 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c225db740 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 0x55f1f543efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c017fa640 0 client.15819 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c225db740 1 --2- 172.21.15.81:0/2315174507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f54375d0 0x55f1f5441cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c225db740 1 -- 172.21.15.81:0/2315174507 >> 172.21.15.81:0/2315174507 conn(0x55f1f5400310 msgr2=0x55f1f5439960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c225db740 1 -- 172.21.15.81:0/2315174507 shutdown_connections 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c225db740 1 -- 172.21.15.81:0/2315174507 wait complete. 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.975+0000 7f5c225db740 20 client.15819 trim_cache size 0 max 16384 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.988+0000 7f5c225db740 1 Processor -- start 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.988+0000 7f5c225db740 1 -- start start 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.988+0000 7f5c225db740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f54375d0 0x55f1f5433e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.988+0000 7f5c225db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5438b40 0x55f1f544e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.988+0000 7f5c225db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5442370 0x55f1f543a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.988+0000 7f5c225db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181ad880 con 0x55f1f5438b40 2024-09-12T01:29:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.988+0000 7f5c225db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181af3c0 con 0x55f1f5442370 2024-09-12T01:29:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.988+0000 7f5c225db740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181adf50 con 0x55f1f54375d0 2024-09-12T01:29:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c1d79d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5438b40 0x55f1f544e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c1d79d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5438b40 0x55f1f544e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32812/0 (socket says 172.21.15.81:32812) 2024-09-12T01:29:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c1d79d640 1 -- 172.21.15.81:0/2217590926 learned_addr learned my addr 172.21.15.81:0/2217590926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c1e79f640 1 --2- 172.21.15.81:0/2217590926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5442370 0x55f1f543a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c1df9e640 1 --2- 172.21.15.81:0/2217590926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f54375d0 0x55f1f5433e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c1d79d640 1 -- 172.21.15.81:0/2217590926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f54375d0 msgr2=0x55f1f5433e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c1d79d640 1 --2- 172.21.15.81:0/2217590926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f54375d0 0x55f1f5433e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c1d79d640 1 -- 172.21.15.81:0/2217590926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5442370 msgr2=0x55f1f543a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c1d79d640 1 --2- 172.21.15.81:0/2217590926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5442370 0x55f1f543a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c1d79d640 1 -- 172.21.15.81:0/2217590926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f5434730 con 0x55f1f5438b40 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c1df9e640 1 --2- 172.21.15.81:0/2217590926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f54375d0 0x55f1f5433e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c1d79d640 1 --2- 172.21.15.81:0/2217590926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5438b40 0x55f1f544e2b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400be60 tx=0x7f5c140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5940dc9cfda57e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c037fe640 1 -- 172.21.15.81:0/2217590926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c140a3d30 con 0x55f1f5438b40 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c037fe640 1 -- 172.21.15.81:0/2217590926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c140993c0 con 0x55f1f5438b40 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.989+0000 7f5c037fe640 1 -- 172.21.15.81:0/2217590926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14017cd0 con 0x55f1f5438b40 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.990+0000 7f5c225db740 1 -- 172.21.15.81:0/2217590926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5438b40 msgr2=0x55f1f544e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.990+0000 7f5c225db740 1 --2- 172.21.15.81:0/2217590926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5438b40 0x55f1f544e2b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400be60 tx=0x7f5c140046c0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.990+0000 7f5c225db740 1 -- 172.21.15.81:0/2217590926 shutdown_connections 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.990+0000 7f5c225db740 1 --2- 172.21.15.81:0/2217590926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5442370 0x55f1f543a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.990+0000 7f5c225db740 1 --2- 172.21.15.81:0/2217590926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f5438b40 0x55f1f544e2b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.990+0000 7f5c225db740 1 --2- 172.21.15.81:0/2217590926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f54375d0 0x55f1f5433e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.990+0000 7f5c225db740 1 -- 172.21.15.81:0/2217590926 >> 172.21.15.81:0/2217590926 conn(0x55f1f5400310 msgr2=0x55f1f5433700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.990+0000 7f5c225db740 1 -- 172.21.15.81:0/2217590926 shutdown_connections 2024-09-12T01:29:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.990+0000 7f5c225db740 1 -- 172.21.15.81:0/2217590926 wait complete. 2024-09-12T01:29:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c225db740 1 -- start start 2024-09-12T01:29:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c225db740 1 Processor -- start 2024-09-12T01:29:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c225db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 0x55f1f544aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c225db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 0x55f1f543bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c225db740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f5442370 0x55f1f543c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c225db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181aecf0 con 0x55f1f54375d0 2024-09-12T01:29:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c225db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181ae620 con 0x55f1f5438b40 2024-09-12T01:29:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c225db740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181ab860 con 0x55f1f5442370 2024-09-12T01:29:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c225db740 10 client.0 _ll_register_callbacks cb 0x7f5c10009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c1df9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 0x55f1f544aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c1df9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 0x55f1f544aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32826/0 (socket says 172.21.15.81:32826) 2024-09-12T01:29:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c1df9e640 1 -- 172.21.15.81:0/1295749024 learned_addr learned my addr 172.21.15.81:0/1295749024 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c1d79d640 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 0x55f1f543bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.991+0000 7f5c1e79f640 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f5442370 0x55f1f543c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c1df9e640 1 -- 172.21.15.81:0/1295749024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f5442370 msgr2=0x55f1f543c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c1df9e640 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f5442370 0x55f1f543c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c1df9e640 1 -- 172.21.15.81:0/1295749024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 msgr2=0x55f1f543bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c1df9e640 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 0x55f1f543bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c1df9e640 1 -- 172.21.15.81:0/1295749024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f543c8b0 con 0x55f1f54375d0 2024-09-12T01:29:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c1d79d640 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 0x55f1f543bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c1df9e640 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 0x55f1f544aa60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55f1f5434ac0 tx=0x7f5c080318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bfe51f9db8b515 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c017fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c017fa640 1 -- 172.21.15.81:0/1295749024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08035040 con 0x55f1f54375d0 2024-09-12T01:29:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c017fa640 1 -- 172.21.15.81:0/1295749024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f5c08004240 con 0x55f1f54375d0 2024-09-12T01:29:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c225db740 1 -- 172.21.15.81:0/1295749024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c140993c0 con 0x55f1f54375d0 2024-09-12T01:29:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c017fa640 1 -- 172.21.15.81:0/1295749024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5c0805d050 con 0x55f1f54375d0 2024-09-12T01:29:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c225db740 10 client.15825 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c225db740 1 -- 172.21.15.81:0/1295749024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f1f54bcb30 con 0x55f1f54375d0 2024-09-12T01:29:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.992+0000 7f5c017fa640 1 -- 172.21.15.81:0/1295749024 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c140993c0 con 0x55f1f54375d0 2024-09-12T01:29:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.993+0000 7f5c017fa640 1 -- 172.21.15.81:0/1295749024 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5c08004750 con 0x55f1f54375d0 2024-09-12T01:29:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.993+0000 7f5c225db740 10 client.15825 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.993+0000 7f5c225db740 10 client.15825 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:29:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.993+0000 7f5c225db740 20 client.15825 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.993+0000 7f5c225db740 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55f1f54bce90 0x55f1f54bf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.993+0000 7f5c225db740 4 client.15825 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:29:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.993+0000 7f5c225db740 1 -- 172.21.15.81:0/1295749024 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1f53a4d70 con 0x55f1f54bce90 2024-09-12T01:29:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.993+0000 7f5c1d79d640 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55f1f54bce90 0x55f1f54bf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.993+0000 7f5c1d79d640 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55f1f54bce90 0x55f1f54bf2b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=59d0ba10458d9cff server_cookie=ecc740e9e7d446a7 in_seq=0 out_seq=0 2024-09-12T01:29:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.993+0000 7f5c017fa640 10 client.15825 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:29:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.993+0000 7f5c017fa640 1 -- 172.21.15.81:0/1295749024 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1f53a4d70 con 0x55f1f54bce90 2024-09-12T01:29:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.993+0000 7f5c017fa640 10 client.15825 handle_command_reply: tid=0 2024-09-12T01:29:42.021 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:29:42.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.993+0000 7f5c225db740 1 client.15825 shutdown 2024-09-12T01:29:42.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c225db740 1 -- 172.21.15.81:0/1295749024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 msgr2=0x55f1f544aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:42.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c225db740 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 0x55f1f544aa60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55f1f5434ac0 tx=0x7f5c080318e0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c225db740 1 -- 172.21.15.81:0/1295749024 shutdown_connections 2024-09-12T01:29:42.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c225db740 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55f1f54bce90 0x55f1f54bf2b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c225db740 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1f5442370 0x55f1f543c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c225db740 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1f5438b40 0x55f1f543bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c225db740 1 --2- 172.21.15.81:0/1295749024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1f54375d0 0x55f1f544aa60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c017fa640 0 client.15825 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:29:42.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c225db740 1 -- 172.21.15.81:0/1295749024 >> 172.21.15.81:0/1295749024 conn(0x55f1f5400310 msgr2=0x55f1f5441020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:42.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c225db740 1 -- 172.21.15.81:0/1295749024 shutdown_connections 2024-09-12T01:29:42.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c225db740 1 -- 172.21.15.81:0/1295749024 wait complete. 2024-09-12T01:29:42.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c225db740 20 client.15825 trim_cache size 0 max 16384 2024-09-12T01:29:42.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c20202640 1 -- 172.21.15.81:0/1211186297 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f5c040a2cf0 msgr2=0x7f5c040a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:42.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c20202640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f5c040a2cf0 0x7f5c040a51b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5c181077c0 tx=0x7f5c10009580 comp rx=0 tx=0).stop 2024-09-12T01:29:42.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c20202640 1 -- 172.21.15.81:0/1211186297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c18100aa0 msgr2=0x7f5c18198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:42.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c20202640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c18100aa0 0x7f5c18198a90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400b4a0 tx=0x7f5c1400b960 comp rx=0 tx=0).stop 2024-09-12T01:29:42.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.994+0000 7f5c20202640 1 -- 172.21.15.81:0/1211186297 shutdown_connections 2024-09-12T01:29:42.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.995+0000 7f5c20202640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f5c040a2cf0 0x7f5c040a51b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.995+0000 7f5c20202640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c18106b80 0x7f5c1819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.995+0000 7f5c20202640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c18100aa0 0x7f5c18198a90 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.995+0000 7f5c20202640 1 --2- 172.21.15.81:0/1211186297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c18100100 0x7f5c18198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:42.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.995+0000 7f5c20202640 1 -- 172.21.15.81:0/1211186297 >> 172.21.15.81:0/1211186297 conn(0x7f5c18077230 msgr2=0x7f5c18104c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:42.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.995+0000 7f5c20202640 1 -- 172.21.15.81:0/1211186297 shutdown_connections 2024-09-12T01:29:42.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:41.995+0000 7f5c20202640 1 -- 172.21.15.81:0/1211186297 wait complete. 2024-09-12T01:29:42.024 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:41 smithi100 ceph-mon[35275]: pgmap v51: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-12T01:29:42.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:41 smithi189 ceph-mon[35357]: pgmap v51: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-12T01:29:42.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:29:42.963 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:29:43.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.406+0000 7f928e6c2640 1 -- 172.21.15.81:0/3684593916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9288100e20 msgr2=0x7f9288101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:43.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.406+0000 7f928e6c2640 1 --2- 172.21.15.81:0/3684593916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9288100e20 0x7f9288101200 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9278009900 tx=0x7f927802a480 comp rx=0 tx=0).stop 2024-09-12T01:29:43.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.406+0000 7f928e6c2640 1 -- 172.21.15.81:0/3684593916 shutdown_connections 2024-09-12T01:29:43.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.406+0000 7f928e6c2640 1 --2- 172.21.15.81:0/3684593916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9288102ef0 0x7f928810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.406+0000 7f928e6c2640 1 --2- 172.21.15.81:0/3684593916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9288102570 0x7f92881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.406+0000 7f928e6c2640 1 --2- 172.21.15.81:0/3684593916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9288100e20 0x7f9288101200 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.406+0000 7f928e6c2640 1 -- 172.21.15.81:0/3684593916 >> 172.21.15.81:0/3684593916 conn(0x7f92880fc7d0 msgr2=0x7f92880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.406+0000 7f928e6c2640 1 -- 172.21.15.81:0/3684593916 shutdown_connections 2024-09-12T01:29:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.406+0000 7f928e6c2640 1 -- 172.21.15.81:0/3684593916 wait complete. 2024-09-12T01:29:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.407+0000 7f928e6c2640 1 Processor -- start 2024-09-12T01:29:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.407+0000 7f928e6c2640 1 -- start start 2024-09-12T01:29:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.407+0000 7f928e6c2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9288100e20 0x7f92881962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.407+0000 7f928e6c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9288102570 0x7f9288196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.407+0000 7f928e6c2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9288102ef0 0x7f928819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.407+0000 7f928e6c2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f928810fea0 con 0x7f9288102570 2024-09-12T01:29:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.407+0000 7f928e6c2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f928810fd20 con 0x7f9288102ef0 2024-09-12T01:29:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.407+0000 7f928e6c2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9288110020 con 0x7f9288100e20 2024-09-12T01:29:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.407+0000 7f927ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9288102570 0x7f9288196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.407+0000 7f927ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9288102570 0x7f9288196800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58728/0 (socket says 172.21.15.81:58728) 2024-09-12T01:29:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.407+0000 7f927ffff640 1 -- 172.21.15.81:0/3844475110 learned_addr learned my addr 172.21.15.81:0/3844475110 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f9287fff640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9288100e20 0x7f92881962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f928cc5f640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9288102ef0 0x7f928819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f927ffff640 1 -- 172.21.15.81:0/3844475110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9288100e20 msgr2=0x7f92881962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f927ffff640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9288100e20 0x7f92881962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f927ffff640 1 -- 172.21.15.81:0/3844475110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9288102ef0 msgr2=0x7f928819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f927ffff640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9288102ef0 0x7f928819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f927ffff640 1 -- 172.21.15.81:0/3844475110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928819b270 con 0x7f9288102570 2024-09-12T01:29:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f928cc5f640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9288102ef0 0x7f928819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:29:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f927ffff640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9288102570 0x7f9288196800 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f927000c920 tx=0x7f927000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f9285ffb640 1 -- 172.21.15.81:0/3844475110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270007c70 con 0x7f9288102570 2024-09-12T01:29:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f928e6c2640 1 -- 172.21.15.81:0/3844475110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928819b560 con 0x7f9288102570 2024-09-12T01:29:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f9285ffb640 1 -- 172.21.15.81:0/3844475110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9270007e10 con 0x7f9288102570 2024-09-12T01:29:43.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f9285ffb640 1 -- 172.21.15.81:0/3844475110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270018890 con 0x7f9288102570 2024-09-12T01:29:43.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.408+0000 7f928e6c2640 1 -- 172.21.15.81:0/3844475110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92881a2e40 con 0x7f9288102570 2024-09-12T01:29:43.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.411+0000 7f9285ffb640 1 -- 172.21.15.81:0/3844475110 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9270018a70 con 0x7f9288102570 2024-09-12T01:29:43.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.411+0000 7f9290a9b740 1 Processor -- start 2024-09-12T01:29:43.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.411+0000 7f9290a9b740 1 -- start start 2024-09-12T01:29:43.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.411+0000 7f9290a9b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f3eb40 0x55b520f3d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.411+0000 7f9290a9b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3d5d0 0x55b520f3da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.411+0000 7f9290a9b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f48370 0x55b520f4a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.411+0000 7f9290a9b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b520ea32f0 con 0x55b520f3eb40 2024-09-12T01:29:43.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.411+0000 7f9290a9b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b520e4acf0 con 0x55b520f48370 2024-09-12T01:29:43.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.411+0000 7f9290a9b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b520e9f2b0 con 0x55b520f3d5d0 2024-09-12T01:29:43.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.411+0000 7f9285ffb640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f92740a2cf0 0x7f92740a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f928cc5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f3eb40 0x55b520f3d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f928cc5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f3eb40 0x55b520f3d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58744/0 (socket says 172.21.15.81:58744) 2024-09-12T01:29:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f928cc5f640 1 -- 172.21.15.81:0/1688267760 learned_addr learned my addr 172.21.15.81:0/1688267760 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f928cc5f640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f92740a2cf0 0x7f92740a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f9285ffb640 1 -- 172.21.15.81:0/3844475110 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f92700cf620 con 0x7f9288102570 2024-09-12T01:29:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f927ffff640 1 --2- 172.21.15.81:0/1688267760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f48370 0x55b520f4a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f9287fff640 1 --2- 172.21.15.81:0/1688267760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3d5d0 0x55b520f3da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f928cc5f640 1 -- 172.21.15.81:0/1688267760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3d5d0 msgr2=0x55b520f3da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f928cc5f640 1 --2- 172.21.15.81:0/1688267760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3d5d0 0x55b520f3da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f928cc5f640 1 -- 172.21.15.81:0/1688267760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f48370 msgr2=0x55b520f4a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f928cc5f640 1 --2- 172.21.15.81:0/1688267760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f48370 0x55b520f4a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f928cc5f640 1 -- 172.21.15.81:0/1688267760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b520e2f3a0 con 0x55b520f3eb40 2024-09-12T01:29:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f927ffff640 1 --2- 172.21.15.81:0/1688267760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f48370 0x55b520f4a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.412+0000 7f928cc5f640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f92740a2cf0 0x7f92740a51b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9280012d60 tx=0x7f928000de50 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.413+0000 7f928cc5f640 1 --2- 172.21.15.81:0/1688267760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f3eb40 0x55b520f3d090 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f92800122f0 tx=0x7f928001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67a300025e59e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.413+0000 7f927e7fc640 1 -- 172.21.15.81:0/1688267760 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280016040 con 0x55b520f3eb40 2024-09-12T01:29:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.413+0000 7f927e7fc640 1 -- 172.21.15.81:0/1688267760 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f928001bde0 con 0x55b520f3eb40 2024-09-12T01:29:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.413+0000 7f927e7fc640 1 -- 172.21.15.81:0/1688267760 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928000cc80 con 0x55b520f3eb40 2024-09-12T01:29:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.414+0000 7f9290a9b740 1 -- 172.21.15.81:0/1688267760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f3eb40 msgr2=0x55b520f3d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.414+0000 7f9290a9b740 1 --2- 172.21.15.81:0/1688267760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f3eb40 0x55b520f3d090 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f92800122f0 tx=0x7f928001c000 comp rx=0 tx=0).stop 2024-09-12T01:29:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.414+0000 7f9290a9b740 1 -- 172.21.15.81:0/1688267760 shutdown_connections 2024-09-12T01:29:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.414+0000 7f9290a9b740 1 --2- 172.21.15.81:0/1688267760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f48370 0x55b520f4a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.414+0000 7f9290a9b740 1 --2- 172.21.15.81:0/1688267760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3d5d0 0x55b520f3da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.414+0000 7f9290a9b740 1 --2- 172.21.15.81:0/1688267760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f3eb40 0x55b520f3d090 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.414+0000 7f9290a9b740 1 -- 172.21.15.81:0/1688267760 >> 172.21.15.81:0/1688267760 conn(0x55b520f06310 msgr2=0x55b520f39c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.414+0000 7f9290a9b740 1 -- 172.21.15.81:0/1688267760 shutdown_connections 2024-09-12T01:29:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.414+0000 7f9290a9b740 1 -- 172.21.15.81:0/1688267760 wait complete. 2024-09-12T01:29:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.414+0000 7f9290a9b740 1 -- start start 2024-09-12T01:29:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.415+0000 7f9290a9b740 1 Processor -- start 2024-09-12T01:29:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.415+0000 7f9290a9b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3d5d0 0x55b520f47d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.415+0000 7f9290a9b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3eb40 0x55b520f45030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.415+0000 7f9290a9b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f45640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.415+0000 7f9290a9b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b520f4afb0 con 0x55b520f48370 2024-09-12T01:29:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.415+0000 7f9290a9b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b520e5e060 con 0x55b520f3d5d0 2024-09-12T01:29:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.415+0000 7f9290a9b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b520f4b130 con 0x55b520f3eb40 2024-09-12T01:29:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.415+0000 7f928cc5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f45640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.415+0000 7f928cc5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f45640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58756/0 (socket says 172.21.15.81:58756) 2024-09-12T01:29:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.415+0000 7f928cc5f640 1 -- 172.21.15.81:0/667067917 learned_addr learned my addr 172.21.15.81:0/667067917 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.415+0000 7f9290a9b740 10 client.0 _ll_register_callbacks cb 0x55b520bb18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.415+0000 7f927ffff640 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3eb40 0x55b520f45030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.415+0000 7f9287fff640 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3d5d0 0x55b520f47d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f928cc5f640 1 -- 172.21.15.81:0/667067917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3eb40 msgr2=0x55b520f45030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f928cc5f640 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3eb40 0x55b520f45030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f928cc5f640 1 -- 172.21.15.81:0/667067917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3d5d0 msgr2=0x55b520f47d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f928cc5f640 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3d5d0 0x55b520f47d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f928cc5f640 1 -- 172.21.15.81:0/667067917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b520c143c0 con 0x55b520f48370 2024-09-12T01:29:43.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f927ffff640 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3eb40 0x55b520f45030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:43.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f928cc5f640 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f45640 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f928000dac0 tx=0x7f928000db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f245778f9485df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:43.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f92677fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:43.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f92677fe640 1 -- 172.21.15.81:0/667067917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928000c250 con 0x55b520f48370 2024-09-12T01:29:43.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f9290a9b740 1 -- 172.21.15.81:0/667067917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f928001bde0 con 0x55b520f48370 2024-09-12T01:29:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f92677fe640 1 -- 172.21.15.81:0/667067917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f928000c3f0 con 0x55b520f48370 2024-09-12T01:29:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f92677fe640 1 -- 172.21.15.81:0/667067917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f928000b5c0 con 0x55b520f48370 2024-09-12T01:29:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f9290a9b740 10 client.15837 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f9290a9b740 1 -- 172.21.15.81:0/667067917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b520f56ad0 con 0x55b520f48370 2024-09-12T01:29:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.416+0000 7f92677fe640 1 -- 172.21.15.81:0/667067917 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f928001bde0 con 0x55b520f48370 2024-09-12T01:29:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.417+0000 7f92677fe640 1 -- 172.21.15.81:0/667067917 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f928002f070 con 0x55b520f48370 2024-09-12T01:29:43.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.417+0000 7f9290a9b740 10 client.15837 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.417+0000 7f9290a9b740 10 client.15837 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:29:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.417+0000 7f9290a9b740 20 client.15837 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.417+0000 7f9290a9b740 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b520f57e80 0x55b520f5a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.417+0000 7f9290a9b740 4 client.15837 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:29:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.417+0000 7f9290a9b740 1 -- 172.21.15.81:0/667067917 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b520eb0860 con 0x55b520f57e80 2024-09-12T01:29:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.417+0000 7f9287fff640 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b520f57e80 0x55b520f5a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.417+0000 7f9287fff640 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b520f57e80 0x55b520f5a270 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1b0af417ec133454 server_cookie=f2d88d6402f6d624 in_seq=0 out_seq=0 2024-09-12T01:29:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.417+0000 7f92677fe640 10 client.15837 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:29:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.418+0000 7f92677fe640 1 -- 172.21.15.81:0/667067917 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b520eb0860 con 0x55b520f57e80 2024-09-12T01:29:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.418+0000 7f92677fe640 10 client.15837 handle_command_reply: tid=0 2024-09-12T01:29:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.418+0000 7f9290a9b740 1 client.15837 shutdown 2024-09-12T01:29:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.418+0000 7f9290a9b740 1 -- 172.21.15.81:0/667067917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 msgr2=0x55b520f45640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.418+0000 7f9290a9b740 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f45640 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f928000dac0 tx=0x7f928000db30 comp rx=0 tx=0).stop 2024-09-12T01:29:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.419+0000 7f9290a9b740 1 -- 172.21.15.81:0/667067917 shutdown_connections 2024-09-12T01:29:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.419+0000 7f9290a9b740 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b520f57e80 0x55b520f5a270 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.419+0000 7f9290a9b740 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f45640 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.419+0000 7f9290a9b740 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3eb40 0x55b520f45030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.419+0000 7f92677fe640 0 client.15837 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:29:43.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.419+0000 7f9290a9b740 1 --2- 172.21.15.81:0/667067917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3d5d0 0x55b520f47d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.419+0000 7f9290a9b740 1 -- 172.21.15.81:0/667067917 >> 172.21.15.81:0/667067917 conn(0x55b520f06310 msgr2=0x55b520f3f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:43.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.419+0000 7f9290a9b740 1 -- 172.21.15.81:0/667067917 shutdown_connections 2024-09-12T01:29:43.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.419+0000 7f9290a9b740 1 -- 172.21.15.81:0/667067917 wait complete. 2024-09-12T01:29:43.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.419+0000 7f9290a9b740 20 client.15837 trim_cache size 0 max 16384 2024-09-12T01:29:43.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f9290a9b740 1 Processor -- start 2024-09-12T01:29:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f9290a9b740 1 -- start start 2024-09-12T01:29:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f9290a9b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3d5d0 0x55b520f54420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f9290a9b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3eb40 0x55b520f46fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f9290a9b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f5d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f9290a9b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92881ab5d0 con 0x55b520f48370 2024-09-12T01:29:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f9290a9b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f92881ad110 con 0x55b520f3eb40 2024-09-12T01:29:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f9290a9b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92881abca0 con 0x55b520f3d5d0 2024-09-12T01:29:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f928cc5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f5d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f928cc5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f5d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58768/0 (socket says 172.21.15.81:58768) 2024-09-12T01:29:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f928cc5f640 1 -- 172.21.15.81:0/1754757757 learned_addr learned my addr 172.21.15.81:0/1754757757 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:43.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f927ffff640 1 --2- 172.21.15.81:0/1754757757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3eb40 0x55b520f46fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f9287fff640 1 --2- 172.21.15.81:0/1754757757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3d5d0 0x55b520f54420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f928cc5f640 1 -- 172.21.15.81:0/1754757757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3d5d0 msgr2=0x55b520f54420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f928cc5f640 1 --2- 172.21.15.81:0/1754757757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3d5d0 0x55b520f54420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f928cc5f640 1 -- 172.21.15.81:0/1754757757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3eb40 msgr2=0x55b520f46fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f928cc5f640 1 --2- 172.21.15.81:0/1754757757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3eb40 0x55b520f46fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f928cc5f640 1 -- 172.21.15.81:0/1754757757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b520f4acf0 con 0x55b520f48370 2024-09-12T01:29:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.444+0000 7f9287fff640 1 --2- 172.21.15.81:0/1754757757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3d5d0 0x55b520f54420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.445+0000 7f928cc5f640 1 --2- 172.21.15.81:0/1754757757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f5d290 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9280012f50 tx=0x7f9280016170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf33ef91789e1996 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.445+0000 7f927dffb640 1 -- 172.21.15.81:0/1754757757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280019ad0 con 0x55b520f48370 2024-09-12T01:29:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.445+0000 7f927dffb640 1 -- 172.21.15.81:0/1754757757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f928001bdc0 con 0x55b520f48370 2024-09-12T01:29:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.445+0000 7f927dffb640 1 -- 172.21.15.81:0/1754757757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928000b760 con 0x55b520f48370 2024-09-12T01:29:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.446+0000 7f9290a9b740 1 -- 172.21.15.81:0/1754757757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 msgr2=0x55b520f5d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.446+0000 7f9290a9b740 1 --2- 172.21.15.81:0/1754757757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f5d290 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9280012f50 tx=0x7f9280016170 comp rx=0 tx=0).stop 2024-09-12T01:29:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.446+0000 7f9290a9b740 1 -- 172.21.15.81:0/1754757757 shutdown_connections 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.446+0000 7f9290a9b740 1 --2- 172.21.15.81:0/1754757757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f5d290 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.446+0000 7f9290a9b740 1 --2- 172.21.15.81:0/1754757757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3eb40 0x55b520f46fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.446+0000 7f9290a9b740 1 --2- 172.21.15.81:0/1754757757 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3d5d0 0x55b520f54420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.446+0000 7f9290a9b740 1 -- 172.21.15.81:0/1754757757 >> 172.21.15.81:0/1754757757 conn(0x55b520f06310 msgr2=0x55b520f46890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.446+0000 7f9290a9b740 1 -- 172.21.15.81:0/1754757757 shutdown_connections 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.446+0000 7f9290a9b740 1 -- 172.21.15.81:0/1754757757 wait complete. 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.446+0000 7f9290a9b740 1 -- start start 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.446+0000 7f9290a9b740 1 Processor -- start 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f9290a9b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3d5d0 0x55b520f5d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f9290a9b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3eb40 0x55b520f5aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f9290a9b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f5afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f9290a9b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92881aca40 con 0x55b520f48370 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f9290a9b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f92881ac370 con 0x55b520f3d5d0 2024-09-12T01:29:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f9290a9b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92881a95b0 con 0x55b520f3eb40 2024-09-12T01:29:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f9290a9b740 10 client.0 _ll_register_callbacks cb 0x7f9278009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f928cc5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f5afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f928cc5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f5afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58780/0 (socket says 172.21.15.81:58780) 2024-09-12T01:29:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f928cc5f640 1 -- 172.21.15.81:0/38953192 learned_addr learned my addr 172.21.15.81:0/38953192 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f927ffff640 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3eb40 0x55b520f5aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f9287fff640 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3d5d0 0x55b520f5d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f928cc5f640 1 -- 172.21.15.81:0/38953192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3eb40 msgr2=0x55b520f5aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f928cc5f640 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3eb40 0x55b520f5aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f928cc5f640 1 -- 172.21.15.81:0/38953192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3d5d0 msgr2=0x55b520f5d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f928cc5f640 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3d5d0 0x55b520f5d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f928cc5f640 1 -- 172.21.15.81:0/38953192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b520f45fd0 con 0x55b520f48370 2024-09-12T01:29:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f9287fff640 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3d5d0 0x55b520f5d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f928cc5f640 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f5afb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9280010040 tx=0x7f9280030b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7ecb8fd4d3f2ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.447+0000 7f92677fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f92677fe640 1 -- 172.21.15.81:0/38953192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280047070 con 0x55b520f48370 2024-09-12T01:29:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f92677fe640 1 -- 172.21.15.81:0/38953192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f928000c250 con 0x55b520f48370 2024-09-12T01:29:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f9290a9b740 1 -- 172.21.15.81:0/38953192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f928001bdc0 con 0x55b520f48370 2024-09-12T01:29:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f92677fe640 1 -- 172.21.15.81:0/38953192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9280053050 con 0x55b520f48370 2024-09-12T01:29:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f9290a9b740 10 client.15843 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f9290a9b740 1 -- 172.21.15.81:0/38953192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b520fc2320 con 0x55b520f48370 2024-09-12T01:29:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f92677fe640 1 -- 172.21.15.81:0/38953192 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f928001bdc0 con 0x55b520f48370 2024-09-12T01:29:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f92677fe640 1 -- 172.21.15.81:0/38953192 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9280040020 con 0x55b520f48370 2024-09-12T01:29:43.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f9290a9b740 10 client.15843 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:43.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f9290a9b740 10 client.15843 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:29:43.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f9290a9b740 20 client.15843 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:43.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f9290a9b740 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b520f57e80 0x55b520fc4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:43.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f9290a9b740 4 client.15843 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:29:43.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f9290a9b740 1 -- 172.21.15.81:0/38953192 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b520eaad70 con 0x55b520f57e80 2024-09-12T01:29:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.448+0000 7f9287fff640 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b520f57e80 0x55b520fc4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.449+0000 7f92677fe640 10 client.15843 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:29:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.449+0000 7f9287fff640 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b520f57e80 0x55b520fc4940 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a3be4041afe414e server_cookie=b67c24014651f54f in_seq=0 out_seq=0 2024-09-12T01:29:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.449+0000 7f92677fe640 1 -- 172.21.15.81:0/38953192 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b520eaad70 con 0x55b520f57e80 2024-09-12T01:29:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.449+0000 7f92677fe640 10 client.15843 handle_command_reply: tid=0 2024-09-12T01:29:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.449+0000 7f9290a9b740 1 client.15843 shutdown 2024-09-12T01:29:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.449+0000 7f9290a9b740 1 -- 172.21.15.81:0/38953192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 msgr2=0x55b520f5afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.449+0000 7f9290a9b740 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f5afb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9280010040 tx=0x7f9280030b40 comp rx=0 tx=0).stop 2024-09-12T01:29:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.449+0000 7f9290a9b740 1 -- 172.21.15.81:0/38953192 shutdown_connections 2024-09-12T01:29:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f9290a9b740 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b520f57e80 0x55b520fc4940 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f9290a9b740 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b520f48370 0x55b520f5afb0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f9290a9b740 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b520f3eb40 0x55b520f5aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f92677fe640 0 client.15843 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:29:43.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f9290a9b740 1 --2- 172.21.15.81:0/38953192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b520f3d5d0 0x55b520f5d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f9290a9b740 1 -- 172.21.15.81:0/38953192 >> 172.21.15.81:0/38953192 conn(0x55b520f06310 msgr2=0x55b520f470b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:43.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f9290a9b740 1 -- 172.21.15.81:0/38953192 shutdown_connections 2024-09-12T01:29:43.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f9290a9b740 1 -- 172.21.15.81:0/38953192 wait complete. 2024-09-12T01:29:43.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f9290a9b740 20 client.15843 trim_cache size 0 max 16384 2024-09-12T01:29:43.462 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:29:43.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f928e6c2640 1 -- 172.21.15.81:0/3844475110 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f92740a2cf0 msgr2=0x7f92740a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:43.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f928e6c2640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f92740a2cf0 0x7f92740a51b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9280012d60 tx=0x7f928000de50 comp rx=0 tx=0).stop 2024-09-12T01:29:43.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f928e6c2640 1 -- 172.21.15.81:0/3844475110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9288102570 msgr2=0x7f9288196800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:43.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f928e6c2640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9288102570 0x7f9288196800 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f927000c920 tx=0x7f927000cde0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f928e6c2640 1 -- 172.21.15.81:0/3844475110 shutdown_connections 2024-09-12T01:29:43.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f928e6c2640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f92740a2cf0 0x7f92740a51b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f928e6c2640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9288102ef0 0x7f928819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f928e6c2640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9288102570 0x7f9288196800 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.450+0000 7f928e6c2640 1 --2- 172.21.15.81:0/3844475110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9288100e20 0x7f92881962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:43.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.451+0000 7f928e6c2640 1 -- 172.21.15.81:0/3844475110 >> 172.21.15.81:0/3844475110 conn(0x7f92880fc7d0 msgr2=0x7f9288106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:43.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.451+0000 7f928e6c2640 1 -- 172.21.15.81:0/3844475110 shutdown_connections 2024-09-12T01:29:43.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:43.451+0000 7f928e6c2640 1 -- 172.21.15.81:0/3844475110 wait complete. 2024-09-12T01:29:43.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:43 smithi081 ceph-mon[30920]: pgmap v52: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 776 KiB/s wr, 13 op/s 2024-09-12T01:29:44.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:43 smithi100 ceph-mon[35275]: pgmap v52: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 776 KiB/s wr, 13 op/s 2024-09-12T01:29:44.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:43 smithi189 ceph-mon[35357]: pgmap v52: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 776 KiB/s wr, 13 op/s 2024-09-12T01:29:44.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:29:44.505 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:29:45.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.023+0000 7fbfcc695640 1 -- 172.21.15.81:0/4261222575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfc4106f40 msgr2=0x7fbfc410eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.023+0000 7fbfcc695640 1 --2- 172.21.15.81:0/4261222575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfc4106f40 0x7fbfc410eac0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009ca0 tx=0x7fbfbc02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.023+0000 7fbfcc695640 1 -- 172.21.15.81:0/4261222575 shutdown_connections 2024-09-12T01:29:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.023+0000 7fbfcc695640 1 --2- 172.21.15.81:0/4261222575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfc4106f40 0x7fbfc410eac0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.023+0000 7fbfcc695640 1 --2- 172.21.15.81:0/4261222575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfc41027c0 0x7fbfc4106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.023+0000 7fbfcc695640 1 --2- 172.21.15.81:0/4261222575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc4101e10 0x7fbfc41021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.023+0000 7fbfcc695640 1 -- 172.21.15.81:0/4261222575 >> 172.21.15.81:0/4261222575 conn(0x7fbfc40fd8d0 msgr2=0x7fbfc40ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.023+0000 7fbfcc695640 1 -- 172.21.15.81:0/4261222575 shutdown_connections 2024-09-12T01:29:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.023+0000 7fbfcc695640 1 -- 172.21.15.81:0/4261222575 wait complete. 2024-09-12T01:29:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.024+0000 7fbfcc695640 1 Processor -- start 2024-09-12T01:29:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.024+0000 7fbfcc695640 1 -- start start 2024-09-12T01:29:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.024+0000 7fbfcc695640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc4101e10 0x7fbfc4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.024+0000 7fbfcc695640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfc41027c0 0x7fbfc4198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.024+0000 7fbfcc695640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfc4106f40 0x7fbfc419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.024+0000 7fbfcc695640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc4111fa0 con 0x7fbfc41027c0 2024-09-12T01:29:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.024+0000 7fbfcc695640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc4111e20 con 0x7fbfc4101e10 2024-09-12T01:29:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.024+0000 7fbfcc695640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc4112120 con 0x7fbfc4106f40 2024-09-12T01:29:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.024+0000 7fbfc9c30640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfc41027c0 0x7fbfc4198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.024+0000 7fbfc9c30640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfc41027c0 0x7fbfc4198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58810/0 (socket says 172.21.15.81:58810) 2024-09-12T01:29:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.024+0000 7fbfc9c30640 1 -- 172.21.15.81:0/845129967 learned_addr learned my addr 172.21.15.81:0/845129967 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfca431640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc4101e10 0x7fbfc4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfcac32640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfc4106f40 0x7fbfc419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfc9c30640 1 -- 172.21.15.81:0/845129967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfc4106f40 msgr2=0x7fbfc419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfc9c30640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfc4106f40 0x7fbfc419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfc9c30640 1 -- 172.21.15.81:0/845129967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc4101e10 msgr2=0x7fbfc4198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfc9c30640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc4101e10 0x7fbfc4198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfc9c30640 1 -- 172.21.15.81:0/845129967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc419d2f0 con 0x7fbfc41027c0 2024-09-12T01:29:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfca431640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc4101e10 0x7fbfc4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfc9c30640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfc41027c0 0x7fbfc4198880 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000c920 tx=0x7fbfc000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfb77fe640 1 -- 172.21.15.81:0/845129967 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0007c70 con 0x7fbfc41027c0 2024-09-12T01:29:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfcc695640 1 -- 172.21.15.81:0/845129967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc419d5e0 con 0x7fbfc41027c0 2024-09-12T01:29:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfb77fe640 1 -- 172.21.15.81:0/845129967 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfc0007e10 con 0x7fbfc41027c0 2024-09-12T01:29:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfb77fe640 1 -- 172.21.15.81:0/845129967 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0018890 con 0x7fbfc41027c0 2024-09-12T01:29:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.025+0000 7fbfcc695640 1 -- 172.21.15.81:0/845129967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc41a4ec0 con 0x7fbfc41027c0 2024-09-12T01:29:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.028+0000 7fbfcea6e740 1 Processor -- start 2024-09-12T01:29:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.028+0000 7fbfcea6e740 1 -- start start 2024-09-12T01:29:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.028+0000 7fbfcea6e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35eb40 0x55f16a35d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.028+0000 7fbfcea6e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35d5d0 0x55f16a35da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.028+0000 7fbfcea6e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a368370 0x55f16a36a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.028+0000 7fbfcea6e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f16a2c32f0 con 0x55f16a35eb40 2024-09-12T01:29:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.028+0000 7fbfcea6e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f16a26acf0 con 0x55f16a368370 2024-09-12T01:29:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.028+0000 7fbfcea6e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f16a2bf2b0 con 0x55f16a35d5d0 2024-09-12T01:29:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.028+0000 7fbfcac32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35eb40 0x55f16a35d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.029+0000 7fbfcac32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35eb40 0x55f16a35d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58820/0 (socket says 172.21.15.81:58820) 2024-09-12T01:29:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.029+0000 7fbfcac32640 1 -- 172.21.15.81:0/710458905 learned_addr learned my addr 172.21.15.81:0/710458905 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.029+0000 7fbfb77fe640 1 -- 172.21.15.81:0/845129967 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fbfc0018b30 con 0x7fbfc41027c0 2024-09-12T01:29:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.029+0000 7fbfcac32640 1 -- 172.21.15.81:0/710458905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35d5d0 msgr2=0x55f16a35da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.029+0000 7fbfcac32640 1 --2- 172.21.15.81:0/710458905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35d5d0 0x55f16a35da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.029+0000 7fbfcac32640 1 -- 172.21.15.81:0/710458905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a368370 msgr2=0x55f16a36a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.029+0000 7fbfc9c30640 1 --2- 172.21.15.81:0/710458905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a368370 0x55f16a36a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.029+0000 7fbfcac32640 1 --2- 172.21.15.81:0/710458905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a368370 0x55f16a36a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.029+0000 7fbfcac32640 1 -- 172.21.15.81:0/710458905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f16a24f3a0 con 0x55f16a35eb40 2024-09-12T01:29:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.029+0000 7fbfcac32640 1 --2- 172.21.15.81:0/710458905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35eb40 0x55f16a35d090 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc005cc0 tx=0x7fbfbc005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe78e2af6b1eb77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.029+0000 7fbfb4ff9640 1 -- 172.21.15.81:0/710458905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc031db0 con 0x55f16a35eb40 2024-09-12T01:29:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.030+0000 7fbfb4ff9640 1 -- 172.21.15.81:0/710458905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfbc036070 con 0x55f16a35eb40 2024-09-12T01:29:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.030+0000 7fbfb4ff9640 1 -- 172.21.15.81:0/710458905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0042a0 con 0x55f16a35eb40 2024-09-12T01:29:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.030+0000 7fbfb77fe640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbfb00a2cf0 0x7fbfb00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.030+0000 7fbfca431640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbfb00a2cf0 0x7fbfb00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.030+0000 7fbfb77fe640 1 -- 172.21.15.81:0/845129967 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fbfc00cf580 con 0x7fbfc41027c0 2024-09-12T01:29:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfca431640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbfb00a2cf0 0x7fbfb00a51b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8005fd0 tx=0x7fbfb800b2c0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 -- 172.21.15.81:0/710458905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35eb40 msgr2=0x55f16a35d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/710458905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35eb40 0x55f16a35d090 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc005cc0 tx=0x7fbfbc005f70 comp rx=0 tx=0).stop 2024-09-12T01:29:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 -- 172.21.15.81:0/710458905 shutdown_connections 2024-09-12T01:29:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/710458905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a368370 0x55f16a36a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/710458905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35d5d0 0x55f16a35da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/710458905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35eb40 0x55f16a35d090 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 -- 172.21.15.81:0/710458905 >> 172.21.15.81:0/710458905 conn(0x55f16a326310 msgr2=0x55f16a359c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 -- 172.21.15.81:0/710458905 shutdown_connections 2024-09-12T01:29:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 -- 172.21.15.81:0/710458905 wait complete. 2024-09-12T01:29:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 -- start start 2024-09-12T01:29:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 Processor -- start 2024-09-12T01:29:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35d5d0 0x55f16a367d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 0x55f16a364fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a368370 0x55f16a365560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f16a36b010 con 0x55f16a35d5d0 2024-09-12T01:29:45.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f16a27e060 con 0x55f16a368370 2024-09-12T01:29:45.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.031+0000 7fbfcea6e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f16a36b190 con 0x55f16a35eb40 2024-09-12T01:29:45.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfcea6e740 10 client.0 _ll_register_callbacks cb 0x55f169fd18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:45.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfca431640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35d5d0 0x55f16a367d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfca431640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35d5d0 0x55f16a367d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58830/0 (socket says 172.21.15.81:58830) 2024-09-12T01:29:45.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfca431640 1 -- 172.21.15.81:0/2187013676 learned_addr learned my addr 172.21.15.81:0/2187013676 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:45.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfc9c30640 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 0x55f16a364fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfcac32640 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a368370 0x55f16a365560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfca431640 1 -- 172.21.15.81:0/2187013676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 msgr2=0x55f16a364fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:45.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfca431640 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 0x55f16a364fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfca431640 1 -- 172.21.15.81:0/2187013676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a368370 msgr2=0x55f16a365560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:45.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfca431640 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a368370 0x55f16a365560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfca431640 1 -- 172.21.15.81:0/2187013676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f16a0343c0 con 0x55f16a35d5d0 2024-09-12T01:29:45.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfcac32640 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a368370 0x55f16a365560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:45.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfca431640 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35d5d0 0x55f16a367d10 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8011440 tx=0x7fbfb8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ba02be012cc05b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:45.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfadffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:45.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfadffb640 1 -- 172.21.15.81:0/2187013676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8022070 con 0x55f16a35d5d0 2024-09-12T01:29:45.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfadffb640 1 -- 172.21.15.81:0/2187013676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fbfb801e860 con 0x55f16a35d5d0 2024-09-12T01:29:45.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.032+0000 7fbfcea6e740 1 -- 172.21.15.81:0/2187013676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfbc036070 con 0x55f16a35d5d0 2024-09-12T01:29:45.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.033+0000 7fbfadffb640 1 -- 172.21.15.81:0/2187013676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbfb802e050 con 0x55f16a35d5d0 2024-09-12T01:29:45.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.033+0000 7fbfcea6e740 10 client.15855 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:45.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.033+0000 7fbfcea6e740 1 -- 172.21.15.81:0/2187013676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f16a376ac0 con 0x55f16a35d5d0 2024-09-12T01:29:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.033+0000 7fbfadffb640 1 -- 172.21.15.81:0/2187013676 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfbc036070 con 0x55f16a35d5d0 2024-09-12T01:29:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.033+0000 7fbfadffb640 1 -- 172.21.15.81:0/2187013676 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbfb8010c90 con 0x55f16a35d5d0 2024-09-12T01:29:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.033+0000 7fbfcea6e740 10 client.15855 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.033+0000 7fbfcea6e740 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:29:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.033+0000 7fbfcea6e740 20 client.15855 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.033+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f16a377ed0 0x55f16a37a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.033+0000 7fbfcea6e740 4 client.15855 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:29:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.033+0000 7fbfcea6e740 1 -- 172.21.15.81:0/2187013676 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f16a2d0860 con 0x55f16a377ed0 2024-09-12T01:29:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.034+0000 7fbfc9c30640 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f16a377ed0 0x55f16a37a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.034+0000 7fbfc9c30640 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f16a377ed0 0x55f16a37a2e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34085e5d52b5d833 server_cookie=c38207d50d9b9b9a in_seq=0 out_seq=0 2024-09-12T01:29:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.034+0000 7fbfadffb640 10 client.15855 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfadffb640 1 -- 172.21.15.81:0/2187013676 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f16a2d0860 con 0x55f16a377ed0 2024-09-12T01:29:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfadffb640 10 client.15855 handle_command_reply: tid=0 2024-09-12T01:29:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfcea6e740 1 client.15855 shutdown 2024-09-12T01:29:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfcea6e740 1 -- 172.21.15.81:0/2187013676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35d5d0 msgr2=0x55f16a367d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35d5d0 0x55f16a367d10 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8011440 tx=0x7fbfb8004730 comp rx=0 tx=0).stop 2024-09-12T01:29:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfcea6e740 1 -- 172.21.15.81:0/2187013676 shutdown_connections 2024-09-12T01:29:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f16a377ed0 0x55f16a37a2e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfadffb640 0 client.15855 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a368370 0x55f16a365560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 0x55f16a364fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/2187013676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a35d5d0 0x55f16a367d10 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfcea6e740 1 -- 172.21.15.81:0/2187013676 >> 172.21.15.81:0/2187013676 conn(0x55f16a326310 msgr2=0x55f16a35f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:45.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfcea6e740 1 -- 172.21.15.81:0/2187013676 shutdown_connections 2024-09-12T01:29:45.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfcea6e740 1 -- 172.21.15.81:0/2187013676 wait complete. 2024-09-12T01:29:45.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.035+0000 7fbfcea6e740 20 client.15855 trim_cache size 0 max 16384 2024-09-12T01:29:45.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.048+0000 7fbfcea6e740 1 Processor -- start 2024-09-12T01:29:45.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.048+0000 7fbfcea6e740 1 -- start start 2024-09-12T01:29:45.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.048+0000 7fbfcea6e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a35d5d0 0x55f16a3742b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.048+0000 7fbfcea6e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 0x55f16a364880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.048+0000 7fbfcea6e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a368370 0x55f16a358c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.048+0000 7fbfcea6e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc41ad6e0 con 0x55f16a368370 2024-09-12T01:29:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.048+0000 7fbfcea6e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc41af220 con 0x55f16a35d5d0 2024-09-12T01:29:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.048+0000 7fbfcea6e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc41addb0 con 0x55f16a35eb40 2024-09-12T01:29:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.048+0000 7fbfcac32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a368370 0x55f16a358c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.049+0000 7fbfcac32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a368370 0x55f16a358c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58844/0 (socket says 172.21.15.81:58844) 2024-09-12T01:29:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.049+0000 7fbfcac32640 1 -- 172.21.15.81:0/1691601575 learned_addr learned my addr 172.21.15.81:0/1691601575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.049+0000 7fbfc9c30640 1 --2- 172.21.15.81:0/1691601575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 0x55f16a364880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.049+0000 7fbfca431640 1 --2- 172.21.15.81:0/1691601575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a35d5d0 0x55f16a3742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.049+0000 7fbfcac32640 1 -- 172.21.15.81:0/1691601575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 msgr2=0x55f16a364880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.049+0000 7fbfcac32640 1 --2- 172.21.15.81:0/1691601575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 0x55f16a364880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.049+0000 7fbfcac32640 1 -- 172.21.15.81:0/1691601575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a35d5d0 msgr2=0x55f16a3742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:45.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.049+0000 7fbfcac32640 1 --2- 172.21.15.81:0/1691601575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a35d5d0 0x55f16a3742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.049+0000 7fbfcac32640 1 -- 172.21.15.81:0/1691601575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f16a35a960 con 0x55f16a368370 2024-09-12T01:29:45.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.049+0000 7fbfcac32640 1 --2- 172.21.15.81:0/1691601575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a368370 0x55f16a358c10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc005cc0 tx=0x7fbfbc031c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1a08ab8ff85057 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.049+0000 7fbfaffff640 1 -- 172.21.15.81:0/1691601575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc051070 con 0x55f16a368370 2024-09-12T01:29:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.049+0000 7fbfaffff640 1 -- 172.21.15.81:0/1691601575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfbc036050 con 0x55f16a368370 2024-09-12T01:29:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.049+0000 7fbfaffff640 1 -- 172.21.15.81:0/1691601575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0042a0 con 0x55f16a368370 2024-09-12T01:29:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.050+0000 7fbfcea6e740 1 -- 172.21.15.81:0/1691601575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a368370 msgr2=0x55f16a358c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.050+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/1691601575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a368370 0x55f16a358c10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc005cc0 tx=0x7fbfbc031c60 comp rx=0 tx=0).stop 2024-09-12T01:29:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.050+0000 7fbfcea6e740 1 -- 172.21.15.81:0/1691601575 shutdown_connections 2024-09-12T01:29:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.050+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/1691601575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a368370 0x55f16a358c10 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.050+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/1691601575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 0x55f16a364880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.050+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/1691601575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a35d5d0 0x55f16a3742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.050+0000 7fbfcea6e740 1 -- 172.21.15.81:0/1691601575 >> 172.21.15.81:0/1691601575 conn(0x55f16a326310 msgr2=0x55f16a358500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.050+0000 7fbfcea6e740 1 -- 172.21.15.81:0/1691601575 shutdown_connections 2024-09-12T01:29:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.050+0000 7fbfcea6e740 1 -- 172.21.15.81:0/1691601575 wait complete. 2024-09-12T01:29:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.050+0000 7fbfcea6e740 1 -- start start 2024-09-12T01:29:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcea6e740 1 Processor -- start 2024-09-12T01:29:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcea6e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a35d5d0 0x55f16a370600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcea6e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 0x55f16a370b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcea6e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a368370 0x55f16a36d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcea6e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc41aeb50 con 0x55f16a368370 2024-09-12T01:29:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcea6e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc41ae480 con 0x55f16a35d5d0 2024-09-12T01:29:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcea6e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc41ab6c0 con 0x55f16a35eb40 2024-09-12T01:29:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcea6e740 10 client.0 _ll_register_callbacks cb 0x7fbfb8015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfca431640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a35d5d0 0x55f16a370600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcac32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a368370 0x55f16a36d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfca431640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a35d5d0 0x55f16a370600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:53802/0 (socket says 172.21.15.81:53802) 2024-09-12T01:29:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfca431640 1 -- 172.21.15.81:0/3408382983 learned_addr learned my addr 172.21.15.81:0/3408382983 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfc9c30640 1 --2- 172.21.15.81:0/3408382983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 0x55f16a370b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcac32640 1 -- 172.21.15.81:0/3408382983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 msgr2=0x55f16a370b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcac32640 1 --2- 172.21.15.81:0/3408382983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 0x55f16a370b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcac32640 1 -- 172.21.15.81:0/3408382983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a35d5d0 msgr2=0x55f16a370600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcac32640 1 --2- 172.21.15.81:0/3408382983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a35d5d0 0x55f16a370600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.051+0000 7fbfcac32640 1 -- 172.21.15.81:0/3408382983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f16a360120 con 0x55f16a368370 2024-09-12T01:29:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.052+0000 7fbfcac32640 1 --2- 172.21.15.81:0/3408382983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a368370 0x55f16a36d3f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc000f80 tx=0x7fbfbc0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda6e1aaf7bb3047 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.052+0000 7fbfadffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.052+0000 7fbfadffb640 1 -- 172.21.15.81:0/3408382983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc051070 con 0x55f16a368370 2024-09-12T01:29:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.052+0000 7fbfadffb640 1 -- 172.21.15.81:0/3408382983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fbfbc003970 con 0x55f16a368370 2024-09-12T01:29:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.052+0000 7fbfcea6e740 1 -- 172.21.15.81:0/3408382983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfbc036050 con 0x55f16a368370 2024-09-12T01:29:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.052+0000 7fbfadffb640 1 -- 172.21.15.81:0/3408382983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbfbc003b70 con 0x55f16a368370 2024-09-12T01:29:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.052+0000 7fbfcea6e740 10 client.15861 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.052+0000 7fbfcea6e740 1 -- 172.21.15.81:0/3408382983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f16a3e33c0 con 0x55f16a368370 2024-09-12T01:29:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.052+0000 7fbfadffb640 1 -- 172.21.15.81:0/3408382983 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfbc036050 con 0x55f16a368370 2024-09-12T01:29:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.052+0000 7fbfadffb640 1 -- 172.21.15.81:0/3408382983 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbfbc02f6a0 con 0x55f16a368370 2024-09-12T01:29:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.052+0000 7fbfcea6e740 10 client.15861 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.053+0000 7fbfcea6e740 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:29:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.053+0000 7fbfcea6e740 20 client.15861 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.053+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/3408382983 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f16a377ed0 0x55f16a3e5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.053+0000 7fbfcea6e740 4 client.15861 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:29:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.053+0000 7fbfcea6e740 1 -- 172.21.15.81:0/3408382983 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f16a2cad70 con 0x55f16a377ed0 2024-09-12T01:29:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.053+0000 7fbfca431640 1 --2- 172.21.15.81:0/3408382983 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f16a377ed0 0x55f16a3e5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.053+0000 7fbfca431640 1 --2- 172.21.15.81:0/3408382983 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f16a377ed0 0x55f16a3e5650 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a81e6a0f29130ef9 server_cookie=470f3195d0c52533 in_seq=0 out_seq=0 2024-09-12T01:29:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.053+0000 7fbfadffb640 10 client.15861 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.053+0000 7fbfadffb640 1 -- 172.21.15.81:0/3408382983 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f16a2cad70 con 0x55f16a377ed0 2024-09-12T01:29:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.053+0000 7fbfadffb640 10 client.15861 handle_command_reply: tid=0 2024-09-12T01:29:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.053+0000 7fbfcea6e740 1 client.15861 shutdown 2024-09-12T01:29:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcea6e740 1 -- 172.21.15.81:0/3408382983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a368370 msgr2=0x55f16a36d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/3408382983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a368370 0x55f16a36d3f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc000f80 tx=0x7fbfbc0319f0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcea6e740 1 -- 172.21.15.81:0/3408382983 shutdown_connections 2024-09-12T01:29:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/3408382983 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f16a377ed0 0x55f16a3e5650 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/3408382983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f16a368370 0x55f16a36d3f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/3408382983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f16a35eb40 0x55f16a370b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcea6e740 1 --2- 172.21.15.81:0/3408382983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f16a35d5d0 0x55f16a370600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcea6e740 1 -- 172.21.15.81:0/3408382983 >> 172.21.15.81:0/3408382983 conn(0x55f16a326310 msgr2=0x55f16a35f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfadffb640 0 client.15861 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcea6e740 1 -- 172.21.15.81:0/3408382983 shutdown_connections 2024-09-12T01:29:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcea6e740 1 -- 172.21.15.81:0/3408382983 wait complete. 2024-09-12T01:29:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcea6e740 20 client.15861 trim_cache size 0 max 16384 2024-09-12T01:29:45.060 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:29:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcc695640 1 -- 172.21.15.81:0/845129967 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbfb00a2cf0 msgr2=0x7fbfb00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcc695640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbfb00a2cf0 0x7fbfb00a51b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8005fd0 tx=0x7fbfb800b2c0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcc695640 1 -- 172.21.15.81:0/845129967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfc41027c0 msgr2=0x7fbfc4198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.054+0000 7fbfcc695640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfc41027c0 0x7fbfc4198880 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000c920 tx=0x7fbfc000cde0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.055+0000 7fbfcc695640 1 -- 172.21.15.81:0/845129967 shutdown_connections 2024-09-12T01:29:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.055+0000 7fbfcc695640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbfb00a2cf0 0x7fbfb00a51b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.055+0000 7fbfcc695640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbfc4106f40 0x7fbfc419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.055+0000 7fbfcc695640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfc41027c0 0x7fbfc4198880 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.055+0000 7fbfcc695640 1 --2- 172.21.15.81:0/845129967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfc4101e10 0x7fbfc4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.055+0000 7fbfcc695640 1 -- 172.21.15.81:0/845129967 >> 172.21.15.81:0/845129967 conn(0x7fbfc40fd8d0 msgr2=0x7fbfc40ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.055+0000 7fbfcc695640 1 -- 172.21.15.81:0/845129967 shutdown_connections 2024-09-12T01:29:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:45.055+0000 7fbfcc695640 1 -- 172.21.15.81:0/845129967 wait complete. 2024-09-12T01:29:45.834 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:45 smithi081 ceph-mon[30920]: pgmap v53: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 776 KiB/s wr, 12 op/s 2024-09-12T01:29:46.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:45 smithi100 ceph-mon[35275]: pgmap v53: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 776 KiB/s wr, 12 op/s 2024-09-12T01:29:46.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:45 smithi189 ceph-mon[35357]: pgmap v53: 97 pgs: 97 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 776 KiB/s wr, 12 op/s 2024-09-12T01:29:46.867 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:29:46.868 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:29:47.143 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:29:47.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.666+0000 7fada19d0640 1 -- 172.21.15.81:0/1915034923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad9c101180 msgr2=0x7fad9c1015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:47.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.666+0000 7fada19d0640 1 --2- 172.21.15.81:0/1915034923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad9c101180 0x7fad9c1015e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fad84009900 tx=0x7fad8402a410 comp rx=0 tx=0).stop 2024-09-12T01:29:47.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.666+0000 7fada19d0640 1 -- 172.21.15.81:0/1915034923 shutdown_connections 2024-09-12T01:29:47.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.666+0000 7fada19d0640 1 --2- 172.21.15.81:0/1915034923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad9c101b20 0x7fad9c10d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.666+0000 7fada19d0640 1 --2- 172.21.15.81:0/1915034923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad9c101180 0x7fad9c1015e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.666+0000 7fada19d0640 1 --2- 172.21.15.81:0/1915034923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad9c106c10 0x7fad9c106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.666+0000 7fada19d0640 1 -- 172.21.15.81:0/1915034923 >> 172.21.15.81:0/1915034923 conn(0x7fad9c0fbee0 msgr2=0x7fad9c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:47.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.666+0000 7fada19d0640 1 -- 172.21.15.81:0/1915034923 shutdown_connections 2024-09-12T01:29:47.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.666+0000 7fada19d0640 1 -- 172.21.15.81:0/1915034923 wait complete. 2024-09-12T01:29:47.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.666+0000 7fada19d0640 1 Processor -- start 2024-09-12T01:29:47.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.666+0000 7fada19d0640 1 -- start start 2024-09-12T01:29:47.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fada19d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad9c101180 0x7fad9c1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fada19d0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad9c101b20 0x7fad9c197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fada19d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad9c106c10 0x7fad9c19bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fada19d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c110f50 con 0x7fad9c106c10 2024-09-12T01:29:47.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fada19d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c110dd0 con 0x7fad9c101180 2024-09-12T01:29:47.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fada19d0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c1110d0 con 0x7fad9c101b20 2024-09-12T01:29:47.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fad9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad9c106c10 0x7fad9c19bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fad9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad9c106c10 0x7fad9c19bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58878/0 (socket says 172.21.15.81:58878) 2024-09-12T01:29:47.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fad9b7fe640 1 -- 172.21.15.81:0/1037293971 learned_addr learned my addr 172.21.15.81:0/1037293971 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:47.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fad927fc640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad9c101b20 0x7fad9c197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fad9affd640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad9c101180 0x7fad9c1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fad9b7fe640 1 -- 172.21.15.81:0/1037293971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad9c101b20 msgr2=0x7fad9c197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:47.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fad9b7fe640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad9c101b20 0x7fad9c197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fad9b7fe640 1 -- 172.21.15.81:0/1037293971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad9c101180 msgr2=0x7fad9c1973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:47.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fad9b7fe640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad9c101180 0x7fad9c1973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fad9b7fe640 1 -- 172.21.15.81:0/1037293971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c19c3a0 con 0x7fad9c106c10 2024-09-12T01:29:47.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fad9affd640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad9c101180 0x7fad9c1973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:29:47.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.667+0000 7fad9b7fe640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad9c106c10 0x7fad9c19bcc0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fad9400cce0 tx=0x7fad9400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:47.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.668+0000 7fada09ce640 1 -- 172.21.15.81:0/1037293971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9400f450 con 0x7fad9c106c10 2024-09-12T01:29:47.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.668+0000 7fada19d0640 1 -- 172.21.15.81:0/1037293971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9c19c690 con 0x7fad9c106c10 2024-09-12T01:29:47.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.668+0000 7fada09ce640 1 -- 172.21.15.81:0/1037293971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad9400fad0 con 0x7fad9c106c10 2024-09-12T01:29:47.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.668+0000 7fada09ce640 1 -- 172.21.15.81:0/1037293971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad94018c10 con 0x7fad9c106c10 2024-09-12T01:29:47.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.668+0000 7fada19d0640 1 -- 172.21.15.81:0/1037293971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9c1a3f70 con 0x7fad9c106c10 2024-09-12T01:29:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.670+0000 7fada09ce640 1 -- 172.21.15.81:0/1037293971 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fad9400f5f0 con 0x7fad9c106c10 2024-09-12T01:29:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fada3da9740 1 Processor -- start 2024-09-12T01:29:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fada3da9740 1 -- start start 2024-09-12T01:29:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fada3da9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x564676159e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fada3da9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56467615a360 0x564676166a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fada3da9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564676166f50 0x564676169340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fada3da9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5646760bf280 con 0x564676166f50 2024-09-12T01:29:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fada3da9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564676066b10 con 0x56467615a360 2024-09-12T01:29:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fada3da9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5646760bb240 con 0x564676159a40 2024-09-12T01:29:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fada09ce640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fad880a2d70 0x7fad880a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fad927fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564676166f50 0x564676169340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fad9b7fe640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fad880a2d70 0x7fad880a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fad927fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564676166f50 0x564676169340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58892/0 (socket says 172.21.15.81:58892) 2024-09-12T01:29:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fad927fc640 1 -- 172.21.15.81:0/3107272658 learned_addr learned my addr 172.21.15.81:0/3107272658 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fad9affd640 1 --2- 172.21.15.81:0/3107272658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56467615a360 0x564676166a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fad927fc640 1 --2- 172.21.15.81:0/3107272658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x564676159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.671+0000 7fada09ce640 1 -- 172.21.15.81:0/1037293971 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fad940cfaf0 con 0x7fad9c106c10 2024-09-12T01:29:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.672+0000 7fad9affd640 1 -- 172.21.15.81:0/3107272658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 msgr2=0x564676159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:47.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.672+0000 7fad9affd640 1 --2- 172.21.15.81:0/3107272658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x564676159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.672+0000 7fad9affd640 1 -- 172.21.15.81:0/3107272658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564676166f50 msgr2=0x564676169340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.672+0000 7fad9affd640 1 --2- 172.21.15.81:0/3107272658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564676166f50 0x564676169340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.672+0000 7fad9affd640 1 -- 172.21.15.81:0/3107272658 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646760731f0 con 0x56467615a360 2024-09-12T01:29:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.672+0000 7fad927fc640 1 --2- 172.21.15.81:0/3107272658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564676166f50 0x564676169340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.672+0000 7fad9b7fe640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fad880a2d70 0x7fad880a5230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad9406f020 tx=0x7fad940cd040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.672+0000 7fad9affd640 1 --2- 172.21.15.81:0/3107272658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56467615a360 0x564676166a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00dba0 tx=0x7fad8c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72bc2e36760cfd30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.672+0000 7fad91ffb640 1 -- 172.21.15.81:0/3107272658 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00de90 con 0x56467615a360 2024-09-12T01:29:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.672+0000 7fad91ffb640 1 -- 172.21.15.81:0/3107272658 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad8c005500 con 0x56467615a360 2024-09-12T01:29:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.672+0000 7fad91ffb640 1 -- 172.21.15.81:0/3107272658 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c011640 con 0x56467615a360 2024-09-12T01:29:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.673+0000 7fada3da9740 1 -- 172.21.15.81:0/3107272658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56467615a360 msgr2=0x564676166a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.673+0000 7fada3da9740 1 --2- 172.21.15.81:0/3107272658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56467615a360 0x564676166a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00dba0 tx=0x7fad8c00f730 comp rx=0 tx=0).stop 2024-09-12T01:29:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.673+0000 7fada3da9740 1 -- 172.21.15.81:0/3107272658 shutdown_connections 2024-09-12T01:29:47.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.673+0000 7fada3da9740 1 --2- 172.21.15.81:0/3107272658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564676166f50 0x564676169340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.673+0000 7fada3da9740 1 --2- 172.21.15.81:0/3107272658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56467615a360 0x564676166a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.673+0000 7fada3da9740 1 --2- 172.21.15.81:0/3107272658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x564676159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.673+0000 7fada3da9740 1 -- 172.21.15.81:0/3107272658 >> 172.21.15.81:0/3107272658 conn(0x5646761560f0 msgr2=0x5646761564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.673+0000 7fada3da9740 1 -- 172.21.15.81:0/3107272658 shutdown_connections 2024-09-12T01:29:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.673+0000 7fada3da9740 1 -- 172.21.15.81:0/3107272658 wait complete. 2024-09-12T01:29:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.673+0000 7fada3da9740 1 -- start start 2024-09-12T01:29:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fada3da9740 1 Processor -- start 2024-09-12T01:29:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fada3da9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x564676163eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fada3da9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x5646761643f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fada3da9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 0x564676164930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fada3da9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564676169b20 con 0x56467615a360 2024-09-12T01:29:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fada3da9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564676079f10 con 0x564676166f50 2024-09-12T01:29:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fada3da9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564676169ca0 con 0x564676159a40 2024-09-12T01:29:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fada3da9740 10 client.0 _ll_register_callbacks cb 0x564676042a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fad9affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x5646761643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fad9affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x5646761643f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58896/0 (socket says 172.21.15.81:58896) 2024-09-12T01:29:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fad9affd640 1 -- 172.21.15.81:0/2925464064 learned_addr learned my addr 172.21.15.81:0/2925464064 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fad927fc640 1 --2- 172.21.15.81:0/2925464064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x564676163eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fad927fc640 1 --2- 172.21.15.81:0/2925464064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 0x564676164930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fad9affd640 1 -- 172.21.15.81:0/2925464064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 msgr2=0x564676163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fad9affd640 1 --2- 172.21.15.81:0/2925464064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x564676163eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fad9affd640 1 -- 172.21.15.81:0/2925464064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 msgr2=0x564676164930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fad9affd640 1 --2- 172.21.15.81:0/2925464064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 0x564676164930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.674+0000 7fad9affd640 1 -- 172.21.15.81:0/2925464064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564675e306a0 con 0x56467615a360 2024-09-12T01:29:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fad9affd640 1 --2- 172.21.15.81:0/2925464064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x5646761643f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0048f0 tx=0x7fad8c0056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5f59232830105 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fad7affd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fad7affd640 1 -- 172.21.15.81:0/2925464064 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c02a060 con 0x56467615a360 2024-09-12T01:29:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fad7affd640 1 -- 172.21.15.81:0/2925464064 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fad8c00dc90 con 0x56467615a360 2024-09-12T01:29:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fada3da9740 1 -- 172.21.15.81:0/2925464064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad8c005500 con 0x56467615a360 2024-09-12T01:29:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fad7affd640 1 -- 172.21.15.81:0/2925464064 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fad8c00de90 con 0x56467615a360 2024-09-12T01:29:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fada3da9740 10 client.15873 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fada3da9740 1 -- 172.21.15.81:0/2925464064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564676175810 con 0x56467615a360 2024-09-12T01:29:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fad7affd640 1 -- 172.21.15.81:0/2925464064 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad8c005500 con 0x56467615a360 2024-09-12T01:29:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fad7affd640 1 -- 172.21.15.81:0/2925464064 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fad8c025ab0 con 0x56467615a360 2024-09-12T01:29:47.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fada3da9740 10 client.15873 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fada3da9740 10 client.15873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:29:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fada3da9740 20 client.15873 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fada3da9740 1 --2- 172.21.15.81:0/2925464064 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x564676176cd0 0x5646761790c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fada3da9740 4 client.15873 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:29:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.675+0000 7fada3da9740 1 -- 172.21.15.81:0/2925464064 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646760cc7f0 con 0x564676176cd0 2024-09-12T01:29:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.676+0000 7fad927fc640 1 --2- 172.21.15.81:0/2925464064 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x564676176cd0 0x5646761790c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.676+0000 7fad927fc640 1 --2- 172.21.15.81:0/2925464064 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x564676176cd0 0x5646761790c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d689f7ba9dafe13 server_cookie=2a30b04a1c4981f7 in_seq=0 out_seq=0 2024-09-12T01:29:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.676+0000 7fad7affd640 10 client.15873 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fad7affd640 1 -- 172.21.15.81:0/2925464064 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5646760cc7f0 con 0x564676176cd0 2024-09-12T01:29:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fad7affd640 10 client.15873 handle_command_reply: tid=0 2024-09-12T01:29:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fada3da9740 1 client.15873 shutdown 2024-09-12T01:29:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fada3da9740 1 -- 172.21.15.81:0/2925464064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 msgr2=0x5646761643f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:47.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fada3da9740 1 --2- 172.21.15.81:0/2925464064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x5646761643f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0048f0 tx=0x7fad8c0056b0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fada3da9740 1 -- 172.21.15.81:0/2925464064 shutdown_connections 2024-09-12T01:29:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fada3da9740 1 --2- 172.21.15.81:0/2925464064 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x564676176cd0 0x5646761790c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fada3da9740 1 --2- 172.21.15.81:0/2925464064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 0x564676164930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fada3da9740 1 --2- 172.21.15.81:0/2925464064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x5646761643f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fada3da9740 1 --2- 172.21.15.81:0/2925464064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x564676163eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fada3da9740 1 -- 172.21.15.81:0/2925464064 >> 172.21.15.81:0/2925464064 conn(0x5646761560f0 msgr2=0x564676155270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fad7affd640 0 client.15873 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fada3da9740 1 -- 172.21.15.81:0/2925464064 shutdown_connections 2024-09-12T01:29:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fada3da9740 1 -- 172.21.15.81:0/2925464064 wait complete. 2024-09-12T01:29:47.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.677+0000 7fada3da9740 20 client.15873 trim_cache size 0 max 16384 2024-09-12T01:29:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.695+0000 7fada3da9740 1 Processor -- start 2024-09-12T01:29:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.695+0000 7fada3da9740 1 -- start start 2024-09-12T01:29:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.695+0000 7fada3da9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x564676165ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.695+0000 7fada3da9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x56467617e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.695+0000 7fada3da9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 0x56467617ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.695+0000 7fada3da9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c1ab560 con 0x56467615a360 2024-09-12T01:29:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.695+0000 7fada3da9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c1ad0a0 con 0x564676166f50 2024-09-12T01:29:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.695+0000 7fada3da9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c1abc30 con 0x564676159a40 2024-09-12T01:29:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.695+0000 7fad9affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x56467617e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.695+0000 7fad9affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x56467617e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58898/0 (socket says 172.21.15.81:58898) 2024-09-12T01:29:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.695+0000 7fad9affd640 1 -- 172.21.15.81:0/3396132525 learned_addr learned my addr 172.21.15.81:0/3396132525 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.695+0000 7fad927fc640 1 --2- 172.21.15.81:0/3396132525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x564676165ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.695+0000 7fad927fc640 1 --2- 172.21.15.81:0/3396132525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 0x56467617ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.696+0000 7fad9affd640 1 -- 172.21.15.81:0/3396132525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 msgr2=0x564676165ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.696+0000 7fad9affd640 1 --2- 172.21.15.81:0/3396132525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x564676165ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.696+0000 7fad9affd640 1 -- 172.21.15.81:0/3396132525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 msgr2=0x56467617ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.696+0000 7fad9affd640 1 --2- 172.21.15.81:0/3396132525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 0x56467617ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.696+0000 7fad9affd640 1 -- 172.21.15.81:0/3396132525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564676155b90 con 0x56467615a360 2024-09-12T01:29:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.696+0000 7fad9affd640 1 --2- 172.21.15.81:0/3396132525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x56467617e690 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00d960 tx=0x7fad8c005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c485191dea56b518 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.696+0000 7fad917fa640 1 -- 172.21.15.81:0/3396132525 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00dc90 con 0x56467615a360 2024-09-12T01:29:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.696+0000 7fad917fa640 1 -- 172.21.15.81:0/3396132525 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad8c00de30 con 0x56467615a360 2024-09-12T01:29:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.696+0000 7fad917fa640 1 -- 172.21.15.81:0/3396132525 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c011e50 con 0x56467615a360 2024-09-12T01:29:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.697+0000 7fada3da9740 1 -- 172.21.15.81:0/3396132525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 msgr2=0x56467617e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.697+0000 7fada3da9740 1 --2- 172.21.15.81:0/3396132525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x56467617e690 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00d960 tx=0x7fad8c005720 comp rx=0 tx=0).stop 2024-09-12T01:29:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.697+0000 7fada3da9740 1 -- 172.21.15.81:0/3396132525 shutdown_connections 2024-09-12T01:29:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.697+0000 7fada3da9740 1 --2- 172.21.15.81:0/3396132525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 0x56467617ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.697+0000 7fada3da9740 1 --2- 172.21.15.81:0/3396132525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x56467617e690 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.697+0000 7fada3da9740 1 --2- 172.21.15.81:0/3396132525 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x564676165ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.697+0000 7fada3da9740 1 -- 172.21.15.81:0/3396132525 >> 172.21.15.81:0/3396132525 conn(0x5646761560f0 msgr2=0x564676165590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.697+0000 7fada3da9740 1 -- 172.21.15.81:0/3396132525 shutdown_connections 2024-09-12T01:29:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.697+0000 7fada3da9740 1 -- 172.21.15.81:0/3396132525 wait complete. 2024-09-12T01:29:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.697+0000 7fada3da9740 1 -- start start 2024-09-12T01:29:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.697+0000 7fada3da9740 1 Processor -- start 2024-09-12T01:29:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fada3da9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x56467616f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fada3da9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x56467616a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fada3da9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 0x56467616ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fada3da9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c1ac9d0 con 0x56467615a360 2024-09-12T01:29:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fada3da9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c1ac300 con 0x564676166f50 2024-09-12T01:29:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fada3da9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c1a9540 con 0x564676159a40 2024-09-12T01:29:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fada3da9740 10 client.0 _ll_register_callbacks cb 0x7fad8c015050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fad9affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x56467616a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fad9affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x56467616a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58908/0 (socket says 172.21.15.81:58908) 2024-09-12T01:29:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fad9affd640 1 -- 172.21.15.81:0/983543642 learned_addr learned my addr 172.21.15.81:0/983543642 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fad927fc640 1 --2- 172.21.15.81:0/983543642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x56467616f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fad9affd640 1 -- 172.21.15.81:0/983543642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 msgr2=0x56467616f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fad9affd640 1 --2- 172.21.15.81:0/983543642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x56467616f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fad9affd640 1 -- 172.21.15.81:0/983543642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 msgr2=0x56467616ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fad9affd640 1 --2- 172.21.15.81:0/983543642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 0x56467616ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fad9affd640 1 -- 172.21.15.81:0/983543642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56467616b6a0 con 0x56467615a360 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fad9affd640 1 --2- 172.21.15.81:0/983543642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x56467616a930 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fad8c004be0 tx=0x7fad8c011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6739a793d76c9d43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.698+0000 7fad7affd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fad7affd640 1 -- 172.21.15.81:0/983543642 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c03d060 con 0x56467615a360 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fad7affd640 1 -- 172.21.15.81:0/983543642 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fad8c004280 con 0x56467615a360 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fada3da9740 1 -- 172.21.15.81:0/983543642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad8c00de30 con 0x56467615a360 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fad7affd640 1 -- 172.21.15.81:0/983543642 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fad8c00dc90 con 0x56467615a360 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fada3da9740 10 client.15879 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fada3da9740 1 -- 172.21.15.81:0/983543642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5646761e1610 con 0x56467615a360 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fad7affd640 1 -- 172.21.15.81:0/983543642 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad8c00de30 con 0x56467615a360 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fad7affd640 1 -- 172.21.15.81:0/983543642 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fad8c036020 con 0x56467615a360 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fada3da9740 10 client.15879 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fada3da9740 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:29:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fada3da9740 20 client.15879 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:47.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fada3da9740 1 --2- 172.21.15.81:0/983543642 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5646761e1b70 0x5646761e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:47.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fada3da9740 4 client.15879 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:29:47.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.699+0000 7fada3da9740 1 -- 172.21.15.81:0/983543642 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5646760c6d00 con 0x5646761e1b70 2024-09-12T01:29:47.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.700+0000 7fad927fc640 1 --2- 172.21.15.81:0/983543642 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5646761e1b70 0x5646761e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:47.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.700+0000 7fad927fc640 1 --2- 172.21.15.81:0/983543642 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5646761e1b70 0x5646761e3f90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3668efaa6cfa41e5 server_cookie=7f35e25cd86ad09d in_seq=0 out_seq=0 2024-09-12T01:29:47.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.700+0000 7fad7affd640 10 client.15879 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:47.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.701+0000 7fad7affd640 1 -- 172.21.15.81:0/983543642 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5646760c6d00 con 0x5646761e1b70 2024-09-12T01:29:47.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.701+0000 7fad7affd640 10 client.15879 handle_command_reply: tid=0 2024-09-12T01:29:47.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.701+0000 7fada3da9740 1 client.15879 shutdown 2024-09-12T01:29:47.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.701+0000 7fada3da9740 1 -- 172.21.15.81:0/983543642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 msgr2=0x56467616a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:47.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.701+0000 7fada3da9740 1 --2- 172.21.15.81:0/983543642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x56467616a930 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fad8c004be0 tx=0x7fad8c011d00 comp rx=0 tx=0).stop 2024-09-12T01:29:47.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.701+0000 7fada3da9740 1 -- 172.21.15.81:0/983543642 shutdown_connections 2024-09-12T01:29:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.701+0000 7fada3da9740 1 --2- 172.21.15.81:0/983543642 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5646761e1b70 0x5646761e3f90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.701+0000 7fada3da9740 1 --2- 172.21.15.81:0/983543642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564676166f50 0x56467616ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.701+0000 7fada3da9740 1 --2- 172.21.15.81:0/983543642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56467615a360 0x56467616a930 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.701+0000 7fada3da9740 1 --2- 172.21.15.81:0/983543642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564676159a40 0x56467616f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.701+0000 7fada3da9740 1 -- 172.21.15.81:0/983543642 >> 172.21.15.81:0/983543642 conn(0x5646761560f0 msgr2=0x564676155270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.701+0000 7fad7affd640 0 client.15879 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.702+0000 7fada3da9740 1 -- 172.21.15.81:0/983543642 shutdown_connections 2024-09-12T01:29:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.702+0000 7fada3da9740 1 -- 172.21.15.81:0/983543642 wait complete. 2024-09-12T01:29:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.702+0000 7fada3da9740 20 client.15879 trim_cache size 0 max 16384 2024-09-12T01:29:47.708 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:29:47.708 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:29:47.709 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "6aafae00-f5b4-474d-83a9-e202ecdb9133", 2024-09-12T01:29:47.709 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:29:47.709 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:29:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.702+0000 7fada19d0640 1 -- 172.21.15.81:0/1037293971 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fad880a2d70 msgr2=0x7fad880a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.702+0000 7fada19d0640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fad880a2d70 0x7fad880a5230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad9406f020 tx=0x7fad940cd040 comp rx=0 tx=0).stop 2024-09-12T01:29:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.702+0000 7fada19d0640 1 -- 172.21.15.81:0/1037293971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad9c106c10 msgr2=0x7fad9c19bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.702+0000 7fada19d0640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad9c106c10 0x7fad9c19bcc0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fad9400cce0 tx=0x7fad9400a620 comp rx=0 tx=0).stop 2024-09-12T01:29:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.702+0000 7fada19d0640 1 -- 172.21.15.81:0/1037293971 shutdown_connections 2024-09-12T01:29:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.702+0000 7fada19d0640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fad880a2d70 0x7fad880a5230 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.702+0000 7fada19d0640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad9c106c10 0x7fad9c19bcc0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.702+0000 7fada19d0640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad9c101b20 0x7fad9c197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.702+0000 7fada19d0640 1 --2- 172.21.15.81:0/1037293971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad9c101180 0x7fad9c1973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.702+0000 7fada19d0640 1 -- 172.21.15.81:0/1037293971 >> 172.21.15.81:0/1037293971 conn(0x7fad9c0fbee0 msgr2=0x7fad9c0fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.703+0000 7fada19d0640 1 -- 172.21.15.81:0/1037293971 shutdown_connections 2024-09-12T01:29:47.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:47.703+0000 7fada19d0640 1 -- 172.21.15.81:0/1037293971 wait complete. 2024-09-12T01:29:47.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:47 smithi081 ceph-mon[30920]: pgmap v54: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-12T01:29:48.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:47 smithi100 ceph-mon[35275]: pgmap v54: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-12T01:29:48.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:47 smithi189 ceph-mon[35357]: pgmap v54: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-09-12T01:29:48.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:29:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:29:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.237+0000 7f7f08b43640 1 -- 172.21.15.81:0/2408490367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f04101df0 msgr2=0x7f7f041021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.237+0000 7f7f08b43640 1 --2- 172.21.15.81:0/2408490367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f04101df0 0x7f7f041021d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009900 tx=0x7f7ef402a410 comp rx=0 tx=0).stop 2024-09-12T01:29:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.237+0000 7f7f08b43640 1 -- 172.21.15.81:0/2408490367 shutdown_connections 2024-09-12T01:29:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.237+0000 7f7f08b43640 1 --2- 172.21.15.81:0/2408490367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f04106f20 0x7f7f0410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.237+0000 7f7f08b43640 1 --2- 172.21.15.81:0/2408490367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f041027a0 0x7f7f041067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.237+0000 7f7f08b43640 1 --2- 172.21.15.81:0/2408490367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f04101df0 0x7f7f041021d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.237+0000 7f7f08b43640 1 -- 172.21.15.81:0/2408490367 >> 172.21.15.81:0/2408490367 conn(0x7f7f040fd8f0 msgr2=0x7f7f040ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.237+0000 7f7f08b43640 1 -- 172.21.15.81:0/2408490367 shutdown_connections 2024-09-12T01:29:49.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.237+0000 7f7f08b43640 1 -- 172.21.15.81:0/2408490367 wait complete. 2024-09-12T01:29:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.238+0000 7f7f08b43640 1 Processor -- start 2024-09-12T01:29:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.238+0000 7f7f08b43640 1 -- start start 2024-09-12T01:29:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f08b43640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f04101df0 0x7f7f04198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f08b43640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f041027a0 0x7f7f04198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f08b43640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f04106f20 0x7f7f0419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f08b43640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7f04111f80 con 0x7f7f04106f20 2024-09-12T01:29:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f08b43640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7f04111e00 con 0x7f7f041027a0 2024-09-12T01:29:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f08b43640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f04112100 con 0x7f7f04101df0 2024-09-12T01:29:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f02d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f04106f20 0x7f7f0419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f02d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f04106f20 0x7f7f0419ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58928/0 (socket says 172.21.15.81:58928) 2024-09-12T01:29:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f02d9d640 1 -- 172.21.15.81:0/3159875243 learned_addr learned my addr 172.21.15.81:0/3159875243 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f041027a0 0x7f7f04198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f0259c640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f04101df0 0x7f7f04198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f02d9d640 1 -- 172.21.15.81:0/3159875243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f04101df0 msgr2=0x7f7f04198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f02d9d640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f04101df0 0x7f7f04198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f02d9d640 1 -- 172.21.15.81:0/3159875243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f041027a0 msgr2=0x7f7f04198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f02d9d640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f041027a0 0x7f7f04198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f02d9d640 1 -- 172.21.15.81:0/3159875243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0419d3d0 con 0x7f7f04106f20 2024-09-12T01:29:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f041027a0 0x7f7f04198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.239+0000 7f7f02d9d640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f04106f20 0x7f7f0419ccf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00cad0 tx=0x7f7efc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.240+0000 7f7ef37fe640 1 -- 172.21.15.81:0/3159875243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00ae20 con 0x7f7f04106f20 2024-09-12T01:29:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.240+0000 7f7f08b43640 1 -- 172.21.15.81:0/3159875243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0419d6c0 con 0x7f7f04106f20 2024-09-12T01:29:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.240+0000 7f7ef37fe640 1 -- 172.21.15.81:0/3159875243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7efc005020 con 0x7f7f04106f20 2024-09-12T01:29:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.240+0000 7f7ef37fe640 1 -- 172.21.15.81:0/3159875243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00f6b0 con 0x7f7f04106f20 2024-09-12T01:29:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.240+0000 7f7f08b43640 1 -- 172.21.15.81:0/3159875243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f041a4fa0 con 0x7f7f04106f20 2024-09-12T01:29:49.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.242+0000 7f7ef37fe640 1 -- 172.21.15.81:0/3159875243 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7efc00f910 con 0x7f7f04106f20 2024-09-12T01:29:49.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.242+0000 7f7f0af1c740 1 Processor -- start 2024-09-12T01:29:49.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.242+0000 7f7f0af1c740 1 -- start start 2024-09-12T01:29:49.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f0af1c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9943224a0 0x55e994322880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f0af1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e994322dc0 0x55e99432d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f0af1c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e99432d680 0x55e99432fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f0af1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e9942882e0 con 0x55e994322dc0 2024-09-12T01:29:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f0af1c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e99422fce0 con 0x55e9943224a0 2024-09-12T01:29:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f0af1c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e9942842a0 con 0x55e99432d680 2024-09-12T01:29:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f0259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e994322dc0 0x55e99432d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f0259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e994322dc0 0x55e99432d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58944/0 (socket says 172.21.15.81:58944) 2024-09-12T01:29:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f0259c640 1 -- 172.21.15.81:0/3611985955 learned_addr learned my addr 172.21.15.81:0/3611985955 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7ef37fe640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7eec0a2cf0 0x7f7eec0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/3611985955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9943224a0 0x55e994322880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/3611985955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e99432d680 0x55e99432fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f02d9d640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7eec0a2cf0 0x7f7eec0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f01d9b640 1 -- 172.21.15.81:0/3611985955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e99432d680 msgr2=0x55e99432fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/3611985955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e99432d680 0x55e99432fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f01d9b640 1 -- 172.21.15.81:0/3611985955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e994322dc0 msgr2=0x55e99432d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:49.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/3611985955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e994322dc0 0x55e99432d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f01d9b640 1 -- 172.21.15.81:0/3611985955 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e994214440 con 0x55e9943224a0 2024-09-12T01:29:49.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7ef37fe640 1 -- 172.21.15.81:0/3159875243 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7efc0cf630 con 0x7f7f04106f20 2024-09-12T01:29:49.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.243+0000 7f7f0259c640 1 --2- 172.21.15.81:0/3611985955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e994322dc0 0x55e99432d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:49.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.244+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/3611985955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9943224a0 0x55e994322880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800bfd0 tx=0x7f7ef8005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54b3058c17979bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:49.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.244+0000 7f7f02d9d640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7eec0a2cf0 0x7f7eec0a51b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7efc09bbc0 tx=0x7f7efc013000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:49.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.244+0000 7f7ef0ff9640 1 -- 172.21.15.81:0/3611985955 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8005020 con 0x55e9943224a0 2024-09-12T01:29:49.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.244+0000 7f7ef0ff9640 1 -- 172.21.15.81:0/3611985955 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ef8010800 con 0x55e9943224a0 2024-09-12T01:29:49.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.244+0000 7f7ef0ff9640 1 -- 172.21.15.81:0/3611985955 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8004b00 con 0x55e9943224a0 2024-09-12T01:29:49.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 -- 172.21.15.81:0/3611985955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9943224a0 msgr2=0x55e994322880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:49.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/3611985955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9943224a0 0x55e994322880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800bfd0 tx=0x7f7ef8005c90 comp rx=0 tx=0).stop 2024-09-12T01:29:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 -- 172.21.15.81:0/3611985955 shutdown_connections 2024-09-12T01:29:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/3611985955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e99432d680 0x55e99432fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/3611985955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e994322dc0 0x55e99432d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/3611985955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e9943224a0 0x55e994322880 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 -- 172.21.15.81:0/3611985955 >> 172.21.15.81:0/3611985955 conn(0x55e99431ea30 msgr2=0x55e99431ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 -- 172.21.15.81:0/3611985955 shutdown_connections 2024-09-12T01:29:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 -- 172.21.15.81:0/3611985955 wait complete. 2024-09-12T01:29:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 -- start start 2024-09-12T01:29:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 Processor -- start 2024-09-12T01:29:49.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 0x55e99432d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e994322dc0 0x55e99432a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e99432d680 0x55e99432a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e994330250 con 0x55e9943224a0 2024-09-12T01:29:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e994243050 con 0x55e994322dc0 2024-09-12T01:29:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e9943303d0 con 0x55e99432d680 2024-09-12T01:29:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.245+0000 7f7f0af1c740 10 client.0 _ll_register_callbacks cb 0x55e994283160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f0259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e994322dc0 0x55e99432a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f01d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 0x55e99432d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f0259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e994322dc0 0x55e99432a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:53894/0 (socket says 172.21.15.81:53894) 2024-09-12T01:29:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f01d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 0x55e99432d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58954/0 (socket says 172.21.15.81:58954) 2024-09-12T01:29:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f0259c640 1 -- 172.21.15.81:0/1472823372 learned_addr learned my addr 172.21.15.81:0/1472823372 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/1472823372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e99432d680 0x55e99432a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f01d9b640 1 -- 172.21.15.81:0/1472823372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e99432d680 msgr2=0x55e99432a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/1472823372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e99432d680 0x55e99432a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f01d9b640 1 -- 172.21.15.81:0/1472823372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e994322dc0 msgr2=0x55e99432a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/1472823372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e994322dc0 0x55e99432a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f01d9b640 1 -- 172.21.15.81:0/1472823372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e993ff93c0 con 0x55e9943224a0 2024-09-12T01:29:49.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f0259c640 1 --2- 172.21.15.81:0/1472823372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e994322dc0 0x55e99432a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/1472823372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 0x55e99432d080 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800ba60 tx=0x7f7ef8005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da76f54a05eb35f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7ee9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7ee9ffb640 1 -- 172.21.15.81:0/1472823372 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef801f670 con 0x55e9943224a0 2024-09-12T01:29:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7ee9ffb640 1 -- 172.21.15.81:0/1472823372 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7ef801f810 con 0x55e9943224a0 2024-09-12T01:29:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.246+0000 7f7f0af1c740 1 -- 172.21.15.81:0/1472823372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ef8010800 con 0x55e9943224a0 2024-09-12T01:29:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.247+0000 7f7ee9ffb640 1 -- 172.21.15.81:0/1472823372 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ef801fa10 con 0x55e9943224a0 2024-09-12T01:29:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.247+0000 7f7f0af1c740 10 client.15891 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.247+0000 7f7f0af1c740 1 -- 172.21.15.81:0/1472823372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e99433bcb0 con 0x55e9943224a0 2024-09-12T01:29:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.247+0000 7f7ee9ffb640 1 -- 172.21.15.81:0/1472823372 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ef8010800 con 0x55e9943224a0 2024-09-12T01:29:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.247+0000 7f7ee9ffb640 1 -- 172.21.15.81:0/1472823372 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ef802ec40 con 0x55e9943224a0 2024-09-12T01:29:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.247+0000 7f7f0af1c740 10 client.15891 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.247+0000 7f7f0af1c740 10 client.15891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:29:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.247+0000 7f7f0af1c740 20 client.15891 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.247+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/1472823372 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e99433d000 0x55e99433f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.247+0000 7f7f0af1c740 4 client.15891 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:29:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.247+0000 7f7f0af1c740 1 -- 172.21.15.81:0/1472823372 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e994295850 con 0x55e99433d000 2024-09-12T01:29:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.247+0000 7f7f0259c640 1 --2- 172.21.15.81:0/1472823372 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e99433d000 0x55e99433f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.248+0000 7f7ee9ffb640 10 client.15891 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.248+0000 7f7f0259c640 1 --2- 172.21.15.81:0/1472823372 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e99433d000 0x55e99433f3f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41bdb7c915e44522 server_cookie=543cc24070f88526 in_seq=0 out_seq=0 2024-09-12T01:29:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7ee9ffb640 1 -- 172.21.15.81:0/1472823372 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e994295850 con 0x55e99433d000 2024-09-12T01:29:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7ee9ffb640 10 client.15891 handle_command_reply: tid=0 2024-09-12T01:29:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7f0af1c740 1 client.15891 shutdown 2024-09-12T01:29:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7f0af1c740 1 -- 172.21.15.81:0/1472823372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 msgr2=0x55e99432d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/1472823372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 0x55e99432d080 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800ba60 tx=0x7f7ef8005740 comp rx=0 tx=0).stop 2024-09-12T01:29:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7f0af1c740 1 -- 172.21.15.81:0/1472823372 shutdown_connections 2024-09-12T01:29:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/1472823372 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e99433d000 0x55e99433f3f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/1472823372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e99432d680 0x55e99432a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/1472823372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e994322dc0 0x55e99432a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/1472823372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 0x55e99432d080 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7ee9ffb640 0 client.15891 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:49.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7f0af1c740 1 -- 172.21.15.81:0/1472823372 >> 172.21.15.81:0/1472823372 conn(0x55e99431ea30 msgr2=0x55e99431db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:49.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7f0af1c740 1 -- 172.21.15.81:0/1472823372 shutdown_connections 2024-09-12T01:29:49.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7f0af1c740 1 -- 172.21.15.81:0/1472823372 wait complete. 2024-09-12T01:29:49.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.249+0000 7f7f0af1c740 20 client.15891 trim_cache size 0 max 16384 2024-09-12T01:29:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.266+0000 7f7f0af1c740 1 Processor -- start 2024-09-12T01:29:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.266+0000 7f7f0af1c740 1 -- start start 2024-09-12T01:29:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f0af1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 0x55e99431e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f0af1c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e994322dc0 0x55e9943394b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f0af1c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e99432d680 0x55e994328c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f0af1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7f041ad880 con 0x55e9943224a0 2024-09-12T01:29:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f0af1c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7f041af3c0 con 0x55e99432d680 2024-09-12T01:29:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f0af1c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f041adf50 con 0x55e994322dc0 2024-09-12T01:29:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f01d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 0x55e99431e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f01d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 0x55e99431e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58962/0 (socket says 172.21.15.81:58962) 2024-09-12T01:29:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f01d9b640 1 -- 172.21.15.81:0/4204688736 learned_addr learned my addr 172.21.15.81:0/4204688736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f0259c640 1 --2- 172.21.15.81:0/4204688736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e994322dc0 0x55e9943394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/4204688736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e99432d680 0x55e994328c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f0259c640 1 -- 172.21.15.81:0/4204688736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e99432d680 msgr2=0x55e994328c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f0259c640 1 --2- 172.21.15.81:0/4204688736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e99432d680 0x55e994328c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f0259c640 1 -- 172.21.15.81:0/4204688736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 msgr2=0x55e99431e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f0259c640 1 --2- 172.21.15.81:0/4204688736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 0x55e99431e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f0259c640 1 -- 172.21.15.81:0/4204688736 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9943292e0 con 0x55e994322dc0 2024-09-12T01:29:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/4204688736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 0x55e99431e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:29:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.267+0000 7f7f0259c640 1 --2- 172.21.15.81:0/4204688736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e994322dc0 0x55e9943394b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55e994329bc0 tx=0x7f7ef4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c98b3bec01ec7571 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.268+0000 7f7eebfff640 1 -- 172.21.15.81:0/4204688736 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef404d020 con 0x55e994322dc0 2024-09-12T01:29:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.268+0000 7f7eebfff640 1 -- 172.21.15.81:0/4204688736 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ef4005520 con 0x55e994322dc0 2024-09-12T01:29:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.268+0000 7f7eebfff640 1 -- 172.21.15.81:0/4204688736 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4035040 con 0x55e994322dc0 2024-09-12T01:29:49.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.268+0000 7f7f0af1c740 1 -- 172.21.15.81:0/4204688736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e994322dc0 msgr2=0x55e9943394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:49.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.268+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/4204688736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e994322dc0 0x55e9943394b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55e994329bc0 tx=0x7f7ef4009260 comp rx=0 tx=0).stop 2024-09-12T01:29:49.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.268+0000 7f7f0af1c740 1 -- 172.21.15.81:0/4204688736 shutdown_connections 2024-09-12T01:29:49.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.268+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/4204688736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e99432d680 0x55e994328c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.268+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/4204688736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e994322dc0 0x55e9943394b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.268+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/4204688736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9943224a0 0x55e99431e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.268+0000 7f7f0af1c740 1 -- 172.21.15.81:0/4204688736 >> 172.21.15.81:0/4204688736 conn(0x55e99431ea30 msgr2=0x55e994325900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:49.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f0af1c740 1 -- 172.21.15.81:0/4204688736 shutdown_connections 2024-09-12T01:29:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f0af1c740 1 -- 172.21.15.81:0/4204688736 wait complete. 2024-09-12T01:29:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f0af1c740 1 -- start start 2024-09-12T01:29:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f0af1c740 1 Processor -- start 2024-09-12T01:29:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f0af1c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9943224a0 0x55e994335d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f0af1c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e994322dc0 0x55e994327050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f0af1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e99432d680 0x55e994327590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f0af1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7f041aecf0 con 0x55e99432d680 2024-09-12T01:29:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f0af1c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7f041ae620 con 0x55e994322dc0 2024-09-12T01:29:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f0af1c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f041ab860 con 0x55e9943224a0 2024-09-12T01:29:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f0af1c740 10 client.0 _ll_register_callbacks cb 0x7f7ef4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:29:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f01d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e99432d680 0x55e994327590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f01d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e99432d680 0x55e994327590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58970/0 (socket says 172.21.15.81:58970) 2024-09-12T01:29:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f01d9b640 1 -- 172.21.15.81:0/156091401 learned_addr learned my addr 172.21.15.81:0/156091401 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:29:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.269+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/156091401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9943224a0 0x55e994335d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7f0259c640 1 --2- 172.21.15.81:0/156091401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e994322dc0 0x55e994327050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7f01d9b640 1 -- 172.21.15.81:0/156091401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9943224a0 msgr2=0x55e994335d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/156091401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9943224a0 0x55e994335d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7f01d9b640 1 -- 172.21.15.81:0/156091401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e994322dc0 msgr2=0x55e994327050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:29:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/156091401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e994322dc0 0x55e994327050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7f01d9b640 1 -- 172.21.15.81:0/156091401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e99432d3f0 con 0x55e99432d680 2024-09-12T01:29:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7f01d9b640 1 --2- 172.21.15.81:0/156091401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e99432d680 0x55e994327590 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8000c00 tx=0x7f7ef8022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbbab17cccd7d82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:29:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7ee9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:29:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7ee9ffb640 1 -- 172.21.15.81:0/156091401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef801f470 con 0x55e99432d680 2024-09-12T01:29:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7ee9ffb640 1 -- 172.21.15.81:0/156091401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7ef801f610 con 0x55e99432d680 2024-09-12T01:29:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7f0af1c740 1 -- 172.21.15.81:0/156091401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ef4005520 con 0x55e99432d680 2024-09-12T01:29:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7ee9ffb640 1 -- 172.21.15.81:0/156091401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ef801f810 con 0x55e99432d680 2024-09-12T01:29:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7f0af1c740 10 client.15897 fetch_fsmap learned FSMap version 28 2024-09-12T01:29:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7f0af1c740 1 -- 172.21.15.81:0/156091401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e9943a78b0 con 0x55e99432d680 2024-09-12T01:29:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.270+0000 7f7ee9ffb640 1 -- 172.21.15.81:0/156091401 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ef4005520 con 0x55e99432d680 2024-09-12T01:29:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.271+0000 7f7ee9ffb640 1 -- 172.21.15.81:0/156091401 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ef8005030 con 0x55e99432d680 2024-09-12T01:29:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.271+0000 7f7f0af1c740 10 client.15897 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:29:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.271+0000 7f7f0af1c740 10 client.15897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:29:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.271+0000 7f7f0af1c740 20 client.15897 populate_metadata read hostname 'smithi081' 2024-09-12T01:29:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.271+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/156091401 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e9943a7ef0 0x55e9943aa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:29:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.271+0000 7f7f0af1c740 4 client.15897 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:29:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.271+0000 7f7f0af1c740 1 -- 172.21.15.81:0/156091401 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e99428fd60 con 0x55e9943a7ef0 2024-09-12T01:29:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.271+0000 7f7f0259c640 1 --2- 172.21.15.81:0/156091401 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e9943a7ef0 0x55e9943aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:29:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.271+0000 7f7ee9ffb640 10 client.15897 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.271+0000 7f7f0259c640 1 --2- 172.21.15.81:0/156091401 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e9943a7ef0 0x55e9943aa310 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35994e66716fd768 server_cookie=c7354aa8da9f2b08 in_seq=0 out_seq=0 2024-09-12T01:29:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7ee9ffb640 1 -- 172.21.15.81:0/156091401 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e99428fd60 con 0x55e9943a7ef0 2024-09-12T01:29:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7ee9ffb640 10 client.15897 handle_command_reply: tid=0 2024-09-12T01:29:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7f0af1c740 1 client.15897 shutdown 2024-09-12T01:29:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7f0af1c740 1 -- 172.21.15.81:0/156091401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e99432d680 msgr2=0x55e994327590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/156091401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e99432d680 0x55e994327590 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8000c00 tx=0x7f7ef8022040 comp rx=0 tx=0).stop 2024-09-12T01:29:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7f0af1c740 1 -- 172.21.15.81:0/156091401 shutdown_connections 2024-09-12T01:29:49.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/156091401 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e9943a7ef0 0x55e9943aa310 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/156091401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e99432d680 0x55e994327590 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/156091401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e994322dc0 0x55e994327050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7f0af1c740 1 --2- 172.21.15.81:0/156091401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9943224a0 0x55e994335d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7f0af1c740 1 -- 172.21.15.81:0/156091401 >> 172.21.15.81:0/156091401 conn(0x55e99431ea30 msgr2=0x55e9943258e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:49.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7ee9ffb640 0 client.15897 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:29:49.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7f0af1c740 1 -- 172.21.15.81:0/156091401 shutdown_connections 2024-09-12T01:29:49.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7f0af1c740 1 -- 172.21.15.81:0/156091401 wait complete. 2024-09-12T01:29:49.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.272+0000 7f7f0af1c740 20 client.15897 trim_cache size 0 max 16384 2024-09-12T01:29:49.279 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:29:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:29:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-12T01:29:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "6aafae00-f5b4-474d-83a9-e202ecdb9133": { 2024-09-12T01:29:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-09-12T01:29:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "6aafae00-f5b4-474d-83a9-e202ecdb9133", 2024-09-12T01:29:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-12T01:29:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:29:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:29:49.280 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:29:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.273+0000 7f7f08b43640 1 -- 172.21.15.81:0/3159875243 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7eec0a2cf0 msgr2=0x7f7eec0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.273+0000 7f7f08b43640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7eec0a2cf0 0x7f7eec0a51b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7efc09bbc0 tx=0x7f7efc013000 comp rx=0 tx=0).stop 2024-09-12T01:29:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.273+0000 7f7f08b43640 1 -- 172.21.15.81:0/3159875243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f04106f20 msgr2=0x7f7f0419ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:29:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.273+0000 7f7f08b43640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f04106f20 0x7f7f0419ccf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00cad0 tx=0x7f7efc00cf90 comp rx=0 tx=0).stop 2024-09-12T01:29:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.273+0000 7f7f08b43640 1 -- 172.21.15.81:0/3159875243 shutdown_connections 2024-09-12T01:29:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.273+0000 7f7f08b43640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7eec0a2cf0 0x7f7eec0a51b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.273+0000 7f7f08b43640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f04106f20 0x7f7f0419ccf0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.273+0000 7f7f08b43640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f041027a0 0x7f7f04198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.273+0000 7f7f08b43640 1 --2- 172.21.15.81:0/3159875243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f04101df0 0x7f7f04198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:29:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.273+0000 7f7f08b43640 1 -- 172.21.15.81:0/3159875243 >> 172.21.15.81:0/3159875243 conn(0x7f7f040fd8f0 msgr2=0x7f7f040fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:29:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.273+0000 7f7f08b43640 1 -- 172.21.15.81:0/3159875243 shutdown_connections 2024-09-12T01:29:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:29:49.273+0000 7f7f08b43640 1 -- 172.21.15.81:0/3159875243 wait complete. 2024-09-12T01:29:49.866 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:49 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:29:49.867 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:49 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:29:49.867 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:49 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:29:49.867 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:49 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:29:49.867 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:49 smithi081 ceph-mon[30920]: pgmap v55: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 775 KiB/s wr, 11 op/s 2024-09-12T01:29:49.954 INFO:tasks.cephfs.filesystem:scrub status for tag:6aafae00-f5b4-474d-83a9-e202ecdb9133 - {'path': '/', 'tag': '6aafae00-f5b4-474d-83a9-e202ecdb9133', 'options': 'recursive,force'} 2024-09-12T01:29:50.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:49 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:29:50.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:49 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:29:50.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:49 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:29:50.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:49 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:29:50.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:49 smithi100 ceph-mon[35275]: pgmap v55: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 775 KiB/s wr, 11 op/s 2024-09-12T01:29:50.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:49 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:29:50.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:49 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:29:50.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:49 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:29:50.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:49 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:29:50.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:49 smithi189 ceph-mon[35357]: pgmap v55: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 775 KiB/s wr, 11 op/s 2024-09-12T01:29:50.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:50 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:29:51.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:50 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:29:51.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:50 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:29:51.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:51 smithi081 ceph-mon[30920]: pgmap v56: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-09-12T01:29:52.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:51 smithi100 ceph-mon[35275]: pgmap v56: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-09-12T01:29:52.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:51 smithi189 ceph-mon[35357]: pgmap v56: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-09-12T01:29:53.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:53 smithi081 ceph-mon[30920]: pgmap v57: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 861 KiB/s wr, 12 op/s 2024-09-12T01:29:54.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:53 smithi100 ceph-mon[35275]: pgmap v57: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 861 KiB/s wr, 12 op/s 2024-09-12T01:29:54.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:53 smithi189 ceph-mon[35357]: pgmap v57: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 861 KiB/s wr, 12 op/s 2024-09-12T01:29:55.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:55 smithi081 ceph-mon[30920]: pgmap v58: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 862 KiB/s wr, 11 op/s 2024-09-12T01:29:56.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:55 smithi100 ceph-mon[35275]: pgmap v58: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 862 KiB/s wr, 11 op/s 2024-09-12T01:29:56.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:55 smithi189 ceph-mon[35357]: pgmap v58: 97 pgs: 97 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 862 KiB/s wr, 11 op/s 2024-09-12T01:29:57.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:57 smithi081 ceph-mon[30920]: pgmap v59: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-09-12T01:29:58.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:57 smithi100 ceph-mon[35275]: pgmap v59: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-09-12T01:29:58.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:57 smithi189 ceph-mon[35357]: pgmap v59: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2024-09-12T01:29:59.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:29:59 smithi081 ceph-mon[30920]: pgmap v60: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 862 KiB/s wr, 11 op/s 2024-09-12T01:30:00.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:29:59 smithi100 ceph-mon[35275]: pgmap v60: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 862 KiB/s wr, 11 op/s 2024-09-12T01:30:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:29:59 smithi189 ceph-mon[35357]: pgmap v60: 97 pgs: 97 active+clean; 2.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 862 KiB/s wr, 11 op/s 2024-09-12T01:30:00.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:00 smithi081 ceph-mon[30920]: overall HEALTH_OK 2024-09-12T01:30:01.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:00 smithi100 ceph-mon[35275]: overall HEALTH_OK 2024-09-12T01:30:01.031 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:00 smithi189 ceph-mon[35357]: overall HEALTH_OK 2024-09-12T01:30:01.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:01 smithi081 ceph-mon[30920]: pgmap v61: 97 pgs: 97 active+clean; 183 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 21 op/s 2024-09-12T01:30:02.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:01 smithi100 ceph-mon[35275]: pgmap v61: 97 pgs: 97 active+clean; 183 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 21 op/s 2024-09-12T01:30:02.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:01 smithi189 ceph-mon[35357]: pgmap v61: 97 pgs: 97 active+clean; 183 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 21 op/s 2024-09-12T01:30:03.374 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.4 2024-09-12T01:30:03.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:30:03.652 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:03.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:03 smithi081 ceph-mon[30920]: pgmap v62: 97 pgs: 97 active+clean; 183 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 15 op/s 2024-09-12T01:30:04.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:03 smithi100 ceph-mon[35275]: pgmap v62: 97 pgs: 97 active+clean; 183 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 15 op/s 2024-09-12T01:30:04.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:03 smithi189 ceph-mon[35357]: pgmap v62: 97 pgs: 97 active+clean; 183 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 15 op/s 2024-09-12T01:30:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.171+0000 7efe618d6640 1 -- 172.21.15.81:0/1208598921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe5c100e20 msgr2=0x7efe5c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.171+0000 7efe618d6640 1 --2- 172.21.15.81:0/1208598921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe5c100e20 0x7efe5c101200 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efe4c009900 tx=0x7efe4c02a480 comp rx=0 tx=0).stop 2024-09-12T01:30:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.171+0000 7efe618d6640 1 -- 172.21.15.81:0/1208598921 shutdown_connections 2024-09-12T01:30:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.171+0000 7efe618d6640 1 --2- 172.21.15.81:0/1208598921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe5c102ef0 0x7efe5c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.171+0000 7efe618d6640 1 --2- 172.21.15.81:0/1208598921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe5c102570 0x7efe5c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.171+0000 7efe618d6640 1 --2- 172.21.15.81:0/1208598921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe5c100e20 0x7efe5c101200 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.171+0000 7efe618d6640 1 -- 172.21.15.81:0/1208598921 >> 172.21.15.81:0/1208598921 conn(0x7efe5c0fc7d0 msgr2=0x7efe5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.171+0000 7efe618d6640 1 -- 172.21.15.81:0/1208598921 shutdown_connections 2024-09-12T01:30:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.171+0000 7efe618d6640 1 -- 172.21.15.81:0/1208598921 wait complete. 2024-09-12T01:30:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.171+0000 7efe618d6640 1 Processor -- start 2024-09-12T01:30:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe618d6640 1 -- start start 2024-09-12T01:30:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe618d6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe5c100e20 0x7efe5c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe618d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe5c102570 0x7efe5c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe618d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe5c102ef0 0x7efe5c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe618d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efe5c110f50 con 0x7efe5c102570 2024-09-12T01:30:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe618d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efe5c110dd0 con 0x7efe5c102ef0 2024-09-12T01:30:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe618d6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efe5c1110d0 con 0x7efe5c100e20 2024-09-12T01:30:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe5a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe5c102570 0x7efe5c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe5a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe5c102570 0x7efe5c198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56342/0 (socket says 172.21.15.81:56342) 2024-09-12T01:30:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe5a7fc640 1 -- 172.21.15.81:0/2901613746 learned_addr learned my addr 172.21.15.81:0/2901613746 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe5affd640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe5c100e20 0x7efe5c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe5b7fe640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe5c102ef0 0x7efe5c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe5a7fc640 1 -- 172.21.15.81:0/2901613746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe5c100e20 msgr2=0x7efe5c198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe5a7fc640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe5c100e20 0x7efe5c198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe5a7fc640 1 -- 172.21.15.81:0/2901613746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe5c102ef0 msgr2=0x7efe5c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe5a7fc640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe5c102ef0 0x7efe5c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe5a7fc640 1 -- 172.21.15.81:0/2901613746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5c19d4d0 con 0x7efe5c102570 2024-09-12T01:30:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe5b7fe640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe5c102ef0 0x7efe5c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.172+0000 7efe5a7fc640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe5c102570 0x7efe5c198a60 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efe5000e9f0 tx=0x7efe5000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.173+0000 7efe608d4640 1 -- 172.21.15.81:0/2901613746 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5000cd80 con 0x7efe5c102570 2024-09-12T01:30:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.173+0000 7efe608d4640 1 -- 172.21.15.81:0/2901613746 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe50010910 con 0x7efe5c102570 2024-09-12T01:30:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.173+0000 7efe618d6640 1 -- 172.21.15.81:0/2901613746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5c19d7c0 con 0x7efe5c102570 2024-09-12T01:30:04.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.173+0000 7efe608d4640 1 -- 172.21.15.81:0/2901613746 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50018990 con 0x7efe5c102570 2024-09-12T01:30:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.173+0000 7efe618d6640 1 -- 172.21.15.81:0/2901613746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe5c1a50a0 con 0x7efe5c102570 2024-09-12T01:30:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.174+0000 7efe618d6640 1 -- 172.21.15.81:0/2901613746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe5c101200 con 0x7efe5c102570 2024-09-12T01:30:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.175+0000 7efe608d4640 1 -- 172.21.15.81:0/2901613746 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7efe50010ac0 con 0x7efe5c102570 2024-09-12T01:30:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.176+0000 7efe608d4640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efe440a2cf0 0x7efe440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.176+0000 7efe608d4640 1 -- 172.21.15.81:0/2901613746 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7efe500cfc20 con 0x7efe5c102570 2024-09-12T01:30:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.176+0000 7efe5affd640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efe440a2cf0 0x7efe440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.176+0000 7efe5affd640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efe440a2cf0 0x7efe440a51b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe4c006010 tx=0x7efe4c005a40 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:04.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.179+0000 7efe608d4640 1 -- 172.21.15.81:0/2901613746 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe5009c870 con 0x7efe5c102570 2024-09-12T01:30:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.417+0000 7efe618d6640 1 -- 172.21.15.81:0/2901613746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe5c199880 con 0x7efe5c102570 2024-09-12T01:30:04.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.418+0000 7efe608d4640 1 -- 172.21.15.81:0/2901613746 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7efe5c199880 con 0x7efe5c102570 2024-09-12T01:30:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:30:04.418 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:30:04.418 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:30:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.421+0000 7efe618d6640 1 -- 172.21.15.81:0/2901613746 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efe440a2cf0 msgr2=0x7efe440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.421+0000 7efe618d6640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efe440a2cf0 0x7efe440a51b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe4c006010 tx=0x7efe4c005a40 comp rx=0 tx=0).stop 2024-09-12T01:30:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.421+0000 7efe618d6640 1 -- 172.21.15.81:0/2901613746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe5c102570 msgr2=0x7efe5c198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.421+0000 7efe618d6640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe5c102570 0x7efe5c198a60 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efe5000e9f0 tx=0x7efe5000eeb0 comp rx=0 tx=0).stop 2024-09-12T01:30:04.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.421+0000 7efe618d6640 1 -- 172.21.15.81:0/2901613746 shutdown_connections 2024-09-12T01:30:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.421+0000 7efe618d6640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efe440a2cf0 0x7efe440a51b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.421+0000 7efe618d6640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe5c102ef0 0x7efe5c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.421+0000 7efe618d6640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe5c102570 0x7efe5c198a60 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.421+0000 7efe618d6640 1 --2- 172.21.15.81:0/2901613746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efe5c100e20 0x7efe5c198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.421+0000 7efe618d6640 1 -- 172.21.15.81:0/2901613746 >> 172.21.15.81:0/2901613746 conn(0x7efe5c0fc7d0 msgr2=0x7efe5c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.421+0000 7efe618d6640 1 -- 172.21.15.81:0/2901613746 shutdown_connections 2024-09-12T01:30:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:04.421+0000 7efe618d6640 1 -- 172.21.15.81:0/2901613746 wait complete. 2024-09-12T01:30:04.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:04 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2901613746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:30:05.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:04 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2901613746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:30:05.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:04 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2901613746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:30:05.127 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0' 2024-09-12T01:30:05.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0 2024-09-12T01:30:05.398 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:05.782 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:05 smithi081 ceph-mon[30920]: pgmap v63: 97 pgs: 97 active+clean; 183 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 15 op/s 2024-09-12T01:30:05.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.882+0000 7f7af7f68640 1 -- 172.21.15.81:0/1893235977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af01027a0 msgr2=0x7f7af01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:05.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.882+0000 7f7af7f68640 1 --2- 172.21.15.81:0/1893235977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af01027a0 0x7f7af01067f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009900 tx=0x7f7ae002a410 comp rx=0 tx=0).stop 2024-09-12T01:30:05.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.882+0000 7f7af7f68640 1 -- 172.21.15.81:0/1893235977 shutdown_connections 2024-09-12T01:30:05.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.882+0000 7f7af7f68640 1 --2- 172.21.15.81:0/1893235977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7af0106f20 0x7f7af010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.882+0000 7f7af7f68640 1 --2- 172.21.15.81:0/1893235977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af01027a0 0x7f7af01067f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.882+0000 7f7af7f68640 1 --2- 172.21.15.81:0/1893235977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7af0101df0 0x7f7af01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.882+0000 7f7af7f68640 1 -- 172.21.15.81:0/1893235977 >> 172.21.15.81:0/1893235977 conn(0x7f7af00fd8f0 msgr2=0x7f7af00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:05.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.882+0000 7f7af7f68640 1 -- 172.21.15.81:0/1893235977 shutdown_connections 2024-09-12T01:30:05.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.882+0000 7f7af7f68640 1 -- 172.21.15.81:0/1893235977 wait complete. 2024-09-12T01:30:05.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af7f68640 1 Processor -- start 2024-09-12T01:30:05.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af7f68640 1 -- start start 2024-09-12T01:30:05.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af7f68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af0101df0 0x7f7af019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af7f68640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7af01027a0 0x7f7af019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af7f68640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7af0106f20 0x7f7af019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af7f68640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7af0111f80 con 0x7f7af0101df0 2024-09-12T01:30:05.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af7f68640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7af0111e00 con 0x7f7af01027a0 2024-09-12T01:30:05.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af7f68640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7af0112100 con 0x7f7af0106f20 2024-09-12T01:30:05.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af5d04640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af0101df0 0x7f7af019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af5d04640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af0101df0 0x7f7af019a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56362/0 (socket says 172.21.15.81:56362) 2024-09-12T01:30:05.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af5d04640 1 -- 172.21.15.81:0/3370356032 learned_addr learned my addr 172.21.15.81:0/3370356032 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:05.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af6505640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7af0106f20 0x7f7af019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af5503640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7af01027a0 0x7f7af019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af5d04640 1 -- 172.21.15.81:0/3370356032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7af0106f20 msgr2=0x7f7af019efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:05.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af5d04640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7af0106f20 0x7f7af019efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af5d04640 1 -- 172.21.15.81:0/3370356032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7af01027a0 msgr2=0x7f7af019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af5d04640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7af01027a0 0x7f7af019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.883+0000 7f7af5d04640 1 -- 172.21.15.81:0/3370356032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af019f690 con 0x7f7af0101df0 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.884+0000 7f7af5d04640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af0101df0 0x7f7af019a6e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00e9f0 tx=0x7f7aec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.884+0000 7f7ae6ffd640 1 -- 172.21.15.81:0/3370356032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec00cd80 con 0x7f7af0101df0 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.884+0000 7f7af7f68640 1 -- 172.21.15.81:0/3370356032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af019f980 con 0x7f7af0101df0 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.884+0000 7f7ae6ffd640 1 -- 172.21.15.81:0/3370356032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7aec010910 con 0x7f7af0101df0 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.884+0000 7f7ae6ffd640 1 -- 172.21.15.81:0/3370356032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec018990 con 0x7f7af0101df0 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.884+0000 7f7af7f68640 1 -- 172.21.15.81:0/3370356032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af01a7260 con 0x7f7af0101df0 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.886+0000 7f7ae6ffd640 1 -- 172.21.15.81:0/3370356032 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7aec010ac0 con 0x7f7af0101df0 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.887+0000 7f7afa341740 1 Processor -- start 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.887+0000 7f7afa341740 1 -- start start 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.887+0000 7f7afa341740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aae760 0x5630d8aaeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.887+0000 7f7afa341740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8aaf080 0x5630d8ab9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.887+0000 7f7afa341740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8ab9940 0x5630d8abbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.887+0000 7f7afa341740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5630d8a142a0 con 0x5630d8aae760 2024-09-12T01:30:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.887+0000 7f7afa341740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5630d89bbb10 con 0x5630d8aaf080 2024-09-12T01:30:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.887+0000 7f7afa341740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5630d8a10260 con 0x5630d8ab9940 2024-09-12T01:30:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.887+0000 7f7af5d04640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8aaf080 0x5630d8ab9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.887+0000 7f7af5d04640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8aaf080 0x5630d8ab9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:38720/0 (socket says 172.21.15.81:38720) 2024-09-12T01:30:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.887+0000 7f7af5d04640 1 -- 172.21.15.81:0/2070171966 learned_addr learned my addr 172.21.15.81:0/2070171966 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.887+0000 7f7af5503640 1 --2- 172.21.15.81:0/2070171966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8ab9940 0x5630d8abbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.887+0000 7f7af6505640 1 --2- 172.21.15.81:0/2070171966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aae760 0x5630d8aaeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.888+0000 7f7ae6ffd640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7adc0a2d70 0x7f7adc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.888+0000 7f7af5d04640 1 -- 172.21.15.81:0/2070171966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8ab9940 msgr2=0x5630d8abbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.888+0000 7f7af5d04640 1 --2- 172.21.15.81:0/2070171966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8ab9940 0x5630d8abbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.888+0000 7f7af5d04640 1 -- 172.21.15.81:0/2070171966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aae760 msgr2=0x5630d8aaeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.888+0000 7f7af5d04640 1 --2- 172.21.15.81:0/2070171966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aae760 0x5630d8aaeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.888+0000 7f7af5d04640 1 -- 172.21.15.81:0/2070171966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d8785b90 con 0x5630d8aaf080 2024-09-12T01:30:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.888+0000 7f7af6505640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7adc0a2d70 0x7f7adc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.888+0000 7f7ae6ffd640 1 -- 172.21.15.81:0/3370356032 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7aec0cf690 con 0x7f7af0101df0 2024-09-12T01:30:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.888+0000 7f7af5d04640 1 --2- 172.21.15.81:0/2070171966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8aaf080 0x5630d8ab9400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0ccd80 tx=0x7f7aec091120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67c8386ef4c2cfc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.888+0000 7f7adbfff640 1 -- 172.21.15.81:0/2070171966 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec09b7d0 con 0x5630d8aaf080 2024-09-12T01:30:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.888+0000 7f7adbfff640 1 -- 172.21.15.81:0/2070171966 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7aec026050 con 0x5630d8aaf080 2024-09-12T01:30:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.888+0000 7f7adbfff640 1 -- 172.21.15.81:0/2070171966 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec06f510 con 0x5630d8aaf080 2024-09-12T01:30:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.889+0000 7f7afa341740 1 -- 172.21.15.81:0/2070171966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8aaf080 msgr2=0x5630d8ab9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.889+0000 7f7af6505640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7adc0a2d70 0x7f7adc0a5230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8005c40 tx=0x7f7ae8004ab0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.889+0000 7f7afa341740 1 --2- 172.21.15.81:0/2070171966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8aaf080 0x5630d8ab9400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0ccd80 tx=0x7f7aec091120 comp rx=0 tx=0).stop 2024-09-12T01:30:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.889+0000 7f7afa341740 1 -- 172.21.15.81:0/2070171966 shutdown_connections 2024-09-12T01:30:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.889+0000 7f7afa341740 1 --2- 172.21.15.81:0/2070171966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8ab9940 0x5630d8abbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.889+0000 7f7afa341740 1 --2- 172.21.15.81:0/2070171966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8aaf080 0x5630d8ab9400 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.889+0000 7f7afa341740 1 --2- 172.21.15.81:0/2070171966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aae760 0x5630d8aaeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.889+0000 7f7afa341740 1 -- 172.21.15.81:0/2070171966 >> 172.21.15.81:0/2070171966 conn(0x5630d8aaacf0 msgr2=0x5630d8aab0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.889+0000 7f7afa341740 1 -- 172.21.15.81:0/2070171966 shutdown_connections 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.889+0000 7f7afa341740 1 -- 172.21.15.81:0/2070171966 wait complete. 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.890+0000 7f7afa341740 1 -- start start 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.890+0000 7f7afa341740 1 Processor -- start 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.890+0000 7f7afa341740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aae760 0x5630d8ab67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.890+0000 7f7afa341740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 0x5630d8ab6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.890+0000 7f7afa341740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8ab7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.890+0000 7f7afa341740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5630d8abc510 con 0x5630d8aaf080 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.890+0000 7f7afa341740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5630d899c6e0 con 0x5630d8ab9940 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.890+0000 7f7afa341740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5630d8abc690 con 0x5630d8aae760 2024-09-12T01:30:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.890+0000 7f7afa341740 10 client.0 _ll_register_callbacks cb 0x5630d89c0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.890+0000 7f7af5503640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 0x5630d8ab6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7af5d04640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aae760 0x5630d8ab67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7af5503640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 0x5630d8ab6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56378/0 (socket says 172.21.15.81:56378) 2024-09-12T01:30:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7af5503640 1 -- 172.21.15.81:0/3844169387 learned_addr learned my addr 172.21.15.81:0/3844169387 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7af6505640 1 --2- 172.21.15.81:0/3844169387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8ab7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7af5503640 1 -- 172.21.15.81:0/3844169387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aae760 msgr2=0x5630d8ab67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7af5503640 1 --2- 172.21.15.81:0/3844169387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aae760 0x5630d8ab67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7af5503640 1 -- 172.21.15.81:0/3844169387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 msgr2=0x5630d8ab7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7af5503640 1 --2- 172.21.15.81:0/3844169387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8ab7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7af5503640 1 -- 172.21.15.81:0/3844169387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630d8ac59d0 con 0x5630d8aaf080 2024-09-12T01:30:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7af6505640 1 --2- 172.21.15.81:0/3844169387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8ab7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7af5503640 1 --2- 172.21.15.81:0/3844169387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 0x5630d8ab6d30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009900 tx=0x7f7ae0031850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfdfbdf874e5e556 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7ad97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7ad97fa640 1 -- 172.21.15.81:0/3844169387 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0035040 con 0x5630d8aaf080 2024-09-12T01:30:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.891+0000 7f7afa341740 1 -- 172.21.15.81:0/3844169387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7aec026050 con 0x5630d8aaf080 2024-09-12T01:30:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.892+0000 7f7ad97fa640 1 -- 172.21.15.81:0/3844169387 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7ae0004460 con 0x5630d8aaf080 2024-09-12T01:30:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.892+0000 7f7ad97fa640 1 -- 172.21.15.81:0/3844169387 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ae00035f0 con 0x5630d8aaf080 2024-09-12T01:30:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.892+0000 7f7afa341740 10 client.15915 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.892+0000 7f7afa341740 1 -- 172.21.15.81:0/3844169387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5630d8ac83b0 con 0x5630d8aaf080 2024-09-12T01:30:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.892+0000 7f7ad97fa640 1 -- 172.21.15.81:0/3844169387 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7aec026050 con 0x5630d8aaf080 2024-09-12T01:30:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.892+0000 7f7ad97fa640 1 -- 172.21.15.81:0/3844169387 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ae003d8e0 con 0x5630d8aaf080 2024-09-12T01:30:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.892+0000 7f7afa341740 10 client.15915 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.892+0000 7f7afa341740 10 client.15915 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T01:30:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.892+0000 7f7afa341740 20 client.15915 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.892+0000 7f7afa341740 1 --2- 172.21.15.81:0/3844169387 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5630d8ac9910 0x5630d8acbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.892+0000 7f7afa341740 4 client.15915 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.892+0000 7f7afa341740 1 -- 172.21.15.81:0/3844169387 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630d8a219d0 con 0x5630d8ac9910 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.893+0000 7f7af5d04640 1 --2- 172.21.15.81:0/3844169387 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5630d8ac9910 0x5630d8acbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.893+0000 7f7af5d04640 1 --2- 172.21.15.81:0/3844169387 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5630d8ac9910 0x5630d8acbd30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e79fb851af80bbc8 server_cookie=8cc922429eae4aad in_seq=0 out_seq=0 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.893+0000 7f7ad97fa640 10 client.15915 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7ad97fa640 1 -- 172.21.15.81:0/3844169387 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630d8a219d0 con 0x5630d8ac9910 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7ad97fa640 10 client.15915 handle_command_reply: tid=0 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7afa341740 1 client.15915 shutdown 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7afa341740 1 -- 172.21.15.81:0/3844169387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 msgr2=0x5630d8ab6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7afa341740 1 --2- 172.21.15.81:0/3844169387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 0x5630d8ab6d30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009900 tx=0x7f7ae0031850 comp rx=0 tx=0).stop 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7afa341740 1 -- 172.21.15.81:0/3844169387 shutdown_connections 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7afa341740 1 --2- 172.21.15.81:0/3844169387 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5630d8ac9910 0x5630d8acbd30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7afa341740 1 --2- 172.21.15.81:0/3844169387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8ab7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7ad97fa640 0 client.15915 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7afa341740 1 --2- 172.21.15.81:0/3844169387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 0x5630d8ab6d30 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7afa341740 1 --2- 172.21.15.81:0/3844169387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aae760 0x5630d8ab67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7afa341740 1 -- 172.21.15.81:0/3844169387 >> 172.21.15.81:0/3844169387 conn(0x5630d8aaacf0 msgr2=0x5630d8ab09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7afa341740 1 -- 172.21.15.81:0/3844169387 shutdown_connections 2024-09-12T01:30:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.894+0000 7f7afa341740 1 -- 172.21.15.81:0/3844169387 wait complete. 2024-09-12T01:30:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.895+0000 7f7afa341740 20 client.15915 trim_cache size 0 max 16384 2024-09-12T01:30:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.914+0000 7f7afa341740 1 Processor -- start 2024-09-12T01:30:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.914+0000 7f7afa341740 1 -- start start 2024-09-12T01:30:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.914+0000 7f7afa341740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aae760 0x5630d8aa9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.914+0000 7f7afa341740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 0x5630d8ab70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.914+0000 7f7afa341740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8ad1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.914+0000 7f7afa341740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7af01af970 con 0x5630d8aaf080 2024-09-12T01:30:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.914+0000 7f7afa341740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7af01b14b0 con 0x5630d8ab9940 2024-09-12T01:30:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.914+0000 7f7afa341740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7af01b0040 con 0x5630d8aae760 2024-09-12T01:30:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.914+0000 7f7af5503640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 0x5630d8ab70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.914+0000 7f7af5503640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 0x5630d8ab70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56390/0 (socket says 172.21.15.81:56390) 2024-09-12T01:30:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.914+0000 7f7af5503640 1 -- 172.21.15.81:0/2510740195 learned_addr learned my addr 172.21.15.81:0/2510740195 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.914+0000 7f7af5d04640 1 --2- 172.21.15.81:0/2510740195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aae760 0x5630d8aa9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.914+0000 7f7af6505640 1 --2- 172.21.15.81:0/2510740195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8ad1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.915+0000 7f7af5503640 1 -- 172.21.15.81:0/2510740195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aae760 msgr2=0x5630d8aa9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.915+0000 7f7af5503640 1 --2- 172.21.15.81:0/2510740195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aae760 0x5630d8aa9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.915+0000 7f7af5503640 1 -- 172.21.15.81:0/2510740195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 msgr2=0x5630d8ad1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.915+0000 7f7af5503640 1 --2- 172.21.15.81:0/2510740195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8ad1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.915+0000 7f7af5503640 1 -- 172.21.15.81:0/2510740195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d8aaab20 con 0x5630d8aaf080 2024-09-12T01:30:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.915+0000 7f7af6505640 1 --2- 172.21.15.81:0/2510740195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8ad1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.915+0000 7f7af5503640 1 --2- 172.21.15.81:0/2510740195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 0x5630d8ab70c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0031bf0 tx=0x7f7ae0031b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5cc89ebd7b6bbf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.915+0000 7f7adb7fe640 1 -- 172.21.15.81:0/2510740195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0035070 con 0x5630d8aaf080 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.915+0000 7f7adb7fe640 1 -- 172.21.15.81:0/2510740195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ae0041070 con 0x5630d8aaf080 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.915+0000 7f7adb7fe640 1 -- 172.21.15.81:0/2510740195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0005410 con 0x5630d8aaf080 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.916+0000 7f7afa341740 1 -- 172.21.15.81:0/2510740195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 msgr2=0x5630d8ab70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.916+0000 7f7afa341740 1 --2- 172.21.15.81:0/2510740195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 0x5630d8ab70c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0031bf0 tx=0x7f7ae0031b00 comp rx=0 tx=0).stop 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.916+0000 7f7afa341740 1 -- 172.21.15.81:0/2510740195 shutdown_connections 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.916+0000 7f7afa341740 1 --2- 172.21.15.81:0/2510740195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8ad1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.916+0000 7f7afa341740 1 --2- 172.21.15.81:0/2510740195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aaf080 0x5630d8ab70c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.916+0000 7f7afa341740 1 --2- 172.21.15.81:0/2510740195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aae760 0x5630d8aa9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.916+0000 7f7afa341740 1 -- 172.21.15.81:0/2510740195 >> 172.21.15.81:0/2510740195 conn(0x5630d8aaacf0 msgr2=0x5630d8aa9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.916+0000 7f7afa341740 1 -- 172.21.15.81:0/2510740195 shutdown_connections 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.916+0000 7f7afa341740 1 -- 172.21.15.81:0/2510740195 wait complete. 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.916+0000 7f7afa341740 1 -- start start 2024-09-12T01:30:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.916+0000 7f7afa341740 1 Processor -- start 2024-09-12T01:30:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7afa341740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aae760 0x5630d8ac1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7afa341740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aaf080 0x5630d8abe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7afa341740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8abedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7afa341740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7af01b0de0 con 0x5630d8aae760 2024-09-12T01:30:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7afa341740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7af01b0710 con 0x5630d8ab9940 2024-09-12T01:30:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7afa341740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7af01ad950 con 0x5630d8aaf080 2024-09-12T01:30:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7afa341740 10 client.0 _ll_register_callbacks cb 0x7f7ae0005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7af5d04640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aae760 0x5630d8ac1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7af5d04640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aae760 0x5630d8ac1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56392/0 (socket says 172.21.15.81:56392) 2024-09-12T01:30:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7af5503640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aaf080 0x5630d8abe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7af5d04640 1 -- 172.21.15.81:0/758572013 learned_addr learned my addr 172.21.15.81:0/758572013 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7af6505640 1 --2- 172.21.15.81:0/758572013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8abedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7af5d04640 1 -- 172.21.15.81:0/758572013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aaf080 msgr2=0x5630d8abe8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7af5d04640 1 --2- 172.21.15.81:0/758572013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aaf080 0x5630d8abe8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7af5d04640 1 -- 172.21.15.81:0/758572013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 msgr2=0x5630d8abedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7af5d04640 1 --2- 172.21.15.81:0/758572013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8abedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7af5d04640 1 -- 172.21.15.81:0/758572013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630d8ab2410 con 0x5630d8aae760 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7af5d04640 1 --2- 172.21.15.81:0/758572013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aae760 0x5630d8ac1f40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00c6a0 tx=0x7f7aec000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39196580807d688 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.917+0000 7f7ad97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7ad97fa640 1 -- 172.21.15.81:0/758572013 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec09b5f0 con 0x5630d8aae760 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7ad97fa640 1 -- 172.21.15.81:0/758572013 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7aec097b20 con 0x5630d8aae760 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7afa341740 1 -- 172.21.15.81:0/758572013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ae0041070 con 0x5630d8aae760 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7ad97fa640 1 -- 172.21.15.81:0/758572013 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7aec09b7d0 con 0x5630d8aae760 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7afa341740 10 client.15921 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7afa341740 1 -- 172.21.15.81:0/758572013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5630d8aab980 con 0x5630d8aae760 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7ad97fa640 1 -- 172.21.15.81:0/758572013 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ae0041070 con 0x5630d8aae760 2024-09-12T01:30:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7ad97fa640 1 -- 172.21.15.81:0/758572013 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7aec0cd090 con 0x5630d8aae760 2024-09-12T01:30:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7afa341740 10 client.15921 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7afa341740 10 client.15921 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T01:30:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7afa341740 20 client.15921 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7afa341740 1 --2- 172.21.15.81:0/758572013 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5630d8b35480 0x5630d8b37870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7afa341740 4 client.15921 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}] 2024-09-12T01:30:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7afa341740 1 -- 172.21.15.81:0/758572013 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}) -- 0x5630d8a1bd20 con 0x5630d8b35480 2024-09-12T01:30:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.918+0000 7f7af5503640 1 --2- 172.21.15.81:0/758572013 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5630d8b35480 0x5630d8b37870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.919+0000 7f7ad97fa640 10 client.15921 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.919+0000 7f7af5503640 1 --2- 172.21.15.81:0/758572013 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5630d8b35480 0x5630d8b37870 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5320dc48d83a63f8 server_cookie=b80afa91d167ee2d in_seq=0 out_seq=0 2024-09-12T01:30:05.934 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:05 smithi100 ceph-mon[35275]: pgmap v63: 97 pgs: 97 active+clean; 183 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 15 op/s 2024-09-12T01:30:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.932+0000 7f7ad97fa640 1 -- 172.21.15.81:0/758572013 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5630d8a1bd20 con 0x5630d8b35480 2024-09-12T01:30:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.932+0000 7f7ad97fa640 10 client.15921 handle_command_reply: tid=0 2024-09-12T01:30:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.932+0000 7f7afa341740 1 client.15921 shutdown 2024-09-12T01:30:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.932+0000 7f7afa341740 1 -- 172.21.15.81:0/758572013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aae760 msgr2=0x5630d8ac1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.932+0000 7f7afa341740 1 --2- 172.21.15.81:0/758572013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aae760 0x5630d8ac1f40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00c6a0 tx=0x7f7aec000bc0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.932+0000 7f7afa341740 1 -- 172.21.15.81:0/758572013 shutdown_connections 2024-09-12T01:30:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.932+0000 7f7afa341740 1 --2- 172.21.15.81:0/758572013 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5630d8b35480 0x5630d8b37870 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.932+0000 7f7afa341740 1 --2- 172.21.15.81:0/758572013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5630d8ab9940 0x5630d8abedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.932+0000 7f7afa341740 1 --2- 172.21.15.81:0/758572013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5630d8aaf080 0x5630d8abe8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.932+0000 7f7ad97fa640 0 client.15921 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.932+0000 7f7afa341740 1 --2- 172.21.15.81:0/758572013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630d8aae760 0x5630d8ac1f40 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.932+0000 7f7afa341740 1 -- 172.21.15.81:0/758572013 >> 172.21.15.81:0/758572013 conn(0x5630d8aaacf0 msgr2=0x5630d8ab09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.932+0000 7f7afa341740 1 -- 172.21.15.81:0/758572013 shutdown_connections 2024-09-12T01:30:05.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7afa341740 1 -- 172.21.15.81:0/758572013 wait complete. 2024-09-12T01:30:05.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7afa341740 20 client.15921 trim_cache size 0 max 16384 2024-09-12T01:30:05.936 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:30:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 28, 2024-09-12T01:30:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24473, 2024-09-12T01:30:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 6, 2024-09-12T01:30:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-12T01:30:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "59bd9bc6": { 2024-09-12T01:30:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 6, 2024-09-12T01:30:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 133.4, 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:30:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:30:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:30:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:30:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:30:05.938 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:30:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7af7f68640 1 -- 172.21.15.81:0/3370356032 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7adc0a2d70 msgr2=0x7f7adc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7af7f68640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7adc0a2d70 0x7f7adc0a5230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8005c40 tx=0x7f7ae8004ab0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7af7f68640 1 -- 172.21.15.81:0/3370356032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af0101df0 msgr2=0x7f7af019a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7af7f68640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af0101df0 0x7f7af019a6e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00e9f0 tx=0x7f7aec00eeb0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7af7f68640 1 -- 172.21.15.81:0/3370356032 shutdown_connections 2024-09-12T01:30:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7af7f68640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7adc0a2d70 0x7f7adc0a5230 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7af7f68640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7af0106f20 0x7f7af019efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7af7f68640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7af01027a0 0x7f7af019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7af7f68640 1 --2- 172.21.15.81:0/3370356032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7af0101df0 0x7f7af019a6e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7af7f68640 1 -- 172.21.15.81:0/3370356032 >> 172.21.15.81:0/3370356032 conn(0x7f7af00fd8f0 msgr2=0x7f7af00febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7af7f68640 1 -- 172.21.15.81:0/3370356032 shutdown_connections 2024-09-12T01:30:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:05.933+0000 7f7af7f68640 1 -- 172.21.15.81:0/3370356032 wait complete. 2024-09-12T01:30:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:05 smithi189 ceph-mon[35357]: pgmap v63: 97 pgs: 97 active+clean; 183 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 15 op/s 2024-09-12T01:30:06.645 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '59bd9bc6', quiesce took 3.3 seconds. Will release after: 10.100000000000001 2024-09-12T01:30:07.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:07 smithi100 ceph-mon[35275]: pgmap v64: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 MiB/s wr, 315 op/s 2024-09-12T01:30:07.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:07 smithi081 ceph-mon[30920]: pgmap v64: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 MiB/s wr, 315 op/s 2024-09-12T01:30:08.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:07 smithi189 ceph-mon[35357]: pgmap v64: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 MiB/s wr, 315 op/s 2024-09-12T01:30:09.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:09 smithi081 ceph-mon[30920]: pgmap v65: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 MiB/s wr, 310 op/s 2024-09-12T01:30:10.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:09 smithi100 ceph-mon[35275]: pgmap v65: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 MiB/s wr, 310 op/s 2024-09-12T01:30:10.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:09 smithi189 ceph-mon[35357]: pgmap v65: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 32 MiB/s wr, 310 op/s 2024-09-12T01:30:11.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:11 smithi081 ceph-mon[30920]: pgmap v66: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 32 MiB/s wr, 390 op/s 2024-09-12T01:30:12.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:11 smithi100 ceph-mon[35275]: pgmap v66: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 32 MiB/s wr, 390 op/s 2024-09-12T01:30:12.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:11 smithi189 ceph-mon[35357]: pgmap v66: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 32 MiB/s wr, 390 op/s 2024-09-12T01:30:12.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:12 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:30:13.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:12 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:30:13.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:12 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:30:13.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:13 smithi081 ceph-mon[30920]: pgmap v67: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 380 op/s 2024-09-12T01:30:13.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:13 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:13.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:13 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:13.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:13 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:13.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:13 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:13.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:13 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:13.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:13 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:13.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:13 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:30:13.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:13 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:30:13.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:13 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:13 smithi100 ceph-mon[35275]: pgmap v67: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 380 op/s 2024-09-12T01:30:14.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:13 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:13 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:13 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:13 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:13 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:13 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:13 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:30:14.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:13 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:30:14.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:13 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:13 smithi189 ceph-mon[35357]: pgmap v67: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 380 op/s 2024-09-12T01:30:14.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:13 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:13 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:13 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:13 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:13 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:13 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:14.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:13 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:30:14.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:13 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:30:14.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:13 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:30:15.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:15 smithi081 ceph-mon[30920]: pgmap v68: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 380 op/s 2024-09-12T01:30:16.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:15 smithi100 ceph-mon[35275]: pgmap v68: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 380 op/s 2024-09-12T01:30:16.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:15 smithi189 ceph-mon[35357]: pgmap v68: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 380 op/s 2024-09-12T01:30:16.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:30:17.004 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.481+0000 7f74efbd2640 1 -- 172.21.15.81:0/2165179912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e8102570 msgr2=0x7f74e81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.481+0000 7f74efbd2640 1 --2- 172.21.15.81:0/2165179912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e8102570 0x7f74e81029b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009900 tx=0x7f74d802a480 comp rx=0 tx=0).stop 2024-09-12T01:30:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.481+0000 7f74efbd2640 1 -- 172.21.15.81:0/2165179912 shutdown_connections 2024-09-12T01:30:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.481+0000 7f74efbd2640 1 --2- 172.21.15.81:0/2165179912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e8102ef0 0x7f74e810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.481+0000 7f74efbd2640 1 --2- 172.21.15.81:0/2165179912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e8102570 0x7f74e81029b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.481+0000 7f74efbd2640 1 --2- 172.21.15.81:0/2165179912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74e8100e20 0x7f74e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.481+0000 7f74efbd2640 1 -- 172.21.15.81:0/2165179912 >> 172.21.15.81:0/2165179912 conn(0x7f74e80fc7d0 msgr2=0x7f74e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.481+0000 7f74efbd2640 1 -- 172.21.15.81:0/2165179912 shutdown_connections 2024-09-12T01:30:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.481+0000 7f74efbd2640 1 -- 172.21.15.81:0/2165179912 wait complete. 2024-09-12T01:30:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.481+0000 7f74efbd2640 1 Processor -- start 2024-09-12T01:30:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.481+0000 7f74efbd2640 1 -- start start 2024-09-12T01:30:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74efbd2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74e8100e20 0x7f74e8199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74efbd2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e8102570 0x7f74e8199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74efbd2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e8102ef0 0x7f74e81a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74efbd2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8110fa0 con 0x7f74e8102ef0 2024-09-12T01:30:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74efbd2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8110e20 con 0x7f74e8102570 2024-09-12T01:30:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74efbd2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8111120 con 0x7f74e8100e20 2024-09-12T01:30:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74ee16f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e8102ef0 0x7f74e81a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74ee16f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e8102ef0 0x7f74e81a44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42518/0 (socket says 172.21.15.81:42518) 2024-09-12T01:30:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74ee16f640 1 -- 172.21.15.81:0/3710285743 learned_addr learned my addr 172.21.15.81:0/3710285743 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74ed96e640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74e8100e20 0x7f74e8199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74ed16d640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e8102570 0x7f74e8199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74ee16f640 1 -- 172.21.15.81:0/3710285743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74e8100e20 msgr2=0x7f74e8199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74ee16f640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74e8100e20 0x7f74e8199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74ee16f640 1 -- 172.21.15.81:0/3710285743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e8102570 msgr2=0x7f74e8199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74ee16f640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e8102570 0x7f74e8199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74ee16f640 1 -- 172.21.15.81:0/3710285743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e81a49f0 con 0x7f74e8102ef0 2024-09-12T01:30:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74ed16d640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e8102570 0x7f74e8199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74ee16f640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e8102ef0 0x7f74e81a44b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f74e000eaa0 tx=0x7f74e000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74deffd640 1 -- 172.21.15.81:0/3710285743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e000cdb0 con 0x7f74e8102ef0 2024-09-12T01:30:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74deffd640 1 -- 172.21.15.81:0/3710285743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74e0005020 con 0x7f74e8102ef0 2024-09-12T01:30:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74deffd640 1 -- 172.21.15.81:0/3710285743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e00116b0 con 0x7f74e8102ef0 2024-09-12T01:30:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74efbd2640 1 -- 172.21.15.81:0/3710285743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e81a4bc0 con 0x7f74e8102ef0 2024-09-12T01:30:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.482+0000 7f74efbd2640 1 -- 172.21.15.81:0/3710285743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e81a50d0 con 0x7f74e8102ef0 2024-09-12T01:30:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.484+0000 7f74efbd2640 1 -- 172.21.15.81:0/3710285743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e8101200 con 0x7f74e8102ef0 2024-09-12T01:30:17.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.484+0000 7f74deffd640 1 -- 172.21.15.81:0/3710285743 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f74e0005560 con 0x7f74e8102ef0 2024-09-12T01:30:17.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.485+0000 7f74deffd640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f74d40a2d70 0x7f74d40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:17.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.485+0000 7f74ed96e640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f74d40a2d70 0x7f74d40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:17.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.485+0000 7f74deffd640 1 -- 172.21.15.81:0/3710285743 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f74e00cf6c0 con 0x7f74e8102ef0 2024-09-12T01:30:17.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.486+0000 7f74ed96e640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f74d40a2d70 0x7f74d40a5230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009890 tx=0x7f74e4008040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:17.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.489+0000 7f74deffd640 1 -- 172.21.15.81:0/3710285743 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f74e0016030 con 0x7f74e8102ef0 2024-09-12T01:30:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.692+0000 7f74efbd2640 1 -- 172.21.15.81:0/3710285743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74e8109090 con 0x7f74e8102ef0 2024-09-12T01:30:17.692 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:17 smithi081 ceph-mon[30920]: pgmap v69: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 17 MiB/s wr, 384 op/s 2024-09-12T01:30:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.692+0000 7f74deffd640 1 -- 172.21.15.81:0/3710285743 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f74e009c310 con 0x7f74e8102ef0 2024-09-12T01:30:17.693 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:30:17.693 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:30:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:30:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.695+0000 7f74efbd2640 1 -- 172.21.15.81:0/3710285743 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f74d40a2d70 msgr2=0x7f74d40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.695+0000 7f74efbd2640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f74d40a2d70 0x7f74d40a5230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009890 tx=0x7f74e4008040 comp rx=0 tx=0).stop 2024-09-12T01:30:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.695+0000 7f74efbd2640 1 -- 172.21.15.81:0/3710285743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e8102ef0 msgr2=0x7f74e81a44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.695+0000 7f74efbd2640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e8102ef0 0x7f74e81a44b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f74e000eaa0 tx=0x7f74e000ef60 comp rx=0 tx=0).stop 2024-09-12T01:30:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.695+0000 7f74efbd2640 1 -- 172.21.15.81:0/3710285743 shutdown_connections 2024-09-12T01:30:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.695+0000 7f74efbd2640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f74d40a2d70 0x7f74d40a5230 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.695+0000 7f74efbd2640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e8102ef0 0x7f74e81a44b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.695+0000 7f74efbd2640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e8102570 0x7f74e8199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.695+0000 7f74efbd2640 1 --2- 172.21.15.81:0/3710285743 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74e8100e20 0x7f74e8199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.695+0000 7f74efbd2640 1 -- 172.21.15.81:0/3710285743 >> 172.21.15.81:0/3710285743 conn(0x7f74e80fc7d0 msgr2=0x7f74e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.695+0000 7f74efbd2640 1 -- 172.21.15.81:0/3710285743 shutdown_connections 2024-09-12T01:30:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:17.695+0000 7f74efbd2640 1 -- 172.21.15.81:0/3710285743 wait complete. 2024-09-12T01:30:18.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:17 smithi100 ceph-mon[35275]: pgmap v69: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 17 MiB/s wr, 384 op/s 2024-09-12T01:30:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:17 smithi189 ceph-mon[35357]: pgmap v69: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 17 MiB/s wr, 384 op/s 2024-09-12T01:30:18.472 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 59bd9bc6 --release --await' 2024-09-12T01:30:18.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 59bd9bc6 --release --await 2024-09-12T01:30:18.721 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:18.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:18 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3710285743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:30:19.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:18 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3710285743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:30:19.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:18 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3710285743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:30:19.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.154+0000 7fefedb40640 1 -- 172.21.15.81:0/1236739825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8106f10 msgr2=0x7fefe810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:19.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.154+0000 7fefedb40640 1 --2- 172.21.15.81:0/1236739825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8106f10 0x7fefe810ea90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009ca0 tx=0x7fefe002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.154+0000 7fefedb40640 1 -- 172.21.15.81:0/1236739825 shutdown_connections 2024-09-12T01:30:19.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.154+0000 7fefedb40640 1 --2- 172.21.15.81:0/1236739825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8106f10 0x7fefe810ea90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.154+0000 7fefedb40640 1 --2- 172.21.15.81:0/1236739825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefe8102790 0x7fefe81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.154+0000 7fefedb40640 1 --2- 172.21.15.81:0/1236739825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefe8101de0 0x7fefe81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.154+0000 7fefedb40640 1 -- 172.21.15.81:0/1236739825 >> 172.21.15.81:0/1236739825 conn(0x7fefe80fd8c0 msgr2=0x7fefe80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.154+0000 7fefedb40640 1 -- 172.21.15.81:0/1236739825 shutdown_connections 2024-09-12T01:30:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.154+0000 7fefedb40640 1 -- 172.21.15.81:0/1236739825 wait complete. 2024-09-12T01:30:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.154+0000 7fefedb40640 1 Processor -- start 2024-09-12T01:30:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefedb40640 1 -- start start 2024-09-12T01:30:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefedb40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8101de0 0x7fefe80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefedb40640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefe8102790 0x7fefe8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefedb40640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefe8106f10 0x7fefe8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefedb40640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fefe8112010 con 0x7fefe8101de0 2024-09-12T01:30:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefedb40640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fefe8111e90 con 0x7fefe8102790 2024-09-12T01:30:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefedb40640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fefe8112190 con 0x7fefe8106f10 2024-09-12T01:30:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefe77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8101de0 0x7fefe80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefe77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8101de0 0x7fefe80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42530/0 (socket says 172.21.15.81:42530) 2024-09-12T01:30:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefe77fe640 1 -- 172.21.15.81:0/922007868 learned_addr learned my addr 172.21.15.81:0/922007868 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefe6ffd640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefe8102790 0x7fefe8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefe7fff640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefe8106f10 0x7fefe8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefe77fe640 1 -- 172.21.15.81:0/922007868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefe8106f10 msgr2=0x7fefe8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefe77fe640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefe8106f10 0x7fefe8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefe77fe640 1 -- 172.21.15.81:0/922007868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefe8102790 msgr2=0x7fefe8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefe77fe640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefe8102790 0x7fefe8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.155+0000 7fefe77fe640 1 -- 172.21.15.81:0/922007868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe81a6a30 con 0x7fefe8101de0 2024-09-12T01:30:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.156+0000 7fefe77fe640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8101de0 0x7fefe80744f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fefd800b4a0 tx=0x7fefd800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.156+0000 7fefe4ff9640 1 -- 172.21.15.81:0/922007868 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8015020 con 0x7fefe8101de0 2024-09-12T01:30:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.156+0000 7fefedb40640 1 -- 172.21.15.81:0/922007868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe81a6d20 con 0x7fefe8101de0 2024-09-12T01:30:19.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.156+0000 7fefe4ff9640 1 -- 172.21.15.81:0/922007868 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd8011d10 con 0x7fefe8101de0 2024-09-12T01:30:19.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.156+0000 7fefe4ff9640 1 -- 172.21.15.81:0/922007868 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd800f2e0 con 0x7fefe8101de0 2024-09-12T01:30:19.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.156+0000 7fefedb40640 1 -- 172.21.15.81:0/922007868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe81a7200 con 0x7fefe8101de0 2024-09-12T01:30:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.158+0000 7fefe4ff9640 1 -- 172.21.15.81:0/922007868 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fefd8018020 con 0x7fefe8101de0 2024-09-12T01:30:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.158+0000 7fefeff19740 1 Processor -- start 2024-09-12T01:30:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefeff19740 1 -- start start 2024-09-12T01:30:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefeff19740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d584554060 0x55d584554440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefeff19740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d58455ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefeff19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d58455f240 0x55d584561630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefeff19740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d5844b9620 con 0x55d584554980 2024-09-12T01:30:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefeff19740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d584460e50 con 0x55d584554060 2024-09-12T01:30:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefeff19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d5844b55e0 con 0x55d58455f240 2024-09-12T01:30:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefe77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d58455ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefe77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d58455ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42532/0 (socket says 172.21.15.81:42532) 2024-09-12T01:30:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefe77fe640 1 -- 172.21.15.81:0/527553738 learned_addr learned my addr 172.21.15.81:0/527553738 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefe7fff640 1 --2- 172.21.15.81:0/527553738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d584554060 0x55d584554440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefe4ff9640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fefd00a2cf0 0x7fefd00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefe6ffd640 1 --2- 172.21.15.81:0/527553738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d58455f240 0x55d584561630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefe7fff640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fefd00a2cf0 0x7fefd00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefe4ff9640 1 -- 172.21.15.81:0/922007868 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fefd80cec60 con 0x7fefe8101de0 2024-09-12T01:30:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefe77fe640 1 -- 172.21.15.81:0/527553738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d58455f240 msgr2=0x55d584561630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefe77fe640 1 --2- 172.21.15.81:0/527553738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d58455f240 0x55d584561630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefe77fe640 1 -- 172.21.15.81:0/527553738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d584554060 msgr2=0x55d584554440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.159+0000 7fefe77fe640 1 --2- 172.21.15.81:0/527553738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d584554060 0x55d584554440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.160+0000 7fefe77fe640 1 -- 172.21.15.81:0/527553738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d584451d40 con 0x55d584554980 2024-09-12T01:30:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.160+0000 7fefe7fff640 1 --2- 172.21.15.81:0/527553738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d584554060 0x55d584554440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:30:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.160+0000 7fefe77fe640 1 --2- 172.21.15.81:0/527553738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d58455ed00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fefd809af60 tx=0x7fefd8010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22c1bccf2fc6226 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.160+0000 7fefcdffb640 1 -- 172.21.15.81:0/527553738 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd809abc0 con 0x55d584554980 2024-09-12T01:30:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.160+0000 7fefe7fff640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fefd00a2cf0 0x7fefd00a51b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009430 tx=0x7fefe002a8c0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.160+0000 7fefcdffb640 1 -- 172.21.15.81:0/527553738 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd809b960 con 0x55d584554980 2024-09-12T01:30:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.160+0000 7fefcdffb640 1 -- 172.21.15.81:0/527553738 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd80092b0 con 0x55d584554980 2024-09-12T01:30:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 -- 172.21.15.81:0/527553738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 msgr2=0x55d58455ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 --2- 172.21.15.81:0/527553738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d58455ed00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fefd809af60 tx=0x7fefd8010910 comp rx=0 tx=0).stop 2024-09-12T01:30:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 -- 172.21.15.81:0/527553738 shutdown_connections 2024-09-12T01:30:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 --2- 172.21.15.81:0/527553738 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d58455f240 0x55d584561630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 --2- 172.21.15.81:0/527553738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d58455ed00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 --2- 172.21.15.81:0/527553738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d584554060 0x55d584554440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 -- 172.21.15.81:0/527553738 >> 172.21.15.81:0/527553738 conn(0x55d5845505f0 msgr2=0x55d5845509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 -- 172.21.15.81:0/527553738 shutdown_connections 2024-09-12T01:30:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 -- 172.21.15.81:0/527553738 wait complete. 2024-09-12T01:30:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 -- start start 2024-09-12T01:30:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 Processor -- start 2024-09-12T01:30:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d584554060 0x55d58455c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d58455c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d58455f240 0x55d58455cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d584561db0 con 0x55d584554980 2024-09-12T01:30:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d584441f10 con 0x55d58455f240 2024-09-12T01:30:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.161+0000 7fefeff19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d584561f30 con 0x55d584554060 2024-09-12T01:30:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefeff19740 10 client.0 _ll_register_callbacks cb 0x55d584465db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d58455c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d58455c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42534/0 (socket says 172.21.15.81:42534) 2024-09-12T01:30:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefe6ffd640 1 -- 172.21.15.81:0/1332794771 learned_addr learned my addr 172.21.15.81:0/1332794771 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefe77fe640 1 --2- 172.21.15.81:0/1332794771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d584554060 0x55d58455c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefe7fff640 1 --2- 172.21.15.81:0/1332794771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d58455f240 0x55d58455cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefe6ffd640 1 -- 172.21.15.81:0/1332794771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d584554060 msgr2=0x55d58455c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefe6ffd640 1 --2- 172.21.15.81:0/1332794771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d584554060 0x55d58455c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefe6ffd640 1 -- 172.21.15.81:0/1332794771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d58455f240 msgr2=0x55d58455cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefe6ffd640 1 --2- 172.21.15.81:0/1332794771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d58455f240 0x55d58455cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefe6ffd640 1 -- 172.21.15.81:0/1332794771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5841c8580 con 0x55d584554980 2024-09-12T01:30:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefe6ffd640 1 --2- 172.21.15.81:0/1332794771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d58455c6b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fefdc0115a0 tx=0x7fefdc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a49b7b7d288fd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefc6ffd640 1 -- 172.21.15.81:0/1332794771 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefdc013670 con 0x55d584554980 2024-09-12T01:30:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefc6ffd640 1 -- 172.21.15.81:0/1332794771 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fefdc013810 con 0x55d584554980 2024-09-12T01:30:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefeff19740 1 -- 172.21.15.81:0/1332794771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefd809b960 con 0x55d584554980 2024-09-12T01:30:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefc6ffd640 1 -- 172.21.15.81:0/1332794771 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fefdc013a10 con 0x55d584554980 2024-09-12T01:30:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.162+0000 7fefeff19740 10 client.15939 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.163+0000 7fefeff19740 1 -- 172.21.15.81:0/1332794771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d584292960 con 0x55d584554980 2024-09-12T01:30:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.163+0000 7fefc6ffd640 1 -- 172.21.15.81:0/1332794771 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd809b960 con 0x55d584554980 2024-09-12T01:30:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.163+0000 7fefc6ffd640 1 -- 172.21.15.81:0/1332794771 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fefdc01d400 con 0x55d584554980 2024-09-12T01:30:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.163+0000 7fefeff19740 10 client.15939 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.163+0000 7fefeff19740 10 client.15939 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T01:30:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.163+0000 7fefeff19740 20 client.15939 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.163+0000 7fefeff19740 1 --2- 172.21.15.81:0/1332794771 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d58456eea0 0x55d5845712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.163+0000 7fefeff19740 4 client.15939 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:30:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.163+0000 7fefeff19740 1 -- 172.21.15.81:0/1332794771 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5844c6b90 con 0x55d58456eea0 2024-09-12T01:30:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.163+0000 7fefe77fe640 1 --2- 172.21.15.81:0/1332794771 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d58456eea0 0x55d5845712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.164+0000 7fefc6ffd640 10 client.15939 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.164+0000 7fefe77fe640 1 --2- 172.21.15.81:0/1332794771 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d58456eea0 0x55d5845712e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26a8f4a6a2089695 server_cookie=cdf5854a2c30c924 in_seq=0 out_seq=0 2024-09-12T01:30:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.164+0000 7fefc6ffd640 1 -- 172.21.15.81:0/1332794771 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d5844c6b90 con 0x55d58456eea0 2024-09-12T01:30:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.164+0000 7fefc6ffd640 10 client.15939 handle_command_reply: tid=0 2024-09-12T01:30:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.164+0000 7fefeff19740 1 client.15939 shutdown 2024-09-12T01:30:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.165+0000 7fefeff19740 1 -- 172.21.15.81:0/1332794771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 msgr2=0x55d58455c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.165+0000 7fefeff19740 1 --2- 172.21.15.81:0/1332794771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d58455c6b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fefdc0115a0 tx=0x7fefdc009f90 comp rx=0 tx=0).stop 2024-09-12T01:30:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.165+0000 7fefeff19740 1 -- 172.21.15.81:0/1332794771 shutdown_connections 2024-09-12T01:30:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.165+0000 7fefeff19740 1 --2- 172.21.15.81:0/1332794771 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d58456eea0 0x55d5845712e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.165+0000 7fefeff19740 1 --2- 172.21.15.81:0/1332794771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d58455f240 0x55d58455cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.165+0000 7fefeff19740 1 --2- 172.21.15.81:0/1332794771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d58455c6b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.165+0000 7fefeff19740 1 --2- 172.21.15.81:0/1332794771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d584554060 0x55d58455c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.165+0000 7fefc6ffd640 0 client.15939 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.165+0000 7fefeff19740 1 -- 172.21.15.81:0/1332794771 >> 172.21.15.81:0/1332794771 conn(0x55d5845505f0 msgr2=0x55d58454f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.165+0000 7fefeff19740 1 -- 172.21.15.81:0/1332794771 shutdown_connections 2024-09-12T01:30:19.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.165+0000 7fefeff19740 1 -- 172.21.15.81:0/1332794771 wait complete. 2024-09-12T01:30:19.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.165+0000 7fefeff19740 20 client.15939 trim_cache size 0 max 16384 2024-09-12T01:30:19.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefeff19740 1 Processor -- start 2024-09-12T01:30:19.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefeff19740 1 -- start start 2024-09-12T01:30:19.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefeff19740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554060 0x55d58455e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefeff19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d584554980 0x55d584556b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefeff19740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d58455f240 0x55d584576b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefeff19740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81afc00 con 0x55d584554060 2024-09-12T01:30:19.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefeff19740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81b1740 con 0x55d58455f240 2024-09-12T01:30:19.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefeff19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81b02d0 con 0x55d584554980 2024-09-12T01:30:19.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefe77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554060 0x55d58455e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefe77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554060 0x55d58455e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42548/0 (socket says 172.21.15.81:42548) 2024-09-12T01:30:19.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefe77fe640 1 -- 172.21.15.81:0/1693719675 learned_addr learned my addr 172.21.15.81:0/1693719675 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:19.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefe6ffd640 1 --2- 172.21.15.81:0/1693719675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d584554980 0x55d584556b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefe77fe640 1 -- 172.21.15.81:0/1693719675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d584554980 msgr2=0x55d584556b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:19.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefe77fe640 1 --2- 172.21.15.81:0/1693719675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d584554980 0x55d584556b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefe77fe640 1 -- 172.21.15.81:0/1693719675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d58455f240 msgr2=0x55d584576b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:19.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefe7fff640 1 --2- 172.21.15.81:0/1693719675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d58455f240 0x55d584576b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefe77fe640 1 --2- 172.21.15.81:0/1693719675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d58455f240 0x55d584576b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefe77fe640 1 -- 172.21.15.81:0/1693719675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d584571910 con 0x55d584554060 2024-09-12T01:30:19.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefe6ffd640 1 --2- 172.21.15.81:0/1693719675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d584554980 0x55d584556b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:19.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefe77fe640 1 --2- 172.21.15.81:0/1693719675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554060 0x55d58455e040 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fefd809b1f0 tx=0x7fefd80d2710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab9cd5cedcda99a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:19.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.182+0000 7fefcd7fa640 1 -- 172.21.15.81:0/1693719675 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8097500 con 0x55d584554060 2024-09-12T01:30:19.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.183+0000 7fefcd7fa640 1 -- 172.21.15.81:0/1693719675 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefd809b260 con 0x55d584554060 2024-09-12T01:30:19.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.183+0000 7fefcd7fa640 1 -- 172.21.15.81:0/1693719675 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd80978d0 con 0x55d584554060 2024-09-12T01:30:19.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.183+0000 7fefeff19740 1 -- 172.21.15.81:0/1693719675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554060 msgr2=0x55d58455e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:19.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.183+0000 7fefeff19740 1 --2- 172.21.15.81:0/1693719675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554060 0x55d58455e040 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fefd809b1f0 tx=0x7fefd80d2710 comp rx=0 tx=0).stop 2024-09-12T01:30:19.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.183+0000 7fefeff19740 1 -- 172.21.15.81:0/1693719675 shutdown_connections 2024-09-12T01:30:19.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.183+0000 7fefeff19740 1 --2- 172.21.15.81:0/1693719675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d58455f240 0x55d584576b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.183+0000 7fefeff19740 1 --2- 172.21.15.81:0/1693719675 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d584554980 0x55d584556b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.183+0000 7fefeff19740 1 --2- 172.21.15.81:0/1693719675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554060 0x55d58455e040 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.183+0000 7fefeff19740 1 -- 172.21.15.81:0/1693719675 >> 172.21.15.81:0/1693719675 conn(0x55d5845505f0 msgr2=0x55d58454f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:19.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.183+0000 7fefeff19740 1 -- 172.21.15.81:0/1693719675 shutdown_connections 2024-09-12T01:30:19.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.183+0000 7fefeff19740 1 -- 172.21.15.81:0/1693719675 wait complete. 2024-09-12T01:30:19.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.183+0000 7fefeff19740 1 -- start start 2024-09-12T01:30:19.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefeff19740 1 Processor -- start 2024-09-12T01:30:19.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefeff19740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d584554060 0x55d584567640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefeff19740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d584563980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefeff19740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d58455f240 0x55d584563ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefeff19740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81b1070 con 0x55d584554980 2024-09-12T01:30:19.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefeff19740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81b09a0 con 0x55d584554060 2024-09-12T01:30:19.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefeff19740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81adbe0 con 0x55d58455f240 2024-09-12T01:30:19.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefeff19740 10 client.0 _ll_register_callbacks cb 0x7fefdc009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:19.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d584563980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d584563980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42558/0 (socket says 172.21.15.81:42558) 2024-09-12T01:30:19.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefe6ffd640 1 -- 172.21.15.81:0/4021624243 learned_addr learned my addr 172.21.15.81:0/4021624243 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:19.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefe77fe640 1 --2- 172.21.15.81:0/4021624243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d584554060 0x55d584567640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefe6ffd640 1 -- 172.21.15.81:0/4021624243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d58455f240 msgr2=0x55d584563ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:19.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefe6ffd640 1 --2- 172.21.15.81:0/4021624243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d58455f240 0x55d584563ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefe6ffd640 1 -- 172.21.15.81:0/4021624243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d584554060 msgr2=0x55d584567640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:19.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefe6ffd640 1 --2- 172.21.15.81:0/4021624243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d584554060 0x55d584567640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.184+0000 7fefe6ffd640 1 -- 172.21.15.81:0/4021624243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d584564430 con 0x55d584554980 2024-09-12T01:30:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefe6ffd640 1 --2- 172.21.15.81:0/4021624243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d584563980 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x55d58455d7b0 tx=0x7fefdc009180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cf5c48742a81fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefc6ffd640 1 -- 172.21.15.81:0/4021624243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefdc02a070 con 0x55d584554980 2024-09-12T01:30:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefc6ffd640 1 -- 172.21.15.81:0/4021624243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fefdc01da90 con 0x55d584554980 2024-09-12T01:30:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefeff19740 1 -- 172.21.15.81:0/4021624243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d584557d90 con 0x55d584554980 2024-09-12T01:30:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefc6ffd640 1 -- 172.21.15.81:0/4021624243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fefdc01de60 con 0x55d584554980 2024-09-12T01:30:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefeff19740 10 client.15945 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefeff19740 1 -- 172.21.15.81:0/4021624243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d5845da8e0 con 0x55d584554980 2024-09-12T01:30:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefc6ffd640 1 -- 172.21.15.81:0/4021624243 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d584557d90 con 0x55d584554980 2024-09-12T01:30:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefc6ffd640 1 -- 172.21.15.81:0/4021624243 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fefdc02f9d0 con 0x55d584554980 2024-09-12T01:30:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefeff19740 10 client.15945 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefeff19740 10 client.15945 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T01:30:19.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefeff19740 20 client.15945 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:19.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefeff19740 1 --2- 172.21.15.81:0/4021624243 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d5845db040 0x55d5845dd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:19.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefeff19740 4 client.15945 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "59bd9bc6", "release": true, "await": true}] 2024-09-12T01:30:19.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.185+0000 7fefeff19740 1 -- 172.21.15.81:0/4021624243 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "quiesce db", "set_id": "59bd9bc6", "release": true, "await": true}) -- 0x55d5844c10a0 con 0x55d5845db040 2024-09-12T01:30:19.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.186+0000 7fefe77fe640 1 --2- 172.21.15.81:0/4021624243 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d5845db040 0x55d5845dd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:19.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.186+0000 7fefc6ffd640 10 client.15945 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:19.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.186+0000 7fefe77fe640 1 --2- 172.21.15.81:0/4021624243 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d5845db040 0x55d5845dd460 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d643fbc0b98a443 server_cookie=46d29931bd45ec0d in_seq=0 out_seq=0 2024-09-12T01:30:19.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefc6ffd640 1 -- 172.21.15.81:0/4021624243 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55d5844c10a0 con 0x55d5845db040 2024-09-12T01:30:19.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefc6ffd640 10 client.15945 handle_command_reply: tid=0 2024-09-12T01:30:19.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefeff19740 1 client.15945 shutdown 2024-09-12T01:30:19.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefeff19740 1 -- 172.21.15.81:0/4021624243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 msgr2=0x55d584563980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:19.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefeff19740 1 --2- 172.21.15.81:0/4021624243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d584563980 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x55d58455d7b0 tx=0x7fefdc009180 comp rx=0 tx=0).stop 2024-09-12T01:30:19.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefeff19740 1 -- 172.21.15.81:0/4021624243 shutdown_connections 2024-09-12T01:30:19.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefeff19740 1 --2- 172.21.15.81:0/4021624243 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55d5845db040 0x55d5845dd460 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefeff19740 1 --2- 172.21.15.81:0/4021624243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d58455f240 0x55d584563ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefeff19740 1 --2- 172.21.15.81:0/4021624243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d584554980 0x55d584563980 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefeff19740 1 --2- 172.21.15.81:0/4021624243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d584554060 0x55d584567640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefeff19740 1 -- 172.21.15.81:0/4021624243 >> 172.21.15.81:0/4021624243 conn(0x55d5845505f0 msgr2=0x55d58456a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefc6ffd640 0 client.15945 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefeff19740 1 -- 172.21.15.81:0/4021624243 shutdown_connections 2024-09-12T01:30:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefeff19740 1 -- 172.21.15.81:0/4021624243 wait complete. 2024-09-12T01:30:19.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.189+0000 7fefeff19740 20 client.15945 trim_cache size 0 max 16384 2024-09-12T01:30:19.192 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:30:19.192 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 28, 2024-09-12T01:30:19.192 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24473, 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 8, 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: "59bd9bc6": { 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 8, 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 133.4, 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-12T01:30:19.193 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-12T01:30:19.194 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T01:30:19.194 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-12T01:30:19.194 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T01:30:19.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:30:19.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:30:19.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:30:19.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:30:19.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:30:19.194 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:30:19.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.190+0000 7fefedb40640 1 -- 172.21.15.81:0/922007868 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fefd00a2cf0 msgr2=0x7fefd00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:19.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.190+0000 7fefedb40640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fefd00a2cf0 0x7fefd00a51b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009430 tx=0x7fefe002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.190+0000 7fefedb40640 1 -- 172.21.15.81:0/922007868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8101de0 msgr2=0x7fefe80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:19.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.190+0000 7fefedb40640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8101de0 0x7fefe80744f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fefd800b4a0 tx=0x7fefd800b8a0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.190+0000 7fefedb40640 1 -- 172.21.15.81:0/922007868 shutdown_connections 2024-09-12T01:30:19.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.190+0000 7fefedb40640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fefd00a2cf0 0x7fefd00a51b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.190+0000 7fefedb40640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fefe8106f10 0x7fefe8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.190+0000 7fefedb40640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefe8102790 0x7fefe8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.190+0000 7fefedb40640 1 --2- 172.21.15.81:0/922007868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8101de0 0x7fefe80744f0 secure :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fefd800b4a0 tx=0x7fefd800b8a0 comp rx=0 tx=0).stop 2024-09-12T01:30:19.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.190+0000 7fefedb40640 1 -- 172.21.15.81:0/922007868 >> 172.21.15.81:0/922007868 conn(0x7fefe80fd8c0 msgr2=0x7fefe80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:19.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.191+0000 7fefedb40640 1 -- 172.21.15.81:0/922007868 shutdown_connections 2024-09-12T01:30:19.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:19.191+0000 7fefedb40640 1 -- 172.21.15.81:0/922007868 wait complete. 2024-09-12T01:30:19.932 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:19 smithi081 ceph-mon[30920]: pgmap v70: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 475 KiB/s wr, 84 op/s 2024-09-12T01:30:19.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:30:19.987 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '59bd9bc6', total seconds elapsed: 16.6 2024-09-12T01:30:20.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:19 smithi100 ceph-mon[35275]: pgmap v70: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 475 KiB/s wr, 84 op/s 2024-09-12T01:30:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:19 smithi189 ceph-mon[35357]: pgmap v70: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 475 KiB/s wr, 84 op/s 2024-09-12T01:30:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.780+0000 7f7ec6430640 1 -- 172.21.15.81:0/1336940697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec0102ef0 msgr2=0x7f7ec010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:20.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.780+0000 7f7ec6430640 1 --2- 172.21.15.81:0/1336940697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec0102ef0 0x7f7ec010da40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009ca0 tx=0x7f7eb802a950 comp rx=0 tx=0).stop 2024-09-12T01:30:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.780+0000 7f7ec6430640 1 -- 172.21.15.81:0/1336940697 shutdown_connections 2024-09-12T01:30:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.780+0000 7f7ec6430640 1 --2- 172.21.15.81:0/1336940697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec0102ef0 0x7f7ec010da40 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.780+0000 7f7ec6430640 1 --2- 172.21.15.81:0/1336940697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ec0102570 0x7f7ec01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.780+0000 7f7ec6430640 1 --2- 172.21.15.81:0/1336940697 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ec0100e20 0x7f7ec0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.780+0000 7f7ec6430640 1 -- 172.21.15.81:0/1336940697 >> 172.21.15.81:0/1336940697 conn(0x7f7ec00fc7d0 msgr2=0x7f7ec00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.780+0000 7f7ec6430640 1 -- 172.21.15.81:0/1336940697 shutdown_connections 2024-09-12T01:30:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.780+0000 7f7ec6430640 1 -- 172.21.15.81:0/1336940697 wait complete. 2024-09-12T01:30:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.781+0000 7f7ec6430640 1 Processor -- start 2024-09-12T01:30:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.781+0000 7f7ec6430640 1 -- start start 2024-09-12T01:30:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.781+0000 7f7ec6430640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec0100e20 0x7f7ec0197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.781+0000 7f7ec6430640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ec0102570 0x7f7ec0197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.781+0000 7f7ec6430640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ec0102ef0 0x7f7ec019bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.781+0000 7f7ec6430640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec0110f80 con 0x7f7ec0100e20 2024-09-12T01:30:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.781+0000 7f7ec6430640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec0110e00 con 0x7f7ec0102ef0 2024-09-12T01:30:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.781+0000 7f7ec6430640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec0111100 con 0x7f7ec0102570 2024-09-12T01:30:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.781+0000 7f7ebffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec0100e20 0x7f7ec0197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ebffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec0100e20 0x7f7ec0197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42582/0 (socket says 172.21.15.81:42582) 2024-09-12T01:30:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ebffff640 1 -- 172.21.15.81:0/3438393301 learned_addr learned my addr 172.21.15.81:0/3438393301 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ebf7fe640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ec0102570 0x7f7ec0197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ec49cd640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ec0102ef0 0x7f7ec019bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ebffff640 1 -- 172.21.15.81:0/3438393301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ec0102570 msgr2=0x7f7ec0197780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ebffff640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ec0102570 0x7f7ec0197780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ebffff640 1 -- 172.21.15.81:0/3438393301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ec0102ef0 msgr2=0x7f7ec019bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:20.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ebffff640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ec0102ef0 0x7f7ec019bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ebffff640 1 -- 172.21.15.81:0/3438393301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec019c1f0 con 0x7f7ec0100e20 2024-09-12T01:30:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ebffff640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec0100e20 0x7f7ec0197240 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000c920 tx=0x7f7eb000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ebd7fa640 1 -- 172.21.15.81:0/3438393301 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0007bb0 con 0x7f7ec0100e20 2024-09-12T01:30:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ec6430640 1 -- 172.21.15.81:0/3438393301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec019c4e0 con 0x7f7ec0100e20 2024-09-12T01:30:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ebd7fa640 1 -- 172.21.15.81:0/3438393301 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eb0007d50 con 0x7f7ec0100e20 2024-09-12T01:30:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ebd7fa640 1 -- 172.21.15.81:0/3438393301 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0018780 con 0x7f7ec0100e20 2024-09-12T01:30:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.782+0000 7f7ec6430640 1 -- 172.21.15.81:0/3438393301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec01a3dc0 con 0x7f7ec0100e20 2024-09-12T01:30:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.785+0000 7f7ebd7fa640 1 -- 172.21.15.81:0/3438393301 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7eb000f450 con 0x7f7ec0100e20 2024-09-12T01:30:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.785+0000 7f7ec8809740 1 Processor -- start 2024-09-12T01:30:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.785+0000 7f7ec8809740 1 -- start start 2024-09-12T01:30:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.785+0000 7f7ec8809740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61570 0x557166e61950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.785+0000 7f7ec8809740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 0x557166e6e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.785+0000 7f7ec8809740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e6ec80 0x557166e71070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.785+0000 7f7ec8809740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557166dc52e0 con 0x557166e61e90 2024-09-12T01:30:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.785+0000 7f7ec8809740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557166d6cce0 con 0x557166e61570 2024-09-12T01:30:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.785+0000 7f7ec8809740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557166dc12a0 con 0x557166e6ec80 2024-09-12T01:30:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.785+0000 7f7ebffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 0x557166e6e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.785+0000 7f7ebd7fa640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ea80a2cf0 0x7f7ea80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.785+0000 7f7ebffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 0x557166e6e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42592/0 (socket says 172.21.15.81:42592) 2024-09-12T01:30:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.785+0000 7f7ebffff640 1 -- 172.21.15.81:0/1576115953 learned_addr learned my addr 172.21.15.81:0/1576115953 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ec49cd640 1 --2- 172.21.15.81:0/1576115953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61570 0x557166e61950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ebf7fe640 1 --2- 172.21.15.81:0/1576115953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e6ec80 0x557166e71070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ec49cd640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ea80a2cf0 0x7f7ea80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ebf7fe640 1 -- 172.21.15.81:0/1576115953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61570 msgr2=0x557166e61950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ebf7fe640 1 --2- 172.21.15.81:0/1576115953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61570 0x557166e61950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ebf7fe640 1 -- 172.21.15.81:0/1576115953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 msgr2=0x557166e6e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ebf7fe640 1 --2- 172.21.15.81:0/1576115953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 0x557166e6e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ebf7fe640 1 -- 172.21.15.81:0/1576115953 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557166d51440 con 0x557166e6ec80 2024-09-12T01:30:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ebd7fa640 1 -- 172.21.15.81:0/3438393301 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7eb00cf570 con 0x7f7ec0100e20 2024-09-12T01:30:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ebffff640 1 --2- 172.21.15.81:0/1576115953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 0x557166e6e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:30:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ec49cd640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ea80a2cf0 0x7f7ea80a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009a60 tx=0x7f7eb80095c0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ebf7fe640 1 --2- 172.21.15.81:0/1576115953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e6ec80 0x557166e71070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400abc0 tx=0x7f7eb400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f604b771874bb5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ea67fc640 1 -- 172.21.15.81:0/1576115953 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4005220 con 0x557166e6ec80 2024-09-12T01:30:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ea67fc640 1 -- 172.21.15.81:0/1576115953 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eb4004c80 con 0x557166e6ec80 2024-09-12T01:30:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.786+0000 7f7ea67fc640 1 -- 172.21.15.81:0/1576115953 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40188a0 con 0x557166e6ec80 2024-09-12T01:30:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.787+0000 7f7ec8809740 1 -- 172.21.15.81:0/1576115953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e6ec80 msgr2=0x557166e71070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.787+0000 7f7ec8809740 1 --2- 172.21.15.81:0/1576115953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e6ec80 0x557166e71070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400abc0 tx=0x7f7eb400f790 comp rx=0 tx=0).stop 2024-09-12T01:30:20.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.787+0000 7f7ec8809740 1 -- 172.21.15.81:0/1576115953 shutdown_connections 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.787+0000 7f7ec8809740 1 --2- 172.21.15.81:0/1576115953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e6ec80 0x557166e71070 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.787+0000 7f7ec8809740 1 --2- 172.21.15.81:0/1576115953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 0x557166e6e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.787+0000 7f7ec8809740 1 --2- 172.21.15.81:0/1576115953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61570 0x557166e61950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.787+0000 7f7ec8809740 1 -- 172.21.15.81:0/1576115953 >> 172.21.15.81:0/1576115953 conn(0x557166e5dc40 msgr2=0x557166e5e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.788+0000 7f7ec8809740 1 -- 172.21.15.81:0/1576115953 shutdown_connections 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.788+0000 7f7ec8809740 1 -- 172.21.15.81:0/1576115953 wait complete. 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.788+0000 7f7ec8809740 1 -- start start 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.788+0000 7f7ec8809740 1 Processor -- start 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec8809740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e61570 0x557166e6e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec8809740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61e90 0x557166e6b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec8809740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 0x557166e6be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec8809740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557166e71670 con 0x557166e6ec80 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec8809740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557166d80050 con 0x557166e61e90 2024-09-12T01:30:20.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec8809740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557166e717f0 con 0x557166e61570 2024-09-12T01:30:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec49cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 0x557166e6be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec8809740 10 client.0 _ll_register_callbacks cb 0x557166dc0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec49cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 0x557166e6be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42600/0 (socket says 172.21.15.81:42600) 2024-09-12T01:30:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec49cd640 1 -- 172.21.15.81:0/2087539233 learned_addr learned my addr 172.21.15.81:0/2087539233 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ebf7fe640 1 --2- 172.21.15.81:0/2087539233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61e90 0x557166e6b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ebffff640 1 --2- 172.21.15.81:0/2087539233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e61570 0x557166e6e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec49cd640 1 -- 172.21.15.81:0/2087539233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e61570 msgr2=0x557166e6e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec49cd640 1 --2- 172.21.15.81:0/2087539233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e61570 0x557166e6e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec49cd640 1 -- 172.21.15.81:0/2087539233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61e90 msgr2=0x557166e6b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec49cd640 1 --2- 172.21.15.81:0/2087539233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61e90 0x557166e6b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec49cd640 1 -- 172.21.15.81:0/2087539233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557166b363c0 con 0x557166e6ec80 2024-09-12T01:30:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7ec49cd640 1 --2- 172.21.15.81:0/2087539233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 0x557166e6be30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7eb802fab0 tx=0x7f7eb802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4b335d07092710 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:20.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.789+0000 7f7e9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7e9f7fe640 1 -- 172.21.15.81:0/2087539233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb804f030 con 0x557166e6ec80 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7ec8809740 1 -- 172.21.15.81:0/2087539233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7eb4004c80 con 0x557166e6ec80 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7e9f7fe640 1 -- 172.21.15.81:0/2087539233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7eb8004040 con 0x557166e6ec80 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7e9f7fe640 1 -- 172.21.15.81:0/2087539233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7eb8034040 con 0x557166e6ec80 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7ec8809740 10 client.15957 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7ec8809740 1 -- 172.21.15.81:0/2087539233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557166e7d080 con 0x557166e6ec80 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7e9f7fe640 1 -- 172.21.15.81:0/2087539233 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eb4004c80 con 0x557166e6ec80 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7e9f7fe640 1 -- 172.21.15.81:0/2087539233 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7eb804b7d0 con 0x557166e6ec80 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7ec8809740 10 client.15957 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7ec8809740 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7ec8809740 20 client.15957 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7ec8809740 1 --2- 172.21.15.81:0/2087539233 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557166e7e490 0x557166e80910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7ec8809740 4 client.15957 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:30:20.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.790+0000 7f7ec8809740 1 -- 172.21.15.81:0/2087539233 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557166dd2850 con 0x557166e7e490 2024-09-12T01:30:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.791+0000 7f7ebffff640 1 --2- 172.21.15.81:0/2087539233 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557166e7e490 0x557166e80910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.791+0000 7f7e9f7fe640 10 client.15957 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.791+0000 7f7ebffff640 1 --2- 172.21.15.81:0/2087539233 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557166e7e490 0x557166e80910 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19c9f8934e95b13e server_cookie=a90c802d4336ce99 in_seq=0 out_seq=0 2024-09-12T01:30:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7e9f7fe640 1 -- 172.21.15.81:0/2087539233 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557166dd2850 con 0x557166e7e490 2024-09-12T01:30:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7e9f7fe640 10 client.15957 handle_command_reply: tid=0 2024-09-12T01:30:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7ec8809740 1 client.15957 shutdown 2024-09-12T01:30:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7ec8809740 1 -- 172.21.15.81:0/2087539233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 msgr2=0x557166e6be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7ec8809740 1 --2- 172.21.15.81:0/2087539233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 0x557166e6be30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7eb802fab0 tx=0x7f7eb802a950 comp rx=0 tx=0).stop 2024-09-12T01:30:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7ec8809740 1 -- 172.21.15.81:0/2087539233 shutdown_connections 2024-09-12T01:30:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7ec8809740 1 --2- 172.21.15.81:0/2087539233 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557166e7e490 0x557166e80910 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7ec8809740 1 --2- 172.21.15.81:0/2087539233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 0x557166e6be30 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7e9f7fe640 0 client.15957 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:20.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7ec8809740 1 --2- 172.21.15.81:0/2087539233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61e90 0x557166e6b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7ec8809740 1 --2- 172.21.15.81:0/2087539233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e61570 0x557166e6e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7ec8809740 1 -- 172.21.15.81:0/2087539233 >> 172.21.15.81:0/2087539233 conn(0x557166e5dc40 msgr2=0x557166e639a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:20.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7ec8809740 1 -- 172.21.15.81:0/2087539233 shutdown_connections 2024-09-12T01:30:20.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7ec8809740 1 -- 172.21.15.81:0/2087539233 wait complete. 2024-09-12T01:30:20.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.792+0000 7f7ec8809740 20 client.15957 trim_cache size 0 max 16384 2024-09-12T01:30:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.810+0000 7f7ec8809740 1 Processor -- start 2024-09-12T01:30:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.810+0000 7f7ec8809740 1 -- start start 2024-09-12T01:30:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.810+0000 7f7ec8809740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61570 0x557166e7a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.810+0000 7f7ec8809740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 0x557166e6a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ec8809740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e6ec80 0x557166e6a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ec8809740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec01ab4a0 con 0x557166e61e90 2024-09-12T01:30:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ec8809740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec01acfe0 con 0x557166e61570 2024-09-12T01:30:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ec8809740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec01abb70 con 0x557166e6ec80 2024-09-12T01:30:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ebf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 0x557166e6a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ebf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 0x557166e6a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42604/0 (socket says 172.21.15.81:42604) 2024-09-12T01:30:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ebffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61570 0x557166e7a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ebf7fe640 1 -- 172.21.15.81:0/2554827631 learned_addr learned my addr 172.21.15.81:0/2554827631 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ec49cd640 1 --2- 172.21.15.81:0/2554827631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e6ec80 0x557166e6a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ebf7fe640 1 -- 172.21.15.81:0/2554827631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e6ec80 msgr2=0x557166e6a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ebf7fe640 1 --2- 172.21.15.81:0/2554827631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e6ec80 0x557166e6a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ebf7fe640 1 -- 172.21.15.81:0/2554827631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61570 msgr2=0x557166e7a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ebf7fe640 1 --2- 172.21.15.81:0/2554827631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61570 0x557166e7a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ebf7fe640 1 -- 172.21.15.81:0/2554827631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557166e626c0 con 0x557166e61e90 2024-09-12T01:30:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ec49cd640 1 --2- 172.21.15.81:0/2554827631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e6ec80 0x557166e6a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ebffff640 1 --2- 172.21.15.81:0/2554827631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61570 0x557166e7a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:30:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ebf7fe640 1 --2- 172.21.15.81:0/2554827631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 0x557166e6a1c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x557166e62690 tx=0x7f7eb4005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7d7aee1c30b611 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.811+0000 7f7ea5ffb640 1 -- 172.21.15.81:0/2554827631 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4028070 con 0x557166e61e90 2024-09-12T01:30:20.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.812+0000 7f7ea5ffb640 1 -- 172.21.15.81:0/2554827631 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eb4005510 con 0x557166e61e90 2024-09-12T01:30:20.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.812+0000 7f7ea5ffb640 1 -- 172.21.15.81:0/2554827631 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4004de0 con 0x557166e61e90 2024-09-12T01:30:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.812+0000 7f7ec8809740 1 -- 172.21.15.81:0/2554827631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 msgr2=0x557166e6a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.812+0000 7f7ec8809740 1 --2- 172.21.15.81:0/2554827631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 0x557166e6a1c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x557166e62690 tx=0x7f7eb4005e60 comp rx=0 tx=0).stop 2024-09-12T01:30:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.812+0000 7f7ec8809740 1 -- 172.21.15.81:0/2554827631 shutdown_connections 2024-09-12T01:30:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.812+0000 7f7ec8809740 1 --2- 172.21.15.81:0/2554827631 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e6ec80 0x557166e6a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.812+0000 7f7ec8809740 1 --2- 172.21.15.81:0/2554827631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e61e90 0x557166e6a1c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.812+0000 7f7ec8809740 1 --2- 172.21.15.81:0/2554827631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61570 0x557166e7a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.812+0000 7f7ec8809740 1 -- 172.21.15.81:0/2554827631 >> 172.21.15.81:0/2554827631 conn(0x557166e5dc40 msgr2=0x557166e5a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.812+0000 7f7ec8809740 1 -- 172.21.15.81:0/2554827631 shutdown_connections 2024-09-12T01:30:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.812+0000 7f7ec8809740 1 -- 172.21.15.81:0/2554827631 wait complete. 2024-09-12T01:30:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.813+0000 7f7ec8809740 1 -- start start 2024-09-12T01:30:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.813+0000 7f7ec8809740 1 Processor -- start 2024-09-12T01:30:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.813+0000 7f7ec8809740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e61570 0x557166e5b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.813+0000 7f7ec8809740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61e90 0x557166e5b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.813+0000 7f7ec8809740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 0x557166e5bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.813+0000 7f7ec8809740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec01ac910 con 0x557166e6ec80 2024-09-12T01:30:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.813+0000 7f7ec8809740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec01ac240 con 0x557166e61e90 2024-09-12T01:30:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.813+0000 7f7ec8809740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec01a9480 con 0x557166e61570 2024-09-12T01:30:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.813+0000 7f7ec8809740 10 client.0 _ll_register_callbacks cb 0x7f7eb802fce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.813+0000 7f7ec49cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 0x557166e5bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.813+0000 7f7ec49cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 0x557166e5bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42620/0 (socket says 172.21.15.81:42620) 2024-09-12T01:30:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7ec49cd640 1 -- 172.21.15.81:0/3642248134 learned_addr learned my addr 172.21.15.81:0/3642248134 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7ebffff640 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e61570 0x557166e5b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7ebf7fe640 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61e90 0x557166e5b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7ebffff640 1 -- 172.21.15.81:0/3642248134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61e90 msgr2=0x557166e5b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7ebffff640 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61e90 0x557166e5b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7ebffff640 1 -- 172.21.15.81:0/3642248134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 msgr2=0x557166e5bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7ebffff640 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 0x557166e5bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7ebffff640 1 -- 172.21.15.81:0/3642248134 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557166ee8330 con 0x557166e61570 2024-09-12T01:30:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7ec49cd640 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 0x557166e5bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:30:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7ebffff640 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e61570 0x557166e5b250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00ccda0 tx=0x7f7eb0086040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=527fecb04f1a17be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7e9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T01:30:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7e9f7fe640 1 -- 172.21.15.81:0/3642248134 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb009fe70 con 0x557166e61570 2024-09-12T01:30:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7e9f7fe640 1 -- 172.21.15.81:0/3642248134 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7eb0099dc0 con 0x557166e61570 2024-09-12T01:30:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7ec8809740 1 -- 172.21.15.81:0/3642248134 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7eb4005510 con 0x557166e61570 2024-09-12T01:30:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7e9f7fe640 1 -- 172.21.15.81:0/3642248134 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7eb00a4730 con 0x557166e61570 2024-09-12T01:30:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7ec8809740 10 client.25318 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.814+0000 7f7ec8809740 1 -- 172.21.15.81:0/3642248134 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557166ee9680 con 0x557166e61570 2024-09-12T01:30:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.815+0000 7f7e9f7fe640 1 -- 172.21.15.81:0/3642248134 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eb4005510 con 0x557166e61570 2024-09-12T01:30:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.815+0000 7f7e9f7fe640 1 -- 172.21.15.81:0/3642248134 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7eb0098130 con 0x557166e61570 2024-09-12T01:30:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.815+0000 7f7ec8809740 10 client.25318 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.815+0000 7f7ec8809740 10 client.25318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:30:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.815+0000 7f7ec8809740 20 client.25318 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.815+0000 7f7ec8809740 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557166e7e490 0x557166eebd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.815+0000 7f7ec8809740 4 client.25318 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:30:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.815+0000 7f7ec8809740 1 -- 172.21.15.81:0/3642248134 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557166dccd60 con 0x557166e7e490 2024-09-12T01:30:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.815+0000 7f7ebf7fe640 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557166e7e490 0x557166eebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7e9f7fe640 10 client.25318 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.815+0000 7f7ebf7fe640 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557166e7e490 0x557166eebd10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=476b6fd79f4aeaa6 server_cookie=347c89d3e6880c6b in_seq=0 out_seq=0 2024-09-12T01:30:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7e9f7fe640 1 -- 172.21.15.81:0/3642248134 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557166dccd60 con 0x557166e7e490 2024-09-12T01:30:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7e9f7fe640 10 client.25318 handle_command_reply: tid=0 2024-09-12T01:30:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7ec8809740 1 client.25318 shutdown 2024-09-12T01:30:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7ec8809740 1 -- 172.21.15.81:0/3642248134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e61570 msgr2=0x557166e5b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7ec8809740 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e61570 0x557166e5b250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00ccda0 tx=0x7f7eb0086040 comp rx=0 tx=0).stop 2024-09-12T01:30:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7ec8809740 1 -- 172.21.15.81:0/3642248134 shutdown_connections 2024-09-12T01:30:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7ec8809740 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557166e7e490 0x557166eebd10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7ec8809740 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557166e6ec80 0x557166e5bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7ec8809740 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557166e61e90 0x557166e5b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7e9f7fe640 0 client.25318 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7ec8809740 1 --2- 172.21.15.81:0/3642248134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557166e61570 0x557166e5b250 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7ec8809740 1 -- 172.21.15.81:0/3642248134 >> 172.21.15.81:0/3642248134 conn(0x557166e5dc40 msgr2=0x557166e6d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7ec8809740 1 -- 172.21.15.81:0/3642248134 shutdown_connections 2024-09-12T01:30:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7ec8809740 1 -- 172.21.15.81:0/3642248134 wait complete. 2024-09-12T01:30:20.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.816+0000 7f7ec8809740 20 client.25318 trim_cache size 0 max 16384 2024-09-12T01:30:20.822 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:30:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:30:20.822 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:30:20.822 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:30:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.817+0000 7f7ec6430640 1 -- 172.21.15.81:0/3438393301 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ea80a2cf0 msgr2=0x7f7ea80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.817+0000 7f7ec6430640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ea80a2cf0 0x7f7ea80a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009a60 tx=0x7f7eb80095c0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.817+0000 7f7ec6430640 1 -- 172.21.15.81:0/3438393301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec0100e20 msgr2=0x7f7ec0197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.817+0000 7f7ec6430640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec0100e20 0x7f7ec0197240 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000c920 tx=0x7f7eb000cd20 comp rx=0 tx=0).stop 2024-09-12T01:30:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.817+0000 7f7ec6430640 1 -- 172.21.15.81:0/3438393301 shutdown_connections 2024-09-12T01:30:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.817+0000 7f7ec6430640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ea80a2cf0 0x7f7ea80a51b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.817+0000 7f7ec6430640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ec0102ef0 0x7f7ec019bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.817+0000 7f7ec6430640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ec0102570 0x7f7ec0197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.817+0000 7f7ec6430640 1 --2- 172.21.15.81:0/3438393301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec0100e20 0x7f7ec0197240 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:20.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.817+0000 7f7ec6430640 1 -- 172.21.15.81:0/3438393301 >> 172.21.15.81:0/3438393301 conn(0x7f7ec00fc7d0 msgr2=0x7f7ec0105720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:20.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.817+0000 7f7ec6430640 1 -- 172.21.15.81:0/3438393301 shutdown_connections 2024-09-12T01:30:20.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:20.817+0000 7f7ec6430640 1 -- 172.21.15.81:0/3438393301 wait complete. 2024-09-12T01:30:21.564 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:30:21.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:30:21.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:21 smithi081 ceph-mon[30920]: pgmap v71: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 573 op/s 2024-09-12T01:30:21.832 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:22.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:21 smithi100 ceph-mon[35275]: pgmap v71: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 573 op/s 2024-09-12T01:30:22.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:21 smithi189 ceph-mon[35357]: pgmap v71: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 573 op/s 2024-09-12T01:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.313+0000 7f1d659ae640 1 -- 172.21.15.81:0/1961310523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d60100a70 msgr2=0x7f1d6010ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.313+0000 7f1d659ae640 1 --2- 172.21.15.81:0/1961310523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d60100a70 0x7f1d6010ea60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009ca0 tx=0x7f1d5802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:30:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.313+0000 7f1d659ae640 1 -- 172.21.15.81:0/1961310523 shutdown_connections 2024-09-12T01:30:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.313+0000 7f1d659ae640 1 --2- 172.21.15.81:0/1961310523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d60100a70 0x7f1d6010ea60 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.313+0000 7f1d659ae640 1 --2- 172.21.15.81:0/1961310523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d601000d0 0x7f1d60100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.313+0000 7f1d659ae640 1 --2- 172.21.15.81:0/1961310523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d60106ba0 0x7f1d60106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.313+0000 7f1d659ae640 1 -- 172.21.15.81:0/1961310523 >> 172.21.15.81:0/1961310523 conn(0x7f1d60077210 msgr2=0x7f1d600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.313+0000 7f1d659ae640 1 -- 172.21.15.81:0/1961310523 shutdown_connections 2024-09-12T01:30:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.313+0000 7f1d659ae640 1 -- 172.21.15.81:0/1961310523 wait complete. 2024-09-12T01:30:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.314+0000 7f1d659ae640 1 Processor -- start 2024-09-12T01:30:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.314+0000 7f1d659ae640 1 -- start start 2024-09-12T01:30:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d659ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d601000d0 0x7f1d601984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d659ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d60100a70 0x7f1d60198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d659ae640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d60106ba0 0x7f1d6019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d659ae640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1d60112090 con 0x7f1d60100a70 2024-09-12T01:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d659ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1d60111f10 con 0x7f1d601000d0 2024-09-12T01:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d659ae640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1d60112210 con 0x7f1d60106ba0 2024-09-12T01:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d57fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d60100a70 0x7f1d60198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d57fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d60100a70 0x7f1d60198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44476/0 (socket says 172.21.15.81:44476) 2024-09-12T01:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d57fff640 1 -- 172.21.15.81:0/787454074 learned_addr learned my addr 172.21.15.81:0/787454074 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d5effd640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d601000d0 0x7f1d601984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d5f7fe640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d60106ba0 0x7f1d6019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d57fff640 1 -- 172.21.15.81:0/787454074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d60106ba0 msgr2=0x7f1d6019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d57fff640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d60106ba0 0x7f1d6019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d57fff640 1 -- 172.21.15.81:0/787454074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d601000d0 msgr2=0x7f1d601984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d57fff640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d601000d0 0x7f1d601984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d57fff640 1 -- 172.21.15.81:0/787454074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6019d4a0 con 0x7f1d60100a70 2024-09-12T01:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.315+0000 7f1d57fff640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d60100a70 0x7f1d60198a30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800d770 tx=0x7f1d4800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.316+0000 7f1d649ac640 1 -- 172.21.15.81:0/787454074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48017070 con 0x7f1d60100a70 2024-09-12T01:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.316+0000 7f1d649ac640 1 -- 172.21.15.81:0/787454074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d48005500 con 0x7f1d60100a70 2024-09-12T01:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.316+0000 7f1d659ae640 1 -- 172.21.15.81:0/787454074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6019d790 con 0x7f1d60100a70 2024-09-12T01:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.316+0000 7f1d649ac640 1 -- 172.21.15.81:0/787454074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48004e00 con 0x7f1d60100a70 2024-09-12T01:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.316+0000 7f1d659ae640 1 -- 172.21.15.81:0/787454074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d601a5070 con 0x7f1d60100a70 2024-09-12T01:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.317+0000 7f1d659ae640 1 -- 172.21.15.81:0/787454074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d60100530 con 0x7f1d60100a70 2024-09-12T01:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.318+0000 7f1d649ac640 1 -- 172.21.15.81:0/787454074 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f1d48004fa0 con 0x7f1d60100a70 2024-09-12T01:30:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.319+0000 7f1d649ac640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1d4c0a2cf0 0x7f1d4c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.319+0000 7f1d5effd640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1d4c0a2cf0 0x7f1d4c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.319+0000 7f1d649ac640 1 -- 172.21.15.81:0/787454074 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1d480ceea0 con 0x7f1d60100a70 2024-09-12T01:30:22.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.320+0000 7f1d5effd640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1d4c0a2cf0 0x7f1d4c0a51b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000bb60 tx=0x7f1d5000b390 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.324+0000 7f1d649ac640 1 -- 172.21.15.81:0/787454074 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d4809baf0 con 0x7f1d60100a70 2024-09-12T01:30:22.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.533+0000 7f1d659ae640 1 -- 172.21.15.81:0/787454074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d601a5240 con 0x7f1d60100a70 2024-09-12T01:30:22.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.534+0000 7f1d649ac640 1 -- 172.21.15.81:0/787454074 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f1d4809b3f0 con 0x7f1d60100a70 2024-09-12T01:30:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:30:22.534 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:30:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:30:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.536+0000 7f1d659ae640 1 -- 172.21.15.81:0/787454074 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1d4c0a2cf0 msgr2=0x7f1d4c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.536+0000 7f1d659ae640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1d4c0a2cf0 0x7f1d4c0a51b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000bb60 tx=0x7f1d5000b390 comp rx=0 tx=0).stop 2024-09-12T01:30:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.536+0000 7f1d659ae640 1 -- 172.21.15.81:0/787454074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d60100a70 msgr2=0x7f1d60198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.536+0000 7f1d659ae640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d60100a70 0x7f1d60198a30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800d770 tx=0x7f1d4800dc30 comp rx=0 tx=0).stop 2024-09-12T01:30:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.536+0000 7f1d659ae640 1 -- 172.21.15.81:0/787454074 shutdown_connections 2024-09-12T01:30:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.536+0000 7f1d659ae640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1d4c0a2cf0 0x7f1d4c0a51b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.536+0000 7f1d659ae640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d60106ba0 0x7f1d6019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:22.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.536+0000 7f1d659ae640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d60100a70 0x7f1d60198a30 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:22.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.536+0000 7f1d659ae640 1 --2- 172.21.15.81:0/787454074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d601000d0 0x7f1d601984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:22.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.537+0000 7f1d659ae640 1 -- 172.21.15.81:0/787454074 >> 172.21.15.81:0/787454074 conn(0x7f1d60077210 msgr2=0x7f1d60104b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:22.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.537+0000 7f1d659ae640 1 -- 172.21.15.81:0/787454074 shutdown_connections 2024-09-12T01:30:22.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:22.537+0000 7f1d659ae640 1 -- 172.21.15.81:0/787454074 wait complete. 2024-09-12T01:30:22.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:22 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/787454074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:30:23.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:22 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/787454074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:30:23.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:22 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/787454074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:30:23.200 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:30:23.463 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:23.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:23 smithi081 ceph-mon[30920]: pgmap v72: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.9 MiB/s wr, 493 op/s 2024-09-12T01:30:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.974+0000 7f02e7bc4640 1 -- 172.21.15.81:0/1169338837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e0074510 msgr2=0x7f02e00748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.974+0000 7f02e7bc4640 1 --2- 172.21.15.81:0/1169338837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e0074510 0x7f02e00748f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009900 tx=0x7f02dc02a480 comp rx=0 tx=0).stop 2024-09-12T01:30:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.974+0000 7f02e7bc4640 1 -- 172.21.15.81:0/1169338837 shutdown_connections 2024-09-12T01:30:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.974+0000 7f02e7bc4640 1 --2- 172.21.15.81:0/1169338837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e010e450 0x7f02e0110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.974+0000 7f02e7bc4640 1 --2- 172.21.15.81:0/1169338837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02e0074e30 0x7f02e010df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.974+0000 7f02e7bc4640 1 --2- 172.21.15.81:0/1169338837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e0074510 0x7f02e00748f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.974+0000 7f02e7bc4640 1 -- 172.21.15.81:0/1169338837 >> 172.21.15.81:0/1169338837 conn(0x7f02e00fd8f0 msgr2=0x7f02e00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.974+0000 7f02e7bc4640 1 -- 172.21.15.81:0/1169338837 shutdown_connections 2024-09-12T01:30:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.974+0000 7f02e7bc4640 1 -- 172.21.15.81:0/1169338837 wait complete. 2024-09-12T01:30:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.975+0000 7f02e7bc4640 1 Processor -- start 2024-09-12T01:30:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.975+0000 7f02e7bc4640 1 -- start start 2024-09-12T01:30:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.975+0000 7f02e7bc4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e0074510 0x7f02e019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.975+0000 7f02e7bc4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02e0074e30 0x7f02e019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.975+0000 7f02e7bc4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e010e450 0x7f02e019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.975+0000 7f02e7bc4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02e0114160 con 0x7f02e010e450 2024-09-12T01:30:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.975+0000 7f02e7bc4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02e0113fe0 con 0x7f02e0074510 2024-09-12T01:30:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.975+0000 7f02e7bc4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01142e0 con 0x7f02e0074e30 2024-09-12T01:30:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e6161640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e010e450 0x7f02e019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e515f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02e0074e30 0x7f02e019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e5960640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e0074510 0x7f02e019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e6161640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e010e450 0x7f02e019ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44498/0 (socket says 172.21.15.81:44498) 2024-09-12T01:30:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e515f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02e0074e30 0x7f02e019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.81:44974/0 (socket says 172.21.15.81:44974) 2024-09-12T01:30:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e6161640 1 -- 172.21.15.81:0/328389997 learned_addr learned my addr 172.21.15.81:0/328389997 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e6161640 1 -- 172.21.15.81:0/328389997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02e0074e30 msgr2=0x7f02e019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e6161640 1 --2- 172.21.15.81:0/328389997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02e0074e30 0x7f02e019ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e6161640 1 -- 172.21.15.81:0/328389997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e0074510 msgr2=0x7f02e019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e6161640 1 --2- 172.21.15.81:0/328389997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e0074510 0x7f02e019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e6161640 1 -- 172.21.15.81:0/328389997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e019f670 con 0x7f02e010e450 2024-09-12T01:30:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e5960640 1 --2- 172.21.15.81:0/328389997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e0074510 0x7f02e019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:30:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e6161640 1 --2- 172.21.15.81:0/328389997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e010e450 0x7f02e019ef90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f02d800dac0 tx=0x7f02d800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02d6ffd640 1 -- 172.21.15.81:0/328389997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8017070 con 0x7f02e010e450 2024-09-12T01:30:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02e7bc4640 1 -- 172.21.15.81:0/328389997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e019f960 con 0x7f02e010e450 2024-09-12T01:30:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02d6ffd640 1 -- 172.21.15.81:0/328389997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02d800be30 con 0x7f02e010e450 2024-09-12T01:30:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.976+0000 7f02d6ffd640 1 -- 172.21.15.81:0/328389997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d800f890 con 0x7f02e010e450 2024-09-12T01:30:24.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.977+0000 7f02e7bc4640 1 -- 172.21.15.81:0/328389997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e01a7240 con 0x7f02e010e450 2024-09-12T01:30:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.979+0000 7f02d6ffd640 1 -- 172.21.15.81:0/328389997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f02d800fad0 con 0x7f02e010e450 2024-09-12T01:30:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.979+0000 7f02e9f9d740 1 Processor -- start 2024-09-12T01:30:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.979+0000 7f02e9f9d740 1 -- start start 2024-09-12T01:30:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e9f9d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e2b40 0x563aee6e1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e9f9d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e15d0 0x563aee6e1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e9f9d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6ec370 0x563aee6ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e9f9d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563aee6472f0 con 0x563aee6e15d0 2024-09-12T01:30:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e9f9d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563aee5eecf0 con 0x563aee6e2b40 2024-09-12T01:30:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e9f9d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563aee6432b0 con 0x563aee6ec370 2024-09-12T01:30:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e5960640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e15d0 0x563aee6e1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e5960640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e15d0 0x563aee6e1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44512/0 (socket says 172.21.15.81:44512) 2024-09-12T01:30:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e5960640 1 -- 172.21.15.81:0/1810183374 learned_addr learned my addr 172.21.15.81:0/1810183374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e515f640 1 --2- 172.21.15.81:0/1810183374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e2b40 0x563aee6e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02d6ffd640 1 --2- 172.21.15.81:0/328389997 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f02cc0a2cf0 0x7f02cc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e515f640 1 --2- 172.21.15.81:0/1810183374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6ec370 0x563aee6ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e6161640 1 --2- 172.21.15.81:0/328389997 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f02cc0a2cf0 0x7f02cc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e5960640 1 -- 172.21.15.81:0/1810183374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6ec370 msgr2=0x563aee6ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e5960640 1 --2- 172.21.15.81:0/1810183374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6ec370 0x563aee6ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e5960640 1 -- 172.21.15.81:0/1810183374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e2b40 msgr2=0x563aee6e1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e5960640 1 --2- 172.21.15.81:0/1810183374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e2b40 0x563aee6e1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e5960640 1 -- 172.21.15.81:0/1810183374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aee5d33a0 con 0x563aee6e15d0 2024-09-12T01:30:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02d6ffd640 1 -- 172.21.15.81:0/328389997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f02d80cf260 con 0x7f02e010e450 2024-09-12T01:30:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.980+0000 7f02e5960640 1 --2- 172.21.15.81:0/1810183374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e15d0 0x563aee6e1a10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009900 tx=0x7f02dc005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c3f2d3cfe86e53 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.981+0000 7f02cbfff640 1 -- 172.21.15.81:0/1810183374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc035040 con 0x563aee6e15d0 2024-09-12T01:30:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.981+0000 7f02e6161640 1 --2- 172.21.15.81:0/328389997 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f02cc0a2cf0 0x7f02cc0a51b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f02d8098230 tx=0x7f02d8097bf0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.981+0000 7f02cbfff640 1 -- 172.21.15.81:0/1810183374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02dc0319f0 con 0x563aee6e15d0 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.981+0000 7f02cbfff640 1 -- 172.21.15.81:0/1810183374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc004a00 con 0x563aee6e15d0 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.981+0000 7f02e9f9d740 1 -- 172.21.15.81:0/1810183374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e15d0 msgr2=0x563aee6e1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.981+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/1810183374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e15d0 0x563aee6e1a10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009900 tx=0x7f02dc005e80 comp rx=0 tx=0).stop 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.982+0000 7f02e9f9d740 1 -- 172.21.15.81:0/1810183374 shutdown_connections 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.982+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/1810183374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6ec370 0x563aee6ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.982+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/1810183374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e15d0 0x563aee6e1a10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.982+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/1810183374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e2b40 0x563aee6e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.982+0000 7f02e9f9d740 1 -- 172.21.15.81:0/1810183374 >> 172.21.15.81:0/1810183374 conn(0x563aee6aa310 msgr2=0x563aee6ddc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.982+0000 7f02e9f9d740 1 -- 172.21.15.81:0/1810183374 shutdown_connections 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.982+0000 7f02e9f9d740 1 -- 172.21.15.81:0/1810183374 wait complete. 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.982+0000 7f02e9f9d740 1 -- start start 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.982+0000 7f02e9f9d740 1 Processor -- start 2024-09-12T01:30:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.982+0000 7f02e9f9d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e15d0 0x563aee6ebc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.982+0000 7f02e9f9d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e2b40 0x563aee6e8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e9f9d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6ec370 0x563aee6e9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e9f9d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563aee6ef010 con 0x563aee6e2b40 2024-09-12T01:30:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e9f9d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563aee602060 con 0x563aee6e15d0 2024-09-12T01:30:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e9f9d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563aee6ef190 con 0x563aee6ec370 2024-09-12T01:30:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e9f9d740 10 client.0 _ll_register_callbacks cb 0x563aee3558c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e5960640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e2b40 0x563aee6e8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e5960640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e2b40 0x563aee6e8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44514/0 (socket says 172.21.15.81:44514) 2024-09-12T01:30:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e5960640 1 -- 172.21.15.81:0/2645063752 learned_addr learned my addr 172.21.15.81:0/2645063752 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e515f640 1 --2- 172.21.15.81:0/2645063752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e15d0 0x563aee6ebc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e515f640 1 --2- 172.21.15.81:0/2645063752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6ec370 0x563aee6e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e5960640 1 -- 172.21.15.81:0/2645063752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6ec370 msgr2=0x563aee6e9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e5960640 1 --2- 172.21.15.81:0/2645063752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6ec370 0x563aee6e9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e5960640 1 -- 172.21.15.81:0/2645063752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e15d0 msgr2=0x563aee6ebc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e5960640 1 --2- 172.21.15.81:0/2645063752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e15d0 0x563aee6ebc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e5960640 1 -- 172.21.15.81:0/2645063752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aee3b83c0 con 0x563aee6e2b40 2024-09-12T01:30:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e5960640 1 --2- 172.21.15.81:0/2645063752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e2b40 0x563aee6e8f40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0042a0 tx=0x7f02dc02ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c75c3b05d4379d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02c97fa640 1 -- 172.21.15.81:0/2645063752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc04e070 con 0x563aee6e2b40 2024-09-12T01:30:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02c97fa640 1 -- 172.21.15.81:0/2645063752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f02dc0035f0 con 0x563aee6e2b40 2024-09-12T01:30:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.983+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2645063752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02dc0319f0 con 0x563aee6e2b40 2024-09-12T01:30:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.984+0000 7f02c97fa640 1 -- 172.21.15.81:0/2645063752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02dc05a050 con 0x563aee6e2b40 2024-09-12T01:30:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.984+0000 7f02e9f9d740 10 client.15981 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.984+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2645063752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563aee6fa9d0 con 0x563aee6e2b40 2024-09-12T01:30:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.984+0000 7f02c97fa640 1 -- 172.21.15.81:0/2645063752 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02dc0319f0 con 0x563aee6e2b40 2024-09-12T01:30:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.984+0000 7f02c97fa640 1 -- 172.21.15.81:0/2645063752 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f02dc046940 con 0x563aee6e2b40 2024-09-12T01:30:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.984+0000 7f02e9f9d740 10 client.15981 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.984+0000 7f02e9f9d740 10 client.15981 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:30:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.984+0000 7f02e9f9d740 20 client.15981 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.984+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2645063752 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x563aee6fbd20 0x563aee6fe110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.984+0000 7f02e9f9d740 4 client.15981 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:30:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.984+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2645063752 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563aee654860 con 0x563aee6fbd20 2024-09-12T01:30:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.984+0000 7f02e515f640 1 --2- 172.21.15.81:0/2645063752 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x563aee6fbd20 0x563aee6fe110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.985+0000 7f02c97fa640 10 client.15981 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:30:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.985+0000 7f02e515f640 1 --2- 172.21.15.81:0/2645063752 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x563aee6fbd20 0x563aee6fe110 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=892bafe101a51de server_cookie=6a3d7f63adf8727b in_seq=0 out_seq=0 2024-09-12T01:30:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.985+0000 7f02c97fa640 1 -- 172.21.15.81:0/2645063752 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563aee654860 con 0x563aee6fbd20 2024-09-12T01:30:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.985+0000 7f02c97fa640 10 client.15981 handle_command_reply: tid=0 2024-09-12T01:30:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.986+0000 7f02e9f9d740 1 client.15981 shutdown 2024-09-12T01:30:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.986+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2645063752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e2b40 msgr2=0x563aee6e8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.986+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2645063752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e2b40 0x563aee6e8f40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0042a0 tx=0x7f02dc02ac30 comp rx=0 tx=0).stop 2024-09-12T01:30:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.986+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2645063752 shutdown_connections 2024-09-12T01:30:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.986+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2645063752 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x563aee6fbd20 0x563aee6fe110 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.986+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2645063752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6ec370 0x563aee6e9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.986+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2645063752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6e2b40 0x563aee6e8f40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.986+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2645063752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e15d0 0x563aee6ebc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.986+0000 7f02c97fa640 0 client.15981 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:30:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.986+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2645063752 >> 172.21.15.81:0/2645063752 conn(0x563aee6aa310 msgr2=0x563aee6e3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.986+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2645063752 shutdown_connections 2024-09-12T01:30:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.986+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2645063752 wait complete. 2024-09-12T01:30:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.986+0000 7f02e9f9d740 20 client.15981 trim_cache size 0 max 16384 2024-09-12T01:30:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.999+0000 7f02e9f9d740 1 Processor -- start 2024-09-12T01:30:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.999+0000 7f02e9f9d740 1 -- start start 2024-09-12T01:30:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.999+0000 7f02e9f9d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6e15d0 0x563aee6f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.999+0000 7f02e9f9d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e2b40 0x563aee6ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.999+0000 7f02e9f9d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 0x563aee6e4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.999+0000 7f02e9f9d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01af9c0 con 0x563aee6ec370 2024-09-12T01:30:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.999+0000 7f02e9f9d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01b1500 con 0x563aee6e2b40 2024-09-12T01:30:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.999+0000 7f02e9f9d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01b0090 con 0x563aee6e15d0 2024-09-12T01:30:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.999+0000 7f02e515f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 0x563aee6e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.999+0000 7f02e515f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 0x563aee6e4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44518/0 (socket says 172.21.15.81:44518) 2024-09-12T01:30:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.999+0000 7f02e515f640 1 -- 172.21.15.81:0/2721132827 learned_addr learned my addr 172.21.15.81:0/2721132827 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.999+0000 7f02e515f640 1 --2- 172.21.15.81:0/2721132827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6e15d0 0x563aee6f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:23.999+0000 7f02e5960640 1 --2- 172.21.15.81:0/2721132827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e2b40 0x563aee6ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.000+0000 7f02e515f640 1 -- 172.21.15.81:0/2721132827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6e15d0 msgr2=0x563aee6f82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.000+0000 7f02e515f640 1 --2- 172.21.15.81:0/2721132827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6e15d0 0x563aee6f82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.000+0000 7f02e515f640 1 -- 172.21.15.81:0/2721132827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e2b40 msgr2=0x563aee6ddd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.000+0000 7f02e515f640 1 --2- 172.21.15.81:0/2721132827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e2b40 0x563aee6ddd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.000+0000 7f02e515f640 1 -- 172.21.15.81:0/2721132827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aee6de960 con 0x563aee6ec370 2024-09-12T01:30:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.000+0000 7f02e515f640 1 --2- 172.21.15.81:0/2721132827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 0x563aee6e4120 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f02d00041e0 tx=0x7f02d0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f866dc0a73bd9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.000+0000 7f02cb7fe640 1 -- 172.21.15.81:0/2721132827 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0012e60 con 0x563aee6ec370 2024-09-12T01:30:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.000+0000 7f02cb7fe640 1 -- 172.21.15.81:0/2721132827 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02d0026040 con 0x563aee6ec370 2024-09-12T01:30:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.000+0000 7f02cb7fe640 1 -- 172.21.15.81:0/2721132827 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d00047a0 con 0x563aee6ec370 2024-09-12T01:30:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.001+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2721132827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 msgr2=0x563aee6e4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.001+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2721132827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 0x563aee6e4120 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f02d00041e0 tx=0x7f02d0014040 comp rx=0 tx=0).stop 2024-09-12T01:30:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.001+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2721132827 shutdown_connections 2024-09-12T01:30:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.001+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2721132827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 0x563aee6e4120 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.001+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2721132827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e2b40 0x563aee6ddd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.001+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2721132827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6e15d0 0x563aee6f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.001+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2721132827 >> 172.21.15.81:0/2721132827 conn(0x563aee6aa310 msgr2=0x563aee6eafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.001+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2721132827 shutdown_connections 2024-09-12T01:30:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.001+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2721132827 wait complete. 2024-09-12T01:30:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.001+0000 7f02e9f9d740 1 -- start start 2024-09-12T01:30:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.001+0000 7f02e9f9d740 1 Processor -- start 2024-09-12T01:30:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e9f9d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e15d0 0x563aee6efb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e9f9d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6e2b40 0x563aee6f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e9f9d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 0x563aee75e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e9f9d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01b0e30 con 0x563aee6ec370 2024-09-12T01:30:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e9f9d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01b0760 con 0x563aee6e15d0 2024-09-12T01:30:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e9f9d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02e01ad9a0 con 0x563aee6e2b40 2024-09-12T01:30:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e9f9d740 10 client.0 _ll_register_callbacks cb 0x7f02dc005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e515f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 0x563aee75e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e515f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 0x563aee75e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44524/0 (socket says 172.21.15.81:44524) 2024-09-12T01:30:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e515f640 1 -- 172.21.15.81:0/2894980618 learned_addr learned my addr 172.21.15.81:0/2894980618 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e515f640 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e15d0 0x563aee6efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e5960640 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6e2b40 0x563aee6f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e515f640 1 -- 172.21.15.81:0/2894980618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6e2b40 msgr2=0x563aee6f00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e515f640 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6e2b40 0x563aee6f00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e515f640 1 -- 172.21.15.81:0/2894980618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e15d0 msgr2=0x563aee6efb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e515f640 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e15d0 0x563aee6efb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e515f640 1 -- 172.21.15.81:0/2894980618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aee6dd510 con 0x563aee6ec370 2024-09-12T01:30:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e5960640 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6e2b40 0x563aee6f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02e515f640 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 0x563aee75e670 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x563aee7042e0 tx=0x7f02d00054d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bbe51e9a919bde server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.002+0000 7f02c97fa640 1 -- 172.21.15.81:0/2894980618 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d00055b0 con 0x563aee6ec370 2024-09-12T01:30:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02c97fa640 1 -- 172.21.15.81:0/2894980618 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f02d001b040 con 0x563aee6ec370 2024-09-12T01:30:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2894980618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02d0026040 con 0x563aee6ec370 2024-09-12T01:30:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02c97fa640 1 -- 172.21.15.81:0/2894980618 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02d0045050 con 0x563aee6ec370 2024-09-12T01:30:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02e9f9d740 10 client.15987 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2894980618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563aee765ee0 con 0x563aee6ec370 2024-09-12T01:30:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02c97fa640 1 -- 172.21.15.81:0/2894980618 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02d0026040 con 0x563aee6ec370 2024-09-12T01:30:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02c97fa640 1 -- 172.21.15.81:0/2894980618 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f02d002b050 con 0x563aee6ec370 2024-09-12T01:30:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02e9f9d740 10 client.15987 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02e9f9d740 10 client.15987 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:30:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02e9f9d740 20 client.15987 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x563aee766440 0x563aee768860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02e9f9d740 4 client.15987 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:30:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2894980618 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563aee64ed70 con 0x563aee766440 2024-09-12T01:30:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.003+0000 7f02e5960640 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x563aee766440 0x563aee768860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02c97fa640 10 client.15987 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:30:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02e5960640 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x563aee766440 0x563aee768860 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=684a281297f2c011 server_cookie=81ea1861d827417c in_seq=0 out_seq=0 2024-09-12T01:30:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02c97fa640 1 -- 172.21.15.81:0/2894980618 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563aee64ed70 con 0x563aee766440 2024-09-12T01:30:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02c97fa640 10 client.15987 handle_command_reply: tid=0 2024-09-12T01:30:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02e9f9d740 1 client.15987 shutdown 2024-09-12T01:30:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2894980618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 msgr2=0x563aee75e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 0x563aee75e670 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x563aee7042e0 tx=0x7f02d00054d0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2894980618 shutdown_connections 2024-09-12T01:30:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563aee6ec370 0x563aee75e670 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x563aee766440 0x563aee768860 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563aee6e2b40 0x563aee6f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02e9f9d740 1 --2- 172.21.15.81:0/2894980618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563aee6e15d0 0x563aee6efb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02c97fa640 0 client.15987 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:30:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2894980618 >> 172.21.15.81:0/2894980618 conn(0x563aee6aa310 msgr2=0x563aee6dc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2894980618 shutdown_connections 2024-09-12T01:30:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02e9f9d740 1 -- 172.21.15.81:0/2894980618 wait complete. 2024-09-12T01:30:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.004+0000 7f02e9f9d740 20 client.15987 trim_cache size 0 max 16384 2024-09-12T01:30:24.029 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:30:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.005+0000 7f02e7bc4640 1 -- 172.21.15.81:0/328389997 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f02cc0a2cf0 msgr2=0x7f02cc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.005+0000 7f02e7bc4640 1 --2- 172.21.15.81:0/328389997 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f02cc0a2cf0 0x7f02cc0a51b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f02d8098230 tx=0x7f02d8097bf0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.005+0000 7f02e7bc4640 1 -- 172.21.15.81:0/328389997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e010e450 msgr2=0x7f02e019ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.005+0000 7f02e7bc4640 1 --2- 172.21.15.81:0/328389997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e010e450 0x7f02e019ef90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f02d800dac0 tx=0x7f02d800df80 comp rx=0 tx=0).stop 2024-09-12T01:30:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.005+0000 7f02e7bc4640 1 -- 172.21.15.81:0/328389997 shutdown_connections 2024-09-12T01:30:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.005+0000 7f02e7bc4640 1 --2- 172.21.15.81:0/328389997 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f02cc0a2cf0 0x7f02cc0a51b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.005+0000 7f02e7bc4640 1 --2- 172.21.15.81:0/328389997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02e010e450 0x7f02e019ef90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.005+0000 7f02e7bc4640 1 --2- 172.21.15.81:0/328389997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02e0074e30 0x7f02e019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.005+0000 7f02e7bc4640 1 --2- 172.21.15.81:0/328389997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e0074510 0x7f02e019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.005+0000 7f02e7bc4640 1 -- 172.21.15.81:0/328389997 >> 172.21.15.81:0/328389997 conn(0x7f02e00fd8f0 msgr2=0x7f02e00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.005+0000 7f02e7bc4640 1 -- 172.21.15.81:0/328389997 shutdown_connections 2024-09-12T01:30:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:24.005+0000 7f02e7bc4640 1 -- 172.21.15.81:0/328389997 wait complete. 2024-09-12T01:30:24.031 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:23 smithi100 ceph-mon[35275]: pgmap v72: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.9 MiB/s wr, 493 op/s 2024-09-12T01:30:24.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:23 smithi189 ceph-mon[35357]: pgmap v72: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.9 MiB/s wr, 493 op/s 2024-09-12T01:30:24.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:30:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:25.239 INFO:tasks.workunit.client.0.smithi081.stdout:setting up random write file 2024-09-12T01:30:25.239 INFO:tasks.workunit.client.0.smithi081.stdout:done setting up random write file 2024-09-12T01:30:25.240 INFO:tasks.workunit.client.0.smithi081.stdout:starting fsync run 2024-09-12T01:30:25.240 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0091s 2024-09-12T01:30:25.240 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0074s 2024-09-12T01:30:25.240 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0055s 2024-09-12T01:30:25.240 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0054s 2024-09-12T01:30:25.240 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0059s 2024-09-12T01:30:25.240 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0058s 2024-09-12T01:30:25.240 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-12T01:30:25.240 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-12T01:30:25.240 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0120s 2024-09-12T01:30:25.240 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-12T01:30:25.240 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0058s 2024-09-12T01:30:25.241 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0058s 2024-09-12T01:30:25.241 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0063s 2024-09-12T01:30:25.241 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0056s 2024-09-12T01:30:25.241 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0055s 2024-09-12T01:30:25.241 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0057s 2024-09-12T01:30:25.241 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0063s 2024-09-12T01:30:25.241 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0060s 2024-09-12T01:30:25.241 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0063s 2024-09-12T01:30:25.241 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0058s 2024-09-12T01:30:25.241 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-12T01:30:25.241 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0053s 2024-09-12T01:30:25.241 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0051s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0060s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0052s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0052s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0051s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0051s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0056s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0057s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0055s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0052s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0059s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0058s 2024-09-12T01:30:25.242 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0005s fsync time: 0.0053s 2024-09-12T01:30:25.243 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0004s fsync time: 0.0049s 2024-09-12T01:30:25.243 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-12T01:30:25.243 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0047s 2024-09-12T01:30:25.243 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0057s 2024-09-12T01:30:25.243 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0064s 2024-09-12T01:30:25.243 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 12.2945s fsync time: 0.0056s 2024-09-12T01:30:25.243 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0089s 2024-09-12T01:30:25.243 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0063s 2024-09-12T01:30:25.243 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0065s 2024-09-12T01:30:25.243 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0002s fsync time: 0.0066s 2024-09-12T01:30:25.243 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0077s 2024-09-12T01:30:25.244 INFO:tasks.workunit.client.0.smithi081.stdout:write time: 0.0003s fsync time: 0.0077s 2024-09-12T01:30:25.244 INFO:tasks.workunit.client.0.smithi081.stdout:run done 49 fsyncs total, killing random writer 2024-09-12T01:30:25.245 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:30:25.245 INFO:tasks.workunit.client.0.smithi081.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:30:25.245 INFO:tasks.workunit.client.0.smithi081.stderr:+ whereis lsof 2024-09-12T01:30:25.354 INFO:tasks.workunit.client.0.smithi081.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-09-12T01:30:25.354 INFO:tasks.workunit.client.0.smithi081.stderr:+ lsof 2024-09-12T01:30:25.377 INFO:tasks.workunit.client.0.smithi081.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/2a495d6d2082bd57fcd49242c57edaf2b3367556813607278ec9620a5c94ce54/merged 2024-09-12T01:30:25.377 INFO:tasks.workunit.client.0.smithi081.stderr: Output information may be incomplete. 2024-09-12T01:30:25.377 INFO:tasks.workunit.client.0.smithi081.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/3c19fa0ec2294925b61e6b8fc586238cc5e92a7ec3e9d8f1b47402a1cbdf1d3c/merged 2024-09-12T01:30:25.377 INFO:tasks.workunit.client.0.smithi081.stderr: Output information may be incomplete. 2024-09-12T01:30:25.377 INFO:tasks.workunit.client.0.smithi081.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/81b75143a80827db650225c473a979eb7562bffec52aa9103b50f520105ced04/merged 2024-09-12T01:30:25.377 INFO:tasks.workunit.client.0.smithi081.stderr: Output information may be incomplete. 2024-09-12T01:30:25.377 INFO:tasks.workunit.client.0.smithi081.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/7649f8f63f626ae52c05b0a777a32a00cfa6b1fab7cf9cd840352171d88e3b0b/merged 2024-09-12T01:30:25.377 INFO:tasks.workunit.client.0.smithi081.stderr: Output information may be incomplete. 2024-09-12T01:30:25.377 INFO:tasks.workunit.client.0.smithi081.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/066a4f4b57304e45d0e1de23dbc3747480143cfc3af5116d404483aa7f387897/merged 2024-09-12T01:30:25.378 INFO:tasks.workunit.client.0.smithi081.stderr: Output information may be incomplete. 2024-09-12T01:30:25.378 INFO:tasks.workunit.client.0.smithi081.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/0677e0a9f758ebd21beaa91b86909ceef044768034ad6dd1c5cb6300615d4ccb/merged 2024-09-12T01:30:25.378 INFO:tasks.workunit.client.0.smithi081.stderr: Output information may be incomplete. 2024-09-12T01:30:25.378 INFO:tasks.workunit.client.0.smithi081.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/2f032be648768e531c9f050125f3ab5b506aadc55ac0cf746e5ae5d167b18460/merged 2024-09-12T01:30:25.378 INFO:tasks.workunit.client.0.smithi081.stderr: Output information may be incomplete. 2024-09-12T01:30:25.378 INFO:tasks.workunit.client.0.smithi081.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/483eb89a34385081a4d299358fbdcdb0e9a2a4283c8890955b56300bf363a5a6/merged 2024-09-12T01:30:25.378 INFO:tasks.workunit.client.0.smithi081.stderr: Output information may be incomplete. 2024-09-12T01:30:25.378 INFO:tasks.workunit.client.0.smithi081.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/d25b9ac3e3bd413176c4cb28136106b0b20f98a58d7995422c85abdfda5eeea9/merged 2024-09-12T01:30:25.378 INFO:tasks.workunit.client.0.smithi081.stderr: Output information may be incomplete. 2024-09-12T01:30:25.378 INFO:tasks.workunit.client.0.smithi081.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/a7ccba6f922e575db5b15f9273881e8c88365dc667e72958ba59516ae2f8ae25/merged 2024-09-12T01:30:25.378 INFO:tasks.workunit.client.0.smithi081.stderr: Output information may be incomplete. 2024-09-12T01:30:25.378 INFO:tasks.workunit.client.0.smithi081.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/9bca0ae7c2332742863320be7d1abb35017459b71717b965792a770713758a6e/merged 2024-09-12T01:30:25.378 INFO:tasks.workunit.client.0.smithi081.stderr: Output information may be incomplete. 2024-09-12T01:30:25.446 INFO:tasks.workunit.client.0.smithi081.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-09-12T01:30:25.446 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-09-12T01:30:25.446 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-09-12T01:30:25.446 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-09-12T01:30:25.447 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-09-12T01:30:25.447 INFO:tasks.workunit.client.0.smithi081.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-09-12T01:30:25.447 INFO:tasks.workunit.client.0.smithi081.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-09-12T01:30:25.447 INFO:tasks.workunit.client.0.smithi081.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-09-12T01:30:25.447 INFO:tasks.workunit.client.0.smithi081.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-09-12T01:30:25.447 INFO:tasks.workunit.client.0.smithi081.stdout:pool_work 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-09-12T01:30:25.447 INFO:tasks.workunit.client.0.smithi081.stdout:pool_work 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-09-12T01:30:25.447 INFO:tasks.workunit.client.0.smithi081.stdout:pool_work 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-09-12T01:30:25.447 INFO:tasks.workunit.client.0.smithi081.stdout:pool_work 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-09-12T01:30:25.447 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-09-12T01:30:25.448 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-09-12T01:30:25.448 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-09-12T01:30:25.448 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-09-12T01:30:25.448 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-09-12T01:30:25.448 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-09-12T01:30:25.448 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-09-12T01:30:25.448 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-09-12T01:30:25.448 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-09-12T01:30:25.448 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-09-12T01:30:25.449 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-09-12T01:30:25.449 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-09-12T01:30:25.449 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-09-12T01:30:25.449 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-09-12T01:30:25.449 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-09-12T01:30:25.449 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-09-12T01:30:25.449 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2024-09-12T01:30:25.449 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2024-09-12T01:30:25.449 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2024-09-12T01:30:25.449 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 9 root NOFD /proc/9/fd (opendir: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 10 root cwd unknown /proc/10/cwd (readlink: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 10 root rtd unknown /proc/10/root (readlink: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 10 root txt unknown /proc/10/exe (readlink: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 10 root NOFD /proc/10/fd (opendir: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_tasks 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-09-12T01:30:25.450 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_tasks 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-09-12T01:30:25.451 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_tasks 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-09-12T01:30:25.451 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_tasks 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-09-12T01:30:25.451 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_tasks 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-09-12T01:30:25.451 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_tasks 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-09-12T01:30:25.451 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_tasks 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-09-12T01:30:25.451 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_tasks 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-09-12T01:30:25.451 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_tasks 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-09-12T01:30:25.451 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_tasks 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-09-12T01:30:25.451 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_tasks 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-09-12T01:30:25.451 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_tasks 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-09-12T01:30:25.451 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-09-12T01:30:25.451 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-09-12T01:30:25.452 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-09-12T01:30:25.452 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-09-12T01:30:25.452 INFO:tasks.workunit.client.0.smithi081.stdout:pr/ttyS1 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-09-12T01:30:25.452 INFO:tasks.workunit.client.0.smithi081.stdout:pr/ttyS1 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-09-12T01:30:25.452 INFO:tasks.workunit.client.0.smithi081.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-09-12T01:30:25.452 INFO:tasks.workunit.client.0.smithi081.stdout:pr/ttyS1 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-09-12T01:30:25.452 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_preem 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-09-12T01:30:25.452 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_preem 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-09-12T01:30:25.452 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_preem 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-09-12T01:30:25.452 INFO:tasks.workunit.client.0.smithi081.stdout:rcu_preem 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-09-12T01:30:25.452 INFO:tasks.workunit.client.0.smithi081.stdout:migration 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-09-12T01:30:25.452 INFO:tasks.workunit.client.0.smithi081.stdout:migration 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-09-12T01:30:25.453 INFO:tasks.workunit.client.0.smithi081.stdout:migration 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-09-12T01:30:25.453 INFO:tasks.workunit.client.0.smithi081.stdout:migration 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-09-12T01:30:25.453 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-09-12T01:30:25.453 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-09-12T01:30:25.453 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-09-12T01:30:25.453 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-09-12T01:30:25.453 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/0 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2024-09-12T01:30:25.453 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/0 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2024-09-12T01:30:25.453 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/0 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2024-09-12T01:30:25.453 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/0 22 root NOFD /proc/22/fd (opendir: Permission denied) 2024-09-12T01:30:25.453 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/1 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-09-12T01:30:25.454 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/1 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-09-12T01:30:25.454 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/1 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-09-12T01:30:25.454 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/1 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-09-12T01:30:25.454 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-09-12T01:30:25.454 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-09-12T01:30:25.454 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-09-12T01:30:25.454 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-09-12T01:30:25.454 INFO:tasks.workunit.client.0.smithi081.stdout:migration 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2024-09-12T01:30:25.454 INFO:tasks.workunit.client.0.smithi081.stdout:migration 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2024-09-12T01:30:25.454 INFO:tasks.workunit.client.0.smithi081.stdout:migration 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2024-09-12T01:30:25.455 INFO:tasks.workunit.client.0.smithi081.stdout:migration 25 root NOFD /proc/25/fd (opendir: Permission denied) 2024-09-12T01:30:25.455 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-09-12T01:30:25.455 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-09-12T01:30:25.455 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-09-12T01:30:25.455 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-09-12T01:30:25.455 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2024-09-12T01:30:25.455 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2024-09-12T01:30:25.455 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2024-09-12T01:30:25.456 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 28 root NOFD /proc/28/fd (opendir: Permission denied) 2024-09-12T01:30:25.456 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/2 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-09-12T01:30:25.456 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/2 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-09-12T01:30:25.456 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/2 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-09-12T01:30:25.456 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/2 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-09-12T01:30:25.456 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-09-12T01:30:25.456 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-09-12T01:30:25.456 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-09-12T01:30:25.456 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-09-12T01:30:25.457 INFO:tasks.workunit.client.0.smithi081.stdout:migration 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-09-12T01:30:25.457 INFO:tasks.workunit.client.0.smithi081.stdout:migration 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-09-12T01:30:25.457 INFO:tasks.workunit.client.0.smithi081.stdout:migration 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-09-12T01:30:25.457 INFO:tasks.workunit.client.0.smithi081.stdout:migration 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-09-12T01:30:25.457 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-09-12T01:30:25.457 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-09-12T01:30:25.457 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-09-12T01:30:25.457 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-09-12T01:30:25.457 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-09-12T01:30:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-09-12T01:30:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-09-12T01:30:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-09-12T01:30:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/3 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-09-12T01:30:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/3 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-09-12T01:30:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/3 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-09-12T01:30:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/3 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-09-12T01:30:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-09-12T01:30:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-09-12T01:30:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-09-12T01:30:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-09-12T01:30:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:migration 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-09-12T01:30:25.458 INFO:tasks.workunit.client.0.smithi081.stdout:migration 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:migration 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:migration 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 40 root cwd unknown /proc/40/cwd (readlink: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 40 root rtd unknown /proc/40/root (readlink: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 40 root txt unknown /proc/40/exe (readlink: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 40 root NOFD /proc/40/fd (opendir: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-09-12T01:30:25.459 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-09-12T01:30:25.460 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-09-12T01:30:25.460 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-09-12T01:30:25.460 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-09-12T01:30:25.460 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-09-12T01:30:25.460 INFO:tasks.workunit.client.0.smithi081.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-09-12T01:30:25.460 INFO:tasks.workunit.client.0.smithi081.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-09-12T01:30:25.460 INFO:tasks.workunit.client.0.smithi081.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-09-12T01:30:25.460 INFO:tasks.workunit.client.0.smithi081.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-09-12T01:30:25.460 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-09-12T01:30:25.460 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-09-12T01:30:25.460 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-09-12T01:30:25.461 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-09-12T01:30:25.461 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 45 root cwd unknown /proc/45/cwd (readlink: Permission denied) 2024-09-12T01:30:25.461 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 45 root rtd unknown /proc/45/root (readlink: Permission denied) 2024-09-12T01:30:25.461 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 45 root txt unknown /proc/45/exe (readlink: Permission denied) 2024-09-12T01:30:25.461 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 45 root NOFD /proc/45/fd (opendir: Permission denied) 2024-09-12T01:30:25.461 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2024-09-12T01:30:25.461 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2024-09-12T01:30:25.461 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2024-09-12T01:30:25.461 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 46 root NOFD /proc/46/fd (opendir: Permission denied) 2024-09-12T01:30:25.461 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/5 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-09-12T01:30:25.461 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/5 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-09-12T01:30:25.461 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/5 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-09-12T01:30:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/5 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-09-12T01:30:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-09-12T01:30:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-09-12T01:30:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-09-12T01:30:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-09-12T01:30:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:migration 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-09-12T01:30:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:migration 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-09-12T01:30:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:migration 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-09-12T01:30:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:migration 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-09-12T01:30:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2024-09-12T01:30:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2024-09-12T01:30:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2024-09-12T01:30:25.462 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 50 root NOFD /proc/50/fd (opendir: Permission denied) 2024-09-12T01:30:25.463 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2024-09-12T01:30:25.463 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2024-09-12T01:30:25.463 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2024-09-12T01:30:25.463 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 52 root NOFD /proc/52/fd (opendir: Permission denied) 2024-09-12T01:30:25.463 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/6 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-09-12T01:30:25.463 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/6 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-09-12T01:30:25.463 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/6 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-09-12T01:30:25.463 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/6 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-09-12T01:30:25.463 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-09-12T01:30:25.463 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-09-12T01:30:25.463 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-09-12T01:30:25.463 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-09-12T01:30:25.463 INFO:tasks.workunit.client.0.smithi081.stdout:migration 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2024-09-12T01:30:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:migration 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2024-09-12T01:30:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:migration 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2024-09-12T01:30:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:migration 55 root NOFD /proc/55/fd (opendir: Permission denied) 2024-09-12T01:30:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-09-12T01:30:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-09-12T01:30:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-09-12T01:30:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-09-12T01:30:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2024-09-12T01:30:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2024-09-12T01:30:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2024-09-12T01:30:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 58 root NOFD /proc/58/fd (opendir: Permission denied) 2024-09-12T01:30:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/7 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-09-12T01:30:25.464 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/7 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/7 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:cpuhp/7 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 60 root cwd unknown /proc/60/cwd (readlink: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 60 root rtd unknown /proc/60/root (readlink: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 60 root txt unknown /proc/60/exe (readlink: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:idle_inje 60 root NOFD /proc/60/fd (opendir: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:migration 61 root cwd unknown /proc/61/cwd (readlink: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:migration 61 root rtd unknown /proc/61/root (readlink: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:migration 61 root txt unknown /proc/61/exe (readlink: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:migration 61 root NOFD /proc/61/fd (opendir: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 62 root cwd unknown /proc/62/cwd (readlink: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 62 root rtd unknown /proc/62/root (readlink: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 62 root txt unknown /proc/62/exe (readlink: Permission denied) 2024-09-12T01:30:25.465 INFO:tasks.workunit.client.0.smithi081.stdout:ksoftirqd 62 root NOFD /proc/62/fd (opendir: Permission denied) 2024-09-12T01:30:25.466 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 64 root cwd unknown /proc/64/cwd (readlink: Permission denied) 2024-09-12T01:30:25.466 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 64 root rtd unknown /proc/64/root (readlink: Permission denied) 2024-09-12T01:30:25.466 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 64 root txt unknown /proc/64/exe (readlink: Permission denied) 2024-09-12T01:30:25.466 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 64 root NOFD /proc/64/fd (opendir: Permission denied) 2024-09-12T01:30:25.466 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2024-09-12T01:30:25.466 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2024-09-12T01:30:25.466 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2024-09-12T01:30:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 69 root NOFD /proc/69/fd (opendir: Permission denied) 2024-09-12T01:30:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:kdevtmpfs 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-09-12T01:30:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:kdevtmpfs 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-09-12T01:30:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:kdevtmpfs 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-09-12T01:30:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:kdevtmpfs 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-09-12T01:30:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-09-12T01:30:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-09-12T01:30:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-09-12T01:30:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-09-12T01:30:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:kauditd 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2024-09-12T01:30:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:kauditd 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2024-09-12T01:30:25.467 INFO:tasks.workunit.client.0.smithi081.stdout:kauditd 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2024-09-12T01:30:25.468 INFO:tasks.workunit.client.0.smithi081.stdout:kauditd 74 root NOFD /proc/74/fd (opendir: Permission denied) 2024-09-12T01:30:25.468 INFO:tasks.workunit.client.0.smithi081.stdout:khungtask 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2024-09-12T01:30:25.468 INFO:tasks.workunit.client.0.smithi081.stdout:khungtask 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2024-09-12T01:30:25.468 INFO:tasks.workunit.client.0.smithi081.stdout:khungtask 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2024-09-12T01:30:25.468 INFO:tasks.workunit.client.0.smithi081.stdout:khungtask 76 root NOFD /proc/76/fd (opendir: Permission denied) 2024-09-12T01:30:25.468 INFO:tasks.workunit.client.0.smithi081.stdout:oom_reape 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-09-12T01:30:25.468 INFO:tasks.workunit.client.0.smithi081.stdout:oom_reape 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-09-12T01:30:25.468 INFO:tasks.workunit.client.0.smithi081.stdout:oom_reape 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-09-12T01:30:25.468 INFO:tasks.workunit.client.0.smithi081.stdout:oom_reape 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-09-12T01:30:25.468 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-09-12T01:30:25.468 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-09-12T01:30:25.468 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-09-12T01:30:25.468 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-09-12T01:30:25.469 INFO:tasks.workunit.client.0.smithi081.stdout:kcompactd 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-09-12T01:30:25.469 INFO:tasks.workunit.client.0.smithi081.stdout:kcompactd 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-09-12T01:30:25.469 INFO:tasks.workunit.client.0.smithi081.stdout:kcompactd 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-09-12T01:30:25.469 INFO:tasks.workunit.client.0.smithi081.stdout:kcompactd 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-09-12T01:30:25.469 INFO:tasks.workunit.client.0.smithi081.stdout:ksmd 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-09-12T01:30:25.469 INFO:tasks.workunit.client.0.smithi081.stdout:ksmd 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-09-12T01:30:25.469 INFO:tasks.workunit.client.0.smithi081.stdout:ksmd 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-09-12T01:30:25.469 INFO:tasks.workunit.client.0.smithi081.stdout:ksmd 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-09-12T01:30:25.469 INFO:tasks.workunit.client.0.smithi081.stdout:khugepage 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:khugepage 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:khugepage 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:khugepage 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2024-09-12T01:30:25.470 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2024-09-12T01:30:25.471 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 84 root NOFD /proc/84/fd (opendir: Permission denied) 2024-09-12T01:30:25.471 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 85 root cwd unknown /proc/85/cwd (readlink: Permission denied) 2024-09-12T01:30:25.471 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 85 root rtd unknown /proc/85/root (readlink: Permission denied) 2024-09-12T01:30:25.471 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 85 root txt unknown /proc/85/exe (readlink: Permission denied) 2024-09-12T01:30:25.471 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 85 root NOFD /proc/85/fd (opendir: Permission denied) 2024-09-12T01:30:25.471 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-09-12T01:30:25.471 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-09-12T01:30:25.471 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-09-12T01:30:25.471 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-09-12T01:30:25.471 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2024-09-12T01:30:25.471 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2024-09-12T01:30:25.472 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2024-09-12T01:30:25.472 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 88 root NOFD /proc/88/fd (opendir: Permission denied) 2024-09-12T01:30:25.472 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-09-12T01:30:25.472 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-09-12T01:30:25.472 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-09-12T01:30:25.472 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-09-12T01:30:25.472 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2024-09-12T01:30:25.472 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2024-09-12T01:30:25.472 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2024-09-12T01:30:25.472 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 90 root NOFD /proc/90/fd (opendir: Permission denied) 2024-09-12T01:30:25.472 INFO:tasks.workunit.client.0.smithi081.stdout:watchdogd 91 root cwd unknown /proc/91/cwd (readlink: Permission denied) 2024-09-12T01:30:25.472 INFO:tasks.workunit.client.0.smithi081.stdout:watchdogd 91 root rtd unknown /proc/91/root (readlink: Permission denied) 2024-09-12T01:30:25.472 INFO:tasks.workunit.client.0.smithi081.stdout:watchdogd 91 root txt unknown /proc/91/exe (readlink: Permission denied) 2024-09-12T01:30:25.473 INFO:tasks.workunit.client.0.smithi081.stdout:watchdogd 91 root NOFD /proc/91/fd (opendir: Permission denied) 2024-09-12T01:30:25.473 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 93 root cwd unknown /proc/93/cwd (readlink: Permission denied) 2024-09-12T01:30:25.473 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 93 root rtd unknown /proc/93/root (readlink: Permission denied) 2024-09-12T01:30:25.473 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 93 root txt unknown /proc/93/exe (readlink: Permission denied) 2024-09-12T01:30:25.473 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 93 root NOFD /proc/93/fd (opendir: Permission denied) 2024-09-12T01:30:25.473 INFO:tasks.workunit.client.0.smithi081.stdout:kswapd0 95 root cwd unknown /proc/95/cwd (readlink: Permission denied) 2024-09-12T01:30:25.473 INFO:tasks.workunit.client.0.smithi081.stdout:kswapd0 95 root rtd unknown /proc/95/root (readlink: Permission denied) 2024-09-12T01:30:25.473 INFO:tasks.workunit.client.0.smithi081.stdout:kswapd0 95 root txt unknown /proc/95/exe (readlink: Permission denied) 2024-09-12T01:30:25.473 INFO:tasks.workunit.client.0.smithi081.stdout:kswapd0 95 root NOFD /proc/95/fd (opendir: Permission denied) 2024-09-12T01:30:25.473 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 102 root cwd unknown /proc/102/cwd (readlink: Permission denied) 2024-09-12T01:30:25.473 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 102 root rtd unknown /proc/102/root (readlink: Permission denied) 2024-09-12T01:30:25.473 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 102 root txt unknown /proc/102/exe (readlink: Permission denied) 2024-09-12T01:30:25.474 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 102 root NOFD /proc/102/fd (opendir: Permission denied) 2024-09-12T01:30:25.474 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 104 root cwd unknown /proc/104/cwd (readlink: Permission denied) 2024-09-12T01:30:25.474 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 104 root rtd unknown /proc/104/root (readlink: Permission denied) 2024-09-12T01:30:25.474 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 104 root txt unknown /proc/104/exe (readlink: Permission denied) 2024-09-12T01:30:25.474 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 104 root NOFD /proc/104/fd (opendir: Permission denied) 2024-09-12T01:30:25.474 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 110 root cwd unknown /proc/110/cwd (readlink: Permission denied) 2024-09-12T01:30:25.474 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 110 root rtd unknown /proc/110/root (readlink: Permission denied) 2024-09-12T01:30:25.474 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 110 root txt unknown /proc/110/exe (readlink: Permission denied) 2024-09-12T01:30:25.474 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 110 root NOFD /proc/110/fd (opendir: Permission denied) 2024-09-12T01:30:25.474 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 111 root cwd unknown /proc/111/cwd (readlink: Permission denied) 2024-09-12T01:30:25.474 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 111 root rtd unknown /proc/111/root (readlink: Permission denied) 2024-09-12T01:30:25.474 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 111 root txt unknown /proc/111/exe (readlink: Permission denied) 2024-09-12T01:30:25.474 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 111 root NOFD /proc/111/fd (opendir: Permission denied) 2024-09-12T01:30:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 112 root cwd unknown /proc/112/cwd (readlink: Permission denied) 2024-09-12T01:30:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 112 root rtd unknown /proc/112/root (readlink: Permission denied) 2024-09-12T01:30:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 112 root txt unknown /proc/112/exe (readlink: Permission denied) 2024-09-12T01:30:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 112 root NOFD /proc/112/fd (opendir: Permission denied) 2024-09-12T01:30:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 113 root cwd unknown /proc/113/cwd (readlink: Permission denied) 2024-09-12T01:30:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 113 root rtd unknown /proc/113/root (readlink: Permission denied) 2024-09-12T01:30:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 113 root txt unknown /proc/113/exe (readlink: Permission denied) 2024-09-12T01:30:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 113 root NOFD /proc/113/fd (opendir: Permission denied) 2024-09-12T01:30:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 114 root cwd unknown /proc/114/cwd (readlink: Permission denied) 2024-09-12T01:30:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 114 root rtd unknown /proc/114/root (readlink: Permission denied) 2024-09-12T01:30:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 114 root txt unknown /proc/114/exe (readlink: Permission denied) 2024-09-12T01:30:25.475 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 114 root NOFD /proc/114/fd (opendir: Permission denied) 2024-09-12T01:30:25.476 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 123 root cwd unknown /proc/123/cwd (readlink: Permission denied) 2024-09-12T01:30:25.476 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 123 root rtd unknown /proc/123/root (readlink: Permission denied) 2024-09-12T01:30:25.476 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 123 root txt unknown /proc/123/exe (readlink: Permission denied) 2024-09-12T01:30:25.476 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 123 root NOFD /proc/123/fd (opendir: Permission denied) 2024-09-12T01:30:25.476 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 125 root cwd unknown /proc/125/cwd (readlink: Permission denied) 2024-09-12T01:30:25.476 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 125 root rtd unknown /proc/125/root (readlink: Permission denied) 2024-09-12T01:30:25.476 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 125 root txt unknown /proc/125/exe (readlink: Permission denied) 2024-09-12T01:30:25.476 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 125 root NOFD /proc/125/fd (opendir: Permission denied) 2024-09-12T01:30:25.476 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 237 root cwd unknown /proc/237/cwd (readlink: Permission denied) 2024-09-12T01:30:25.476 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 237 root rtd unknown /proc/237/root (readlink: Permission denied) 2024-09-12T01:30:25.476 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 237 root txt unknown /proc/237/exe (readlink: Permission denied) 2024-09-12T01:30:25.476 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 237 root NOFD /proc/237/fd (opendir: Permission denied) 2024-09-12T01:30:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 238 root cwd unknown /proc/238/cwd (readlink: Permission denied) 2024-09-12T01:30:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 238 root rtd unknown /proc/238/root (readlink: Permission denied) 2024-09-12T01:30:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 238 root txt unknown /proc/238/exe (readlink: Permission denied) 2024-09-12T01:30:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 238 root NOFD /proc/238/fd (opendir: Permission denied) 2024-09-12T01:30:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 277 root cwd unknown /proc/277/cwd (readlink: Permission denied) 2024-09-12T01:30:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 277 root rtd unknown /proc/277/root (readlink: Permission denied) 2024-09-12T01:30:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 277 root txt unknown /proc/277/exe (readlink: Permission denied) 2024-09-12T01:30:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 277 root NOFD /proc/277/fd (opendir: Permission denied) 2024-09-12T01:30:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 280 root cwd unknown /proc/280/cwd (readlink: Permission denied) 2024-09-12T01:30:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 280 root rtd unknown /proc/280/root (readlink: Permission denied) 2024-09-12T01:30:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 280 root txt unknown /proc/280/exe (readlink: Permission denied) 2024-09-12T01:30:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 280 root NOFD /proc/280/fd (opendir: Permission denied) 2024-09-12T01:30:25.477 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 281 root cwd unknown /proc/281/cwd (readlink: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 281 root rtd unknown /proc/281/root (readlink: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 281 root txt unknown /proc/281/exe (readlink: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 281 root NOFD /proc/281/fd (opendir: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 283 root cwd unknown /proc/283/cwd (readlink: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 283 root rtd unknown /proc/283/root (readlink: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 283 root txt unknown /proc/283/exe (readlink: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 283 root NOFD /proc/283/fd (opendir: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 294 root cwd unknown /proc/294/cwd (readlink: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 294 root rtd unknown /proc/294/root (readlink: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 294 root txt unknown /proc/294/exe (readlink: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 294 root NOFD /proc/294/fd (opendir: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 297 root cwd unknown /proc/297/cwd (readlink: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 297 root rtd unknown /proc/297/root (readlink: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 297 root txt unknown /proc/297/exe (readlink: Permission denied) 2024-09-12T01:30:25.478 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 297 root NOFD /proc/297/fd (opendir: Permission denied) 2024-09-12T01:30:25.479 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 396 root cwd unknown /proc/396/cwd (readlink: Permission denied) 2024-09-12T01:30:25.479 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 396 root rtd unknown /proc/396/root (readlink: Permission denied) 2024-09-12T01:30:25.479 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 396 root txt unknown /proc/396/exe (readlink: Permission denied) 2024-09-12T01:30:25.479 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 396 root NOFD /proc/396/fd (opendir: Permission denied) 2024-09-12T01:30:25.479 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 438 root cwd unknown /proc/438/cwd (readlink: Permission denied) 2024-09-12T01:30:25.479 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 438 root rtd unknown /proc/438/root (readlink: Permission denied) 2024-09-12T01:30:25.479 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 438 root txt unknown /proc/438/exe (readlink: Permission denied) 2024-09-12T01:30:25.479 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 438 root NOFD /proc/438/fd (opendir: Permission denied) 2024-09-12T01:30:25.479 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 441 root cwd unknown /proc/441/cwd (readlink: Permission denied) 2024-09-12T01:30:25.479 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 441 root rtd unknown /proc/441/root (readlink: Permission denied) 2024-09-12T01:30:25.479 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 441 root txt unknown /proc/441/exe (readlink: Permission denied) 2024-09-12T01:30:25.479 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 441 root NOFD /proc/441/fd (opendir: Permission denied) 2024-09-12T01:30:25.479 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 444 root cwd unknown /proc/444/cwd (readlink: Permission denied) 2024-09-12T01:30:25.480 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 444 root rtd unknown /proc/444/root (readlink: Permission denied) 2024-09-12T01:30:25.480 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 444 root txt unknown /proc/444/exe (readlink: Permission denied) 2024-09-12T01:30:25.480 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 444 root NOFD /proc/444/fd (opendir: Permission denied) 2024-09-12T01:30:25.480 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 445 root cwd unknown /proc/445/cwd (readlink: Permission denied) 2024-09-12T01:30:25.480 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 445 root rtd unknown /proc/445/root (readlink: Permission denied) 2024-09-12T01:30:25.480 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 445 root txt unknown /proc/445/exe (readlink: Permission denied) 2024-09-12T01:30:25.480 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 445 root NOFD /proc/445/fd (opendir: Permission denied) 2024-09-12T01:30:25.480 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 446 root cwd unknown /proc/446/cwd (readlink: Permission denied) 2024-09-12T01:30:25.480 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 446 root rtd unknown /proc/446/root (readlink: Permission denied) 2024-09-12T01:30:25.480 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 446 root txt unknown /proc/446/exe (readlink: Permission denied) 2024-09-12T01:30:25.480 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 446 root NOFD /proc/446/fd (opendir: Permission denied) 2024-09-12T01:30:25.480 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 447 root cwd unknown /proc/447/cwd (readlink: Permission denied) 2024-09-12T01:30:25.480 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 447 root rtd unknown /proc/447/root (readlink: Permission denied) 2024-09-12T01:30:25.481 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 447 root txt unknown /proc/447/exe (readlink: Permission denied) 2024-09-12T01:30:25.481 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 447 root NOFD /proc/447/fd (opendir: Permission denied) 2024-09-12T01:30:25.481 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_0 451 root cwd unknown /proc/451/cwd (readlink: Permission denied) 2024-09-12T01:30:25.481 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_0 451 root rtd unknown /proc/451/root (readlink: Permission denied) 2024-09-12T01:30:25.481 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_0 451 root txt unknown /proc/451/exe (readlink: Permission denied) 2024-09-12T01:30:25.481 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_0 451 root NOFD /proc/451/fd (opendir: Permission denied) 2024-09-12T01:30:25.481 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 452 root cwd unknown /proc/452/cwd (readlink: Permission denied) 2024-09-12T01:30:25.481 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 452 root rtd unknown /proc/452/root (readlink: Permission denied) 2024-09-12T01:30:25.481 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 452 root txt unknown /proc/452/exe (readlink: Permission denied) 2024-09-12T01:30:25.481 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 452 root NOFD /proc/452/fd (opendir: Permission denied) 2024-09-12T01:30:25.481 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_1 453 root cwd unknown /proc/453/cwd (readlink: Permission denied) 2024-09-12T01:30:25.481 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_1 453 root rtd unknown /proc/453/root (readlink: Permission denied) 2024-09-12T01:30:25.481 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_1 453 root txt unknown /proc/453/exe (readlink: Permission denied) 2024-09-12T01:30:25.482 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_1 453 root NOFD /proc/453/fd (opendir: Permission denied) 2024-09-12T01:30:25.482 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 454 root cwd unknown /proc/454/cwd (readlink: Permission denied) 2024-09-12T01:30:25.482 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 454 root rtd unknown /proc/454/root (readlink: Permission denied) 2024-09-12T01:30:25.482 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 454 root txt unknown /proc/454/exe (readlink: Permission denied) 2024-09-12T01:30:25.482 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 454 root NOFD /proc/454/fd (opendir: Permission denied) 2024-09-12T01:30:25.482 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_2 455 root cwd unknown /proc/455/cwd (readlink: Permission denied) 2024-09-12T01:30:25.482 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_2 455 root rtd unknown /proc/455/root (readlink: Permission denied) 2024-09-12T01:30:25.482 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_2 455 root txt unknown /proc/455/exe (readlink: Permission denied) 2024-09-12T01:30:25.482 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_2 455 root NOFD /proc/455/fd (opendir: Permission denied) 2024-09-12T01:30:25.482 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 456 root cwd unknown /proc/456/cwd (readlink: Permission denied) 2024-09-12T01:30:25.482 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 456 root rtd unknown /proc/456/root (readlink: Permission denied) 2024-09-12T01:30:25.482 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 456 root txt unknown /proc/456/exe (readlink: Permission denied) 2024-09-12T01:30:25.482 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 456 root NOFD /proc/456/fd (opendir: Permission denied) 2024-09-12T01:30:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_3 457 root cwd unknown /proc/457/cwd (readlink: Permission denied) 2024-09-12T01:30:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_3 457 root rtd unknown /proc/457/root (readlink: Permission denied) 2024-09-12T01:30:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_3 457 root txt unknown /proc/457/exe (readlink: Permission denied) 2024-09-12T01:30:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_3 457 root NOFD /proc/457/fd (opendir: Permission denied) 2024-09-12T01:30:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 458 root cwd unknown /proc/458/cwd (readlink: Permission denied) 2024-09-12T01:30:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 458 root rtd unknown /proc/458/root (readlink: Permission denied) 2024-09-12T01:30:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 458 root txt unknown /proc/458/exe (readlink: Permission denied) 2024-09-12T01:30:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 458 root NOFD /proc/458/fd (opendir: Permission denied) 2024-09-12T01:30:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_4 460 root cwd unknown /proc/460/cwd (readlink: Permission denied) 2024-09-12T01:30:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_4 460 root rtd unknown /proc/460/root (readlink: Permission denied) 2024-09-12T01:30:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_4 460 root txt unknown /proc/460/exe (readlink: Permission denied) 2024-09-12T01:30:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_4 460 root NOFD /proc/460/fd (opendir: Permission denied) 2024-09-12T01:30:25.483 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 461 root cwd unknown /proc/461/cwd (readlink: Permission denied) 2024-09-12T01:30:25.484 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 461 root rtd unknown /proc/461/root (readlink: Permission denied) 2024-09-12T01:30:25.484 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 461 root txt unknown /proc/461/exe (readlink: Permission denied) 2024-09-12T01:30:25.484 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 461 root NOFD /proc/461/fd (opendir: Permission denied) 2024-09-12T01:30:25.484 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_5 462 root cwd unknown /proc/462/cwd (readlink: Permission denied) 2024-09-12T01:30:25.484 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_5 462 root rtd unknown /proc/462/root (readlink: Permission denied) 2024-09-12T01:30:25.484 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_5 462 root txt unknown /proc/462/exe (readlink: Permission denied) 2024-09-12T01:30:25.484 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_5 462 root NOFD /proc/462/fd (opendir: Permission denied) 2024-09-12T01:30:25.484 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 463 root cwd unknown /proc/463/cwd (readlink: Permission denied) 2024-09-12T01:30:25.484 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 463 root rtd unknown /proc/463/root (readlink: Permission denied) 2024-09-12T01:30:25.484 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 463 root txt unknown /proc/463/exe (readlink: Permission denied) 2024-09-12T01:30:25.484 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 463 root NOFD /proc/463/fd (opendir: Permission denied) 2024-09-12T01:30:25.484 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_6 464 root cwd unknown /proc/464/cwd (readlink: Permission denied) 2024-09-12T01:30:25.485 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_6 464 root rtd unknown /proc/464/root (readlink: Permission denied) 2024-09-12T01:30:25.485 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_6 464 root txt unknown /proc/464/exe (readlink: Permission denied) 2024-09-12T01:30:25.485 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_6 464 root NOFD /proc/464/fd (opendir: Permission denied) 2024-09-12T01:30:25.485 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 465 root cwd unknown /proc/465/cwd (readlink: Permission denied) 2024-09-12T01:30:25.485 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 465 root rtd unknown /proc/465/root (readlink: Permission denied) 2024-09-12T01:30:25.485 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 465 root txt unknown /proc/465/exe (readlink: Permission denied) 2024-09-12T01:30:25.485 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 465 root NOFD /proc/465/fd (opendir: Permission denied) 2024-09-12T01:30:25.485 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_7 466 root cwd unknown /proc/466/cwd (readlink: Permission denied) 2024-09-12T01:30:25.485 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_7 466 root rtd unknown /proc/466/root (readlink: Permission denied) 2024-09-12T01:30:25.485 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_7 466 root txt unknown /proc/466/exe (readlink: Permission denied) 2024-09-12T01:30:25.485 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_7 466 root NOFD /proc/466/fd (opendir: Permission denied) 2024-09-12T01:30:25.485 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 467 root cwd unknown /proc/467/cwd (readlink: Permission denied) 2024-09-12T01:30:25.485 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 467 root rtd unknown /proc/467/root (readlink: Permission denied) 2024-09-12T01:30:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 467 root txt unknown /proc/467/exe (readlink: Permission denied) 2024-09-12T01:30:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 467 root NOFD /proc/467/fd (opendir: Permission denied) 2024-09-12T01:30:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_8 468 root cwd unknown /proc/468/cwd (readlink: Permission denied) 2024-09-12T01:30:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_8 468 root rtd unknown /proc/468/root (readlink: Permission denied) 2024-09-12T01:30:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_8 468 root txt unknown /proc/468/exe (readlink: Permission denied) 2024-09-12T01:30:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_8 468 root NOFD /proc/468/fd (opendir: Permission denied) 2024-09-12T01:30:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 469 root cwd unknown /proc/469/cwd (readlink: Permission denied) 2024-09-12T01:30:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 469 root rtd unknown /proc/469/root (readlink: Permission denied) 2024-09-12T01:30:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 469 root txt unknown /proc/469/exe (readlink: Permission denied) 2024-09-12T01:30:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 469 root NOFD /proc/469/fd (opendir: Permission denied) 2024-09-12T01:30:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_9 470 root cwd unknown /proc/470/cwd (readlink: Permission denied) 2024-09-12T01:30:25.486 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_9 470 root rtd unknown /proc/470/root (readlink: Permission denied) 2024-09-12T01:30:25.487 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_9 470 root txt unknown /proc/470/exe (readlink: Permission denied) 2024-09-12T01:30:25.487 INFO:tasks.workunit.client.0.smithi081.stdout:scsi_eh_9 470 root NOFD /proc/470/fd (opendir: Permission denied) 2024-09-12T01:30:25.487 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 471 root cwd unknown /proc/471/cwd (readlink: Permission denied) 2024-09-12T01:30:25.487 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 471 root rtd unknown /proc/471/root (readlink: Permission denied) 2024-09-12T01:30:25.487 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 471 root txt unknown /proc/471/exe (readlink: Permission denied) 2024-09-12T01:30:25.487 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 471 root NOFD /proc/471/fd (opendir: Permission denied) 2024-09-12T01:30:25.487 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 472 root cwd unknown /proc/472/cwd (readlink: Permission denied) 2024-09-12T01:30:25.487 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 472 root rtd unknown /proc/472/root (readlink: Permission denied) 2024-09-12T01:30:25.487 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 472 root txt unknown /proc/472/exe (readlink: Permission denied) 2024-09-12T01:30:25.487 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 472 root NOFD /proc/472/fd (opendir: Permission denied) 2024-09-12T01:30:25.487 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 473 root cwd unknown /proc/473/cwd (readlink: Permission denied) 2024-09-12T01:30:25.488 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 473 root rtd unknown /proc/473/root (readlink: Permission denied) 2024-09-12T01:30:25.488 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 473 root txt unknown /proc/473/exe (readlink: Permission denied) 2024-09-12T01:30:25.488 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 473 root NOFD /proc/473/fd (opendir: Permission denied) 2024-09-12T01:30:25.488 INFO:tasks.workunit.client.0.smithi081.stdout:jbd2/sda1 502 root cwd unknown /proc/502/cwd (readlink: Permission denied) 2024-09-12T01:30:25.488 INFO:tasks.workunit.client.0.smithi081.stdout:jbd2/sda1 502 root rtd unknown /proc/502/root (readlink: Permission denied) 2024-09-12T01:30:25.488 INFO:tasks.workunit.client.0.smithi081.stdout:jbd2/sda1 502 root txt unknown /proc/502/exe (readlink: Permission denied) 2024-09-12T01:30:25.488 INFO:tasks.workunit.client.0.smithi081.stdout:jbd2/sda1 502 root NOFD /proc/502/fd (opendir: Permission denied) 2024-09-12T01:30:25.488 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 503 root cwd unknown /proc/503/cwd (readlink: Permission denied) 2024-09-12T01:30:25.488 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 503 root rtd unknown /proc/503/root (readlink: Permission denied) 2024-09-12T01:30:25.488 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 503 root txt unknown /proc/503/exe (readlink: Permission denied) 2024-09-12T01:30:25.488 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 503 root NOFD /proc/503/fd (opendir: Permission denied) 2024-09-12T01:30:25.488 INFO:tasks.workunit.client.0.smithi081.stdout:systemd-j 578 root cwd unknown /proc/578/cwd (readlink: Permission denied) 2024-09-12T01:30:25.489 INFO:tasks.workunit.client.0.smithi081.stdout:systemd-j 578 root rtd unknown /proc/578/root (readlink: Permission denied) 2024-09-12T01:30:25.489 INFO:tasks.workunit.client.0.smithi081.stdout:systemd-j 578 root txt unknown /proc/578/exe (readlink: Permission denied) 2024-09-12T01:30:25.489 INFO:tasks.workunit.client.0.smithi081.stdout:systemd-j 578 root NOFD /proc/578/fd (opendir: Permission denied) 2024-09-12T01:30:25.489 INFO:tasks.workunit.client.0.smithi081.stdout:ext4lazyi 584 root cwd unknown /proc/584/cwd (readlink: Permission denied) 2024-09-12T01:30:25.489 INFO:tasks.workunit.client.0.smithi081.stdout:ext4lazyi 584 root rtd unknown /proc/584/root (readlink: Permission denied) 2024-09-12T01:30:25.489 INFO:tasks.workunit.client.0.smithi081.stdout:ext4lazyi 584 root txt unknown /proc/584/exe (readlink: Permission denied) 2024-09-12T01:30:25.489 INFO:tasks.workunit.client.0.smithi081.stdout:ext4lazyi 584 root NOFD /proc/584/fd (opendir: Permission denied) 2024-09-12T01:30:25.489 INFO:tasks.workunit.client.0.smithi081.stdout:systemd-u 594 root cwd unknown /proc/594/cwd (readlink: Permission denied) 2024-09-12T01:30:25.489 INFO:tasks.workunit.client.0.smithi081.stdout:systemd-u 594 root rtd unknown /proc/594/root (readlink: Permission denied) 2024-09-12T01:30:25.489 INFO:tasks.workunit.client.0.smithi081.stdout:systemd-u 594 root txt unknown /proc/594/exe (readlink: Permission denied) 2024-09-12T01:30:25.489 INFO:tasks.workunit.client.0.smithi081.stdout:systemd-u 594 root NOFD /proc/594/fd (opendir: Permission denied) 2024-09-12T01:30:25.489 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 637 root cwd unknown /proc/637/cwd (readlink: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 637 root rtd unknown /proc/637/root (readlink: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 637 root txt unknown /proc/637/exe (readlink: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 637 root NOFD /proc/637/fd (opendir: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:kipmi0 646 root cwd unknown /proc/646/cwd (readlink: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:kipmi0 646 root rtd unknown /proc/646/root (readlink: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:kipmi0 646 root txt unknown /proc/646/exe (readlink: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:kipmi0 646 root NOFD /proc/646/fd (opendir: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 665 root cwd unknown /proc/665/cwd (readlink: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 665 root rtd unknown /proc/665/root (readlink: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 665 root txt unknown /proc/665/exe (readlink: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 665 root NOFD /proc/665/fd (opendir: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:rpcbind 666 rpc cwd unknown /proc/666/cwd (readlink: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:rpcbind 666 rpc rtd unknown /proc/666/root (readlink: Permission denied) 2024-09-12T01:30:25.490 INFO:tasks.workunit.client.0.smithi081.stdout:rpcbind 666 rpc txt unknown /proc/666/exe (readlink: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:rpcbind 666 rpc NOFD /proc/666/fd (opendir: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 673 root cwd unknown /proc/673/cwd (readlink: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 673 root rtd unknown /proc/673/root (readlink: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 673 root txt unknown /proc/673/exe (readlink: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 673 root NOFD /proc/673/fd (opendir: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 674 root cwd unknown /proc/674/cwd (readlink: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 674 root rtd unknown /proc/674/root (readlink: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 674 root txt unknown /proc/674/exe (readlink: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 674 root NOFD /proc/674/fd (opendir: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:auditd 675 root cwd unknown /proc/675/cwd (readlink: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:auditd 675 root rtd unknown /proc/675/root (readlink: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:auditd 675 root txt unknown /proc/675/exe (readlink: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:auditd 675 root NOFD /proc/675/fd (opendir: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:auditd 675 676 auditd root cwd unknown /proc/675/task/676/cwd (readlink: Permission denied) 2024-09-12T01:30:25.491 INFO:tasks.workunit.client.0.smithi081.stdout:auditd 675 676 auditd root rtd unknown /proc/675/task/676/root (readlink: Permission denied) 2024-09-12T01:30:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:auditd 675 676 auditd root txt unknown /proc/675/task/676/exe (readlink: Permission denied) 2024-09-12T01:30:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:auditd 675 676 auditd root NOFD /proc/675/task/676/fd (opendir: Permission denied) 2024-09-12T01:30:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:auditd 675 678 auditd root cwd unknown /proc/675/task/678/cwd (readlink: Permission denied) 2024-09-12T01:30:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:auditd 675 678 auditd root rtd unknown /proc/675/task/678/root (readlink: Permission denied) 2024-09-12T01:30:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:auditd 675 678 auditd root txt unknown /proc/675/task/678/exe (readlink: Permission denied) 2024-09-12T01:30:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:auditd 675 678 auditd root NOFD /proc/675/task/678/fd (opendir: Permission denied) 2024-09-12T01:30:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:sedispatc 677 root cwd unknown /proc/677/cwd (readlink: Permission denied) 2024-09-12T01:30:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:sedispatc 677 root rtd unknown /proc/677/root (readlink: Permission denied) 2024-09-12T01:30:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:sedispatc 677 root txt unknown /proc/677/exe (readlink: Permission denied) 2024-09-12T01:30:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:sedispatc 677 root NOFD /proc/677/fd (opendir: Permission denied) 2024-09-12T01:30:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:dbus-brok 721 dbus cwd unknown /proc/721/cwd (readlink: Permission denied) 2024-09-12T01:30:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:dbus-brok 721 dbus rtd unknown /proc/721/root (readlink: Permission denied) 2024-09-12T01:30:25.492 INFO:tasks.workunit.client.0.smithi081.stdout:dbus-brok 721 dbus txt unknown /proc/721/exe (readlink: Permission denied) 2024-09-12T01:30:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:dbus-brok 721 dbus NOFD /proc/721/fd (opendir: Permission denied) 2024-09-12T01:30:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:dbus-brok 722 dbus cwd unknown /proc/722/cwd (readlink: Permission denied) 2024-09-12T01:30:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:dbus-brok 722 dbus rtd unknown /proc/722/root (readlink: Permission denied) 2024-09-12T01:30:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:dbus-brok 722 dbus txt unknown /proc/722/exe (readlink: Permission denied) 2024-09-12T01:30:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:dbus-brok 722 dbus NOFD /proc/722/fd (opendir: Permission denied) 2024-09-12T01:30:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:NetworkMa 723 root cwd unknown /proc/723/cwd (readlink: Permission denied) 2024-09-12T01:30:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:NetworkMa 723 root rtd unknown /proc/723/root (readlink: Permission denied) 2024-09-12T01:30:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:NetworkMa 723 root txt unknown /proc/723/exe (readlink: Permission denied) 2024-09-12T01:30:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:NetworkMa 723 root NOFD /proc/723/fd (opendir: Permission denied) 2024-09-12T01:30:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:NetworkMa 723 740 gmain root cwd unknown /proc/723/task/740/cwd (readlink: Permission denied) 2024-09-12T01:30:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:NetworkMa 723 740 gmain root rtd unknown /proc/723/task/740/root (readlink: Permission denied) 2024-09-12T01:30:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:NetworkMa 723 740 gmain root txt unknown /proc/723/task/740/exe (readlink: Permission denied) 2024-09-12T01:30:25.493 INFO:tasks.workunit.client.0.smithi081.stdout:NetworkMa 723 740 gmain root NOFD /proc/723/task/740/fd (opendir: Permission denied) 2024-09-12T01:30:25.494 INFO:tasks.workunit.client.0.smithi081.stdout:NetworkMa 723 741 gdbus root cwd unknown /proc/723/task/741/cwd (readlink: Permission denied) 2024-09-12T01:30:25.494 INFO:tasks.workunit.client.0.smithi081.stdout:NetworkMa 723 741 gdbus root rtd unknown /proc/723/task/741/root (readlink: Permission denied) 2024-09-12T01:30:25.494 INFO:tasks.workunit.client.0.smithi081.stdout:NetworkMa 723 741 gdbus root txt unknown /proc/723/task/741/exe (readlink: Permission denied) 2024-09-12T01:30:25.494 INFO:tasks.workunit.client.0.smithi081.stdout:NetworkMa 723 741 gdbus root NOFD /proc/723/task/741/fd (opendir: Permission denied) 2024-09-12T01:30:25.494 INFO:tasks.workunit.client.0.smithi081.stdout:irqbalanc 726 root cwd unknown /proc/726/cwd (readlink: Permission denied) 2024-09-12T01:30:25.494 INFO:tasks.workunit.client.0.smithi081.stdout:irqbalanc 726 root rtd unknown /proc/726/root (readlink: Permission denied) 2024-09-12T01:30:25.494 INFO:tasks.workunit.client.0.smithi081.stdout:irqbalanc 726 root txt unknown /proc/726/exe (readlink: Permission denied) 2024-09-12T01:30:25.494 INFO:tasks.workunit.client.0.smithi081.stdout:irqbalanc 726 root NOFD /proc/726/fd (opendir: Permission denied) 2024-09-12T01:30:25.494 INFO:tasks.workunit.client.0.smithi081.stdout:irqbalanc 726 733 gmain root cwd unknown /proc/726/task/733/cwd (readlink: Permission denied) 2024-09-12T01:30:25.494 INFO:tasks.workunit.client.0.smithi081.stdout:irqbalanc 726 733 gmain root rtd unknown /proc/726/task/733/root (readlink: Permission denied) 2024-09-12T01:30:25.494 INFO:tasks.workunit.client.0.smithi081.stdout:irqbalanc 726 733 gmain root txt unknown /proc/726/task/733/exe (readlink: Permission denied) 2024-09-12T01:30:25.494 INFO:tasks.workunit.client.0.smithi081.stdout:irqbalanc 726 733 gmain root NOFD /proc/726/task/733/fd (opendir: Permission denied) 2024-09-12T01:30:25.494 INFO:tasks.workunit.client.0.smithi081.stdout:lsmd 727 libstoragemgmt cwd unknown /proc/727/cwd (readlink: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:lsmd 727 libstoragemgmt rtd unknown /proc/727/root (readlink: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:lsmd 727 libstoragemgmt txt unknown /proc/727/exe (readlink: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:lsmd 727 libstoragemgmt NOFD /proc/727/fd (opendir: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:mcelog 728 root cwd unknown /proc/728/cwd (readlink: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:mcelog 728 root rtd unknown /proc/728/root (readlink: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:mcelog 728 root txt unknown /proc/728/exe (readlink: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:mcelog 728 root NOFD /proc/728/fd (opendir: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:smartd 730 root cwd unknown /proc/730/cwd (readlink: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:smartd 730 root rtd unknown /proc/730/root (readlink: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:smartd 730 root txt unknown /proc/730/exe (readlink: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:smartd 730 root NOFD /proc/730/fd (opendir: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:systemd-l 732 root cwd unknown /proc/732/cwd (readlink: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:systemd-l 732 root rtd unknown /proc/732/root (readlink: Permission denied) 2024-09-12T01:30:25.495 INFO:tasks.workunit.client.0.smithi081.stdout:systemd-l 732 root txt unknown /proc/732/exe (readlink: Permission denied) 2024-09-12T01:30:25.496 INFO:tasks.workunit.client.0.smithi081.stdout:systemd-l 732 root NOFD /proc/732/fd (opendir: Permission denied) 2024-09-12T01:30:25.496 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 767 root cwd unknown /proc/767/cwd (readlink: Permission denied) 2024-09-12T01:30:25.496 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 767 root rtd unknown /proc/767/root (readlink: Permission denied) 2024-09-12T01:30:25.496 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 767 root txt unknown /proc/767/exe (readlink: Permission denied) 2024-09-12T01:30:25.496 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 767 root NOFD /proc/767/fd (opendir: Permission denied) 2024-09-12T01:30:25.496 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 root cwd unknown /proc/779/cwd (readlink: Permission denied) 2024-09-12T01:30:25.496 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 root rtd unknown /proc/779/root (readlink: Permission denied) 2024-09-12T01:30:25.496 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 root txt unknown /proc/779/exe (readlink: Permission denied) 2024-09-12T01:30:25.496 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 root NOFD /proc/779/fd (opendir: Permission denied) 2024-09-12T01:30:25.496 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 780 gssproxy root cwd unknown /proc/779/task/780/cwd (readlink: Permission denied) 2024-09-12T01:30:25.496 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 780 gssproxy root rtd unknown /proc/779/task/780/root (readlink: Permission denied) 2024-09-12T01:30:25.496 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 780 gssproxy root txt unknown /proc/779/task/780/exe (readlink: Permission denied) 2024-09-12T01:30:25.496 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 780 gssproxy root NOFD /proc/779/task/780/fd (opendir: Permission denied) 2024-09-12T01:30:25.497 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 781 gssproxy root cwd unknown /proc/779/task/781/cwd (readlink: Permission denied) 2024-09-12T01:30:25.497 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 781 gssproxy root rtd unknown /proc/779/task/781/root (readlink: Permission denied) 2024-09-12T01:30:25.497 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 781 gssproxy root txt unknown /proc/779/task/781/exe (readlink: Permission denied) 2024-09-12T01:30:25.497 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 781 gssproxy root NOFD /proc/779/task/781/fd (opendir: Permission denied) 2024-09-12T01:30:25.497 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 782 gssproxy root cwd unknown /proc/779/task/782/cwd (readlink: Permission denied) 2024-09-12T01:30:25.497 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 782 gssproxy root rtd unknown /proc/779/task/782/root (readlink: Permission denied) 2024-09-12T01:30:25.497 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 782 gssproxy root txt unknown /proc/779/task/782/exe (readlink: Permission denied) 2024-09-12T01:30:25.497 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 782 gssproxy root NOFD /proc/779/task/782/fd (opendir: Permission denied) 2024-09-12T01:30:25.497 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 783 gssproxy root cwd unknown /proc/779/task/783/cwd (readlink: Permission denied) 2024-09-12T01:30:25.497 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 783 gssproxy root rtd unknown /proc/779/task/783/root (readlink: Permission denied) 2024-09-12T01:30:25.497 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 783 gssproxy root txt unknown /proc/779/task/783/exe (readlink: Permission denied) 2024-09-12T01:30:25.497 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 783 gssproxy root NOFD /proc/779/task/783/fd (opendir: Permission denied) 2024-09-12T01:30:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 784 gssproxy root cwd unknown /proc/779/task/784/cwd (readlink: Permission denied) 2024-09-12T01:30:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 784 gssproxy root rtd unknown /proc/779/task/784/root (readlink: Permission denied) 2024-09-12T01:30:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 784 gssproxy root txt unknown /proc/779/task/784/exe (readlink: Permission denied) 2024-09-12T01:30:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:gssproxy 779 784 gssproxy root NOFD /proc/779/task/784/fd (opendir: Permission denied) 2024-09-12T01:30:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:atd 786 root cwd unknown /proc/786/cwd (readlink: Permission denied) 2024-09-12T01:30:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:atd 786 root rtd unknown /proc/786/root (readlink: Permission denied) 2024-09-12T01:30:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:atd 786 root txt unknown /proc/786/exe (readlink: Permission denied) 2024-09-12T01:30:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:atd 786 root NOFD /proc/786/fd (opendir: Permission denied) 2024-09-12T01:30:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:crond 787 root cwd unknown /proc/787/cwd (readlink: Permission denied) 2024-09-12T01:30:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:crond 787 root rtd unknown /proc/787/root (readlink: Permission denied) 2024-09-12T01:30:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:crond 787 root txt unknown /proc/787/exe (readlink: Permission denied) 2024-09-12T01:30:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:crond 787 root NOFD /proc/787/fd (opendir: Permission denied) 2024-09-12T01:30:25.498 INFO:tasks.workunit.client.0.smithi081.stdout:nrpe 812 nrpe cwd unknown /proc/812/cwd (readlink: Permission denied) 2024-09-12T01:30:25.499 INFO:tasks.workunit.client.0.smithi081.stdout:nrpe 812 nrpe rtd unknown /proc/812/root (readlink: Permission denied) 2024-09-12T01:30:25.499 INFO:tasks.workunit.client.0.smithi081.stdout:nrpe 812 nrpe txt unknown /proc/812/exe (readlink: Permission denied) 2024-09-12T01:30:25.499 INFO:tasks.workunit.client.0.smithi081.stdout:nrpe 812 nrpe NOFD /proc/812/fd (opendir: Permission denied) 2024-09-12T01:30:25.499 INFO:tasks.workunit.client.0.smithi081.stdout:agetty 1215 root cwd unknown /proc/1215/cwd (readlink: Permission denied) 2024-09-12T01:30:25.499 INFO:tasks.workunit.client.0.smithi081.stdout:agetty 1215 root rtd unknown /proc/1215/root (readlink: Permission denied) 2024-09-12T01:30:25.499 INFO:tasks.workunit.client.0.smithi081.stdout:agetty 1215 root txt unknown /proc/1215/exe (readlink: Permission denied) 2024-09-12T01:30:25.499 INFO:tasks.workunit.client.0.smithi081.stdout:agetty 1215 root NOFD /proc/1215/fd (opendir: Permission denied) 2024-09-12T01:30:25.499 INFO:tasks.workunit.client.0.smithi081.stdout:agetty 1226 root cwd unknown /proc/1226/cwd (readlink: Permission denied) 2024-09-12T01:30:25.499 INFO:tasks.workunit.client.0.smithi081.stdout:agetty 1226 root rtd unknown /proc/1226/root (readlink: Permission denied) 2024-09-12T01:30:25.499 INFO:tasks.workunit.client.0.smithi081.stdout:agetty 1226 root txt unknown /proc/1226/exe (readlink: Permission denied) 2024-09-12T01:30:25.499 INFO:tasks.workunit.client.0.smithi081.stdout:agetty 1226 root NOFD /proc/1226/fd (opendir: Permission denied) 2024-09-12T01:30:25.499 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu cwd DIR 8,1 4096 2 / 2024-09-12T01:30:25.499 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T01:30:25.500 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu txt REG 8,1 98208 22394 /usr/lib/systemd/systemd 2024-09-12T01:30:25.500 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu DEL REG 8,1 2229 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-09-12T01:30:25.500 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-12T01:30:25.500 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 912440 11215 /usr/lib64/libm.so.6 2024-09-12T01:30:25.500 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 882376 11287 /usr/lib64/libzstd.so.1.5.1 2024-09-12T01:30:25.500 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu DEL REG 8,1 11595 /usr/lib64/libcrypto.so.3.2.2 2024-09-12T01:30:25.500 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 1714208 11376 /usr/lib64/libp11-kit.so.0.3.1 2024-09-12T01:30:25.500 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 1304864 11471 /usr/lib64/libgcrypt.so.20.4.0 2024-09-12T01:30:25.500 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T01:30:25.500 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu DEL REG 8,1 2232 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-09-12T01:30:25.500 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 44784 11373 /usr/lib64/libffi.so.8.1.0 2024-09-12T01:30:25.500 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 153600 11397 /usr/lib64/libgpg-error.so.0.32.0 2024-09-12T01:30:25.500 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 28552 11392 /usr/lib64/libattr.so.1.1.2501 2024-09-12T01:30:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-12T01:30:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 32528 11311 /usr/lib64/libcap-ng.so.0.0.0 2024-09-12T01:30:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 40520 12544 /usr/lib64/libeconf.so.0.4.1 2024-09-12T01:30:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 178728 11282 /usr/lib64/liblzma.so.5.2.5 2024-09-12T01:30:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 144120 11455 /usr/lib64/liblz4.so.1.9.3 2024-09-12T01:30:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 201808 11284 /usr/lib64/libcrypt.so.2.0.0 2024-09-12T01:30:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 36296 11290 /usr/lib64/libcap.so.2.48 2024-09-12T01:30:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 229424 11714 /usr/lib64/libblkid.so.1.1.0 2024-09-12T01:30:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 291496 11744 /usr/lib64/libmount.so.1.1.0 2024-09-12T01:30:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-12T01:30:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 107528 11768 /usr/lib64/libkmod.so.2.3.6 2024-09-12T01:30:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 3826840 50305 /usr/lib64/systemd/libsystemd-shared-252.so 2024-09-12T01:30:25.501 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 40496 11393 /usr/lib64/libacl.so.1.1.2301 2024-09-12T01:30:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 163464 11315 /usr/lib64/libaudit.so.1.0.0 2024-09-12T01:30:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 127680 11560 /usr/lib64/libseccomp.so.2.5.2 2024-09-12T01:30:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 2162040 50302 /usr/lib64/systemd/libsystemd-core-252.so 2024-09-12T01:30:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 69592 12553 /usr/lib64/libpam.so.0.85.1 2024-09-12T01:30:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 108136 14698 /usr/lib64/libgcc_s-11-20240719.so.1 2024-09-12T01:30:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-09-12T01:30:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T01:30:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-09-12T01:30:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 1u unix 0x0000000000000000 0t0 24879 type=STREAM (CONNECTED) 2024-09-12T01:30:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 2u unix 0x0000000000000000 0t0 24879 type=STREAM (CONNECTED) 2024-09-12T01:30:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 3u unix 0x0000000000000000 0t0 24907 type=DGRAM (CONNECTED) 2024-09-12T01:30:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 4u a_inode 0,14 0 2055 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-09-12T01:30:25.502 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 5u a_inode 0,14 0 2055 [signalfd] 2024-09-12T01:30:25.503 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 6r a_inode 0,14 0 2055 inotify 2024-09-12T01:30:25.503 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 7r DIR 0,25 0 3417 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-09-12T01:30:25.503 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 8u a_inode 0,14 0 2055 [timerfd] 2024-09-12T01:30:25.503 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 9u a_inode 0,14 0 2055 [eventpoll:10,13] 2024-09-12T01:30:25.503 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 10r REG 0,20 0 24896 /proc/3352/mountinfo 2024-09-12T01:30:25.503 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 11r a_inode 0,14 0 2055 inotify 2024-09-12T01:30:25.503 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 12u unix 0x0000000000000000 0t0 22450 /run/user/1000/bus type=STREAM (LISTEN) 2024-09-12T01:30:25.503 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 13r a_inode 0,14 0 2055 inotify 2024-09-12T01:30:25.503 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 14r REG 0,20 0 4026532068 /proc/swaps 2024-09-12T01:30:25.503 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 15u netlink 0t0 24917 KOBJECT_UEVENT 2024-09-12T01:30:25.503 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 16u unix 0x0000000000000000 0t0 24922 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-09-12T01:30:25.503 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 17u unix 0x0000000000000000 0t0 24923 type=DGRAM (CONNECTED) 2024-09-12T01:30:25.504 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 18u unix 0x0000000000000000 0t0 24924 type=DGRAM (CONNECTED) 2024-09-12T01:30:25.504 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 19u unix 0x0000000000000000 0t0 24925 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-09-12T01:30:25.504 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 20u unix 0x0000000000000000 0t0 24927 type=STREAM (CONNECTED) 2024-09-12T01:30:25.504 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 3352 ubuntu 21u a_inode 0,14 0 2055 [timerfd] 2024-09-12T01:30:25.504 INFO:tasks.workunit.client.0.smithi081.stdout:(sd-pam) 3359 ubuntu cwd unknown /proc/3359/cwd (readlink: Permission denied) 2024-09-12T01:30:25.504 INFO:tasks.workunit.client.0.smithi081.stdout:(sd-pam) 3359 ubuntu rtd unknown /proc/3359/root (readlink: Permission denied) 2024-09-12T01:30:25.504 INFO:tasks.workunit.client.0.smithi081.stdout:(sd-pam) 3359 ubuntu txt unknown /proc/3359/exe (readlink: Permission denied) 2024-09-12T01:30:25.504 INFO:tasks.workunit.client.0.smithi081.stdout:(sd-pam) 3359 ubuntu NOFD /proc/3359/fd (opendir: Permission denied) 2024-09-12T01:30:25.504 INFO:tasks.workunit.client.0.smithi081.stdout:rsyslogd 4982 root cwd unknown /proc/4982/cwd (readlink: Permission denied) 2024-09-12T01:30:25.504 INFO:tasks.workunit.client.0.smithi081.stdout:rsyslogd 4982 root rtd unknown /proc/4982/root (readlink: Permission denied) 2024-09-12T01:30:25.504 INFO:tasks.workunit.client.0.smithi081.stdout:rsyslogd 4982 root txt unknown /proc/4982/exe (readlink: Permission denied) 2024-09-12T01:30:25.504 INFO:tasks.workunit.client.0.smithi081.stdout:rsyslogd 4982 root NOFD /proc/4982/fd (opendir: Permission denied) 2024-09-12T01:30:25.504 INFO:tasks.workunit.client.0.smithi081.stdout:rsyslogd 4982 4984 in:imjour root cwd unknown /proc/4982/task/4984/cwd (readlink: Permission denied) 2024-09-12T01:30:25.505 INFO:tasks.workunit.client.0.smithi081.stdout:rsyslogd 4982 4984 in:imjour root rtd unknown /proc/4982/task/4984/root (readlink: Permission denied) 2024-09-12T01:30:25.505 INFO:tasks.workunit.client.0.smithi081.stdout:rsyslogd 4982 4984 in:imjour root txt unknown /proc/4982/task/4984/exe (readlink: Permission denied) 2024-09-12T01:30:25.505 INFO:tasks.workunit.client.0.smithi081.stdout:rsyslogd 4982 4984 in:imjour root NOFD /proc/4982/task/4984/fd (opendir: Permission denied) 2024-09-12T01:30:25.505 INFO:tasks.workunit.client.0.smithi081.stdout:rsyslogd 4982 4985 rs:main root cwd unknown /proc/4982/task/4985/cwd (readlink: Permission denied) 2024-09-12T01:30:25.505 INFO:tasks.workunit.client.0.smithi081.stdout:rsyslogd 4982 4985 rs:main root rtd unknown /proc/4982/task/4985/root (readlink: Permission denied) 2024-09-12T01:30:25.505 INFO:tasks.workunit.client.0.smithi081.stdout:rsyslogd 4982 4985 rs:main root txt unknown /proc/4982/task/4985/exe (readlink: Permission denied) 2024-09-12T01:30:25.505 INFO:tasks.workunit.client.0.smithi081.stdout:rsyslogd 4982 4985 rs:main root NOFD /proc/4982/task/4985/fd (opendir: Permission denied) 2024-09-12T01:30:25.505 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 18640 root cwd unknown /proc/18640/cwd (readlink: Permission denied) 2024-09-12T01:30:25.505 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 18640 root rtd unknown /proc/18640/root (readlink: Permission denied) 2024-09-12T01:30:25.505 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 18640 root txt unknown /proc/18640/exe (readlink: Permission denied) 2024-09-12T01:30:25.505 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 18640 root NOFD /proc/18640/fd (opendir: Permission denied) 2024-09-12T01:30:25.505 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 polkitd cwd unknown /proc/19203/cwd (readlink: Permission denied) 2024-09-12T01:30:25.505 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 polkitd rtd unknown /proc/19203/root (readlink: Permission denied) 2024-09-12T01:30:25.506 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 polkitd txt unknown /proc/19203/exe (readlink: Permission denied) 2024-09-12T01:30:25.506 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 polkitd NOFD /proc/19203/fd (opendir: Permission denied) 2024-09-12T01:30:25.506 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19205 gmain polkitd cwd unknown /proc/19203/task/19205/cwd (readlink: Permission denied) 2024-09-12T01:30:25.506 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19205 gmain polkitd rtd unknown /proc/19203/task/19205/root (readlink: Permission denied) 2024-09-12T01:30:25.506 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19205 gmain polkitd txt unknown /proc/19203/task/19205/exe (readlink: Permission denied) 2024-09-12T01:30:25.506 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19205 gmain polkitd NOFD /proc/19203/task/19205/fd (opendir: Permission denied) 2024-09-12T01:30:25.506 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19206 gdbus polkitd cwd unknown /proc/19203/task/19206/cwd (readlink: Permission denied) 2024-09-12T01:30:25.506 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19206 gdbus polkitd rtd unknown /proc/19203/task/19206/root (readlink: Permission denied) 2024-09-12T01:30:25.506 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19206 gdbus polkitd txt unknown /proc/19203/task/19206/exe (readlink: Permission denied) 2024-09-12T01:30:25.506 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19206 gdbus polkitd NOFD /proc/19203/task/19206/fd (opendir: Permission denied) 2024-09-12T01:30:25.506 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19207 JS\x20Hel polkitd cwd unknown /proc/19203/task/19207/cwd (readlink: Permission denied) 2024-09-12T01:30:25.506 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19207 JS\x20Hel polkitd rtd unknown /proc/19203/task/19207/root (readlink: Permission denied) 2024-09-12T01:30:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19207 JS\x20Hel polkitd txt unknown /proc/19203/task/19207/exe (readlink: Permission denied) 2024-09-12T01:30:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19207 JS\x20Hel polkitd NOFD /proc/19203/task/19207/fd (opendir: Permission denied) 2024-09-12T01:30:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19208 JS\x20Hel polkitd cwd unknown /proc/19203/task/19208/cwd (readlink: Permission denied) 2024-09-12T01:30:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19208 JS\x20Hel polkitd rtd unknown /proc/19203/task/19208/root (readlink: Permission denied) 2024-09-12T01:30:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19208 JS\x20Hel polkitd txt unknown /proc/19203/task/19208/exe (readlink: Permission denied) 2024-09-12T01:30:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19208 JS\x20Hel polkitd NOFD /proc/19203/task/19208/fd (opendir: Permission denied) 2024-09-12T01:30:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19209 JS\x20Hel polkitd cwd unknown /proc/19203/task/19209/cwd (readlink: Permission denied) 2024-09-12T01:30:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19209 JS\x20Hel polkitd rtd unknown /proc/19203/task/19209/root (readlink: Permission denied) 2024-09-12T01:30:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19209 JS\x20Hel polkitd txt unknown /proc/19203/task/19209/exe (readlink: Permission denied) 2024-09-12T01:30:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19209 JS\x20Hel polkitd NOFD /proc/19203/task/19209/fd (opendir: Permission denied) 2024-09-12T01:30:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19210 JS\x20Hel polkitd cwd unknown /proc/19203/task/19210/cwd (readlink: Permission denied) 2024-09-12T01:30:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19210 JS\x20Hel polkitd rtd unknown /proc/19203/task/19210/root (readlink: Permission denied) 2024-09-12T01:30:25.507 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19210 JS\x20Hel polkitd txt unknown /proc/19203/task/19210/exe (readlink: Permission denied) 2024-09-12T01:30:25.508 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19210 JS\x20Hel polkitd NOFD /proc/19203/task/19210/fd (opendir: Permission denied) 2024-09-12T01:30:25.508 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19211 JS\x20Hel polkitd cwd unknown /proc/19203/task/19211/cwd (readlink: Permission denied) 2024-09-12T01:30:25.508 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19211 JS\x20Hel polkitd rtd unknown /proc/19203/task/19211/root (readlink: Permission denied) 2024-09-12T01:30:25.508 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19211 JS\x20Hel polkitd txt unknown /proc/19203/task/19211/exe (readlink: Permission denied) 2024-09-12T01:30:25.508 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19211 JS\x20Hel polkitd NOFD /proc/19203/task/19211/fd (opendir: Permission denied) 2024-09-12T01:30:25.508 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19212 JS\x20Hel polkitd cwd unknown /proc/19203/task/19212/cwd (readlink: Permission denied) 2024-09-12T01:30:25.508 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19212 JS\x20Hel polkitd rtd unknown /proc/19203/task/19212/root (readlink: Permission denied) 2024-09-12T01:30:25.508 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19212 JS\x20Hel polkitd txt unknown /proc/19203/task/19212/exe (readlink: Permission denied) 2024-09-12T01:30:25.508 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19212 JS\x20Hel polkitd NOFD /proc/19203/task/19212/fd (opendir: Permission denied) 2024-09-12T01:30:25.508 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19213 JS\x20Hel polkitd cwd unknown /proc/19203/task/19213/cwd (readlink: Permission denied) 2024-09-12T01:30:25.508 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19213 JS\x20Hel polkitd rtd unknown /proc/19203/task/19213/root (readlink: Permission denied) 2024-09-12T01:30:25.508 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19213 JS\x20Hel polkitd txt unknown /proc/19203/task/19213/exe (readlink: Permission denied) 2024-09-12T01:30:25.508 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19213 JS\x20Hel polkitd NOFD /proc/19203/task/19213/fd (opendir: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19214 JS\x20Hel polkitd cwd unknown /proc/19203/task/19214/cwd (readlink: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19214 JS\x20Hel polkitd rtd unknown /proc/19203/task/19214/root (readlink: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19214 JS\x20Hel polkitd txt unknown /proc/19203/task/19214/exe (readlink: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19214 JS\x20Hel polkitd NOFD /proc/19203/task/19214/fd (opendir: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19215 polkitd polkitd cwd unknown /proc/19203/task/19215/cwd (readlink: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19215 polkitd polkitd rtd unknown /proc/19203/task/19215/root (readlink: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19215 polkitd polkitd txt unknown /proc/19203/task/19215/exe (readlink: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:polkitd 19203 19215 polkitd polkitd NOFD /proc/19203/task/19215/fd (opendir: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21110 root cwd unknown /proc/21110/cwd (readlink: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21110 root rtd unknown /proc/21110/root (readlink: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21110 root txt unknown /proc/21110/exe (readlink: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21110 root NOFD /proc/21110/fd (opendir: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21139 root cwd unknown /proc/21139/cwd (readlink: Permission denied) 2024-09-12T01:30:25.509 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21139 root rtd unknown /proc/21139/root (readlink: Permission denied) 2024-09-12T01:30:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21139 root txt unknown /proc/21139/exe (readlink: Permission denied) 2024-09-12T01:30:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21139 root NOFD /proc/21139/fd (opendir: Permission denied) 2024-09-12T01:30:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21168 root cwd unknown /proc/21168/cwd (readlink: Permission denied) 2024-09-12T01:30:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21168 root rtd unknown /proc/21168/root (readlink: Permission denied) 2024-09-12T01:30:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21168 root txt unknown /proc/21168/exe (readlink: Permission denied) 2024-09-12T01:30:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21168 root NOFD /proc/21168/fd (opendir: Permission denied) 2024-09-12T01:30:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21197 root cwd unknown /proc/21197/cwd (readlink: Permission denied) 2024-09-12T01:30:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21197 root rtd unknown /proc/21197/root (readlink: Permission denied) 2024-09-12T01:30:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21197 root txt unknown /proc/21197/exe (readlink: Permission denied) 2024-09-12T01:30:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21197 root NOFD /proc/21197/fd (opendir: Permission denied) 2024-09-12T01:30:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21226 root cwd unknown /proc/21226/cwd (readlink: Permission denied) 2024-09-12T01:30:25.510 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21226 root rtd unknown /proc/21226/root (readlink: Permission denied) 2024-09-12T01:30:25.511 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21226 root txt unknown /proc/21226/exe (readlink: Permission denied) 2024-09-12T01:30:25.511 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21226 root NOFD /proc/21226/fd (opendir: Permission denied) 2024-09-12T01:30:25.511 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21390 root cwd unknown /proc/21390/cwd (readlink: Permission denied) 2024-09-12T01:30:25.511 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21390 root rtd unknown /proc/21390/root (readlink: Permission denied) 2024-09-12T01:30:25.511 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21390 root txt unknown /proc/21390/exe (readlink: Permission denied) 2024-09-12T01:30:25.511 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21390 root NOFD /proc/21390/fd (opendir: Permission denied) 2024-09-12T01:30:25.511 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21391 root cwd unknown /proc/21391/cwd (readlink: Permission denied) 2024-09-12T01:30:25.511 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21391 root rtd unknown /proc/21391/root (readlink: Permission denied) 2024-09-12T01:30:25.511 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21391 root txt unknown /proc/21391/exe (readlink: Permission denied) 2024-09-12T01:30:25.511 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21391 root NOFD /proc/21391/fd (opendir: Permission denied) 2024-09-12T01:30:25.511 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21392 root cwd unknown /proc/21392/cwd (readlink: Permission denied) 2024-09-12T01:30:25.511 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21392 root rtd unknown /proc/21392/root (readlink: Permission denied) 2024-09-12T01:30:25.512 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21392 root txt unknown /proc/21392/exe (readlink: Permission denied) 2024-09-12T01:30:25.512 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21392 root NOFD /proc/21392/fd (opendir: Permission denied) 2024-09-12T01:30:25.512 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21393 root cwd unknown /proc/21393/cwd (readlink: Permission denied) 2024-09-12T01:30:25.512 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21393 root rtd unknown /proc/21393/root (readlink: Permission denied) 2024-09-12T01:30:25.512 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21393 root txt unknown /proc/21393/exe (readlink: Permission denied) 2024-09-12T01:30:25.512 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21393 root NOFD /proc/21393/fd (opendir: Permission denied) 2024-09-12T01:30:25.512 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21394 root cwd unknown /proc/21394/cwd (readlink: Permission denied) 2024-09-12T01:30:25.513 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21394 root rtd unknown /proc/21394/root (readlink: Permission denied) 2024-09-12T01:30:25.513 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21394 root txt unknown /proc/21394/exe (readlink: Permission denied) 2024-09-12T01:30:25.513 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21394 root NOFD /proc/21394/fd (opendir: Permission denied) 2024-09-12T01:30:25.513 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21395 root cwd unknown /proc/21395/cwd (readlink: Permission denied) 2024-09-12T01:30:25.513 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21395 root rtd unknown /proc/21395/root (readlink: Permission denied) 2024-09-12T01:30:25.513 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21395 root txt unknown /proc/21395/exe (readlink: Permission denied) 2024-09-12T01:30:25.513 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21395 root NOFD /proc/21395/fd (opendir: Permission denied) 2024-09-12T01:30:25.513 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21396 root cwd unknown /proc/21396/cwd (readlink: Permission denied) 2024-09-12T01:30:25.514 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21396 root rtd unknown /proc/21396/root (readlink: Permission denied) 2024-09-12T01:30:25.514 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21396 root txt unknown /proc/21396/exe (readlink: Permission denied) 2024-09-12T01:30:25.514 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21396 root NOFD /proc/21396/fd (opendir: Permission denied) 2024-09-12T01:30:25.514 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21397 root cwd unknown /proc/21397/cwd (readlink: Permission denied) 2024-09-12T01:30:25.514 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21397 root rtd unknown /proc/21397/root (readlink: Permission denied) 2024-09-12T01:30:25.514 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21397 root txt unknown /proc/21397/exe (readlink: Permission denied) 2024-09-12T01:30:25.514 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21397 root NOFD /proc/21397/fd (opendir: Permission denied) 2024-09-12T01:30:25.514 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21398 root cwd unknown /proc/21398/cwd (readlink: Permission denied) 2024-09-12T01:30:25.514 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21398 root rtd unknown /proc/21398/root (readlink: Permission denied) 2024-09-12T01:30:25.514 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21398 root txt unknown /proc/21398/exe (readlink: Permission denied) 2024-09-12T01:30:25.514 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 21398 root NOFD /proc/21398/fd (opendir: Permission denied) 2024-09-12T01:30:25.514 INFO:tasks.workunit.client.0.smithi081.stdout:xfsaild/d 21399 root cwd unknown /proc/21399/cwd (readlink: Permission denied) 2024-09-12T01:30:25.515 INFO:tasks.workunit.client.0.smithi081.stdout:xfsaild/d 21399 root rtd unknown /proc/21399/root (readlink: Permission denied) 2024-09-12T01:30:25.515 INFO:tasks.workunit.client.0.smithi081.stdout:xfsaild/d 21399 root txt unknown /proc/21399/exe (readlink: Permission denied) 2024-09-12T01:30:25.515 INFO:tasks.workunit.client.0.smithi081.stdout:xfsaild/d 21399 root NOFD /proc/21399/fd (opendir: Permission denied) 2024-09-12T01:30:25.515 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 22319 root cwd unknown /proc/22319/cwd (readlink: Permission denied) 2024-09-12T01:30:25.515 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 22319 root rtd unknown /proc/22319/root (readlink: Permission denied) 2024-09-12T01:30:25.515 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 22319 root txt unknown /proc/22319/exe (readlink: Permission denied) 2024-09-12T01:30:25.515 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 22319 root NOFD /proc/22319/fd (opendir: Permission denied) 2024-09-12T01:30:25.515 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 22322 ubuntu cwd unknown /proc/22322/cwd (readlink: Permission denied) 2024-09-12T01:30:25.515 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 22322 ubuntu rtd unknown /proc/22322/root (readlink: Permission denied) 2024-09-12T01:30:25.515 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 22322 ubuntu txt unknown /proc/22322/exe (readlink: Permission denied) 2024-09-12T01:30:25.515 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 22322 ubuntu NOFD /proc/22322/fd (opendir: Permission denied) 2024-09-12T01:30:25.515 INFO:tasks.workunit.client.0.smithi081.stdout:chronyd 22382 chrony cwd unknown /proc/22382/cwd (readlink: Permission denied) 2024-09-12T01:30:25.516 INFO:tasks.workunit.client.0.smithi081.stdout:chronyd 22382 chrony rtd unknown /proc/22382/root (readlink: Permission denied) 2024-09-12T01:30:25.516 INFO:tasks.workunit.client.0.smithi081.stdout:chronyd 22382 chrony txt unknown /proc/22382/exe (readlink: Permission denied) 2024-09-12T01:30:25.516 INFO:tasks.workunit.client.0.smithi081.stdout:chronyd 22382 chrony NOFD /proc/22382/fd (opendir: Permission denied) 2024-09-12T01:30:25.516 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 22669 root cwd unknown /proc/22669/cwd (readlink: Permission denied) 2024-09-12T01:30:25.516 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 22669 root rtd unknown /proc/22669/root (readlink: Permission denied) 2024-09-12T01:30:25.516 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 22669 root txt unknown /proc/22669/exe (readlink: Permission denied) 2024-09-12T01:30:25.516 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 22669 root NOFD /proc/22669/fd (opendir: Permission denied) 2024-09-12T01:30:25.516 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-cras 22693 ceph cwd unknown /proc/22693/cwd (readlink: Permission denied) 2024-09-12T01:30:25.516 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-cras 22693 ceph rtd unknown /proc/22693/root (readlink: Permission denied) 2024-09-12T01:30:25.516 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-cras 22693 ceph txt unknown /proc/22693/exe (readlink: Permission denied) 2024-09-12T01:30:25.516 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-cras 22693 ceph NOFD /proc/22693/fd (opendir: Permission denied) 2024-09-12T01:30:25.516 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 24199 root cwd unknown /proc/24199/cwd (readlink: Permission denied) 2024-09-12T01:30:25.517 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 24199 root rtd unknown /proc/24199/root (readlink: Permission denied) 2024-09-12T01:30:25.517 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 24199 root txt unknown /proc/24199/exe (readlink: Permission denied) 2024-09-12T01:30:25.517 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 24199 root NOFD /proc/24199/fd (opendir: Permission denied) 2024-09-12T01:30:25.517 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 24200 root cwd unknown /proc/24200/cwd (readlink: Permission denied) 2024-09-12T01:30:25.517 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 24200 root rtd unknown /proc/24200/root (readlink: Permission denied) 2024-09-12T01:30:25.517 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 24200 root txt unknown /proc/24200/exe (readlink: Permission denied) 2024-09-12T01:30:25.517 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 24200 root NOFD /proc/24200/fd (opendir: Permission denied) 2024-09-12T01:30:25.517 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 29771 root cwd unknown /proc/29771/cwd (readlink: Permission denied) 2024-09-12T01:30:25.517 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 29771 root rtd unknown /proc/29771/root (readlink: Permission denied) 2024-09-12T01:30:25.517 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 29771 root txt unknown /proc/29771/exe (readlink: Permission denied) 2024-09-12T01:30:25.517 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 29771 root NOFD /proc/29771/fd (opendir: Permission denied) 2024-09-12T01:30:25.517 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 29907 root cwd unknown /proc/29907/cwd (readlink: Permission denied) 2024-09-12T01:30:25.517 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 29907 root rtd unknown /proc/29907/root (readlink: Permission denied) 2024-09-12T01:30:25.518 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 29907 root txt unknown /proc/29907/exe (readlink: Permission denied) 2024-09-12T01:30:25.518 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 29907 root NOFD /proc/29907/fd (opendir: Permission denied) 2024-09-12T01:30:25.518 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 29924 root cwd unknown /proc/29924/cwd (readlink: Permission denied) 2024-09-12T01:30:25.518 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 29924 root rtd unknown /proc/29924/root (readlink: Permission denied) 2024-09-12T01:30:25.518 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 29924 root txt unknown /proc/29924/exe (readlink: Permission denied) 2024-09-12T01:30:25.518 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 29924 root NOFD /proc/29924/fd (opendir: Permission denied) 2024-09-12T01:30:25.518 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 29925 root cwd unknown /proc/29925/cwd (readlink: Permission denied) 2024-09-12T01:30:25.518 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 29925 root rtd unknown /proc/29925/root (readlink: Permission denied) 2024-09-12T01:30:25.518 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 29925 root txt unknown /proc/29925/exe (readlink: Permission denied) 2024-09-12T01:30:25.519 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 29925 root NOFD /proc/29925/fd (opendir: Permission denied) 2024-09-12T01:30:25.519 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 29942 root cwd unknown /proc/29942/cwd (readlink: Permission denied) 2024-09-12T01:30:25.519 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 29942 root rtd unknown /proc/29942/root (readlink: Permission denied) 2024-09-12T01:30:25.519 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 29942 root txt unknown /proc/29942/exe (readlink: Permission denied) 2024-09-12T01:30:25.519 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 29942 root NOFD /proc/29942/fd (opendir: Permission denied) 2024-09-12T01:30:25.519 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 30749 root cwd unknown /proc/30749/cwd (readlink: Permission denied) 2024-09-12T01:30:25.519 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 30749 root rtd unknown /proc/30749/root (readlink: Permission denied) 2024-09-12T01:30:25.519 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 30749 root txt unknown /proc/30749/exe (readlink: Permission denied) 2024-09-12T01:30:25.519 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 30749 root NOFD /proc/30749/fd (opendir: Permission denied) 2024-09-12T01:30:25.519 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 30809 root cwd unknown /proc/30809/cwd (readlink: Permission denied) 2024-09-12T01:30:25.519 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 30809 root rtd unknown /proc/30809/root (readlink: Permission denied) 2024-09-12T01:30:25.519 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 30809 root txt unknown /proc/30809/exe (readlink: Permission denied) 2024-09-12T01:30:25.520 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 30809 root NOFD /proc/30809/fd (opendir: Permission denied) 2024-09-12T01:30:25.520 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 30915 root cwd unknown /proc/30915/cwd (readlink: Permission denied) 2024-09-12T01:30:25.520 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 30915 root rtd unknown /proc/30915/root (readlink: Permission denied) 2024-09-12T01:30:25.520 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 30915 root txt unknown /proc/30915/exe (readlink: Permission denied) 2024-09-12T01:30:25.520 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 30915 root NOFD /proc/30915/fd (opendir: Permission denied) 2024-09-12T01:30:25.520 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 30917 root cwd unknown /proc/30917/cwd (readlink: Permission denied) 2024-09-12T01:30:25.520 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 30917 root rtd unknown /proc/30917/root (readlink: Permission denied) 2024-09-12T01:30:25.520 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 30917 root txt unknown /proc/30917/exe (readlink: Permission denied) 2024-09-12T01:30:25.520 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 30917 root NOFD /proc/30917/fd (opendir: Permission denied) 2024-09-12T01:30:25.520 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 ceph cwd unknown /proc/30920/cwd (readlink: Permission denied) 2024-09-12T01:30:25.520 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 ceph rtd unknown /proc/30920/root (readlink: Permission denied) 2024-09-12T01:30:25.520 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 ceph txt unknown /proc/30920/exe (readlink: Permission denied) 2024-09-12T01:30:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 ceph NOFD /proc/30920/fd (opendir: Permission denied) 2024-09-12T01:30:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30921 log ceph cwd unknown /proc/30920/task/30921/cwd (readlink: Permission denied) 2024-09-12T01:30:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30921 log ceph rtd unknown /proc/30920/task/30921/root (readlink: Permission denied) 2024-09-12T01:30:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30921 log ceph txt unknown /proc/30920/task/30921/exe (readlink: Permission denied) 2024-09-12T01:30:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30921 log ceph NOFD /proc/30920/task/30921/fd (opendir: Permission denied) 2024-09-12T01:30:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30922 service ceph cwd unknown /proc/30920/task/30922/cwd (readlink: Permission denied) 2024-09-12T01:30:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30922 service ceph rtd unknown /proc/30920/task/30922/root (readlink: Permission denied) 2024-09-12T01:30:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30922 service ceph txt unknown /proc/30920/task/30922/exe (readlink: Permission denied) 2024-09-12T01:30:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30922 service ceph NOFD /proc/30920/task/30922/fd (opendir: Permission denied) 2024-09-12T01:30:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30923 admin_soc ceph cwd unknown /proc/30920/task/30923/cwd (readlink: Permission denied) 2024-09-12T01:30:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30923 admin_soc ceph rtd unknown /proc/30920/task/30923/root (readlink: Permission denied) 2024-09-12T01:30:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30923 admin_soc ceph txt unknown /proc/30920/task/30923/exe (readlink: Permission denied) 2024-09-12T01:30:25.521 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30923 admin_soc ceph NOFD /proc/30920/task/30923/fd (opendir: Permission denied) 2024-09-12T01:30:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30924 signal_ha ceph cwd unknown /proc/30920/task/30924/cwd (readlink: Permission denied) 2024-09-12T01:30:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30924 signal_ha ceph rtd unknown /proc/30920/task/30924/root (readlink: Permission denied) 2024-09-12T01:30:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30924 signal_ha ceph txt unknown /proc/30920/task/30924/exe (readlink: Permission denied) 2024-09-12T01:30:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30924 signal_ha ceph NOFD /proc/30920/task/30924/fd (opendir: Permission denied) 2024-09-12T01:30:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30925 rocksdb:l ceph cwd unknown /proc/30920/task/30925/cwd (readlink: Permission denied) 2024-09-12T01:30:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30925 rocksdb:l ceph rtd unknown /proc/30920/task/30925/root (readlink: Permission denied) 2024-09-12T01:30:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30925 rocksdb:l ceph txt unknown /proc/30920/task/30925/exe (readlink: Permission denied) 2024-09-12T01:30:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30925 rocksdb:l ceph NOFD /proc/30920/task/30925/fd (opendir: Permission denied) 2024-09-12T01:30:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30926 rocksdb:h ceph cwd unknown /proc/30920/task/30926/cwd (readlink: Permission denied) 2024-09-12T01:30:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30926 rocksdb:h ceph rtd unknown /proc/30920/task/30926/root (readlink: Permission denied) 2024-09-12T01:30:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30926 rocksdb:h ceph txt unknown /proc/30920/task/30926/exe (readlink: Permission denied) 2024-09-12T01:30:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30926 rocksdb:h ceph NOFD /proc/30920/task/30926/fd (opendir: Permission denied) 2024-09-12T01:30:25.522 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30942 ceph-mon ceph cwd unknown /proc/30920/task/30942/cwd (readlink: Permission denied) 2024-09-12T01:30:25.523 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30942 ceph-mon ceph rtd unknown /proc/30920/task/30942/root (readlink: Permission denied) 2024-09-12T01:30:25.523 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30942 ceph-mon ceph txt unknown /proc/30920/task/30942/exe (readlink: Permission denied) 2024-09-12T01:30:25.523 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30942 ceph-mon ceph NOFD /proc/30920/task/30942/fd (opendir: Permission denied) 2024-09-12T01:30:25.523 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30943 fn_monsto ceph cwd unknown /proc/30920/task/30943/cwd (readlink: Permission denied) 2024-09-12T01:30:25.523 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30943 fn_monsto ceph rtd unknown /proc/30920/task/30943/root (readlink: Permission denied) 2024-09-12T01:30:25.523 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30943 fn_monsto ceph txt unknown /proc/30920/task/30943/exe (readlink: Permission denied) 2024-09-12T01:30:25.523 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30943 fn_monsto ceph NOFD /proc/30920/task/30943/fd (opendir: Permission denied) 2024-09-12T01:30:25.523 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30944 msgr-work ceph cwd unknown /proc/30920/task/30944/cwd (readlink: Permission denied) 2024-09-12T01:30:25.523 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30944 msgr-work ceph rtd unknown /proc/30920/task/30944/root (readlink: Permission denied) 2024-09-12T01:30:25.523 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30944 msgr-work ceph txt unknown /proc/30920/task/30944/exe (readlink: Permission denied) 2024-09-12T01:30:25.523 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30944 msgr-work ceph NOFD /proc/30920/task/30944/fd (opendir: Permission denied) 2024-09-12T01:30:25.523 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30945 msgr-work ceph cwd unknown /proc/30920/task/30945/cwd (readlink: Permission denied) 2024-09-12T01:30:25.523 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30945 msgr-work ceph rtd unknown /proc/30920/task/30945/root (readlink: Permission denied) 2024-09-12T01:30:25.524 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30945 msgr-work ceph txt unknown /proc/30920/task/30945/exe (readlink: Permission denied) 2024-09-12T01:30:25.524 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30945 msgr-work ceph NOFD /proc/30920/task/30945/fd (opendir: Permission denied) 2024-09-12T01:30:25.524 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30946 msgr-work ceph cwd unknown /proc/30920/task/30946/cwd (readlink: Permission denied) 2024-09-12T01:30:25.524 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30946 msgr-work ceph rtd unknown /proc/30920/task/30946/root (readlink: Permission denied) 2024-09-12T01:30:25.524 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30946 msgr-work ceph txt unknown /proc/30920/task/30946/exe (readlink: Permission denied) 2024-09-12T01:30:25.524 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30946 msgr-work ceph NOFD /proc/30920/task/30946/fd (opendir: Permission denied) 2024-09-12T01:30:25.524 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30947 OpHistory ceph cwd unknown /proc/30920/task/30947/cwd (readlink: Permission denied) 2024-09-12T01:30:25.524 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30947 OpHistory ceph rtd unknown /proc/30920/task/30947/root (readlink: Permission denied) 2024-09-12T01:30:25.524 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30947 OpHistory ceph txt unknown /proc/30920/task/30947/exe (readlink: Permission denied) 2024-09-12T01:30:25.524 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30947 OpHistory ceph NOFD /proc/30920/task/30947/fd (opendir: Permission denied) 2024-09-12T01:30:25.524 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30948 fin ceph cwd unknown /proc/30920/task/30948/cwd (readlink: Permission denied) 2024-09-12T01:30:25.524 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30948 fin ceph rtd unknown /proc/30920/task/30948/root (readlink: Permission denied) 2024-09-12T01:30:25.525 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30948 fin ceph txt unknown /proc/30920/task/30948/exe (readlink: Permission denied) 2024-09-12T01:30:25.525 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30948 fin ceph NOFD /proc/30920/task/30948/fd (opendir: Permission denied) 2024-09-12T01:30:25.525 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30949 safe_time ceph cwd unknown /proc/30920/task/30949/cwd (readlink: Permission denied) 2024-09-12T01:30:25.525 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30949 safe_time ceph rtd unknown /proc/30920/task/30949/root (readlink: Permission denied) 2024-09-12T01:30:25.525 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30949 safe_time ceph txt unknown /proc/30920/task/30949/exe (readlink: Permission denied) 2024-09-12T01:30:25.525 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30949 safe_time ceph NOFD /proc/30920/task/30949/fd (opendir: Permission denied) 2024-09-12T01:30:25.525 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30950 cpu_tp ceph cwd unknown /proc/30920/task/30950/cwd (readlink: Permission denied) 2024-09-12T01:30:25.525 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30950 cpu_tp ceph rtd unknown /proc/30920/task/30950/root (readlink: Permission denied) 2024-09-12T01:30:25.525 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30950 cpu_tp ceph txt unknown /proc/30920/task/30950/exe (readlink: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30950 cpu_tp ceph NOFD /proc/30920/task/30950/fd (opendir: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30951 cpu_tp ceph cwd unknown /proc/30920/task/30951/cwd (readlink: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30951 cpu_tp ceph rtd unknown /proc/30920/task/30951/root (readlink: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30951 cpu_tp ceph txt unknown /proc/30920/task/30951/exe (readlink: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30951 cpu_tp ceph NOFD /proc/30920/task/30951/fd (opendir: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30952 cpu_tp ceph cwd unknown /proc/30920/task/30952/cwd (readlink: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30952 cpu_tp ceph rtd unknown /proc/30920/task/30952/root (readlink: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30952 cpu_tp ceph txt unknown /proc/30920/task/30952/exe (readlink: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30952 cpu_tp ceph NOFD /proc/30920/task/30952/fd (opendir: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30953 cpu_tp ceph cwd unknown /proc/30920/task/30953/cwd (readlink: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30953 cpu_tp ceph rtd unknown /proc/30920/task/30953/root (readlink: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30953 cpu_tp ceph txt unknown /proc/30920/task/30953/exe (readlink: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30953 cpu_tp ceph NOFD /proc/30920/task/30953/fd (opendir: Permission denied) 2024-09-12T01:30:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30954 ms_dispat ceph cwd unknown /proc/30920/task/30954/cwd (readlink: Permission denied) 2024-09-12T01:30:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30954 ms_dispat ceph rtd unknown /proc/30920/task/30954/root (readlink: Permission denied) 2024-09-12T01:30:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30954 ms_dispat ceph txt unknown /proc/30920/task/30954/exe (readlink: Permission denied) 2024-09-12T01:30:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30954 ms_dispat ceph NOFD /proc/30920/task/30954/fd (opendir: Permission denied) 2024-09-12T01:30:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30955 ms_local ceph cwd unknown /proc/30920/task/30955/cwd (readlink: Permission denied) 2024-09-12T01:30:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30955 ms_local ceph rtd unknown /proc/30920/task/30955/root (readlink: Permission denied) 2024-09-12T01:30:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30955 ms_local ceph txt unknown /proc/30920/task/30955/exe (readlink: Permission denied) 2024-09-12T01:30:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30955 ms_local ceph NOFD /proc/30920/task/30955/fd (opendir: Permission denied) 2024-09-12T01:30:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30956 safe_time ceph cwd unknown /proc/30920/task/30956/cwd (readlink: Permission denied) 2024-09-12T01:30:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30956 safe_time ceph rtd unknown /proc/30920/task/30956/root (readlink: Permission denied) 2024-09-12T01:30:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30956 safe_time ceph txt unknown /proc/30920/task/30956/exe (readlink: Permission denied) 2024-09-12T01:30:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30956 safe_time ceph NOFD /proc/30920/task/30956/fd (opendir: Permission denied) 2024-09-12T01:30:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30957 ms_dispat ceph cwd unknown /proc/30920/task/30957/cwd (readlink: Permission denied) 2024-09-12T01:30:25.527 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30957 ms_dispat ceph rtd unknown /proc/30920/task/30957/root (readlink: Permission denied) 2024-09-12T01:30:25.528 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30957 ms_dispat ceph txt unknown /proc/30920/task/30957/exe (readlink: Permission denied) 2024-09-12T01:30:25.528 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30957 ms_dispat ceph NOFD /proc/30920/task/30957/fd (opendir: Permission denied) 2024-09-12T01:30:25.528 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30958 ms_local ceph cwd unknown /proc/30920/task/30958/cwd (readlink: Permission denied) 2024-09-12T01:30:25.528 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30958 ms_local ceph rtd unknown /proc/30920/task/30958/root (readlink: Permission denied) 2024-09-12T01:30:25.528 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30958 ms_local ceph txt unknown /proc/30920/task/30958/exe (readlink: Permission denied) 2024-09-12T01:30:25.528 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 30958 ms_local ceph NOFD /proc/30920/task/30958/fd (opendir: Permission denied) 2024-09-12T01:30:25.528 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 69005 rstore_co ceph cwd unknown /proc/30920/task/69005/cwd (readlink: Permission denied) 2024-09-12T01:30:25.528 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 69005 rstore_co ceph rtd unknown /proc/30920/task/69005/root (readlink: Permission denied) 2024-09-12T01:30:25.528 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 69005 rstore_co ceph txt unknown /proc/30920/task/69005/exe (readlink: Permission denied) 2024-09-12T01:30:25.528 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mon 30920 69005 rstore_co ceph NOFD /proc/30920/task/69005/fd (opendir: Permission denied) 2024-09-12T01:30:25.528 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 31144 root cwd unknown /proc/31144/cwd (readlink: Permission denied) 2024-09-12T01:30:25.528 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 31144 root rtd unknown /proc/31144/root (readlink: Permission denied) 2024-09-12T01:30:25.529 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 31144 root txt unknown /proc/31144/exe (readlink: Permission denied) 2024-09-12T01:30:25.529 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 31144 root NOFD /proc/31144/fd (opendir: Permission denied) 2024-09-12T01:30:25.529 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 31146 root cwd unknown /proc/31146/cwd (readlink: Permission denied) 2024-09-12T01:30:25.529 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 31146 root rtd unknown /proc/31146/root (readlink: Permission denied) 2024-09-12T01:30:25.529 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 31146 root txt unknown /proc/31146/exe (readlink: Permission denied) 2024-09-12T01:30:25.529 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 31146 root NOFD /proc/31146/fd (opendir: Permission denied) 2024-09-12T01:30:25.529 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 ceph cwd unknown /proc/31148/cwd (readlink: Permission denied) 2024-09-12T01:30:25.529 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 ceph rtd unknown /proc/31148/root (readlink: Permission denied) 2024-09-12T01:30:25.529 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 ceph txt unknown /proc/31148/exe (readlink: Permission denied) 2024-09-12T01:30:25.529 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 ceph NOFD /proc/31148/fd (opendir: Permission denied) 2024-09-12T01:30:25.529 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82130 log ceph cwd unknown /proc/31148/task/82130/cwd (readlink: Permission denied) 2024-09-12T01:30:25.530 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82130 log ceph rtd unknown /proc/31148/task/82130/root (readlink: Permission denied) 2024-09-12T01:30:25.530 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82130 log ceph txt unknown /proc/31148/task/82130/exe (readlink: Permission denied) 2024-09-12T01:30:25.530 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82130 log ceph NOFD /proc/31148/task/82130/fd (opendir: Permission denied) 2024-09-12T01:30:25.530 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82134 msgr-work ceph cwd unknown /proc/31148/task/82134/cwd (readlink: Permission denied) 2024-09-12T01:30:25.530 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82134 msgr-work ceph rtd unknown /proc/31148/task/82134/root (readlink: Permission denied) 2024-09-12T01:30:25.530 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82134 msgr-work ceph txt unknown /proc/31148/task/82134/exe (readlink: Permission denied) 2024-09-12T01:30:25.530 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82134 msgr-work ceph NOFD /proc/31148/task/82134/fd (opendir: Permission denied) 2024-09-12T01:30:25.530 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82136 msgr-work ceph cwd unknown /proc/31148/task/82136/cwd (readlink: Permission denied) 2024-09-12T01:30:25.531 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82136 msgr-work ceph rtd unknown /proc/31148/task/82136/root (readlink: Permission denied) 2024-09-12T01:30:25.531 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82136 msgr-work ceph txt unknown /proc/31148/task/82136/exe (readlink: Permission denied) 2024-09-12T01:30:25.531 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82136 msgr-work ceph NOFD /proc/31148/task/82136/fd (opendir: Permission denied) 2024-09-12T01:30:25.531 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82137 msgr-work ceph cwd unknown /proc/31148/task/82137/cwd (readlink: Permission denied) 2024-09-12T01:30:25.531 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82137 msgr-work ceph rtd unknown /proc/31148/task/82137/root (readlink: Permission denied) 2024-09-12T01:30:25.531 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82137 msgr-work ceph txt unknown /proc/31148/task/82137/exe (readlink: Permission denied) 2024-09-12T01:30:25.531 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82137 msgr-work ceph NOFD /proc/31148/task/82137/fd (opendir: Permission denied) 2024-09-12T01:30:25.531 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82146 service ceph cwd unknown /proc/31148/task/82146/cwd (readlink: Permission denied) 2024-09-12T01:30:25.531 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82146 service ceph rtd unknown /proc/31148/task/82146/root (readlink: Permission denied) 2024-09-12T01:30:25.531 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82146 service ceph txt unknown /proc/31148/task/82146/exe (readlink: Permission denied) 2024-09-12T01:30:25.531 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82146 service ceph NOFD /proc/31148/task/82146/fd (opendir: Permission denied) 2024-09-12T01:30:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82147 admin_soc ceph cwd unknown /proc/31148/task/82147/cwd (readlink: Permission denied) 2024-09-12T01:30:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82147 admin_soc ceph rtd unknown /proc/31148/task/82147/root (readlink: Permission denied) 2024-09-12T01:30:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82147 admin_soc ceph txt unknown /proc/31148/task/82147/exe (readlink: Permission denied) 2024-09-12T01:30:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82147 admin_soc ceph NOFD /proc/31148/task/82147/fd (opendir: Permission denied) 2024-09-12T01:30:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82148 ceph_time ceph cwd unknown /proc/31148/task/82148/cwd (readlink: Permission denied) 2024-09-12T01:30:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82148 ceph_time ceph rtd unknown /proc/31148/task/82148/root (readlink: Permission denied) 2024-09-12T01:30:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82148 ceph_time ceph txt unknown /proc/31148/task/82148/exe (readlink: Permission denied) 2024-09-12T01:30:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82148 ceph_time ceph NOFD /proc/31148/task/82148/fd (opendir: Permission denied) 2024-09-12T01:30:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82149 fn_anonym ceph cwd unknown /proc/31148/task/82149/cwd (readlink: Permission denied) 2024-09-12T01:30:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82149 fn_anonym ceph rtd unknown /proc/31148/task/82149/root (readlink: Permission denied) 2024-09-12T01:30:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82149 fn_anonym ceph txt unknown /proc/31148/task/82149/exe (readlink: Permission denied) 2024-09-12T01:30:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82149 fn_anonym ceph NOFD /proc/31148/task/82149/fd (opendir: Permission denied) 2024-09-12T01:30:25.532 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82150 signal_ha ceph cwd unknown /proc/31148/task/82150/cwd (readlink: Permission denied) 2024-09-12T01:30:25.533 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82150 signal_ha ceph rtd unknown /proc/31148/task/82150/root (readlink: Permission denied) 2024-09-12T01:30:25.533 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82150 signal_ha ceph txt unknown /proc/31148/task/82150/exe (readlink: Permission denied) 2024-09-12T01:30:25.533 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82150 signal_ha ceph NOFD /proc/31148/task/82150/fd (opendir: Permission denied) 2024-09-12T01:30:25.533 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82151 mgrsb-fin ceph cwd unknown /proc/31148/task/82151/cwd (readlink: Permission denied) 2024-09-12T01:30:25.533 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82151 mgrsb-fin ceph rtd unknown /proc/31148/task/82151/root (readlink: Permission denied) 2024-09-12T01:30:25.533 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82151 mgrsb-fin ceph txt unknown /proc/31148/task/82151/exe (readlink: Permission denied) 2024-09-12T01:30:25.533 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82151 mgrsb-fin ceph NOFD /proc/31148/task/82151/fd (opendir: Permission denied) 2024-09-12T01:30:25.533 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82152 ms_dispat ceph cwd unknown /proc/31148/task/82152/cwd (readlink: Permission denied) 2024-09-12T01:30:25.533 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82152 ms_dispat ceph rtd unknown /proc/31148/task/82152/root (readlink: Permission denied) 2024-09-12T01:30:25.533 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82152 ms_dispat ceph txt unknown /proc/31148/task/82152/exe (readlink: Permission denied) 2024-09-12T01:30:25.533 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82152 ms_dispat ceph NOFD /proc/31148/task/82152/fd (opendir: Permission denied) 2024-09-12T01:30:25.533 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82153 ms_local ceph cwd unknown /proc/31148/task/82153/cwd (readlink: Permission denied) 2024-09-12T01:30:25.534 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82153 ms_local ceph rtd unknown /proc/31148/task/82153/root (readlink: Permission denied) 2024-09-12T01:30:25.534 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82153 ms_local ceph txt unknown /proc/31148/task/82153/exe (readlink: Permission denied) 2024-09-12T01:30:25.534 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82153 ms_local ceph NOFD /proc/31148/task/82153/fd (opendir: Permission denied) 2024-09-12T01:30:25.534 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82154 io_contex ceph cwd unknown /proc/31148/task/82154/cwd (readlink: Permission denied) 2024-09-12T01:30:25.534 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82154 io_contex ceph rtd unknown /proc/31148/task/82154/root (readlink: Permission denied) 2024-09-12T01:30:25.534 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82154 io_contex ceph txt unknown /proc/31148/task/82154/exe (readlink: Permission denied) 2024-09-12T01:30:25.534 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82154 io_contex ceph NOFD /proc/31148/task/82154/fd (opendir: Permission denied) 2024-09-12T01:30:25.534 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82155 io_contex ceph cwd unknown /proc/31148/task/82155/cwd (readlink: Permission denied) 2024-09-12T01:30:25.534 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82155 io_contex ceph rtd unknown /proc/31148/task/82155/root (readlink: Permission denied) 2024-09-12T01:30:25.534 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82155 io_contex ceph txt unknown /proc/31148/task/82155/exe (readlink: Permission denied) 2024-09-12T01:30:25.534 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82155 io_contex ceph NOFD /proc/31148/task/82155/fd (opendir: Permission denied) 2024-09-12T01:30:25.534 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82156 safe_time ceph cwd unknown /proc/31148/task/82156/cwd (readlink: Permission denied) 2024-09-12T01:30:25.534 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82156 safe_time ceph rtd unknown /proc/31148/task/82156/root (readlink: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82156 safe_time ceph txt unknown /proc/31148/task/82156/exe (readlink: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82156 safe_time ceph NOFD /proc/31148/task/82156/fd (opendir: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82157 safe_time ceph cwd unknown /proc/31148/task/82157/cwd (readlink: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82157 safe_time ceph rtd unknown /proc/31148/task/82157/root (readlink: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82157 safe_time ceph txt unknown /proc/31148/task/82157/exe (readlink: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82157 safe_time ceph NOFD /proc/31148/task/82157/fd (opendir: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82158 safe_time ceph cwd unknown /proc/31148/task/82158/cwd (readlink: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82158 safe_time ceph rtd unknown /proc/31148/task/82158/root (readlink: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82158 safe_time ceph txt unknown /proc/31148/task/82158/exe (readlink: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82158 safe_time ceph NOFD /proc/31148/task/82158/fd (opendir: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82159 fn_anonym ceph cwd unknown /proc/31148/task/82159/cwd (readlink: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82159 fn_anonym ceph rtd unknown /proc/31148/task/82159/root (readlink: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82159 fn_anonym ceph txt unknown /proc/31148/task/82159/exe (readlink: Permission denied) 2024-09-12T01:30:25.535 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82159 fn_anonym ceph NOFD /proc/31148/task/82159/fd (opendir: Permission denied) 2024-09-12T01:30:25.536 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82160 flusher ceph cwd unknown /proc/31148/task/82160/cwd (readlink: Permission denied) 2024-09-12T01:30:25.536 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82160 flusher ceph rtd unknown /proc/31148/task/82160/root (readlink: Permission denied) 2024-09-12T01:30:25.536 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82160 flusher ceph txt unknown /proc/31148/task/82160/exe (readlink: Permission denied) 2024-09-12T01:30:25.536 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82160 flusher ceph NOFD /proc/31148/task/82160/fd (opendir: Permission denied) 2024-09-12T01:30:25.536 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82161 safe_time ceph cwd unknown /proc/31148/task/82161/cwd (readlink: Permission denied) 2024-09-12T01:30:25.536 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82161 safe_time ceph rtd unknown /proc/31148/task/82161/root (readlink: Permission denied) 2024-09-12T01:30:25.536 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82161 safe_time ceph txt unknown /proc/31148/task/82161/exe (readlink: Permission denied) 2024-09-12T01:30:25.536 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82161 safe_time ceph NOFD /proc/31148/task/82161/fd (opendir: Permission denied) 2024-09-12T01:30:25.536 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82949 OpHistory ceph cwd unknown /proc/31148/task/82949/cwd (readlink: Permission denied) 2024-09-12T01:30:25.536 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82949 OpHistory ceph rtd unknown /proc/31148/task/82949/root (readlink: Permission denied) 2024-09-12T01:30:25.536 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82949 OpHistory ceph txt unknown /proc/31148/task/82949/exe (readlink: Permission denied) 2024-09-12T01:30:25.537 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82949 OpHistory ceph NOFD /proc/31148/task/82949/fd (opendir: Permission denied) 2024-09-12T01:30:25.537 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82950 mgr-fin ceph cwd unknown /proc/31148/task/82950/cwd (readlink: Permission denied) 2024-09-12T01:30:25.537 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82950 mgr-fin ceph rtd unknown /proc/31148/task/82950/root (readlink: Permission denied) 2024-09-12T01:30:25.537 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82950 mgr-fin ceph txt unknown /proc/31148/task/82950/exe (readlink: Permission denied) 2024-09-12T01:30:25.537 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82950 mgr-fin ceph NOFD /proc/31148/task/82950/fd (opendir: Permission denied) 2024-09-12T01:30:25.537 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82958 ms_dispat ceph cwd unknown /proc/31148/task/82958/cwd (readlink: Permission denied) 2024-09-12T01:30:25.538 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82958 ms_dispat ceph rtd unknown /proc/31148/task/82958/root (readlink: Permission denied) 2024-09-12T01:30:25.538 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82958 ms_dispat ceph txt unknown /proc/31148/task/82958/exe (readlink: Permission denied) 2024-09-12T01:30:25.538 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82958 ms_dispat ceph NOFD /proc/31148/task/82958/fd (opendir: Permission denied) 2024-09-12T01:30:25.538 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82959 ms_local ceph cwd unknown /proc/31148/task/82959/cwd (readlink: Permission denied) 2024-09-12T01:30:25.538 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82959 ms_local ceph rtd unknown /proc/31148/task/82959/root (readlink: Permission denied) 2024-09-12T01:30:25.538 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82959 ms_local ceph txt unknown /proc/31148/task/82959/exe (readlink: Permission denied) 2024-09-12T01:30:25.538 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82959 ms_local ceph NOFD /proc/31148/task/82959/fd (opendir: Permission denied) 2024-09-12T01:30:25.538 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82961 safe_time ceph cwd unknown /proc/31148/task/82961/cwd (readlink: Permission denied) 2024-09-12T01:30:25.539 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82961 safe_time ceph rtd unknown /proc/31148/task/82961/root (readlink: Permission denied) 2024-09-12T01:30:25.539 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82961 safe_time ceph txt unknown /proc/31148/task/82961/exe (readlink: Permission denied) 2024-09-12T01:30:25.539 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82961 safe_time ceph NOFD /proc/31148/task/82961/fd (opendir: Permission denied) 2024-09-12T01:30:25.539 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82964 cmdfin ceph cwd unknown /proc/31148/task/82964/cwd (readlink: Permission denied) 2024-09-12T01:30:25.539 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82964 cmdfin ceph rtd unknown /proc/31148/task/82964/root (readlink: Permission denied) 2024-09-12T01:30:25.539 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82964 cmdfin ceph txt unknown /proc/31148/task/82964/exe (readlink: Permission denied) 2024-09-12T01:30:25.539 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82964 cmdfin ceph NOFD /proc/31148/task/82964/fd (opendir: Permission denied) 2024-09-12T01:30:25.539 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82968 io_contex ceph cwd unknown /proc/31148/task/82968/cwd (readlink: Permission denied) 2024-09-12T01:30:25.539 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82968 io_contex ceph rtd unknown /proc/31148/task/82968/root (readlink: Permission denied) 2024-09-12T01:30:25.539 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82968 io_contex ceph txt unknown /proc/31148/task/82968/exe (readlink: Permission denied) 2024-09-12T01:30:25.539 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82968 io_contex ceph NOFD /proc/31148/task/82968/fd (opendir: Permission denied) 2024-09-12T01:30:25.539 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82969 io_contex ceph cwd unknown /proc/31148/task/82969/cwd (readlink: Permission denied) 2024-09-12T01:30:25.539 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82969 io_contex ceph rtd unknown /proc/31148/task/82969/root (readlink: Permission denied) 2024-09-12T01:30:25.540 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82969 io_contex ceph txt unknown /proc/31148/task/82969/exe (readlink: Permission denied) 2024-09-12T01:30:25.540 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82969 io_contex ceph NOFD /proc/31148/task/82969/fd (opendir: Permission denied) 2024-09-12T01:30:25.540 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82970 ceph_time ceph cwd unknown /proc/31148/task/82970/cwd (readlink: Permission denied) 2024-09-12T01:30:25.540 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82970 ceph_time ceph rtd unknown /proc/31148/task/82970/root (readlink: Permission denied) 2024-09-12T01:30:25.540 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82970 ceph_time ceph txt unknown /proc/31148/task/82970/exe (readlink: Permission denied) 2024-09-12T01:30:25.540 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82970 ceph_time ceph NOFD /proc/31148/task/82970/fd (opendir: Permission denied) 2024-09-12T01:30:25.540 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82971 ms_dispat ceph cwd unknown /proc/31148/task/82971/cwd (readlink: Permission denied) 2024-09-12T01:30:25.540 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82971 ms_dispat ceph rtd unknown /proc/31148/task/82971/root (readlink: Permission denied) 2024-09-12T01:30:25.540 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82971 ms_dispat ceph txt unknown /proc/31148/task/82971/exe (readlink: Permission denied) 2024-09-12T01:30:25.540 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82971 ms_dispat ceph NOFD /proc/31148/task/82971/fd (opendir: Permission denied) 2024-09-12T01:30:25.540 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82972 ms_local ceph cwd unknown /proc/31148/task/82972/cwd (readlink: Permission denied) 2024-09-12T01:30:25.540 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82972 ms_local ceph rtd unknown /proc/31148/task/82972/root (readlink: Permission denied) 2024-09-12T01:30:25.540 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82972 ms_local ceph txt unknown /proc/31148/task/82972/exe (readlink: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82972 ms_local ceph NOFD /proc/31148/task/82972/fd (opendir: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82973 safe_time ceph cwd unknown /proc/31148/task/82973/cwd (readlink: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82973 safe_time ceph rtd unknown /proc/31148/task/82973/root (readlink: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82973 safe_time ceph txt unknown /proc/31148/task/82973/exe (readlink: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82973 safe_time ceph NOFD /proc/31148/task/82973/fd (opendir: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82974 safe_time ceph cwd unknown /proc/31148/task/82974/cwd (readlink: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82974 safe_time ceph rtd unknown /proc/31148/task/82974/root (readlink: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82974 safe_time ceph txt unknown /proc/31148/task/82974/exe (readlink: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82974 safe_time ceph NOFD /proc/31148/task/82974/fd (opendir: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82975 balancer ceph cwd unknown /proc/31148/task/82975/cwd (readlink: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82975 balancer ceph rtd unknown /proc/31148/task/82975/root (readlink: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82975 balancer ceph txt unknown /proc/31148/task/82975/exe (readlink: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82975 balancer ceph NOFD /proc/31148/task/82975/fd (opendir: Permission denied) 2024-09-12T01:30:25.541 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82976 m-fin-bal ceph cwd unknown /proc/31148/task/82976/cwd (readlink: Permission denied) 2024-09-12T01:30:25.542 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82976 m-fin-bal ceph rtd unknown /proc/31148/task/82976/root (readlink: Permission denied) 2024-09-12T01:30:25.542 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82976 m-fin-bal ceph txt unknown /proc/31148/task/82976/exe (readlink: Permission denied) 2024-09-12T01:30:25.542 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82976 m-fin-bal ceph NOFD /proc/31148/task/82976/fd (opendir: Permission denied) 2024-09-12T01:30:25.542 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82979 mgr-fin ceph cwd unknown /proc/31148/task/82979/cwd (readlink: Permission denied) 2024-09-12T01:30:25.542 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82979 mgr-fin ceph rtd unknown /proc/31148/task/82979/root (readlink: Permission denied) 2024-09-12T01:30:25.542 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82979 mgr-fin ceph txt unknown /proc/31148/task/82979/exe (readlink: Permission denied) 2024-09-12T01:30:25.542 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82979 mgr-fin ceph NOFD /proc/31148/task/82979/fd (opendir: Permission denied) 2024-09-12T01:30:25.542 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82980 mgr-fin ceph cwd unknown /proc/31148/task/82980/cwd (readlink: Permission denied) 2024-09-12T01:30:25.542 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82980 mgr-fin ceph rtd unknown /proc/31148/task/82980/root (readlink: Permission denied) 2024-09-12T01:30:25.542 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82980 mgr-fin ceph txt unknown /proc/31148/task/82980/exe (readlink: Permission denied) 2024-09-12T01:30:25.542 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82980 mgr-fin ceph NOFD /proc/31148/task/82980/fd (opendir: Permission denied) 2024-09-12T01:30:25.542 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82981 mgr-fin ceph cwd unknown /proc/31148/task/82981/cwd (readlink: Permission denied) 2024-09-12T01:30:25.542 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82981 mgr-fin ceph rtd unknown /proc/31148/task/82981/root (readlink: Permission denied) 2024-09-12T01:30:25.543 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82981 mgr-fin ceph txt unknown /proc/31148/task/82981/exe (readlink: Permission denied) 2024-09-12T01:30:25.543 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82981 mgr-fin ceph NOFD /proc/31148/task/82981/fd (opendir: Permission denied) 2024-09-12T01:30:25.543 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82982 mgr-fin ceph cwd unknown /proc/31148/task/82982/cwd (readlink: Permission denied) 2024-09-12T01:30:25.543 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82982 mgr-fin ceph rtd unknown /proc/31148/task/82982/root (readlink: Permission denied) 2024-09-12T01:30:25.543 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82982 mgr-fin ceph txt unknown /proc/31148/task/82982/exe (readlink: Permission denied) 2024-09-12T01:30:25.543 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82982 mgr-fin ceph NOFD /proc/31148/task/82982/fd (opendir: Permission denied) 2024-09-12T01:30:25.543 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82983 mgr-fin ceph cwd unknown /proc/31148/task/82983/cwd (readlink: Permission denied) 2024-09-12T01:30:25.543 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82983 mgr-fin ceph rtd unknown /proc/31148/task/82983/root (readlink: Permission denied) 2024-09-12T01:30:25.543 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82983 mgr-fin ceph txt unknown /proc/31148/task/82983/exe (readlink: Permission denied) 2024-09-12T01:30:25.543 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82983 mgr-fin ceph NOFD /proc/31148/task/82983/fd (opendir: Permission denied) 2024-09-12T01:30:25.543 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82984 mgr-fin ceph cwd unknown /proc/31148/task/82984/cwd (readlink: Permission denied) 2024-09-12T01:30:25.544 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82984 mgr-fin ceph rtd unknown /proc/31148/task/82984/root (readlink: Permission denied) 2024-09-12T01:30:25.544 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82984 mgr-fin ceph txt unknown /proc/31148/task/82984/exe (readlink: Permission denied) 2024-09-12T01:30:25.544 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82984 mgr-fin ceph NOFD /proc/31148/task/82984/fd (opendir: Permission denied) 2024-09-12T01:30:25.544 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82985 mgr-fin ceph cwd unknown /proc/31148/task/82985/cwd (readlink: Permission denied) 2024-09-12T01:30:25.544 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82985 mgr-fin ceph rtd unknown /proc/31148/task/82985/root (readlink: Permission denied) 2024-09-12T01:30:25.544 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82985 mgr-fin ceph txt unknown /proc/31148/task/82985/exe (readlink: Permission denied) 2024-09-12T01:30:25.544 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82985 mgr-fin ceph NOFD /proc/31148/task/82985/fd (opendir: Permission denied) 2024-09-12T01:30:25.544 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82986 mgr-fin ceph cwd unknown /proc/31148/task/82986/cwd (readlink: Permission denied) 2024-09-12T01:30:25.544 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82986 mgr-fin ceph rtd unknown /proc/31148/task/82986/root (readlink: Permission denied) 2024-09-12T01:30:25.544 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82986 mgr-fin ceph txt unknown /proc/31148/task/82986/exe (readlink: Permission denied) 2024-09-12T01:30:25.544 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82986 mgr-fin ceph NOFD /proc/31148/task/82986/fd (opendir: Permission denied) 2024-09-12T01:30:25.544 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82987 mgr-fin ceph cwd unknown /proc/31148/task/82987/cwd (readlink: Permission denied) 2024-09-12T01:30:25.545 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82987 mgr-fin ceph rtd unknown /proc/31148/task/82987/root (readlink: Permission denied) 2024-09-12T01:30:25.545 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82987 mgr-fin ceph txt unknown /proc/31148/task/82987/exe (readlink: Permission denied) 2024-09-12T01:30:25.545 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82987 mgr-fin ceph NOFD /proc/31148/task/82987/fd (opendir: Permission denied) 2024-09-12T01:30:25.545 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82988 mgr-fin ceph cwd unknown /proc/31148/task/82988/cwd (readlink: Permission denied) 2024-09-12T01:30:25.545 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82988 mgr-fin ceph rtd unknown /proc/31148/task/82988/root (readlink: Permission denied) 2024-09-12T01:30:25.545 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82988 mgr-fin ceph txt unknown /proc/31148/task/82988/exe (readlink: Permission denied) 2024-09-12T01:30:25.545 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82988 mgr-fin ceph NOFD /proc/31148/task/82988/fd (opendir: Permission denied) 2024-09-12T01:30:25.545 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82989 mgr-fin ceph cwd unknown /proc/31148/task/82989/cwd (readlink: Permission denied) 2024-09-12T01:30:25.545 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82989 mgr-fin ceph rtd unknown /proc/31148/task/82989/root (readlink: Permission denied) 2024-09-12T01:30:25.545 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82989 mgr-fin ceph txt unknown /proc/31148/task/82989/exe (readlink: Permission denied) 2024-09-12T01:30:25.545 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82989 mgr-fin ceph NOFD /proc/31148/task/82989/fd (opendir: Permission denied) 2024-09-12T01:30:25.545 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82990 mgr-fin ceph cwd unknown /proc/31148/task/82990/cwd (readlink: Permission denied) 2024-09-12T01:30:25.545 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82990 mgr-fin ceph rtd unknown /proc/31148/task/82990/root (readlink: Permission denied) 2024-09-12T01:30:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82990 mgr-fin ceph txt unknown /proc/31148/task/82990/exe (readlink: Permission denied) 2024-09-12T01:30:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82990 mgr-fin ceph NOFD /proc/31148/task/82990/fd (opendir: Permission denied) 2024-09-12T01:30:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82991 mgr-fin ceph cwd unknown /proc/31148/task/82991/cwd (readlink: Permission denied) 2024-09-12T01:30:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82991 mgr-fin ceph rtd unknown /proc/31148/task/82991/root (readlink: Permission denied) 2024-09-12T01:30:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82991 mgr-fin ceph txt unknown /proc/31148/task/82991/exe (readlink: Permission denied) 2024-09-12T01:30:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82991 mgr-fin ceph NOFD /proc/31148/task/82991/fd (opendir: Permission denied) 2024-09-12T01:30:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82992 mgr-fin ceph cwd unknown /proc/31148/task/82992/cwd (readlink: Permission denied) 2024-09-12T01:30:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82992 mgr-fin ceph rtd unknown /proc/31148/task/82992/root (readlink: Permission denied) 2024-09-12T01:30:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82992 mgr-fin ceph txt unknown /proc/31148/task/82992/exe (readlink: Permission denied) 2024-09-12T01:30:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82992 mgr-fin ceph NOFD /proc/31148/task/82992/fd (opendir: Permission denied) 2024-09-12T01:30:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82993 mgr-fin ceph cwd unknown /proc/31148/task/82993/cwd (readlink: Permission denied) 2024-09-12T01:30:25.546 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82993 mgr-fin ceph rtd unknown /proc/31148/task/82993/root (readlink: Permission denied) 2024-09-12T01:30:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82993 mgr-fin ceph txt unknown /proc/31148/task/82993/exe (readlink: Permission denied) 2024-09-12T01:30:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82993 mgr-fin ceph NOFD /proc/31148/task/82993/fd (opendir: Permission denied) 2024-09-12T01:30:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82994 cephadm ceph cwd unknown /proc/31148/task/82994/cwd (readlink: Permission denied) 2024-09-12T01:30:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82994 cephadm ceph rtd unknown /proc/31148/task/82994/root (readlink: Permission denied) 2024-09-12T01:30:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82994 cephadm ceph txt unknown /proc/31148/task/82994/exe (readlink: Permission denied) 2024-09-12T01:30:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82994 cephadm ceph NOFD /proc/31148/task/82994/fd (opendir: Permission denied) 2024-09-12T01:30:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82995 m-fin-cep ceph cwd unknown /proc/31148/task/82995/cwd (readlink: Permission denied) 2024-09-12T01:30:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82995 m-fin-cep ceph rtd unknown /proc/31148/task/82995/root (readlink: Permission denied) 2024-09-12T01:30:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82995 m-fin-cep ceph txt unknown /proc/31148/task/82995/exe (readlink: Permission denied) 2024-09-12T01:30:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82995 m-fin-cep ceph NOFD /proc/31148/task/82995/fd (opendir: Permission denied) 2024-09-12T01:30:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82996 mgr-fin ceph cwd unknown /proc/31148/task/82996/cwd (readlink: Permission denied) 2024-09-12T01:30:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82996 mgr-fin ceph rtd unknown /proc/31148/task/82996/root (readlink: Permission denied) 2024-09-12T01:30:25.547 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82996 mgr-fin ceph txt unknown /proc/31148/task/82996/exe (readlink: Permission denied) 2024-09-12T01:30:25.548 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82996 mgr-fin ceph NOFD /proc/31148/task/82996/fd (opendir: Permission denied) 2024-09-12T01:30:25.548 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82997 crash ceph cwd unknown /proc/31148/task/82997/cwd (readlink: Permission denied) 2024-09-12T01:30:25.548 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82997 crash ceph rtd unknown /proc/31148/task/82997/root (readlink: Permission denied) 2024-09-12T01:30:25.548 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82997 crash ceph txt unknown /proc/31148/task/82997/exe (readlink: Permission denied) 2024-09-12T01:30:25.548 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82997 crash ceph NOFD /proc/31148/task/82997/fd (opendir: Permission denied) 2024-09-12T01:30:25.548 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82998 m-fin-cra ceph cwd unknown /proc/31148/task/82998/cwd (readlink: Permission denied) 2024-09-12T01:30:25.548 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82998 m-fin-cra ceph rtd unknown /proc/31148/task/82998/root (readlink: Permission denied) 2024-09-12T01:30:25.548 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82998 m-fin-cra ceph txt unknown /proc/31148/task/82998/exe (readlink: Permission denied) 2024-09-12T01:30:25.549 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82998 m-fin-cra ceph NOFD /proc/31148/task/82998/fd (opendir: Permission denied) 2024-09-12T01:30:25.549 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82999 mgr-fin ceph cwd unknown /proc/31148/task/82999/cwd (readlink: Permission denied) 2024-09-12T01:30:25.549 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82999 mgr-fin ceph rtd unknown /proc/31148/task/82999/root (readlink: Permission denied) 2024-09-12T01:30:25.549 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82999 mgr-fin ceph txt unknown /proc/31148/task/82999/exe (readlink: Permission denied) 2024-09-12T01:30:25.549 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 82999 mgr-fin ceph NOFD /proc/31148/task/82999/fd (opendir: Permission denied) 2024-09-12T01:30:25.549 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83000 dashboard ceph cwd unknown /proc/31148/task/83000/cwd (readlink: Permission denied) 2024-09-12T01:30:25.549 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83000 dashboard ceph rtd unknown /proc/31148/task/83000/root (readlink: Permission denied) 2024-09-12T01:30:25.549 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83000 dashboard ceph txt unknown /proc/31148/task/83000/exe (readlink: Permission denied) 2024-09-12T01:30:25.549 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83000 dashboard ceph NOFD /proc/31148/task/83000/fd (opendir: Permission denied) 2024-09-12T01:30:25.550 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83001 m-fin-das ceph cwd unknown /proc/31148/task/83001/cwd (readlink: Permission denied) 2024-09-12T01:30:25.550 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83001 m-fin-das ceph rtd unknown /proc/31148/task/83001/root (readlink: Permission denied) 2024-09-12T01:30:25.550 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83001 m-fin-das ceph txt unknown /proc/31148/task/83001/exe (readlink: Permission denied) 2024-09-12T01:30:25.550 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83001 m-fin-das ceph NOFD /proc/31148/task/83001/fd (opendir: Permission denied) 2024-09-12T01:30:25.550 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83002 mgr-fin ceph cwd unknown /proc/31148/task/83002/cwd (readlink: Permission denied) 2024-09-12T01:30:25.550 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83002 mgr-fin ceph rtd unknown /proc/31148/task/83002/root (readlink: Permission denied) 2024-09-12T01:30:25.550 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83002 mgr-fin ceph txt unknown /proc/31148/task/83002/exe (readlink: Permission denied) 2024-09-12T01:30:25.550 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83002 mgr-fin ceph NOFD /proc/31148/task/83002/fd (opendir: Permission denied) 2024-09-12T01:30:25.550 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83003 cephadm ceph cwd unknown /proc/31148/task/83003/cwd (readlink: Permission denied) 2024-09-12T01:30:25.550 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83003 cephadm ceph rtd unknown /proc/31148/task/83003/root (readlink: Permission denied) 2024-09-12T01:30:25.550 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83003 cephadm ceph txt unknown /proc/31148/task/83003/exe (readlink: Permission denied) 2024-09-12T01:30:25.550 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83003 cephadm ceph NOFD /proc/31148/task/83003/fd (opendir: Permission denied) 2024-09-12T01:30:25.551 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83004 mgr-fin ceph cwd unknown /proc/31148/task/83004/cwd (readlink: Permission denied) 2024-09-12T01:30:25.551 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83004 mgr-fin ceph rtd unknown /proc/31148/task/83004/root (readlink: Permission denied) 2024-09-12T01:30:25.551 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83004 mgr-fin ceph txt unknown /proc/31148/task/83004/exe (readlink: Permission denied) 2024-09-12T01:30:25.551 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83004 mgr-fin ceph NOFD /proc/31148/task/83004/fd (opendir: Permission denied) 2024-09-12T01:30:25.551 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83005 devicehea ceph cwd unknown /proc/31148/task/83005/cwd (readlink: Permission denied) 2024-09-12T01:30:25.551 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83005 devicehea ceph rtd unknown /proc/31148/task/83005/root (readlink: Permission denied) 2024-09-12T01:30:25.551 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83005 devicehea ceph txt unknown /proc/31148/task/83005/exe (readlink: Permission denied) 2024-09-12T01:30:25.551 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83005 devicehea ceph NOFD /proc/31148/task/83005/fd (opendir: Permission denied) 2024-09-12T01:30:25.551 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83006 m-fin-dev ceph cwd unknown /proc/31148/task/83006/cwd (readlink: Permission denied) 2024-09-12T01:30:25.551 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83006 m-fin-dev ceph rtd unknown /proc/31148/task/83006/root (readlink: Permission denied) 2024-09-12T01:30:25.551 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83006 m-fin-dev ceph txt unknown /proc/31148/task/83006/exe (readlink: Permission denied) 2024-09-12T01:30:25.551 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83006 m-fin-dev ceph NOFD /proc/31148/task/83006/fd (opendir: Permission denied) 2024-09-12T01:30:25.551 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83007 mgr-fin ceph cwd unknown /proc/31148/task/83007/cwd (readlink: Permission denied) 2024-09-12T01:30:25.552 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83007 mgr-fin ceph rtd unknown /proc/31148/task/83007/root (readlink: Permission denied) 2024-09-12T01:30:25.552 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83007 mgr-fin ceph txt unknown /proc/31148/task/83007/exe (readlink: Permission denied) 2024-09-12T01:30:25.552 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83007 mgr-fin ceph NOFD /proc/31148/task/83007/fd (opendir: Permission denied) 2024-09-12T01:30:25.552 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83009 m-fin-ios ceph cwd unknown /proc/31148/task/83009/cwd (readlink: Permission denied) 2024-09-12T01:30:25.552 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83009 m-fin-ios ceph rtd unknown /proc/31148/task/83009/root (readlink: Permission denied) 2024-09-12T01:30:25.552 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83009 m-fin-ios ceph txt unknown /proc/31148/task/83009/exe (readlink: Permission denied) 2024-09-12T01:30:25.552 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83009 m-fin-ios ceph NOFD /proc/31148/task/83009/fd (opendir: Permission denied) 2024-09-12T01:30:25.552 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83010 mgr-fin ceph cwd unknown /proc/31148/task/83010/cwd (readlink: Permission denied) 2024-09-12T01:30:25.552 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83010 mgr-fin ceph rtd unknown /proc/31148/task/83010/root (readlink: Permission denied) 2024-09-12T01:30:25.552 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83010 mgr-fin ceph txt unknown /proc/31148/task/83010/exe (readlink: Permission denied) 2024-09-12T01:30:25.552 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83010 mgr-fin ceph NOFD /proc/31148/task/83010/fd (opendir: Permission denied) 2024-09-12T01:30:25.552 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83012 m-fin-nfs ceph cwd unknown /proc/31148/task/83012/cwd (readlink: Permission denied) 2024-09-12T01:30:25.552 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83012 m-fin-nfs ceph rtd unknown /proc/31148/task/83012/root (readlink: Permission denied) 2024-09-12T01:30:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83012 m-fin-nfs ceph txt unknown /proc/31148/task/83012/exe (readlink: Permission denied) 2024-09-12T01:30:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83012 m-fin-nfs ceph NOFD /proc/31148/task/83012/fd (opendir: Permission denied) 2024-09-12T01:30:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83013 mgr-fin ceph cwd unknown /proc/31148/task/83013/cwd (readlink: Permission denied) 2024-09-12T01:30:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83013 mgr-fin ceph rtd unknown /proc/31148/task/83013/root (readlink: Permission denied) 2024-09-12T01:30:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83013 mgr-fin ceph txt unknown /proc/31148/task/83013/exe (readlink: Permission denied) 2024-09-12T01:30:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83013 mgr-fin ceph NOFD /proc/31148/task/83013/fd (opendir: Permission denied) 2024-09-12T01:30:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83014 mgr-fin ceph cwd unknown /proc/31148/task/83014/cwd (readlink: Permission denied) 2024-09-12T01:30:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83014 mgr-fin ceph rtd unknown /proc/31148/task/83014/root (readlink: Permission denied) 2024-09-12T01:30:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83014 mgr-fin ceph txt unknown /proc/31148/task/83014/exe (readlink: Permission denied) 2024-09-12T01:30:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83014 mgr-fin ceph NOFD /proc/31148/task/83014/fd (opendir: Permission denied) 2024-09-12T01:30:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83016 mgr-fin ceph cwd unknown /proc/31148/task/83016/cwd (readlink: Permission denied) 2024-09-12T01:30:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83016 mgr-fin ceph rtd unknown /proc/31148/task/83016/root (readlink: Permission denied) 2024-09-12T01:30:25.553 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83016 mgr-fin ceph txt unknown /proc/31148/task/83016/exe (readlink: Permission denied) 2024-09-12T01:30:25.554 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83016 mgr-fin ceph NOFD /proc/31148/task/83016/fd (opendir: Permission denied) 2024-09-12T01:30:25.554 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83017 m-fin-orc ceph cwd unknown /proc/31148/task/83017/cwd (readlink: Permission denied) 2024-09-12T01:30:25.554 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83017 m-fin-orc ceph rtd unknown /proc/31148/task/83017/root (readlink: Permission denied) 2024-09-12T01:30:25.554 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83017 m-fin-orc ceph txt unknown /proc/31148/task/83017/exe (readlink: Permission denied) 2024-09-12T01:30:25.554 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83017 m-fin-orc ceph NOFD /proc/31148/task/83017/fd (opendir: Permission denied) 2024-09-12T01:30:25.554 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83018 pg_autosc ceph cwd unknown /proc/31148/task/83018/cwd (readlink: Permission denied) 2024-09-12T01:30:25.554 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83018 pg_autosc ceph rtd unknown /proc/31148/task/83018/root (readlink: Permission denied) 2024-09-12T01:30:25.554 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83018 pg_autosc ceph txt unknown /proc/31148/task/83018/exe (readlink: Permission denied) 2024-09-12T01:30:25.554 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83018 pg_autosc ceph NOFD /proc/31148/task/83018/fd (opendir: Permission denied) 2024-09-12T01:30:25.554 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83019 m-fin-pg_ ceph cwd unknown /proc/31148/task/83019/cwd (readlink: Permission denied) 2024-09-12T01:30:25.554 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83019 m-fin-pg_ ceph rtd unknown /proc/31148/task/83019/root (readlink: Permission denied) 2024-09-12T01:30:25.554 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83019 m-fin-pg_ ceph txt unknown /proc/31148/task/83019/exe (readlink: Permission denied) 2024-09-12T01:30:25.554 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83019 m-fin-pg_ ceph NOFD /proc/31148/task/83019/fd (opendir: Permission denied) 2024-09-12T01:30:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83020 mgr-fin ceph cwd unknown /proc/31148/task/83020/cwd (readlink: Permission denied) 2024-09-12T01:30:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83020 mgr-fin ceph rtd unknown /proc/31148/task/83020/root (readlink: Permission denied) 2024-09-12T01:30:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83020 mgr-fin ceph txt unknown /proc/31148/task/83020/exe (readlink: Permission denied) 2024-09-12T01:30:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83020 mgr-fin ceph NOFD /proc/31148/task/83020/fd (opendir: Permission denied) 2024-09-12T01:30:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83021 mgr-fin ceph cwd unknown /proc/31148/task/83021/cwd (readlink: Permission denied) 2024-09-12T01:30:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83021 mgr-fin ceph rtd unknown /proc/31148/task/83021/root (readlink: Permission denied) 2024-09-12T01:30:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83021 mgr-fin ceph txt unknown /proc/31148/task/83021/exe (readlink: Permission denied) 2024-09-12T01:30:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83021 mgr-fin ceph NOFD /proc/31148/task/83021/fd (opendir: Permission denied) 2024-09-12T01:30:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83022 progress ceph cwd unknown /proc/31148/task/83022/cwd (readlink: Permission denied) 2024-09-12T01:30:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83022 progress ceph rtd unknown /proc/31148/task/83022/root (readlink: Permission denied) 2024-09-12T01:30:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83022 progress ceph txt unknown /proc/31148/task/83022/exe (readlink: Permission denied) 2024-09-12T01:30:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83022 progress ceph NOFD /proc/31148/task/83022/fd (opendir: Permission denied) 2024-09-12T01:30:25.555 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83023 mgr-fin ceph cwd unknown /proc/31148/task/83023/cwd (readlink: Permission denied) 2024-09-12T01:30:25.556 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83023 mgr-fin ceph rtd unknown /proc/31148/task/83023/root (readlink: Permission denied) 2024-09-12T01:30:25.556 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83023 mgr-fin ceph txt unknown /proc/31148/task/83023/exe (readlink: Permission denied) 2024-09-12T01:30:25.556 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83023 mgr-fin ceph NOFD /proc/31148/task/83023/fd (opendir: Permission denied) 2024-09-12T01:30:25.556 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83024 m-fin-pro ceph cwd unknown /proc/31148/task/83024/cwd (readlink: Permission denied) 2024-09-12T01:30:25.556 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83024 m-fin-pro ceph rtd unknown /proc/31148/task/83024/root (readlink: Permission denied) 2024-09-12T01:30:25.556 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83024 m-fin-pro ceph txt unknown /proc/31148/task/83024/exe (readlink: Permission denied) 2024-09-12T01:30:25.556 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83024 m-fin-pro ceph NOFD /proc/31148/task/83024/fd (opendir: Permission denied) 2024-09-12T01:30:25.556 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83025 cephadm ceph cwd unknown /proc/31148/task/83025/cwd (readlink: Permission denied) 2024-09-12T01:30:25.556 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83025 cephadm ceph rtd unknown /proc/31148/task/83025/root (readlink: Permission denied) 2024-09-12T01:30:25.556 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83025 cephadm ceph txt unknown /proc/31148/task/83025/exe (readlink: Permission denied) 2024-09-12T01:30:25.556 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83025 cephadm ceph NOFD /proc/31148/task/83025/fd (opendir: Permission denied) 2024-09-12T01:30:25.556 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83029 mgr-fin ceph cwd unknown /proc/31148/task/83029/cwd (readlink: Permission denied) 2024-09-12T01:30:25.556 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83029 mgr-fin ceph rtd unknown /proc/31148/task/83029/root (readlink: Permission denied) 2024-09-12T01:30:25.557 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83029 mgr-fin ceph txt unknown /proc/31148/task/83029/exe (readlink: Permission denied) 2024-09-12T01:30:25.557 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83029 mgr-fin ceph NOFD /proc/31148/task/83029/fd (opendir: Permission denied) 2024-09-12T01:30:25.557 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83030 io_contex ceph cwd unknown /proc/31148/task/83030/cwd (readlink: Permission denied) 2024-09-12T01:30:25.557 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83030 io_contex ceph rtd unknown /proc/31148/task/83030/root (readlink: Permission denied) 2024-09-12T01:30:25.557 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83030 io_contex ceph txt unknown /proc/31148/task/83030/exe (readlink: Permission denied) 2024-09-12T01:30:25.557 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83030 io_contex ceph NOFD /proc/31148/task/83030/fd (opendir: Permission denied) 2024-09-12T01:30:25.557 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83031 io_contex ceph cwd unknown /proc/31148/task/83031/cwd (readlink: Permission denied) 2024-09-12T01:30:25.557 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83031 io_contex ceph rtd unknown /proc/31148/task/83031/root (readlink: Permission denied) 2024-09-12T01:30:25.557 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83031 io_contex ceph txt unknown /proc/31148/task/83031/exe (readlink: Permission denied) 2024-09-12T01:30:25.557 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83031 io_contex ceph NOFD /proc/31148/task/83031/fd (opendir: Permission denied) 2024-09-12T01:30:25.557 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83032 ceph_time ceph cwd unknown /proc/31148/task/83032/cwd (readlink: Permission denied) 2024-09-12T01:30:25.557 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83032 ceph_time ceph rtd unknown /proc/31148/task/83032/root (readlink: Permission denied) 2024-09-12T01:30:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83032 ceph_time ceph txt unknown /proc/31148/task/83032/exe (readlink: Permission denied) 2024-09-12T01:30:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83032 ceph_time ceph NOFD /proc/31148/task/83032/fd (opendir: Permission denied) 2024-09-12T01:30:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83033 ms_dispat ceph cwd unknown /proc/31148/task/83033/cwd (readlink: Permission denied) 2024-09-12T01:30:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83033 ms_dispat ceph rtd unknown /proc/31148/task/83033/root (readlink: Permission denied) 2024-09-12T01:30:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83033 ms_dispat ceph txt unknown /proc/31148/task/83033/exe (readlink: Permission denied) 2024-09-12T01:30:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83033 ms_dispat ceph NOFD /proc/31148/task/83033/fd (opendir: Permission denied) 2024-09-12T01:30:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83034 ms_local ceph cwd unknown /proc/31148/task/83034/cwd (readlink: Permission denied) 2024-09-12T01:30:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83034 ms_local ceph rtd unknown /proc/31148/task/83034/root (readlink: Permission denied) 2024-09-12T01:30:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83034 ms_local ceph txt unknown /proc/31148/task/83034/exe (readlink: Permission denied) 2024-09-12T01:30:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83034 ms_local ceph NOFD /proc/31148/task/83034/fd (opendir: Permission denied) 2024-09-12T01:30:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83035 safe_time ceph cwd unknown /proc/31148/task/83035/cwd (readlink: Permission denied) 2024-09-12T01:30:25.558 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83035 safe_time ceph rtd unknown /proc/31148/task/83035/root (readlink: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83035 safe_time ceph txt unknown /proc/31148/task/83035/exe (readlink: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83035 safe_time ceph NOFD /proc/31148/task/83035/fd (opendir: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83036 safe_time ceph cwd unknown /proc/31148/task/83036/cwd (readlink: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83036 safe_time ceph rtd unknown /proc/31148/task/83036/root (readlink: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83036 safe_time ceph txt unknown /proc/31148/task/83036/exe (readlink: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83036 safe_time ceph NOFD /proc/31148/task/83036/fd (opendir: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83037 mgr-fin ceph cwd unknown /proc/31148/task/83037/cwd (readlink: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83037 mgr-fin ceph rtd unknown /proc/31148/task/83037/root (readlink: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83037 mgr-fin ceph txt unknown /proc/31148/task/83037/exe (readlink: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83037 mgr-fin ceph NOFD /proc/31148/task/83037/fd (opendir: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83038 cephadm ceph cwd unknown /proc/31148/task/83038/cwd (readlink: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83038 cephadm ceph rtd unknown /proc/31148/task/83038/root (readlink: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83038 cephadm ceph txt unknown /proc/31148/task/83038/exe (readlink: Permission denied) 2024-09-12T01:30:25.559 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83038 cephadm ceph NOFD /proc/31148/task/83038/fd (opendir: Permission denied) 2024-09-12T01:30:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83040 m-fin-rbd ceph cwd unknown /proc/31148/task/83040/cwd (readlink: Permission denied) 2024-09-12T01:30:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83040 m-fin-rbd ceph rtd unknown /proc/31148/task/83040/root (readlink: Permission denied) 2024-09-12T01:30:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83040 m-fin-rbd ceph txt unknown /proc/31148/task/83040/exe (readlink: Permission denied) 2024-09-12T01:30:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83040 m-fin-rbd ceph NOFD /proc/31148/task/83040/fd (opendir: Permission denied) 2024-09-12T01:30:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83041 restful ceph cwd unknown /proc/31148/task/83041/cwd (readlink: Permission denied) 2024-09-12T01:30:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83041 restful ceph rtd unknown /proc/31148/task/83041/root (readlink: Permission denied) 2024-09-12T01:30:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83041 restful ceph txt unknown /proc/31148/task/83041/exe (readlink: Permission denied) 2024-09-12T01:30:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83041 restful ceph NOFD /proc/31148/task/83041/fd (opendir: Permission denied) 2024-09-12T01:30:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83042 m-fin-res ceph cwd unknown /proc/31148/task/83042/cwd (readlink: Permission denied) 2024-09-12T01:30:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83042 m-fin-res ceph rtd unknown /proc/31148/task/83042/root (readlink: Permission denied) 2024-09-12T01:30:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83042 m-fin-res ceph txt unknown /proc/31148/task/83042/exe (readlink: Permission denied) 2024-09-12T01:30:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83042 m-fin-res ceph NOFD /proc/31148/task/83042/fd (opendir: Permission denied) 2024-09-12T01:30:25.560 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83043 cephadm ceph cwd unknown /proc/31148/task/83043/cwd (readlink: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83043 cephadm ceph rtd unknown /proc/31148/task/83043/root (readlink: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83043 cephadm ceph txt unknown /proc/31148/task/83043/exe (readlink: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83043 cephadm ceph NOFD /proc/31148/task/83043/fd (opendir: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83044 mgr-fin ceph cwd unknown /proc/31148/task/83044/cwd (readlink: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83044 mgr-fin ceph rtd unknown /proc/31148/task/83044/root (readlink: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83044 mgr-fin ceph txt unknown /proc/31148/task/83044/exe (readlink: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83044 mgr-fin ceph NOFD /proc/31148/task/83044/fd (opendir: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83045 mgr-fin ceph cwd unknown /proc/31148/task/83045/cwd (readlink: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83045 mgr-fin ceph rtd unknown /proc/31148/task/83045/root (readlink: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83045 mgr-fin ceph txt unknown /proc/31148/task/83045/exe (readlink: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83045 mgr-fin ceph NOFD /proc/31148/task/83045/fd (opendir: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83046 mgr-fin ceph cwd unknown /proc/31148/task/83046/cwd (readlink: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83046 mgr-fin ceph rtd unknown /proc/31148/task/83046/root (readlink: Permission denied) 2024-09-12T01:30:25.561 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83046 mgr-fin ceph txt unknown /proc/31148/task/83046/exe (readlink: Permission denied) 2024-09-12T01:30:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83046 mgr-fin ceph NOFD /proc/31148/task/83046/fd (opendir: Permission denied) 2024-09-12T01:30:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83047 mgr-fin ceph cwd unknown /proc/31148/task/83047/cwd (readlink: Permission denied) 2024-09-12T01:30:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83047 mgr-fin ceph rtd unknown /proc/31148/task/83047/root (readlink: Permission denied) 2024-09-12T01:30:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83047 mgr-fin ceph txt unknown /proc/31148/task/83047/exe (readlink: Permission denied) 2024-09-12T01:30:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83047 mgr-fin ceph NOFD /proc/31148/task/83047/fd (opendir: Permission denied) 2024-09-12T01:30:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83048 mgr-fin ceph cwd unknown /proc/31148/task/83048/cwd (readlink: Permission denied) 2024-09-12T01:30:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83048 mgr-fin ceph rtd unknown /proc/31148/task/83048/root (readlink: Permission denied) 2024-09-12T01:30:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83048 mgr-fin ceph txt unknown /proc/31148/task/83048/exe (readlink: Permission denied) 2024-09-12T01:30:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83048 mgr-fin ceph NOFD /proc/31148/task/83048/fd (opendir: Permission denied) 2024-09-12T01:30:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83049 mgr-fin ceph cwd unknown /proc/31148/task/83049/cwd (readlink: Permission denied) 2024-09-12T01:30:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83049 mgr-fin ceph rtd unknown /proc/31148/task/83049/root (readlink: Permission denied) 2024-09-12T01:30:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83049 mgr-fin ceph txt unknown /proc/31148/task/83049/exe (readlink: Permission denied) 2024-09-12T01:30:25.562 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83049 mgr-fin ceph NOFD /proc/31148/task/83049/fd (opendir: Permission denied) 2024-09-12T01:30:25.563 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83053 io_contex ceph cwd unknown /proc/31148/task/83053/cwd (readlink: Permission denied) 2024-09-12T01:30:25.563 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83053 io_contex ceph rtd unknown /proc/31148/task/83053/root (readlink: Permission denied) 2024-09-12T01:30:25.563 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83053 io_contex ceph txt unknown /proc/31148/task/83053/exe (readlink: Permission denied) 2024-09-12T01:30:25.563 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83053 io_contex ceph NOFD /proc/31148/task/83053/fd (opendir: Permission denied) 2024-09-12T01:30:25.563 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83054 io_contex ceph cwd unknown /proc/31148/task/83054/cwd (readlink: Permission denied) 2024-09-12T01:30:25.563 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83054 io_contex ceph rtd unknown /proc/31148/task/83054/root (readlink: Permission denied) 2024-09-12T01:30:25.563 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83054 io_contex ceph txt unknown /proc/31148/task/83054/exe (readlink: Permission denied) 2024-09-12T01:30:25.563 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83054 io_contex ceph NOFD /proc/31148/task/83054/fd (opendir: Permission denied) 2024-09-12T01:30:25.563 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83055 ceph_time ceph cwd unknown /proc/31148/task/83055/cwd (readlink: Permission denied) 2024-09-12T01:30:25.563 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83055 ceph_time ceph rtd unknown /proc/31148/task/83055/root (readlink: Permission denied) 2024-09-12T01:30:25.563 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83055 ceph_time ceph txt unknown /proc/31148/task/83055/exe (readlink: Permission denied) 2024-09-12T01:30:25.563 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83055 ceph_time ceph NOFD /proc/31148/task/83055/fd (opendir: Permission denied) 2024-09-12T01:30:25.563 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83056 ms_dispat ceph cwd unknown /proc/31148/task/83056/cwd (readlink: Permission denied) 2024-09-12T01:30:25.564 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83056 ms_dispat ceph rtd unknown /proc/31148/task/83056/root (readlink: Permission denied) 2024-09-12T01:30:25.564 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83056 ms_dispat ceph txt unknown /proc/31148/task/83056/exe (readlink: Permission denied) 2024-09-12T01:30:25.564 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83056 ms_dispat ceph NOFD /proc/31148/task/83056/fd (opendir: Permission denied) 2024-09-12T01:30:25.564 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83057 ms_local ceph cwd unknown /proc/31148/task/83057/cwd (readlink: Permission denied) 2024-09-12T01:30:25.564 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83057 ms_local ceph rtd unknown /proc/31148/task/83057/root (readlink: Permission denied) 2024-09-12T01:30:25.564 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83057 ms_local ceph txt unknown /proc/31148/task/83057/exe (readlink: Permission denied) 2024-09-12T01:30:25.564 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83057 ms_local ceph NOFD /proc/31148/task/83057/fd (opendir: Permission denied) 2024-09-12T01:30:25.564 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83058 safe_time ceph cwd unknown /proc/31148/task/83058/cwd (readlink: Permission denied) 2024-09-12T01:30:25.564 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83058 safe_time ceph rtd unknown /proc/31148/task/83058/root (readlink: Permission denied) 2024-09-12T01:30:25.564 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83058 safe_time ceph txt unknown /proc/31148/task/83058/exe (readlink: Permission denied) 2024-09-12T01:30:25.564 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83058 safe_time ceph NOFD /proc/31148/task/83058/fd (opendir: Permission denied) 2024-09-12T01:30:25.564 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83059 safe_time ceph cwd unknown /proc/31148/task/83059/cwd (readlink: Permission denied) 2024-09-12T01:30:25.564 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83059 safe_time ceph rtd unknown /proc/31148/task/83059/root (readlink: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83059 safe_time ceph txt unknown /proc/31148/task/83059/exe (readlink: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83059 safe_time ceph NOFD /proc/31148/task/83059/fd (opendir: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83061 m-fin-sna ceph cwd unknown /proc/31148/task/83061/cwd (readlink: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83061 m-fin-sna ceph rtd unknown /proc/31148/task/83061/root (readlink: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83061 m-fin-sna ceph txt unknown /proc/31148/task/83061/exe (readlink: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83061 m-fin-sna ceph NOFD /proc/31148/task/83061/fd (opendir: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83063 m-fin-sta ceph cwd unknown /proc/31148/task/83063/cwd (readlink: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83063 m-fin-sta ceph rtd unknown /proc/31148/task/83063/root (readlink: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83063 m-fin-sta ceph txt unknown /proc/31148/task/83063/exe (readlink: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83063 m-fin-sta ceph NOFD /proc/31148/task/83063/fd (opendir: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83065 telemetry ceph cwd unknown /proc/31148/task/83065/cwd (readlink: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83065 telemetry ceph rtd unknown /proc/31148/task/83065/root (readlink: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83065 telemetry ceph txt unknown /proc/31148/task/83065/exe (readlink: Permission denied) 2024-09-12T01:30:25.565 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83065 telemetry ceph NOFD /proc/31148/task/83065/fd (opendir: Permission denied) 2024-09-12T01:30:25.566 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83066 m-fin-tel ceph cwd unknown /proc/31148/task/83066/cwd (readlink: Permission denied) 2024-09-12T01:30:25.566 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83066 m-fin-tel ceph rtd unknown /proc/31148/task/83066/root (readlink: Permission denied) 2024-09-12T01:30:25.566 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83066 m-fin-tel ceph txt unknown /proc/31148/task/83066/exe (readlink: Permission denied) 2024-09-12T01:30:25.566 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83066 m-fin-tel ceph NOFD /proc/31148/task/83066/fd (opendir: Permission denied) 2024-09-12T01:30:25.566 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83068 mgr-fin ceph cwd unknown /proc/31148/task/83068/cwd (readlink: Permission denied) 2024-09-12T01:30:25.566 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83068 mgr-fin ceph rtd unknown /proc/31148/task/83068/root (readlink: Permission denied) 2024-09-12T01:30:25.566 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83068 mgr-fin ceph txt unknown /proc/31148/task/83068/exe (readlink: Permission denied) 2024-09-12T01:30:25.566 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83068 mgr-fin ceph NOFD /proc/31148/task/83068/fd (opendir: Permission denied) 2024-09-12T01:30:25.566 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83072 io_contex ceph cwd unknown /proc/31148/task/83072/cwd (readlink: Permission denied) 2024-09-12T01:30:25.566 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83072 io_contex ceph rtd unknown /proc/31148/task/83072/root (readlink: Permission denied) 2024-09-12T01:30:25.566 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83072 io_contex ceph txt unknown /proc/31148/task/83072/exe (readlink: Permission denied) 2024-09-12T01:30:25.566 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83072 io_contex ceph NOFD /proc/31148/task/83072/fd (opendir: Permission denied) 2024-09-12T01:30:25.566 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83073 io_contex ceph cwd unknown /proc/31148/task/83073/cwd (readlink: Permission denied) 2024-09-12T01:30:25.567 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83073 io_contex ceph rtd unknown /proc/31148/task/83073/root (readlink: Permission denied) 2024-09-12T01:30:25.567 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83073 io_contex ceph txt unknown /proc/31148/task/83073/exe (readlink: Permission denied) 2024-09-12T01:30:25.567 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83073 io_contex ceph NOFD /proc/31148/task/83073/fd (opendir: Permission denied) 2024-09-12T01:30:25.567 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83074 ceph_time ceph cwd unknown /proc/31148/task/83074/cwd (readlink: Permission denied) 2024-09-12T01:30:25.567 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83074 ceph_time ceph rtd unknown /proc/31148/task/83074/root (readlink: Permission denied) 2024-09-12T01:30:25.567 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83074 ceph_time ceph txt unknown /proc/31148/task/83074/exe (readlink: Permission denied) 2024-09-12T01:30:25.567 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83074 ceph_time ceph NOFD /proc/31148/task/83074/fd (opendir: Permission denied) 2024-09-12T01:30:25.567 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83075 ms_dispat ceph cwd unknown /proc/31148/task/83075/cwd (readlink: Permission denied) 2024-09-12T01:30:25.567 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83075 ms_dispat ceph rtd unknown /proc/31148/task/83075/root (readlink: Permission denied) 2024-09-12T01:30:25.567 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83075 ms_dispat ceph txt unknown /proc/31148/task/83075/exe (readlink: Permission denied) 2024-09-12T01:30:25.567 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83075 ms_dispat ceph NOFD /proc/31148/task/83075/fd (opendir: Permission denied) 2024-09-12T01:30:25.567 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83076 ms_local ceph cwd unknown /proc/31148/task/83076/cwd (readlink: Permission denied) 2024-09-12T01:30:25.567 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83076 ms_local ceph rtd unknown /proc/31148/task/83076/root (readlink: Permission denied) 2024-09-12T01:30:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83076 ms_local ceph txt unknown /proc/31148/task/83076/exe (readlink: Permission denied) 2024-09-12T01:30:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83076 ms_local ceph NOFD /proc/31148/task/83076/fd (opendir: Permission denied) 2024-09-12T01:30:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83077 safe_time ceph cwd unknown /proc/31148/task/83077/cwd (readlink: Permission denied) 2024-09-12T01:30:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83077 safe_time ceph rtd unknown /proc/31148/task/83077/root (readlink: Permission denied) 2024-09-12T01:30:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83077 safe_time ceph txt unknown /proc/31148/task/83077/exe (readlink: Permission denied) 2024-09-12T01:30:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83077 safe_time ceph NOFD /proc/31148/task/83077/fd (opendir: Permission denied) 2024-09-12T01:30:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83078 safe_time ceph cwd unknown /proc/31148/task/83078/cwd (readlink: Permission denied) 2024-09-12T01:30:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83078 safe_time ceph rtd unknown /proc/31148/task/83078/root (readlink: Permission denied) 2024-09-12T01:30:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83078 safe_time ceph txt unknown /proc/31148/task/83078/exe (readlink: Permission denied) 2024-09-12T01:30:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83078 safe_time ceph NOFD /proc/31148/task/83078/fd (opendir: Permission denied) 2024-09-12T01:30:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83080 mgr-fin ceph cwd unknown /proc/31148/task/83080/cwd (readlink: Permission denied) 2024-09-12T01:30:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83080 mgr-fin ceph rtd unknown /proc/31148/task/83080/root (readlink: Permission denied) 2024-09-12T01:30:25.568 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83080 mgr-fin ceph txt unknown /proc/31148/task/83080/exe (readlink: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83080 mgr-fin ceph NOFD /proc/31148/task/83080/fd (opendir: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83087 mgr-fin ceph cwd unknown /proc/31148/task/83087/cwd (readlink: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83087 mgr-fin ceph rtd unknown /proc/31148/task/83087/root (readlink: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83087 mgr-fin ceph txt unknown /proc/31148/task/83087/exe (readlink: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83087 mgr-fin ceph NOFD /proc/31148/task/83087/fd (opendir: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83088 mgr-fin ceph cwd unknown /proc/31148/task/83088/cwd (readlink: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83088 mgr-fin ceph rtd unknown /proc/31148/task/83088/root (readlink: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83088 mgr-fin ceph txt unknown /proc/31148/task/83088/exe (readlink: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83088 mgr-fin ceph NOFD /proc/31148/task/83088/fd (opendir: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83089 mgr-fin ceph cwd unknown /proc/31148/task/83089/cwd (readlink: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83089 mgr-fin ceph rtd unknown /proc/31148/task/83089/root (readlink: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83089 mgr-fin ceph txt unknown /proc/31148/task/83089/exe (readlink: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83089 mgr-fin ceph NOFD /proc/31148/task/83089/fd (opendir: Permission denied) 2024-09-12T01:30:25.569 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83090 mgr-fin ceph cwd unknown /proc/31148/task/83090/cwd (readlink: Permission denied) 2024-09-12T01:30:25.570 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83090 mgr-fin ceph rtd unknown /proc/31148/task/83090/root (readlink: Permission denied) 2024-09-12T01:30:25.570 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83090 mgr-fin ceph txt unknown /proc/31148/task/83090/exe (readlink: Permission denied) 2024-09-12T01:30:25.570 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83090 mgr-fin ceph NOFD /proc/31148/task/83090/fd (opendir: Permission denied) 2024-09-12T01:30:25.570 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83091 mgr-fin ceph cwd unknown /proc/31148/task/83091/cwd (readlink: Permission denied) 2024-09-12T01:30:25.570 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83091 mgr-fin ceph rtd unknown /proc/31148/task/83091/root (readlink: Permission denied) 2024-09-12T01:30:25.570 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83091 mgr-fin ceph txt unknown /proc/31148/task/83091/exe (readlink: Permission denied) 2024-09-12T01:30:25.570 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83091 mgr-fin ceph NOFD /proc/31148/task/83091/fd (opendir: Permission denied) 2024-09-12T01:30:25.570 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83092 mgr-fin ceph cwd unknown /proc/31148/task/83092/cwd (readlink: Permission denied) 2024-09-12T01:30:25.570 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83092 mgr-fin ceph rtd unknown /proc/31148/task/83092/root (readlink: Permission denied) 2024-09-12T01:30:25.570 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83092 mgr-fin ceph txt unknown /proc/31148/task/83092/exe (readlink: Permission denied) 2024-09-12T01:30:25.570 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83092 mgr-fin ceph NOFD /proc/31148/task/83092/fd (opendir: Permission denied) 2024-09-12T01:30:25.570 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83093 mgr-fin ceph cwd unknown /proc/31148/task/83093/cwd (readlink: Permission denied) 2024-09-12T01:30:25.571 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83093 mgr-fin ceph rtd unknown /proc/31148/task/83093/root (readlink: Permission denied) 2024-09-12T01:30:25.571 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83093 mgr-fin ceph txt unknown /proc/31148/task/83093/exe (readlink: Permission denied) 2024-09-12T01:30:25.571 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83093 mgr-fin ceph NOFD /proc/31148/task/83093/fd (opendir: Permission denied) 2024-09-12T01:30:25.571 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83094 mgr-fin ceph cwd unknown /proc/31148/task/83094/cwd (readlink: Permission denied) 2024-09-12T01:30:25.571 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83094 mgr-fin ceph rtd unknown /proc/31148/task/83094/root (readlink: Permission denied) 2024-09-12T01:30:25.571 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83094 mgr-fin ceph txt unknown /proc/31148/task/83094/exe (readlink: Permission denied) 2024-09-12T01:30:25.571 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83094 mgr-fin ceph NOFD /proc/31148/task/83094/fd (opendir: Permission denied) 2024-09-12T01:30:25.571 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83095 mgr-fin ceph cwd unknown /proc/31148/task/83095/cwd (readlink: Permission denied) 2024-09-12T01:30:25.571 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83095 mgr-fin ceph rtd unknown /proc/31148/task/83095/root (readlink: Permission denied) 2024-09-12T01:30:25.571 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83095 mgr-fin ceph txt unknown /proc/31148/task/83095/exe (readlink: Permission denied) 2024-09-12T01:30:25.571 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83095 mgr-fin ceph NOFD /proc/31148/task/83095/fd (opendir: Permission denied) 2024-09-12T01:30:25.571 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83096 mgr-fin ceph cwd unknown /proc/31148/task/83096/cwd (readlink: Permission denied) 2024-09-12T01:30:25.571 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83096 mgr-fin ceph rtd unknown /proc/31148/task/83096/root (readlink: Permission denied) 2024-09-12T01:30:25.572 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83096 mgr-fin ceph txt unknown /proc/31148/task/83096/exe (readlink: Permission denied) 2024-09-12T01:30:25.572 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83096 mgr-fin ceph NOFD /proc/31148/task/83096/fd (opendir: Permission denied) 2024-09-12T01:30:25.572 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83097 mgr-fin ceph cwd unknown /proc/31148/task/83097/cwd (readlink: Permission denied) 2024-09-12T01:30:25.572 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83097 mgr-fin ceph rtd unknown /proc/31148/task/83097/root (readlink: Permission denied) 2024-09-12T01:30:25.572 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83097 mgr-fin ceph txt unknown /proc/31148/task/83097/exe (readlink: Permission denied) 2024-09-12T01:30:25.572 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83097 mgr-fin ceph NOFD /proc/31148/task/83097/fd (opendir: Permission denied) 2024-09-12T01:30:25.572 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83099 m-fin-vol ceph cwd unknown /proc/31148/task/83099/cwd (readlink: Permission denied) 2024-09-12T01:30:25.572 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83099 m-fin-vol ceph rtd unknown /proc/31148/task/83099/root (readlink: Permission denied) 2024-09-12T01:30:25.572 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83099 m-fin-vol ceph txt unknown /proc/31148/task/83099/exe (readlink: Permission denied) 2024-09-12T01:30:25.572 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83099 m-fin-vol ceph NOFD /proc/31148/task/83099/fd (opendir: Permission denied) 2024-09-12T01:30:25.572 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83101 io_contex ceph cwd unknown /proc/31148/task/83101/cwd (readlink: Permission denied) 2024-09-12T01:30:25.572 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83101 io_contex ceph rtd unknown /proc/31148/task/83101/root (readlink: Permission denied) 2024-09-12T01:30:25.572 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83101 io_contex ceph txt unknown /proc/31148/task/83101/exe (readlink: Permission denied) 2024-09-12T01:30:25.573 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83101 io_contex ceph NOFD /proc/31148/task/83101/fd (opendir: Permission denied) 2024-09-12T01:30:25.573 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83102 io_contex ceph cwd unknown /proc/31148/task/83102/cwd (readlink: Permission denied) 2024-09-12T01:30:25.573 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83102 io_contex ceph rtd unknown /proc/31148/task/83102/root (readlink: Permission denied) 2024-09-12T01:30:25.573 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83102 io_contex ceph txt unknown /proc/31148/task/83102/exe (readlink: Permission denied) 2024-09-12T01:30:25.573 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83102 io_contex ceph NOFD /proc/31148/task/83102/fd (opendir: Permission denied) 2024-09-12T01:30:25.573 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83172 dashboard ceph cwd unknown /proc/31148/task/83172/cwd (readlink: Permission denied) 2024-09-12T01:30:25.573 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83172 dashboard ceph rtd unknown /proc/31148/task/83172/root (readlink: Permission denied) 2024-09-12T01:30:25.573 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83172 dashboard ceph txt unknown /proc/31148/task/83172/exe (readlink: Permission denied) 2024-09-12T01:30:25.573 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83172 dashboard ceph NOFD /proc/31148/task/83172/fd (opendir: Permission denied) 2024-09-12T01:30:25.573 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83173 dashboard ceph cwd unknown /proc/31148/task/83173/cwd (readlink: Permission denied) 2024-09-12T01:30:25.573 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83173 dashboard ceph rtd unknown /proc/31148/task/83173/root (readlink: Permission denied) 2024-09-12T01:30:25.573 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83173 dashboard ceph txt unknown /proc/31148/task/83173/exe (readlink: Permission denied) 2024-09-12T01:30:25.574 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83173 dashboard ceph NOFD /proc/31148/task/83173/fd (opendir: Permission denied) 2024-09-12T01:30:25.574 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83174 dashboard ceph cwd unknown /proc/31148/task/83174/cwd (readlink: Permission denied) 2024-09-12T01:30:25.574 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83174 dashboard ceph rtd unknown /proc/31148/task/83174/root (readlink: Permission denied) 2024-09-12T01:30:25.574 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83174 dashboard ceph txt unknown /proc/31148/task/83174/exe (readlink: Permission denied) 2024-09-12T01:30:25.574 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83174 dashboard ceph NOFD /proc/31148/task/83174/fd (opendir: Permission denied) 2024-09-12T01:30:25.574 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83175 dashboard ceph cwd unknown /proc/31148/task/83175/cwd (readlink: Permission denied) 2024-09-12T01:30:25.574 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83175 dashboard ceph rtd unknown /proc/31148/task/83175/root (readlink: Permission denied) 2024-09-12T01:30:25.574 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83175 dashboard ceph txt unknown /proc/31148/task/83175/exe (readlink: Permission denied) 2024-09-12T01:30:25.574 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83175 dashboard ceph NOFD /proc/31148/task/83175/fd (opendir: Permission denied) 2024-09-12T01:30:25.574 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83176 dashboard ceph cwd unknown /proc/31148/task/83176/cwd (readlink: Permission denied) 2024-09-12T01:30:25.574 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83176 dashboard ceph rtd unknown /proc/31148/task/83176/root (readlink: Permission denied) 2024-09-12T01:30:25.574 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83176 dashboard ceph txt unknown /proc/31148/task/83176/exe (readlink: Permission denied) 2024-09-12T01:30:25.574 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83176 dashboard ceph NOFD /proc/31148/task/83176/fd (opendir: Permission denied) 2024-09-12T01:30:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83177 dashboard ceph cwd unknown /proc/31148/task/83177/cwd (readlink: Permission denied) 2024-09-12T01:30:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83177 dashboard ceph rtd unknown /proc/31148/task/83177/root (readlink: Permission denied) 2024-09-12T01:30:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83177 dashboard ceph txt unknown /proc/31148/task/83177/exe (readlink: Permission denied) 2024-09-12T01:30:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83177 dashboard ceph NOFD /proc/31148/task/83177/fd (opendir: Permission denied) 2024-09-12T01:30:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83178 dashboard ceph cwd unknown /proc/31148/task/83178/cwd (readlink: Permission denied) 2024-09-12T01:30:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83178 dashboard ceph rtd unknown /proc/31148/task/83178/root (readlink: Permission denied) 2024-09-12T01:30:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83178 dashboard ceph txt unknown /proc/31148/task/83178/exe (readlink: Permission denied) 2024-09-12T01:30:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83178 dashboard ceph NOFD /proc/31148/task/83178/fd (opendir: Permission denied) 2024-09-12T01:30:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83179 dashboard ceph cwd unknown /proc/31148/task/83179/cwd (readlink: Permission denied) 2024-09-12T01:30:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83179 dashboard ceph rtd unknown /proc/31148/task/83179/root (readlink: Permission denied) 2024-09-12T01:30:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83179 dashboard ceph txt unknown /proc/31148/task/83179/exe (readlink: Permission denied) 2024-09-12T01:30:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83179 dashboard ceph NOFD /proc/31148/task/83179/fd (opendir: Permission denied) 2024-09-12T01:30:25.575 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83180 dashboard ceph cwd unknown /proc/31148/task/83180/cwd (readlink: Permission denied) 2024-09-12T01:30:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83180 dashboard ceph rtd unknown /proc/31148/task/83180/root (readlink: Permission denied) 2024-09-12T01:30:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83180 dashboard ceph txt unknown /proc/31148/task/83180/exe (readlink: Permission denied) 2024-09-12T01:30:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83180 dashboard ceph NOFD /proc/31148/task/83180/fd (opendir: Permission denied) 2024-09-12T01:30:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83181 dashboard ceph cwd unknown /proc/31148/task/83181/cwd (readlink: Permission denied) 2024-09-12T01:30:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83181 dashboard ceph rtd unknown /proc/31148/task/83181/root (readlink: Permission denied) 2024-09-12T01:30:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83181 dashboard ceph txt unknown /proc/31148/task/83181/exe (readlink: Permission denied) 2024-09-12T01:30:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83181 dashboard ceph NOFD /proc/31148/task/83181/fd (opendir: Permission denied) 2024-09-12T01:30:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83182 dashboard ceph cwd unknown /proc/31148/task/83182/cwd (readlink: Permission denied) 2024-09-12T01:30:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83182 dashboard ceph rtd unknown /proc/31148/task/83182/root (readlink: Permission denied) 2024-09-12T01:30:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83182 dashboard ceph txt unknown /proc/31148/task/83182/exe (readlink: Permission denied) 2024-09-12T01:30:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83182 dashboard ceph NOFD /proc/31148/task/83182/fd (opendir: Permission denied) 2024-09-12T01:30:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83253 dashboard ceph cwd unknown /proc/31148/task/83253/cwd (readlink: Permission denied) 2024-09-12T01:30:25.576 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83253 dashboard ceph rtd unknown /proc/31148/task/83253/root (readlink: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83253 dashboard ceph txt unknown /proc/31148/task/83253/exe (readlink: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83253 dashboard ceph NOFD /proc/31148/task/83253/fd (opendir: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83388 mgr-fin ceph cwd unknown /proc/31148/task/83388/cwd (readlink: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83388 mgr-fin ceph rtd unknown /proc/31148/task/83388/root (readlink: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83388 mgr-fin ceph txt unknown /proc/31148/task/83388/exe (readlink: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83388 mgr-fin ceph NOFD /proc/31148/task/83388/fd (opendir: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83389 mgr-fin ceph cwd unknown /proc/31148/task/83389/cwd (readlink: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83389 mgr-fin ceph rtd unknown /proc/31148/task/83389/root (readlink: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83389 mgr-fin ceph txt unknown /proc/31148/task/83389/exe (readlink: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83389 mgr-fin ceph NOFD /proc/31148/task/83389/fd (opendir: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83390 mgr-fin ceph cwd unknown /proc/31148/task/83390/cwd (readlink: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83390 mgr-fin ceph rtd unknown /proc/31148/task/83390/root (readlink: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83390 mgr-fin ceph txt unknown /proc/31148/task/83390/exe (readlink: Permission denied) 2024-09-12T01:30:25.577 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83390 mgr-fin ceph NOFD /proc/31148/task/83390/fd (opendir: Permission denied) 2024-09-12T01:30:25.578 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83391 mgr-fin ceph cwd unknown /proc/31148/task/83391/cwd (readlink: Permission denied) 2024-09-12T01:30:25.578 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83391 mgr-fin ceph rtd unknown /proc/31148/task/83391/root (readlink: Permission denied) 2024-09-12T01:30:25.578 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83391 mgr-fin ceph txt unknown /proc/31148/task/83391/exe (readlink: Permission denied) 2024-09-12T01:30:25.578 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83391 mgr-fin ceph NOFD /proc/31148/task/83391/fd (opendir: Permission denied) 2024-09-12T01:30:25.578 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83392 mgr-fin ceph cwd unknown /proc/31148/task/83392/cwd (readlink: Permission denied) 2024-09-12T01:30:25.578 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83392 mgr-fin ceph rtd unknown /proc/31148/task/83392/root (readlink: Permission denied) 2024-09-12T01:30:25.578 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83392 mgr-fin ceph txt unknown /proc/31148/task/83392/exe (readlink: Permission denied) 2024-09-12T01:30:25.578 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83392 mgr-fin ceph NOFD /proc/31148/task/83392/fd (opendir: Permission denied) 2024-09-12T01:30:25.578 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83393 mgr-fin ceph cwd unknown /proc/31148/task/83393/cwd (readlink: Permission denied) 2024-09-12T01:30:25.578 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83393 mgr-fin ceph rtd unknown /proc/31148/task/83393/root (readlink: Permission denied) 2024-09-12T01:30:25.578 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83393 mgr-fin ceph txt unknown /proc/31148/task/83393/exe (readlink: Permission denied) 2024-09-12T01:30:25.578 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83393 mgr-fin ceph NOFD /proc/31148/task/83393/fd (opendir: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83394 mgr-fin ceph cwd unknown /proc/31148/task/83394/cwd (readlink: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83394 mgr-fin ceph rtd unknown /proc/31148/task/83394/root (readlink: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83394 mgr-fin ceph txt unknown /proc/31148/task/83394/exe (readlink: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83394 mgr-fin ceph NOFD /proc/31148/task/83394/fd (opendir: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83395 mgr-fin ceph cwd unknown /proc/31148/task/83395/cwd (readlink: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83395 mgr-fin ceph rtd unknown /proc/31148/task/83395/root (readlink: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83395 mgr-fin ceph txt unknown /proc/31148/task/83395/exe (readlink: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83395 mgr-fin ceph NOFD /proc/31148/task/83395/fd (opendir: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83396 mgr-fin ceph cwd unknown /proc/31148/task/83396/cwd (readlink: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83396 mgr-fin ceph rtd unknown /proc/31148/task/83396/root (readlink: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83396 mgr-fin ceph txt unknown /proc/31148/task/83396/exe (readlink: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83396 mgr-fin ceph NOFD /proc/31148/task/83396/fd (opendir: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83397 mgr-fin ceph cwd unknown /proc/31148/task/83397/cwd (readlink: Permission denied) 2024-09-12T01:30:25.579 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83397 mgr-fin ceph rtd unknown /proc/31148/task/83397/root (readlink: Permission denied) 2024-09-12T01:30:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83397 mgr-fin ceph txt unknown /proc/31148/task/83397/exe (readlink: Permission denied) 2024-09-12T01:30:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83397 mgr-fin ceph NOFD /proc/31148/task/83397/fd (opendir: Permission denied) 2024-09-12T01:30:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83398 mgr-fin ceph cwd unknown /proc/31148/task/83398/cwd (readlink: Permission denied) 2024-09-12T01:30:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83398 mgr-fin ceph rtd unknown /proc/31148/task/83398/root (readlink: Permission denied) 2024-09-12T01:30:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83398 mgr-fin ceph txt unknown /proc/31148/task/83398/exe (readlink: Permission denied) 2024-09-12T01:30:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83398 mgr-fin ceph NOFD /proc/31148/task/83398/fd (opendir: Permission denied) 2024-09-12T01:30:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83400 mgr-fin ceph cwd unknown /proc/31148/task/83400/cwd (readlink: Permission denied) 2024-09-12T01:30:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83400 mgr-fin ceph rtd unknown /proc/31148/task/83400/root (readlink: Permission denied) 2024-09-12T01:30:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83400 mgr-fin ceph txt unknown /proc/31148/task/83400/exe (readlink: Permission denied) 2024-09-12T01:30:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83400 mgr-fin ceph NOFD /proc/31148/task/83400/fd (opendir: Permission denied) 2024-09-12T01:30:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83401 mgr-fin ceph cwd unknown /proc/31148/task/83401/cwd (readlink: Permission denied) 2024-09-12T01:30:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83401 mgr-fin ceph rtd unknown /proc/31148/task/83401/root (readlink: Permission denied) 2024-09-12T01:30:25.580 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83401 mgr-fin ceph txt unknown /proc/31148/task/83401/exe (readlink: Permission denied) 2024-09-12T01:30:25.581 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83401 mgr-fin ceph NOFD /proc/31148/task/83401/fd (opendir: Permission denied) 2024-09-12T01:30:25.581 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83402 mgr-fin ceph cwd unknown /proc/31148/task/83402/cwd (readlink: Permission denied) 2024-09-12T01:30:25.581 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83402 mgr-fin ceph rtd unknown /proc/31148/task/83402/root (readlink: Permission denied) 2024-09-12T01:30:25.581 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83402 mgr-fin ceph txt unknown /proc/31148/task/83402/exe (readlink: Permission denied) 2024-09-12T01:30:25.581 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83402 mgr-fin ceph NOFD /proc/31148/task/83402/fd (opendir: Permission denied) 2024-09-12T01:30:25.581 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83403 mgr-fin ceph cwd unknown /proc/31148/task/83403/cwd (readlink: Permission denied) 2024-09-12T01:30:25.581 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83403 mgr-fin ceph rtd unknown /proc/31148/task/83403/root (readlink: Permission denied) 2024-09-12T01:30:25.581 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83403 mgr-fin ceph txt unknown /proc/31148/task/83403/exe (readlink: Permission denied) 2024-09-12T01:30:25.581 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83403 mgr-fin ceph NOFD /proc/31148/task/83403/fd (opendir: Permission denied) 2024-09-12T01:30:25.581 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83404 mgr-fin ceph cwd unknown /proc/31148/task/83404/cwd (readlink: Permission denied) 2024-09-12T01:30:25.581 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83404 mgr-fin ceph rtd unknown /proc/31148/task/83404/root (readlink: Permission denied) 2024-09-12T01:30:25.581 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83404 mgr-fin ceph txt unknown /proc/31148/task/83404/exe (readlink: Permission denied) 2024-09-12T01:30:25.581 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83404 mgr-fin ceph NOFD /proc/31148/task/83404/fd (opendir: Permission denied) 2024-09-12T01:30:25.582 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83405 mgr-fin ceph cwd unknown /proc/31148/task/83405/cwd (readlink: Permission denied) 2024-09-12T01:30:25.582 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83405 mgr-fin ceph rtd unknown /proc/31148/task/83405/root (readlink: Permission denied) 2024-09-12T01:30:25.582 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83405 mgr-fin ceph txt unknown /proc/31148/task/83405/exe (readlink: Permission denied) 2024-09-12T01:30:25.582 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83405 mgr-fin ceph NOFD /proc/31148/task/83405/fd (opendir: Permission denied) 2024-09-12T01:30:25.582 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83406 mgr-fin ceph cwd unknown /proc/31148/task/83406/cwd (readlink: Permission denied) 2024-09-12T01:30:25.582 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83406 mgr-fin ceph rtd unknown /proc/31148/task/83406/root (readlink: Permission denied) 2024-09-12T01:30:25.582 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83406 mgr-fin ceph txt unknown /proc/31148/task/83406/exe (readlink: Permission denied) 2024-09-12T01:30:25.582 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83406 mgr-fin ceph NOFD /proc/31148/task/83406/fd (opendir: Permission denied) 2024-09-12T01:30:25.582 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83407 mgr-fin ceph cwd unknown /proc/31148/task/83407/cwd (readlink: Permission denied) 2024-09-12T01:30:25.582 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83407 mgr-fin ceph rtd unknown /proc/31148/task/83407/root (readlink: Permission denied) 2024-09-12T01:30:25.582 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83407 mgr-fin ceph txt unknown /proc/31148/task/83407/exe (readlink: Permission denied) 2024-09-12T01:30:25.582 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83407 mgr-fin ceph NOFD /proc/31148/task/83407/fd (opendir: Permission denied) 2024-09-12T01:30:25.583 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83408 mgr-fin ceph cwd unknown /proc/31148/task/83408/cwd (readlink: Permission denied) 2024-09-12T01:30:25.583 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83408 mgr-fin ceph rtd unknown /proc/31148/task/83408/root (readlink: Permission denied) 2024-09-12T01:30:25.583 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83408 mgr-fin ceph txt unknown /proc/31148/task/83408/exe (readlink: Permission denied) 2024-09-12T01:30:25.583 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83408 mgr-fin ceph NOFD /proc/31148/task/83408/fd (opendir: Permission denied) 2024-09-12T01:30:25.583 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83409 mgr-fin ceph cwd unknown /proc/31148/task/83409/cwd (readlink: Permission denied) 2024-09-12T01:30:25.583 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83409 mgr-fin ceph rtd unknown /proc/31148/task/83409/root (readlink: Permission denied) 2024-09-12T01:30:25.583 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83409 mgr-fin ceph txt unknown /proc/31148/task/83409/exe (readlink: Permission denied) 2024-09-12T01:30:25.583 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83409 mgr-fin ceph NOFD /proc/31148/task/83409/fd (opendir: Permission denied) 2024-09-12T01:30:25.583 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83410 mgr-fin ceph cwd unknown /proc/31148/task/83410/cwd (readlink: Permission denied) 2024-09-12T01:30:25.583 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83410 mgr-fin ceph rtd unknown /proc/31148/task/83410/root (readlink: Permission denied) 2024-09-12T01:30:25.583 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83410 mgr-fin ceph txt unknown /proc/31148/task/83410/exe (readlink: Permission denied) 2024-09-12T01:30:25.583 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83410 mgr-fin ceph NOFD /proc/31148/task/83410/fd (opendir: Permission denied) 2024-09-12T01:30:25.583 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83428 devicehea ceph cwd unknown /proc/31148/task/83428/cwd (readlink: Permission denied) 2024-09-12T01:30:25.584 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83428 devicehea ceph rtd unknown /proc/31148/task/83428/root (readlink: Permission denied) 2024-09-12T01:30:25.584 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83428 devicehea ceph txt unknown /proc/31148/task/83428/exe (readlink: Permission denied) 2024-09-12T01:30:25.584 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83428 devicehea ceph NOFD /proc/31148/task/83428/fd (opendir: Permission denied) 2024-09-12T01:30:25.584 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83432 io_contex ceph cwd unknown /proc/31148/task/83432/cwd (readlink: Permission denied) 2024-09-12T01:30:25.584 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83432 io_contex ceph rtd unknown /proc/31148/task/83432/root (readlink: Permission denied) 2024-09-12T01:30:25.584 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83432 io_contex ceph txt unknown /proc/31148/task/83432/exe (readlink: Permission denied) 2024-09-12T01:30:25.584 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83432 io_contex ceph NOFD /proc/31148/task/83432/fd (opendir: Permission denied) 2024-09-12T01:30:25.584 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83433 io_contex ceph cwd unknown /proc/31148/task/83433/cwd (readlink: Permission denied) 2024-09-12T01:30:25.584 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83433 io_contex ceph rtd unknown /proc/31148/task/83433/root (readlink: Permission denied) 2024-09-12T01:30:25.584 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83433 io_contex ceph txt unknown /proc/31148/task/83433/exe (readlink: Permission denied) 2024-09-12T01:30:25.584 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83433 io_contex ceph NOFD /proc/31148/task/83433/fd (opendir: Permission denied) 2024-09-12T01:30:25.584 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83434 ceph_time ceph cwd unknown /proc/31148/task/83434/cwd (readlink: Permission denied) 2024-09-12T01:30:25.584 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83434 ceph_time ceph rtd unknown /proc/31148/task/83434/root (readlink: Permission denied) 2024-09-12T01:30:25.585 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83434 ceph_time ceph txt unknown /proc/31148/task/83434/exe (readlink: Permission denied) 2024-09-12T01:30:25.585 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83434 ceph_time ceph NOFD /proc/31148/task/83434/fd (opendir: Permission denied) 2024-09-12T01:30:25.585 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83435 ms_dispat ceph cwd unknown /proc/31148/task/83435/cwd (readlink: Permission denied) 2024-09-12T01:30:25.585 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83435 ms_dispat ceph rtd unknown /proc/31148/task/83435/root (readlink: Permission denied) 2024-09-12T01:30:25.585 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83435 ms_dispat ceph txt unknown /proc/31148/task/83435/exe (readlink: Permission denied) 2024-09-12T01:30:25.585 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83435 ms_dispat ceph NOFD /proc/31148/task/83435/fd (opendir: Permission denied) 2024-09-12T01:30:25.585 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83436 ms_local ceph cwd unknown /proc/31148/task/83436/cwd (readlink: Permission denied) 2024-09-12T01:30:25.585 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83436 ms_local ceph rtd unknown /proc/31148/task/83436/root (readlink: Permission denied) 2024-09-12T01:30:25.585 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83436 ms_local ceph txt unknown /proc/31148/task/83436/exe (readlink: Permission denied) 2024-09-12T01:30:25.585 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83436 ms_local ceph NOFD /proc/31148/task/83436/fd (opendir: Permission denied) 2024-09-12T01:30:25.585 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83437 safe_time ceph cwd unknown /proc/31148/task/83437/cwd (readlink: Permission denied) 2024-09-12T01:30:25.585 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83437 safe_time ceph rtd unknown /proc/31148/task/83437/root (readlink: Permission denied) 2024-09-12T01:30:25.585 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83437 safe_time ceph txt unknown /proc/31148/task/83437/exe (readlink: Permission denied) 2024-09-12T01:30:25.586 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83437 safe_time ceph NOFD /proc/31148/task/83437/fd (opendir: Permission denied) 2024-09-12T01:30:25.586 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83438 safe_time ceph cwd unknown /proc/31148/task/83438/cwd (readlink: Permission denied) 2024-09-12T01:30:25.586 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83438 safe_time ceph rtd unknown /proc/31148/task/83438/root (readlink: Permission denied) 2024-09-12T01:30:25.586 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83438 safe_time ceph txt unknown /proc/31148/task/83438/exe (readlink: Permission denied) 2024-09-12T01:30:25.586 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 83438 safe_time ceph NOFD /proc/31148/task/83438/fd (opendir: Permission denied) 2024-09-12T01:30:25.586 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88521 ceph_time ceph cwd unknown /proc/31148/task/88521/cwd (readlink: Permission denied) 2024-09-12T01:30:25.586 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88521 ceph_time ceph rtd unknown /proc/31148/task/88521/root (readlink: Permission denied) 2024-09-12T01:30:25.586 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88521 ceph_time ceph txt unknown /proc/31148/task/88521/exe (readlink: Permission denied) 2024-09-12T01:30:25.586 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88521 ceph_time ceph NOFD /proc/31148/task/88521/fd (opendir: Permission denied) 2024-09-12T01:30:25.586 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88522 fn_anonym ceph cwd unknown /proc/31148/task/88522/cwd (readlink: Permission denied) 2024-09-12T01:30:25.586 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88522 fn_anonym ceph rtd unknown /proc/31148/task/88522/root (readlink: Permission denied) 2024-09-12T01:30:25.586 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88522 fn_anonym ceph txt unknown /proc/31148/task/88522/exe (readlink: Permission denied) 2024-09-12T01:30:25.587 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88522 fn_anonym ceph NOFD /proc/31148/task/88522/fd (opendir: Permission denied) 2024-09-12T01:30:25.587 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88523 safe_time ceph cwd unknown /proc/31148/task/88523/cwd (readlink: Permission denied) 2024-09-12T01:30:25.587 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88523 safe_time ceph rtd unknown /proc/31148/task/88523/root (readlink: Permission denied) 2024-09-12T01:30:25.587 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88523 safe_time ceph txt unknown /proc/31148/task/88523/exe (readlink: Permission denied) 2024-09-12T01:30:25.587 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88523 safe_time ceph NOFD /proc/31148/task/88523/fd (opendir: Permission denied) 2024-09-12T01:30:25.587 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88524 fn_anonym ceph cwd unknown /proc/31148/task/88524/cwd (readlink: Permission denied) 2024-09-12T01:30:25.587 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88524 fn_anonym ceph rtd unknown /proc/31148/task/88524/root (readlink: Permission denied) 2024-09-12T01:30:25.587 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88524 fn_anonym ceph txt unknown /proc/31148/task/88524/exe (readlink: Permission denied) 2024-09-12T01:30:25.587 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88524 fn_anonym ceph NOFD /proc/31148/task/88524/fd (opendir: Permission denied) 2024-09-12T01:30:25.587 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88525 flusher ceph cwd unknown /proc/31148/task/88525/cwd (readlink: Permission denied) 2024-09-12T01:30:25.587 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88525 flusher ceph rtd unknown /proc/31148/task/88525/root (readlink: Permission denied) 2024-09-12T01:30:25.587 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88525 flusher ceph txt unknown /proc/31148/task/88525/exe (readlink: Permission denied) 2024-09-12T01:30:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88525 flusher ceph NOFD /proc/31148/task/88525/fd (opendir: Permission denied) 2024-09-12T01:30:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88526 ms_dispat ceph cwd unknown /proc/31148/task/88526/cwd (readlink: Permission denied) 2024-09-12T01:30:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88526 ms_dispat ceph rtd unknown /proc/31148/task/88526/root (readlink: Permission denied) 2024-09-12T01:30:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88526 ms_dispat ceph txt unknown /proc/31148/task/88526/exe (readlink: Permission denied) 2024-09-12T01:30:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88526 ms_dispat ceph NOFD /proc/31148/task/88526/fd (opendir: Permission denied) 2024-09-12T01:30:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88527 ms_local ceph cwd unknown /proc/31148/task/88527/cwd (readlink: Permission denied) 2024-09-12T01:30:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88527 ms_local ceph rtd unknown /proc/31148/task/88527/root (readlink: Permission denied) 2024-09-12T01:30:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88527 ms_local ceph txt unknown /proc/31148/task/88527/exe (readlink: Permission denied) 2024-09-12T01:30:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88527 ms_local ceph NOFD /proc/31148/task/88527/fd (opendir: Permission denied) 2024-09-12T01:30:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88528 safe_time ceph cwd unknown /proc/31148/task/88528/cwd (readlink: Permission denied) 2024-09-12T01:30:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88528 safe_time ceph rtd unknown /proc/31148/task/88528/root (readlink: Permission denied) 2024-09-12T01:30:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88528 safe_time ceph txt unknown /proc/31148/task/88528/exe (readlink: Permission denied) 2024-09-12T01:30:25.588 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88528 safe_time ceph NOFD /proc/31148/task/88528/fd (opendir: Permission denied) 2024-09-12T01:30:25.589 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88529 m-fin-sna ceph cwd unknown /proc/31148/task/88529/cwd (readlink: Permission denied) 2024-09-12T01:30:25.589 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88529 m-fin-sna ceph rtd unknown /proc/31148/task/88529/root (readlink: Permission denied) 2024-09-12T01:30:25.589 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88529 m-fin-sna ceph txt unknown /proc/31148/task/88529/exe (readlink: Permission denied) 2024-09-12T01:30:25.589 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 88529 m-fin-sna ceph NOFD /proc/31148/task/88529/fd (opendir: Permission denied) 2024-09-12T01:30:25.589 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 90525 m-fin-sna ceph cwd unknown /proc/31148/task/90525/cwd (readlink: Permission denied) 2024-09-12T01:30:25.589 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 90525 m-fin-sna ceph rtd unknown /proc/31148/task/90525/root (readlink: Permission denied) 2024-09-12T01:30:25.589 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 90525 m-fin-sna ceph txt unknown /proc/31148/task/90525/exe (readlink: Permission denied) 2024-09-12T01:30:25.589 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mgr 31148 90525 m-fin-sna ceph NOFD /proc/31148/task/90525/fd (opendir: Permission denied) 2024-09-12T01:30:25.589 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 31628 root cwd unknown /proc/31628/cwd (readlink: Permission denied) 2024-09-12T01:30:25.589 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 31628 root rtd unknown /proc/31628/root (readlink: Permission denied) 2024-09-12T01:30:25.589 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 31628 root txt unknown /proc/31628/exe (readlink: Permission denied) 2024-09-12T01:30:25.589 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 31628 root NOFD /proc/31628/fd (opendir: Permission denied) 2024-09-12T01:30:25.590 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 32104 root cwd unknown /proc/32104/cwd (readlink: Permission denied) 2024-09-12T01:30:25.590 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 32104 root rtd unknown /proc/32104/root (readlink: Permission denied) 2024-09-12T01:30:25.590 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 32104 root txt unknown /proc/32104/exe (readlink: Permission denied) 2024-09-12T01:30:25.590 INFO:tasks.workunit.client.0.smithi081.stdout:systemd 32104 root NOFD /proc/32104/fd (opendir: Permission denied) 2024-09-12T01:30:25.590 INFO:tasks.workunit.client.0.smithi081.stdout:(sd-pam) 32106 root cwd unknown /proc/32106/cwd (readlink: Permission denied) 2024-09-12T01:30:25.590 INFO:tasks.workunit.client.0.smithi081.stdout:(sd-pam) 32106 root rtd unknown /proc/32106/root (readlink: Permission denied) 2024-09-12T01:30:25.590 INFO:tasks.workunit.client.0.smithi081.stdout:(sd-pam) 32106 root txt unknown /proc/32106/exe (readlink: Permission denied) 2024-09-12T01:30:25.590 INFO:tasks.workunit.client.0.smithi081.stdout:(sd-pam) 32106 root NOFD /proc/32106/fd (opendir: Permission denied) 2024-09-12T01:30:25.590 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 32511 root cwd unknown /proc/32511/cwd (readlink: Permission denied) 2024-09-12T01:30:25.590 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 32511 root rtd unknown /proc/32511/root (readlink: Permission denied) 2024-09-12T01:30:25.590 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 32511 root txt unknown /proc/32511/exe (readlink: Permission denied) 2024-09-12T01:30:25.590 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/4 32511 root NOFD /proc/32511/fd (opendir: Permission denied) 2024-09-12T01:30:25.591 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 45200 root cwd unknown /proc/45200/cwd (readlink: Permission denied) 2024-09-12T01:30:25.591 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 45200 root rtd unknown /proc/45200/root (readlink: Permission denied) 2024-09-12T01:30:25.591 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 45200 root txt unknown /proc/45200/exe (readlink: Permission denied) 2024-09-12T01:30:25.591 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 45200 root NOFD /proc/45200/fd (opendir: Permission denied) 2024-09-12T01:30:25.591 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 45202 root cwd unknown /proc/45202/cwd (readlink: Permission denied) 2024-09-12T01:30:25.591 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 45202 root rtd unknown /proc/45202/root (readlink: Permission denied) 2024-09-12T01:30:25.591 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 45202 root txt unknown /proc/45202/exe (readlink: Permission denied) 2024-09-12T01:30:25.591 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 45202 root NOFD /proc/45202/fd (opendir: Permission denied) 2024-09-12T01:30:25.591 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 ceph cwd unknown /proc/45204/cwd (readlink: Permission denied) 2024-09-12T01:30:25.591 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 ceph rtd unknown /proc/45204/root (readlink: Permission denied) 2024-09-12T01:30:25.591 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 ceph txt unknown /proc/45204/exe (readlink: Permission denied) 2024-09-12T01:30:25.591 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 ceph NOFD /proc/45204/fd (opendir: Permission denied) 2024-09-12T01:30:25.591 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45205 log ceph cwd unknown /proc/45204/task/45205/cwd (readlink: Permission denied) 2024-09-12T01:30:25.592 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45205 log ceph rtd unknown /proc/45204/task/45205/root (readlink: Permission denied) 2024-09-12T01:30:25.592 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45205 log ceph txt unknown /proc/45204/task/45205/exe (readlink: Permission denied) 2024-09-12T01:30:25.592 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45205 log ceph NOFD /proc/45204/task/45205/fd (opendir: Permission denied) 2024-09-12T01:30:25.592 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45207 msgr-work ceph cwd unknown /proc/45204/task/45207/cwd (readlink: Permission denied) 2024-09-12T01:30:25.592 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45207 msgr-work ceph rtd unknown /proc/45204/task/45207/root (readlink: Permission denied) 2024-09-12T01:30:25.592 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45207 msgr-work ceph txt unknown /proc/45204/task/45207/exe (readlink: Permission denied) 2024-09-12T01:30:25.592 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45207 msgr-work ceph NOFD /proc/45204/task/45207/fd (opendir: Permission denied) 2024-09-12T01:30:25.592 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45208 msgr-work ceph cwd unknown /proc/45204/task/45208/cwd (readlink: Permission denied) 2024-09-12T01:30:25.592 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45208 msgr-work ceph rtd unknown /proc/45204/task/45208/root (readlink: Permission denied) 2024-09-12T01:30:25.592 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45208 msgr-work ceph txt unknown /proc/45204/task/45208/exe (readlink: Permission denied) 2024-09-12T01:30:25.592 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45208 msgr-work ceph NOFD /proc/45204/task/45208/fd (opendir: Permission denied) 2024-09-12T01:30:25.592 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45209 msgr-work ceph cwd unknown /proc/45204/task/45209/cwd (readlink: Permission denied) 2024-09-12T01:30:25.592 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45209 msgr-work ceph rtd unknown /proc/45204/task/45209/root (readlink: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45209 msgr-work ceph txt unknown /proc/45204/task/45209/exe (readlink: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45209 msgr-work ceph NOFD /proc/45204/task/45209/fd (opendir: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45213 service ceph cwd unknown /proc/45204/task/45213/cwd (readlink: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45213 service ceph rtd unknown /proc/45204/task/45213/root (readlink: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45213 service ceph txt unknown /proc/45204/task/45213/exe (readlink: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45213 service ceph NOFD /proc/45204/task/45213/fd (opendir: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45214 admin_soc ceph cwd unknown /proc/45204/task/45214/cwd (readlink: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45214 admin_soc ceph rtd unknown /proc/45204/task/45214/root (readlink: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45214 admin_soc ceph txt unknown /proc/45204/task/45214/exe (readlink: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45214 admin_soc ceph NOFD /proc/45204/task/45214/fd (opendir: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45580 signal_ha ceph cwd unknown /proc/45204/task/45580/cwd (readlink: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45580 signal_ha ceph rtd unknown /proc/45204/task/45580/root (readlink: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45580 signal_ha ceph txt unknown /proc/45204/task/45580/exe (readlink: Permission denied) 2024-09-12T01:30:25.593 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45580 signal_ha ceph NOFD /proc/45204/task/45580/fd (opendir: Permission denied) 2024-09-12T01:30:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45581 io_contex ceph cwd unknown /proc/45204/task/45581/cwd (readlink: Permission denied) 2024-09-12T01:30:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45581 io_contex ceph rtd unknown /proc/45204/task/45581/root (readlink: Permission denied) 2024-09-12T01:30:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45581 io_contex ceph txt unknown /proc/45204/task/45581/exe (readlink: Permission denied) 2024-09-12T01:30:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45581 io_contex ceph NOFD /proc/45204/task/45581/fd (opendir: Permission denied) 2024-09-12T01:30:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45582 io_contex ceph cwd unknown /proc/45204/task/45582/cwd (readlink: Permission denied) 2024-09-12T01:30:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45582 io_contex ceph rtd unknown /proc/45204/task/45582/root (readlink: Permission denied) 2024-09-12T01:30:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45582 io_contex ceph txt unknown /proc/45204/task/45582/exe (readlink: Permission denied) 2024-09-12T01:30:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45582 io_contex ceph NOFD /proc/45204/task/45582/fd (opendir: Permission denied) 2024-09-12T01:30:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45587 OpHistory ceph cwd unknown /proc/45204/task/45587/cwd (readlink: Permission denied) 2024-09-12T01:30:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45587 OpHistory ceph rtd unknown /proc/45204/task/45587/root (readlink: Permission denied) 2024-09-12T01:30:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45587 OpHistory ceph txt unknown /proc/45204/task/45587/exe (readlink: Permission denied) 2024-09-12T01:30:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45587 OpHistory ceph NOFD /proc/45204/task/45587/fd (opendir: Permission denied) 2024-09-12T01:30:25.594 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45588 ceph_time ceph cwd unknown /proc/45204/task/45588/cwd (readlink: Permission denied) 2024-09-12T01:30:25.595 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45588 ceph_time ceph rtd unknown /proc/45204/task/45588/root (readlink: Permission denied) 2024-09-12T01:30:25.595 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45588 ceph_time ceph txt unknown /proc/45204/task/45588/exe (readlink: Permission denied) 2024-09-12T01:30:25.595 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45588 ceph_time ceph NOFD /proc/45204/task/45588/fd (opendir: Permission denied) 2024-09-12T01:30:25.595 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45742 ceph-osd ceph cwd unknown /proc/45204/task/45742/cwd (readlink: Permission denied) 2024-09-12T01:30:25.595 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45742 ceph-osd ceph rtd unknown /proc/45204/task/45742/root (readlink: Permission denied) 2024-09-12T01:30:25.595 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45742 ceph-osd ceph txt unknown /proc/45204/task/45742/exe (readlink: Permission denied) 2024-09-12T01:30:25.595 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45742 ceph-osd ceph NOFD /proc/45204/task/45742/fd (opendir: Permission denied) 2024-09-12T01:30:25.595 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45743 safe_time ceph cwd unknown /proc/45204/task/45743/cwd (readlink: Permission denied) 2024-09-12T01:30:25.595 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45743 safe_time ceph rtd unknown /proc/45204/task/45743/root (readlink: Permission denied) 2024-09-12T01:30:25.595 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45743 safe_time ceph txt unknown /proc/45204/task/45743/exe (readlink: Permission denied) 2024-09-12T01:30:25.595 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45743 safe_time ceph NOFD /proc/45204/task/45743/fd (opendir: Permission denied) 2024-09-12T01:30:25.595 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45744 safe_time ceph cwd unknown /proc/45204/task/45744/cwd (readlink: Permission denied) 2024-09-12T01:30:25.595 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45744 safe_time ceph rtd unknown /proc/45204/task/45744/root (readlink: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45744 safe_time ceph txt unknown /proc/45204/task/45744/exe (readlink: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45744 safe_time ceph NOFD /proc/45204/task/45744/fd (opendir: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45745 safe_time ceph cwd unknown /proc/45204/task/45745/cwd (readlink: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45745 safe_time ceph rtd unknown /proc/45204/task/45745/root (readlink: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45745 safe_time ceph txt unknown /proc/45204/task/45745/exe (readlink: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45745 safe_time ceph NOFD /proc/45204/task/45745/fd (opendir: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45746 safe_time ceph cwd unknown /proc/45204/task/45746/cwd (readlink: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45746 safe_time ceph rtd unknown /proc/45204/task/45746/root (readlink: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45746 safe_time ceph txt unknown /proc/45204/task/45746/exe (readlink: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45746 safe_time ceph NOFD /proc/45204/task/45746/fd (opendir: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45747 fn_anonym ceph cwd unknown /proc/45204/task/45747/cwd (readlink: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45747 fn_anonym ceph rtd unknown /proc/45204/task/45747/root (readlink: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45747 fn_anonym ceph txt unknown /proc/45204/task/45747/exe (readlink: Permission denied) 2024-09-12T01:30:25.596 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45747 fn_anonym ceph NOFD /proc/45204/task/45747/fd (opendir: Permission denied) 2024-09-12T01:30:25.597 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45884 rocksdb:l ceph cwd unknown /proc/45204/task/45884/cwd (readlink: Permission denied) 2024-09-12T01:30:25.597 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45884 rocksdb:l ceph rtd unknown /proc/45204/task/45884/root (readlink: Permission denied) 2024-09-12T01:30:25.597 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45884 rocksdb:l ceph txt unknown /proc/45204/task/45884/exe (readlink: Permission denied) 2024-09-12T01:30:25.597 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45884 rocksdb:l ceph NOFD /proc/45204/task/45884/fd (opendir: Permission denied) 2024-09-12T01:30:25.597 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45885 rocksdb:l ceph cwd unknown /proc/45204/task/45885/cwd (readlink: Permission denied) 2024-09-12T01:30:25.597 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45885 rocksdb:l ceph rtd unknown /proc/45204/task/45885/root (readlink: Permission denied) 2024-09-12T01:30:25.597 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45885 rocksdb:l ceph txt unknown /proc/45204/task/45885/exe (readlink: Permission denied) 2024-09-12T01:30:25.597 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45885 rocksdb:l ceph NOFD /proc/45204/task/45885/fd (opendir: Permission denied) 2024-09-12T01:30:25.597 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45886 rocksdb:l ceph cwd unknown /proc/45204/task/45886/cwd (readlink: Permission denied) 2024-09-12T01:30:25.597 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45886 rocksdb:l ceph rtd unknown /proc/45204/task/45886/root (readlink: Permission denied) 2024-09-12T01:30:25.597 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45886 rocksdb:l ceph txt unknown /proc/45204/task/45886/exe (readlink: Permission denied) 2024-09-12T01:30:25.597 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45886 rocksdb:l ceph NOFD /proc/45204/task/45886/fd (opendir: Permission denied) 2024-09-12T01:30:25.597 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45887 rocksdb:h ceph cwd unknown /proc/45204/task/45887/cwd (readlink: Permission denied) 2024-09-12T01:30:25.598 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45887 rocksdb:h ceph rtd unknown /proc/45204/task/45887/root (readlink: Permission denied) 2024-09-12T01:30:25.598 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45887 rocksdb:h ceph txt unknown /proc/45204/task/45887/exe (readlink: Permission denied) 2024-09-12T01:30:25.598 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 45887 rocksdb:h ceph NOFD /proc/45204/task/45887/fd (opendir: Permission denied) 2024-09-12T01:30:25.598 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46305 bstore_ai ceph cwd unknown /proc/45204/task/46305/cwd (readlink: Permission denied) 2024-09-12T01:30:25.598 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46305 bstore_ai ceph rtd unknown /proc/45204/task/46305/root (readlink: Permission denied) 2024-09-12T01:30:25.598 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46305 bstore_ai ceph txt unknown /proc/45204/task/46305/exe (readlink: Permission denied) 2024-09-12T01:30:25.598 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46305 bstore_ai ceph NOFD /proc/45204/task/46305/fd (opendir: Permission denied) 2024-09-12T01:30:25.598 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46306 bstore_di ceph cwd unknown /proc/45204/task/46306/cwd (readlink: Permission denied) 2024-09-12T01:30:25.598 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46306 bstore_di ceph rtd unknown /proc/45204/task/46306/root (readlink: Permission denied) 2024-09-12T01:30:25.598 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46306 bstore_di ceph txt unknown /proc/45204/task/46306/exe (readlink: Permission denied) 2024-09-12T01:30:25.598 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46306 bstore_di ceph NOFD /proc/45204/task/46306/fd (opendir: Permission denied) 2024-09-12T01:30:25.598 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46511 bstore_ai ceph cwd unknown /proc/45204/task/46511/cwd (readlink: Permission denied) 2024-09-12T01:30:25.598 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46511 bstore_ai ceph rtd unknown /proc/45204/task/46511/root (readlink: Permission denied) 2024-09-12T01:30:25.599 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46511 bstore_ai ceph txt unknown /proc/45204/task/46511/exe (readlink: Permission denied) 2024-09-12T01:30:25.599 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46511 bstore_ai ceph NOFD /proc/45204/task/46511/fd (opendir: Permission denied) 2024-09-12T01:30:25.599 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46512 bstore_di ceph cwd unknown /proc/45204/task/46512/cwd (readlink: Permission denied) 2024-09-12T01:30:25.599 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46512 bstore_di ceph rtd unknown /proc/45204/task/46512/root (readlink: Permission denied) 2024-09-12T01:30:25.599 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46512 bstore_di ceph txt unknown /proc/45204/task/46512/exe (readlink: Permission denied) 2024-09-12T01:30:25.599 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46512 bstore_di ceph NOFD /proc/45204/task/46512/fd (opendir: Permission denied) 2024-09-12T01:30:25.599 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46694 ceph-osd ceph cwd unknown /proc/45204/task/46694/cwd (readlink: Permission denied) 2024-09-12T01:30:25.599 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46694 ceph-osd ceph rtd unknown /proc/45204/task/46694/root (readlink: Permission denied) 2024-09-12T01:30:25.599 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46694 ceph-osd ceph txt unknown /proc/45204/task/46694/exe (readlink: Permission denied) 2024-09-12T01:30:25.599 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46694 ceph-osd ceph NOFD /proc/45204/task/46694/fd (opendir: Permission denied) 2024-09-12T01:30:25.599 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46695 cfin ceph cwd unknown /proc/45204/task/46695/cwd (readlink: Permission denied) 2024-09-12T01:30:25.599 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46695 cfin ceph rtd unknown /proc/45204/task/46695/root (readlink: Permission denied) 2024-09-12T01:30:25.599 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46695 cfin ceph txt unknown /proc/45204/task/46695/exe (readlink: Permission denied) 2024-09-12T01:30:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46695 cfin ceph NOFD /proc/45204/task/46695/fd (opendir: Permission denied) 2024-09-12T01:30:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46696 bstore_kv ceph cwd unknown /proc/45204/task/46696/cwd (readlink: Permission denied) 2024-09-12T01:30:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46696 bstore_kv ceph rtd unknown /proc/45204/task/46696/root (readlink: Permission denied) 2024-09-12T01:30:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46696 bstore_kv ceph txt unknown /proc/45204/task/46696/exe (readlink: Permission denied) 2024-09-12T01:30:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46696 bstore_kv ceph NOFD /proc/45204/task/46696/fd (opendir: Permission denied) 2024-09-12T01:30:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46697 bstore_kv ceph cwd unknown /proc/45204/task/46697/cwd (readlink: Permission denied) 2024-09-12T01:30:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46697 bstore_kv ceph rtd unknown /proc/45204/task/46697/root (readlink: Permission denied) 2024-09-12T01:30:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46697 bstore_kv ceph txt unknown /proc/45204/task/46697/exe (readlink: Permission denied) 2024-09-12T01:30:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46697 bstore_kv ceph NOFD /proc/45204/task/46697/fd (opendir: Permission denied) 2024-09-12T01:30:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46698 bstore_me ceph cwd unknown /proc/45204/task/46698/cwd (readlink: Permission denied) 2024-09-12T01:30:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46698 bstore_me ceph rtd unknown /proc/45204/task/46698/root (readlink: Permission denied) 2024-09-12T01:30:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46698 bstore_me ceph txt unknown /proc/45204/task/46698/exe (readlink: Permission denied) 2024-09-12T01:30:25.600 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46698 bstore_me ceph NOFD /proc/45204/task/46698/fd (opendir: Permission denied) 2024-09-12T01:30:25.601 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46699 ms_dispat ceph cwd unknown /proc/45204/task/46699/cwd (readlink: Permission denied) 2024-09-12T01:30:25.601 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46699 ms_dispat ceph rtd unknown /proc/45204/task/46699/root (readlink: Permission denied) 2024-09-12T01:30:25.601 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46699 ms_dispat ceph txt unknown /proc/45204/task/46699/exe (readlink: Permission denied) 2024-09-12T01:30:25.601 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46699 ms_dispat ceph NOFD /proc/45204/task/46699/fd (opendir: Permission denied) 2024-09-12T01:30:25.601 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46700 ms_local ceph cwd unknown /proc/45204/task/46700/cwd (readlink: Permission denied) 2024-09-12T01:30:25.601 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46700 ms_local ceph rtd unknown /proc/45204/task/46700/root (readlink: Permission denied) 2024-09-12T01:30:25.601 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46700 ms_local ceph txt unknown /proc/45204/task/46700/exe (readlink: Permission denied) 2024-09-12T01:30:25.601 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46700 ms_local ceph NOFD /proc/45204/task/46700/fd (opendir: Permission denied) 2024-09-12T01:30:25.601 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46701 safe_time ceph cwd unknown /proc/45204/task/46701/cwd (readlink: Permission denied) 2024-09-12T01:30:25.601 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46701 safe_time ceph rtd unknown /proc/45204/task/46701/root (readlink: Permission denied) 2024-09-12T01:30:25.601 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46701 safe_time ceph txt unknown /proc/45204/task/46701/exe (readlink: Permission denied) 2024-09-12T01:30:25.601 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46701 safe_time ceph NOFD /proc/45204/task/46701/fd (opendir: Permission denied) 2024-09-12T01:30:25.601 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46702 safe_time ceph cwd unknown /proc/45204/task/46702/cwd (readlink: Permission denied) 2024-09-12T01:30:25.602 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46702 safe_time ceph rtd unknown /proc/45204/task/46702/root (readlink: Permission denied) 2024-09-12T01:30:25.602 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46702 safe_time ceph txt unknown /proc/45204/task/46702/exe (readlink: Permission denied) 2024-09-12T01:30:25.602 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46702 safe_time ceph NOFD /proc/45204/task/46702/fd (opendir: Permission denied) 2024-09-12T01:30:25.602 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46703 ms_dispat ceph cwd unknown /proc/45204/task/46703/cwd (readlink: Permission denied) 2024-09-12T01:30:25.602 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46703 ms_dispat ceph rtd unknown /proc/45204/task/46703/root (readlink: Permission denied) 2024-09-12T01:30:25.602 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46703 ms_dispat ceph txt unknown /proc/45204/task/46703/exe (readlink: Permission denied) 2024-09-12T01:30:25.602 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46703 ms_dispat ceph NOFD /proc/45204/task/46703/fd (opendir: Permission denied) 2024-09-12T01:30:25.602 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46704 ms_local ceph cwd unknown /proc/45204/task/46704/cwd (readlink: Permission denied) 2024-09-12T01:30:25.602 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46704 ms_local ceph rtd unknown /proc/45204/task/46704/root (readlink: Permission denied) 2024-09-12T01:30:25.602 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46704 ms_local ceph txt unknown /proc/45204/task/46704/exe (readlink: Permission denied) 2024-09-12T01:30:25.602 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46704 ms_local ceph NOFD /proc/45204/task/46704/fd (opendir: Permission denied) 2024-09-12T01:30:25.602 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46705 ms_dispat ceph cwd unknown /proc/45204/task/46705/cwd (readlink: Permission denied) 2024-09-12T01:30:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46705 ms_dispat ceph rtd unknown /proc/45204/task/46705/root (readlink: Permission denied) 2024-09-12T01:30:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46705 ms_dispat ceph txt unknown /proc/45204/task/46705/exe (readlink: Permission denied) 2024-09-12T01:30:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46705 ms_dispat ceph NOFD /proc/45204/task/46705/fd (opendir: Permission denied) 2024-09-12T01:30:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46706 ms_local ceph cwd unknown /proc/45204/task/46706/cwd (readlink: Permission denied) 2024-09-12T01:30:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46706 ms_local ceph rtd unknown /proc/45204/task/46706/root (readlink: Permission denied) 2024-09-12T01:30:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46706 ms_local ceph txt unknown /proc/45204/task/46706/exe (readlink: Permission denied) 2024-09-12T01:30:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46706 ms_local ceph NOFD /proc/45204/task/46706/fd (opendir: Permission denied) 2024-09-12T01:30:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46707 ms_dispat ceph cwd unknown /proc/45204/task/46707/cwd (readlink: Permission denied) 2024-09-12T01:30:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46707 ms_dispat ceph rtd unknown /proc/45204/task/46707/root (readlink: Permission denied) 2024-09-12T01:30:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46707 ms_dispat ceph txt unknown /proc/45204/task/46707/exe (readlink: Permission denied) 2024-09-12T01:30:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46707 ms_dispat ceph NOFD /proc/45204/task/46707/fd (opendir: Permission denied) 2024-09-12T01:30:25.603 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46708 ms_local ceph cwd unknown /proc/45204/task/46708/cwd (readlink: Permission denied) 2024-09-12T01:30:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46708 ms_local ceph rtd unknown /proc/45204/task/46708/root (readlink: Permission denied) 2024-09-12T01:30:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46708 ms_local ceph txt unknown /proc/45204/task/46708/exe (readlink: Permission denied) 2024-09-12T01:30:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46708 ms_local ceph NOFD /proc/45204/task/46708/fd (opendir: Permission denied) 2024-09-12T01:30:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46709 ms_dispat ceph cwd unknown /proc/45204/task/46709/cwd (readlink: Permission denied) 2024-09-12T01:30:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46709 ms_dispat ceph rtd unknown /proc/45204/task/46709/root (readlink: Permission denied) 2024-09-12T01:30:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46709 ms_dispat ceph txt unknown /proc/45204/task/46709/exe (readlink: Permission denied) 2024-09-12T01:30:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46709 ms_dispat ceph NOFD /proc/45204/task/46709/fd (opendir: Permission denied) 2024-09-12T01:30:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46710 ms_local ceph cwd unknown /proc/45204/task/46710/cwd (readlink: Permission denied) 2024-09-12T01:30:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46710 ms_local ceph rtd unknown /proc/45204/task/46710/root (readlink: Permission denied) 2024-09-12T01:30:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46710 ms_local ceph txt unknown /proc/45204/task/46710/exe (readlink: Permission denied) 2024-09-12T01:30:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46710 ms_local ceph NOFD /proc/45204/task/46710/fd (opendir: Permission denied) 2024-09-12T01:30:25.604 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46711 ms_dispat ceph cwd unknown /proc/45204/task/46711/cwd (readlink: Permission denied) 2024-09-12T01:30:25.605 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46711 ms_dispat ceph rtd unknown /proc/45204/task/46711/root (readlink: Permission denied) 2024-09-12T01:30:25.605 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46711 ms_dispat ceph txt unknown /proc/45204/task/46711/exe (readlink: Permission denied) 2024-09-12T01:30:25.605 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46711 ms_dispat ceph NOFD /proc/45204/task/46711/fd (opendir: Permission denied) 2024-09-12T01:30:25.605 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46712 ms_local ceph cwd unknown /proc/45204/task/46712/cwd (readlink: Permission denied) 2024-09-12T01:30:25.605 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46712 ms_local ceph rtd unknown /proc/45204/task/46712/root (readlink: Permission denied) 2024-09-12T01:30:25.605 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46712 ms_local ceph txt unknown /proc/45204/task/46712/exe (readlink: Permission denied) 2024-09-12T01:30:25.605 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46712 ms_local ceph NOFD /proc/45204/task/46712/fd (opendir: Permission denied) 2024-09-12T01:30:25.605 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46713 ms_dispat ceph cwd unknown /proc/45204/task/46713/cwd (readlink: Permission denied) 2024-09-12T01:30:25.605 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46713 ms_dispat ceph rtd unknown /proc/45204/task/46713/root (readlink: Permission denied) 2024-09-12T01:30:25.605 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46713 ms_dispat ceph txt unknown /proc/45204/task/46713/exe (readlink: Permission denied) 2024-09-12T01:30:25.605 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46713 ms_dispat ceph NOFD /proc/45204/task/46713/fd (opendir: Permission denied) 2024-09-12T01:30:25.605 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46714 ms_local ceph cwd unknown /proc/45204/task/46714/cwd (readlink: Permission denied) 2024-09-12T01:30:25.605 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46714 ms_local ceph rtd unknown /proc/45204/task/46714/root (readlink: Permission denied) 2024-09-12T01:30:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46714 ms_local ceph txt unknown /proc/45204/task/46714/exe (readlink: Permission denied) 2024-09-12T01:30:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46714 ms_local ceph NOFD /proc/45204/task/46714/fd (opendir: Permission denied) 2024-09-12T01:30:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46715 fn_anonym ceph cwd unknown /proc/45204/task/46715/cwd (readlink: Permission denied) 2024-09-12T01:30:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46715 fn_anonym ceph rtd unknown /proc/45204/task/46715/root (readlink: Permission denied) 2024-09-12T01:30:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46715 fn_anonym ceph txt unknown /proc/45204/task/46715/exe (readlink: Permission denied) 2024-09-12T01:30:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46715 fn_anonym ceph NOFD /proc/45204/task/46715/fd (opendir: Permission denied) 2024-09-12T01:30:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46716 finisher ceph cwd unknown /proc/45204/task/46716/cwd (readlink: Permission denied) 2024-09-12T01:30:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46716 finisher ceph rtd unknown /proc/45204/task/46716/root (readlink: Permission denied) 2024-09-12T01:30:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46716 finisher ceph txt unknown /proc/45204/task/46716/exe (readlink: Permission denied) 2024-09-12T01:30:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46716 finisher ceph NOFD /proc/45204/task/46716/fd (opendir: Permission denied) 2024-09-12T01:30:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46717 safe_time ceph cwd unknown /proc/45204/task/46717/cwd (readlink: Permission denied) 2024-09-12T01:30:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46717 safe_time ceph rtd unknown /proc/45204/task/46717/root (readlink: Permission denied) 2024-09-12T01:30:25.606 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46717 safe_time ceph txt unknown /proc/45204/task/46717/exe (readlink: Permission denied) 2024-09-12T01:30:25.607 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46717 safe_time ceph NOFD /proc/45204/task/46717/fd (opendir: Permission denied) 2024-09-12T01:30:25.607 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46718 safe_time ceph cwd unknown /proc/45204/task/46718/cwd (readlink: Permission denied) 2024-09-12T01:30:25.607 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46718 safe_time ceph rtd unknown /proc/45204/task/46718/root (readlink: Permission denied) 2024-09-12T01:30:25.607 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46718 safe_time ceph txt unknown /proc/45204/task/46718/exe (readlink: Permission denied) 2024-09-12T01:30:25.607 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46718 safe_time ceph NOFD /proc/45204/task/46718/fd (opendir: Permission denied) 2024-09-12T01:30:25.607 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46719 ceph-osd ceph cwd unknown /proc/45204/task/46719/cwd (readlink: Permission denied) 2024-09-12T01:30:25.607 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46719 ceph-osd ceph rtd unknown /proc/45204/task/46719/root (readlink: Permission denied) 2024-09-12T01:30:25.607 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46719 ceph-osd ceph txt unknown /proc/45204/task/46719/exe (readlink: Permission denied) 2024-09-12T01:30:25.607 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46719 ceph-osd ceph NOFD /proc/45204/task/46719/fd (opendir: Permission denied) 2024-09-12T01:30:25.607 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46720 osd_srv_a ceph cwd unknown /proc/45204/task/46720/cwd (readlink: Permission denied) 2024-09-12T01:30:25.607 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46720 osd_srv_a ceph rtd unknown /proc/45204/task/46720/root (readlink: Permission denied) 2024-09-12T01:30:25.607 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46720 osd_srv_a ceph txt unknown /proc/45204/task/46720/exe (readlink: Permission denied) 2024-09-12T01:30:25.607 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46720 osd_srv_a ceph NOFD /proc/45204/task/46720/fd (opendir: Permission denied) 2024-09-12T01:30:25.608 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46721 tp_osd_tp ceph cwd unknown /proc/45204/task/46721/cwd (readlink: Permission denied) 2024-09-12T01:30:25.608 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46721 tp_osd_tp ceph rtd unknown /proc/45204/task/46721/root (readlink: Permission denied) 2024-09-12T01:30:25.608 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46721 tp_osd_tp ceph txt unknown /proc/45204/task/46721/exe (readlink: Permission denied) 2024-09-12T01:30:25.608 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46721 tp_osd_tp ceph NOFD /proc/45204/task/46721/fd (opendir: Permission denied) 2024-09-12T01:30:25.608 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46722 tp_osd_tp ceph cwd unknown /proc/45204/task/46722/cwd (readlink: Permission denied) 2024-09-12T01:30:25.608 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46722 tp_osd_tp ceph rtd unknown /proc/45204/task/46722/root (readlink: Permission denied) 2024-09-12T01:30:25.608 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46722 tp_osd_tp ceph txt unknown /proc/45204/task/46722/exe (readlink: Permission denied) 2024-09-12T01:30:25.608 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46722 tp_osd_tp ceph NOFD /proc/45204/task/46722/fd (opendir: Permission denied) 2024-09-12T01:30:25.608 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46723 tp_osd_tp ceph cwd unknown /proc/45204/task/46723/cwd (readlink: Permission denied) 2024-09-12T01:30:25.608 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46723 tp_osd_tp ceph rtd unknown /proc/45204/task/46723/root (readlink: Permission denied) 2024-09-12T01:30:25.608 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46723 tp_osd_tp ceph txt unknown /proc/45204/task/46723/exe (readlink: Permission denied) 2024-09-12T01:30:25.608 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46723 tp_osd_tp ceph NOFD /proc/45204/task/46723/fd (opendir: Permission denied) 2024-09-12T01:30:25.608 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46724 tp_osd_tp ceph cwd unknown /proc/45204/task/46724/cwd (readlink: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46724 tp_osd_tp ceph rtd unknown /proc/45204/task/46724/root (readlink: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46724 tp_osd_tp ceph txt unknown /proc/45204/task/46724/exe (readlink: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46724 tp_osd_tp ceph NOFD /proc/45204/task/46724/fd (opendir: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46725 tp_osd_tp ceph cwd unknown /proc/45204/task/46725/cwd (readlink: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46725 tp_osd_tp ceph rtd unknown /proc/45204/task/46725/root (readlink: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46725 tp_osd_tp ceph txt unknown /proc/45204/task/46725/exe (readlink: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46725 tp_osd_tp ceph NOFD /proc/45204/task/46725/fd (opendir: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46726 tp_osd_tp ceph cwd unknown /proc/45204/task/46726/cwd (readlink: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46726 tp_osd_tp ceph rtd unknown /proc/45204/task/46726/root (readlink: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46726 tp_osd_tp ceph txt unknown /proc/45204/task/46726/exe (readlink: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46726 tp_osd_tp ceph NOFD /proc/45204/task/46726/fd (opendir: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46727 tp_osd_tp ceph cwd unknown /proc/45204/task/46727/cwd (readlink: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46727 tp_osd_tp ceph rtd unknown /proc/45204/task/46727/root (readlink: Permission denied) 2024-09-12T01:30:25.609 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46727 tp_osd_tp ceph txt unknown /proc/45204/task/46727/exe (readlink: Permission denied) 2024-09-12T01:30:25.610 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46727 tp_osd_tp ceph NOFD /proc/45204/task/46727/fd (opendir: Permission denied) 2024-09-12T01:30:25.610 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46728 tp_osd_tp ceph cwd unknown /proc/45204/task/46728/cwd (readlink: Permission denied) 2024-09-12T01:30:25.610 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46728 tp_osd_tp ceph rtd unknown /proc/45204/task/46728/root (readlink: Permission denied) 2024-09-12T01:30:25.610 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46728 tp_osd_tp ceph txt unknown /proc/45204/task/46728/exe (readlink: Permission denied) 2024-09-12T01:30:25.610 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46728 tp_osd_tp ceph NOFD /proc/45204/task/46728/fd (opendir: Permission denied) 2024-09-12T01:30:25.610 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46729 tp_osd_tp ceph cwd unknown /proc/45204/task/46729/cwd (readlink: Permission denied) 2024-09-12T01:30:25.610 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46729 tp_osd_tp ceph rtd unknown /proc/45204/task/46729/root (readlink: Permission denied) 2024-09-12T01:30:25.610 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46729 tp_osd_tp ceph txt unknown /proc/45204/task/46729/exe (readlink: Permission denied) 2024-09-12T01:30:25.610 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46729 tp_osd_tp ceph NOFD /proc/45204/task/46729/fd (opendir: Permission denied) 2024-09-12T01:30:25.610 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46730 tp_osd_tp ceph cwd unknown /proc/45204/task/46730/cwd (readlink: Permission denied) 2024-09-12T01:30:25.610 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46730 tp_osd_tp ceph rtd unknown /proc/45204/task/46730/root (readlink: Permission denied) 2024-09-12T01:30:25.610 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46730 tp_osd_tp ceph txt unknown /proc/45204/task/46730/exe (readlink: Permission denied) 2024-09-12T01:30:25.610 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46730 tp_osd_tp ceph NOFD /proc/45204/task/46730/fd (opendir: Permission denied) 2024-09-12T01:30:25.611 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46731 tp_osd_tp ceph cwd unknown /proc/45204/task/46731/cwd (readlink: Permission denied) 2024-09-12T01:30:25.611 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46731 tp_osd_tp ceph rtd unknown /proc/45204/task/46731/root (readlink: Permission denied) 2024-09-12T01:30:25.611 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46731 tp_osd_tp ceph txt unknown /proc/45204/task/46731/exe (readlink: Permission denied) 2024-09-12T01:30:25.611 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46731 tp_osd_tp ceph NOFD /proc/45204/task/46731/fd (opendir: Permission denied) 2024-09-12T01:30:25.611 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46732 tp_osd_tp ceph cwd unknown /proc/45204/task/46732/cwd (readlink: Permission denied) 2024-09-12T01:30:25.611 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46732 tp_osd_tp ceph rtd unknown /proc/45204/task/46732/root (readlink: Permission denied) 2024-09-12T01:30:25.611 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46732 tp_osd_tp ceph txt unknown /proc/45204/task/46732/exe (readlink: Permission denied) 2024-09-12T01:30:25.611 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46732 tp_osd_tp ceph NOFD /proc/45204/task/46732/fd (opendir: Permission denied) 2024-09-12T01:30:25.611 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46733 tp_osd_tp ceph cwd unknown /proc/45204/task/46733/cwd (readlink: Permission denied) 2024-09-12T01:30:25.611 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46733 tp_osd_tp ceph rtd unknown /proc/45204/task/46733/root (readlink: Permission denied) 2024-09-12T01:30:25.611 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46733 tp_osd_tp ceph txt unknown /proc/45204/task/46733/exe (readlink: Permission denied) 2024-09-12T01:30:25.611 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46733 tp_osd_tp ceph NOFD /proc/45204/task/46733/fd (opendir: Permission denied) 2024-09-12T01:30:25.612 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46734 tp_osd_tp ceph cwd unknown /proc/45204/task/46734/cwd (readlink: Permission denied) 2024-09-12T01:30:25.612 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46734 tp_osd_tp ceph rtd unknown /proc/45204/task/46734/root (readlink: Permission denied) 2024-09-12T01:30:25.612 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46734 tp_osd_tp ceph txt unknown /proc/45204/task/46734/exe (readlink: Permission denied) 2024-09-12T01:30:25.612 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46734 tp_osd_tp ceph NOFD /proc/45204/task/46734/fd (opendir: Permission denied) 2024-09-12T01:30:25.612 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46735 tp_osd_tp ceph cwd unknown /proc/45204/task/46735/cwd (readlink: Permission denied) 2024-09-12T01:30:25.612 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46735 tp_osd_tp ceph rtd unknown /proc/45204/task/46735/root (readlink: Permission denied) 2024-09-12T01:30:25.612 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46735 tp_osd_tp ceph txt unknown /proc/45204/task/46735/exe (readlink: Permission denied) 2024-09-12T01:30:25.612 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46735 tp_osd_tp ceph NOFD /proc/45204/task/46735/fd (opendir: Permission denied) 2024-09-12T01:30:25.612 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46736 tp_osd_tp ceph cwd unknown /proc/45204/task/46736/cwd (readlink: Permission denied) 2024-09-12T01:30:25.612 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46736 tp_osd_tp ceph rtd unknown /proc/45204/task/46736/root (readlink: Permission denied) 2024-09-12T01:30:25.612 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46736 tp_osd_tp ceph txt unknown /proc/45204/task/46736/exe (readlink: Permission denied) 2024-09-12T01:30:25.612 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46736 tp_osd_tp ceph NOFD /proc/45204/task/46736/fd (opendir: Permission denied) 2024-09-12T01:30:25.612 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46737 osd_srv_h ceph cwd unknown /proc/45204/task/46737/cwd (readlink: Permission denied) 2024-09-12T01:30:25.613 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46737 osd_srv_h ceph rtd unknown /proc/45204/task/46737/root (readlink: Permission denied) 2024-09-12T01:30:25.613 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46737 osd_srv_h ceph txt unknown /proc/45204/task/46737/exe (readlink: Permission denied) 2024-09-12T01:30:25.613 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 45204 46737 osd_srv_h ceph NOFD /proc/45204/task/46737/fd (opendir: Permission denied) 2024-09-12T01:30:25.613 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 45861 root cwd unknown /proc/45861/cwd (readlink: Permission denied) 2024-09-12T01:30:25.613 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 45861 root rtd unknown /proc/45861/root (readlink: Permission denied) 2024-09-12T01:30:25.613 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 45861 root txt unknown /proc/45861/exe (readlink: Permission denied) 2024-09-12T01:30:25.613 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 45861 root NOFD /proc/45861/fd (opendir: Permission denied) 2024-09-12T01:30:25.613 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 45878 root cwd unknown /proc/45878/cwd (readlink: Permission denied) 2024-09-12T01:30:25.613 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 45878 root rtd unknown /proc/45878/root (readlink: Permission denied) 2024-09-12T01:30:25.613 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 45878 root txt unknown /proc/45878/exe (readlink: Permission denied) 2024-09-12T01:30:25.613 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 45878 root NOFD /proc/45878/fd (opendir: Permission denied) 2024-09-12T01:30:25.613 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 51312 root cwd unknown /proc/51312/cwd (readlink: Permission denied) 2024-09-12T01:30:25.613 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 51312 root rtd unknown /proc/51312/root (readlink: Permission denied) 2024-09-12T01:30:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 51312 root txt unknown /proc/51312/exe (readlink: Permission denied) 2024-09-12T01:30:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 51312 root NOFD /proc/51312/fd (opendir: Permission denied) 2024-09-12T01:30:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 51660 root cwd unknown /proc/51660/cwd (readlink: Permission denied) 2024-09-12T01:30:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 51660 root rtd unknown /proc/51660/root (readlink: Permission denied) 2024-09-12T01:30:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 51660 root txt unknown /proc/51660/exe (readlink: Permission denied) 2024-09-12T01:30:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 51660 root NOFD /proc/51660/fd (opendir: Permission denied) 2024-09-12T01:30:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 51662 root cwd unknown /proc/51662/cwd (readlink: Permission denied) 2024-09-12T01:30:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 51662 root rtd unknown /proc/51662/root (readlink: Permission denied) 2024-09-12T01:30:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 51662 root txt unknown /proc/51662/exe (readlink: Permission denied) 2024-09-12T01:30:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 51662 root NOFD /proc/51662/fd (opendir: Permission denied) 2024-09-12T01:30:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 ceph cwd unknown /proc/51664/cwd (readlink: Permission denied) 2024-09-12T01:30:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 ceph rtd unknown /proc/51664/root (readlink: Permission denied) 2024-09-12T01:30:25.614 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 ceph txt unknown /proc/51664/exe (readlink: Permission denied) 2024-09-12T01:30:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 ceph NOFD /proc/51664/fd (opendir: Permission denied) 2024-09-12T01:30:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51665 log ceph cwd unknown /proc/51664/task/51665/cwd (readlink: Permission denied) 2024-09-12T01:30:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51665 log ceph rtd unknown /proc/51664/task/51665/root (readlink: Permission denied) 2024-09-12T01:30:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51665 log ceph txt unknown /proc/51664/task/51665/exe (readlink: Permission denied) 2024-09-12T01:30:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51665 log ceph NOFD /proc/51664/task/51665/fd (opendir: Permission denied) 2024-09-12T01:30:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51667 msgr-work ceph cwd unknown /proc/51664/task/51667/cwd (readlink: Permission denied) 2024-09-12T01:30:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51667 msgr-work ceph rtd unknown /proc/51664/task/51667/root (readlink: Permission denied) 2024-09-12T01:30:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51667 msgr-work ceph txt unknown /proc/51664/task/51667/exe (readlink: Permission denied) 2024-09-12T01:30:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51667 msgr-work ceph NOFD /proc/51664/task/51667/fd (opendir: Permission denied) 2024-09-12T01:30:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51668 msgr-work ceph cwd unknown /proc/51664/task/51668/cwd (readlink: Permission denied) 2024-09-12T01:30:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51668 msgr-work ceph rtd unknown /proc/51664/task/51668/root (readlink: Permission denied) 2024-09-12T01:30:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51668 msgr-work ceph txt unknown /proc/51664/task/51668/exe (readlink: Permission denied) 2024-09-12T01:30:25.615 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51668 msgr-work ceph NOFD /proc/51664/task/51668/fd (opendir: Permission denied) 2024-09-12T01:30:25.616 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51669 msgr-work ceph cwd unknown /proc/51664/task/51669/cwd (readlink: Permission denied) 2024-09-12T01:30:25.616 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51669 msgr-work ceph rtd unknown /proc/51664/task/51669/root (readlink: Permission denied) 2024-09-12T01:30:25.616 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51669 msgr-work ceph txt unknown /proc/51664/task/51669/exe (readlink: Permission denied) 2024-09-12T01:30:25.616 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51669 msgr-work ceph NOFD /proc/51664/task/51669/fd (opendir: Permission denied) 2024-09-12T01:30:25.616 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51673 service ceph cwd unknown /proc/51664/task/51673/cwd (readlink: Permission denied) 2024-09-12T01:30:25.616 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51673 service ceph rtd unknown /proc/51664/task/51673/root (readlink: Permission denied) 2024-09-12T01:30:25.616 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51673 service ceph txt unknown /proc/51664/task/51673/exe (readlink: Permission denied) 2024-09-12T01:30:25.616 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51673 service ceph NOFD /proc/51664/task/51673/fd (opendir: Permission denied) 2024-09-12T01:30:25.616 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51674 admin_soc ceph cwd unknown /proc/51664/task/51674/cwd (readlink: Permission denied) 2024-09-12T01:30:25.616 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51674 admin_soc ceph rtd unknown /proc/51664/task/51674/root (readlink: Permission denied) 2024-09-12T01:30:25.616 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51674 admin_soc ceph txt unknown /proc/51664/task/51674/exe (readlink: Permission denied) 2024-09-12T01:30:25.616 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 51674 admin_soc ceph NOFD /proc/51664/task/51674/fd (opendir: Permission denied) 2024-09-12T01:30:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52027 signal_ha ceph cwd unknown /proc/51664/task/52027/cwd (readlink: Permission denied) 2024-09-12T01:30:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52027 signal_ha ceph rtd unknown /proc/51664/task/52027/root (readlink: Permission denied) 2024-09-12T01:30:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52027 signal_ha ceph txt unknown /proc/51664/task/52027/exe (readlink: Permission denied) 2024-09-12T01:30:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52027 signal_ha ceph NOFD /proc/51664/task/52027/fd (opendir: Permission denied) 2024-09-12T01:30:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52028 io_contex ceph cwd unknown /proc/51664/task/52028/cwd (readlink: Permission denied) 2024-09-12T01:30:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52028 io_contex ceph rtd unknown /proc/51664/task/52028/root (readlink: Permission denied) 2024-09-12T01:30:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52028 io_contex ceph txt unknown /proc/51664/task/52028/exe (readlink: Permission denied) 2024-09-12T01:30:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52028 io_contex ceph NOFD /proc/51664/task/52028/fd (opendir: Permission denied) 2024-09-12T01:30:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52029 io_contex ceph cwd unknown /proc/51664/task/52029/cwd (readlink: Permission denied) 2024-09-12T01:30:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52029 io_contex ceph rtd unknown /proc/51664/task/52029/root (readlink: Permission denied) 2024-09-12T01:30:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52029 io_contex ceph txt unknown /proc/51664/task/52029/exe (readlink: Permission denied) 2024-09-12T01:30:25.617 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52029 io_contex ceph NOFD /proc/51664/task/52029/fd (opendir: Permission denied) 2024-09-12T01:30:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52041 OpHistory ceph cwd unknown /proc/51664/task/52041/cwd (readlink: Permission denied) 2024-09-12T01:30:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52041 OpHistory ceph rtd unknown /proc/51664/task/52041/root (readlink: Permission denied) 2024-09-12T01:30:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52041 OpHistory ceph txt unknown /proc/51664/task/52041/exe (readlink: Permission denied) 2024-09-12T01:30:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52041 OpHistory ceph NOFD /proc/51664/task/52041/fd (opendir: Permission denied) 2024-09-12T01:30:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52042 ceph_time ceph cwd unknown /proc/51664/task/52042/cwd (readlink: Permission denied) 2024-09-12T01:30:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52042 ceph_time ceph rtd unknown /proc/51664/task/52042/root (readlink: Permission denied) 2024-09-12T01:30:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52042 ceph_time ceph txt unknown /proc/51664/task/52042/exe (readlink: Permission denied) 2024-09-12T01:30:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52042 ceph_time ceph NOFD /proc/51664/task/52042/fd (opendir: Permission denied) 2024-09-12T01:30:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52065 ceph-osd ceph cwd unknown /proc/51664/task/52065/cwd (readlink: Permission denied) 2024-09-12T01:30:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52065 ceph-osd ceph rtd unknown /proc/51664/task/52065/root (readlink: Permission denied) 2024-09-12T01:30:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52065 ceph-osd ceph txt unknown /proc/51664/task/52065/exe (readlink: Permission denied) 2024-09-12T01:30:25.618 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52065 ceph-osd ceph NOFD /proc/51664/task/52065/fd (opendir: Permission denied) 2024-09-12T01:30:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52103 ceph-osd ceph cwd unknown /proc/51664/task/52103/cwd (readlink: Permission denied) 2024-09-12T01:30:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52103 ceph-osd ceph rtd unknown /proc/51664/task/52103/root (readlink: Permission denied) 2024-09-12T01:30:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52103 ceph-osd ceph txt unknown /proc/51664/task/52103/exe (readlink: Permission denied) 2024-09-12T01:30:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52103 ceph-osd ceph NOFD /proc/51664/task/52103/fd (opendir: Permission denied) 2024-09-12T01:30:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52156 ceph-osd ceph cwd unknown /proc/51664/task/52156/cwd (readlink: Permission denied) 2024-09-12T01:30:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52156 ceph-osd ceph rtd unknown /proc/51664/task/52156/root (readlink: Permission denied) 2024-09-12T01:30:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52156 ceph-osd ceph txt unknown /proc/51664/task/52156/exe (readlink: Permission denied) 2024-09-12T01:30:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52156 ceph-osd ceph NOFD /proc/51664/task/52156/fd (opendir: Permission denied) 2024-09-12T01:30:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52166 ceph-osd ceph cwd unknown /proc/51664/task/52166/cwd (readlink: Permission denied) 2024-09-12T01:30:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52166 ceph-osd ceph rtd unknown /proc/51664/task/52166/root (readlink: Permission denied) 2024-09-12T01:30:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52166 ceph-osd ceph txt unknown /proc/51664/task/52166/exe (readlink: Permission denied) 2024-09-12T01:30:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52166 ceph-osd ceph NOFD /proc/51664/task/52166/fd (opendir: Permission denied) 2024-09-12T01:30:25.619 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52186 ceph-osd ceph cwd unknown /proc/51664/task/52186/cwd (readlink: Permission denied) 2024-09-12T01:30:25.620 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52186 ceph-osd ceph rtd unknown /proc/51664/task/52186/root (readlink: Permission denied) 2024-09-12T01:30:25.620 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52186 ceph-osd ceph txt unknown /proc/51664/task/52186/exe (readlink: Permission denied) 2024-09-12T01:30:25.620 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52186 ceph-osd ceph NOFD /proc/51664/task/52186/fd (opendir: Permission denied) 2024-09-12T01:30:25.620 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52197 ceph-osd ceph cwd unknown /proc/51664/task/52197/cwd (readlink: Permission denied) 2024-09-12T01:30:25.620 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52197 ceph-osd ceph rtd unknown /proc/51664/task/52197/root (readlink: Permission denied) 2024-09-12T01:30:25.620 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52197 ceph-osd ceph txt unknown /proc/51664/task/52197/exe (readlink: Permission denied) 2024-09-12T01:30:25.620 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52197 ceph-osd ceph NOFD /proc/51664/task/52197/fd (opendir: Permission denied) 2024-09-12T01:30:25.620 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52203 ceph-osd ceph cwd unknown /proc/51664/task/52203/cwd (readlink: Permission denied) 2024-09-12T01:30:25.620 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52203 ceph-osd ceph rtd unknown /proc/51664/task/52203/root (readlink: Permission denied) 2024-09-12T01:30:25.620 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52203 ceph-osd ceph txt unknown /proc/51664/task/52203/exe (readlink: Permission denied) 2024-09-12T01:30:25.620 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52203 ceph-osd ceph NOFD /proc/51664/task/52203/fd (opendir: Permission denied) 2024-09-12T01:30:25.620 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52289 ceph-osd ceph cwd unknown /proc/51664/task/52289/cwd (readlink: Permission denied) 2024-09-12T01:30:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52289 ceph-osd ceph rtd unknown /proc/51664/task/52289/root (readlink: Permission denied) 2024-09-12T01:30:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52289 ceph-osd ceph txt unknown /proc/51664/task/52289/exe (readlink: Permission denied) 2024-09-12T01:30:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52289 ceph-osd ceph NOFD /proc/51664/task/52289/fd (opendir: Permission denied) 2024-09-12T01:30:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52290 ceph-osd ceph cwd unknown /proc/51664/task/52290/cwd (readlink: Permission denied) 2024-09-12T01:30:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52290 ceph-osd ceph rtd unknown /proc/51664/task/52290/root (readlink: Permission denied) 2024-09-12T01:30:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52290 ceph-osd ceph txt unknown /proc/51664/task/52290/exe (readlink: Permission denied) 2024-09-12T01:30:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52290 ceph-osd ceph NOFD /proc/51664/task/52290/fd (opendir: Permission denied) 2024-09-12T01:30:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52291 safe_time ceph cwd unknown /proc/51664/task/52291/cwd (readlink: Permission denied) 2024-09-12T01:30:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52291 safe_time ceph rtd unknown /proc/51664/task/52291/root (readlink: Permission denied) 2024-09-12T01:30:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52291 safe_time ceph txt unknown /proc/51664/task/52291/exe (readlink: Permission denied) 2024-09-12T01:30:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52291 safe_time ceph NOFD /proc/51664/task/52291/fd (opendir: Permission denied) 2024-09-12T01:30:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52292 safe_time ceph cwd unknown /proc/51664/task/52292/cwd (readlink: Permission denied) 2024-09-12T01:30:25.621 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52292 safe_time ceph rtd unknown /proc/51664/task/52292/root (readlink: Permission denied) 2024-09-12T01:30:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52292 safe_time ceph txt unknown /proc/51664/task/52292/exe (readlink: Permission denied) 2024-09-12T01:30:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52292 safe_time ceph NOFD /proc/51664/task/52292/fd (opendir: Permission denied) 2024-09-12T01:30:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52293 safe_time ceph cwd unknown /proc/51664/task/52293/cwd (readlink: Permission denied) 2024-09-12T01:30:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52293 safe_time ceph rtd unknown /proc/51664/task/52293/root (readlink: Permission denied) 2024-09-12T01:30:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52293 safe_time ceph txt unknown /proc/51664/task/52293/exe (readlink: Permission denied) 2024-09-12T01:30:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52293 safe_time ceph NOFD /proc/51664/task/52293/fd (opendir: Permission denied) 2024-09-12T01:30:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52294 safe_time ceph cwd unknown /proc/51664/task/52294/cwd (readlink: Permission denied) 2024-09-12T01:30:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52294 safe_time ceph rtd unknown /proc/51664/task/52294/root (readlink: Permission denied) 2024-09-12T01:30:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52294 safe_time ceph txt unknown /proc/51664/task/52294/exe (readlink: Permission denied) 2024-09-12T01:30:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52294 safe_time ceph NOFD /proc/51664/task/52294/fd (opendir: Permission denied) 2024-09-12T01:30:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52295 fn_anonym ceph cwd unknown /proc/51664/task/52295/cwd (readlink: Permission denied) 2024-09-12T01:30:25.622 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52295 fn_anonym ceph rtd unknown /proc/51664/task/52295/root (readlink: Permission denied) 2024-09-12T01:30:25.623 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52295 fn_anonym ceph txt unknown /proc/51664/task/52295/exe (readlink: Permission denied) 2024-09-12T01:30:25.623 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52295 fn_anonym ceph NOFD /proc/51664/task/52295/fd (opendir: Permission denied) 2024-09-12T01:30:25.623 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52388 rocksdb:l ceph cwd unknown /proc/51664/task/52388/cwd (readlink: Permission denied) 2024-09-12T01:30:25.623 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52388 rocksdb:l ceph rtd unknown /proc/51664/task/52388/root (readlink: Permission denied) 2024-09-12T01:30:25.623 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52388 rocksdb:l ceph txt unknown /proc/51664/task/52388/exe (readlink: Permission denied) 2024-09-12T01:30:25.623 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52388 rocksdb:l ceph NOFD /proc/51664/task/52388/fd (opendir: Permission denied) 2024-09-12T01:30:25.623 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52389 rocksdb:l ceph cwd unknown /proc/51664/task/52389/cwd (readlink: Permission denied) 2024-09-12T01:30:25.623 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52389 rocksdb:l ceph rtd unknown /proc/51664/task/52389/root (readlink: Permission denied) 2024-09-12T01:30:25.623 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52389 rocksdb:l ceph txt unknown /proc/51664/task/52389/exe (readlink: Permission denied) 2024-09-12T01:30:25.623 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52389 rocksdb:l ceph NOFD /proc/51664/task/52389/fd (opendir: Permission denied) 2024-09-12T01:30:25.623 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52390 rocksdb:l ceph cwd unknown /proc/51664/task/52390/cwd (readlink: Permission denied) 2024-09-12T01:30:25.623 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52390 rocksdb:l ceph rtd unknown /proc/51664/task/52390/root (readlink: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52390 rocksdb:l ceph txt unknown /proc/51664/task/52390/exe (readlink: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52390 rocksdb:l ceph NOFD /proc/51664/task/52390/fd (opendir: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52391 rocksdb:h ceph cwd unknown /proc/51664/task/52391/cwd (readlink: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52391 rocksdb:h ceph rtd unknown /proc/51664/task/52391/root (readlink: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52391 rocksdb:h ceph txt unknown /proc/51664/task/52391/exe (readlink: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52391 rocksdb:h ceph NOFD /proc/51664/task/52391/fd (opendir: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52802 bstore_ai ceph cwd unknown /proc/51664/task/52802/cwd (readlink: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52802 bstore_ai ceph rtd unknown /proc/51664/task/52802/root (readlink: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52802 bstore_ai ceph txt unknown /proc/51664/task/52802/exe (readlink: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52802 bstore_ai ceph NOFD /proc/51664/task/52802/fd (opendir: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52803 bstore_di ceph cwd unknown /proc/51664/task/52803/cwd (readlink: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52803 bstore_di ceph rtd unknown /proc/51664/task/52803/root (readlink: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52803 bstore_di ceph txt unknown /proc/51664/task/52803/exe (readlink: Permission denied) 2024-09-12T01:30:25.624 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52803 bstore_di ceph NOFD /proc/51664/task/52803/fd (opendir: Permission denied) 2024-09-12T01:30:25.625 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52991 bstore_ai ceph cwd unknown /proc/51664/task/52991/cwd (readlink: Permission denied) 2024-09-12T01:30:25.625 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52991 bstore_ai ceph rtd unknown /proc/51664/task/52991/root (readlink: Permission denied) 2024-09-12T01:30:25.625 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52991 bstore_ai ceph txt unknown /proc/51664/task/52991/exe (readlink: Permission denied) 2024-09-12T01:30:25.625 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52991 bstore_ai ceph NOFD /proc/51664/task/52991/fd (opendir: Permission denied) 2024-09-12T01:30:25.625 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52992 bstore_di ceph cwd unknown /proc/51664/task/52992/cwd (readlink: Permission denied) 2024-09-12T01:30:25.625 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52992 bstore_di ceph rtd unknown /proc/51664/task/52992/root (readlink: Permission denied) 2024-09-12T01:30:25.625 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52992 bstore_di ceph txt unknown /proc/51664/task/52992/exe (readlink: Permission denied) 2024-09-12T01:30:25.625 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 52992 bstore_di ceph NOFD /proc/51664/task/52992/fd (opendir: Permission denied) 2024-09-12T01:30:25.625 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53177 ceph-osd ceph cwd unknown /proc/51664/task/53177/cwd (readlink: Permission denied) 2024-09-12T01:30:25.626 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53177 ceph-osd ceph rtd unknown /proc/51664/task/53177/root (readlink: Permission denied) 2024-09-12T01:30:25.626 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53177 ceph-osd ceph txt unknown /proc/51664/task/53177/exe (readlink: Permission denied) 2024-09-12T01:30:25.626 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53177 ceph-osd ceph NOFD /proc/51664/task/53177/fd (opendir: Permission denied) 2024-09-12T01:30:25.627 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53178 cfin ceph cwd unknown /proc/51664/task/53178/cwd (readlink: Permission denied) 2024-09-12T01:30:25.627 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53178 cfin ceph rtd unknown /proc/51664/task/53178/root (readlink: Permission denied) 2024-09-12T01:30:25.628 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53178 cfin ceph txt unknown /proc/51664/task/53178/exe (readlink: Permission denied) 2024-09-12T01:30:25.628 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53178 cfin ceph NOFD /proc/51664/task/53178/fd (opendir: Permission denied) 2024-09-12T01:30:25.628 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53179 bstore_kv ceph cwd unknown /proc/51664/task/53179/cwd (readlink: Permission denied) 2024-09-12T01:30:25.628 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53179 bstore_kv ceph rtd unknown /proc/51664/task/53179/root (readlink: Permission denied) 2024-09-12T01:30:25.628 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53179 bstore_kv ceph txt unknown /proc/51664/task/53179/exe (readlink: Permission denied) 2024-09-12T01:30:25.628 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53179 bstore_kv ceph NOFD /proc/51664/task/53179/fd (opendir: Permission denied) 2024-09-12T01:30:25.628 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53180 bstore_kv ceph cwd unknown /proc/51664/task/53180/cwd (readlink: Permission denied) 2024-09-12T01:30:25.628 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53180 bstore_kv ceph rtd unknown /proc/51664/task/53180/root (readlink: Permission denied) 2024-09-12T01:30:25.628 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53180 bstore_kv ceph txt unknown /proc/51664/task/53180/exe (readlink: Permission denied) 2024-09-12T01:30:25.628 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53180 bstore_kv ceph NOFD /proc/51664/task/53180/fd (opendir: Permission denied) 2024-09-12T01:30:25.628 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53181 bstore_me ceph cwd unknown /proc/51664/task/53181/cwd (readlink: Permission denied) 2024-09-12T01:30:25.628 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53181 bstore_me ceph rtd unknown /proc/51664/task/53181/root (readlink: Permission denied) 2024-09-12T01:30:25.629 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53181 bstore_me ceph txt unknown /proc/51664/task/53181/exe (readlink: Permission denied) 2024-09-12T01:30:25.629 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53181 bstore_me ceph NOFD /proc/51664/task/53181/fd (opendir: Permission denied) 2024-09-12T01:30:25.629 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53182 ms_dispat ceph cwd unknown /proc/51664/task/53182/cwd (readlink: Permission denied) 2024-09-12T01:30:25.629 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53182 ms_dispat ceph rtd unknown /proc/51664/task/53182/root (readlink: Permission denied) 2024-09-12T01:30:25.629 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53182 ms_dispat ceph txt unknown /proc/51664/task/53182/exe (readlink: Permission denied) 2024-09-12T01:30:25.629 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53182 ms_dispat ceph NOFD /proc/51664/task/53182/fd (opendir: Permission denied) 2024-09-12T01:30:25.629 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53183 ms_local ceph cwd unknown /proc/51664/task/53183/cwd (readlink: Permission denied) 2024-09-12T01:30:25.629 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53183 ms_local ceph rtd unknown /proc/51664/task/53183/root (readlink: Permission denied) 2024-09-12T01:30:25.629 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53183 ms_local ceph txt unknown /proc/51664/task/53183/exe (readlink: Permission denied) 2024-09-12T01:30:25.629 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53183 ms_local ceph NOFD /proc/51664/task/53183/fd (opendir: Permission denied) 2024-09-12T01:30:25.629 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53184 safe_time ceph cwd unknown /proc/51664/task/53184/cwd (readlink: Permission denied) 2024-09-12T01:30:25.629 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53184 safe_time ceph rtd unknown /proc/51664/task/53184/root (readlink: Permission denied) 2024-09-12T01:30:25.629 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53184 safe_time ceph txt unknown /proc/51664/task/53184/exe (readlink: Permission denied) 2024-09-12T01:30:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53184 safe_time ceph NOFD /proc/51664/task/53184/fd (opendir: Permission denied) 2024-09-12T01:30:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53185 safe_time ceph cwd unknown /proc/51664/task/53185/cwd (readlink: Permission denied) 2024-09-12T01:30:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53185 safe_time ceph rtd unknown /proc/51664/task/53185/root (readlink: Permission denied) 2024-09-12T01:30:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53185 safe_time ceph txt unknown /proc/51664/task/53185/exe (readlink: Permission denied) 2024-09-12T01:30:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53185 safe_time ceph NOFD /proc/51664/task/53185/fd (opendir: Permission denied) 2024-09-12T01:30:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53186 ms_dispat ceph cwd unknown /proc/51664/task/53186/cwd (readlink: Permission denied) 2024-09-12T01:30:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53186 ms_dispat ceph rtd unknown /proc/51664/task/53186/root (readlink: Permission denied) 2024-09-12T01:30:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53186 ms_dispat ceph txt unknown /proc/51664/task/53186/exe (readlink: Permission denied) 2024-09-12T01:30:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53186 ms_dispat ceph NOFD /proc/51664/task/53186/fd (opendir: Permission denied) 2024-09-12T01:30:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53187 ms_local ceph cwd unknown /proc/51664/task/53187/cwd (readlink: Permission denied) 2024-09-12T01:30:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53187 ms_local ceph rtd unknown /proc/51664/task/53187/root (readlink: Permission denied) 2024-09-12T01:30:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53187 ms_local ceph txt unknown /proc/51664/task/53187/exe (readlink: Permission denied) 2024-09-12T01:30:25.630 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53187 ms_local ceph NOFD /proc/51664/task/53187/fd (opendir: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53188 ms_dispat ceph cwd unknown /proc/51664/task/53188/cwd (readlink: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53188 ms_dispat ceph rtd unknown /proc/51664/task/53188/root (readlink: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53188 ms_dispat ceph txt unknown /proc/51664/task/53188/exe (readlink: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53188 ms_dispat ceph NOFD /proc/51664/task/53188/fd (opendir: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53189 ms_local ceph cwd unknown /proc/51664/task/53189/cwd (readlink: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53189 ms_local ceph rtd unknown /proc/51664/task/53189/root (readlink: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53189 ms_local ceph txt unknown /proc/51664/task/53189/exe (readlink: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53189 ms_local ceph NOFD /proc/51664/task/53189/fd (opendir: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53190 ms_dispat ceph cwd unknown /proc/51664/task/53190/cwd (readlink: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53190 ms_dispat ceph rtd unknown /proc/51664/task/53190/root (readlink: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53190 ms_dispat ceph txt unknown /proc/51664/task/53190/exe (readlink: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53190 ms_dispat ceph NOFD /proc/51664/task/53190/fd (opendir: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53191 ms_local ceph cwd unknown /proc/51664/task/53191/cwd (readlink: Permission denied) 2024-09-12T01:30:25.631 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53191 ms_local ceph rtd unknown /proc/51664/task/53191/root (readlink: Permission denied) 2024-09-12T01:30:25.632 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53191 ms_local ceph txt unknown /proc/51664/task/53191/exe (readlink: Permission denied) 2024-09-12T01:30:25.632 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53191 ms_local ceph NOFD /proc/51664/task/53191/fd (opendir: Permission denied) 2024-09-12T01:30:25.632 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53192 ms_dispat ceph cwd unknown /proc/51664/task/53192/cwd (readlink: Permission denied) 2024-09-12T01:30:25.632 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53192 ms_dispat ceph rtd unknown /proc/51664/task/53192/root (readlink: Permission denied) 2024-09-12T01:30:25.632 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53192 ms_dispat ceph txt unknown /proc/51664/task/53192/exe (readlink: Permission denied) 2024-09-12T01:30:25.632 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53192 ms_dispat ceph NOFD /proc/51664/task/53192/fd (opendir: Permission denied) 2024-09-12T01:30:25.632 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53193 ms_local ceph cwd unknown /proc/51664/task/53193/cwd (readlink: Permission denied) 2024-09-12T01:30:25.632 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53193 ms_local ceph rtd unknown /proc/51664/task/53193/root (readlink: Permission denied) 2024-09-12T01:30:25.632 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53193 ms_local ceph txt unknown /proc/51664/task/53193/exe (readlink: Permission denied) 2024-09-12T01:30:25.632 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53193 ms_local ceph NOFD /proc/51664/task/53193/fd (opendir: Permission denied) 2024-09-12T01:30:25.632 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53194 ms_dispat ceph cwd unknown /proc/51664/task/53194/cwd (readlink: Permission denied) 2024-09-12T01:30:25.632 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53194 ms_dispat ceph rtd unknown /proc/51664/task/53194/root (readlink: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53194 ms_dispat ceph txt unknown /proc/51664/task/53194/exe (readlink: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53194 ms_dispat ceph NOFD /proc/51664/task/53194/fd (opendir: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53195 ms_local ceph cwd unknown /proc/51664/task/53195/cwd (readlink: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53195 ms_local ceph rtd unknown /proc/51664/task/53195/root (readlink: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53195 ms_local ceph txt unknown /proc/51664/task/53195/exe (readlink: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53195 ms_local ceph NOFD /proc/51664/task/53195/fd (opendir: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53196 ms_dispat ceph cwd unknown /proc/51664/task/53196/cwd (readlink: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53196 ms_dispat ceph rtd unknown /proc/51664/task/53196/root (readlink: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53196 ms_dispat ceph txt unknown /proc/51664/task/53196/exe (readlink: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53196 ms_dispat ceph NOFD /proc/51664/task/53196/fd (opendir: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53197 ms_local ceph cwd unknown /proc/51664/task/53197/cwd (readlink: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53197 ms_local ceph rtd unknown /proc/51664/task/53197/root (readlink: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53197 ms_local ceph txt unknown /proc/51664/task/53197/exe (readlink: Permission denied) 2024-09-12T01:30:25.633 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53197 ms_local ceph NOFD /proc/51664/task/53197/fd (opendir: Permission denied) 2024-09-12T01:30:25.634 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53198 fn_anonym ceph cwd unknown /proc/51664/task/53198/cwd (readlink: Permission denied) 2024-09-12T01:30:25.634 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53198 fn_anonym ceph rtd unknown /proc/51664/task/53198/root (readlink: Permission denied) 2024-09-12T01:30:25.634 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53198 fn_anonym ceph txt unknown /proc/51664/task/53198/exe (readlink: Permission denied) 2024-09-12T01:30:25.634 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53198 fn_anonym ceph NOFD /proc/51664/task/53198/fd (opendir: Permission denied) 2024-09-12T01:30:25.634 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53199 finisher ceph cwd unknown /proc/51664/task/53199/cwd (readlink: Permission denied) 2024-09-12T01:30:25.634 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53199 finisher ceph rtd unknown /proc/51664/task/53199/root (readlink: Permission denied) 2024-09-12T01:30:25.634 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53199 finisher ceph txt unknown /proc/51664/task/53199/exe (readlink: Permission denied) 2024-09-12T01:30:25.634 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53199 finisher ceph NOFD /proc/51664/task/53199/fd (opendir: Permission denied) 2024-09-12T01:30:25.634 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53200 safe_time ceph cwd unknown /proc/51664/task/53200/cwd (readlink: Permission denied) 2024-09-12T01:30:25.634 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53200 safe_time ceph rtd unknown /proc/51664/task/53200/root (readlink: Permission denied) 2024-09-12T01:30:25.634 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53200 safe_time ceph txt unknown /proc/51664/task/53200/exe (readlink: Permission denied) 2024-09-12T01:30:25.634 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53200 safe_time ceph NOFD /proc/51664/task/53200/fd (opendir: Permission denied) 2024-09-12T01:30:25.634 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53201 safe_time ceph cwd unknown /proc/51664/task/53201/cwd (readlink: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53201 safe_time ceph rtd unknown /proc/51664/task/53201/root (readlink: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53201 safe_time ceph txt unknown /proc/51664/task/53201/exe (readlink: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53201 safe_time ceph NOFD /proc/51664/task/53201/fd (opendir: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53202 ceph-osd ceph cwd unknown /proc/51664/task/53202/cwd (readlink: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53202 ceph-osd ceph rtd unknown /proc/51664/task/53202/root (readlink: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53202 ceph-osd ceph txt unknown /proc/51664/task/53202/exe (readlink: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53202 ceph-osd ceph NOFD /proc/51664/task/53202/fd (opendir: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53203 osd_srv_a ceph cwd unknown /proc/51664/task/53203/cwd (readlink: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53203 osd_srv_a ceph rtd unknown /proc/51664/task/53203/root (readlink: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53203 osd_srv_a ceph txt unknown /proc/51664/task/53203/exe (readlink: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53203 osd_srv_a ceph NOFD /proc/51664/task/53203/fd (opendir: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53204 tp_osd_tp ceph cwd unknown /proc/51664/task/53204/cwd (readlink: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53204 tp_osd_tp ceph rtd unknown /proc/51664/task/53204/root (readlink: Permission denied) 2024-09-12T01:30:25.635 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53204 tp_osd_tp ceph txt unknown /proc/51664/task/53204/exe (readlink: Permission denied) 2024-09-12T01:30:25.636 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53204 tp_osd_tp ceph NOFD /proc/51664/task/53204/fd (opendir: Permission denied) 2024-09-12T01:30:25.636 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53205 tp_osd_tp ceph cwd unknown /proc/51664/task/53205/cwd (readlink: Permission denied) 2024-09-12T01:30:25.636 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53205 tp_osd_tp ceph rtd unknown /proc/51664/task/53205/root (readlink: Permission denied) 2024-09-12T01:30:25.636 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53205 tp_osd_tp ceph txt unknown /proc/51664/task/53205/exe (readlink: Permission denied) 2024-09-12T01:30:25.636 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53205 tp_osd_tp ceph NOFD /proc/51664/task/53205/fd (opendir: Permission denied) 2024-09-12T01:30:25.636 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53206 tp_osd_tp ceph cwd unknown /proc/51664/task/53206/cwd (readlink: Permission denied) 2024-09-12T01:30:25.636 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53206 tp_osd_tp ceph rtd unknown /proc/51664/task/53206/root (readlink: Permission denied) 2024-09-12T01:30:25.636 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53206 tp_osd_tp ceph txt unknown /proc/51664/task/53206/exe (readlink: Permission denied) 2024-09-12T01:30:25.636 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53206 tp_osd_tp ceph NOFD /proc/51664/task/53206/fd (opendir: Permission denied) 2024-09-12T01:30:25.636 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53207 tp_osd_tp ceph cwd unknown /proc/51664/task/53207/cwd (readlink: Permission denied) 2024-09-12T01:30:25.636 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53207 tp_osd_tp ceph rtd unknown /proc/51664/task/53207/root (readlink: Permission denied) 2024-09-12T01:30:25.636 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53207 tp_osd_tp ceph txt unknown /proc/51664/task/53207/exe (readlink: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53207 tp_osd_tp ceph NOFD /proc/51664/task/53207/fd (opendir: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53208 tp_osd_tp ceph cwd unknown /proc/51664/task/53208/cwd (readlink: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53208 tp_osd_tp ceph rtd unknown /proc/51664/task/53208/root (readlink: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53208 tp_osd_tp ceph txt unknown /proc/51664/task/53208/exe (readlink: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53208 tp_osd_tp ceph NOFD /proc/51664/task/53208/fd (opendir: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53209 tp_osd_tp ceph cwd unknown /proc/51664/task/53209/cwd (readlink: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53209 tp_osd_tp ceph rtd unknown /proc/51664/task/53209/root (readlink: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53209 tp_osd_tp ceph txt unknown /proc/51664/task/53209/exe (readlink: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53209 tp_osd_tp ceph NOFD /proc/51664/task/53209/fd (opendir: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53210 tp_osd_tp ceph cwd unknown /proc/51664/task/53210/cwd (readlink: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53210 tp_osd_tp ceph rtd unknown /proc/51664/task/53210/root (readlink: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53210 tp_osd_tp ceph txt unknown /proc/51664/task/53210/exe (readlink: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53210 tp_osd_tp ceph NOFD /proc/51664/task/53210/fd (opendir: Permission denied) 2024-09-12T01:30:25.637 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53211 tp_osd_tp ceph cwd unknown /proc/51664/task/53211/cwd (readlink: Permission denied) 2024-09-12T01:30:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53211 tp_osd_tp ceph rtd unknown /proc/51664/task/53211/root (readlink: Permission denied) 2024-09-12T01:30:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53211 tp_osd_tp ceph txt unknown /proc/51664/task/53211/exe (readlink: Permission denied) 2024-09-12T01:30:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53211 tp_osd_tp ceph NOFD /proc/51664/task/53211/fd (opendir: Permission denied) 2024-09-12T01:30:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53212 tp_osd_tp ceph cwd unknown /proc/51664/task/53212/cwd (readlink: Permission denied) 2024-09-12T01:30:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53212 tp_osd_tp ceph rtd unknown /proc/51664/task/53212/root (readlink: Permission denied) 2024-09-12T01:30:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53212 tp_osd_tp ceph txt unknown /proc/51664/task/53212/exe (readlink: Permission denied) 2024-09-12T01:30:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53212 tp_osd_tp ceph NOFD /proc/51664/task/53212/fd (opendir: Permission denied) 2024-09-12T01:30:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53213 tp_osd_tp ceph cwd unknown /proc/51664/task/53213/cwd (readlink: Permission denied) 2024-09-12T01:30:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53213 tp_osd_tp ceph rtd unknown /proc/51664/task/53213/root (readlink: Permission denied) 2024-09-12T01:30:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53213 tp_osd_tp ceph txt unknown /proc/51664/task/53213/exe (readlink: Permission denied) 2024-09-12T01:30:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53213 tp_osd_tp ceph NOFD /proc/51664/task/53213/fd (opendir: Permission denied) 2024-09-12T01:30:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53214 tp_osd_tp ceph cwd unknown /proc/51664/task/53214/cwd (readlink: Permission denied) 2024-09-12T01:30:25.638 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53214 tp_osd_tp ceph rtd unknown /proc/51664/task/53214/root (readlink: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53214 tp_osd_tp ceph txt unknown /proc/51664/task/53214/exe (readlink: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53214 tp_osd_tp ceph NOFD /proc/51664/task/53214/fd (opendir: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53215 tp_osd_tp ceph cwd unknown /proc/51664/task/53215/cwd (readlink: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53215 tp_osd_tp ceph rtd unknown /proc/51664/task/53215/root (readlink: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53215 tp_osd_tp ceph txt unknown /proc/51664/task/53215/exe (readlink: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53215 tp_osd_tp ceph NOFD /proc/51664/task/53215/fd (opendir: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53216 tp_osd_tp ceph cwd unknown /proc/51664/task/53216/cwd (readlink: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53216 tp_osd_tp ceph rtd unknown /proc/51664/task/53216/root (readlink: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53216 tp_osd_tp ceph txt unknown /proc/51664/task/53216/exe (readlink: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53216 tp_osd_tp ceph NOFD /proc/51664/task/53216/fd (opendir: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53217 tp_osd_tp ceph cwd unknown /proc/51664/task/53217/cwd (readlink: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53217 tp_osd_tp ceph rtd unknown /proc/51664/task/53217/root (readlink: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53217 tp_osd_tp ceph txt unknown /proc/51664/task/53217/exe (readlink: Permission denied) 2024-09-12T01:30:25.639 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53217 tp_osd_tp ceph NOFD /proc/51664/task/53217/fd (opendir: Permission denied) 2024-09-12T01:30:25.640 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53218 tp_osd_tp ceph cwd unknown /proc/51664/task/53218/cwd (readlink: Permission denied) 2024-09-12T01:30:25.640 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53218 tp_osd_tp ceph rtd unknown /proc/51664/task/53218/root (readlink: Permission denied) 2024-09-12T01:30:25.640 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53218 tp_osd_tp ceph txt unknown /proc/51664/task/53218/exe (readlink: Permission denied) 2024-09-12T01:30:25.640 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53218 tp_osd_tp ceph NOFD /proc/51664/task/53218/fd (opendir: Permission denied) 2024-09-12T01:30:25.640 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53219 tp_osd_tp ceph cwd unknown /proc/51664/task/53219/cwd (readlink: Permission denied) 2024-09-12T01:30:25.640 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53219 tp_osd_tp ceph rtd unknown /proc/51664/task/53219/root (readlink: Permission denied) 2024-09-12T01:30:25.640 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53219 tp_osd_tp ceph txt unknown /proc/51664/task/53219/exe (readlink: Permission denied) 2024-09-12T01:30:25.640 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53219 tp_osd_tp ceph NOFD /proc/51664/task/53219/fd (opendir: Permission denied) 2024-09-12T01:30:25.640 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53220 osd_srv_h ceph cwd unknown /proc/51664/task/53220/cwd (readlink: Permission denied) 2024-09-12T01:30:25.640 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53220 osd_srv_h ceph rtd unknown /proc/51664/task/53220/root (readlink: Permission denied) 2024-09-12T01:30:25.640 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53220 osd_srv_h ceph txt unknown /proc/51664/task/53220/exe (readlink: Permission denied) 2024-09-12T01:30:25.640 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 51664 53220 osd_srv_h ceph NOFD /proc/51664/task/53220/fd (opendir: Permission denied) 2024-09-12T01:30:25.640 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 52315 root cwd unknown /proc/52315/cwd (readlink: Permission denied) 2024-09-12T01:30:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 52315 root rtd unknown /proc/52315/root (readlink: Permission denied) 2024-09-12T01:30:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 52315 root txt unknown /proc/52315/exe (readlink: Permission denied) 2024-09-12T01:30:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 52315 root NOFD /proc/52315/fd (opendir: Permission denied) 2024-09-12T01:30:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 52332 root cwd unknown /proc/52332/cwd (readlink: Permission denied) 2024-09-12T01:30:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 52332 root rtd unknown /proc/52332/root (readlink: Permission denied) 2024-09-12T01:30:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 52332 root txt unknown /proc/52332/exe (readlink: Permission denied) 2024-09-12T01:30:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 52332 root NOFD /proc/52332/fd (opendir: Permission denied) 2024-09-12T01:30:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 55784 root cwd unknown /proc/55784/cwd (readlink: Permission denied) 2024-09-12T01:30:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 55784 root rtd unknown /proc/55784/root (readlink: Permission denied) 2024-09-12T01:30:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 55784 root txt unknown /proc/55784/exe (readlink: Permission denied) 2024-09-12T01:30:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 55784 root NOFD /proc/55784/fd (opendir: Permission denied) 2024-09-12T01:30:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 55959 root cwd unknown /proc/55959/cwd (readlink: Permission denied) 2024-09-12T01:30:25.641 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 55959 root rtd unknown /proc/55959/root (readlink: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 55959 root txt unknown /proc/55959/exe (readlink: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 55959 root NOFD /proc/55959/fd (opendir: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 58069 root cwd unknown /proc/58069/cwd (readlink: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 58069 root rtd unknown /proc/58069/root (readlink: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 58069 root txt unknown /proc/58069/exe (readlink: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 58069 root NOFD /proc/58069/fd (opendir: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 58625 root cwd unknown /proc/58625/cwd (readlink: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 58625 root rtd unknown /proc/58625/root (readlink: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 58625 root txt unknown /proc/58625/exe (readlink: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 58625 root NOFD /proc/58625/fd (opendir: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 58627 root cwd unknown /proc/58627/cwd (readlink: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 58627 root rtd unknown /proc/58627/root (readlink: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 58627 root txt unknown /proc/58627/exe (readlink: Permission denied) 2024-09-12T01:30:25.642 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 58627 root NOFD /proc/58627/fd (opendir: Permission denied) 2024-09-12T01:30:25.643 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 ceph cwd unknown /proc/58629/cwd (readlink: Permission denied) 2024-09-12T01:30:25.643 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 ceph rtd unknown /proc/58629/root (readlink: Permission denied) 2024-09-12T01:30:25.643 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 ceph txt unknown /proc/58629/exe (readlink: Permission denied) 2024-09-12T01:30:25.643 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 ceph NOFD /proc/58629/fd (opendir: Permission denied) 2024-09-12T01:30:25.643 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58630 log ceph cwd unknown /proc/58629/task/58630/cwd (readlink: Permission denied) 2024-09-12T01:30:25.643 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58630 log ceph rtd unknown /proc/58629/task/58630/root (readlink: Permission denied) 2024-09-12T01:30:25.643 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58630 log ceph txt unknown /proc/58629/task/58630/exe (readlink: Permission denied) 2024-09-12T01:30:25.643 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58630 log ceph NOFD /proc/58629/task/58630/fd (opendir: Permission denied) 2024-09-12T01:30:25.643 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58632 msgr-work ceph cwd unknown /proc/58629/task/58632/cwd (readlink: Permission denied) 2024-09-12T01:30:25.643 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58632 msgr-work ceph rtd unknown /proc/58629/task/58632/root (readlink: Permission denied) 2024-09-12T01:30:25.643 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58632 msgr-work ceph txt unknown /proc/58629/task/58632/exe (readlink: Permission denied) 2024-09-12T01:30:25.643 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58632 msgr-work ceph NOFD /proc/58629/task/58632/fd (opendir: Permission denied) 2024-09-12T01:30:25.643 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58633 msgr-work ceph cwd unknown /proc/58629/task/58633/cwd (readlink: Permission denied) 2024-09-12T01:30:25.644 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58633 msgr-work ceph rtd unknown /proc/58629/task/58633/root (readlink: Permission denied) 2024-09-12T01:30:25.644 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58633 msgr-work ceph txt unknown /proc/58629/task/58633/exe (readlink: Permission denied) 2024-09-12T01:30:25.644 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58633 msgr-work ceph NOFD /proc/58629/task/58633/fd (opendir: Permission denied) 2024-09-12T01:30:25.644 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58634 msgr-work ceph cwd unknown /proc/58629/task/58634/cwd (readlink: Permission denied) 2024-09-12T01:30:25.644 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58634 msgr-work ceph rtd unknown /proc/58629/task/58634/root (readlink: Permission denied) 2024-09-12T01:30:25.644 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58634 msgr-work ceph txt unknown /proc/58629/task/58634/exe (readlink: Permission denied) 2024-09-12T01:30:25.644 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58634 msgr-work ceph NOFD /proc/58629/task/58634/fd (opendir: Permission denied) 2024-09-12T01:30:25.644 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58638 service ceph cwd unknown /proc/58629/task/58638/cwd (readlink: Permission denied) 2024-09-12T01:30:25.644 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58638 service ceph rtd unknown /proc/58629/task/58638/root (readlink: Permission denied) 2024-09-12T01:30:25.644 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58638 service ceph txt unknown /proc/58629/task/58638/exe (readlink: Permission denied) 2024-09-12T01:30:25.644 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58638 service ceph NOFD /proc/58629/task/58638/fd (opendir: Permission denied) 2024-09-12T01:30:25.644 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58639 admin_soc ceph cwd unknown /proc/58629/task/58639/cwd (readlink: Permission denied) 2024-09-12T01:30:25.644 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58639 admin_soc ceph rtd unknown /proc/58629/task/58639/root (readlink: Permission denied) 2024-09-12T01:30:25.645 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58639 admin_soc ceph txt unknown /proc/58629/task/58639/exe (readlink: Permission denied) 2024-09-12T01:30:25.645 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58639 admin_soc ceph NOFD /proc/58629/task/58639/fd (opendir: Permission denied) 2024-09-12T01:30:25.645 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58982 signal_ha ceph cwd unknown /proc/58629/task/58982/cwd (readlink: Permission denied) 2024-09-12T01:30:25.645 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58982 signal_ha ceph rtd unknown /proc/58629/task/58982/root (readlink: Permission denied) 2024-09-12T01:30:25.645 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58982 signal_ha ceph txt unknown /proc/58629/task/58982/exe (readlink: Permission denied) 2024-09-12T01:30:25.645 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58982 signal_ha ceph NOFD /proc/58629/task/58982/fd (opendir: Permission denied) 2024-09-12T01:30:25.645 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58983 io_contex ceph cwd unknown /proc/58629/task/58983/cwd (readlink: Permission denied) 2024-09-12T01:30:25.645 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58983 io_contex ceph rtd unknown /proc/58629/task/58983/root (readlink: Permission denied) 2024-09-12T01:30:25.645 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58983 io_contex ceph txt unknown /proc/58629/task/58983/exe (readlink: Permission denied) 2024-09-12T01:30:25.645 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58983 io_contex ceph NOFD /proc/58629/task/58983/fd (opendir: Permission denied) 2024-09-12T01:30:25.645 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58984 io_contex ceph cwd unknown /proc/58629/task/58984/cwd (readlink: Permission denied) 2024-09-12T01:30:25.645 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58984 io_contex ceph rtd unknown /proc/58629/task/58984/root (readlink: Permission denied) 2024-09-12T01:30:25.645 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58984 io_contex ceph txt unknown /proc/58629/task/58984/exe (readlink: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 58984 io_contex ceph NOFD /proc/58629/task/58984/fd (opendir: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59005 OpHistory ceph cwd unknown /proc/58629/task/59005/cwd (readlink: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59005 OpHistory ceph rtd unknown /proc/58629/task/59005/root (readlink: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59005 OpHistory ceph txt unknown /proc/58629/task/59005/exe (readlink: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59005 OpHistory ceph NOFD /proc/58629/task/59005/fd (opendir: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59006 ceph_time ceph cwd unknown /proc/58629/task/59006/cwd (readlink: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59006 ceph_time ceph rtd unknown /proc/58629/task/59006/root (readlink: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59006 ceph_time ceph txt unknown /proc/58629/task/59006/exe (readlink: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59006 ceph_time ceph NOFD /proc/58629/task/59006/fd (opendir: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59293 ceph-osd ceph cwd unknown /proc/58629/task/59293/cwd (readlink: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59293 ceph-osd ceph rtd unknown /proc/58629/task/59293/root (readlink: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59293 ceph-osd ceph txt unknown /proc/58629/task/59293/exe (readlink: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59293 ceph-osd ceph NOFD /proc/58629/task/59293/fd (opendir: Permission denied) 2024-09-12T01:30:25.646 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59294 safe_time ceph cwd unknown /proc/58629/task/59294/cwd (readlink: Permission denied) 2024-09-12T01:30:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59294 safe_time ceph rtd unknown /proc/58629/task/59294/root (readlink: Permission denied) 2024-09-12T01:30:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59294 safe_time ceph txt unknown /proc/58629/task/59294/exe (readlink: Permission denied) 2024-09-12T01:30:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59294 safe_time ceph NOFD /proc/58629/task/59294/fd (opendir: Permission denied) 2024-09-12T01:30:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59295 safe_time ceph cwd unknown /proc/58629/task/59295/cwd (readlink: Permission denied) 2024-09-12T01:30:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59295 safe_time ceph rtd unknown /proc/58629/task/59295/root (readlink: Permission denied) 2024-09-12T01:30:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59295 safe_time ceph txt unknown /proc/58629/task/59295/exe (readlink: Permission denied) 2024-09-12T01:30:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59295 safe_time ceph NOFD /proc/58629/task/59295/fd (opendir: Permission denied) 2024-09-12T01:30:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59296 safe_time ceph cwd unknown /proc/58629/task/59296/cwd (readlink: Permission denied) 2024-09-12T01:30:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59296 safe_time ceph rtd unknown /proc/58629/task/59296/root (readlink: Permission denied) 2024-09-12T01:30:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59296 safe_time ceph txt unknown /proc/58629/task/59296/exe (readlink: Permission denied) 2024-09-12T01:30:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59296 safe_time ceph NOFD /proc/58629/task/59296/fd (opendir: Permission denied) 2024-09-12T01:30:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59297 safe_time ceph cwd unknown /proc/58629/task/59297/cwd (readlink: Permission denied) 2024-09-12T01:30:25.647 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59297 safe_time ceph rtd unknown /proc/58629/task/59297/root (readlink: Permission denied) 2024-09-12T01:30:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59297 safe_time ceph txt unknown /proc/58629/task/59297/exe (readlink: Permission denied) 2024-09-12T01:30:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59297 safe_time ceph NOFD /proc/58629/task/59297/fd (opendir: Permission denied) 2024-09-12T01:30:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59298 fn_anonym ceph cwd unknown /proc/58629/task/59298/cwd (readlink: Permission denied) 2024-09-12T01:30:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59298 fn_anonym ceph rtd unknown /proc/58629/task/59298/root (readlink: Permission denied) 2024-09-12T01:30:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59298 fn_anonym ceph txt unknown /proc/58629/task/59298/exe (readlink: Permission denied) 2024-09-12T01:30:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59298 fn_anonym ceph NOFD /proc/58629/task/59298/fd (opendir: Permission denied) 2024-09-12T01:30:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59317 rocksdb:l ceph cwd unknown /proc/58629/task/59317/cwd (readlink: Permission denied) 2024-09-12T01:30:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59317 rocksdb:l ceph rtd unknown /proc/58629/task/59317/root (readlink: Permission denied) 2024-09-12T01:30:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59317 rocksdb:l ceph txt unknown /proc/58629/task/59317/exe (readlink: Permission denied) 2024-09-12T01:30:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59317 rocksdb:l ceph NOFD /proc/58629/task/59317/fd (opendir: Permission denied) 2024-09-12T01:30:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59318 rocksdb:l ceph cwd unknown /proc/58629/task/59318/cwd (readlink: Permission denied) 2024-09-12T01:30:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59318 rocksdb:l ceph rtd unknown /proc/58629/task/59318/root (readlink: Permission denied) 2024-09-12T01:30:25.648 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59318 rocksdb:l ceph txt unknown /proc/58629/task/59318/exe (readlink: Permission denied) 2024-09-12T01:30:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59318 rocksdb:l ceph NOFD /proc/58629/task/59318/fd (opendir: Permission denied) 2024-09-12T01:30:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59319 rocksdb:l ceph cwd unknown /proc/58629/task/59319/cwd (readlink: Permission denied) 2024-09-12T01:30:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59319 rocksdb:l ceph rtd unknown /proc/58629/task/59319/root (readlink: Permission denied) 2024-09-12T01:30:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59319 rocksdb:l ceph txt unknown /proc/58629/task/59319/exe (readlink: Permission denied) 2024-09-12T01:30:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59319 rocksdb:l ceph NOFD /proc/58629/task/59319/fd (opendir: Permission denied) 2024-09-12T01:30:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59320 rocksdb:h ceph cwd unknown /proc/58629/task/59320/cwd (readlink: Permission denied) 2024-09-12T01:30:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59320 rocksdb:h ceph rtd unknown /proc/58629/task/59320/root (readlink: Permission denied) 2024-09-12T01:30:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59320 rocksdb:h ceph txt unknown /proc/58629/task/59320/exe (readlink: Permission denied) 2024-09-12T01:30:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59320 rocksdb:h ceph NOFD /proc/58629/task/59320/fd (opendir: Permission denied) 2024-09-12T01:30:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59771 bstore_ai ceph cwd unknown /proc/58629/task/59771/cwd (readlink: Permission denied) 2024-09-12T01:30:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59771 bstore_ai ceph rtd unknown /proc/58629/task/59771/root (readlink: Permission denied) 2024-09-12T01:30:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59771 bstore_ai ceph txt unknown /proc/58629/task/59771/exe (readlink: Permission denied) 2024-09-12T01:30:25.649 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59771 bstore_ai ceph NOFD /proc/58629/task/59771/fd (opendir: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59772 bstore_di ceph cwd unknown /proc/58629/task/59772/cwd (readlink: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59772 bstore_di ceph rtd unknown /proc/58629/task/59772/root (readlink: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59772 bstore_di ceph txt unknown /proc/58629/task/59772/exe (readlink: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59772 bstore_di ceph NOFD /proc/58629/task/59772/fd (opendir: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59977 bstore_ai ceph cwd unknown /proc/58629/task/59977/cwd (readlink: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59977 bstore_ai ceph rtd unknown /proc/58629/task/59977/root (readlink: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59977 bstore_ai ceph txt unknown /proc/58629/task/59977/exe (readlink: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59977 bstore_ai ceph NOFD /proc/58629/task/59977/fd (opendir: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59978 bstore_di ceph cwd unknown /proc/58629/task/59978/cwd (readlink: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59978 bstore_di ceph rtd unknown /proc/58629/task/59978/root (readlink: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59978 bstore_di ceph txt unknown /proc/58629/task/59978/exe (readlink: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 59978 bstore_di ceph NOFD /proc/58629/task/59978/fd (opendir: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60160 ceph-osd ceph cwd unknown /proc/58629/task/60160/cwd (readlink: Permission denied) 2024-09-12T01:30:25.650 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60160 ceph-osd ceph rtd unknown /proc/58629/task/60160/root (readlink: Permission denied) 2024-09-12T01:30:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60160 ceph-osd ceph txt unknown /proc/58629/task/60160/exe (readlink: Permission denied) 2024-09-12T01:30:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60160 ceph-osd ceph NOFD /proc/58629/task/60160/fd (opendir: Permission denied) 2024-09-12T01:30:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60161 cfin ceph cwd unknown /proc/58629/task/60161/cwd (readlink: Permission denied) 2024-09-12T01:30:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60161 cfin ceph rtd unknown /proc/58629/task/60161/root (readlink: Permission denied) 2024-09-12T01:30:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60161 cfin ceph txt unknown /proc/58629/task/60161/exe (readlink: Permission denied) 2024-09-12T01:30:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60161 cfin ceph NOFD /proc/58629/task/60161/fd (opendir: Permission denied) 2024-09-12T01:30:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60162 bstore_kv ceph cwd unknown /proc/58629/task/60162/cwd (readlink: Permission denied) 2024-09-12T01:30:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60162 bstore_kv ceph rtd unknown /proc/58629/task/60162/root (readlink: Permission denied) 2024-09-12T01:30:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60162 bstore_kv ceph txt unknown /proc/58629/task/60162/exe (readlink: Permission denied) 2024-09-12T01:30:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60162 bstore_kv ceph NOFD /proc/58629/task/60162/fd (opendir: Permission denied) 2024-09-12T01:30:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60163 bstore_kv ceph cwd unknown /proc/58629/task/60163/cwd (readlink: Permission denied) 2024-09-12T01:30:25.651 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60163 bstore_kv ceph rtd unknown /proc/58629/task/60163/root (readlink: Permission denied) 2024-09-12T01:30:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60163 bstore_kv ceph txt unknown /proc/58629/task/60163/exe (readlink: Permission denied) 2024-09-12T01:30:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60163 bstore_kv ceph NOFD /proc/58629/task/60163/fd (opendir: Permission denied) 2024-09-12T01:30:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60164 bstore_me ceph cwd unknown /proc/58629/task/60164/cwd (readlink: Permission denied) 2024-09-12T01:30:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60164 bstore_me ceph rtd unknown /proc/58629/task/60164/root (readlink: Permission denied) 2024-09-12T01:30:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60164 bstore_me ceph txt unknown /proc/58629/task/60164/exe (readlink: Permission denied) 2024-09-12T01:30:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60164 bstore_me ceph NOFD /proc/58629/task/60164/fd (opendir: Permission denied) 2024-09-12T01:30:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60165 ms_dispat ceph cwd unknown /proc/58629/task/60165/cwd (readlink: Permission denied) 2024-09-12T01:30:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60165 ms_dispat ceph rtd unknown /proc/58629/task/60165/root (readlink: Permission denied) 2024-09-12T01:30:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60165 ms_dispat ceph txt unknown /proc/58629/task/60165/exe (readlink: Permission denied) 2024-09-12T01:30:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60165 ms_dispat ceph NOFD /proc/58629/task/60165/fd (opendir: Permission denied) 2024-09-12T01:30:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60166 ms_local ceph cwd unknown /proc/58629/task/60166/cwd (readlink: Permission denied) 2024-09-12T01:30:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60166 ms_local ceph rtd unknown /proc/58629/task/60166/root (readlink: Permission denied) 2024-09-12T01:30:25.652 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60166 ms_local ceph txt unknown /proc/58629/task/60166/exe (readlink: Permission denied) 2024-09-12T01:30:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60166 ms_local ceph NOFD /proc/58629/task/60166/fd (opendir: Permission denied) 2024-09-12T01:30:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60167 safe_time ceph cwd unknown /proc/58629/task/60167/cwd (readlink: Permission denied) 2024-09-12T01:30:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60167 safe_time ceph rtd unknown /proc/58629/task/60167/root (readlink: Permission denied) 2024-09-12T01:30:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60167 safe_time ceph txt unknown /proc/58629/task/60167/exe (readlink: Permission denied) 2024-09-12T01:30:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60167 safe_time ceph NOFD /proc/58629/task/60167/fd (opendir: Permission denied) 2024-09-12T01:30:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60168 safe_time ceph cwd unknown /proc/58629/task/60168/cwd (readlink: Permission denied) 2024-09-12T01:30:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60168 safe_time ceph rtd unknown /proc/58629/task/60168/root (readlink: Permission denied) 2024-09-12T01:30:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60168 safe_time ceph txt unknown /proc/58629/task/60168/exe (readlink: Permission denied) 2024-09-12T01:30:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60168 safe_time ceph NOFD /proc/58629/task/60168/fd (opendir: Permission denied) 2024-09-12T01:30:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60169 ms_dispat ceph cwd unknown /proc/58629/task/60169/cwd (readlink: Permission denied) 2024-09-12T01:30:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60169 ms_dispat ceph rtd unknown /proc/58629/task/60169/root (readlink: Permission denied) 2024-09-12T01:30:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60169 ms_dispat ceph txt unknown /proc/58629/task/60169/exe (readlink: Permission denied) 2024-09-12T01:30:25.653 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60169 ms_dispat ceph NOFD /proc/58629/task/60169/fd (opendir: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60170 ms_local ceph cwd unknown /proc/58629/task/60170/cwd (readlink: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60170 ms_local ceph rtd unknown /proc/58629/task/60170/root (readlink: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60170 ms_local ceph txt unknown /proc/58629/task/60170/exe (readlink: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60170 ms_local ceph NOFD /proc/58629/task/60170/fd (opendir: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60171 ms_dispat ceph cwd unknown /proc/58629/task/60171/cwd (readlink: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60171 ms_dispat ceph rtd unknown /proc/58629/task/60171/root (readlink: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60171 ms_dispat ceph txt unknown /proc/58629/task/60171/exe (readlink: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60171 ms_dispat ceph NOFD /proc/58629/task/60171/fd (opendir: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60172 ms_local ceph cwd unknown /proc/58629/task/60172/cwd (readlink: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60172 ms_local ceph rtd unknown /proc/58629/task/60172/root (readlink: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60172 ms_local ceph txt unknown /proc/58629/task/60172/exe (readlink: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60172 ms_local ceph NOFD /proc/58629/task/60172/fd (opendir: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60173 ms_dispat ceph cwd unknown /proc/58629/task/60173/cwd (readlink: Permission denied) 2024-09-12T01:30:25.654 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60173 ms_dispat ceph rtd unknown /proc/58629/task/60173/root (readlink: Permission denied) 2024-09-12T01:30:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60173 ms_dispat ceph txt unknown /proc/58629/task/60173/exe (readlink: Permission denied) 2024-09-12T01:30:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60173 ms_dispat ceph NOFD /proc/58629/task/60173/fd (opendir: Permission denied) 2024-09-12T01:30:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60174 ms_local ceph cwd unknown /proc/58629/task/60174/cwd (readlink: Permission denied) 2024-09-12T01:30:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60174 ms_local ceph rtd unknown /proc/58629/task/60174/root (readlink: Permission denied) 2024-09-12T01:30:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60174 ms_local ceph txt unknown /proc/58629/task/60174/exe (readlink: Permission denied) 2024-09-12T01:30:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60174 ms_local ceph NOFD /proc/58629/task/60174/fd (opendir: Permission denied) 2024-09-12T01:30:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60175 ms_dispat ceph cwd unknown /proc/58629/task/60175/cwd (readlink: Permission denied) 2024-09-12T01:30:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60175 ms_dispat ceph rtd unknown /proc/58629/task/60175/root (readlink: Permission denied) 2024-09-12T01:30:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60175 ms_dispat ceph txt unknown /proc/58629/task/60175/exe (readlink: Permission denied) 2024-09-12T01:30:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60175 ms_dispat ceph NOFD /proc/58629/task/60175/fd (opendir: Permission denied) 2024-09-12T01:30:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60176 ms_local ceph cwd unknown /proc/58629/task/60176/cwd (readlink: Permission denied) 2024-09-12T01:30:25.655 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60176 ms_local ceph rtd unknown /proc/58629/task/60176/root (readlink: Permission denied) 2024-09-12T01:30:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60176 ms_local ceph txt unknown /proc/58629/task/60176/exe (readlink: Permission denied) 2024-09-12T01:30:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60176 ms_local ceph NOFD /proc/58629/task/60176/fd (opendir: Permission denied) 2024-09-12T01:30:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60177 ms_dispat ceph cwd unknown /proc/58629/task/60177/cwd (readlink: Permission denied) 2024-09-12T01:30:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60177 ms_dispat ceph rtd unknown /proc/58629/task/60177/root (readlink: Permission denied) 2024-09-12T01:30:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60177 ms_dispat ceph txt unknown /proc/58629/task/60177/exe (readlink: Permission denied) 2024-09-12T01:30:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60177 ms_dispat ceph NOFD /proc/58629/task/60177/fd (opendir: Permission denied) 2024-09-12T01:30:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60178 ms_local ceph cwd unknown /proc/58629/task/60178/cwd (readlink: Permission denied) 2024-09-12T01:30:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60178 ms_local ceph rtd unknown /proc/58629/task/60178/root (readlink: Permission denied) 2024-09-12T01:30:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60178 ms_local ceph txt unknown /proc/58629/task/60178/exe (readlink: Permission denied) 2024-09-12T01:30:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60178 ms_local ceph NOFD /proc/58629/task/60178/fd (opendir: Permission denied) 2024-09-12T01:30:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60179 ms_dispat ceph cwd unknown /proc/58629/task/60179/cwd (readlink: Permission denied) 2024-09-12T01:30:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60179 ms_dispat ceph rtd unknown /proc/58629/task/60179/root (readlink: Permission denied) 2024-09-12T01:30:25.656 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60179 ms_dispat ceph txt unknown /proc/58629/task/60179/exe (readlink: Permission denied) 2024-09-12T01:30:25.657 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60179 ms_dispat ceph NOFD /proc/58629/task/60179/fd (opendir: Permission denied) 2024-09-12T01:30:25.657 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60180 ms_local ceph cwd unknown /proc/58629/task/60180/cwd (readlink: Permission denied) 2024-09-12T01:30:25.657 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60180 ms_local ceph rtd unknown /proc/58629/task/60180/root (readlink: Permission denied) 2024-09-12T01:30:25.657 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60180 ms_local ceph txt unknown /proc/58629/task/60180/exe (readlink: Permission denied) 2024-09-12T01:30:25.657 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60180 ms_local ceph NOFD /proc/58629/task/60180/fd (opendir: Permission denied) 2024-09-12T01:30:25.657 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60181 fn_anonym ceph cwd unknown /proc/58629/task/60181/cwd (readlink: Permission denied) 2024-09-12T01:30:25.657 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60181 fn_anonym ceph rtd unknown /proc/58629/task/60181/root (readlink: Permission denied) 2024-09-12T01:30:25.657 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60181 fn_anonym ceph txt unknown /proc/58629/task/60181/exe (readlink: Permission denied) 2024-09-12T01:30:25.657 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60181 fn_anonym ceph NOFD /proc/58629/task/60181/fd (opendir: Permission denied) 2024-09-12T01:30:25.657 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60182 finisher ceph cwd unknown /proc/58629/task/60182/cwd (readlink: Permission denied) 2024-09-12T01:30:25.657 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60182 finisher ceph rtd unknown /proc/58629/task/60182/root (readlink: Permission denied) 2024-09-12T01:30:25.657 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60182 finisher ceph txt unknown /proc/58629/task/60182/exe (readlink: Permission denied) 2024-09-12T01:30:25.657 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60182 finisher ceph NOFD /proc/58629/task/60182/fd (opendir: Permission denied) 2024-09-12T01:30:25.658 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60183 safe_time ceph cwd unknown /proc/58629/task/60183/cwd (readlink: Permission denied) 2024-09-12T01:30:25.658 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60183 safe_time ceph rtd unknown /proc/58629/task/60183/root (readlink: Permission denied) 2024-09-12T01:30:25.658 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60183 safe_time ceph txt unknown /proc/58629/task/60183/exe (readlink: Permission denied) 2024-09-12T01:30:25.658 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60183 safe_time ceph NOFD /proc/58629/task/60183/fd (opendir: Permission denied) 2024-09-12T01:30:25.658 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60184 safe_time ceph cwd unknown /proc/58629/task/60184/cwd (readlink: Permission denied) 2024-09-12T01:30:25.658 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60184 safe_time ceph rtd unknown /proc/58629/task/60184/root (readlink: Permission denied) 2024-09-12T01:30:25.658 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60184 safe_time ceph txt unknown /proc/58629/task/60184/exe (readlink: Permission denied) 2024-09-12T01:30:25.658 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60184 safe_time ceph NOFD /proc/58629/task/60184/fd (opendir: Permission denied) 2024-09-12T01:30:25.658 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60185 ceph-osd ceph cwd unknown /proc/58629/task/60185/cwd (readlink: Permission denied) 2024-09-12T01:30:25.658 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60185 ceph-osd ceph rtd unknown /proc/58629/task/60185/root (readlink: Permission denied) 2024-09-12T01:30:25.658 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60185 ceph-osd ceph txt unknown /proc/58629/task/60185/exe (readlink: Permission denied) 2024-09-12T01:30:25.658 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60185 ceph-osd ceph NOFD /proc/58629/task/60185/fd (opendir: Permission denied) 2024-09-12T01:30:25.658 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60186 osd_srv_a ceph cwd unknown /proc/58629/task/60186/cwd (readlink: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60186 osd_srv_a ceph rtd unknown /proc/58629/task/60186/root (readlink: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60186 osd_srv_a ceph txt unknown /proc/58629/task/60186/exe (readlink: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60186 osd_srv_a ceph NOFD /proc/58629/task/60186/fd (opendir: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60187 tp_osd_tp ceph cwd unknown /proc/58629/task/60187/cwd (readlink: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60187 tp_osd_tp ceph rtd unknown /proc/58629/task/60187/root (readlink: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60187 tp_osd_tp ceph txt unknown /proc/58629/task/60187/exe (readlink: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60187 tp_osd_tp ceph NOFD /proc/58629/task/60187/fd (opendir: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60188 tp_osd_tp ceph cwd unknown /proc/58629/task/60188/cwd (readlink: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60188 tp_osd_tp ceph rtd unknown /proc/58629/task/60188/root (readlink: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60188 tp_osd_tp ceph txt unknown /proc/58629/task/60188/exe (readlink: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60188 tp_osd_tp ceph NOFD /proc/58629/task/60188/fd (opendir: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60189 tp_osd_tp ceph cwd unknown /proc/58629/task/60189/cwd (readlink: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60189 tp_osd_tp ceph rtd unknown /proc/58629/task/60189/root (readlink: Permission denied) 2024-09-12T01:30:25.659 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60189 tp_osd_tp ceph txt unknown /proc/58629/task/60189/exe (readlink: Permission denied) 2024-09-12T01:30:25.660 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60189 tp_osd_tp ceph NOFD /proc/58629/task/60189/fd (opendir: Permission denied) 2024-09-12T01:30:25.660 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60190 tp_osd_tp ceph cwd unknown /proc/58629/task/60190/cwd (readlink: Permission denied) 2024-09-12T01:30:25.660 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60190 tp_osd_tp ceph rtd unknown /proc/58629/task/60190/root (readlink: Permission denied) 2024-09-12T01:30:25.660 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60190 tp_osd_tp ceph txt unknown /proc/58629/task/60190/exe (readlink: Permission denied) 2024-09-12T01:30:25.660 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60190 tp_osd_tp ceph NOFD /proc/58629/task/60190/fd (opendir: Permission denied) 2024-09-12T01:30:25.660 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60191 tp_osd_tp ceph cwd unknown /proc/58629/task/60191/cwd (readlink: Permission denied) 2024-09-12T01:30:25.660 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60191 tp_osd_tp ceph rtd unknown /proc/58629/task/60191/root (readlink: Permission denied) 2024-09-12T01:30:25.660 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60191 tp_osd_tp ceph txt unknown /proc/58629/task/60191/exe (readlink: Permission denied) 2024-09-12T01:30:25.660 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60191 tp_osd_tp ceph NOFD /proc/58629/task/60191/fd (opendir: Permission denied) 2024-09-12T01:30:25.660 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60192 tp_osd_tp ceph cwd unknown /proc/58629/task/60192/cwd (readlink: Permission denied) 2024-09-12T01:30:25.660 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60192 tp_osd_tp ceph rtd unknown /proc/58629/task/60192/root (readlink: Permission denied) 2024-09-12T01:30:25.660 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60192 tp_osd_tp ceph txt unknown /proc/58629/task/60192/exe (readlink: Permission denied) 2024-09-12T01:30:25.661 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60192 tp_osd_tp ceph NOFD /proc/58629/task/60192/fd (opendir: Permission denied) 2024-09-12T01:30:25.661 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60193 tp_osd_tp ceph cwd unknown /proc/58629/task/60193/cwd (readlink: Permission denied) 2024-09-12T01:30:25.661 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60193 tp_osd_tp ceph rtd unknown /proc/58629/task/60193/root (readlink: Permission denied) 2024-09-12T01:30:25.661 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60193 tp_osd_tp ceph txt unknown /proc/58629/task/60193/exe (readlink: Permission denied) 2024-09-12T01:30:25.661 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60193 tp_osd_tp ceph NOFD /proc/58629/task/60193/fd (opendir: Permission denied) 2024-09-12T01:30:25.661 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60194 tp_osd_tp ceph cwd unknown /proc/58629/task/60194/cwd (readlink: Permission denied) 2024-09-12T01:30:25.661 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60194 tp_osd_tp ceph rtd unknown /proc/58629/task/60194/root (readlink: Permission denied) 2024-09-12T01:30:25.661 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60194 tp_osd_tp ceph txt unknown /proc/58629/task/60194/exe (readlink: Permission denied) 2024-09-12T01:30:25.661 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60194 tp_osd_tp ceph NOFD /proc/58629/task/60194/fd (opendir: Permission denied) 2024-09-12T01:30:25.661 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60195 tp_osd_tp ceph cwd unknown /proc/58629/task/60195/cwd (readlink: Permission denied) 2024-09-12T01:30:25.661 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60195 tp_osd_tp ceph rtd unknown /proc/58629/task/60195/root (readlink: Permission denied) 2024-09-12T01:30:25.661 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60195 tp_osd_tp ceph txt unknown /proc/58629/task/60195/exe (readlink: Permission denied) 2024-09-12T01:30:25.661 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60195 tp_osd_tp ceph NOFD /proc/58629/task/60195/fd (opendir: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60196 tp_osd_tp ceph cwd unknown /proc/58629/task/60196/cwd (readlink: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60196 tp_osd_tp ceph rtd unknown /proc/58629/task/60196/root (readlink: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60196 tp_osd_tp ceph txt unknown /proc/58629/task/60196/exe (readlink: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60196 tp_osd_tp ceph NOFD /proc/58629/task/60196/fd (opendir: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60197 tp_osd_tp ceph cwd unknown /proc/58629/task/60197/cwd (readlink: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60197 tp_osd_tp ceph rtd unknown /proc/58629/task/60197/root (readlink: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60197 tp_osd_tp ceph txt unknown /proc/58629/task/60197/exe (readlink: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60197 tp_osd_tp ceph NOFD /proc/58629/task/60197/fd (opendir: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60198 tp_osd_tp ceph cwd unknown /proc/58629/task/60198/cwd (readlink: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60198 tp_osd_tp ceph rtd unknown /proc/58629/task/60198/root (readlink: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60198 tp_osd_tp ceph txt unknown /proc/58629/task/60198/exe (readlink: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60198 tp_osd_tp ceph NOFD /proc/58629/task/60198/fd (opendir: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60199 tp_osd_tp ceph cwd unknown /proc/58629/task/60199/cwd (readlink: Permission denied) 2024-09-12T01:30:25.662 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60199 tp_osd_tp ceph rtd unknown /proc/58629/task/60199/root (readlink: Permission denied) 2024-09-12T01:30:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60199 tp_osd_tp ceph txt unknown /proc/58629/task/60199/exe (readlink: Permission denied) 2024-09-12T01:30:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60199 tp_osd_tp ceph NOFD /proc/58629/task/60199/fd (opendir: Permission denied) 2024-09-12T01:30:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60200 tp_osd_tp ceph cwd unknown /proc/58629/task/60200/cwd (readlink: Permission denied) 2024-09-12T01:30:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60200 tp_osd_tp ceph rtd unknown /proc/58629/task/60200/root (readlink: Permission denied) 2024-09-12T01:30:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60200 tp_osd_tp ceph txt unknown /proc/58629/task/60200/exe (readlink: Permission denied) 2024-09-12T01:30:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60200 tp_osd_tp ceph NOFD /proc/58629/task/60200/fd (opendir: Permission denied) 2024-09-12T01:30:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60201 tp_osd_tp ceph cwd unknown /proc/58629/task/60201/cwd (readlink: Permission denied) 2024-09-12T01:30:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60201 tp_osd_tp ceph rtd unknown /proc/58629/task/60201/root (readlink: Permission denied) 2024-09-12T01:30:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60201 tp_osd_tp ceph txt unknown /proc/58629/task/60201/exe (readlink: Permission denied) 2024-09-12T01:30:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60201 tp_osd_tp ceph NOFD /proc/58629/task/60201/fd (opendir: Permission denied) 2024-09-12T01:30:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60202 tp_osd_tp ceph cwd unknown /proc/58629/task/60202/cwd (readlink: Permission denied) 2024-09-12T01:30:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60202 tp_osd_tp ceph rtd unknown /proc/58629/task/60202/root (readlink: Permission denied) 2024-09-12T01:30:25.663 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60202 tp_osd_tp ceph txt unknown /proc/58629/task/60202/exe (readlink: Permission denied) 2024-09-12T01:30:25.664 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60202 tp_osd_tp ceph NOFD /proc/58629/task/60202/fd (opendir: Permission denied) 2024-09-12T01:30:25.664 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60203 osd_srv_h ceph cwd unknown /proc/58629/task/60203/cwd (readlink: Permission denied) 2024-09-12T01:30:25.664 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60203 osd_srv_h ceph rtd unknown /proc/58629/task/60203/root (readlink: Permission denied) 2024-09-12T01:30:25.664 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60203 osd_srv_h ceph txt unknown /proc/58629/task/60203/exe (readlink: Permission denied) 2024-09-12T01:30:25.664 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 58629 60203 osd_srv_h ceph NOFD /proc/58629/task/60203/fd (opendir: Permission denied) 2024-09-12T01:30:25.664 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 59502 root cwd unknown /proc/59502/cwd (readlink: Permission denied) 2024-09-12T01:30:25.664 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 59502 root rtd unknown /proc/59502/root (readlink: Permission denied) 2024-09-12T01:30:25.664 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 59502 root txt unknown /proc/59502/exe (readlink: Permission denied) 2024-09-12T01:30:25.664 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 59502 root NOFD /proc/59502/fd (opendir: Permission denied) 2024-09-12T01:30:25.664 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 59519 root cwd unknown /proc/59519/cwd (readlink: Permission denied) 2024-09-12T01:30:25.664 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 59519 root rtd unknown /proc/59519/root (readlink: Permission denied) 2024-09-12T01:30:25.664 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 59519 root txt unknown /proc/59519/exe (readlink: Permission denied) 2024-09-12T01:30:25.664 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 59519 root NOFD /proc/59519/fd (opendir: Permission denied) 2024-09-12T01:30:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 62646 root cwd unknown /proc/62646/cwd (readlink: Permission denied) 2024-09-12T01:30:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 62646 root rtd unknown /proc/62646/root (readlink: Permission denied) 2024-09-12T01:30:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 62646 root txt unknown /proc/62646/exe (readlink: Permission denied) 2024-09-12T01:30:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 62646 root NOFD /proc/62646/fd (opendir: Permission denied) 2024-09-12T01:30:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 64457 root cwd unknown /proc/64457/cwd (readlink: Permission denied) 2024-09-12T01:30:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 64457 root rtd unknown /proc/64457/root (readlink: Permission denied) 2024-09-12T01:30:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 64457 root txt unknown /proc/64457/exe (readlink: Permission denied) 2024-09-12T01:30:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 64457 root NOFD /proc/64457/fd (opendir: Permission denied) 2024-09-12T01:30:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 64838 root cwd unknown /proc/64838/cwd (readlink: Permission denied) 2024-09-12T01:30:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 64838 root rtd unknown /proc/64838/root (readlink: Permission denied) 2024-09-12T01:30:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 64838 root txt unknown /proc/64838/exe (readlink: Permission denied) 2024-09-12T01:30:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/7 64838 root NOFD /proc/64838/fd (opendir: Permission denied) 2024-09-12T01:30:25.665 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 65182 root cwd unknown /proc/65182/cwd (readlink: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 65182 root rtd unknown /proc/65182/root (readlink: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 65182 root txt unknown /proc/65182/exe (readlink: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 65182 root NOFD /proc/65182/fd (opendir: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 65184 root cwd unknown /proc/65184/cwd (readlink: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 65184 root rtd unknown /proc/65184/root (readlink: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 65184 root txt unknown /proc/65184/exe (readlink: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 65184 root NOFD /proc/65184/fd (opendir: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 ceph cwd unknown /proc/65186/cwd (readlink: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 ceph rtd unknown /proc/65186/root (readlink: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 ceph txt unknown /proc/65186/exe (readlink: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 ceph NOFD /proc/65186/fd (opendir: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65187 log ceph cwd unknown /proc/65186/task/65187/cwd (readlink: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65187 log ceph rtd unknown /proc/65186/task/65187/root (readlink: Permission denied) 2024-09-12T01:30:25.666 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65187 log ceph txt unknown /proc/65186/task/65187/exe (readlink: Permission denied) 2024-09-12T01:30:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65187 log ceph NOFD /proc/65186/task/65187/fd (opendir: Permission denied) 2024-09-12T01:30:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65189 msgr-work ceph cwd unknown /proc/65186/task/65189/cwd (readlink: Permission denied) 2024-09-12T01:30:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65189 msgr-work ceph rtd unknown /proc/65186/task/65189/root (readlink: Permission denied) 2024-09-12T01:30:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65189 msgr-work ceph txt unknown /proc/65186/task/65189/exe (readlink: Permission denied) 2024-09-12T01:30:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65189 msgr-work ceph NOFD /proc/65186/task/65189/fd (opendir: Permission denied) 2024-09-12T01:30:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65190 msgr-work ceph cwd unknown /proc/65186/task/65190/cwd (readlink: Permission denied) 2024-09-12T01:30:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65190 msgr-work ceph rtd unknown /proc/65186/task/65190/root (readlink: Permission denied) 2024-09-12T01:30:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65190 msgr-work ceph txt unknown /proc/65186/task/65190/exe (readlink: Permission denied) 2024-09-12T01:30:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65190 msgr-work ceph NOFD /proc/65186/task/65190/fd (opendir: Permission denied) 2024-09-12T01:30:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65191 msgr-work ceph cwd unknown /proc/65186/task/65191/cwd (readlink: Permission denied) 2024-09-12T01:30:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65191 msgr-work ceph rtd unknown /proc/65186/task/65191/root (readlink: Permission denied) 2024-09-12T01:30:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65191 msgr-work ceph txt unknown /proc/65186/task/65191/exe (readlink: Permission denied) 2024-09-12T01:30:25.667 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65191 msgr-work ceph NOFD /proc/65186/task/65191/fd (opendir: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65195 service ceph cwd unknown /proc/65186/task/65195/cwd (readlink: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65195 service ceph rtd unknown /proc/65186/task/65195/root (readlink: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65195 service ceph txt unknown /proc/65186/task/65195/exe (readlink: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65195 service ceph NOFD /proc/65186/task/65195/fd (opendir: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65196 admin_soc ceph cwd unknown /proc/65186/task/65196/cwd (readlink: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65196 admin_soc ceph rtd unknown /proc/65186/task/65196/root (readlink: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65196 admin_soc ceph txt unknown /proc/65186/task/65196/exe (readlink: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65196 admin_soc ceph NOFD /proc/65186/task/65196/fd (opendir: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65537 signal_ha ceph cwd unknown /proc/65186/task/65537/cwd (readlink: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65537 signal_ha ceph rtd unknown /proc/65186/task/65537/root (readlink: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65537 signal_ha ceph txt unknown /proc/65186/task/65537/exe (readlink: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65537 signal_ha ceph NOFD /proc/65186/task/65537/fd (opendir: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65538 io_contex ceph cwd unknown /proc/65186/task/65538/cwd (readlink: Permission denied) 2024-09-12T01:30:25.668 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65538 io_contex ceph rtd unknown /proc/65186/task/65538/root (readlink: Permission denied) 2024-09-12T01:30:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65538 io_contex ceph txt unknown /proc/65186/task/65538/exe (readlink: Permission denied) 2024-09-12T01:30:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65538 io_contex ceph NOFD /proc/65186/task/65538/fd (opendir: Permission denied) 2024-09-12T01:30:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65539 io_contex ceph cwd unknown /proc/65186/task/65539/cwd (readlink: Permission denied) 2024-09-12T01:30:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65539 io_contex ceph rtd unknown /proc/65186/task/65539/root (readlink: Permission denied) 2024-09-12T01:30:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65539 io_contex ceph txt unknown /proc/65186/task/65539/exe (readlink: Permission denied) 2024-09-12T01:30:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65539 io_contex ceph NOFD /proc/65186/task/65539/fd (opendir: Permission denied) 2024-09-12T01:30:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65559 OpHistory ceph cwd unknown /proc/65186/task/65559/cwd (readlink: Permission denied) 2024-09-12T01:30:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65559 OpHistory ceph rtd unknown /proc/65186/task/65559/root (readlink: Permission denied) 2024-09-12T01:30:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65559 OpHistory ceph txt unknown /proc/65186/task/65559/exe (readlink: Permission denied) 2024-09-12T01:30:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65559 OpHistory ceph NOFD /proc/65186/task/65559/fd (opendir: Permission denied) 2024-09-12T01:30:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65560 ceph_time ceph cwd unknown /proc/65186/task/65560/cwd (readlink: Permission denied) 2024-09-12T01:30:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65560 ceph_time ceph rtd unknown /proc/65186/task/65560/root (readlink: Permission denied) 2024-09-12T01:30:25.669 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65560 ceph_time ceph txt unknown /proc/65186/task/65560/exe (readlink: Permission denied) 2024-09-12T01:30:25.670 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65560 ceph_time ceph NOFD /proc/65186/task/65560/fd (opendir: Permission denied) 2024-09-12T01:30:25.670 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65859 ceph-osd ceph cwd unknown /proc/65186/task/65859/cwd (readlink: Permission denied) 2024-09-12T01:30:25.670 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65859 ceph-osd ceph rtd unknown /proc/65186/task/65859/root (readlink: Permission denied) 2024-09-12T01:30:25.670 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65859 ceph-osd ceph txt unknown /proc/65186/task/65859/exe (readlink: Permission denied) 2024-09-12T01:30:25.670 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65859 ceph-osd ceph NOFD /proc/65186/task/65859/fd (opendir: Permission denied) 2024-09-12T01:30:25.670 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65860 safe_time ceph cwd unknown /proc/65186/task/65860/cwd (readlink: Permission denied) 2024-09-12T01:30:25.670 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65860 safe_time ceph rtd unknown /proc/65186/task/65860/root (readlink: Permission denied) 2024-09-12T01:30:25.670 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65860 safe_time ceph txt unknown /proc/65186/task/65860/exe (readlink: Permission denied) 2024-09-12T01:30:25.670 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65860 safe_time ceph NOFD /proc/65186/task/65860/fd (opendir: Permission denied) 2024-09-12T01:30:25.670 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65861 safe_time ceph cwd unknown /proc/65186/task/65861/cwd (readlink: Permission denied) 2024-09-12T01:30:25.670 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65861 safe_time ceph rtd unknown /proc/65186/task/65861/root (readlink: Permission denied) 2024-09-12T01:30:25.670 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65861 safe_time ceph txt unknown /proc/65186/task/65861/exe (readlink: Permission denied) 2024-09-12T01:30:25.670 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65861 safe_time ceph NOFD /proc/65186/task/65861/fd (opendir: Permission denied) 2024-09-12T01:30:25.671 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65862 safe_time ceph cwd unknown /proc/65186/task/65862/cwd (readlink: Permission denied) 2024-09-12T01:30:25.671 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65862 safe_time ceph rtd unknown /proc/65186/task/65862/root (readlink: Permission denied) 2024-09-12T01:30:25.671 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65862 safe_time ceph txt unknown /proc/65186/task/65862/exe (readlink: Permission denied) 2024-09-12T01:30:25.671 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65862 safe_time ceph NOFD /proc/65186/task/65862/fd (opendir: Permission denied) 2024-09-12T01:30:25.671 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65864 safe_time ceph cwd unknown /proc/65186/task/65864/cwd (readlink: Permission denied) 2024-09-12T01:30:25.671 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65864 safe_time ceph rtd unknown /proc/65186/task/65864/root (readlink: Permission denied) 2024-09-12T01:30:25.671 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65864 safe_time ceph txt unknown /proc/65186/task/65864/exe (readlink: Permission denied) 2024-09-12T01:30:25.671 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65864 safe_time ceph NOFD /proc/65186/task/65864/fd (opendir: Permission denied) 2024-09-12T01:30:25.671 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65865 fn_anonym ceph cwd unknown /proc/65186/task/65865/cwd (readlink: Permission denied) 2024-09-12T01:30:25.671 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65865 fn_anonym ceph rtd unknown /proc/65186/task/65865/root (readlink: Permission denied) 2024-09-12T01:30:25.671 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65865 fn_anonym ceph txt unknown /proc/65186/task/65865/exe (readlink: Permission denied) 2024-09-12T01:30:25.671 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65865 fn_anonym ceph NOFD /proc/65186/task/65865/fd (opendir: Permission denied) 2024-09-12T01:30:25.671 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65951 rocksdb:l ceph cwd unknown /proc/65186/task/65951/cwd (readlink: Permission denied) 2024-09-12T01:30:25.672 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65951 rocksdb:l ceph rtd unknown /proc/65186/task/65951/root (readlink: Permission denied) 2024-09-12T01:30:25.672 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65951 rocksdb:l ceph txt unknown /proc/65186/task/65951/exe (readlink: Permission denied) 2024-09-12T01:30:25.672 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65951 rocksdb:l ceph NOFD /proc/65186/task/65951/fd (opendir: Permission denied) 2024-09-12T01:30:25.672 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65952 rocksdb:l ceph cwd unknown /proc/65186/task/65952/cwd (readlink: Permission denied) 2024-09-12T01:30:25.672 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65952 rocksdb:l ceph rtd unknown /proc/65186/task/65952/root (readlink: Permission denied) 2024-09-12T01:30:25.672 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65952 rocksdb:l ceph txt unknown /proc/65186/task/65952/exe (readlink: Permission denied) 2024-09-12T01:30:25.672 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65952 rocksdb:l ceph NOFD /proc/65186/task/65952/fd (opendir: Permission denied) 2024-09-12T01:30:25.672 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65953 rocksdb:l ceph cwd unknown /proc/65186/task/65953/cwd (readlink: Permission denied) 2024-09-12T01:30:25.672 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65953 rocksdb:l ceph rtd unknown /proc/65186/task/65953/root (readlink: Permission denied) 2024-09-12T01:30:25.672 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65953 rocksdb:l ceph txt unknown /proc/65186/task/65953/exe (readlink: Permission denied) 2024-09-12T01:30:25.672 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65953 rocksdb:l ceph NOFD /proc/65186/task/65953/fd (opendir: Permission denied) 2024-09-12T01:30:25.672 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65954 rocksdb:h ceph cwd unknown /proc/65186/task/65954/cwd (readlink: Permission denied) 2024-09-12T01:30:25.672 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65954 rocksdb:h ceph rtd unknown /proc/65186/task/65954/root (readlink: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65954 rocksdb:h ceph txt unknown /proc/65186/task/65954/exe (readlink: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 65954 rocksdb:h ceph NOFD /proc/65186/task/65954/fd (opendir: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66354 bstore_ai ceph cwd unknown /proc/65186/task/66354/cwd (readlink: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66354 bstore_ai ceph rtd unknown /proc/65186/task/66354/root (readlink: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66354 bstore_ai ceph txt unknown /proc/65186/task/66354/exe (readlink: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66354 bstore_ai ceph NOFD /proc/65186/task/66354/fd (opendir: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66355 bstore_di ceph cwd unknown /proc/65186/task/66355/cwd (readlink: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66355 bstore_di ceph rtd unknown /proc/65186/task/66355/root (readlink: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66355 bstore_di ceph txt unknown /proc/65186/task/66355/exe (readlink: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66355 bstore_di ceph NOFD /proc/65186/task/66355/fd (opendir: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66840 bstore_ai ceph cwd unknown /proc/65186/task/66840/cwd (readlink: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66840 bstore_ai ceph rtd unknown /proc/65186/task/66840/root (readlink: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66840 bstore_ai ceph txt unknown /proc/65186/task/66840/exe (readlink: Permission denied) 2024-09-12T01:30:25.673 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66840 bstore_ai ceph NOFD /proc/65186/task/66840/fd (opendir: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66841 bstore_di ceph cwd unknown /proc/65186/task/66841/cwd (readlink: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66841 bstore_di ceph rtd unknown /proc/65186/task/66841/root (readlink: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66841 bstore_di ceph txt unknown /proc/65186/task/66841/exe (readlink: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 66841 bstore_di ceph NOFD /proc/65186/task/66841/fd (opendir: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67157 ceph-osd ceph cwd unknown /proc/65186/task/67157/cwd (readlink: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67157 ceph-osd ceph rtd unknown /proc/65186/task/67157/root (readlink: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67157 ceph-osd ceph txt unknown /proc/65186/task/67157/exe (readlink: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67157 ceph-osd ceph NOFD /proc/65186/task/67157/fd (opendir: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67164 cfin ceph cwd unknown /proc/65186/task/67164/cwd (readlink: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67164 cfin ceph rtd unknown /proc/65186/task/67164/root (readlink: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67164 cfin ceph txt unknown /proc/65186/task/67164/exe (readlink: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67164 cfin ceph NOFD /proc/65186/task/67164/fd (opendir: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67165 bstore_kv ceph cwd unknown /proc/65186/task/67165/cwd (readlink: Permission denied) 2024-09-12T01:30:25.674 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67165 bstore_kv ceph rtd unknown /proc/65186/task/67165/root (readlink: Permission denied) 2024-09-12T01:30:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67165 bstore_kv ceph txt unknown /proc/65186/task/67165/exe (readlink: Permission denied) 2024-09-12T01:30:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67165 bstore_kv ceph NOFD /proc/65186/task/67165/fd (opendir: Permission denied) 2024-09-12T01:30:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67166 bstore_kv ceph cwd unknown /proc/65186/task/67166/cwd (readlink: Permission denied) 2024-09-12T01:30:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67166 bstore_kv ceph rtd unknown /proc/65186/task/67166/root (readlink: Permission denied) 2024-09-12T01:30:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67166 bstore_kv ceph txt unknown /proc/65186/task/67166/exe (readlink: Permission denied) 2024-09-12T01:30:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67166 bstore_kv ceph NOFD /proc/65186/task/67166/fd (opendir: Permission denied) 2024-09-12T01:30:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67168 bstore_me ceph cwd unknown /proc/65186/task/67168/cwd (readlink: Permission denied) 2024-09-12T01:30:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67168 bstore_me ceph rtd unknown /proc/65186/task/67168/root (readlink: Permission denied) 2024-09-12T01:30:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67168 bstore_me ceph txt unknown /proc/65186/task/67168/exe (readlink: Permission denied) 2024-09-12T01:30:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67168 bstore_me ceph NOFD /proc/65186/task/67168/fd (opendir: Permission denied) 2024-09-12T01:30:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67275 ms_dispat ceph cwd unknown /proc/65186/task/67275/cwd (readlink: Permission denied) 2024-09-12T01:30:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67275 ms_dispat ceph rtd unknown /proc/65186/task/67275/root (readlink: Permission denied) 2024-09-12T01:30:25.675 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67275 ms_dispat ceph txt unknown /proc/65186/task/67275/exe (readlink: Permission denied) 2024-09-12T01:30:25.676 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67275 ms_dispat ceph NOFD /proc/65186/task/67275/fd (opendir: Permission denied) 2024-09-12T01:30:25.676 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67277 ms_local ceph cwd unknown /proc/65186/task/67277/cwd (readlink: Permission denied) 2024-09-12T01:30:25.676 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67277 ms_local ceph rtd unknown /proc/65186/task/67277/root (readlink: Permission denied) 2024-09-12T01:30:25.676 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67277 ms_local ceph txt unknown /proc/65186/task/67277/exe (readlink: Permission denied) 2024-09-12T01:30:25.676 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67277 ms_local ceph NOFD /proc/65186/task/67277/fd (opendir: Permission denied) 2024-09-12T01:30:25.676 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67278 safe_time ceph cwd unknown /proc/65186/task/67278/cwd (readlink: Permission denied) 2024-09-12T01:30:25.676 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67278 safe_time ceph rtd unknown /proc/65186/task/67278/root (readlink: Permission denied) 2024-09-12T01:30:25.676 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67278 safe_time ceph txt unknown /proc/65186/task/67278/exe (readlink: Permission denied) 2024-09-12T01:30:25.676 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67278 safe_time ceph NOFD /proc/65186/task/67278/fd (opendir: Permission denied) 2024-09-12T01:30:25.676 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67280 safe_time ceph cwd unknown /proc/65186/task/67280/cwd (readlink: Permission denied) 2024-09-12T01:30:25.676 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67280 safe_time ceph rtd unknown /proc/65186/task/67280/root (readlink: Permission denied) 2024-09-12T01:30:25.676 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67280 safe_time ceph txt unknown /proc/65186/task/67280/exe (readlink: Permission denied) 2024-09-12T01:30:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67280 safe_time ceph NOFD /proc/65186/task/67280/fd (opendir: Permission denied) 2024-09-12T01:30:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67281 ms_dispat ceph cwd unknown /proc/65186/task/67281/cwd (readlink: Permission denied) 2024-09-12T01:30:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67281 ms_dispat ceph rtd unknown /proc/65186/task/67281/root (readlink: Permission denied) 2024-09-12T01:30:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67281 ms_dispat ceph txt unknown /proc/65186/task/67281/exe (readlink: Permission denied) 2024-09-12T01:30:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67281 ms_dispat ceph NOFD /proc/65186/task/67281/fd (opendir: Permission denied) 2024-09-12T01:30:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67283 ms_local ceph cwd unknown /proc/65186/task/67283/cwd (readlink: Permission denied) 2024-09-12T01:30:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67283 ms_local ceph rtd unknown /proc/65186/task/67283/root (readlink: Permission denied) 2024-09-12T01:30:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67283 ms_local ceph txt unknown /proc/65186/task/67283/exe (readlink: Permission denied) 2024-09-12T01:30:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67283 ms_local ceph NOFD /proc/65186/task/67283/fd (opendir: Permission denied) 2024-09-12T01:30:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67284 ms_dispat ceph cwd unknown /proc/65186/task/67284/cwd (readlink: Permission denied) 2024-09-12T01:30:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67284 ms_dispat ceph rtd unknown /proc/65186/task/67284/root (readlink: Permission denied) 2024-09-12T01:30:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67284 ms_dispat ceph txt unknown /proc/65186/task/67284/exe (readlink: Permission denied) 2024-09-12T01:30:25.677 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67284 ms_dispat ceph NOFD /proc/65186/task/67284/fd (opendir: Permission denied) 2024-09-12T01:30:25.678 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67285 ms_local ceph cwd unknown /proc/65186/task/67285/cwd (readlink: Permission denied) 2024-09-12T01:30:25.678 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67285 ms_local ceph rtd unknown /proc/65186/task/67285/root (readlink: Permission denied) 2024-09-12T01:30:25.678 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67285 ms_local ceph txt unknown /proc/65186/task/67285/exe (readlink: Permission denied) 2024-09-12T01:30:25.678 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67285 ms_local ceph NOFD /proc/65186/task/67285/fd (opendir: Permission denied) 2024-09-12T01:30:25.678 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67287 ms_dispat ceph cwd unknown /proc/65186/task/67287/cwd (readlink: Permission denied) 2024-09-12T01:30:25.678 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67287 ms_dispat ceph rtd unknown /proc/65186/task/67287/root (readlink: Permission denied) 2024-09-12T01:30:25.678 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67287 ms_dispat ceph txt unknown /proc/65186/task/67287/exe (readlink: Permission denied) 2024-09-12T01:30:25.678 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67287 ms_dispat ceph NOFD /proc/65186/task/67287/fd (opendir: Permission denied) 2024-09-12T01:30:25.678 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67288 ms_local ceph cwd unknown /proc/65186/task/67288/cwd (readlink: Permission denied) 2024-09-12T01:30:25.678 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67288 ms_local ceph rtd unknown /proc/65186/task/67288/root (readlink: Permission denied) 2024-09-12T01:30:25.678 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67288 ms_local ceph txt unknown /proc/65186/task/67288/exe (readlink: Permission denied) 2024-09-12T01:30:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67288 ms_local ceph NOFD /proc/65186/task/67288/fd (opendir: Permission denied) 2024-09-12T01:30:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67289 ms_dispat ceph cwd unknown /proc/65186/task/67289/cwd (readlink: Permission denied) 2024-09-12T01:30:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67289 ms_dispat ceph rtd unknown /proc/65186/task/67289/root (readlink: Permission denied) 2024-09-12T01:30:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67289 ms_dispat ceph txt unknown /proc/65186/task/67289/exe (readlink: Permission denied) 2024-09-12T01:30:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67289 ms_dispat ceph NOFD /proc/65186/task/67289/fd (opendir: Permission denied) 2024-09-12T01:30:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67291 ms_local ceph cwd unknown /proc/65186/task/67291/cwd (readlink: Permission denied) 2024-09-12T01:30:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67291 ms_local ceph rtd unknown /proc/65186/task/67291/root (readlink: Permission denied) 2024-09-12T01:30:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67291 ms_local ceph txt unknown /proc/65186/task/67291/exe (readlink: Permission denied) 2024-09-12T01:30:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67291 ms_local ceph NOFD /proc/65186/task/67291/fd (opendir: Permission denied) 2024-09-12T01:30:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67292 ms_dispat ceph cwd unknown /proc/65186/task/67292/cwd (readlink: Permission denied) 2024-09-12T01:30:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67292 ms_dispat ceph rtd unknown /proc/65186/task/67292/root (readlink: Permission denied) 2024-09-12T01:30:25.679 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67292 ms_dispat ceph txt unknown /proc/65186/task/67292/exe (readlink: Permission denied) 2024-09-12T01:30:25.680 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67292 ms_dispat ceph NOFD /proc/65186/task/67292/fd (opendir: Permission denied) 2024-09-12T01:30:25.680 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67293 ms_local ceph cwd unknown /proc/65186/task/67293/cwd (readlink: Permission denied) 2024-09-12T01:30:25.680 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67293 ms_local ceph rtd unknown /proc/65186/task/67293/root (readlink: Permission denied) 2024-09-12T01:30:25.680 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67293 ms_local ceph txt unknown /proc/65186/task/67293/exe (readlink: Permission denied) 2024-09-12T01:30:25.680 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67293 ms_local ceph NOFD /proc/65186/task/67293/fd (opendir: Permission denied) 2024-09-12T01:30:25.680 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67295 ms_dispat ceph cwd unknown /proc/65186/task/67295/cwd (readlink: Permission denied) 2024-09-12T01:30:25.680 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67295 ms_dispat ceph rtd unknown /proc/65186/task/67295/root (readlink: Permission denied) 2024-09-12T01:30:25.680 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67295 ms_dispat ceph txt unknown /proc/65186/task/67295/exe (readlink: Permission denied) 2024-09-12T01:30:25.680 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67295 ms_dispat ceph NOFD /proc/65186/task/67295/fd (opendir: Permission denied) 2024-09-12T01:30:25.680 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67296 ms_local ceph cwd unknown /proc/65186/task/67296/cwd (readlink: Permission denied) 2024-09-12T01:30:25.680 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67296 ms_local ceph rtd unknown /proc/65186/task/67296/root (readlink: Permission denied) 2024-09-12T01:30:25.680 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67296 ms_local ceph txt unknown /proc/65186/task/67296/exe (readlink: Permission denied) 2024-09-12T01:30:25.680 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67296 ms_local ceph NOFD /proc/65186/task/67296/fd (opendir: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67297 fn_anonym ceph cwd unknown /proc/65186/task/67297/cwd (readlink: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67297 fn_anonym ceph rtd unknown /proc/65186/task/67297/root (readlink: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67297 fn_anonym ceph txt unknown /proc/65186/task/67297/exe (readlink: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67297 fn_anonym ceph NOFD /proc/65186/task/67297/fd (opendir: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67298 finisher ceph cwd unknown /proc/65186/task/67298/cwd (readlink: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67298 finisher ceph rtd unknown /proc/65186/task/67298/root (readlink: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67298 finisher ceph txt unknown /proc/65186/task/67298/exe (readlink: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67298 finisher ceph NOFD /proc/65186/task/67298/fd (opendir: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67300 safe_time ceph cwd unknown /proc/65186/task/67300/cwd (readlink: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67300 safe_time ceph rtd unknown /proc/65186/task/67300/root (readlink: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67300 safe_time ceph txt unknown /proc/65186/task/67300/exe (readlink: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67300 safe_time ceph NOFD /proc/65186/task/67300/fd (opendir: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67301 safe_time ceph cwd unknown /proc/65186/task/67301/cwd (readlink: Permission denied) 2024-09-12T01:30:25.681 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67301 safe_time ceph rtd unknown /proc/65186/task/67301/root (readlink: Permission denied) 2024-09-12T01:30:25.682 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67301 safe_time ceph txt unknown /proc/65186/task/67301/exe (readlink: Permission denied) 2024-09-12T01:30:25.682 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67301 safe_time ceph NOFD /proc/65186/task/67301/fd (opendir: Permission denied) 2024-09-12T01:30:25.682 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67302 ceph-osd ceph cwd unknown /proc/65186/task/67302/cwd (readlink: Permission denied) 2024-09-12T01:30:25.682 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67302 ceph-osd ceph rtd unknown /proc/65186/task/67302/root (readlink: Permission denied) 2024-09-12T01:30:25.682 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67302 ceph-osd ceph txt unknown /proc/65186/task/67302/exe (readlink: Permission denied) 2024-09-12T01:30:25.682 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67302 ceph-osd ceph NOFD /proc/65186/task/67302/fd (opendir: Permission denied) 2024-09-12T01:30:25.682 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67303 osd_srv_a ceph cwd unknown /proc/65186/task/67303/cwd (readlink: Permission denied) 2024-09-12T01:30:25.682 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67303 osd_srv_a ceph rtd unknown /proc/65186/task/67303/root (readlink: Permission denied) 2024-09-12T01:30:25.682 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67303 osd_srv_a ceph txt unknown /proc/65186/task/67303/exe (readlink: Permission denied) 2024-09-12T01:30:25.682 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67303 osd_srv_a ceph NOFD /proc/65186/task/67303/fd (opendir: Permission denied) 2024-09-12T01:30:25.682 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67305 tp_osd_tp ceph cwd unknown /proc/65186/task/67305/cwd (readlink: Permission denied) 2024-09-12T01:30:25.682 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67305 tp_osd_tp ceph rtd unknown /proc/65186/task/67305/root (readlink: Permission denied) 2024-09-12T01:30:25.682 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67305 tp_osd_tp ceph txt unknown /proc/65186/task/67305/exe (readlink: Permission denied) 2024-09-12T01:30:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67305 tp_osd_tp ceph NOFD /proc/65186/task/67305/fd (opendir: Permission denied) 2024-09-12T01:30:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67306 tp_osd_tp ceph cwd unknown /proc/65186/task/67306/cwd (readlink: Permission denied) 2024-09-12T01:30:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67306 tp_osd_tp ceph rtd unknown /proc/65186/task/67306/root (readlink: Permission denied) 2024-09-12T01:30:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67306 tp_osd_tp ceph txt unknown /proc/65186/task/67306/exe (readlink: Permission denied) 2024-09-12T01:30:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67306 tp_osd_tp ceph NOFD /proc/65186/task/67306/fd (opendir: Permission denied) 2024-09-12T01:30:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67307 tp_osd_tp ceph cwd unknown /proc/65186/task/67307/cwd (readlink: Permission denied) 2024-09-12T01:30:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67307 tp_osd_tp ceph rtd unknown /proc/65186/task/67307/root (readlink: Permission denied) 2024-09-12T01:30:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67307 tp_osd_tp ceph txt unknown /proc/65186/task/67307/exe (readlink: Permission denied) 2024-09-12T01:30:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67307 tp_osd_tp ceph NOFD /proc/65186/task/67307/fd (opendir: Permission denied) 2024-09-12T01:30:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67309 tp_osd_tp ceph cwd unknown /proc/65186/task/67309/cwd (readlink: Permission denied) 2024-09-12T01:30:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67309 tp_osd_tp ceph rtd unknown /proc/65186/task/67309/root (readlink: Permission denied) 2024-09-12T01:30:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67309 tp_osd_tp ceph txt unknown /proc/65186/task/67309/exe (readlink: Permission denied) 2024-09-12T01:30:25.683 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67309 tp_osd_tp ceph NOFD /proc/65186/task/67309/fd (opendir: Permission denied) 2024-09-12T01:30:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67310 tp_osd_tp ceph cwd unknown /proc/65186/task/67310/cwd (readlink: Permission denied) 2024-09-12T01:30:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67310 tp_osd_tp ceph rtd unknown /proc/65186/task/67310/root (readlink: Permission denied) 2024-09-12T01:30:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67310 tp_osd_tp ceph txt unknown /proc/65186/task/67310/exe (readlink: Permission denied) 2024-09-12T01:30:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67310 tp_osd_tp ceph NOFD /proc/65186/task/67310/fd (opendir: Permission denied) 2024-09-12T01:30:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67311 tp_osd_tp ceph cwd unknown /proc/65186/task/67311/cwd (readlink: Permission denied) 2024-09-12T01:30:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67311 tp_osd_tp ceph rtd unknown /proc/65186/task/67311/root (readlink: Permission denied) 2024-09-12T01:30:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67311 tp_osd_tp ceph txt unknown /proc/65186/task/67311/exe (readlink: Permission denied) 2024-09-12T01:30:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67311 tp_osd_tp ceph NOFD /proc/65186/task/67311/fd (opendir: Permission denied) 2024-09-12T01:30:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67312 tp_osd_tp ceph cwd unknown /proc/65186/task/67312/cwd (readlink: Permission denied) 2024-09-12T01:30:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67312 tp_osd_tp ceph rtd unknown /proc/65186/task/67312/root (readlink: Permission denied) 2024-09-12T01:30:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67312 tp_osd_tp ceph txt unknown /proc/65186/task/67312/exe (readlink: Permission denied) 2024-09-12T01:30:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67312 tp_osd_tp ceph NOFD /proc/65186/task/67312/fd (opendir: Permission denied) 2024-09-12T01:30:25.684 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67313 tp_osd_tp ceph cwd unknown /proc/65186/task/67313/cwd (readlink: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67313 tp_osd_tp ceph rtd unknown /proc/65186/task/67313/root (readlink: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67313 tp_osd_tp ceph txt unknown /proc/65186/task/67313/exe (readlink: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67313 tp_osd_tp ceph NOFD /proc/65186/task/67313/fd (opendir: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67315 tp_osd_tp ceph cwd unknown /proc/65186/task/67315/cwd (readlink: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67315 tp_osd_tp ceph rtd unknown /proc/65186/task/67315/root (readlink: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67315 tp_osd_tp ceph txt unknown /proc/65186/task/67315/exe (readlink: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67315 tp_osd_tp ceph NOFD /proc/65186/task/67315/fd (opendir: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67316 tp_osd_tp ceph cwd unknown /proc/65186/task/67316/cwd (readlink: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67316 tp_osd_tp ceph rtd unknown /proc/65186/task/67316/root (readlink: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67316 tp_osd_tp ceph txt unknown /proc/65186/task/67316/exe (readlink: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67316 tp_osd_tp ceph NOFD /proc/65186/task/67316/fd (opendir: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67317 tp_osd_tp ceph cwd unknown /proc/65186/task/67317/cwd (readlink: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67317 tp_osd_tp ceph rtd unknown /proc/65186/task/67317/root (readlink: Permission denied) 2024-09-12T01:30:25.685 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67317 tp_osd_tp ceph txt unknown /proc/65186/task/67317/exe (readlink: Permission denied) 2024-09-12T01:30:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67317 tp_osd_tp ceph NOFD /proc/65186/task/67317/fd (opendir: Permission denied) 2024-09-12T01:30:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67318 tp_osd_tp ceph cwd unknown /proc/65186/task/67318/cwd (readlink: Permission denied) 2024-09-12T01:30:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67318 tp_osd_tp ceph rtd unknown /proc/65186/task/67318/root (readlink: Permission denied) 2024-09-12T01:30:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67318 tp_osd_tp ceph txt unknown /proc/65186/task/67318/exe (readlink: Permission denied) 2024-09-12T01:30:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67318 tp_osd_tp ceph NOFD /proc/65186/task/67318/fd (opendir: Permission denied) 2024-09-12T01:30:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67320 tp_osd_tp ceph cwd unknown /proc/65186/task/67320/cwd (readlink: Permission denied) 2024-09-12T01:30:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67320 tp_osd_tp ceph rtd unknown /proc/65186/task/67320/root (readlink: Permission denied) 2024-09-12T01:30:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67320 tp_osd_tp ceph txt unknown /proc/65186/task/67320/exe (readlink: Permission denied) 2024-09-12T01:30:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67320 tp_osd_tp ceph NOFD /proc/65186/task/67320/fd (opendir: Permission denied) 2024-09-12T01:30:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67321 tp_osd_tp ceph cwd unknown /proc/65186/task/67321/cwd (readlink: Permission denied) 2024-09-12T01:30:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67321 tp_osd_tp ceph rtd unknown /proc/65186/task/67321/root (readlink: Permission denied) 2024-09-12T01:30:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67321 tp_osd_tp ceph txt unknown /proc/65186/task/67321/exe (readlink: Permission denied) 2024-09-12T01:30:25.686 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67321 tp_osd_tp ceph NOFD /proc/65186/task/67321/fd (opendir: Permission denied) 2024-09-12T01:30:25.687 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67322 tp_osd_tp ceph cwd unknown /proc/65186/task/67322/cwd (readlink: Permission denied) 2024-09-12T01:30:25.687 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67322 tp_osd_tp ceph rtd unknown /proc/65186/task/67322/root (readlink: Permission denied) 2024-09-12T01:30:25.687 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67322 tp_osd_tp ceph txt unknown /proc/65186/task/67322/exe (readlink: Permission denied) 2024-09-12T01:30:25.687 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67322 tp_osd_tp ceph NOFD /proc/65186/task/67322/fd (opendir: Permission denied) 2024-09-12T01:30:25.687 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67323 tp_osd_tp ceph cwd unknown /proc/65186/task/67323/cwd (readlink: Permission denied) 2024-09-12T01:30:25.687 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67323 tp_osd_tp ceph rtd unknown /proc/65186/task/67323/root (readlink: Permission denied) 2024-09-12T01:30:25.687 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67323 tp_osd_tp ceph txt unknown /proc/65186/task/67323/exe (readlink: Permission denied) 2024-09-12T01:30:25.687 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67323 tp_osd_tp ceph NOFD /proc/65186/task/67323/fd (opendir: Permission denied) 2024-09-12T01:30:25.687 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67324 osd_srv_h ceph cwd unknown /proc/65186/task/67324/cwd (readlink: Permission denied) 2024-09-12T01:30:25.687 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67324 osd_srv_h ceph rtd unknown /proc/65186/task/67324/root (readlink: Permission denied) 2024-09-12T01:30:25.687 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67324 osd_srv_h ceph txt unknown /proc/65186/task/67324/exe (readlink: Permission denied) 2024-09-12T01:30:25.687 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-osd 65186 67324 osd_srv_h ceph NOFD /proc/65186/task/67324/fd (opendir: Permission denied) 2024-09-12T01:30:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 65872 root cwd unknown /proc/65872/cwd (readlink: Permission denied) 2024-09-12T01:30:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 65872 root rtd unknown /proc/65872/root (readlink: Permission denied) 2024-09-12T01:30:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 65872 root txt unknown /proc/65872/exe (readlink: Permission denied) 2024-09-12T01:30:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 65872 root NOFD /proc/65872/fd (opendir: Permission denied) 2024-09-12T01:30:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 65889 root cwd unknown /proc/65889/cwd (readlink: Permission denied) 2024-09-12T01:30:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 65889 root rtd unknown /proc/65889/root (readlink: Permission denied) 2024-09-12T01:30:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 65889 root txt unknown /proc/65889/exe (readlink: Permission denied) 2024-09-12T01:30:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 65889 root NOFD /proc/65889/fd (opendir: Permission denied) 2024-09-12T01:30:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 69753 root cwd unknown /proc/69753/cwd (readlink: Permission denied) 2024-09-12T01:30:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 69753 root rtd unknown /proc/69753/root (readlink: Permission denied) 2024-09-12T01:30:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 69753 root txt unknown /proc/69753/exe (readlink: Permission denied) 2024-09-12T01:30:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/2 69753 root NOFD /proc/69753/fd (opendir: Permission denied) 2024-09-12T01:30:25.688 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69754 root cwd unknown /proc/69754/cwd (readlink: Permission denied) 2024-09-12T01:30:25.689 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69754 root rtd unknown /proc/69754/root (readlink: Permission denied) 2024-09-12T01:30:25.689 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69754 root txt unknown /proc/69754/exe (readlink: Permission denied) 2024-09-12T01:30:25.689 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69754 root NOFD /proc/69754/fd (opendir: Permission denied) 2024-09-12T01:30:25.689 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69771 root cwd unknown /proc/69771/cwd (readlink: Permission denied) 2024-09-12T01:30:25.689 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69771 root rtd unknown /proc/69771/root (readlink: Permission denied) 2024-09-12T01:30:25.689 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69771 root txt unknown /proc/69771/exe (readlink: Permission denied) 2024-09-12T01:30:25.689 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69771 root NOFD /proc/69771/fd (opendir: Permission denied) 2024-09-12T01:30:25.689 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69772 root cwd unknown /proc/69772/cwd (readlink: Permission denied) 2024-09-12T01:30:25.689 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69772 root rtd unknown /proc/69772/root (readlink: Permission denied) 2024-09-12T01:30:25.689 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69772 root txt unknown /proc/69772/exe (readlink: Permission denied) 2024-09-12T01:30:25.689 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69772 root NOFD /proc/69772/fd (opendir: Permission denied) 2024-09-12T01:30:25.689 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69789 root cwd unknown /proc/69789/cwd (readlink: Permission denied) 2024-09-12T01:30:25.689 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69789 root rtd unknown /proc/69789/root (readlink: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69789 root txt unknown /proc/69789/exe (readlink: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69789 root NOFD /proc/69789/fd (opendir: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69790 root cwd unknown /proc/69790/cwd (readlink: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69790 root rtd unknown /proc/69790/root (readlink: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69790 root txt unknown /proc/69790/exe (readlink: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69790 root NOFD /proc/69790/fd (opendir: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69807 root cwd unknown /proc/69807/cwd (readlink: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69807 root rtd unknown /proc/69807/root (readlink: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69807 root txt unknown /proc/69807/exe (readlink: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69807 root NOFD /proc/69807/fd (opendir: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69808 root cwd unknown /proc/69808/cwd (readlink: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69808 root rtd unknown /proc/69808/root (readlink: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69808 root txt unknown /proc/69808/exe (readlink: Permission denied) 2024-09-12T01:30:25.690 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 69808 root NOFD /proc/69808/fd (opendir: Permission denied) 2024-09-12T01:30:25.691 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69825 root cwd unknown /proc/69825/cwd (readlink: Permission denied) 2024-09-12T01:30:25.691 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69825 root rtd unknown /proc/69825/root (readlink: Permission denied) 2024-09-12T01:30:25.691 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69825 root txt unknown /proc/69825/exe (readlink: Permission denied) 2024-09-12T01:30:25.691 INFO:tasks.workunit.client.0.smithi081.stdout:journalct 69825 root NOFD /proc/69825/fd (opendir: Permission denied) 2024-09-12T01:30:25.691 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 70330 root cwd unknown /proc/70330/cwd (readlink: Permission denied) 2024-09-12T01:30:25.691 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 70330 root rtd unknown /proc/70330/root (readlink: Permission denied) 2024-09-12T01:30:25.691 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 70330 root txt unknown /proc/70330/exe (readlink: Permission denied) 2024-09-12T01:30:25.691 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 70330 root NOFD /proc/70330/fd (opendir: Permission denied) 2024-09-12T01:30:25.691 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 70332 root cwd unknown /proc/70332/cwd (readlink: Permission denied) 2024-09-12T01:30:25.691 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 70332 root rtd unknown /proc/70332/root (readlink: Permission denied) 2024-09-12T01:30:25.691 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 70332 root txt unknown /proc/70332/exe (readlink: Permission denied) 2024-09-12T01:30:25.691 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 70332 root NOFD /proc/70332/fd (opendir: Permission denied) 2024-09-12T01:30:25.692 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 ceph cwd unknown /proc/70352/cwd (readlink: Permission denied) 2024-09-12T01:30:25.692 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 ceph rtd unknown /proc/70352/root (readlink: Permission denied) 2024-09-12T01:30:25.692 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 ceph txt unknown /proc/70352/exe (readlink: Permission denied) 2024-09-12T01:30:25.692 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 ceph NOFD /proc/70352/fd (opendir: Permission denied) 2024-09-12T01:30:25.692 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70353 log ceph cwd unknown /proc/70352/task/70353/cwd (readlink: Permission denied) 2024-09-12T01:30:25.692 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70353 log ceph rtd unknown /proc/70352/task/70353/root (readlink: Permission denied) 2024-09-12T01:30:25.692 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70353 log ceph txt unknown /proc/70352/task/70353/exe (readlink: Permission denied) 2024-09-12T01:30:25.692 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70353 log ceph NOFD /proc/70352/task/70353/fd (opendir: Permission denied) 2024-09-12T01:30:25.692 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70355 msgr-work ceph cwd unknown /proc/70352/task/70355/cwd (readlink: Permission denied) 2024-09-12T01:30:25.692 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70355 msgr-work ceph rtd unknown /proc/70352/task/70355/root (readlink: Permission denied) 2024-09-12T01:30:25.692 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70355 msgr-work ceph txt unknown /proc/70352/task/70355/exe (readlink: Permission denied) 2024-09-12T01:30:25.692 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70355 msgr-work ceph NOFD /proc/70352/task/70355/fd (opendir: Permission denied) 2024-09-12T01:30:25.692 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70356 msgr-work ceph cwd unknown /proc/70352/task/70356/cwd (readlink: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70356 msgr-work ceph rtd unknown /proc/70352/task/70356/root (readlink: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70356 msgr-work ceph txt unknown /proc/70352/task/70356/exe (readlink: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70356 msgr-work ceph NOFD /proc/70352/task/70356/fd (opendir: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70357 msgr-work ceph cwd unknown /proc/70352/task/70357/cwd (readlink: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70357 msgr-work ceph rtd unknown /proc/70352/task/70357/root (readlink: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70357 msgr-work ceph txt unknown /proc/70352/task/70357/exe (readlink: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70357 msgr-work ceph NOFD /proc/70352/task/70357/fd (opendir: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70361 service ceph cwd unknown /proc/70352/task/70361/cwd (readlink: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70361 service ceph rtd unknown /proc/70352/task/70361/root (readlink: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70361 service ceph txt unknown /proc/70352/task/70361/exe (readlink: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70361 service ceph NOFD /proc/70352/task/70361/fd (opendir: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70362 admin_soc ceph cwd unknown /proc/70352/task/70362/cwd (readlink: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70362 admin_soc ceph rtd unknown /proc/70352/task/70362/root (readlink: Permission denied) 2024-09-12T01:30:25.693 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70362 admin_soc ceph txt unknown /proc/70352/task/70362/exe (readlink: Permission denied) 2024-09-12T01:30:25.694 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70362 admin_soc ceph NOFD /proc/70352/task/70362/fd (opendir: Permission denied) 2024-09-12T01:30:25.694 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70363 signal_ha ceph cwd unknown /proc/70352/task/70363/cwd (readlink: Permission denied) 2024-09-12T01:30:25.694 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70363 signal_ha ceph rtd unknown /proc/70352/task/70363/root (readlink: Permission denied) 2024-09-12T01:30:25.694 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70363 signal_ha ceph txt unknown /proc/70352/task/70363/exe (readlink: Permission denied) 2024-09-12T01:30:25.694 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70363 signal_ha ceph NOFD /proc/70352/task/70363/fd (opendir: Permission denied) 2024-09-12T01:30:25.694 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70364 io_contex ceph cwd unknown /proc/70352/task/70364/cwd (readlink: Permission denied) 2024-09-12T01:30:25.694 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70364 io_contex ceph rtd unknown /proc/70352/task/70364/root (readlink: Permission denied) 2024-09-12T01:30:25.694 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70364 io_contex ceph txt unknown /proc/70352/task/70364/exe (readlink: Permission denied) 2024-09-12T01:30:25.694 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70364 io_contex ceph NOFD /proc/70352/task/70364/fd (opendir: Permission denied) 2024-09-12T01:30:25.694 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70365 io_contex ceph cwd unknown /proc/70352/task/70365/cwd (readlink: Permission denied) 2024-09-12T01:30:25.694 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70365 io_contex ceph rtd unknown /proc/70352/task/70365/root (readlink: Permission denied) 2024-09-12T01:30:25.694 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70365 io_contex ceph txt unknown /proc/70352/task/70365/exe (readlink: Permission denied) 2024-09-12T01:30:25.694 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70365 io_contex ceph NOFD /proc/70352/task/70365/fd (opendir: Permission denied) 2024-09-12T01:30:25.695 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70366 ms_dispat ceph cwd unknown /proc/70352/task/70366/cwd (readlink: Permission denied) 2024-09-12T01:30:25.695 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70366 ms_dispat ceph rtd unknown /proc/70352/task/70366/root (readlink: Permission denied) 2024-09-12T01:30:25.695 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70366 ms_dispat ceph txt unknown /proc/70352/task/70366/exe (readlink: Permission denied) 2024-09-12T01:30:25.695 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70366 ms_dispat ceph NOFD /proc/70352/task/70366/fd (opendir: Permission denied) 2024-09-12T01:30:25.695 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70367 ms_local ceph cwd unknown /proc/70352/task/70367/cwd (readlink: Permission denied) 2024-09-12T01:30:25.695 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70367 ms_local ceph rtd unknown /proc/70352/task/70367/root (readlink: Permission denied) 2024-09-12T01:30:25.695 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70367 ms_local ceph txt unknown /proc/70352/task/70367/exe (readlink: Permission denied) 2024-09-12T01:30:25.695 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70367 ms_local ceph NOFD /proc/70352/task/70367/fd (opendir: Permission denied) 2024-09-12T01:30:25.695 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70368 safe_time ceph cwd unknown /proc/70352/task/70368/cwd (readlink: Permission denied) 2024-09-12T01:30:25.695 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70368 safe_time ceph rtd unknown /proc/70352/task/70368/root (readlink: Permission denied) 2024-09-12T01:30:25.695 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70368 safe_time ceph txt unknown /proc/70352/task/70368/exe (readlink: Permission denied) 2024-09-12T01:30:25.695 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70368 safe_time ceph NOFD /proc/70352/task/70368/fd (opendir: Permission denied) 2024-09-12T01:30:25.695 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70369 safe_time ceph cwd unknown /proc/70352/task/70369/cwd (readlink: Permission denied) 2024-09-12T01:30:25.696 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70369 safe_time ceph rtd unknown /proc/70352/task/70369/root (readlink: Permission denied) 2024-09-12T01:30:25.696 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70369 safe_time ceph txt unknown /proc/70352/task/70369/exe (readlink: Permission denied) 2024-09-12T01:30:25.696 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70369 safe_time ceph NOFD /proc/70352/task/70369/fd (opendir: Permission denied) 2024-09-12T01:30:25.696 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70370 ceph-mds ceph cwd unknown /proc/70352/task/70370/cwd (readlink: Permission denied) 2024-09-12T01:30:25.696 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70370 ceph-mds ceph rtd unknown /proc/70352/task/70370/root (readlink: Permission denied) 2024-09-12T01:30:25.696 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70370 ceph-mds ceph txt unknown /proc/70352/task/70370/exe (readlink: Permission denied) 2024-09-12T01:30:25.696 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70370 ceph-mds ceph NOFD /proc/70352/task/70370/fd (opendir: Permission denied) 2024-09-12T01:30:25.696 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70525 safe_time ceph cwd unknown /proc/70352/task/70525/cwd (readlink: Permission denied) 2024-09-12T01:30:25.696 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70525 safe_time ceph rtd unknown /proc/70352/task/70525/root (readlink: Permission denied) 2024-09-12T01:30:25.696 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70525 safe_time ceph txt unknown /proc/70352/task/70525/exe (readlink: Permission denied) 2024-09-12T01:30:25.696 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70352 70525 safe_time ceph NOFD /proc/70352/task/70525/fd (opendir: Permission denied) 2024-09-12T01:30:25.696 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 70740 root cwd unknown /proc/70740/cwd (readlink: Permission denied) 2024-09-12T01:30:25.696 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 70740 root rtd unknown /proc/70740/root (readlink: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 70740 root txt unknown /proc/70740/exe (readlink: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 70740 root NOFD /proc/70740/fd (opendir: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 70742 root cwd unknown /proc/70742/cwd (readlink: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 70742 root rtd unknown /proc/70742/root (readlink: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 70742 root txt unknown /proc/70742/exe (readlink: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 70742 root NOFD /proc/70742/fd (opendir: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 ceph cwd unknown /proc/70744/cwd (readlink: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 ceph rtd unknown /proc/70744/root (readlink: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 ceph txt unknown /proc/70744/exe (readlink: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 ceph NOFD /proc/70744/fd (opendir: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70745 log ceph cwd unknown /proc/70744/task/70745/cwd (readlink: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70745 log ceph rtd unknown /proc/70744/task/70745/root (readlink: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70745 log ceph txt unknown /proc/70744/task/70745/exe (readlink: Permission denied) 2024-09-12T01:30:25.697 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70745 log ceph NOFD /proc/70744/task/70745/fd (opendir: Permission denied) 2024-09-12T01:30:25.698 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70747 msgr-work ceph cwd unknown /proc/70744/task/70747/cwd (readlink: Permission denied) 2024-09-12T01:30:25.698 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70747 msgr-work ceph rtd unknown /proc/70744/task/70747/root (readlink: Permission denied) 2024-09-12T01:30:25.698 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70747 msgr-work ceph txt unknown /proc/70744/task/70747/exe (readlink: Permission denied) 2024-09-12T01:30:25.698 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70747 msgr-work ceph NOFD /proc/70744/task/70747/fd (opendir: Permission denied) 2024-09-12T01:30:25.698 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70748 msgr-work ceph cwd unknown /proc/70744/task/70748/cwd (readlink: Permission denied) 2024-09-12T01:30:25.698 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70748 msgr-work ceph rtd unknown /proc/70744/task/70748/root (readlink: Permission denied) 2024-09-12T01:30:25.698 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70748 msgr-work ceph txt unknown /proc/70744/task/70748/exe (readlink: Permission denied) 2024-09-12T01:30:25.698 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70748 msgr-work ceph NOFD /proc/70744/task/70748/fd (opendir: Permission denied) 2024-09-12T01:30:25.698 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70749 msgr-work ceph cwd unknown /proc/70744/task/70749/cwd (readlink: Permission denied) 2024-09-12T01:30:25.698 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70749 msgr-work ceph rtd unknown /proc/70744/task/70749/root (readlink: Permission denied) 2024-09-12T01:30:25.698 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70749 msgr-work ceph txt unknown /proc/70744/task/70749/exe (readlink: Permission denied) 2024-09-12T01:30:25.698 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70749 msgr-work ceph NOFD /proc/70744/task/70749/fd (opendir: Permission denied) 2024-09-12T01:30:25.698 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70753 service ceph cwd unknown /proc/70744/task/70753/cwd (readlink: Permission denied) 2024-09-12T01:30:25.699 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70753 service ceph rtd unknown /proc/70744/task/70753/root (readlink: Permission denied) 2024-09-12T01:30:25.699 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70753 service ceph txt unknown /proc/70744/task/70753/exe (readlink: Permission denied) 2024-09-12T01:30:25.699 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70753 service ceph NOFD /proc/70744/task/70753/fd (opendir: Permission denied) 2024-09-12T01:30:25.699 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70754 admin_soc ceph cwd unknown /proc/70744/task/70754/cwd (readlink: Permission denied) 2024-09-12T01:30:25.699 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70754 admin_soc ceph rtd unknown /proc/70744/task/70754/root (readlink: Permission denied) 2024-09-12T01:30:25.699 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70754 admin_soc ceph txt unknown /proc/70744/task/70754/exe (readlink: Permission denied) 2024-09-12T01:30:25.699 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70754 admin_soc ceph NOFD /proc/70744/task/70754/fd (opendir: Permission denied) 2024-09-12T01:30:25.699 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70755 signal_ha ceph cwd unknown /proc/70744/task/70755/cwd (readlink: Permission denied) 2024-09-12T01:30:25.699 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70755 signal_ha ceph rtd unknown /proc/70744/task/70755/root (readlink: Permission denied) 2024-09-12T01:30:25.699 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70755 signal_ha ceph txt unknown /proc/70744/task/70755/exe (readlink: Permission denied) 2024-09-12T01:30:25.699 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70755 signal_ha ceph NOFD /proc/70744/task/70755/fd (opendir: Permission denied) 2024-09-12T01:30:25.699 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70756 io_contex ceph cwd unknown /proc/70744/task/70756/cwd (readlink: Permission denied) 2024-09-12T01:30:25.699 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70756 io_contex ceph rtd unknown /proc/70744/task/70756/root (readlink: Permission denied) 2024-09-12T01:30:25.700 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70756 io_contex ceph txt unknown /proc/70744/task/70756/exe (readlink: Permission denied) 2024-09-12T01:30:25.700 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70756 io_contex ceph NOFD /proc/70744/task/70756/fd (opendir: Permission denied) 2024-09-12T01:30:25.700 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70757 io_contex ceph cwd unknown /proc/70744/task/70757/cwd (readlink: Permission denied) 2024-09-12T01:30:25.700 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70757 io_contex ceph rtd unknown /proc/70744/task/70757/root (readlink: Permission denied) 2024-09-12T01:30:25.700 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70757 io_contex ceph txt unknown /proc/70744/task/70757/exe (readlink: Permission denied) 2024-09-12T01:30:25.700 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70757 io_contex ceph NOFD /proc/70744/task/70757/fd (opendir: Permission denied) 2024-09-12T01:30:25.700 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70758 ms_dispat ceph cwd unknown /proc/70744/task/70758/cwd (readlink: Permission denied) 2024-09-12T01:30:25.700 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70758 ms_dispat ceph rtd unknown /proc/70744/task/70758/root (readlink: Permission denied) 2024-09-12T01:30:25.700 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70758 ms_dispat ceph txt unknown /proc/70744/task/70758/exe (readlink: Permission denied) 2024-09-12T01:30:25.700 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70758 ms_dispat ceph NOFD /proc/70744/task/70758/fd (opendir: Permission denied) 2024-09-12T01:30:25.700 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70759 ms_local ceph cwd unknown /proc/70744/task/70759/cwd (readlink: Permission denied) 2024-09-12T01:30:25.700 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70759 ms_local ceph rtd unknown /proc/70744/task/70759/root (readlink: Permission denied) 2024-09-12T01:30:25.701 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70759 ms_local ceph txt unknown /proc/70744/task/70759/exe (readlink: Permission denied) 2024-09-12T01:30:25.701 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70759 ms_local ceph NOFD /proc/70744/task/70759/fd (opendir: Permission denied) 2024-09-12T01:30:25.701 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70760 safe_time ceph cwd unknown /proc/70744/task/70760/cwd (readlink: Permission denied) 2024-09-12T01:30:25.701 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70760 safe_time ceph rtd unknown /proc/70744/task/70760/root (readlink: Permission denied) 2024-09-12T01:30:25.701 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70760 safe_time ceph txt unknown /proc/70744/task/70760/exe (readlink: Permission denied) 2024-09-12T01:30:25.701 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70760 safe_time ceph NOFD /proc/70744/task/70760/fd (opendir: Permission denied) 2024-09-12T01:30:25.701 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70761 safe_time ceph cwd unknown /proc/70744/task/70761/cwd (readlink: Permission denied) 2024-09-12T01:30:25.701 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70761 safe_time ceph rtd unknown /proc/70744/task/70761/root (readlink: Permission denied) 2024-09-12T01:30:25.701 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70761 safe_time ceph txt unknown /proc/70744/task/70761/exe (readlink: Permission denied) 2024-09-12T01:30:25.701 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70761 safe_time ceph NOFD /proc/70744/task/70761/fd (opendir: Permission denied) 2024-09-12T01:30:25.701 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70762 ceph-mds ceph cwd unknown /proc/70744/task/70762/cwd (readlink: Permission denied) 2024-09-12T01:30:25.701 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70762 ceph-mds ceph rtd unknown /proc/70744/task/70762/root (readlink: Permission denied) 2024-09-12T01:30:25.701 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70762 ceph-mds ceph txt unknown /proc/70744/task/70762/exe (readlink: Permission denied) 2024-09-12T01:30:25.702 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70762 ceph-mds ceph NOFD /proc/70744/task/70762/fd (opendir: Permission denied) 2024-09-12T01:30:25.702 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70763 safe_time ceph cwd unknown /proc/70744/task/70763/cwd (readlink: Permission denied) 2024-09-12T01:30:25.702 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70763 safe_time ceph rtd unknown /proc/70744/task/70763/root (readlink: Permission denied) 2024-09-12T01:30:25.702 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70763 safe_time ceph txt unknown /proc/70744/task/70763/exe (readlink: Permission denied) 2024-09-12T01:30:25.702 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 70744 70763 safe_time ceph NOFD /proc/70744/task/70763/fd (opendir: Permission denied) 2024-09-12T01:30:25.702 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 71507 root cwd unknown /proc/71507/cwd (readlink: Permission denied) 2024-09-12T01:30:25.702 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 71507 root rtd unknown /proc/71507/root (readlink: Permission denied) 2024-09-12T01:30:25.702 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 71507 root txt unknown /proc/71507/exe (readlink: Permission denied) 2024-09-12T01:30:25.702 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 71507 root NOFD /proc/71507/fd (opendir: Permission denied) 2024-09-12T01:30:25.702 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 71509 root cwd unknown /proc/71509/cwd (readlink: Permission denied) 2024-09-12T01:30:25.702 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 71509 root rtd unknown /proc/71509/root (readlink: Permission denied) 2024-09-12T01:30:25.702 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 71509 root txt unknown /proc/71509/exe (readlink: Permission denied) 2024-09-12T01:30:25.702 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 71509 root NOFD /proc/71509/fd (opendir: Permission denied) 2024-09-12T01:30:25.703 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 ceph cwd unknown /proc/71529/cwd (readlink: Permission denied) 2024-09-12T01:30:25.703 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 ceph rtd unknown /proc/71529/root (readlink: Permission denied) 2024-09-12T01:30:25.703 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 ceph txt unknown /proc/71529/exe (readlink: Permission denied) 2024-09-12T01:30:25.703 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 ceph NOFD /proc/71529/fd (opendir: Permission denied) 2024-09-12T01:30:25.703 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71530 log ceph cwd unknown /proc/71529/task/71530/cwd (readlink: Permission denied) 2024-09-12T01:30:25.703 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71530 log ceph rtd unknown /proc/71529/task/71530/root (readlink: Permission denied) 2024-09-12T01:30:25.703 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71530 log ceph txt unknown /proc/71529/task/71530/exe (readlink: Permission denied) 2024-09-12T01:30:25.703 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71530 log ceph NOFD /proc/71529/task/71530/fd (opendir: Permission denied) 2024-09-12T01:30:25.703 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71532 msgr-work ceph cwd unknown /proc/71529/task/71532/cwd (readlink: Permission denied) 2024-09-12T01:30:25.703 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71532 msgr-work ceph rtd unknown /proc/71529/task/71532/root (readlink: Permission denied) 2024-09-12T01:30:25.703 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71532 msgr-work ceph txt unknown /proc/71529/task/71532/exe (readlink: Permission denied) 2024-09-12T01:30:25.703 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71532 msgr-work ceph NOFD /proc/71529/task/71532/fd (opendir: Permission denied) 2024-09-12T01:30:25.703 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71533 msgr-work ceph cwd unknown /proc/71529/task/71533/cwd (readlink: Permission denied) 2024-09-12T01:30:25.704 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71533 msgr-work ceph rtd unknown /proc/71529/task/71533/root (readlink: Permission denied) 2024-09-12T01:30:25.704 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71533 msgr-work ceph txt unknown /proc/71529/task/71533/exe (readlink: Permission denied) 2024-09-12T01:30:25.704 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71533 msgr-work ceph NOFD /proc/71529/task/71533/fd (opendir: Permission denied) 2024-09-12T01:30:25.704 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71534 msgr-work ceph cwd unknown /proc/71529/task/71534/cwd (readlink: Permission denied) 2024-09-12T01:30:25.704 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71534 msgr-work ceph rtd unknown /proc/71529/task/71534/root (readlink: Permission denied) 2024-09-12T01:30:25.704 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71534 msgr-work ceph txt unknown /proc/71529/task/71534/exe (readlink: Permission denied) 2024-09-12T01:30:25.704 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71534 msgr-work ceph NOFD /proc/71529/task/71534/fd (opendir: Permission denied) 2024-09-12T01:30:25.704 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71538 service ceph cwd unknown /proc/71529/task/71538/cwd (readlink: Permission denied) 2024-09-12T01:30:25.704 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71538 service ceph rtd unknown /proc/71529/task/71538/root (readlink: Permission denied) 2024-09-12T01:30:25.704 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71538 service ceph txt unknown /proc/71529/task/71538/exe (readlink: Permission denied) 2024-09-12T01:30:25.704 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71538 service ceph NOFD /proc/71529/task/71538/fd (opendir: Permission denied) 2024-09-12T01:30:25.704 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71539 admin_soc ceph cwd unknown /proc/71529/task/71539/cwd (readlink: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71539 admin_soc ceph rtd unknown /proc/71529/task/71539/root (readlink: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71539 admin_soc ceph txt unknown /proc/71529/task/71539/exe (readlink: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71539 admin_soc ceph NOFD /proc/71529/task/71539/fd (opendir: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71540 signal_ha ceph cwd unknown /proc/71529/task/71540/cwd (readlink: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71540 signal_ha ceph rtd unknown /proc/71529/task/71540/root (readlink: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71540 signal_ha ceph txt unknown /proc/71529/task/71540/exe (readlink: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71540 signal_ha ceph NOFD /proc/71529/task/71540/fd (opendir: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71541 io_contex ceph cwd unknown /proc/71529/task/71541/cwd (readlink: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71541 io_contex ceph rtd unknown /proc/71529/task/71541/root (readlink: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71541 io_contex ceph txt unknown /proc/71529/task/71541/exe (readlink: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71541 io_contex ceph NOFD /proc/71529/task/71541/fd (opendir: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71542 io_contex ceph cwd unknown /proc/71529/task/71542/cwd (readlink: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71542 io_contex ceph rtd unknown /proc/71529/task/71542/root (readlink: Permission denied) 2024-09-12T01:30:25.705 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71542 io_contex ceph txt unknown /proc/71529/task/71542/exe (readlink: Permission denied) 2024-09-12T01:30:25.706 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71542 io_contex ceph NOFD /proc/71529/task/71542/fd (opendir: Permission denied) 2024-09-12T01:30:25.706 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71543 ms_dispat ceph cwd unknown /proc/71529/task/71543/cwd (readlink: Permission denied) 2024-09-12T01:30:25.706 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71543 ms_dispat ceph rtd unknown /proc/71529/task/71543/root (readlink: Permission denied) 2024-09-12T01:30:25.706 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71543 ms_dispat ceph txt unknown /proc/71529/task/71543/exe (readlink: Permission denied) 2024-09-12T01:30:25.706 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71543 ms_dispat ceph NOFD /proc/71529/task/71543/fd (opendir: Permission denied) 2024-09-12T01:30:25.706 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71544 ms_local ceph cwd unknown /proc/71529/task/71544/cwd (readlink: Permission denied) 2024-09-12T01:30:25.706 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71544 ms_local ceph rtd unknown /proc/71529/task/71544/root (readlink: Permission denied) 2024-09-12T01:30:25.706 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71544 ms_local ceph txt unknown /proc/71529/task/71544/exe (readlink: Permission denied) 2024-09-12T01:30:25.706 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71544 ms_local ceph NOFD /proc/71529/task/71544/fd (opendir: Permission denied) 2024-09-12T01:30:25.706 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71545 safe_time ceph cwd unknown /proc/71529/task/71545/cwd (readlink: Permission denied) 2024-09-12T01:30:25.706 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71545 safe_time ceph rtd unknown /proc/71529/task/71545/root (readlink: Permission denied) 2024-09-12T01:30:25.706 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71545 safe_time ceph txt unknown /proc/71529/task/71545/exe (readlink: Permission denied) 2024-09-12T01:30:25.707 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71545 safe_time ceph NOFD /proc/71529/task/71545/fd (opendir: Permission denied) 2024-09-12T01:30:25.707 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71546 safe_time ceph cwd unknown /proc/71529/task/71546/cwd (readlink: Permission denied) 2024-09-12T01:30:25.707 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71546 safe_time ceph rtd unknown /proc/71529/task/71546/root (readlink: Permission denied) 2024-09-12T01:30:25.707 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71546 safe_time ceph txt unknown /proc/71529/task/71546/exe (readlink: Permission denied) 2024-09-12T01:30:25.707 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71546 safe_time ceph NOFD /proc/71529/task/71546/fd (opendir: Permission denied) 2024-09-12T01:30:25.707 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71547 ceph-mds ceph cwd unknown /proc/71529/task/71547/cwd (readlink: Permission denied) 2024-09-12T01:30:25.707 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71547 ceph-mds ceph rtd unknown /proc/71529/task/71547/root (readlink: Permission denied) 2024-09-12T01:30:25.707 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71547 ceph-mds ceph txt unknown /proc/71529/task/71547/exe (readlink: Permission denied) 2024-09-12T01:30:25.707 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71547 ceph-mds ceph NOFD /proc/71529/task/71547/fd (opendir: Permission denied) 2024-09-12T01:30:25.707 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71561 safe_time ceph cwd unknown /proc/71529/task/71561/cwd (readlink: Permission denied) 2024-09-12T01:30:25.707 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71561 safe_time ceph rtd unknown /proc/71529/task/71561/root (readlink: Permission denied) 2024-09-12T01:30:25.707 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71561 safe_time ceph txt unknown /proc/71529/task/71561/exe (readlink: Permission denied) 2024-09-12T01:30:25.708 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 71561 safe_time ceph NOFD /proc/71529/task/71561/fd (opendir: Permission denied) 2024-09-12T01:30:25.708 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74085 ceph_time ceph cwd unknown /proc/71529/task/74085/cwd (readlink: Permission denied) 2024-09-12T01:30:25.708 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74085 ceph_time ceph rtd unknown /proc/71529/task/74085/root (readlink: Permission denied) 2024-09-12T01:30:25.708 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74085 ceph_time ceph txt unknown /proc/71529/task/74085/exe (readlink: Permission denied) 2024-09-12T01:30:25.708 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74085 ceph_time ceph NOFD /proc/71529/task/74085/fd (opendir: Permission denied) 2024-09-12T01:30:25.708 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74087 OpHistory ceph cwd unknown /proc/71529/task/74087/cwd (readlink: Permission denied) 2024-09-12T01:30:25.708 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74087 OpHistory ceph rtd unknown /proc/71529/task/74087/root (readlink: Permission denied) 2024-09-12T01:30:25.708 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74087 OpHistory ceph txt unknown /proc/71529/task/74087/exe (readlink: Permission denied) 2024-09-12T01:30:25.708 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74087 OpHistory ceph NOFD /proc/71529/task/74087/fd (opendir: Permission denied) 2024-09-12T01:30:25.708 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74089 ms_dispat ceph cwd unknown /proc/71529/task/74089/cwd (readlink: Permission denied) 2024-09-12T01:30:25.708 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74089 ms_dispat ceph rtd unknown /proc/71529/task/74089/root (readlink: Permission denied) 2024-09-12T01:30:25.708 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74089 ms_dispat ceph txt unknown /proc/71529/task/74089/exe (readlink: Permission denied) 2024-09-12T01:30:25.709 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74089 ms_dispat ceph NOFD /proc/71529/task/74089/fd (opendir: Permission denied) 2024-09-12T01:30:25.709 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74092 ms_dispat ceph cwd unknown /proc/71529/task/74092/cwd (readlink: Permission denied) 2024-09-12T01:30:25.709 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74092 ms_dispat ceph rtd unknown /proc/71529/task/74092/root (readlink: Permission denied) 2024-09-12T01:30:25.709 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74092 ms_dispat ceph txt unknown /proc/71529/task/74092/exe (readlink: Permission denied) 2024-09-12T01:30:25.709 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74092 ms_dispat ceph NOFD /proc/71529/task/74092/fd (opendir: Permission denied) 2024-09-12T01:30:25.709 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74094 mds_rank_ ceph cwd unknown /proc/71529/task/74094/cwd (readlink: Permission denied) 2024-09-12T01:30:25.709 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74094 mds_rank_ ceph rtd unknown /proc/71529/task/74094/root (readlink: Permission denied) 2024-09-12T01:30:25.709 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74094 mds_rank_ ceph txt unknown /proc/71529/task/74094/exe (readlink: Permission denied) 2024-09-12T01:30:25.709 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74094 mds_rank_ ceph NOFD /proc/71529/task/74094/fd (opendir: Permission denied) 2024-09-12T01:30:25.709 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74096 PQ_Finish ceph cwd unknown /proc/71529/task/74096/cwd (readlink: Permission denied) 2024-09-12T01:30:25.709 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74096 PQ_Finish ceph rtd unknown /proc/71529/task/74096/root (readlink: Permission denied) 2024-09-12T01:30:25.709 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74096 PQ_Finish ceph txt unknown /proc/71529/task/74096/exe (readlink: Permission denied) 2024-09-12T01:30:25.709 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74096 PQ_Finish ceph NOFD /proc/71529/task/74096/fd (opendir: Permission denied) 2024-09-12T01:30:25.710 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74097 safe_time ceph cwd unknown /proc/71529/task/74097/cwd (readlink: Permission denied) 2024-09-12T01:30:25.710 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74097 safe_time ceph rtd unknown /proc/71529/task/74097/root (readlink: Permission denied) 2024-09-12T01:30:25.710 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74097 safe_time ceph txt unknown /proc/71529/task/74097/exe (readlink: Permission denied) 2024-09-12T01:30:25.710 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74097 safe_time ceph NOFD /proc/71529/task/74097/fd (opendir: Permission denied) 2024-09-12T01:30:25.710 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74100 MR_Finish ceph cwd unknown /proc/71529/task/74100/cwd (readlink: Permission denied) 2024-09-12T01:30:25.710 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74100 MR_Finish ceph rtd unknown /proc/71529/task/74100/root (readlink: Permission denied) 2024-09-12T01:30:25.710 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74100 MR_Finish ceph txt unknown /proc/71529/task/74100/exe (readlink: Permission denied) 2024-09-12T01:30:25.710 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74100 MR_Finish ceph NOFD /proc/71529/task/74100/fd (opendir: Permission denied) 2024-09-12T01:30:25.710 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74103 md_submit ceph cwd unknown /proc/71529/task/74103/cwd (readlink: Permission denied) 2024-09-12T01:30:25.710 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74103 md_submit ceph rtd unknown /proc/71529/task/74103/root (readlink: Permission denied) 2024-09-12T01:30:25.710 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74103 md_submit ceph txt unknown /proc/71529/task/74103/exe (readlink: Permission denied) 2024-09-12T01:30:25.710 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71529 74103 md_submit ceph NOFD /proc/71529/task/74103/fd (opendir: Permission denied) 2024-09-12T01:30:25.710 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 71922 root cwd unknown /proc/71922/cwd (readlink: Permission denied) 2024-09-12T01:30:25.711 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 71922 root rtd unknown /proc/71922/root (readlink: Permission denied) 2024-09-12T01:30:25.711 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 71922 root txt unknown /proc/71922/exe (readlink: Permission denied) 2024-09-12T01:30:25.711 INFO:tasks.workunit.client.0.smithi081.stdout:conmon 71922 root NOFD /proc/71922/fd (opendir: Permission denied) 2024-09-12T01:30:25.711 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 71924 root cwd unknown /proc/71924/cwd (readlink: Permission denied) 2024-09-12T01:30:25.711 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 71924 root rtd unknown /proc/71924/root (readlink: Permission denied) 2024-09-12T01:30:25.711 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 71924 root txt unknown /proc/71924/exe (readlink: Permission denied) 2024-09-12T01:30:25.711 INFO:tasks.workunit.client.0.smithi081.stdout:podman-in 71924 root NOFD /proc/71924/fd (opendir: Permission denied) 2024-09-12T01:30:25.711 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 ceph cwd unknown /proc/71926/cwd (readlink: Permission denied) 2024-09-12T01:30:25.711 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 ceph rtd unknown /proc/71926/root (readlink: Permission denied) 2024-09-12T01:30:25.711 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 ceph txt unknown /proc/71926/exe (readlink: Permission denied) 2024-09-12T01:30:25.711 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 ceph NOFD /proc/71926/fd (opendir: Permission denied) 2024-09-12T01:30:25.711 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71927 log ceph cwd unknown /proc/71926/task/71927/cwd (readlink: Permission denied) 2024-09-12T01:30:25.711 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71927 log ceph rtd unknown /proc/71926/task/71927/root (readlink: Permission denied) 2024-09-12T01:30:25.712 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71927 log ceph txt unknown /proc/71926/task/71927/exe (readlink: Permission denied) 2024-09-12T01:30:25.712 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71927 log ceph NOFD /proc/71926/task/71927/fd (opendir: Permission denied) 2024-09-12T01:30:25.712 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71929 msgr-work ceph cwd unknown /proc/71926/task/71929/cwd (readlink: Permission denied) 2024-09-12T01:30:25.712 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71929 msgr-work ceph rtd unknown /proc/71926/task/71929/root (readlink: Permission denied) 2024-09-12T01:30:25.712 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71929 msgr-work ceph txt unknown /proc/71926/task/71929/exe (readlink: Permission denied) 2024-09-12T01:30:25.712 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71929 msgr-work ceph NOFD /proc/71926/task/71929/fd (opendir: Permission denied) 2024-09-12T01:30:25.712 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71930 msgr-work ceph cwd unknown /proc/71926/task/71930/cwd (readlink: Permission denied) 2024-09-12T01:30:25.712 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71930 msgr-work ceph rtd unknown /proc/71926/task/71930/root (readlink: Permission denied) 2024-09-12T01:30:25.712 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71930 msgr-work ceph txt unknown /proc/71926/task/71930/exe (readlink: Permission denied) 2024-09-12T01:30:25.712 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71930 msgr-work ceph NOFD /proc/71926/task/71930/fd (opendir: Permission denied) 2024-09-12T01:30:25.712 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71931 msgr-work ceph cwd unknown /proc/71926/task/71931/cwd (readlink: Permission denied) 2024-09-12T01:30:25.712 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71931 msgr-work ceph rtd unknown /proc/71926/task/71931/root (readlink: Permission denied) 2024-09-12T01:30:25.713 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71931 msgr-work ceph txt unknown /proc/71926/task/71931/exe (readlink: Permission denied) 2024-09-12T01:30:25.713 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71931 msgr-work ceph NOFD /proc/71926/task/71931/fd (opendir: Permission denied) 2024-09-12T01:30:25.713 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71935 service ceph cwd unknown /proc/71926/task/71935/cwd (readlink: Permission denied) 2024-09-12T01:30:25.713 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71935 service ceph rtd unknown /proc/71926/task/71935/root (readlink: Permission denied) 2024-09-12T01:30:25.713 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71935 service ceph txt unknown /proc/71926/task/71935/exe (readlink: Permission denied) 2024-09-12T01:30:25.713 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71935 service ceph NOFD /proc/71926/task/71935/fd (opendir: Permission denied) 2024-09-12T01:30:25.713 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71936 admin_soc ceph cwd unknown /proc/71926/task/71936/cwd (readlink: Permission denied) 2024-09-12T01:30:25.713 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71936 admin_soc ceph rtd unknown /proc/71926/task/71936/root (readlink: Permission denied) 2024-09-12T01:30:25.713 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71936 admin_soc ceph txt unknown /proc/71926/task/71936/exe (readlink: Permission denied) 2024-09-12T01:30:25.713 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71936 admin_soc ceph NOFD /proc/71926/task/71936/fd (opendir: Permission denied) 2024-09-12T01:30:25.713 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71937 signal_ha ceph cwd unknown /proc/71926/task/71937/cwd (readlink: Permission denied) 2024-09-12T01:30:25.713 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71937 signal_ha ceph rtd unknown /proc/71926/task/71937/root (readlink: Permission denied) 2024-09-12T01:30:25.714 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71937 signal_ha ceph txt unknown /proc/71926/task/71937/exe (readlink: Permission denied) 2024-09-12T01:30:25.714 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71937 signal_ha ceph NOFD /proc/71926/task/71937/fd (opendir: Permission denied) 2024-09-12T01:30:25.714 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71938 io_contex ceph cwd unknown /proc/71926/task/71938/cwd (readlink: Permission denied) 2024-09-12T01:30:25.714 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71938 io_contex ceph rtd unknown /proc/71926/task/71938/root (readlink: Permission denied) 2024-09-12T01:30:25.714 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71938 io_contex ceph txt unknown /proc/71926/task/71938/exe (readlink: Permission denied) 2024-09-12T01:30:25.714 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71938 io_contex ceph NOFD /proc/71926/task/71938/fd (opendir: Permission denied) 2024-09-12T01:30:25.714 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71939 io_contex ceph cwd unknown /proc/71926/task/71939/cwd (readlink: Permission denied) 2024-09-12T01:30:25.714 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71939 io_contex ceph rtd unknown /proc/71926/task/71939/root (readlink: Permission denied) 2024-09-12T01:30:25.714 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71939 io_contex ceph txt unknown /proc/71926/task/71939/exe (readlink: Permission denied) 2024-09-12T01:30:25.714 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71939 io_contex ceph NOFD /proc/71926/task/71939/fd (opendir: Permission denied) 2024-09-12T01:30:25.714 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71940 ms_dispat ceph cwd unknown /proc/71926/task/71940/cwd (readlink: Permission denied) 2024-09-12T01:30:25.714 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71940 ms_dispat ceph rtd unknown /proc/71926/task/71940/root (readlink: Permission denied) 2024-09-12T01:30:25.714 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71940 ms_dispat ceph txt unknown /proc/71926/task/71940/exe (readlink: Permission denied) 2024-09-12T01:30:25.715 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71940 ms_dispat ceph NOFD /proc/71926/task/71940/fd (opendir: Permission denied) 2024-09-12T01:30:25.715 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71941 ms_local ceph cwd unknown /proc/71926/task/71941/cwd (readlink: Permission denied) 2024-09-12T01:30:25.715 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71941 ms_local ceph rtd unknown /proc/71926/task/71941/root (readlink: Permission denied) 2024-09-12T01:30:25.715 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71941 ms_local ceph txt unknown /proc/71926/task/71941/exe (readlink: Permission denied) 2024-09-12T01:30:25.715 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71941 ms_local ceph NOFD /proc/71926/task/71941/fd (opendir: Permission denied) 2024-09-12T01:30:25.715 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71942 safe_time ceph cwd unknown /proc/71926/task/71942/cwd (readlink: Permission denied) 2024-09-12T01:30:25.715 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71942 safe_time ceph rtd unknown /proc/71926/task/71942/root (readlink: Permission denied) 2024-09-12T01:30:25.715 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71942 safe_time ceph txt unknown /proc/71926/task/71942/exe (readlink: Permission denied) 2024-09-12T01:30:25.715 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71942 safe_time ceph NOFD /proc/71926/task/71942/fd (opendir: Permission denied) 2024-09-12T01:30:25.715 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71943 safe_time ceph cwd unknown /proc/71926/task/71943/cwd (readlink: Permission denied) 2024-09-12T01:30:25.715 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71943 safe_time ceph rtd unknown /proc/71926/task/71943/root (readlink: Permission denied) 2024-09-12T01:30:25.715 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71943 safe_time ceph txt unknown /proc/71926/task/71943/exe (readlink: Permission denied) 2024-09-12T01:30:25.715 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71943 safe_time ceph NOFD /proc/71926/task/71943/fd (opendir: Permission denied) 2024-09-12T01:30:25.716 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71944 ceph-mds ceph cwd unknown /proc/71926/task/71944/cwd (readlink: Permission denied) 2024-09-12T01:30:25.716 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71944 ceph-mds ceph rtd unknown /proc/71926/task/71944/root (readlink: Permission denied) 2024-09-12T01:30:25.716 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71944 ceph-mds ceph txt unknown /proc/71926/task/71944/exe (readlink: Permission denied) 2024-09-12T01:30:25.716 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 71944 ceph-mds ceph NOFD /proc/71926/task/71944/fd (opendir: Permission denied) 2024-09-12T01:30:25.716 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 72024 safe_time ceph cwd unknown /proc/71926/task/72024/cwd (readlink: Permission denied) 2024-09-12T01:30:25.716 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 72024 safe_time ceph rtd unknown /proc/71926/task/72024/root (readlink: Permission denied) 2024-09-12T01:30:25.716 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 72024 safe_time ceph txt unknown /proc/71926/task/72024/exe (readlink: Permission denied) 2024-09-12T01:30:25.716 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 72024 safe_time ceph NOFD /proc/71926/task/72024/fd (opendir: Permission denied) 2024-09-12T01:30:25.716 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74086 ceph_time ceph cwd unknown /proc/71926/task/74086/cwd (readlink: Permission denied) 2024-09-12T01:30:25.716 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74086 ceph_time ceph rtd unknown /proc/71926/task/74086/root (readlink: Permission denied) 2024-09-12T01:30:25.716 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74086 ceph_time ceph txt unknown /proc/71926/task/74086/exe (readlink: Permission denied) 2024-09-12T01:30:25.716 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74086 ceph_time ceph NOFD /proc/71926/task/74086/fd (opendir: Permission denied) 2024-09-12T01:30:25.716 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74088 OpHistory ceph cwd unknown /proc/71926/task/74088/cwd (readlink: Permission denied) 2024-09-12T01:30:25.717 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74088 OpHistory ceph rtd unknown /proc/71926/task/74088/root (readlink: Permission denied) 2024-09-12T01:30:25.717 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74088 OpHistory ceph txt unknown /proc/71926/task/74088/exe (readlink: Permission denied) 2024-09-12T01:30:25.717 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74088 OpHistory ceph NOFD /proc/71926/task/74088/fd (opendir: Permission denied) 2024-09-12T01:30:25.717 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74090 ms_dispat ceph cwd unknown /proc/71926/task/74090/cwd (readlink: Permission denied) 2024-09-12T01:30:25.717 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74090 ms_dispat ceph rtd unknown /proc/71926/task/74090/root (readlink: Permission denied) 2024-09-12T01:30:25.717 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74090 ms_dispat ceph txt unknown /proc/71926/task/74090/exe (readlink: Permission denied) 2024-09-12T01:30:25.717 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74090 ms_dispat ceph NOFD /proc/71926/task/74090/fd (opendir: Permission denied) 2024-09-12T01:30:25.717 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74091 ms_dispat ceph cwd unknown /proc/71926/task/74091/cwd (readlink: Permission denied) 2024-09-12T01:30:25.717 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74091 ms_dispat ceph rtd unknown /proc/71926/task/74091/root (readlink: Permission denied) 2024-09-12T01:30:25.717 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74091 ms_dispat ceph txt unknown /proc/71926/task/74091/exe (readlink: Permission denied) 2024-09-12T01:30:25.717 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74091 ms_dispat ceph NOFD /proc/71926/task/74091/fd (opendir: Permission denied) 2024-09-12T01:30:25.717 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74093 mds_rank_ ceph cwd unknown /proc/71926/task/74093/cwd (readlink: Permission denied) 2024-09-12T01:30:25.717 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74093 mds_rank_ ceph rtd unknown /proc/71926/task/74093/root (readlink: Permission denied) 2024-09-12T01:30:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74093 mds_rank_ ceph txt unknown /proc/71926/task/74093/exe (readlink: Permission denied) 2024-09-12T01:30:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74093 mds_rank_ ceph NOFD /proc/71926/task/74093/fd (opendir: Permission denied) 2024-09-12T01:30:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74095 PQ_Finish ceph cwd unknown /proc/71926/task/74095/cwd (readlink: Permission denied) 2024-09-12T01:30:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74095 PQ_Finish ceph rtd unknown /proc/71926/task/74095/root (readlink: Permission denied) 2024-09-12T01:30:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74095 PQ_Finish ceph txt unknown /proc/71926/task/74095/exe (readlink: Permission denied) 2024-09-12T01:30:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74095 PQ_Finish ceph NOFD /proc/71926/task/74095/fd (opendir: Permission denied) 2024-09-12T01:30:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74098 safe_time ceph cwd unknown /proc/71926/task/74098/cwd (readlink: Permission denied) 2024-09-12T01:30:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74098 safe_time ceph rtd unknown /proc/71926/task/74098/root (readlink: Permission denied) 2024-09-12T01:30:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74098 safe_time ceph txt unknown /proc/71926/task/74098/exe (readlink: Permission denied) 2024-09-12T01:30:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74098 safe_time ceph NOFD /proc/71926/task/74098/fd (opendir: Permission denied) 2024-09-12T01:30:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74099 MR_Finish ceph cwd unknown /proc/71926/task/74099/cwd (readlink: Permission denied) 2024-09-12T01:30:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74099 MR_Finish ceph rtd unknown /proc/71926/task/74099/root (readlink: Permission denied) 2024-09-12T01:30:25.718 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74099 MR_Finish ceph txt unknown /proc/71926/task/74099/exe (readlink: Permission denied) 2024-09-12T01:30:25.719 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74099 MR_Finish ceph NOFD /proc/71926/task/74099/fd (opendir: Permission denied) 2024-09-12T01:30:25.719 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74104 md_submit ceph cwd unknown /proc/71926/task/74104/cwd (readlink: Permission denied) 2024-09-12T01:30:25.719 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74104 md_submit ceph rtd unknown /proc/71926/task/74104/root (readlink: Permission denied) 2024-09-12T01:30:25.719 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74104 md_submit ceph txt unknown /proc/71926/task/74104/exe (readlink: Permission denied) 2024-09-12T01:30:25.719 INFO:tasks.workunit.client.0.smithi081.stdout:ceph-mds 71926 74104 md_submit ceph NOFD /proc/71926/task/74104/fd (opendir: Permission denied) 2024-09-12T01:30:25.719 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 74557 root cwd unknown /proc/74557/cwd (readlink: Permission denied) 2024-09-12T01:30:25.719 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 74557 root rtd unknown /proc/74557/root (readlink: Permission denied) 2024-09-12T01:30:25.719 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 74557 root txt unknown /proc/74557/exe (readlink: Permission denied) 2024-09-12T01:30:25.719 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/0 74557 root NOFD /proc/74557/fd (opendir: Permission denied) 2024-09-12T01:30:25.719 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 79426 root cwd unknown /proc/79426/cwd (readlink: Permission denied) 2024-09-12T01:30:25.719 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 79426 root rtd unknown /proc/79426/root (readlink: Permission denied) 2024-09-12T01:30:25.719 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 79426 root txt unknown /proc/79426/exe (readlink: Permission denied) 2024-09-12T01:30:25.719 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 79426 root NOFD /proc/79426/fd (opendir: Permission denied) 2024-09-12T01:30:25.720 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82627 root cwd unknown /proc/82627/cwd (readlink: Permission denied) 2024-09-12T01:30:25.720 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82627 root rtd unknown /proc/82627/root (readlink: Permission denied) 2024-09-12T01:30:25.720 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82627 root txt unknown /proc/82627/exe (readlink: Permission denied) 2024-09-12T01:30:25.720 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82627 root NOFD /proc/82627/fd (opendir: Permission denied) 2024-09-12T01:30:25.720 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82628 root cwd unknown /proc/82628/cwd (readlink: Permission denied) 2024-09-12T01:30:25.720 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82628 root rtd unknown /proc/82628/root (readlink: Permission denied) 2024-09-12T01:30:25.720 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82628 root txt unknown /proc/82628/exe (readlink: Permission denied) 2024-09-12T01:30:25.720 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82628 root NOFD /proc/82628/fd (opendir: Permission denied) 2024-09-12T01:30:25.720 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82629 root cwd unknown /proc/82629/cwd (readlink: Permission denied) 2024-09-12T01:30:25.720 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82629 root rtd unknown /proc/82629/root (readlink: Permission denied) 2024-09-12T01:30:25.720 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82629 root txt unknown /proc/82629/exe (readlink: Permission denied) 2024-09-12T01:30:25.720 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/R 82629 root NOFD /proc/82629/fd (opendir: Permission denied) 2024-09-12T01:30:25.720 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 83138 root cwd unknown /proc/83138/cwd (readlink: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 83138 root rtd unknown /proc/83138/root (readlink: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 83138 root txt unknown /proc/83138/exe (readlink: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 83138 root NOFD /proc/83138/fd (opendir: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 83170 root cwd unknown /proc/83170/cwd (readlink: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 83170 root rtd unknown /proc/83170/root (readlink: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 83170 root txt unknown /proc/83170/exe (readlink: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:sshd 83170 root NOFD /proc/83170/fd (opendir: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 84904 root cwd unknown /proc/84904/cwd (readlink: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 84904 root rtd unknown /proc/84904/root (readlink: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 84904 root txt unknown /proc/84904/exe (readlink: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/u 84904 root NOFD /proc/84904/fd (opendir: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 87063 root cwd unknown /proc/87063/cwd (readlink: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 87063 root rtd unknown /proc/87063/root (readlink: Permission denied) 2024-09-12T01:30:25.721 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 87063 root txt unknown /proc/87063/exe (readlink: Permission denied) 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 87063 root NOFD /proc/87063/fd (opendir: Permission denied) 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 87973 root cwd unknown /proc/87973/cwd (readlink: Permission denied) 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 87973 root rtd unknown /proc/87973/root (readlink: Permission denied) 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 87973 root txt unknown /proc/87973/exe (readlink: Permission denied) 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/3 87973 root NOFD /proc/87973/fd (opendir: Permission denied) 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu txt REG 8,1 41128 11685 /usr/bin/timeout 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-12T01:30:25.722 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-12T01:30:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-12T01:30:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-12T01:30:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-12T01:30:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-12T01:30:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-12T01:30:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-12T01:30:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T01:30:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-12T01:30:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T01:30:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu 0r FIFO 0,13 0t0 237983 pipe 2024-09-12T01:30:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu 1w FIFO 0,13 0t0 237984 pipe 2024-09-12T01:30:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:timeout 89270 ubuntu 2w FIFO 0,13 0t0 237985 pipe 2024-09-12T01:30:25.723 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:30:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T01:30:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-09-12T01:30:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-12T01:30:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T01:30:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T01:30:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-12T01:30:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-12T01:30:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-12T01:30:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-12T01:30:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-12T01:30:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-12T01:30:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-12T01:30:25.724 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-12T01:30:25.725 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-12T01:30:25.725 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-09-12T01:30:25.725 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T01:30:25.725 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-12T01:30:25.725 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T01:30:25.725 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu 0r FIFO 0,13 0t0 237983 pipe 2024-09-12T01:30:25.725 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu 1w FIFO 0,13 0t0 237984 pipe 2024-09-12T01:30:25.725 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu 2w FIFO 0,13 0t0 237985 pipe 2024-09-12T01:30:25.725 INFO:tasks.workunit.client.0.smithi081.stdout:fsync-tes 89288 ubuntu 255r REG 8,1 207 532574 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-12T01:30:25.725 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 90523 root cwd unknown /proc/90523/cwd (readlink: Permission denied) 2024-09-12T01:30:25.725 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 90523 root rtd unknown /proc/90523/root (readlink: Permission denied) 2024-09-12T01:30:25.725 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 90523 root txt unknown /proc/90523/exe (readlink: Permission denied) 2024-09-12T01:30:25.726 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/5 90523 root NOFD /proc/90523/fd (opendir: Permission denied) 2024-09-12T01:30:25.726 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 90524 root cwd unknown /proc/90524/cwd (readlink: Permission denied) 2024-09-12T01:30:25.726 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 90524 root rtd unknown /proc/90524/root (readlink: Permission denied) 2024-09-12T01:30:25.726 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 90524 root txt unknown /proc/90524/exe (readlink: Permission denied) 2024-09-12T01:30:25.726 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/6 90524 root NOFD /proc/90524/fd (opendir: Permission denied) 2024-09-12T01:30:25.726 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 90545 root cwd unknown /proc/90545/cwd (readlink: Permission denied) 2024-09-12T01:30:25.726 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 90545 root rtd unknown /proc/90545/root (readlink: Permission denied) 2024-09-12T01:30:25.726 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 90545 root txt unknown /proc/90545/exe (readlink: Permission denied) 2024-09-12T01:30:25.726 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 90545 root NOFD /proc/90545/fd (opendir: Permission denied) 2024-09-12T01:30:25.726 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 90546 root cwd unknown /proc/90546/cwd (readlink: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 90546 root rtd unknown /proc/90546/root (readlink: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 90546 root txt unknown /proc/90546/exe (readlink: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:kworker/1 90546 root NOFD /proc/90546/fd (opendir: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 91634 root cwd unknown /proc/91634/cwd (readlink: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 91634 root rtd unknown /proc/91634/root (readlink: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 91634 root txt unknown /proc/91634/exe (readlink: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:sudo 91634 root NOFD /proc/91634/fd (opendir: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:cephadm 91651 root cwd unknown /proc/91651/cwd (readlink: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:cephadm 91651 root rtd unknown /proc/91651/root (readlink: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:cephadm 91651 root txt unknown /proc/91651/exe (readlink: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:cephadm 91651 root NOFD /proc/91651/fd (opendir: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 root cwd unknown /proc/91691/cwd (readlink: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 root rtd unknown /proc/91691/root (readlink: Permission denied) 2024-09-12T01:30:25.727 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 root txt unknown /proc/91691/exe (readlink: Permission denied) 2024-09-12T01:30:25.728 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 root NOFD /proc/91691/fd (opendir: Permission denied) 2024-09-12T01:30:25.728 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91692 podman root cwd unknown /proc/91691/task/91692/cwd (readlink: Permission denied) 2024-09-12T01:30:25.728 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91692 podman root rtd unknown /proc/91691/task/91692/root (readlink: Permission denied) 2024-09-12T01:30:25.728 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91692 podman root txt unknown /proc/91691/task/91692/exe (readlink: Permission denied) 2024-09-12T01:30:25.728 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91692 podman root NOFD /proc/91691/task/91692/fd (opendir: Permission denied) 2024-09-12T01:30:25.728 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91693 podman root cwd unknown /proc/91691/task/91693/cwd (readlink: Permission denied) 2024-09-12T01:30:25.728 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91693 podman root rtd unknown /proc/91691/task/91693/root (readlink: Permission denied) 2024-09-12T01:30:25.728 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91693 podman root txt unknown /proc/91691/task/91693/exe (readlink: Permission denied) 2024-09-12T01:30:25.728 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91693 podman root NOFD /proc/91691/task/91693/fd (opendir: Permission denied) 2024-09-12T01:30:25.728 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91694 podman root cwd unknown /proc/91691/task/91694/cwd (readlink: Permission denied) 2024-09-12T01:30:25.728 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91694 podman root rtd unknown /proc/91691/task/91694/root (readlink: Permission denied) 2024-09-12T01:30:25.728 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91694 podman root txt unknown /proc/91691/task/91694/exe (readlink: Permission denied) 2024-09-12T01:30:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91694 podman root NOFD /proc/91691/task/91694/fd (opendir: Permission denied) 2024-09-12T01:30:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91695 podman root cwd unknown /proc/91691/task/91695/cwd (readlink: Permission denied) 2024-09-12T01:30:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91695 podman root rtd unknown /proc/91691/task/91695/root (readlink: Permission denied) 2024-09-12T01:30:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91695 podman root txt unknown /proc/91691/task/91695/exe (readlink: Permission denied) 2024-09-12T01:30:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91695 podman root NOFD /proc/91691/task/91695/fd (opendir: Permission denied) 2024-09-12T01:30:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91696 podman root cwd unknown /proc/91691/task/91696/cwd (readlink: Permission denied) 2024-09-12T01:30:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91696 podman root rtd unknown /proc/91691/task/91696/root (readlink: Permission denied) 2024-09-12T01:30:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91696 podman root txt unknown /proc/91691/task/91696/exe (readlink: Permission denied) 2024-09-12T01:30:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91696 podman root NOFD /proc/91691/task/91696/fd (opendir: Permission denied) 2024-09-12T01:30:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91697 podman root cwd unknown /proc/91691/task/91697/cwd (readlink: Permission denied) 2024-09-12T01:30:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91697 podman root rtd unknown /proc/91691/task/91697/root (readlink: Permission denied) 2024-09-12T01:30:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91697 podman root txt unknown /proc/91691/task/91697/exe (readlink: Permission denied) 2024-09-12T01:30:25.729 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91697 podman root NOFD /proc/91691/task/91697/fd (opendir: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91698 podman root cwd unknown /proc/91691/task/91698/cwd (readlink: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91698 podman root rtd unknown /proc/91691/task/91698/root (readlink: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91698 podman root txt unknown /proc/91691/task/91698/exe (readlink: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91698 podman root NOFD /proc/91691/task/91698/fd (opendir: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91699 podman root cwd unknown /proc/91691/task/91699/cwd (readlink: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91699 podman root rtd unknown /proc/91691/task/91699/root (readlink: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91699 podman root txt unknown /proc/91691/task/91699/exe (readlink: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91699 podman root NOFD /proc/91691/task/91699/fd (opendir: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91700 podman root cwd unknown /proc/91691/task/91700/cwd (readlink: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91700 podman root rtd unknown /proc/91691/task/91700/root (readlink: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91700 podman root txt unknown /proc/91691/task/91700/exe (readlink: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91700 podman root NOFD /proc/91691/task/91700/fd (opendir: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91701 podman root cwd unknown /proc/91691/task/91701/cwd (readlink: Permission denied) 2024-09-12T01:30:25.730 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91701 podman root rtd unknown /proc/91691/task/91701/root (readlink: Permission denied) 2024-09-12T01:30:25.731 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91701 podman root txt unknown /proc/91691/task/91701/exe (readlink: Permission denied) 2024-09-12T01:30:25.731 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91701 podman root NOFD /proc/91691/task/91701/fd (opendir: Permission denied) 2024-09-12T01:30:25.731 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91702 podman root cwd unknown /proc/91691/task/91702/cwd (readlink: Permission denied) 2024-09-12T01:30:25.731 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91702 podman root rtd unknown /proc/91691/task/91702/root (readlink: Permission denied) 2024-09-12T01:30:25.731 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91702 podman root txt unknown /proc/91691/task/91702/exe (readlink: Permission denied) 2024-09-12T01:30:25.731 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91702 podman root NOFD /proc/91691/task/91702/fd (opendir: Permission denied) 2024-09-12T01:30:25.731 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91703 podman root cwd unknown /proc/91691/task/91703/cwd (readlink: Permission denied) 2024-09-12T01:30:25.731 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91703 podman root rtd unknown /proc/91691/task/91703/root (readlink: Permission denied) 2024-09-12T01:30:25.731 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91703 podman root txt unknown /proc/91691/task/91703/exe (readlink: Permission denied) 2024-09-12T01:30:25.731 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91703 podman root NOFD /proc/91691/task/91703/fd (opendir: Permission denied) 2024-09-12T01:30:25.731 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91706 podman root cwd unknown /proc/91691/task/91706/cwd (readlink: Permission denied) 2024-09-12T01:30:25.731 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91706 podman root rtd unknown /proc/91691/task/91706/root (readlink: Permission denied) 2024-09-12T01:30:25.731 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91706 podman root txt unknown /proc/91691/task/91706/exe (readlink: Permission denied) 2024-09-12T01:30:25.732 INFO:tasks.workunit.client.0.smithi081.stdout:podman 91691 91706 podman root NOFD /proc/91691/task/91706/fd (opendir: Permission denied) 2024-09-12T01:30:25.732 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:30:25.732 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T01:30:25.732 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-12T01:30:25.732 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-12T01:30:25.732 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T01:30:25.732 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-12T01:30:25.732 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-12T01:30:25.732 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-12T01:30:25.732 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-12T01:30:25.732 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-12T01:30:25.732 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-12T01:30:25.732 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T01:30:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-12T01:30:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-12T01:30:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-12T01:30:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-12T01:30:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-12T01:30:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T01:30:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T01:30:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu 0r FIFO 0,13 0t0 237983 pipe 2024-09-12T01:30:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu 1w FIFO 0,13 0t0 237984 pipe 2024-09-12T01:30:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu 2w FIFO 0,13 0t0 237985 pipe 2024-09-12T01:30:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu 3r DIR 0,20 0 1 /proc 2024-09-12T01:30:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu 4r DIR 0,20 0 240373 /proc/91705/fd 2024-09-12T01:30:25.733 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu 5w FIFO 0,13 0t0 240378 pipe 2024-09-12T01:30:25.734 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91705 ubuntu 6r FIFO 0,13 0t0 240379 pipe 2024-09-12T01:30:25.734 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:30:25.734 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu rtd DIR 8,1 4096 2 / 2024-09-12T01:30:25.734 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-12T01:30:25.734 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-12T01:30:25.734 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-12T01:30:25.734 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-12T01:30:25.734 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-12T01:30:25.734 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-12T01:30:25.734 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-12T01:30:25.734 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-12T01:30:25.734 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-12T01:30:25.734 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-12T01:30:25.735 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-12T01:30:25.735 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-12T01:30:25.735 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-12T01:30:25.735 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-12T01:30:25.735 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-12T01:30:25.735 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-12T01:30:25.735 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-12T01:30:25.735 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu 4r FIFO 0,13 0t0 240378 pipe 2024-09-12T01:30:25.735 INFO:tasks.workunit.client.0.smithi081.stdout:lsof 91708 ubuntu 7w FIFO 0,13 0t0 240379 pipe 2024-09-12T01:30:25.735 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:30:25.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:30:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.588+0000 7f9ea16de640 1 -- 172.21.15.81:0/3542401604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e9c100e30 msgr2=0x7f9e9c104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.588+0000 7f9ea16de640 1 --2- 172.21.15.81:0/3542401604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e9c100e30 0x7f9e9c104e80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009900 tx=0x7f9e9002a410 comp rx=0 tx=0).stop 2024-09-12T01:30:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.588+0000 7f9ea16de640 1 -- 172.21.15.81:0/3542401604 shutdown_connections 2024-09-12T01:30:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.588+0000 7f9ea16de640 1 --2- 172.21.15.81:0/3542401604 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e9c1055b0 0x7f9e9c10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.588+0000 7f9ea16de640 1 --2- 172.21.15.81:0/3542401604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e9c100e30 0x7f9e9c104e80 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.588+0000 7f9ea16de640 1 --2- 172.21.15.81:0/3542401604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e9c100480 0x7f9e9c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.588+0000 7f9ea16de640 1 -- 172.21.15.81:0/3542401604 >> 172.21.15.81:0/3542401604 conn(0x7f9e9c077210 msgr2=0x7f9e9c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.588+0000 7f9ea16de640 1 -- 172.21.15.81:0/3542401604 shutdown_connections 2024-09-12T01:30:25.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.589+0000 7f9ea16de640 1 -- 172.21.15.81:0/3542401604 wait complete. 2024-09-12T01:30:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.589+0000 7f9ea16de640 1 Processor -- start 2024-09-12T01:30:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.589+0000 7f9ea16de640 1 -- start start 2024-09-12T01:30:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.590+0000 7f9ea16de640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e9c100480 0x7f9e9c197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.590+0000 7f9ea16de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e9c100e30 0x7f9e9c1978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.590+0000 7f9ea16de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e9c1055b0 0x7f9e9c19bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.590+0000 7f9ea16de640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1105b0 con 0x7f9e9c1055b0 2024-09-12T01:30:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.590+0000 7f9ea16de640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c110430 con 0x7f9e9c100e30 2024-09-12T01:30:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.590+0000 7f9ea16de640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c110730 con 0x7f9e9c100480 2024-09-12T01:30:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.590+0000 7f9e9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e9c1055b0 0x7f9e9c19bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.590+0000 7f9e9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e9c1055b0 0x7f9e9c19bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44550/0 (socket says 172.21.15.81:44550) 2024-09-12T01:30:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.590+0000 7f9e9b7fe640 1 -- 172.21.15.81:0/145613437 learned_addr learned my addr 172.21.15.81:0/145613437 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.590+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e9c100e30 0x7f9e9c1978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.590+0000 7f9e9affd640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e9c100480 0x7f9e9c197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.590+0000 7f9e9b7fe640 1 -- 172.21.15.81:0/145613437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e9c100480 msgr2=0x7f9e9c197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.590+0000 7f9e9b7fe640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e9c100480 0x7f9e9c197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.591+0000 7f9e9b7fe640 1 -- 172.21.15.81:0/145613437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e9c100e30 msgr2=0x7f9e9c1978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.591+0000 7f9e9b7fe640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e9c100e30 0x7f9e9c1978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.591+0000 7f9e9b7fe640 1 -- 172.21.15.81:0/145613437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9c19c320 con 0x7f9e9c1055b0 2024-09-12T01:30:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.591+0000 7f9e9affd640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e9c100480 0x7f9e9c197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.591+0000 7f9e9b7fe640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e9c1055b0 0x7f9e9c19bc40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9e94007cb0 tx=0x7f9e9400e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.591+0000 7f9e83fff640 1 -- 172.21.15.81:0/145613437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9400eb30 con 0x7f9e9c1055b0 2024-09-12T01:30:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.591+0000 7f9e83fff640 1 -- 172.21.15.81:0/145613437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e9400ecd0 con 0x7f9e9c1055b0 2024-09-12T01:30:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.591+0000 7f9e83fff640 1 -- 172.21.15.81:0/145613437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e94015650 con 0x7f9e9c1055b0 2024-09-12T01:30:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.591+0000 7f9ea16de640 1 -- 172.21.15.81:0/145613437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9c19c610 con 0x7f9e9c1055b0 2024-09-12T01:30:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.591+0000 7f9ea16de640 1 -- 172.21.15.81:0/145613437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9c103460 con 0x7f9e9c1055b0 2024-09-12T01:30:25.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.593+0000 7f9e83fff640 1 -- 172.21.15.81:0/145613437 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9e9400a440 con 0x7f9e9c1055b0 2024-09-12T01:30:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9ea3ab7740 1 Processor -- start 2024-09-12T01:30:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9ea3ab7740 1 -- start start 2024-09-12T01:30:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9ea3ab7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781747b40 0x55d781746090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9ea3ab7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 0x55d781746a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9ea3ab7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781751370 0x55d781753760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9ea3ab7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d7816ac2f0 con 0x55d781751370 2024-09-12T01:30:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9ea3ab7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d781653cf0 con 0x55d7817465d0 2024-09-12T01:30:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9ea3ab7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d7816a82b0 con 0x55d781747b40 2024-09-12T01:30:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9e9a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781751370 0x55d781753760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9e9a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781751370 0x55d781753760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44560/0 (socket says 172.21.15.81:44560) 2024-09-12T01:30:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9e9affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 0x55d781746a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9e9a7fc640 1 -- 172.21.15.81:0/2044791851 learned_addr learned my addr 172.21.15.81:0/2044791851 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9e83fff640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9e840a2cf0 0x7f9e840a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/2044791851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781747b40 0x55d781746090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9e9b7fe640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9e840a2cf0 0x7f9e840a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9e9a7fc640 1 -- 172.21.15.81:0/2044791851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781747b40 msgr2=0x55d781746090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/2044791851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781747b40 0x55d781746090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9e9a7fc640 1 -- 172.21.15.81:0/2044791851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 msgr2=0x55d781746a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/2044791851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 0x55d781746a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9e83fff640 1 -- 172.21.15.81:0/145613437 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f9e940d1070 con 0x7f9e9c1055b0 2024-09-12T01:30:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.594+0000 7f9e9a7fc640 1 -- 172.21.15.81:0/2044791851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7816383a0 con 0x55d781751370 2024-09-12T01:30:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.595+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/2044791851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781751370 0x55d781753760 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009900 tx=0x7f9e900056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132936f7a10adf59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.595+0000 7f9e9b7fe640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9e840a2cf0 0x7f9e840a51b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9e940ce8a0 tx=0x7f9e9400aba0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.595+0000 7f9e817fa640 1 -- 172.21.15.81:0/2044791851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90035040 con 0x55d781751370 2024-09-12T01:30:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.595+0000 7f9e817fa640 1 -- 172.21.15.81:0/2044791851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e90004030 con 0x55d781751370 2024-09-12T01:30:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.595+0000 7f9e817fa640 1 -- 172.21.15.81:0/2044791851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90003b60 con 0x55d781751370 2024-09-12T01:30:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/2044791851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781751370 msgr2=0x55d781753760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/2044791851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781751370 0x55d781753760 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009900 tx=0x7f9e900056d0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/2044791851 shutdown_connections 2024-09-12T01:30:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/2044791851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781751370 0x55d781753760 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/2044791851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 0x55d781746a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/2044791851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781747b40 0x55d781746090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/2044791851 >> 172.21.15.81:0/2044791851 conn(0x55d78170f310 msgr2=0x55d781742c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/2044791851 shutdown_connections 2024-09-12T01:30:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/2044791851 wait complete. 2024-09-12T01:30:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 -- start start 2024-09-12T01:30:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 Processor -- start 2024-09-12T01:30:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7817465d0 0x55d781750d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d781747b40 0x55d78174e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 0x55d78174e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d781754010 con 0x55d7817465d0 2024-09-12T01:30:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d781667060 con 0x55d781747b40 2024-09-12T01:30:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d781754190 con 0x55d781751370 2024-09-12T01:30:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.596+0000 7f9ea3ab7740 10 client.0 _ll_register_callbacks cb 0x55d7813ba8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e9a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7817465d0 0x55d781750d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e9a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7817465d0 0x55d781750d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44570/0 (socket says 172.21.15.81:44570) 2024-09-12T01:30:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e9a7fc640 1 -- 172.21.15.81:0/4048914494 learned_addr learned my addr 172.21.15.81:0/4048914494 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e9affd640 1 --2- 172.21.15.81:0/4048914494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d781747b40 0x55d78174e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e9a7fc640 1 -- 172.21.15.81:0/4048914494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 msgr2=0x55d78174e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/4048914494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 0x55d78174e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e9a7fc640 1 -- 172.21.15.81:0/4048914494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d781747b40 msgr2=0x55d78174e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/4048914494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d781747b40 0x55d78174e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e9a7fc640 1 -- 172.21.15.81:0/4048914494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d78141d3c0 con 0x55d7817465d0 2024-09-12T01:30:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/4048914494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7817465d0 0x55d781750d70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9e9002a930 tx=0x7f9e90003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf042c6f59f4b7db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e7eff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e7eff5640 1 -- 172.21.15.81:0/4048914494 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90035050 con 0x55d7817465d0 2024-09-12T01:30:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e7eff5640 1 -- 172.21.15.81:0/4048914494 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f9e90003920 con 0x55d7817465d0 2024-09-12T01:30:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/4048914494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e90004030 con 0x55d7817465d0 2024-09-12T01:30:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9e7eff5640 1 -- 172.21.15.81:0/4048914494 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9e9005a050 con 0x55d7817465d0 2024-09-12T01:30:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9ea3ab7740 10 client.15999 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.597+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/4048914494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d78175fab0 con 0x55d7817465d0 2024-09-12T01:30:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.598+0000 7f9e7eff5640 1 -- 172.21.15.81:0/4048914494 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e90004030 con 0x55d7817465d0 2024-09-12T01:30:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.598+0000 7f9e7eff5640 1 -- 172.21.15.81:0/4048914494 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9e9003a040 con 0x55d7817465d0 2024-09-12T01:30:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.598+0000 7f9ea3ab7740 10 client.15999 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.598+0000 7f9ea3ab7740 10 client.15999 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.598+0000 7f9ea3ab7740 20 client.15999 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.598+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/4048914494 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55d781760e00 0x55d7817631f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.598+0000 7f9ea3ab7740 4 client.15999 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.598+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/4048914494 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7816b9860 con 0x55d781760e00 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.598+0000 7f9e9affd640 1 --2- 172.21.15.81:0/4048914494 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55d781760e00 0x55d7817631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9e9affd640 1 --2- 172.21.15.81:0/4048914494 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55d781760e00 0x55d7817631f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dd0783fabcb90ad server_cookie=5428016dcc4d10b8 in_seq=0 out_seq=0 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9e7eff5640 10 client.15999 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9e7eff5640 1 -- 172.21.15.81:0/4048914494 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7816b9860 con 0x55d781760e00 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9e7eff5640 10 client.15999 handle_command_reply: tid=0 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9ea3ab7740 1 client.15999 shutdown 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/4048914494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7817465d0 msgr2=0x55d781750d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/4048914494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7817465d0 0x55d781750d70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9e9002a930 tx=0x7f9e90003700 comp rx=0 tx=0).stop 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/4048914494 shutdown_connections 2024-09-12T01:30:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/4048914494 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55d781760e00 0x55d7817631f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/4048914494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 0x55d78174e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9e7eff5640 0 client.15999 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:30:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/4048914494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d781747b40 0x55d78174e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/4048914494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7817465d0 0x55d781750d70 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.599+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/4048914494 >> 172.21.15.81:0/4048914494 conn(0x55d78170f310 msgr2=0x55d781748960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.600+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/4048914494 shutdown_connections 2024-09-12T01:30:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.600+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/4048914494 wait complete. 2024-09-12T01:30:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.600+0000 7f9ea3ab7740 20 client.15999 trim_cache size 0 max 16384 2024-09-12T01:30:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.612+0000 7f9ea3ab7740 1 Processor -- start 2024-09-12T01:30:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.612+0000 7f9ea3ab7740 1 -- start start 2024-09-12T01:30:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9ea3ab7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 0x55d781742df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9ea3ab7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 0x55d781747300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9ea3ab7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 0x55d78175d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9ea3ab7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1ab590 con 0x55d781747b40 2024-09-12T01:30:25.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9ea3ab7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1ad0d0 con 0x55d7817465d0 2024-09-12T01:30:25.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9ea3ab7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1abc60 con 0x55d781751370 2024-09-12T01:30:25.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e9affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 0x55d781747300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e9affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 0x55d781747300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44584/0 (socket says 172.21.15.81:44584) 2024-09-12T01:30:25.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e9affd640 1 -- 172.21.15.81:0/1344392195 learned_addr learned my addr 172.21.15.81:0/1344392195 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:25.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/1344392195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 0x55d781742df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e9affd640 1 -- 172.21.15.81:0/1344392195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 msgr2=0x55d78175d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:25.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e9affd640 1 --2- 172.21.15.81:0/1344392195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 0x55d78175d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e9affd640 1 -- 172.21.15.81:0/1344392195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 msgr2=0x55d781742df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:25.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e9affd640 1 --2- 172.21.15.81:0/1344392195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 0x55d781742df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e9affd640 1 -- 172.21.15.81:0/1344392195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7817462d0 con 0x55d781747b40 2024-09-12T01:30:25.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/1344392195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 0x55d781742df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:25.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e9affd640 1 --2- 172.21.15.81:0/1344392195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 0x55d781747300 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c000c00 tx=0x7f9e8c0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cac9ad31d383aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:25.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e80ff9640 1 -- 172.21.15.81:0/1344392195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0142d0 con 0x55d781747b40 2024-09-12T01:30:25.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e80ff9640 1 -- 172.21.15.81:0/1344392195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e8c005500 con 0x55d781747b40 2024-09-12T01:30:25.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.613+0000 7f9e80ff9640 1 -- 172.21.15.81:0/1344392195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c01b590 con 0x55d781747b40 2024-09-12T01:30:25.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.614+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/1344392195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 msgr2=0x55d781747300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:25.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.614+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/1344392195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 0x55d781747300 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c000c00 tx=0x7f9e8c0094a0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.614+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/1344392195 shutdown_connections 2024-09-12T01:30:25.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.614+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/1344392195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 0x55d78175d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.614+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/1344392195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 0x55d781747300 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.614+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/1344392195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 0x55d781742df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.614+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/1344392195 >> 172.21.15.81:0/1344392195 conn(0x55d78170f310 msgr2=0x55d7817426e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.614+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/1344392195 shutdown_connections 2024-09-12T01:30:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.614+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/1344392195 wait complete. 2024-09-12T01:30:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9ea3ab7740 1 -- start start 2024-09-12T01:30:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9ea3ab7740 1 Processor -- start 2024-09-12T01:30:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9ea3ab7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 0x55d781759700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9ea3ab7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 0x55d781759c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9ea3ab7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 0x55d78174aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9ea3ab7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1aca00 con 0x55d781747b40 2024-09-12T01:30:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9ea3ab7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1ac330 con 0x55d7817465d0 2024-09-12T01:30:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9ea3ab7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1a9570 con 0x55d781751370 2024-09-12T01:30:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9ea3ab7740 10 client.0 _ll_register_callbacks cb 0x7f9e8c009340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9e9affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 0x55d781759c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9e9affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 0x55d781759c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44596/0 (socket says 172.21.15.81:44596) 2024-09-12T01:30:25.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9e9affd640 1 -- 172.21.15.81:0/2417703679 learned_addr learned my addr 172.21.15.81:0/2417703679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:25.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 0x55d781759700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9e9affd640 1 -- 172.21.15.81:0/2417703679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 msgr2=0x55d78174aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:25.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 0x55d78174aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9e9affd640 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 0x55d78174aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9e9affd640 1 -- 172.21.15.81:0/2417703679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 msgr2=0x55d781759700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:25.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9e9affd640 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 0x55d781759700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9e9affd640 1 -- 172.21.15.81:0/2417703679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d78174b290 con 0x55d781747b40 2024-09-12T01:30:25.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 0x55d78174aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:25.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.615+0000 7f9e9affd640 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 0x55d781759c40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c014f90 tx=0x7f9e8c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7893d3b50012953f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:25.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9e7eff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:25.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9e7eff5640 1 -- 172.21.15.81:0/2417703679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c005020 con 0x55d781747b40 2024-09-12T01:30:25.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9e7eff5640 1 -- 172.21.15.81:0/2417703679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f9e8c0051c0 con 0x55d781747b40 2024-09-12T01:30:25.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/2417703679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e8c005500 con 0x55d781747b40 2024-09-12T01:30:25.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9e7eff5640 1 -- 172.21.15.81:0/2417703679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9e8c035050 con 0x55d781747b40 2024-09-12T01:30:25.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9ea3ab7740 10 client.16005 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:25.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/2417703679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d7817cb3c0 con 0x55d781747b40 2024-09-12T01:30:25.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9e7eff5640 1 -- 172.21.15.81:0/2417703679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e8c005500 con 0x55d781747b40 2024-09-12T01:30:25.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9e7eff5640 1 -- 172.21.15.81:0/2417703679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9e8c02e060 con 0x55d781747b40 2024-09-12T01:30:25.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9ea3ab7740 10 client.16005 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:25.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9ea3ab7740 10 client.16005 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:30:25.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9ea3ab7740 20 client.16005 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:25.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55d7817cbab0 0x55d7817cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9ea3ab7740 4 client.16005 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:30:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.616+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/2417703679 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d7816b3d70 con 0x55d7817cbab0 2024-09-12T01:30:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55d7817cbab0 0x55d7817cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9e9a7fc640 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55d7817cbab0 0x55d7817cded0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=21fbd1d52f2b4cba server_cookie=3d873bd97cb85bc8 in_seq=0 out_seq=0 2024-09-12T01:30:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9e7eff5640 10 client.16005 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:30:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9e7eff5640 1 -- 172.21.15.81:0/2417703679 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d7816b3d70 con 0x55d7817cbab0 2024-09-12T01:30:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9e7eff5640 10 client.16005 handle_command_reply: tid=0 2024-09-12T01:30:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9ea3ab7740 1 client.16005 shutdown 2024-09-12T01:30:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/2417703679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 msgr2=0x55d781759c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 0x55d781759c40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c014f90 tx=0x7f9e8c009ae0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/2417703679 shutdown_connections 2024-09-12T01:30:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55d7817cbab0 0x55d7817cded0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d781751370 0x55d78174aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d781747b40 0x55d781759c40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9ea3ab7740 1 --2- 172.21.15.81:0/2417703679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7817465d0 0x55d781759700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/2417703679 >> 172.21.15.81:0/2417703679 conn(0x55d78170f310 msgr2=0x55d781742680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:25.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9e7eff5640 0 client.16005 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:30:25.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/2417703679 shutdown_connections 2024-09-12T01:30:25.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.617+0000 7f9ea3ab7740 1 -- 172.21.15.81:0/2417703679 wait complete. 2024-09-12T01:30:25.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.618+0000 7f9ea3ab7740 20 client.16005 trim_cache size 0 max 16384 2024-09-12T01:30:25.762 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:30:25.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.618+0000 7f9ea16de640 1 -- 172.21.15.81:0/145613437 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9e840a2cf0 msgr2=0x7f9e840a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:25.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.618+0000 7f9ea16de640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9e840a2cf0 0x7f9e840a51b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9e940ce8a0 tx=0x7f9e9400aba0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.618+0000 7f9ea16de640 1 -- 172.21.15.81:0/145613437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e9c1055b0 msgr2=0x7f9e9c19bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:25.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.618+0000 7f9ea16de640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e9c1055b0 0x7f9e9c19bc40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9e94007cb0 tx=0x7f9e9400e420 comp rx=0 tx=0).stop 2024-09-12T01:30:25.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.618+0000 7f9ea16de640 1 -- 172.21.15.81:0/145613437 shutdown_connections 2024-09-12T01:30:25.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.618+0000 7f9ea16de640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9e840a2cf0 0x7f9e840a51b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.618+0000 7f9ea16de640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e9c1055b0 0x7f9e9c19bc40 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.618+0000 7f9ea16de640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e9c100e30 0x7f9e9c1978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.618+0000 7f9ea16de640 1 --2- 172.21.15.81:0/145613437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e9c100480 0x7f9e9c197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:25.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.618+0000 7f9ea16de640 1 -- 172.21.15.81:0/145613437 >> 172.21.15.81:0/145613437 conn(0x7f9e9c077210 msgr2=0x7f9e9c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:25.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.618+0000 7f9ea16de640 1 -- 172.21.15.81:0/145613437 shutdown_connections 2024-09-12T01:30:25.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:25.618+0000 7f9ea16de640 1 -- 172.21.15.81:0/145613437 wait complete. 2024-09-12T01:30:25.786 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:25 smithi081 ceph-mon[30920]: pgmap v73: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.9 MiB/s wr, 493 op/s 2024-09-12T01:30:25.810 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-09-12T01:30:25.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:30:26.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:25 smithi100 ceph-mon[35275]: pgmap v73: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.9 MiB/s wr, 493 op/s 2024-09-12T01:30:26.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:25 smithi189 ceph-mon[35357]: pgmap v73: 97 pgs: 97 active+clean; 260 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.9 MiB/s wr, 493 op/s 2024-09-12T01:30:26.164 DEBUG:teuthology.parallel:result is None 2024-09-12T01:30:26.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:30:26.199 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:30:26.200 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-12T01:30:26.211 INFO:tasks.quiescer:joining Quiescers 2024-09-12T01:30:26.211 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-12T01:30:26.212 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:30:26.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:30:26.491 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.939+0000 7f9a8af44640 1 -- 172.21.15.81:0/2794609955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a841036e0 msgr2=0x7f9a84107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.939+0000 7f9a8af44640 1 --2- 172.21.15.81:0/2794609955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a841036e0 0x7f9a84107b90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009930 tx=0x7f9a6c02a420 comp rx=0 tx=0).stop 2024-09-12T01:30:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.939+0000 7f9a8af44640 1 -- 172.21.15.81:0/2794609955 shutdown_connections 2024-09-12T01:30:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.939+0000 7f9a8af44640 1 --2- 172.21.15.81:0/2794609955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a841082a0 0x7f9a8410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.939+0000 7f9a8af44640 1 --2- 172.21.15.81:0/2794609955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a841036e0 0x7f9a84107b90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.939+0000 7f9a8af44640 1 --2- 172.21.15.81:0/2794609955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a84102d30 0x7f9a84103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.939+0000 7f9a8af44640 1 -- 172.21.15.81:0/2794609955 >> 172.21.15.81:0/2794609955 conn(0x7f9a840fc7d0 msgr2=0x7f9a840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.939+0000 7f9a8af44640 1 -- 172.21.15.81:0/2794609955 shutdown_connections 2024-09-12T01:30:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.939+0000 7f9a8af44640 1 -- 172.21.15.81:0/2794609955 wait complete. 2024-09-12T01:30:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.939+0000 7f9a8af44640 1 Processor -- start 2024-09-12T01:30:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.939+0000 7f9a8af44640 1 -- start start 2024-09-12T01:30:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a8af44640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a84102d30 0x7f9a841985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a8af44640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a841036e0 0x7f9a84198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a8af44640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a841082a0 0x7f9a8419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a8af44640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a841120a0 con 0x7f9a841036e0 2024-09-12T01:30:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a8af44640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9a84111f20 con 0x7f9a84102d30 2024-09-12T01:30:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a8af44640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9a84112220 con 0x7f9a841082a0 2024-09-12T01:30:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a841036e0 0x7f9a84198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a841036e0 0x7f9a84198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44624/0 (socket says 172.21.15.81:44624) 2024-09-12T01:30:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a83fff640 1 -- 172.21.15.81:0/885578730 learned_addr learned my addr 172.21.15.81:0/885578730 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a894e1640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a841082a0 0x7f9a8419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a88ce0640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a84102d30 0x7f9a841985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a83fff640 1 -- 172.21.15.81:0/885578730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a841082a0 msgr2=0x7f9a8419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a83fff640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a841082a0 0x7f9a8419ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a83fff640 1 -- 172.21.15.81:0/885578730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a84102d30 msgr2=0x7f9a841985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a83fff640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a84102d30 0x7f9a841985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a83fff640 1 -- 172.21.15.81:0/885578730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8419d560 con 0x7f9a841036e0 2024-09-12T01:30:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a894e1640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a841082a0 0x7f9a8419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a83fff640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a841036e0 0x7f9a84198af0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c005940 tx=0x7f9a6c031b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a81ffb640 1 -- 172.21.15.81:0/885578730 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c03f030 con 0x7f9a841036e0 2024-09-12T01:30:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a8af44640 1 -- 172.21.15.81:0/885578730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8419d7f0 con 0x7f9a841036e0 2024-09-12T01:30:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a81ffb640 1 -- 172.21.15.81:0/885578730 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a6c0043d0 con 0x7f9a841036e0 2024-09-12T01:30:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.940+0000 7f9a81ffb640 1 -- 172.21.15.81:0/885578730 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c035070 con 0x7f9a841036e0 2024-09-12T01:30:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.941+0000 7f9a8af44640 1 -- 172.21.15.81:0/885578730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a841a5130 con 0x7f9a841036e0 2024-09-12T01:30:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.942+0000 7f9a8af44640 1 -- 172.21.15.81:0/885578730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a84103110 con 0x7f9a841036e0 2024-09-12T01:30:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.943+0000 7f9a81ffb640 1 -- 172.21.15.81:0/885578730 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9a6c042030 con 0x7f9a841036e0 2024-09-12T01:30:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.943+0000 7f9a81ffb640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9a700a2cf0 0x7f9a700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.944+0000 7f9a88ce0640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9a700a2cf0 0x7f9a700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.944+0000 7f9a81ffb640 1 -- 172.21.15.81:0/885578730 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f9a6c0ef7e0 con 0x7f9a841036e0 2024-09-12T01:30:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.944+0000 7f9a88ce0640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9a700a2cf0 0x7f9a700a51b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c005fd0 tx=0x7f9a7c009500 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:26.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:26.948+0000 7f9a81ffb640 1 -- 172.21.15.81:0/885578730 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a6c0bc430 con 0x7f9a841036e0 2024-09-12T01:30:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:27.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.161+0000 7f9a8af44640 1 -- 172.21.15.81:0/885578730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a8410a2b0 con 0x7f9a841036e0 2024-09-12T01:30:27.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.161+0000 7f9a81ffb640 1 -- 172.21.15.81:0/885578730 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f9a6c0bbd30 con 0x7f9a841036e0 2024-09-12T01:30:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:30:27.161 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:30:27.161 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:30:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.163+0000 7f9a8af44640 1 -- 172.21.15.81:0/885578730 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9a700a2cf0 msgr2=0x7f9a700a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.163+0000 7f9a8af44640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9a700a2cf0 0x7f9a700a51b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c005fd0 tx=0x7f9a7c009500 comp rx=0 tx=0).stop 2024-09-12T01:30:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.163+0000 7f9a8af44640 1 -- 172.21.15.81:0/885578730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a841036e0 msgr2=0x7f9a84198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.163+0000 7f9a8af44640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a841036e0 0x7f9a84198af0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c005940 tx=0x7f9a6c031b50 comp rx=0 tx=0).stop 2024-09-12T01:30:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.163+0000 7f9a8af44640 1 -- 172.21.15.81:0/885578730 shutdown_connections 2024-09-12T01:30:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.163+0000 7f9a8af44640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9a700a2cf0 0x7f9a700a51b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.163+0000 7f9a8af44640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a841082a0 0x7f9a8419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.163+0000 7f9a8af44640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a841036e0 0x7f9a84198af0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.163+0000 7f9a8af44640 1 --2- 172.21.15.81:0/885578730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a84102d30 0x7f9a841985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.163+0000 7f9a8af44640 1 -- 172.21.15.81:0/885578730 >> 172.21.15.81:0/885578730 conn(0x7f9a840fc7d0 msgr2=0x7f9a84105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.164+0000 7f9a8af44640 1 -- 172.21.15.81:0/885578730 shutdown_connections 2024-09-12T01:30:27.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:27.164+0000 7f9a8af44640 1 -- 172.21.15.81:0/885578730 wait complete. 2024-09-12T01:30:27.925 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:27 smithi081 ceph-mon[30920]: pgmap v74: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.38k op/s 2024-09-12T01:30:27.925 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:27 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/885578730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:30:27.953 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --cancel --all' 2024-09-12T01:30:27.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --cancel --all 2024-09-12T01:30:28.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:27 smithi100 ceph-mon[35275]: pgmap v74: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.38k op/s 2024-09-12T01:30:28.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:27 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/885578730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:30:28.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:27 smithi189 ceph-mon[35357]: pgmap v74: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.38k op/s 2024-09-12T01:30:28.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:27 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/885578730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:30:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.148+0000 7f096722d640 1 -- 172.21.15.81:0/1989316859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960106a70 msgr2=0x7f0960106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.148+0000 7f096722d640 1 --2- 172.21.15.81:0/1989316859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960106a70 0x7f0960106e50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0954009930 tx=0x7f095402a420 comp rx=0 tx=0).stop 2024-09-12T01:30:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.148+0000 7f096722d640 1 -- 172.21.15.81:0/1989316859 shutdown_connections 2024-09-12T01:30:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.148+0000 7f096722d640 1 --2- 172.21.15.81:0/1989316859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0960101410 0x7f096010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.148+0000 7f096722d640 1 --2- 172.21.15.81:0/1989316859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960100a70 0x7f0960100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.148+0000 7f096722d640 1 --2- 172.21.15.81:0/1989316859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960106a70 0x7f0960106e50 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.148+0000 7f096722d640 1 -- 172.21.15.81:0/1989316859 >> 172.21.15.81:0/1989316859 conn(0x7f09600fc790 msgr2=0x7f09600febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.148+0000 7f096722d640 1 -- 172.21.15.81:0/1989316859 shutdown_connections 2024-09-12T01:30:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.148+0000 7f096722d640 1 -- 172.21.15.81:0/1989316859 wait complete. 2024-09-12T01:30:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.148+0000 7f096722d640 1 Processor -- start 2024-09-12T01:30:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.148+0000 7f096722d640 1 -- start start 2024-09-12T01:30:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f096722d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960100a70 0x7f0960199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f096722d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960101410 0x7f0960199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f096722d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0960106a70 0x7f09601a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f096722d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0960110e70 con 0x7f0960101410 2024-09-12T01:30:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f096722d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0960110cf0 con 0x7f0960100a70 2024-09-12T01:30:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f096722d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0960110ff0 con 0x7f0960106a70 2024-09-12T01:30:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f095ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960101410 0x7f0960199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f095ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960101410 0x7f0960199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44652/0 (socket says 172.21.15.81:44652) 2024-09-12T01:30:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f095ffff640 1 -- 172.21.15.81:0/1892036060 learned_addr learned my addr 172.21.15.81:0/1892036060 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f0964fc9640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960100a70 0x7f0960199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f09657ca640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0960106a70 0x7f09601a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f095ffff640 1 -- 172.21.15.81:0/1892036060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0960106a70 msgr2=0x7f09601a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f095ffff640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0960106a70 0x7f09601a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f095ffff640 1 -- 172.21.15.81:0/1892036060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960100a70 msgr2=0x7f0960199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f095ffff640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960100a70 0x7f0960199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f095ffff640 1 -- 172.21.15.81:0/1892036060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09601a48e0 con 0x7f0960101410 2024-09-12T01:30:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.149+0000 7f09657ca640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0960106a70 0x7f09601a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.150+0000 7f095ffff640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960101410 0x7f0960199860 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f094c00e9f0 tx=0x7f094c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.150+0000 7f095dffb640 1 -- 172.21.15.81:0/1892036060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c00cd80 con 0x7f0960101410 2024-09-12T01:30:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.150+0000 7f096722d640 1 -- 172.21.15.81:0/1892036060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09601a4ab0 con 0x7f0960101410 2024-09-12T01:30:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.150+0000 7f095dffb640 1 -- 172.21.15.81:0/1892036060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f094c010910 con 0x7f0960101410 2024-09-12T01:30:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.150+0000 7f095dffb640 1 -- 172.21.15.81:0/1892036060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c0188f0 con 0x7f0960101410 2024-09-12T01:30:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.150+0000 7f096722d640 1 -- 172.21.15.81:0/1892036060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09601a4fa0 con 0x7f0960101410 2024-09-12T01:30:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.152+0000 7f095dffb640 1 -- 172.21.15.81:0/1892036060 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f094c010ac0 con 0x7f0960101410 2024-09-12T01:30:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f0969606740 1 Processor -- start 2024-09-12T01:30:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f0969606740 1 -- start start 2024-09-12T01:30:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f0969606740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x559368463090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f0969606740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593684635d0 0x559368463a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f095dffb640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f09500a2cf0 0x7f09500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f0969606740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559368472780 0x559368474b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f0969606740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5593683c92f0 con 0x559368464b40 2024-09-12T01:30:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f0969606740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559368370cf0 con 0x5593684635d0 2024-09-12T01:30:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f0969606740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5593683c52b0 con 0x559368472780 2024-09-12T01:30:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f09657ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x559368463090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f09657ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x559368463090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44664/0 (socket says 172.21.15.81:44664) 2024-09-12T01:30:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f09657ca640 1 -- 172.21.15.81:0/3757706508 learned_addr learned my addr 172.21.15.81:0/3757706508 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f095ffff640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f09500a2cf0 0x7f09500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.153+0000 7f0964fc9640 1 --2- 172.21.15.81:0/3757706508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593684635d0 0x559368463a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.154+0000 7f09657ca640 1 --2- 172.21.15.81:0/3757706508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559368472780 0x559368474b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.154+0000 7f095dffb640 1 -- 172.21.15.81:0/1892036060 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f094c0cf8c0 con 0x7f0960101410 2024-09-12T01:30:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.154+0000 7f09657ca640 1 -- 172.21.15.81:0/3757706508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559368472780 msgr2=0x559368474b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.154+0000 7f09657ca640 1 --2- 172.21.15.81:0/3757706508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559368472780 0x559368474b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.154+0000 7f09657ca640 1 -- 172.21.15.81:0/3757706508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593684635d0 msgr2=0x559368463a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.154+0000 7f09657ca640 1 --2- 172.21.15.81:0/3757706508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593684635d0 0x559368463a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.154+0000 7f09657ca640 1 -- 172.21.15.81:0/3757706508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593683553a0 con 0x559368464b40 2024-09-12T01:30:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.154+0000 7f09657ca640 1 --2- 172.21.15.81:0/3757706508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x559368463090 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f09580126e0 tx=0x7f095800a880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf603f31926416a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.154+0000 7f095ffff640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f09500a2cf0 0x7f09500a51b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f094c09bab0 tx=0x7f094c025360 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.154+0000 7f094affd640 1 -- 172.21.15.81:0/3757706508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958018070 con 0x559368464b40 2024-09-12T01:30:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.154+0000 7f094affd640 1 -- 172.21.15.81:0/3757706508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0958010dd0 con 0x559368464b40 2024-09-12T01:30:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.154+0000 7f094affd640 1 -- 172.21.15.81:0/3757706508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958005700 con 0x559368464b40 2024-09-12T01:30:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.155+0000 7f0969606740 1 -- 172.21.15.81:0/3757706508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 msgr2=0x559368463090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.155+0000 7f0969606740 1 --2- 172.21.15.81:0/3757706508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x559368463090 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f09580126e0 tx=0x7f095800a880 comp rx=0 tx=0).stop 2024-09-12T01:30:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.155+0000 7f0969606740 1 -- 172.21.15.81:0/3757706508 shutdown_connections 2024-09-12T01:30:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.155+0000 7f0969606740 1 --2- 172.21.15.81:0/3757706508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559368472780 0x559368474b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.155+0000 7f0969606740 1 --2- 172.21.15.81:0/3757706508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593684635d0 0x559368463a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.155+0000 7f0969606740 1 --2- 172.21.15.81:0/3757706508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x559368463090 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.155+0000 7f0969606740 1 -- 172.21.15.81:0/3757706508 >> 172.21.15.81:0/3757706508 conn(0x55936842c310 msgr2=0x55936845fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.155+0000 7f0969606740 1 -- 172.21.15.81:0/3757706508 shutdown_connections 2024-09-12T01:30:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.155+0000 7f0969606740 1 -- 172.21.15.81:0/3757706508 wait complete. 2024-09-12T01:30:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.155+0000 7f0969606740 1 -- start start 2024-09-12T01:30:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f0969606740 1 Processor -- start 2024-09-12T01:30:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f0969606740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593684635d0 0x559368472140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f0969606740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x55936846f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f0969606740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559368472780 0x55936846f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f0969606740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559368475480 con 0x559368464b40 2024-09-12T01:30:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f0969606740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559368384060 con 0x559368472780 2024-09-12T01:30:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f0969606740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559368475600 con 0x5593684635d0 2024-09-12T01:30:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f0969606740 10 client.0 _ll_register_callbacks cb 0x5593680d78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f09657ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559368472780 0x55936846f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f0964fc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x55936846f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f09657ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559368472780 0x55936846f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:39620/0 (socket says 172.21.15.81:39620) 2024-09-12T01:30:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f0964fc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x55936846f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44672/0 (socket says 172.21.15.81:44672) 2024-09-12T01:30:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f09657ca640 1 -- 172.21.15.81:0/3059943521 learned_addr learned my addr 172.21.15.81:0/3059943521 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.156+0000 7f09657ca640 1 --2- 172.21.15.81:0/3059943521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593684635d0 0x559368472140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f0964fc9640 1 -- 172.21.15.81:0/3059943521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593684635d0 msgr2=0x559368472140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f0964fc9640 1 --2- 172.21.15.81:0/3059943521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593684635d0 0x559368472140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f0964fc9640 1 -- 172.21.15.81:0/3059943521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559368472780 msgr2=0x55936846f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f0964fc9640 1 --2- 172.21.15.81:0/3059943521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559368472780 0x55936846f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f0964fc9640 1 -- 172.21.15.81:0/3059943521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55936813a3c0 con 0x559368464b40 2024-09-12T01:30:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f0964fc9640 1 --2- 172.21.15.81:0/3059943521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x55936846f3f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0954005940 tx=0x7f0954031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d69f3fb78b3663 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f093ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f093ffff640 1 -- 172.21.15.81:0/3059943521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954035040 con 0x559368464b40 2024-09-12T01:30:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f0969606740 1 -- 172.21.15.81:0/3059943521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0958010dd0 con 0x559368464b40 2024-09-12T01:30:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f093ffff640 1 -- 172.21.15.81:0/3059943521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f0954004240 con 0x559368464b40 2024-09-12T01:30:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f093ffff640 1 -- 172.21.15.81:0/3059943521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0954004440 con 0x559368464b40 2024-09-12T01:30:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f0969606740 10 client.16023 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f0969606740 1 -- 172.21.15.81:0/3059943521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559368480f30 con 0x559368464b40 2024-09-12T01:30:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.157+0000 7f093ffff640 1 -- 172.21.15.81:0/3059943521 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0958010dd0 con 0x559368464b40 2024-09-12T01:30:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.158+0000 7f093ffff640 1 -- 172.21.15.81:0/3059943521 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0954004c50 con 0x559368464b40 2024-09-12T01:30:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.158+0000 7f0969606740 10 client.16023 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.158+0000 7f0969606740 10 client.16023 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:30:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.158+0000 7f0969606740 20 client.16023 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.158+0000 7f0969606740 1 --2- 172.21.15.81:0/3059943521 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x559368482340 0x559368484730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.158+0000 7f0969606740 4 client.16023 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:30:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.158+0000 7f0969606740 1 -- 172.21.15.81:0/3059943521 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593683d6860 con 0x559368482340 2024-09-12T01:30:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.158+0000 7f09657ca640 1 --2- 172.21.15.81:0/3059943521 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x559368482340 0x559368484730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.159+0000 7f093ffff640 10 client.16023 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:30:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.159+0000 7f09657ca640 1 --2- 172.21.15.81:0/3059943521 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x559368482340 0x559368484730 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cc48c05ac7794bb1 server_cookie=c2a4aa4e06c27cb1 in_seq=0 out_seq=0 2024-09-12T01:30:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.159+0000 7f093ffff640 1 -- 172.21.15.81:0/3059943521 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593683d6860 con 0x559368482340 2024-09-12T01:30:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.159+0000 7f093ffff640 10 client.16023 handle_command_reply: tid=0 2024-09-12T01:30:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.159+0000 7f0969606740 1 client.16023 shutdown 2024-09-12T01:30:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.159+0000 7f0969606740 1 -- 172.21.15.81:0/3059943521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 msgr2=0x55936846f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.159+0000 7f0969606740 1 --2- 172.21.15.81:0/3059943521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x55936846f3f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0954005940 tx=0x7f0954031920 comp rx=0 tx=0).stop 2024-09-12T01:30:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.160+0000 7f0969606740 1 -- 172.21.15.81:0/3059943521 shutdown_connections 2024-09-12T01:30:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.160+0000 7f0969606740 1 --2- 172.21.15.81:0/3059943521 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x559368482340 0x559368484730 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.160+0000 7f0969606740 1 --2- 172.21.15.81:0/3059943521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559368472780 0x55936846f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.160+0000 7f0969606740 1 --2- 172.21.15.81:0/3059943521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x55936846f3f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.160+0000 7f0969606740 1 --2- 172.21.15.81:0/3059943521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593684635d0 0x559368472140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.160+0000 7f0969606740 1 -- 172.21.15.81:0/3059943521 >> 172.21.15.81:0/3059943521 conn(0x55936842c310 msgr2=0x559368465960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.160+0000 7f093ffff640 0 client.16023 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:30:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.160+0000 7f0969606740 1 -- 172.21.15.81:0/3059943521 shutdown_connections 2024-09-12T01:30:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.160+0000 7f0969606740 1 -- 172.21.15.81:0/3059943521 wait complete. 2024-09-12T01:30:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.160+0000 7f0969606740 20 client.16023 trim_cache size 0 max 16384 2024-09-12T01:30:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.174+0000 7f0969606740 1 Processor -- start 2024-09-12T01:30:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.174+0000 7f0969606740 1 -- start start 2024-09-12T01:30:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0969606740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593684635d0 0x55936846f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0969606740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x55936847e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0969606740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559368472780 0x55936848a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0969606740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f09601ab680 con 0x559368464b40 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0969606740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f09601ad1c0 con 0x5593684635d0 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0969606740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f09601abd50 con 0x559368472780 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0964fc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x55936847e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f09657ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593684635d0 0x55936846f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0964fc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x55936847e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44688/0 (socket says 172.21.15.81:44688) 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f09657ca640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559368472780 0x55936848a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0964fc9640 1 -- 172.21.15.81:0/1706330737 learned_addr learned my addr 172.21.15.81:0/1706330737 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0964fc9640 1 -- 172.21.15.81:0/1706330737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559368472780 msgr2=0x55936848a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0964fc9640 1 --2- 172.21.15.81:0/1706330737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559368472780 0x55936848a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0964fc9640 1 -- 172.21.15.81:0/1706330737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593684635d0 msgr2=0x55936846f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0964fc9640 1 --2- 172.21.15.81:0/1706330737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593684635d0 0x55936846f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f0964fc9640 1 -- 172.21.15.81:0/1706330737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936845fed0 con 0x559368464b40 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.175+0000 7f09657ca640 1 --2- 172.21.15.81:0/1706330737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559368472780 0x55936848a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:30:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.176+0000 7f0964fc9640 1 --2- 172.21.15.81:0/1706330737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x55936847e720 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f09540096c0 tx=0x7f0954005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2db1b8f32766fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.176+0000 7f094a7fc640 1 -- 172.21.15.81:0/1706330737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954035070 con 0x559368464b40 2024-09-12T01:30:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.176+0000 7f094a7fc640 1 -- 172.21.15.81:0/1706330737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0954005040 con 0x559368464b40 2024-09-12T01:30:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.176+0000 7f094a7fc640 1 -- 172.21.15.81:0/1706330737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954053040 con 0x559368464b40 2024-09-12T01:30:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.177+0000 7f0969606740 1 -- 172.21.15.81:0/1706330737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 msgr2=0x55936847e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.177+0000 7f0969606740 1 --2- 172.21.15.81:0/1706330737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x55936847e720 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f09540096c0 tx=0x7f0954005fd0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.177+0000 7f0969606740 1 -- 172.21.15.81:0/1706330737 shutdown_connections 2024-09-12T01:30:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.177+0000 7f0969606740 1 --2- 172.21.15.81:0/1706330737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559368472780 0x55936848a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.177+0000 7f0969606740 1 --2- 172.21.15.81:0/1706330737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x55936847e720 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.177+0000 7f0969606740 1 --2- 172.21.15.81:0/1706330737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593684635d0 0x55936846f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.177+0000 7f0969606740 1 -- 172.21.15.81:0/1706330737 >> 172.21.15.81:0/1706330737 conn(0x55936842c310 msgr2=0x55936846ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.177+0000 7f0969606740 1 -- 172.21.15.81:0/1706330737 shutdown_connections 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.177+0000 7f0969606740 1 -- 172.21.15.81:0/1706330737 wait complete. 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.177+0000 7f0969606740 1 -- start start 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.178+0000 7f0969606740 1 Processor -- start 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.178+0000 7f0969606740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593684635d0 0x559368475e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.178+0000 7f0969606740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x559368476350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.178+0000 7f0969606740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559368472780 0x5593684eafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.178+0000 7f0969606740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f09601acaf0 con 0x559368464b40 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f0969606740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f09601ac420 con 0x559368472780 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f0969606740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f09601a9660 con 0x5593684635d0 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f0969606740 10 client.0 _ll_register_callbacks cb 0x7f0954009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f0964fc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x559368476350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f0964fc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x559368476350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44702/0 (socket says 172.21.15.81:44702) 2024-09-12T01:30:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f0964fc9640 1 -- 172.21.15.81:0/75929739 learned_addr learned my addr 172.21.15.81:0/75929739 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f09657ca640 1 --2- 172.21.15.81:0/75929739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593684635d0 0x559368475e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f09657ca640 1 --2- 172.21.15.81:0/75929739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559368472780 0x5593684eafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f0964fc9640 1 -- 172.21.15.81:0/75929739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593684635d0 msgr2=0x559368475e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f0964fc9640 1 --2- 172.21.15.81:0/75929739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593684635d0 0x559368475e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f0964fc9640 1 -- 172.21.15.81:0/75929739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559368472780 msgr2=0x5593684eafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f0964fc9640 1 --2- 172.21.15.81:0/75929739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559368472780 0x5593684eafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f0964fc9640 1 -- 172.21.15.81:0/75929739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593684eb530 con 0x559368464b40 2024-09-12T01:30:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f0964fc9640 1 --2- 172.21.15.81:0/75929739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x559368476350 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0954003610 tx=0x7f095402aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571f35aca77e6af9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.179+0000 7f093ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f093ffff640 1 -- 172.21.15.81:0/75929739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954035070 con 0x559368464b40 2024-09-12T01:30:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f093ffff640 1 -- 172.21.15.81:0/75929739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f09540051f0 con 0x559368464b40 2024-09-12T01:30:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f0969606740 1 -- 172.21.15.81:0/75929739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0954005040 con 0x559368464b40 2024-09-12T01:30:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f093ffff640 1 -- 172.21.15.81:0/75929739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0954069050 con 0x559368464b40 2024-09-12T01:30:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f0969606740 10 client.16029 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f0969606740 1 -- 172.21.15.81:0/75929739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5593684ec830 con 0x559368464b40 2024-09-12T01:30:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f093ffff640 1 -- 172.21.15.81:0/75929739 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0954003880 con 0x559368464b40 2024-09-12T01:30:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f093ffff640 1 -- 172.21.15.81:0/75929739 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0954060070 con 0x559368464b40 2024-09-12T01:30:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f0969606740 10 client.16029 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f0969606740 10 client.16029 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:30:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f0969606740 20 client.16029 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f0969606740 1 --2- 172.21.15.81:0/75929739 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5593684ece70 0x5593684ef290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f0969606740 4 client.16029 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:30:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.180+0000 7f0969606740 1 -- 172.21.15.81:0/75929739 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f0954005040 con 0x5593684ece70 2024-09-12T01:30:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.181+0000 7f09657ca640 1 --2- 172.21.15.81:0/75929739 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5593684ece70 0x5593684ef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.181+0000 7f09657ca640 1 --2- 172.21.15.81:0/75929739 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5593684ece70 0x5593684ef290 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d2a4dbc840228a04 server_cookie=2030eba8d6bbfc86 in_seq=0 out_seq=0 2024-09-12T01:30:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.181+0000 7f093ffff640 10 client.16029 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:30:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.181+0000 7f093ffff640 1 -- 172.21.15.81:0/75929739 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f0954005040 con 0x5593684ece70 2024-09-12T01:30:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.181+0000 7f093ffff640 10 client.16029 handle_command_reply: tid=0 2024-09-12T01:30:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.181+0000 7f0969606740 1 client.16029 shutdown 2024-09-12T01:30:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.182+0000 7f0969606740 1 -- 172.21.15.81:0/75929739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 msgr2=0x559368476350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.182+0000 7f0969606740 1 --2- 172.21.15.81:0/75929739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x559368476350 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0954003610 tx=0x7f095402aae0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.182+0000 7f0969606740 1 -- 172.21.15.81:0/75929739 shutdown_connections 2024-09-12T01:30:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.182+0000 7f0969606740 1 --2- 172.21.15.81:0/75929739 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5593684ece70 0x5593684ef290 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.182+0000 7f0969606740 1 --2- 172.21.15.81:0/75929739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559368472780 0x5593684eafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.182+0000 7f0969606740 1 --2- 172.21.15.81:0/75929739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559368464b40 0x559368476350 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.182+0000 7f0969606740 1 --2- 172.21.15.81:0/75929739 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5593684635d0 0x559368475e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.182+0000 7f0969606740 1 -- 172.21.15.81:0/75929739 >> 172.21.15.81:0/75929739 conn(0x55936842c310 msgr2=0x55936845ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.182+0000 7f093ffff640 0 client.16029 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:30:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.182+0000 7f0969606740 1 -- 172.21.15.81:0/75929739 shutdown_connections 2024-09-12T01:30:28.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.182+0000 7f0969606740 1 -- 172.21.15.81:0/75929739 wait complete. 2024-09-12T01:30:28.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.182+0000 7f0969606740 20 client.16029 trim_cache size 0 max 16384 2024-09-12T01:30:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:30:28.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.183+0000 7f096722d640 1 -- 172.21.15.81:0/1892036060 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f09500a2cf0 msgr2=0x7f09500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.183+0000 7f096722d640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f09500a2cf0 0x7f09500a51b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f094c09bab0 tx=0x7f094c025360 comp rx=0 tx=0).stop 2024-09-12T01:30:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.183+0000 7f096722d640 1 -- 172.21.15.81:0/1892036060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960101410 msgr2=0x7f0960199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.183+0000 7f096722d640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960101410 0x7f0960199860 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f094c00e9f0 tx=0x7f094c00eeb0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.183+0000 7f096722d640 1 -- 172.21.15.81:0/1892036060 shutdown_connections 2024-09-12T01:30:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.183+0000 7f096722d640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f09500a2cf0 0x7f09500a51b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.183+0000 7f096722d640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0960106a70 0x7f09601a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.183+0000 7f096722d640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0960101410 0x7f0960199860 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.183+0000 7f096722d640 1 --2- 172.21.15.81:0/1892036060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960100a70 0x7f0960199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.183+0000 7f096722d640 1 -- 172.21.15.81:0/1892036060 >> 172.21.15.81:0/1892036060 conn(0x7f09600fc790 msgr2=0x7f09600fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.183+0000 7f096722d640 1 -- 172.21.15.81:0/1892036060 shutdown_connections 2024-09-12T01:30:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:28.183+0000 7f096722d640 1 -- 172.21.15.81:0/1892036060 wait complete. 2024-09-12T01:30:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:28.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:30:29.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.418+0000 7f4ae5cb2640 1 -- 172.21.15.81:0/1212269432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae0102ef0 msgr2=0x7f4ae010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:29.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.418+0000 7f4ae5cb2640 1 --2- 172.21.15.81:0/1212269432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae0102ef0 0x7f4ae010da40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009ca0 tx=0x7f4ad802a950 comp rx=0 tx=0).stop 2024-09-12T01:30:29.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.418+0000 7f4ae5cb2640 1 -- 172.21.15.81:0/1212269432 shutdown_connections 2024-09-12T01:30:29.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.418+0000 7f4ae5cb2640 1 --2- 172.21.15.81:0/1212269432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae0102ef0 0x7f4ae010da40 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.418+0000 7f4ae5cb2640 1 --2- 172.21.15.81:0/1212269432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ae0102570 0x7f4ae01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.418+0000 7f4ae5cb2640 1 --2- 172.21.15.81:0/1212269432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ae0100e20 0x7f4ae0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.418+0000 7f4ae5cb2640 1 -- 172.21.15.81:0/1212269432 >> 172.21.15.81:0/1212269432 conn(0x7f4ae00fc7d0 msgr2=0x7f4ae00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:29.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.418+0000 7f4ae5cb2640 1 -- 172.21.15.81:0/1212269432 shutdown_connections 2024-09-12T01:30:29.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.418+0000 7f4ae5cb2640 1 -- 172.21.15.81:0/1212269432 wait complete. 2024-09-12T01:30:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.418+0000 7f4ae5cb2640 1 Processor -- start 2024-09-12T01:30:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4ae5cb2640 1 -- start start 2024-09-12T01:30:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4ae5cb2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ae0100e20 0x7f4ae01992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4ae5cb2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae0102570 0x7f4ae0199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4ae5cb2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ae0102ef0 0x7f4ae01a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4ae5cb2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae0110f80 con 0x7f4ae0102570 2024-09-12T01:30:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4ae5cb2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae0110e00 con 0x7f4ae0102ef0 2024-09-12T01:30:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4ae5cb2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae0111100 con 0x7f4ae0100e20 2024-09-12T01:30:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae0102570 0x7f4ae0199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae0102570 0x7f4ae0199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44718/0 (socket says 172.21.15.81:44718) 2024-09-12T01:30:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4adeffd640 1 -- 172.21.15.81:0/2523455239 learned_addr learned my addr 172.21.15.81:0/2523455239 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4adffff640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ae0102ef0 0x7f4ae01a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4adf7fe640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ae0100e20 0x7f4ae01992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4adeffd640 1 -- 172.21.15.81:0/2523455239 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ae0100e20 msgr2=0x7f4ae01992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4adeffd640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ae0100e20 0x7f4ae01992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4adeffd640 1 -- 172.21.15.81:0/2523455239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ae0102ef0 msgr2=0x7f4ae01a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4adeffd640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ae0102ef0 0x7f4ae01a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.419+0000 7f4adeffd640 1 -- 172.21.15.81:0/2523455239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae01a4890 con 0x7f4ae0102570 2024-09-12T01:30:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.420+0000 7f4adeffd640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae0102570 0x7f4ae0199810 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c890 tx=0x7f4ac800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.420+0000 7f4adcff9640 1 -- 172.21.15.81:0/2523455239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8004220 con 0x7f4ae0102570 2024-09-12T01:30:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.420+0000 7f4adcff9640 1 -- 172.21.15.81:0/2523455239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ac80043c0 con 0x7f4ae0102570 2024-09-12T01:30:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.420+0000 7f4ae5cb2640 1 -- 172.21.15.81:0/2523455239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae01a4a60 con 0x7f4ae0102570 2024-09-12T01:30:29.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.420+0000 7f4adcff9640 1 -- 172.21.15.81:0/2523455239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8004a00 con 0x7f4ae0102570 2024-09-12T01:30:29.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.420+0000 7f4ae5cb2640 1 -- 172.21.15.81:0/2523455239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae01a4f70 con 0x7f4ae0102570 2024-09-12T01:30:29.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.422+0000 7f4adcff9640 1 -- 172.21.15.81:0/2523455239 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f4ac8004c60 con 0x7f4ae0102570 2024-09-12T01:30:29.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.422+0000 7f4ae808b740 1 Processor -- start 2024-09-12T01:30:29.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.423+0000 7f4ae808b740 1 -- start start 2024-09-12T01:30:29.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.423+0000 7f4ae808b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d0ea00 0x55e572d0ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.423+0000 7f4ae808b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0f320 0x55e572d196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.423+0000 7f4ae808b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d19be0 0x55e572d1bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.423+0000 7f4ae808b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e572c73200 con 0x55e572d19be0 2024-09-12T01:30:29.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.423+0000 7f4ae808b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e572c19dc0 con 0x55e572d0ea00 2024-09-12T01:30:29.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.423+0000 7f4ae808b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e572c6f1c0 con 0x55e572d0f320 2024-09-12T01:30:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.423+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d19be0 0x55e572d1bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.423+0000 7f4adffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d0ea00 0x55e572d0ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.423+0000 7f4adffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d0ea00 0x55e572d0ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:39672/0 (socket says 172.21.15.81:39672) 2024-09-12T01:30:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.423+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d19be0 0x55e572d1bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44724/0 (socket says 172.21.15.81:44724) 2024-09-12T01:30:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.423+0000 7f4adffff640 1 -- 172.21.15.81:0/3730295351 learned_addr learned my addr 172.21.15.81:0/3730295351 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.423+0000 7f4adf7fe640 1 --2- 172.21.15.81:0/3730295351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0f320 0x55e572d196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.424+0000 7f4adeffd640 1 -- 172.21.15.81:0/3730295351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0f320 msgr2=0x55e572d196a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.424+0000 7f4adeffd640 1 --2- 172.21.15.81:0/3730295351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0f320 0x55e572d196a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.424+0000 7f4adeffd640 1 -- 172.21.15.81:0/3730295351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d0ea00 msgr2=0x55e572d0ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.424+0000 7f4adeffd640 1 --2- 172.21.15.81:0/3730295351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d0ea00 0x55e572d0ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.424+0000 7f4adeffd640 1 -- 172.21.15.81:0/3730295351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5729e4620 con 0x55e572d19be0 2024-09-12T01:30:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.424+0000 7f4adcff9640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f4acc0a2cf0 0x7f4acc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.424+0000 7f4adeffd640 1 --2- 172.21.15.81:0/3730295351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d19be0 0x55e572d1bfd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80cc8e0 tx=0x7f4ac80d9c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9084ea304a44e34e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.424+0000 7f4adffff640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f4acc0a2cf0 0x7f4acc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.424+0000 7f4adcff9640 1 -- 172.21.15.81:0/2523455239 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f4ac80cf0c0 con 0x7f4ae0102570 2024-09-12T01:30:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.424+0000 7f4ad5ffb640 1 -- 172.21.15.81:0/3730295351 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8097950 con 0x55e572d19be0 2024-09-12T01:30:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.424+0000 7f4ad5ffb640 1 -- 172.21.15.81:0/3730295351 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ac809bdb0 con 0x55e572d19be0 2024-09-12T01:30:29.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.424+0000 7f4ad5ffb640 1 -- 172.21.15.81:0/3730295351 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac809b010 con 0x55e572d19be0 2024-09-12T01:30:29.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.425+0000 7f4adffff640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f4acc0a2cf0 0x7f4acc0a51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009430 tx=0x7f4ad8009360 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.425+0000 7f4ae808b740 1 -- 172.21.15.81:0/3730295351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d19be0 msgr2=0x55e572d1bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.425+0000 7f4ae808b740 1 --2- 172.21.15.81:0/3730295351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d19be0 0x55e572d1bfd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80cc8e0 tx=0x7f4ac80d9c20 comp rx=0 tx=0).stop 2024-09-12T01:30:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.425+0000 7f4ae808b740 1 -- 172.21.15.81:0/3730295351 shutdown_connections 2024-09-12T01:30:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.425+0000 7f4ae808b740 1 --2- 172.21.15.81:0/3730295351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d19be0 0x55e572d1bfd0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.425+0000 7f4ae808b740 1 --2- 172.21.15.81:0/3730295351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0f320 0x55e572d196a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.425+0000 7f4ae808b740 1 --2- 172.21.15.81:0/3730295351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d0ea00 0x55e572d0ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.425+0000 7f4ae808b740 1 -- 172.21.15.81:0/3730295351 >> 172.21.15.81:0/3730295351 conn(0x55e572d0af90 msgr2=0x55e572d0b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.425+0000 7f4ae808b740 1 -- 172.21.15.81:0/3730295351 shutdown_connections 2024-09-12T01:30:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.425+0000 7f4ae808b740 1 -- 172.21.15.81:0/3730295351 wait complete. 2024-09-12T01:30:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.426+0000 7f4ae808b740 1 -- start start 2024-09-12T01:30:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.426+0000 7f4ae808b740 1 Processor -- start 2024-09-12T01:30:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.426+0000 7f4ae808b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0ea00 0x55e572d19490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.426+0000 7f4ae808b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 0x55e572d16740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.426+0000 7f4ae808b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d19be0 0x55e572d16c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.426+0000 7f4ae808b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e572d1c750 con 0x55e572d0f320 2024-09-12T01:30:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.426+0000 7f4ae808b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e572c0dc50 con 0x55e572d19be0 2024-09-12T01:30:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.426+0000 7f4ae808b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e572d1c8d0 con 0x55e572d0ea00 2024-09-12T01:30:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.426+0000 7f4ae808b740 10 client.0 _ll_register_callbacks cb 0x55e572c1fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 0x55e572d16740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 0x55e572d16740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44738/0 (socket says 172.21.15.81:44738) 2024-09-12T01:30:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4adeffd640 1 -- 172.21.15.81:0/661797772 learned_addr learned my addr 172.21.15.81:0/661797772 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4adf7fe640 1 --2- 172.21.15.81:0/661797772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0ea00 0x55e572d19490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4adffff640 1 --2- 172.21.15.81:0/661797772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d19be0 0x55e572d16c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4adeffd640 1 -- 172.21.15.81:0/661797772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0ea00 msgr2=0x55e572d19490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4adeffd640 1 --2- 172.21.15.81:0/661797772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0ea00 0x55e572d19490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4adeffd640 1 -- 172.21.15.81:0/661797772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d19be0 msgr2=0x55e572d16c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4adeffd640 1 --2- 172.21.15.81:0/661797772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d19be0 0x55e572d16c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4adeffd640 1 -- 172.21.15.81:0/661797772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e572d17480 con 0x55e572d0f320 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4adeffd640 1 --2- 172.21.15.81:0/661797772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 0x55e572d16740 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80a3df0 tx=0x7f4ac80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64241117e72da641 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4abeffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4abeffd640 1 -- 172.21.15.81:0/661797772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac801d070 con 0x55e572d0f320 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4abeffd640 1 -- 172.21.15.81:0/661797772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f4ac809b910 con 0x55e572d0f320 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.427+0000 7f4ae808b740 1 -- 172.21.15.81:0/661797772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ac809bdb0 con 0x55e572d0f320 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.428+0000 7f4abeffd640 1 -- 172.21.15.81:0/661797772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4ac809b1f0 con 0x55e572d0f320 2024-09-12T01:30:29.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.428+0000 7f4ae808b740 10 client.16041 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.428+0000 7f4ae808b740 1 -- 172.21.15.81:0/661797772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e572d28240 con 0x55e572d0f320 2024-09-12T01:30:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.428+0000 7f4abeffd640 1 -- 172.21.15.81:0/661797772 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ac809bdb0 con 0x55e572d0f320 2024-09-12T01:30:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.428+0000 7f4abeffd640 1 -- 172.21.15.81:0/661797772 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4ac80bb030 con 0x55e572d0f320 2024-09-12T01:30:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.428+0000 7f4ae808b740 10 client.16041 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.428+0000 7f4ae808b740 10 client.16041 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T01:30:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.428+0000 7f4ae808b740 20 client.16041 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.428+0000 7f4ae808b740 1 --2- 172.21.15.81:0/661797772 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e572d29590 0x55e572d2b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.428+0000 7f4ae808b740 4 client.16041 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:30:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.428+0000 7f4ae808b740 1 -- 172.21.15.81:0/661797772 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e572c80770 con 0x55e572d29590 2024-09-12T01:30:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.428+0000 7f4adf7fe640 1 --2- 172.21.15.81:0/661797772 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e572d29590 0x55e572d2b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.429+0000 7f4abeffd640 10 client.16041 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.429+0000 7f4adf7fe640 1 --2- 172.21.15.81:0/661797772 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e572d29590 0x55e572d2b980 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9156d6e5734ad04 server_cookie=f917a9d29cc1e1a3 in_seq=0 out_seq=0 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4abeffd640 1 -- 172.21.15.81:0/661797772 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e572c80770 con 0x55e572d29590 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4abeffd640 10 client.16041 handle_command_reply: tid=0 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4ae808b740 1 client.16041 shutdown 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4ae808b740 1 -- 172.21.15.81:0/661797772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 msgr2=0x55e572d16740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4ae808b740 1 --2- 172.21.15.81:0/661797772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 0x55e572d16740 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80a3df0 tx=0x7f4ac80046c0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4ae808b740 1 -- 172.21.15.81:0/661797772 shutdown_connections 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4ae808b740 1 --2- 172.21.15.81:0/661797772 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e572d29590 0x55e572d2b980 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4ae808b740 1 --2- 172.21.15.81:0/661797772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d19be0 0x55e572d16c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4ae808b740 1 --2- 172.21.15.81:0/661797772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 0x55e572d16740 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4abeffd640 0 client.16041 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4ae808b740 1 --2- 172.21.15.81:0/661797772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0ea00 0x55e572d19490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4ae808b740 1 -- 172.21.15.81:0/661797772 >> 172.21.15.81:0/661797772 conn(0x55e572d0af90 msgr2=0x55e572d0a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4ae808b740 1 -- 172.21.15.81:0/661797772 shutdown_connections 2024-09-12T01:30:29.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4ae808b740 1 -- 172.21.15.81:0/661797772 wait complete. 2024-09-12T01:30:29.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.430+0000 7f4ae808b740 20 client.16041 trim_cache size 0 max 16384 2024-09-12T01:30:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.459+0000 7f4ae808b740 1 Processor -- start 2024-09-12T01:30:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.459+0000 7f4ae808b740 1 -- start start 2024-09-12T01:30:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.459+0000 7f4ae808b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0ea00 0x55e572d25b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.459+0000 7f4ae808b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d0f320 0x55e572d18610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.459+0000 7f4ae808b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d19be0 0x55e572d2e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.459+0000 7f4ae808b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01ab660 con 0x55e572d0ea00 2024-09-12T01:30:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.459+0000 7f4ae808b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01ad1a0 con 0x55e572d0f320 2024-09-12T01:30:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.459+0000 7f4ae808b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01abd30 con 0x55e572d19be0 2024-09-12T01:30:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4adf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0ea00 0x55e572d25b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4adf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0ea00 0x55e572d25b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44742/0 (socket says 172.21.15.81:44742) 2024-09-12T01:30:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4adf7fe640 1 -- 172.21.15.81:0/346905859 learned_addr learned my addr 172.21.15.81:0/346905859 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4adffff640 1 --2- 172.21.15.81:0/346905859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d19be0 0x55e572d2e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4adeffd640 1 --2- 172.21.15.81:0/346905859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d0f320 0x55e572d18610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4adf7fe640 1 -- 172.21.15.81:0/346905859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d19be0 msgr2=0x55e572d2e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4adf7fe640 1 --2- 172.21.15.81:0/346905859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d19be0 0x55e572d2e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4adf7fe640 1 -- 172.21.15.81:0/346905859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d0f320 msgr2=0x55e572d18610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4adf7fe640 1 --2- 172.21.15.81:0/346905859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d0f320 0x55e572d18610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4adf7fe640 1 -- 172.21.15.81:0/346905859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e572d0bb40 con 0x55e572d0ea00 2024-09-12T01:30:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4adf7fe640 1 --2- 172.21.15.81:0/346905859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0ea00 0x55e572d25b30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000bb30 tx=0x7f4ad0013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db00891e945f2c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4ad57fa640 1 -- 172.21.15.81:0/346905859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0005020 con 0x55e572d0ea00 2024-09-12T01:30:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4ad57fa640 1 -- 172.21.15.81:0/346905859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ad00056a0 con 0x55e572d0ea00 2024-09-12T01:30:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.460+0000 7f4ad57fa640 1 -- 172.21.15.81:0/346905859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad00116a0 con 0x55e572d0ea00 2024-09-12T01:30:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.461+0000 7f4ae808b740 1 -- 172.21.15.81:0/346905859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0ea00 msgr2=0x55e572d25b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.461+0000 7f4ae808b740 1 --2- 172.21.15.81:0/346905859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0ea00 0x55e572d25b30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000bb30 tx=0x7f4ad0013830 comp rx=0 tx=0).stop 2024-09-12T01:30:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.462+0000 7f4ae808b740 1 -- 172.21.15.81:0/346905859 shutdown_connections 2024-09-12T01:30:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.462+0000 7f4ae808b740 1 --2- 172.21.15.81:0/346905859 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d19be0 0x55e572d2e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.462+0000 7f4ae808b740 1 --2- 172.21.15.81:0/346905859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d0f320 0x55e572d18610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.462+0000 7f4ae808b740 1 --2- 172.21.15.81:0/346905859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0ea00 0x55e572d25b30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.462+0000 7f4ae808b740 1 -- 172.21.15.81:0/346905859 >> 172.21.15.81:0/346905859 conn(0x55e572d0af90 msgr2=0x55e572d0a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.462+0000 7f4ae808b740 1 -- 172.21.15.81:0/346905859 shutdown_connections 2024-09-12T01:30:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.462+0000 7f4ae808b740 1 -- 172.21.15.81:0/346905859 wait complete. 2024-09-12T01:30:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.462+0000 7f4ae808b740 1 -- start start 2024-09-12T01:30:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.463+0000 7f4ae808b740 1 Processor -- start 2024-09-12T01:30:29.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.463+0000 7f4ae808b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0ea00 0x55e572d2f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.463+0000 7f4ae808b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 0x55e572d2c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.463+0000 7f4ae808b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d19be0 0x55e572d2cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.463+0000 7f4ae808b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01acad0 con 0x55e572d0f320 2024-09-12T01:30:29.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.463+0000 7f4ae808b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01ac400 con 0x55e572d19be0 2024-09-12T01:30:29.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.463+0000 7f4ae808b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01a9660 con 0x55e572d0ea00 2024-09-12T01:30:29.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.463+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 0x55e572d2c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.463+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 0x55e572d2c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44756/0 (socket says 172.21.15.81:44756) 2024-09-12T01:30:29.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.463+0000 7f4adeffd640 1 -- 172.21.15.81:0/1300160580 learned_addr learned my addr 172.21.15.81:0/1300160580 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:29.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.464+0000 7f4ae808b740 10 client.0 _ll_register_callbacks cb 0x7f4ac80d9690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:29.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.464+0000 7f4adffff640 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d19be0 0x55e572d2cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.464+0000 7f4adf7fe640 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0ea00 0x55e572d2f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.464+0000 7f4adeffd640 1 -- 172.21.15.81:0/1300160580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0ea00 msgr2=0x55e572d2f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:29.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.464+0000 7f4adeffd640 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0ea00 0x55e572d2f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.464+0000 7f4adeffd640 1 -- 172.21.15.81:0/1300160580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d19be0 msgr2=0x55e572d2cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:29.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.464+0000 7f4adeffd640 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d19be0 0x55e572d2cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.464+0000 7f4adeffd640 1 -- 172.21.15.81:0/1300160580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e572d2d340 con 0x55e572d0f320 2024-09-12T01:30:29.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.464+0000 7f4adffff640 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d19be0 0x55e572d2cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:29.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.464+0000 7f4adf7fe640 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0ea00 0x55e572d2f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:29.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.464+0000 7f4ae808b740 1 -- 172.21.15.81:0/1300160580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ad00056a0 con 0x55e572d0f320 2024-09-12T01:30:29.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.464+0000 7f4adeffd640 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 0x55e572d2c590 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80d9760 tx=0x7f4ac80d2890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d048bcb76d9bd9ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.464+0000 7f4abeffd640 10 client.16047 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.465+0000 7f4abeffd640 1 -- 172.21.15.81:0/1300160580 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac801d070 con 0x55e572d0f320 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.465+0000 7f4abeffd640 1 -- 172.21.15.81:0/1300160580 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f4ac80afbd0 con 0x55e572d0f320 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.465+0000 7f4abeffd640 1 -- 172.21.15.81:0/1300160580 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4ac809b480 con 0x55e572d0f320 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.465+0000 7f4ae808b740 10 client.16047 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.465+0000 7f4ae808b740 1 -- 172.21.15.81:0/1300160580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e572d2d340 con 0x55e572d0f320 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.465+0000 7f4abeffd640 1 -- 172.21.15.81:0/1300160580 <== mon.0 v2:172.21.15.81:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4ac80bb040 con 0x55e572d0f320 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.465+0000 7f4ae808b740 10 client.16047 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.465+0000 7f4ae808b740 10 client.16047 resolve_mds: validated gid 24473 aka daemon mds.b 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.465+0000 7f4ae808b740 20 client.16047 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.465+0000 7f4ae808b740 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e572d93fd0 0x55e572d963c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.465+0000 7f4ae808b740 4 client.16047 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.465+0000 7f4ae808b740 1 -- 172.21.15.81:0/1300160580 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55e572c7ac80 con 0x55e572d93fd0 2024-09-12T01:30:29.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.466+0000 7f4adf7fe640 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e572d93fd0 0x55e572d963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:29.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.466+0000 7f4adf7fe640 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e572d93fd0 0x55e572d963c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fab93ff3456518f server_cookie=7193d5d57b29ccf6 in_seq=0 out_seq=0 2024-09-12T01:30:29.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.466+0000 7f4abeffd640 10 client.16047 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:29.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.466+0000 7f4abeffd640 1 -- 172.21.15.81:0/1300160580 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x55e572c7ac80 con 0x55e572d93fd0 2024-09-12T01:30:29.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.466+0000 7f4abeffd640 10 client.16047 handle_command_reply: tid=0 2024-09-12T01:30:29.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.466+0000 7f4ae808b740 1 client.16047 shutdown 2024-09-12T01:30:29.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.467+0000 7f4ae808b740 1 -- 172.21.15.81:0/1300160580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 msgr2=0x55e572d2c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:29.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.467+0000 7f4ae808b740 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 0x55e572d2c590 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80d9760 tx=0x7f4ac80d2890 comp rx=0 tx=0).stop 2024-09-12T01:30:29.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.467+0000 7f4ae808b740 1 -- 172.21.15.81:0/1300160580 shutdown_connections 2024-09-12T01:30:29.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.467+0000 7f4ae808b740 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e572d93fd0 0x55e572d963c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.467+0000 7f4ae808b740 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e572d19be0 0x55e572d2cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.467+0000 7f4ae808b740 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e572d0f320 0x55e572d2c590 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.467+0000 7f4ae808b740 1 --2- 172.21.15.81:0/1300160580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e572d0ea00 0x55e572d2f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.467+0000 7f4ae808b740 1 -- 172.21.15.81:0/1300160580 >> 172.21.15.81:0/1300160580 conn(0x55e572d0af90 msgr2=0x55e572d14ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:29.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.467+0000 7f4abeffd640 0 client.16047 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:29.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.467+0000 7f4ae808b740 1 -- 172.21.15.81:0/1300160580 shutdown_connections 2024-09-12T01:30:29.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.467+0000 7f4ae808b740 1 -- 172.21.15.81:0/1300160580 wait complete. 2024-09-12T01:30:29.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.467+0000 7f4ae808b740 20 client.16047 trim_cache size 0 max 16384 2024-09-12T01:30:29.472 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:30:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 28, 2024-09-12T01:30:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24473, 2024-09-12T01:30:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 8, 2024-09-12T01:30:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": {} 2024-09-12T01:30:29.473 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:30:29.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.468+0000 7f4ae5cb2640 1 -- 172.21.15.81:0/2523455239 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f4acc0a2cf0 msgr2=0x7f4acc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:29.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.468+0000 7f4ae5cb2640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f4acc0a2cf0 0x7f4acc0a51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009430 tx=0x7f4ad8009360 comp rx=0 tx=0).stop 2024-09-12T01:30:29.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.468+0000 7f4ae5cb2640 1 -- 172.21.15.81:0/2523455239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae0102570 msgr2=0x7f4ae0199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:29.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.468+0000 7f4ae5cb2640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae0102570 0x7f4ae0199810 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c890 tx=0x7f4ac800cd50 comp rx=0 tx=0).stop 2024-09-12T01:30:29.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.468+0000 7f4ae5cb2640 1 -- 172.21.15.81:0/2523455239 shutdown_connections 2024-09-12T01:30:29.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.468+0000 7f4ae5cb2640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f4acc0a2cf0 0x7f4acc0a51b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.468+0000 7f4ae5cb2640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ae0102ef0 0x7f4ae01a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.468+0000 7f4ae5cb2640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ae0102570 0x7f4ae0199810 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.468+0000 7f4ae5cb2640 1 --2- 172.21.15.81:0/2523455239 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ae0100e20 0x7f4ae01992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:29.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.468+0000 7f4ae5cb2640 1 -- 172.21.15.81:0/2523455239 >> 172.21.15.81:0/2523455239 conn(0x7f4ae00fc7d0 msgr2=0x7f4ae0106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:29.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.468+0000 7f4ae5cb2640 1 -- 172.21.15.81:0/2523455239 shutdown_connections 2024-09-12T01:30:29.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:29.468+0000 7f4ae5cb2640 1 -- 172.21.15.81:0/2523455239 wait complete. 2024-09-12T01:30:29.474 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:29.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:29 smithi081 ceph-mon[30920]: pgmap v75: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 1.38k op/s 2024-09-12T01:30:30.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:29 smithi100 ceph-mon[35275]: pgmap v75: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 1.38k op/s 2024-09-12T01:30:30.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:29 smithi189 ceph-mon[35357]: pgmap v75: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 1.38k op/s 2024-09-12T01:30:30.470 INFO:tasks.quiescer:done joining Quiescers 2024-09-12T01:30:30.470 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-12T01:30:30.480 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-12T01:30:30.480 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T01:30:30.480 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T01:30:30.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-12T01:30:30.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-12T01:30:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.724+0000 7f7edd77f640 1 -- 172.21.15.81:0/2851020562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed8102db0 msgr2=0x7f7ed8103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.724+0000 7f7edd77f640 1 --2- 172.21.15.81:0/2851020562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed8102db0 0x7f7ed8103190 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009930 tx=0x7f7ec802a420 comp rx=0 tx=0).stop 2024-09-12T01:30:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.724+0000 7f7edd77f640 1 -- 172.21.15.81:0/2851020562 shutdown_connections 2024-09-12T01:30:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.724+0000 7f7edd77f640 1 --2- 172.21.15.81:0/2851020562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed81082e0 0x7f7ed810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.724+0000 7f7edd77f640 1 --2- 172.21.15.81:0/2851020562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ed8103760 0x7f7ed8107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.724+0000 7f7edd77f640 1 --2- 172.21.15.81:0/2851020562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed8102db0 0x7f7ed8103190 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.724+0000 7f7edd77f640 1 -- 172.21.15.81:0/2851020562 >> 172.21.15.81:0/2851020562 conn(0x7f7ed80fc7d0 msgr2=0x7f7ed80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.724+0000 7f7edd77f640 1 -- 172.21.15.81:0/2851020562 shutdown_connections 2024-09-12T01:30:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.724+0000 7f7edd77f640 1 -- 172.21.15.81:0/2851020562 wait complete. 2024-09-12T01:30:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.724+0000 7f7edd77f640 1 Processor -- start 2024-09-12T01:30:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7edd77f640 1 -- start start 2024-09-12T01:30:30.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7edd77f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed8102db0 0x7f7ed81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7edd77f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ed8103760 0x7f7ed8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7edd77f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed81082e0 0x7f7ed819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7edd77f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed8112110 con 0x7f7ed81082e0 2024-09-12T01:30:30.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7edd77f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed8111f90 con 0x7f7ed8103760 2024-09-12T01:30:30.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7edd77f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed8112290 con 0x7f7ed8102db0 2024-09-12T01:30:30.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7ed77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed81082e0 0x7f7ed819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7ed77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed81082e0 0x7f7ed819ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44770/0 (socket says 172.21.15.81:44770) 2024-09-12T01:30:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7ed77fe640 1 -- 172.21.15.81:0/2818042764 learned_addr learned my addr 172.21.15.81:0/2818042764 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ed8103760 0x7f7ed8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7ed77fe640 1 -- 172.21.15.81:0/2818042764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed8102db0 msgr2=0x7f7ed81985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed8102db0 0x7f7ed81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7ed77fe640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed8102db0 0x7f7ed81985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7ed77fe640 1 -- 172.21.15.81:0/2818042764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ed8103760 msgr2=0x7f7ed8198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7ed77fe640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ed8103760 0x7f7ed8198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7ed77fe640 1 -- 172.21.15.81:0/2818042764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed819d560 con 0x7f7ed81082e0 2024-09-12T01:30:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ed8103760 0x7f7ed8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.725+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed8102db0 0x7f7ed81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.726+0000 7f7ed77fe640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed81082e0 0x7f7ed819ce80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000b970 tx=0x7f7ed000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.726+0000 7f7ebffff640 1 -- 172.21.15.81:0/2818042764 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0019070 con 0x7f7ed81082e0 2024-09-12T01:30:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.726+0000 7f7edd77f640 1 -- 172.21.15.81:0/2818042764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed819d850 con 0x7f7ed81082e0 2024-09-12T01:30:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.726+0000 7f7ebffff640 1 -- 172.21.15.81:0/2818042764 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ed000cb40 con 0x7f7ed81082e0 2024-09-12T01:30:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.726+0000 7f7ebffff640 1 -- 172.21.15.81:0/2818042764 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0007650 con 0x7f7ed81082e0 2024-09-12T01:30:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.726+0000 7f7edd77f640 1 -- 172.21.15.81:0/2818042764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed81a5130 con 0x7f7ed81082e0 2024-09-12T01:30:30.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.728+0000 7f7ebffff640 1 -- 172.21.15.81:0/2818042764 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7ed001c070 con 0x7f7ed81082e0 2024-09-12T01:30:30.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.729+0000 7f7ebffff640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ec00a2cf0 0x7f7ec00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.729+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ec00a2cf0 0x7f7ec00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.729+0000 7f7ebffff640 1 -- 172.21.15.81:0/2818042764 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7ed00cea30 con 0x7f7ed81082e0 2024-09-12T01:30:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.729+0000 7f7edfb58740 1 Processor -- start 2024-09-12T01:30:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.729+0000 7f7edfb58740 1 -- start start 2024-09-12T01:30:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.729+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ec00a2cf0 0x7f7ec00a51b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8000c00 tx=0x7f7ec80041e0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7edfb58740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe4b40 0x556c5cfe3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7edfb58740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cfe3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7edfb58740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 0x556c5cff0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7edfb58740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556c5cf492f0 con 0x556c5cfe35d0 2024-09-12T01:30:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7edfb58740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556c5cef0cf0 con 0x556c5cfe4b40 2024-09-12T01:30:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7edfb58740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556c5cf452b0 con 0x556c5cfee370 2024-09-12T01:30:30.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ed67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cfe3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ed67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cfe3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44784/0 (socket says 172.21.15.81:44784) 2024-09-12T01:30:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ed67fc640 1 -- 172.21.15.81:0/2686314955 learned_addr learned my addr 172.21.15.81:0/2686314955 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/2686314955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe4b40 0x556c5cfe3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ed77fe640 1 --2- 172.21.15.81:0/2686314955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 0x556c5cff0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ed67fc640 1 -- 172.21.15.81:0/2686314955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 msgr2=0x556c5cff0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/2686314955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 0x556c5cff0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ed67fc640 1 -- 172.21.15.81:0/2686314955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe4b40 msgr2=0x556c5cfe3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/2686314955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe4b40 0x556c5cfe3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ed67fc640 1 -- 172.21.15.81:0/2686314955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5ced53a0 con 0x556c5cfe35d0 2024-09-12T01:30:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ed77fe640 1 --2- 172.21.15.81:0/2686314955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 0x556c5cff0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/2686314955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe4b40 0x556c5cfe3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/2686314955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cfe3a10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc008bb0 tx=0x7f7ecc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82be17ad1143ab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ebd7fa640 1 -- 172.21.15.81:0/2686314955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc014070 con 0x556c5cfe35d0 2024-09-12T01:30:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ebd7fa640 1 -- 172.21.15.81:0/2686314955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ecc0047a0 con 0x556c5cfe35d0 2024-09-12T01:30:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.730+0000 7f7ebd7fa640 1 -- 172.21.15.81:0/2686314955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc010670 con 0x556c5cfe35d0 2024-09-12T01:30:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.731+0000 7f7edfb58740 1 -- 172.21.15.81:0/2686314955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 msgr2=0x556c5cfe3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.731+0000 7f7edfb58740 1 --2- 172.21.15.81:0/2686314955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cfe3a10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc008bb0 tx=0x7f7ecc00e720 comp rx=0 tx=0).stop 2024-09-12T01:30:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.731+0000 7f7edfb58740 1 -- 172.21.15.81:0/2686314955 shutdown_connections 2024-09-12T01:30:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.731+0000 7f7edfb58740 1 --2- 172.21.15.81:0/2686314955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 0x556c5cff0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.731+0000 7f7edfb58740 1 --2- 172.21.15.81:0/2686314955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cfe3a10 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.731+0000 7f7edfb58740 1 --2- 172.21.15.81:0/2686314955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe4b40 0x556c5cfe3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.731+0000 7f7edfb58740 1 -- 172.21.15.81:0/2686314955 >> 172.21.15.81:0/2686314955 conn(0x556c5cfac310 msgr2=0x556c5cfdfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.731+0000 7f7edfb58740 1 -- 172.21.15.81:0/2686314955 shutdown_connections 2024-09-12T01:30:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.731+0000 7f7edfb58740 1 -- 172.21.15.81:0/2686314955 wait complete. 2024-09-12T01:30:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.731+0000 7f7edfb58740 1 -- start start 2024-09-12T01:30:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7edfb58740 1 Processor -- start 2024-09-12T01:30:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7edfb58740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cfedcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7edfb58740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfe4b40 0x556c5cfeafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7edfb58740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfee370 0x556c5cfeb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7edfb58740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556c5cff5480 con 0x556c5cfe35d0 2024-09-12T01:30:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7edfb58740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556c5cf04060 con 0x556c5cfee370 2024-09-12T01:30:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7edfb58740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556c5cff5600 con 0x556c5cfe4b40 2024-09-12T01:30:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7ed6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cfedcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7ed6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cfedcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44790/0 (socket says 172.21.15.81:44790) 2024-09-12T01:30:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7edfb58740 10 client.0 _ll_register_callbacks cb 0x556c5cc578c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7ed6ffd640 1 -- 172.21.15.81:0/1112499104 learned_addr learned my addr 172.21.15.81:0/1112499104 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7ed77fe640 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfee370 0x556c5cfeb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfe4b40 0x556c5cfeafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7ed6ffd640 1 -- 172.21.15.81:0/1112499104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfe4b40 msgr2=0x556c5cfeafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfe4b40 0x556c5cfeafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7ed6ffd640 1 -- 172.21.15.81:0/1112499104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfee370 msgr2=0x556c5cfeb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfee370 0x556c5cfeb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7ed6ffd640 1 -- 172.21.15.81:0/1112499104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c5ccba3c0 con 0x556c5cfe35d0 2024-09-12T01:30:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7ed77fe640 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfee370 0x556c5cfeb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cfedcf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8033000 tx=0x7f7ec8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afaf11095e673c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.732+0000 7f7ebaff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7ebaff5640 1 -- 172.21.15.81:0/1112499104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec804c020 con 0x556c5cfe35d0 2024-09-12T01:30:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7ebaff5640 1 -- 172.21.15.81:0/1112499104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7ec8004b40 con 0x556c5cfe35d0 2024-09-12T01:30:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7edfb58740 1 -- 172.21.15.81:0/1112499104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ecc0047a0 con 0x556c5cfe35d0 2024-09-12T01:30:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7ebaff5640 1 -- 172.21.15.81:0/1112499104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ec8057050 con 0x556c5cfe35d0 2024-09-12T01:30:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7edfb58740 10 client.16059 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7edfb58740 1 -- 172.21.15.81:0/1112499104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556c5d000e20 con 0x556c5cfe35d0 2024-09-12T01:30:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7ebaff5640 1 -- 172.21.15.81:0/1112499104 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ecc0047a0 con 0x556c5cfe35d0 2024-09-12T01:30:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7ebaff5640 1 -- 172.21.15.81:0/1112499104 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ec8032670 con 0x556c5cfe35d0 2024-09-12T01:30:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7edfb58740 10 client.16059 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7edfb58740 10 client.16059 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:30:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7edfb58740 20 client.16059 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7edfb58740 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x556c5d0022e0 0x556c5d004730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7edfb58740 4 client.16059 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:30:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.733+0000 7f7edfb58740 1 -- 172.21.15.81:0/1112499104 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c5cf56860 con 0x556c5d0022e0 2024-09-12T01:30:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.734+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x556c5d0022e0 0x556c5d004730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.734+0000 7f7ebaff5640 10 client.16059 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.734+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x556c5d0022e0 0x556c5d004730 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=768736ce74234504 server_cookie=25108d922f3b4b85 in_seq=0 out_seq=0 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7ebaff5640 1 -- 172.21.15.81:0/1112499104 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c5cf56860 con 0x556c5d0022e0 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7ebaff5640 10 client.16059 handle_command_reply: tid=0 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7edfb58740 1 client.16059 shutdown 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7edfb58740 1 -- 172.21.15.81:0/1112499104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 msgr2=0x556c5cfedcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7edfb58740 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cfedcf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8033000 tx=0x7f7ec8009260 comp rx=0 tx=0).stop 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7edfb58740 1 -- 172.21.15.81:0/1112499104 shutdown_connections 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7edfb58740 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfee370 0x556c5cfeb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7edfb58740 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfe4b40 0x556c5cfeafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7edfb58740 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x556c5d0022e0 0x556c5d004730 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7edfb58740 1 --2- 172.21.15.81:0/1112499104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cfedcf0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7ebaff5640 0 client.16059 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:30:30.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7edfb58740 1 -- 172.21.15.81:0/1112499104 >> 172.21.15.81:0/1112499104 conn(0x556c5cfac310 msgr2=0x556c5cfe5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:30.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7edfb58740 1 -- 172.21.15.81:0/1112499104 shutdown_connections 2024-09-12T01:30:30.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7edfb58740 1 -- 172.21.15.81:0/1112499104 wait complete. 2024-09-12T01:30:30.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.735+0000 7f7edfb58740 20 client.16059 trim_cache size 0 max 16384 2024-09-12T01:30:30.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.748+0000 7f7edfb58740 1 Processor -- start 2024-09-12T01:30:30.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.748+0000 7f7edfb58740 1 -- start start 2024-09-12T01:30:30.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.748+0000 7f7edfb58740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe35d0 0x556c5cfecf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.748+0000 7f7edfb58740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe4b40 0x556c5cfe6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.748+0000 7f7edfb58740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 0x556c5cfe6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.748+0000 7f7edfb58740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed81ab5b0 con 0x556c5cfe4b40 2024-09-12T01:30:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.748+0000 7f7edfb58740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed81ad0f0 con 0x556c5cfe35d0 2024-09-12T01:30:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.748+0000 7f7edfb58740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed81abc80 con 0x556c5cfee370 2024-09-12T01:30:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.748+0000 7f7ed67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe4b40 0x556c5cfe6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.748+0000 7f7ed67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe4b40 0x556c5cfe6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44798/0 (socket says 172.21.15.81:44798) 2024-09-12T01:30:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.748+0000 7f7ed67fc640 1 -- 172.21.15.81:0/1002205708 learned_addr learned my addr 172.21.15.81:0/1002205708 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.749+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/1002205708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe35d0 0x556c5cfecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.749+0000 7f7ed67fc640 1 -- 172.21.15.81:0/1002205708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 msgr2=0x556c5cfe6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.749+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/1002205708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 0x556c5cfe6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.749+0000 7f7ed67fc640 1 -- 172.21.15.81:0/1002205708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe35d0 msgr2=0x556c5cfecf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.749+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/1002205708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe35d0 0x556c5cfecf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.749+0000 7f7ed67fc640 1 -- 172.21.15.81:0/1002205708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c5cfe9f70 con 0x556c5cfe4b40 2024-09-12T01:30:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.749+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/1002205708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe35d0 0x556c5cfecf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.749+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/1002205708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe4b40 0x556c5cfe6120 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc008760 tx=0x7f7ecc0084f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2aba2e0ba26c2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.749+0000 7f7ebcff9640 1 -- 172.21.15.81:0/1002205708 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc014050 con 0x556c5cfe4b40 2024-09-12T01:30:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.749+0000 7f7ebcff9640 1 -- 172.21.15.81:0/1002205708 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ecc004f50 con 0x556c5cfe4b40 2024-09-12T01:30:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.749+0000 7f7ebcff9640 1 -- 172.21.15.81:0/1002205708 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc003850 con 0x556c5cfe4b40 2024-09-12T01:30:30.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 -- 172.21.15.81:0/1002205708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe4b40 msgr2=0x556c5cfe6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:30.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 --2- 172.21.15.81:0/1002205708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe4b40 0x556c5cfe6120 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc008760 tx=0x7f7ecc0084f0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 -- 172.21.15.81:0/1002205708 shutdown_connections 2024-09-12T01:30:30.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 --2- 172.21.15.81:0/1002205708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 0x556c5cfe6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 --2- 172.21.15.81:0/1002205708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe4b40 0x556c5cfe6120 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 --2- 172.21.15.81:0/1002205708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe35d0 0x556c5cfecf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 -- 172.21.15.81:0/1002205708 >> 172.21.15.81:0/1002205708 conn(0x556c5cfac310 msgr2=0x556c5cfec800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:30.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 -- 172.21.15.81:0/1002205708 shutdown_connections 2024-09-12T01:30:30.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 -- 172.21.15.81:0/1002205708 wait complete. 2024-09-12T01:30:30.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 -- start start 2024-09-12T01:30:30.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 Processor -- start 2024-09-12T01:30:30.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cff44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe4b40 0x556c5cff4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 0x556c5cffa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed81aca20 con 0x556c5cfe35d0 2024-09-12T01:30:30.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed81ac350 con 0x556c5cfe4b40 2024-09-12T01:30:30.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed81a9590 con 0x556c5cfee370 2024-09-12T01:30:30.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7edfb58740 10 client.0 _ll_register_callbacks cb 0x7f7ec8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:30.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7ed6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cff44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7ed6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cff44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44800/0 (socket says 172.21.15.81:44800) 2024-09-12T01:30:30.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.750+0000 7f7ed6ffd640 1 -- 172.21.15.81:0/2455510270 learned_addr learned my addr 172.21.15.81:0/2455510270 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:30.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7ed77fe640 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 0x556c5cffa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe4b40 0x556c5cff4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7ed6ffd640 1 -- 172.21.15.81:0/2455510270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 msgr2=0x556c5cffa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:30.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 0x556c5cffa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7ed6ffd640 1 -- 172.21.15.81:0/2455510270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe4b40 msgr2=0x556c5cff4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:30.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe4b40 0x556c5cff4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7ed6ffd640 1 -- 172.21.15.81:0/2455510270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c5cffb0e0 con 0x556c5cfe35d0 2024-09-12T01:30:30.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe4b40 0x556c5cff4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:30.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7ed6ffd640 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cff44f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8032a90 tx=0x7f7ec8004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2300015b1ee5e64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:30.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7ebaff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:30.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7ebaff5640 1 -- 172.21.15.81:0/2455510270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec804c040 con 0x556c5cfe35d0 2024-09-12T01:30:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7ebaff5640 1 -- 172.21.15.81:0/2455510270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7ec8004940 con 0x556c5cfe35d0 2024-09-12T01:30:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7edfb58740 1 -- 172.21.15.81:0/2455510270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ecc004f50 con 0x556c5cfe35d0 2024-09-12T01:30:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7ebaff5640 1 -- 172.21.15.81:0/2455510270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ec806a050 con 0x556c5cfe35d0 2024-09-12T01:30:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7edfb58740 10 client.16065 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.751+0000 7f7edfb58740 1 -- 172.21.15.81:0/2455510270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556c5cfe8ad0 con 0x556c5cfe35d0 2024-09-12T01:30:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.752+0000 7f7ebaff5640 1 -- 172.21.15.81:0/2455510270 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ecc004f50 con 0x556c5cfe35d0 2024-09-12T01:30:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.752+0000 7f7ebaff5640 1 -- 172.21.15.81:0/2455510270 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ec8003c60 con 0x556c5cfe35d0 2024-09-12T01:30:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.752+0000 7f7edfb58740 10 client.16065 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.752+0000 7f7edfb58740 10 client.16065 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:30:30.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.752+0000 7f7edfb58740 20 client.16065 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.752+0000 7f7edfb58740 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x556c5d071b80 0x556c5d073fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.752+0000 7f7edfb58740 4 client.16065 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:30:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.752+0000 7f7edfb58740 1 -- 172.21.15.81:0/2455510270 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556c5cf50d70 con 0x556c5d071b80 2024-09-12T01:30:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.752+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x556c5d071b80 0x556c5d073fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7ed67fc640 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x556c5d071b80 0x556c5d073fa0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e75ac0f6d0fdaa33 server_cookie=fa3d5f793d9c9871 in_seq=0 out_seq=0 2024-09-12T01:30:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7ebaff5640 10 client.16065 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:30:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7ebaff5640 1 -- 172.21.15.81:0/2455510270 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556c5cf50d70 con 0x556c5d071b80 2024-09-12T01:30:30.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7ebaff5640 10 client.16065 handle_command_reply: tid=0 2024-09-12T01:30:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7edfb58740 1 client.16065 shutdown 2024-09-12T01:30:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7edfb58740 1 -- 172.21.15.81:0/2455510270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 msgr2=0x556c5cff44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7edfb58740 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cff44f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8032a90 tx=0x7f7ec8004320 comp rx=0 tx=0).stop 2024-09-12T01:30:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7edfb58740 1 -- 172.21.15.81:0/2455510270 shutdown_connections 2024-09-12T01:30:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7edfb58740 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c5cfee370 0x556c5cffa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7edfb58740 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556c5cfe4b40 0x556c5cff4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7edfb58740 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x556c5d071b80 0x556c5d073fa0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7edfb58740 1 --2- 172.21.15.81:0/2455510270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c5cfe35d0 0x556c5cff44f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7ebaff5640 0 client.16065 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:30:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7edfb58740 1 -- 172.21.15.81:0/2455510270 >> 172.21.15.81:0/2455510270 conn(0x556c5cfac310 msgr2=0x556c5cfed020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7edfb58740 1 -- 172.21.15.81:0/2455510270 shutdown_connections 2024-09-12T01:30:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7edfb58740 1 -- 172.21.15.81:0/2455510270 wait complete. 2024-09-12T01:30:30.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.753+0000 7f7edfb58740 20 client.16065 trim_cache size 0 max 16384 2024-09-12T01:30:30.761 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:30:30.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.754+0000 7f7edd77f640 1 -- 172.21.15.81:0/2818042764 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ec00a2cf0 msgr2=0x7f7ec00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:30.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.754+0000 7f7edd77f640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ec00a2cf0 0x7f7ec00a51b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8000c00 tx=0x7f7ec80041e0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.754+0000 7f7edd77f640 1 -- 172.21.15.81:0/2818042764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed81082e0 msgr2=0x7f7ed819ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:30.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.754+0000 7f7edd77f640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed81082e0 0x7f7ed819ce80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000b970 tx=0x7f7ed000be30 comp rx=0 tx=0).stop 2024-09-12T01:30:30.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.754+0000 7f7edd77f640 1 -- 172.21.15.81:0/2818042764 shutdown_connections 2024-09-12T01:30:30.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.754+0000 7f7edd77f640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ec00a2cf0 0x7f7ec00a51b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.754+0000 7f7edd77f640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed81082e0 0x7f7ed819ce80 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.754+0000 7f7edd77f640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ed8103760 0x7f7ed8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.754+0000 7f7edd77f640 1 --2- 172.21.15.81:0/2818042764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed8102db0 0x7f7ed81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:30.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.754+0000 7f7edd77f640 1 -- 172.21.15.81:0/2818042764 >> 172.21.15.81:0/2818042764 conn(0x7f7ed80fc7d0 msgr2=0x7f7ed80fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:30.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.754+0000 7f7edd77f640 1 -- 172.21.15.81:0/2818042764 shutdown_connections 2024-09-12T01:30:30.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:30.754+0000 7f7edd77f640 1 -- 172.21.15.81:0/2818042764 wait complete. 2024-09-12T01:30:31.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:30:31.712 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:31.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:31 smithi081 ceph-mon[30920]: pgmap v76: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 1.38k op/s 2024-09-12T01:30:32.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:31 smithi100 ceph-mon[35275]: pgmap v76: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 1.38k op/s 2024-09-12T01:30:32.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:31 smithi189 ceph-mon[35357]: pgmap v76: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 1.38k op/s 2024-09-12T01:30:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.201+0000 7f7a8553b640 1 -- 172.21.15.81:0/2648742812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a80102570 msgr2=0x7f7a801029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.201+0000 7f7a8553b640 1 --2- 172.21.15.81:0/2648742812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a80102570 0x7f7a801029b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009900 tx=0x7f7a6802a480 comp rx=0 tx=0).stop 2024-09-12T01:30:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.201+0000 7f7a8553b640 1 -- 172.21.15.81:0/2648742812 shutdown_connections 2024-09-12T01:30:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.201+0000 7f7a8553b640 1 --2- 172.21.15.81:0/2648742812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a80102ef0 0x7f7a8010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.201+0000 7f7a8553b640 1 --2- 172.21.15.81:0/2648742812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a80102570 0x7f7a801029b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.201+0000 7f7a8553b640 1 --2- 172.21.15.81:0/2648742812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a80100e20 0x7f7a80101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.201+0000 7f7a8553b640 1 -- 172.21.15.81:0/2648742812 >> 172.21.15.81:0/2648742812 conn(0x7f7a800fc7d0 msgr2=0x7f7a800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.201+0000 7f7a8553b640 1 -- 172.21.15.81:0/2648742812 shutdown_connections 2024-09-12T01:30:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.201+0000 7f7a8553b640 1 -- 172.21.15.81:0/2648742812 wait complete. 2024-09-12T01:30:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.202+0000 7f7a8553b640 1 Processor -- start 2024-09-12T01:30:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.202+0000 7f7a8553b640 1 -- start start 2024-09-12T01:30:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.202+0000 7f7a8553b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a80100e20 0x7f7a80198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.202+0000 7f7a8553b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a80102570 0x7f7a80198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.202+0000 7f7a8553b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a80102ef0 0x7f7a8019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.202+0000 7f7a8553b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801120a0 con 0x7f7a80102570 2024-09-12T01:30:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.202+0000 7f7a8553b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a80111f20 con 0x7f7a80100e20 2024-09-12T01:30:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.202+0000 7f7a8553b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a80112220 con 0x7f7a80102ef0 2024-09-12T01:30:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.202+0000 7f7a7e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a80102570 0x7f7a80198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a7e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a80102570 0x7f7a80198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46826/0 (socket says 172.21.15.81:46826) 2024-09-12T01:30:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a7e7fc640 1 -- 172.21.15.81:0/680720334 learned_addr learned my addr 172.21.15.81:0/680720334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a7effd640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a80100e20 0x7f7a80198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a7f7fe640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a80102ef0 0x7f7a8019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a7e7fc640 1 -- 172.21.15.81:0/680720334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a80102ef0 msgr2=0x7f7a8019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a80102ef0 0x7f7a8019cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a7e7fc640 1 -- 172.21.15.81:0/680720334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a80100e20 msgr2=0x7f7a80198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a80100e20 0x7f7a80198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a7e7fc640 1 -- 172.21.15.81:0/680720334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8019d4d0 con 0x7f7a80102570 2024-09-12T01:30:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a80102570 0x7f7a80198a60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7a68006010 tx=0x7f7a68003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a77fff640 1 -- 172.21.15.81:0/680720334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6803f070 con 0x7f7a80102570 2024-09-12T01:30:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a77fff640 1 -- 172.21.15.81:0/680720334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a68031c30 con 0x7f7a80102570 2024-09-12T01:30:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a8553b640 1 -- 172.21.15.81:0/680720334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8019d760 con 0x7f7a80102570 2024-09-12T01:30:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a77fff640 1 -- 172.21.15.81:0/680720334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68035030 con 0x7f7a80102570 2024-09-12T01:30:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.203+0000 7f7a8553b640 1 -- 172.21.15.81:0/680720334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a801a50a0 con 0x7f7a80102570 2024-09-12T01:30:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.205+0000 7f7a77fff640 1 -- 172.21.15.81:0/680720334 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7a68042070 con 0x7f7a80102570 2024-09-12T01:30:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.206+0000 7f7a87914740 1 Processor -- start 2024-09-12T01:30:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.206+0000 7f7a87914740 1 -- start start 2024-09-12T01:30:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.206+0000 7f7a87914740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb632fb40 0x561fb632e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.206+0000 7f7a87914740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb632ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.206+0000 7f7a87914740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb6339370 0x561fb633b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.206+0000 7f7a87914740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561fb62942f0 con 0x561fb632e5d0 2024-09-12T01:30:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.206+0000 7f7a87914740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561fb623bcf0 con 0x561fb6339370 2024-09-12T01:30:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.206+0000 7f7a87914740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561fb62902b0 con 0x561fb632fb40 2024-09-12T01:30:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.206+0000 7f7a7effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb632ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a7effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb632ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46832/0 (socket says 172.21.15.81:46832) 2024-09-12T01:30:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a7effd640 1 -- 172.21.15.81:0/3589934473 learned_addr learned my addr 172.21.15.81:0/3589934473 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a77fff640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7a6c0a2cf0 0x7f7a6c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a7f7fe640 1 --2- 172.21.15.81:0/3589934473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb632fb40 0x561fb632e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/3589934473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb6339370 0x561fb633b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a7f7fe640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7a6c0a2cf0 0x7f7a6c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a7effd640 1 -- 172.21.15.81:0/3589934473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb632fb40 msgr2=0x561fb632e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a7effd640 1 --2- 172.21.15.81:0/3589934473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb632fb40 0x561fb632e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a7effd640 1 -- 172.21.15.81:0/3589934473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb6339370 msgr2=0x561fb633b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a77fff640 1 -- 172.21.15.81:0/680720334 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7a680efce0 con 0x7f7a80102570 2024-09-12T01:30:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a7effd640 1 --2- 172.21.15.81:0/3589934473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb6339370 0x561fb633b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a7effd640 1 -- 172.21.15.81:0/3589934473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb62203a0 con 0x561fb632e5d0 2024-09-12T01:30:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/3589934473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb6339370 0x561fb633b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a7effd640 1 --2- 172.21.15.81:0/3589934473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb632ea10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800bd10 tx=0x7f7a780107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9b5b7864b7cb63 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a757fa640 1 -- 172.21.15.81:0/3589934473 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78004030 con 0x561fb632e5d0 2024-09-12T01:30:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a7f7fe640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7a6c0a2cf0 0x7f7a6c0a51b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a70006b30 tx=0x7f7a70005df0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a757fa640 1 -- 172.21.15.81:0/3589934473 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a780041d0 con 0x561fb632e5d0 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.207+0000 7f7a757fa640 1 -- 172.21.15.81:0/3589934473 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78011820 con 0x561fb632e5d0 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.208+0000 7f7a87914740 1 -- 172.21.15.81:0/3589934473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 msgr2=0x561fb632ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.208+0000 7f7a87914740 1 --2- 172.21.15.81:0/3589934473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb632ea10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800bd10 tx=0x7f7a780107a0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.208+0000 7f7a87914740 1 -- 172.21.15.81:0/3589934473 shutdown_connections 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.208+0000 7f7a87914740 1 --2- 172.21.15.81:0/3589934473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb6339370 0x561fb633b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.208+0000 7f7a87914740 1 --2- 172.21.15.81:0/3589934473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb632ea10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.208+0000 7f7a87914740 1 --2- 172.21.15.81:0/3589934473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb632fb40 0x561fb632e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.208+0000 7f7a87914740 1 -- 172.21.15.81:0/3589934473 >> 172.21.15.81:0/3589934473 conn(0x561fb62f7310 msgr2=0x561fb632ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.208+0000 7f7a87914740 1 -- 172.21.15.81:0/3589934473 shutdown_connections 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.208+0000 7f7a87914740 1 -- 172.21.15.81:0/3589934473 wait complete. 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.208+0000 7f7a87914740 1 -- start start 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.208+0000 7f7a87914740 1 Processor -- start 2024-09-12T01:30:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a87914740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb6338d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a87914740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb632fb40 0x561fb6336030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a87914740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb6339370 0x561fb6336640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a87914740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561fb633c070 con 0x561fb632e5d0 2024-09-12T01:30:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a87914740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561fb624f060 con 0x561fb632fb40 2024-09-12T01:30:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a87914740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561fb633c1f0 con 0x561fb6339370 2024-09-12T01:30:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a87914740 10 client.0 _ll_register_callbacks cb 0x561fb5fa28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a7effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb6338d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a7effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb6338d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46838/0 (socket says 172.21.15.81:46838) 2024-09-12T01:30:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a7effd640 1 -- 172.21.15.81:0/2282684811 learned_addr learned my addr 172.21.15.81:0/2282684811 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb632fb40 0x561fb6336030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a7f7fe640 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb6339370 0x561fb6336640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a7effd640 1 -- 172.21.15.81:0/2282684811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb6339370 msgr2=0x561fb6336640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a7effd640 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb6339370 0x561fb6336640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a7effd640 1 -- 172.21.15.81:0/2282684811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb632fb40 msgr2=0x561fb6336030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a7effd640 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb632fb40 0x561fb6336030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a7effd640 1 -- 172.21.15.81:0/2282684811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb60053c0 con 0x561fb632e5d0 2024-09-12T01:30:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a7f7fe640 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb6339370 0x561fb6336640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a7effd640 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb6338d80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7a78010ca0 tx=0x7f7a78004070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de24d72710d617f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a667fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.209+0000 7f7a667fc640 1 -- 172.21.15.81:0/2282684811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78029060 con 0x561fb632e5d0 2024-09-12T01:30:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a667fc640 1 -- 172.21.15.81:0/2282684811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7a780035f0 con 0x561fb632e5d0 2024-09-12T01:30:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a87914740 1 -- 172.21.15.81:0/2282684811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a780041d0 con 0x561fb632e5d0 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a667fc640 1 -- 172.21.15.81:0/2282684811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a780037f0 con 0x561fb632e5d0 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a87914740 10 client.16077 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a87914740 1 -- 172.21.15.81:0/2282684811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561fb6347ab0 con 0x561fb632e5d0 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a667fc640 1 -- 172.21.15.81:0/2282684811 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a780041d0 con 0x561fb632e5d0 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a667fc640 1 -- 172.21.15.81:0/2282684811 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7a78004920 con 0x561fb632e5d0 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a87914740 10 client.16077 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a87914740 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a87914740 20 client.16077 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a87914740 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561fb6348eb0 0x561fb634b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a87914740 4 client.16077 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a87914740 1 -- 172.21.15.81:0/2282684811 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fb62a1860 con 0x561fb6348eb0 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.210+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561fb6348eb0 0x561fb634b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.211+0000 7f7a667fc640 10 client.16077 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.211+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561fb6348eb0 0x561fb634b2a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a935378a24d066a5 server_cookie=a5caa6b29fe43e59 in_seq=0 out_seq=0 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.211+0000 7f7a667fc640 1 -- 172.21.15.81:0/2282684811 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fb62a1860 con 0x561fb6348eb0 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.211+0000 7f7a667fc640 10 client.16077 handle_command_reply: tid=0 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.211+0000 7f7a87914740 1 client.16077 shutdown 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.212+0000 7f7a87914740 1 -- 172.21.15.81:0/2282684811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 msgr2=0x561fb6338d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.212+0000 7f7a87914740 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb6338d80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7a78010ca0 tx=0x7f7a78004070 comp rx=0 tx=0).stop 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.212+0000 7f7a87914740 1 -- 172.21.15.81:0/2282684811 shutdown_connections 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.212+0000 7f7a87914740 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561fb6348eb0 0x561fb634b2a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.212+0000 7f7a87914740 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb6339370 0x561fb6336640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.212+0000 7f7a87914740 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb632fb40 0x561fb6336030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.212+0000 7f7a667fc640 0 client.16077 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.212+0000 7f7a87914740 1 --2- 172.21.15.81:0/2282684811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb6338d80 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.212+0000 7f7a87914740 1 -- 172.21.15.81:0/2282684811 >> 172.21.15.81:0/2282684811 conn(0x561fb62f7310 msgr2=0x561fb6330960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.212+0000 7f7a87914740 1 -- 172.21.15.81:0/2282684811 shutdown_connections 2024-09-12T01:30:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.212+0000 7f7a87914740 1 -- 172.21.15.81:0/2282684811 wait complete. 2024-09-12T01:30:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.212+0000 7f7a87914740 20 client.16077 trim_cache size 0 max 16384 2024-09-12T01:30:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.224+0000 7f7a87914740 1 Processor -- start 2024-09-12T01:30:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.224+0000 7f7a87914740 1 -- start start 2024-09-12T01:30:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a87914740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb632e5d0 0x561fb6345310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a87914740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632fb40 0x561fb6350840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a87914740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb6339370 0x561fb6350d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a87914740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801ad870 con 0x561fb632fb40 2024-09-12T01:30:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a87914740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801af3b0 con 0x561fb6339370 2024-09-12T01:30:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a87914740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801adf40 con 0x561fb632e5d0 2024-09-12T01:30:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a7e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632fb40 0x561fb6350840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a7e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632fb40 0x561fb6350840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46844/0 (socket says 172.21.15.81:46844) 2024-09-12T01:30:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a7e7fc640 1 -- 172.21.15.81:0/3332318230 learned_addr learned my addr 172.21.15.81:0/3332318230 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a7effd640 1 --2- 172.21.15.81:0/3332318230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb632e5d0 0x561fb6345310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a7e7fc640 1 -- 172.21.15.81:0/3332318230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb632e5d0 msgr2=0x561fb6345310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/3332318230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb632e5d0 0x561fb6345310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a7f7fe640 1 --2- 172.21.15.81:0/3332318230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb6339370 0x561fb6350d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a7e7fc640 1 -- 172.21.15.81:0/3332318230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb6339370 msgr2=0x561fb6350d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/3332318230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb6339370 0x561fb6350d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a7e7fc640 1 -- 172.21.15.81:0/3332318230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb6336fd0 con 0x561fb632fb40 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.225+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/3332318230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632fb40 0x561fb6350840 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009320 tx=0x7f7a68036b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4306c581dadb82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.226+0000 7f7a74ff9640 1 -- 172.21.15.81:0/3332318230 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68049040 con 0x561fb632fb40 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.226+0000 7f7a74ff9640 1 -- 172.21.15.81:0/3332318230 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a680bc1d0 con 0x561fb632fb40 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.226+0000 7f7a74ff9640 1 -- 172.21.15.81:0/3332318230 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a680c0170 con 0x561fb632fb40 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.226+0000 7f7a87914740 1 -- 172.21.15.81:0/3332318230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632fb40 msgr2=0x561fb6350840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.226+0000 7f7a87914740 1 --2- 172.21.15.81:0/3332318230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632fb40 0x561fb6350840 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009320 tx=0x7f7a68036b60 comp rx=0 tx=0).stop 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.226+0000 7f7a87914740 1 -- 172.21.15.81:0/3332318230 shutdown_connections 2024-09-12T01:30:32.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.226+0000 7f7a87914740 1 --2- 172.21.15.81:0/3332318230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb6339370 0x561fb6350d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.226+0000 7f7a87914740 1 --2- 172.21.15.81:0/3332318230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632fb40 0x561fb6350840 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.226+0000 7f7a87914740 1 --2- 172.21.15.81:0/3332318230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb632e5d0 0x561fb6345310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.226+0000 7f7a87914740 1 -- 172.21.15.81:0/3332318230 >> 172.21.15.81:0/3332318230 conn(0x561fb62f7310 msgr2=0x561fb6325a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.226+0000 7f7a87914740 1 -- 172.21.15.81:0/3332318230 shutdown_connections 2024-09-12T01:30:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.226+0000 7f7a87914740 1 -- 172.21.15.81:0/3332318230 wait complete. 2024-09-12T01:30:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a87914740 1 -- start start 2024-09-12T01:30:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a87914740 1 Processor -- start 2024-09-12T01:30:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a87914740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb633c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a87914740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb632fb40 0x561fb633cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a87914740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb6339370 0x561fb63b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a87914740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801aece0 con 0x561fb632e5d0 2024-09-12T01:30:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a87914740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801ae610 con 0x561fb632fb40 2024-09-12T01:30:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a87914740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a801ab850 con 0x561fb6339370 2024-09-12T01:30:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a87914740 10 client.0 _ll_register_callbacks cb 0x7f7a7800bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a7effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb633c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a7effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb633c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46850/0 (socket says 172.21.15.81:46850) 2024-09-12T01:30:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a7effd640 1 -- 172.21.15.81:0/1173160844 learned_addr learned my addr 172.21.15.81:0/1173160844 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb632fb40 0x561fb633cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a7f7fe640 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb6339370 0x561fb63b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a7effd640 1 -- 172.21.15.81:0/1173160844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb6339370 msgr2=0x561fb63b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a7effd640 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb6339370 0x561fb63b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a7effd640 1 -- 172.21.15.81:0/1173160844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb632fb40 msgr2=0x561fb633cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a7effd640 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb632fb40 0x561fb633cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a7effd640 1 -- 172.21.15.81:0/1173160844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb63b1d40 con 0x561fb632e5d0 2024-09-12T01:30:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a7f7fe640 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb6339370 0x561fb63b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb632fb40 0x561fb633cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:30:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.227+0000 7f7a7effd640 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb633c9e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7a78005d00 tx=0x7f7a78004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7347c53f0cb3553 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a667fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a667fc640 1 -- 172.21.15.81:0/1173160844 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78029050 con 0x561fb632e5d0 2024-09-12T01:30:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a667fc640 1 -- 172.21.15.81:0/1173160844 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7a780035f0 con 0x561fb632e5d0 2024-09-12T01:30:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a87914740 1 -- 172.21.15.81:0/1173160844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a680bc1d0 con 0x561fb632e5d0 2024-09-12T01:30:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a667fc640 1 -- 172.21.15.81:0/1173160844 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a7803c050 con 0x561fb632e5d0 2024-09-12T01:30:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a87914740 10 client.16083 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a87914740 1 -- 172.21.15.81:0/1173160844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561fb63b2f50 con 0x561fb632e5d0 2024-09-12T01:30:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a667fc640 1 -- 172.21.15.81:0/1173160844 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a680bc1d0 con 0x561fb632e5d0 2024-09-12T01:30:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a667fc640 1 -- 172.21.15.81:0/1173160844 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7a780046b0 con 0x561fb632e5d0 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a87914740 10 client.16083 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a87914740 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a87914740 20 client.16083 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a87914740 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561fb6348eb0 0x561fb63b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a87914740 4 client.16083 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.228+0000 7f7a87914740 1 -- 172.21.15.81:0/1173160844 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561fb629bd70 con 0x561fb6348eb0 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561fb6348eb0 0x561fb63b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a7e7fc640 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561fb6348eb0 0x561fb63b5650 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45c661a8af55949 server_cookie=4a855355c4302a40 in_seq=0 out_seq=0 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a667fc640 10 client.16083 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a667fc640 1 -- 172.21.15.81:0/1173160844 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561fb629bd70 con 0x561fb6348eb0 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a667fc640 10 client.16083 handle_command_reply: tid=0 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a87914740 1 client.16083 shutdown 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a87914740 1 -- 172.21.15.81:0/1173160844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 msgr2=0x561fb633c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a87914740 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb633c9e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7a78005d00 tx=0x7f7a78004310 comp rx=0 tx=0).stop 2024-09-12T01:30:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a87914740 1 -- 172.21.15.81:0/1173160844 shutdown_connections 2024-09-12T01:30:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a87914740 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561fb6348eb0 0x561fb63b5650 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a87914740 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561fb6339370 0x561fb63b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a667fc640 0 client.16083 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a87914740 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fb632fb40 0x561fb633cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a87914740 1 --2- 172.21.15.81:0/1173160844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561fb632e5d0 0x561fb633c9e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a87914740 1 -- 172.21.15.81:0/1173160844 >> 172.21.15.81:0/1173160844 conn(0x561fb62f7310 msgr2=0x561fb6334900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a87914740 1 -- 172.21.15.81:0/1173160844 shutdown_connections 2024-09-12T01:30:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a87914740 1 -- 172.21.15.81:0/1173160844 wait complete. 2024-09-12T01:30:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.229+0000 7f7a87914740 20 client.16083 trim_cache size 0 max 16384 2024-09-12T01:30:32.254 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:30:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.230+0000 7f7a8553b640 1 -- 172.21.15.81:0/680720334 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7a6c0a2cf0 msgr2=0x7f7a6c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.230+0000 7f7a8553b640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7a6c0a2cf0 0x7f7a6c0a51b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a70006b30 tx=0x7f7a70005df0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.230+0000 7f7a8553b640 1 -- 172.21.15.81:0/680720334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a80102570 msgr2=0x7f7a80198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.230+0000 7f7a8553b640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a80102570 0x7f7a80198a60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7a68006010 tx=0x7f7a68003c10 comp rx=0 tx=0).stop 2024-09-12T01:30:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.230+0000 7f7a8553b640 1 -- 172.21.15.81:0/680720334 shutdown_connections 2024-09-12T01:30:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.230+0000 7f7a8553b640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7a6c0a2cf0 0x7f7a6c0a51b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.230+0000 7f7a8553b640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a80102ef0 0x7f7a8019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.230+0000 7f7a8553b640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a80102570 0x7f7a80198a60 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.230+0000 7f7a8553b640 1 --2- 172.21.15.81:0/680720334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a80100e20 0x7f7a80198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.230+0000 7f7a8553b640 1 -- 172.21.15.81:0/680720334 >> 172.21.15.81:0/680720334 conn(0x7f7a800fc7d0 msgr2=0x7f7a800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.230+0000 7f7a8553b640 1 -- 172.21.15.81:0/680720334 shutdown_connections 2024-09-12T01:30:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:32.230+0000 7f7a8553b640 1 -- 172.21.15.81:0/680720334 wait complete. 2024-09-12T01:30:32.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:32 smithi081 ceph-mon[30920]: pgmap v77: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.0 MiB/s wr, 892 op/s 2024-09-12T01:30:33.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:32 smithi100 ceph-mon[35275]: pgmap v77: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.0 MiB/s wr, 892 op/s 2024-09-12T01:30:33.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:32 smithi189 ceph-mon[35357]: pgmap v77: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.0 MiB/s wr, 892 op/s 2024-09-12T01:30:33.941 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:30:33.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:30:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.602+0000 7f0bf629b640 1 -- 172.21.15.81:0/2902661637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0102790 msgr2=0x7f0bf01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.602+0000 7f0bf629b640 1 --2- 172.21.15.81:0/2902661637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0102790 0x7f0bf01067e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009900 tx=0x7f0be402a410 comp rx=0 tx=0).stop 2024-09-12T01:30:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.602+0000 7f0bf629b640 1 -- 172.21.15.81:0/2902661637 shutdown_connections 2024-09-12T01:30:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.602+0000 7f0bf629b640 1 --2- 172.21.15.81:0/2902661637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf0106f10 0x7f0bf010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.602+0000 7f0bf629b640 1 --2- 172.21.15.81:0/2902661637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0102790 0x7f0bf01067e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.602+0000 7f0bf629b640 1 --2- 172.21.15.81:0/2902661637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bf0101de0 0x7f0bf01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.602+0000 7f0bf629b640 1 -- 172.21.15.81:0/2902661637 >> 172.21.15.81:0/2902661637 conn(0x7f0bf00fd8c0 msgr2=0x7f0bf00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.602+0000 7f0bf629b640 1 -- 172.21.15.81:0/2902661637 shutdown_connections 2024-09-12T01:30:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.602+0000 7f0bf629b640 1 -- 172.21.15.81:0/2902661637 wait complete. 2024-09-12T01:30:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.603+0000 7f0bf629b640 1 Processor -- start 2024-09-12T01:30:34.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.603+0000 7f0bf629b640 1 -- start start 2024-09-12T01:30:34.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.603+0000 7f0bf629b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bf0101de0 0x7f0bf00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.603+0000 7f0bf629b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0102790 0x7f0bf0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.603+0000 7f0bf629b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf0106f10 0x7f0bf0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.603+0000 7f0bf629b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf0111f70 con 0x7f0bf0102790 2024-09-12T01:30:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.603+0000 7f0bf629b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf0111df0 con 0x7f0bf0106f10 2024-09-12T01:30:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.603+0000 7f0bf629b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf01120f0 con 0x7f0bf0101de0 2024-09-12T01:30:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.603+0000 7f0bef7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0102790 0x7f0bf0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.603+0000 7f0bef7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0102790 0x7f0bf0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46866/0 (socket says 172.21.15.81:46866) 2024-09-12T01:30:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.603+0000 7f0bef7fe640 1 -- 172.21.15.81:0/2537749330 learned_addr learned my addr 172.21.15.81:0/2537749330 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.603+0000 7f0bf4838640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf0106f10 0x7f0bf0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.603+0000 7f0beffff640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bf0101de0 0x7f0bf00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.604+0000 7f0bef7fe640 1 -- 172.21.15.81:0/2537749330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bf0101de0 msgr2=0x7f0bf00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.604+0000 7f0bef7fe640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bf0101de0 0x7f0bf00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.604+0000 7f0bef7fe640 1 -- 172.21.15.81:0/2537749330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf0106f10 msgr2=0x7f0bf0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.604+0000 7f0bef7fe640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf0106f10 0x7f0bf0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.604+0000 7f0bef7fe640 1 -- 172.21.15.81:0/2537749330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf01a6950 con 0x7f0bf0102790 2024-09-12T01:30:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.604+0000 7f0beffff640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bf0101de0 0x7f0bf00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:34.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.604+0000 7f0bf4838640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf0106f10 0x7f0bf0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:34.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.604+0000 7f0bef7fe640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0102790 0x7f0bf0074a30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0be4006010 tx=0x7f0be40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:34.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.604+0000 7f0bed7fa640 1 -- 172.21.15.81:0/2537749330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be403f030 con 0x7f0bf0102790 2024-09-12T01:30:34.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.604+0000 7f0bf629b640 1 -- 172.21.15.81:0/2537749330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf01a6be0 con 0x7f0bf0102790 2024-09-12T01:30:34.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.604+0000 7f0bed7fa640 1 -- 172.21.15.81:0/2537749330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be4003ce0 con 0x7f0bf0102790 2024-09-12T01:30:34.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.604+0000 7f0bed7fa640 1 -- 172.21.15.81:0/2537749330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4035070 con 0x7f0bf0102790 2024-09-12T01:30:34.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.604+0000 7f0bf629b640 1 -- 172.21.15.81:0/2537749330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf01a7110 con 0x7f0bf0102790 2024-09-12T01:30:34.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.606+0000 7f0bed7fa640 1 -- 172.21.15.81:0/2537749330 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f0be4042030 con 0x7f0bf0102790 2024-09-12T01:30:34.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bf8674740 1 Processor -- start 2024-09-12T01:30:34.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bed7fa640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0bd80a2cf0 0x7f0bd80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bf8674740 1 -- start start 2024-09-12T01:30:34.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bed7fa640 1 -- 172.21.15.81:0/2537749330 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f0be40ef9e0 con 0x7f0bf0102790 2024-09-12T01:30:34.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bf4838640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0bd80a2cf0 0x7f0bd80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bf8674740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee0b60 0x5571c5ee0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bf8674740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee1480 0x5571c5eeb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bf8674740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5eee130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bf8674740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5571c5e46280 con 0x5571c5eebd40 2024-09-12T01:30:34.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bf8674740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5571c5dedb10 con 0x5571c5ee1480 2024-09-12T01:30:34.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bf8674740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5571c5e42240 con 0x5571c5ee0b60 2024-09-12T01:30:34.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bf4838640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5eee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bef7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee1480 0x5571c5eeb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bf4838640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5eee130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46876/0 (socket says 172.21.15.81:46876) 2024-09-12T01:30:34.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bef7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee1480 0x5571c5eeb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:38626/0 (socket says 172.21.15.81:38626) 2024-09-12T01:30:34.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bf4838640 1 -- 172.21.15.81:0/1453568563 learned_addr learned my addr 172.21.15.81:0/1453568563 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:34.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0beffff640 1 --2- 172.21.15.81:0/1453568563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee0b60 0x5571c5ee0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.607+0000 7f0bf4838640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0bd80a2cf0 0x7f0bd80a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0be800add0 tx=0x7f0be800e720 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:34.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.608+0000 7f0bf4838640 1 -- 172.21.15.81:0/1453568563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee0b60 msgr2=0x5571c5ee0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:34.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.608+0000 7f0bf4838640 1 --2- 172.21.15.81:0/1453568563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee0b60 0x5571c5ee0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.608+0000 7f0bf4838640 1 -- 172.21.15.81:0/1453568563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee1480 msgr2=0x5571c5eeb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:34.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.608+0000 7f0bf4838640 1 --2- 172.21.15.81:0/1453568563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee1480 0x5571c5eeb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.608+0000 7f0bf4838640 1 -- 172.21.15.81:0/1453568563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571c5dfa1f0 con 0x5571c5eebd40 2024-09-12T01:30:34.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.608+0000 7f0bf4838640 1 --2- 172.21.15.81:0/1453568563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5eee130 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0be8012720 tx=0x7f0be8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640cf1e48b87886c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:34.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.608+0000 7f0bd67fc640 1 -- 172.21.15.81:0/1453568563 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8003b70 con 0x5571c5eebd40 2024-09-12T01:30:34.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.608+0000 7f0bd67fc640 1 -- 172.21.15.81:0/1453568563 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be8003d10 con 0x5571c5eebd40 2024-09-12T01:30:34.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.608+0000 7f0bd67fc640 1 -- 172.21.15.81:0/1453568563 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8004630 con 0x5571c5eebd40 2024-09-12T01:30:34.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.609+0000 7f0bf8674740 1 -- 172.21.15.81:0/1453568563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 msgr2=0x5571c5eee130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:34.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.609+0000 7f0bf8674740 1 --2- 172.21.15.81:0/1453568563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5eee130 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0be8012720 tx=0x7f0be8019000 comp rx=0 tx=0).stop 2024-09-12T01:30:34.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.609+0000 7f0bf8674740 1 -- 172.21.15.81:0/1453568563 shutdown_connections 2024-09-12T01:30:34.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.609+0000 7f0bf8674740 1 --2- 172.21.15.81:0/1453568563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5eee130 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.609+0000 7f0bf8674740 1 --2- 172.21.15.81:0/1453568563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee1480 0x5571c5eeb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.609+0000 7f0bf8674740 1 --2- 172.21.15.81:0/1453568563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee0b60 0x5571c5ee0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.609+0000 7f0bf8674740 1 -- 172.21.15.81:0/1453568563 >> 172.21.15.81:0/1453568563 conn(0x5571c5edd0f0 msgr2=0x5571c5edd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:34.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.609+0000 7f0bf8674740 1 -- 172.21.15.81:0/1453568563 shutdown_connections 2024-09-12T01:30:34.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.609+0000 7f0bf8674740 1 -- 172.21.15.81:0/1453568563 wait complete. 2024-09-12T01:30:34.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.609+0000 7f0bf8674740 1 -- start start 2024-09-12T01:30:34.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.609+0000 7f0bf8674740 1 Processor -- start 2024-09-12T01:30:34.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf8674740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee0b60 0x5571c5ee8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf8674740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee1480 0x5571c5ee90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf8674740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5ee9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf8674740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5571c5eee910 con 0x5571c5eebd40 2024-09-12T01:30:34.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf8674740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5571c5e00f10 con 0x5571c5ee1480 2024-09-12T01:30:34.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf8674740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5571c5eeea90 con 0x5571c5ee0b60 2024-09-12T01:30:34.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf8674740 10 client.0 _ll_register_callbacks cb 0x5571c5dc9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:34.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf4838640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5ee9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf4838640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5ee9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46884/0 (socket says 172.21.15.81:46884) 2024-09-12T01:30:34.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf4838640 1 -- 172.21.15.81:0/1861816388 learned_addr learned my addr 172.21.15.81:0/1861816388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:34.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bef7fe640 1 --2- 172.21.15.81:0/1861816388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee1480 0x5571c5ee90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0beffff640 1 --2- 172.21.15.81:0/1861816388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee0b60 0x5571c5ee8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf4838640 1 -- 172.21.15.81:0/1861816388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee0b60 msgr2=0x5571c5ee8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:34.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf4838640 1 --2- 172.21.15.81:0/1861816388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee0b60 0x5571c5ee8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf4838640 1 -- 172.21.15.81:0/1861816388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee1480 msgr2=0x5571c5ee90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:34.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf4838640 1 --2- 172.21.15.81:0/1861816388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee1480 0x5571c5ee90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf4838640 1 -- 172.21.15.81:0/1861816388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571c5bb76a0 con 0x5571c5eebd40 2024-09-12T01:30:34.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf4838640 1 --2- 172.21.15.81:0/1861816388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5ee9630 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0be80041d0 tx=0x7f0be8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56de2f8acecd4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:34.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bcf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:34.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bcf7fe640 1 -- 172.21.15.81:0/1861816388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8034060 con 0x5571c5eebd40 2024-09-12T01:30:34.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bcf7fe640 1 -- 172.21.15.81:0/1861816388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f0be80045c0 con 0x5571c5eebd40 2024-09-12T01:30:34.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.610+0000 7f0bf8674740 1 -- 172.21.15.81:0/1861816388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0be8003d10 con 0x5571c5eebd40 2024-09-12T01:30:34.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.611+0000 7f0bcf7fe640 1 -- 172.21.15.81:0/1861816388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0be80047c0 con 0x5571c5eebd40 2024-09-12T01:30:34.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.611+0000 7f0bf8674740 10 client.16095 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:34.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.611+0000 7f0bf8674740 1 -- 172.21.15.81:0/1861816388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5571c5efa4a0 con 0x5571c5eebd40 2024-09-12T01:30:34.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.611+0000 7f0bcf7fe640 1 -- 172.21.15.81:0/1861816388 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be8003d10 con 0x5571c5eebd40 2024-09-12T01:30:34.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.611+0000 7f0bcf7fe640 1 -- 172.21.15.81:0/1861816388 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0be8005030 con 0x5571c5eebd40 2024-09-12T01:30:34.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.611+0000 7f0bf8674740 10 client.16095 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:34.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.611+0000 7f0bf8674740 10 client.16095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:30:34.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.611+0000 7f0bf8674740 20 client.16095 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:34.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.611+0000 7f0bf8674740 1 --2- 172.21.15.81:0/1861816388 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5571c5efb960 0x5571c5efdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.611+0000 7f0bf8674740 4 client.16095 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:30:34.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.611+0000 7f0bf8674740 1 -- 172.21.15.81:0/1861816388 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571c5e537f0 con 0x5571c5efb960 2024-09-12T01:30:34.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.611+0000 7f0beffff640 1 --2- 172.21.15.81:0/1861816388 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5571c5efb960 0x5571c5efdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.612+0000 7f0beffff640 1 --2- 172.21.15.81:0/1861816388 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5571c5efb960 0x5571c5efdd50 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=208a4847aaf61fd8 server_cookie=1adddceb4c2ebbc9 in_seq=0 out_seq=0 2024-09-12T01:30:34.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.612+0000 7f0bcf7fe640 10 client.16095 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:34.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.612+0000 7f0bcf7fe640 1 -- 172.21.15.81:0/1861816388 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571c5e537f0 con 0x5571c5efb960 2024-09-12T01:30:34.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bcf7fe640 10 client.16095 handle_command_reply: tid=0 2024-09-12T01:30:34.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bf8674740 1 client.16095 shutdown 2024-09-12T01:30:34.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bf8674740 1 -- 172.21.15.81:0/1861816388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 msgr2=0x5571c5ee9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:34.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bf8674740 1 --2- 172.21.15.81:0/1861816388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5ee9630 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0be80041d0 tx=0x7f0be8003ba0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bf8674740 1 -- 172.21.15.81:0/1861816388 shutdown_connections 2024-09-12T01:30:34.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bf8674740 1 --2- 172.21.15.81:0/1861816388 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5571c5efb960 0x5571c5efdd50 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bf8674740 1 --2- 172.21.15.81:0/1861816388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5ee9630 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bf8674740 1 --2- 172.21.15.81:0/1861816388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee1480 0x5571c5ee90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bf8674740 1 --2- 172.21.15.81:0/1861816388 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee0b60 0x5571c5ee8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bcf7fe640 0 client.16095 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:34.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bf8674740 1 -- 172.21.15.81:0/1861816388 >> 172.21.15.81:0/1861816388 conn(0x5571c5edd0f0 msgr2=0x5571c5edc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:34.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bf8674740 1 -- 172.21.15.81:0/1861816388 shutdown_connections 2024-09-12T01:30:34.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bf8674740 1 -- 172.21.15.81:0/1861816388 wait complete. 2024-09-12T01:30:34.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.613+0000 7f0bf8674740 20 client.16095 trim_cache size 0 max 16384 2024-09-12T01:30:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf8674740 1 Processor -- start 2024-09-12T01:30:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf8674740 1 -- start start 2024-09-12T01:30:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf8674740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee0b60 0x5571c5ef73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf8674740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee1480 0x5571c5f00d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf8674740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5f012b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf8674740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf01afa80 con 0x5571c5eebd40 2024-09-12T01:30:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf8674740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf01b15c0 con 0x5571c5ee0b60 2024-09-12T01:30:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf8674740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf01b0150 con 0x5571c5ee1480 2024-09-12T01:30:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf4838640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5f012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf4838640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5f012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46896/0 (socket says 172.21.15.81:46896) 2024-09-12T01:30:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf4838640 1 -- 172.21.15.81:0/834626320 learned_addr learned my addr 172.21.15.81:0/834626320 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0beffff640 1 --2- 172.21.15.81:0/834626320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee0b60 0x5571c5ef73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bef7fe640 1 --2- 172.21.15.81:0/834626320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee1480 0x5571c5f00d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf4838640 1 -- 172.21.15.81:0/834626320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee1480 msgr2=0x5571c5f00d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf4838640 1 --2- 172.21.15.81:0/834626320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee1480 0x5571c5f00d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf4838640 1 -- 172.21.15.81:0/834626320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee0b60 msgr2=0x5571c5ef73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf4838640 1 --2- 172.21.15.81:0/834626320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee0b60 0x5571c5ef73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0bf4838640 1 -- 172.21.15.81:0/834626320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571c5eeea40 con 0x5571c5eebd40 2024-09-12T01:30:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.630+0000 7f0beffff640 1 --2- 172.21.15.81:0/834626320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee0b60 0x5571c5ef73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.631+0000 7f0bf4838640 1 --2- 172.21.15.81:0/834626320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5f012b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0be8005480 tx=0x7f0be8012670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2789e69f7ee0f476 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.631+0000 7f0bd5ffb640 1 -- 172.21.15.81:0/834626320 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be80045c0 con 0x5571c5eebd40 2024-09-12T01:30:34.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.631+0000 7f0bd5ffb640 1 -- 172.21.15.81:0/834626320 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be8003c10 con 0x5571c5eebd40 2024-09-12T01:30:34.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.631+0000 7f0bd5ffb640 1 -- 172.21.15.81:0/834626320 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8004a00 con 0x5571c5eebd40 2024-09-12T01:30:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.631+0000 7f0bf8674740 1 -- 172.21.15.81:0/834626320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 msgr2=0x5571c5f012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.631+0000 7f0bf8674740 1 --2- 172.21.15.81:0/834626320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5f012b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0be8005480 tx=0x7f0be8012670 comp rx=0 tx=0).stop 2024-09-12T01:30:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.631+0000 7f0bf8674740 1 -- 172.21.15.81:0/834626320 shutdown_connections 2024-09-12T01:30:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.631+0000 7f0bf8674740 1 --2- 172.21.15.81:0/834626320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5f012b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.631+0000 7f0bf8674740 1 --2- 172.21.15.81:0/834626320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee1480 0x5571c5f00d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.631+0000 7f0bf8674740 1 --2- 172.21.15.81:0/834626320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee0b60 0x5571c5ef73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.631+0000 7f0bf8674740 1 -- 172.21.15.81:0/834626320 >> 172.21.15.81:0/834626320 conn(0x5571c5edd0f0 msgr2=0x5571c5ef6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.631+0000 7f0bf8674740 1 -- 172.21.15.81:0/834626320 shutdown_connections 2024-09-12T01:30:34.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.631+0000 7f0bf8674740 1 -- 172.21.15.81:0/834626320 wait complete. 2024-09-12T01:30:34.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0bf8674740 1 -- start start 2024-09-12T01:30:34.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0bf8674740 1 Processor -- start 2024-09-12T01:30:34.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0bf8674740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee0b60 0x5571c5efea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0bf8674740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee1480 0x5571c5efefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0bf8674740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5eff500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0bf8674740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf01b0ef0 con 0x5571c5eebd40 2024-09-12T01:30:34.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0bf8674740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf01b0820 con 0x5571c5ee0b60 2024-09-12T01:30:34.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0bf8674740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf01ada60 con 0x5571c5ee1480 2024-09-12T01:30:34.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0bf8674740 10 client.0 _ll_register_callbacks cb 0x7f0be4005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:34.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0bf4838640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5eff500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0beffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee0b60 0x5571c5efea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0beffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee0b60 0x5571c5efea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:38658/0 (socket says 172.21.15.81:38658) 2024-09-12T01:30:34.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0bf4838640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5eff500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46904/0 (socket says 172.21.15.81:46904) 2024-09-12T01:30:34.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.632+0000 7f0beffff640 1 -- 172.21.15.81:0/2414622800 learned_addr learned my addr 172.21.15.81:0/2414622800 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:34.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bef7fe640 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee1480 0x5571c5efefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bf4838640 1 -- 172.21.15.81:0/2414622800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee1480 msgr2=0x5571c5efefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:34.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bf4838640 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee1480 0x5571c5efefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bf4838640 1 -- 172.21.15.81:0/2414622800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee0b60 msgr2=0x5571c5efea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:34.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bf4838640 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee0b60 0x5571c5efea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bf4838640 1 -- 172.21.15.81:0/2414622800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571c5f652a0 con 0x5571c5eebd40 2024-09-12T01:30:34.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bef7fe640 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee1480 0x5571c5efefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:34.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0beffff640 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee0b60 0x5571c5efea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:30:34.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bf4838640 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5eff500 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0be800ec20 tx=0x7f0be8011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108c22e1fe5c0df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:34.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bcf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:34.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bcf7fe640 1 -- 172.21.15.81:0/2414622800 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8047070 con 0x5571c5eebd40 2024-09-12T01:30:34.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bf8674740 1 -- 172.21.15.81:0/2414622800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0be8003c10 con 0x5571c5eebd40 2024-09-12T01:30:34.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bcf7fe640 1 -- 172.21.15.81:0/2414622800 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f0be80045c0 con 0x5571c5eebd40 2024-09-12T01:30:34.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bcf7fe640 1 -- 172.21.15.81:0/2414622800 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0be8053050 con 0x5571c5eebd40 2024-09-12T01:30:34.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bf8674740 10 client.16101 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:34.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bf8674740 1 -- 172.21.15.81:0/2414622800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5571c5f66540 con 0x5571c5eebd40 2024-09-12T01:30:34.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.633+0000 7f0bcf7fe640 1 -- 172.21.15.81:0/2414622800 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be8003c10 con 0x5571c5eebd40 2024-09-12T01:30:34.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.634+0000 7f0bcf7fe640 1 -- 172.21.15.81:0/2414622800 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0be8041020 con 0x5571c5eebd40 2024-09-12T01:30:34.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.634+0000 7f0bf8674740 10 client.16101 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:34.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.634+0000 7f0bf8674740 10 client.16101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:30:34.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.634+0000 7f0bf8674740 20 client.16101 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:34.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.634+0000 7f0bf8674740 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5571c5f66ba0 0x5571c5f68f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:34.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.634+0000 7f0bf8674740 4 client.16101 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:30:34.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.634+0000 7f0bf8674740 1 -- 172.21.15.81:0/2414622800 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5571c5e4dd00 con 0x5571c5f66ba0 2024-09-12T01:30:34.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.634+0000 7f0beffff640 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5571c5f66ba0 0x5571c5f68f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:34.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.634+0000 7f0beffff640 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5571c5f66ba0 0x5571c5f68f90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1469338cbbca6459 server_cookie=51330a849724f6b in_seq=0 out_seq=0 2024-09-12T01:30:34.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.634+0000 7f0bcf7fe640 10 client.16101 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:34.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.635+0000 7f0bcf7fe640 1 -- 172.21.15.81:0/2414622800 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5571c5e4dd00 con 0x5571c5f66ba0 2024-09-12T01:30:34.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.635+0000 7f0bcf7fe640 10 client.16101 handle_command_reply: tid=0 2024-09-12T01:30:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.635+0000 7f0bf8674740 1 client.16101 shutdown 2024-09-12T01:30:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.635+0000 7f0bf8674740 1 -- 172.21.15.81:0/2414622800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 msgr2=0x5571c5eff500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.635+0000 7f0bf8674740 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5eff500 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0be800ec20 tx=0x7f0be8011e00 comp rx=0 tx=0).stop 2024-09-12T01:30:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf8674740 1 -- 172.21.15.81:0/2414622800 shutdown_connections 2024-09-12T01:30:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf8674740 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5571c5f66ba0 0x5571c5f68f90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf8674740 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5571c5eebd40 0x5571c5eff500 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf8674740 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5571c5ee1480 0x5571c5efefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf8674740 1 --2- 172.21.15.81:0/2414622800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c5ee0b60 0x5571c5efea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf8674740 1 -- 172.21.15.81:0/2414622800 >> 172.21.15.81:0/2414622800 conn(0x5571c5edd0f0 msgr2=0x5571c5ef7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:34.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bcf7fe640 0 client.16101 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:34.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf8674740 1 -- 172.21.15.81:0/2414622800 shutdown_connections 2024-09-12T01:30:34.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf8674740 1 -- 172.21.15.81:0/2414622800 wait complete. 2024-09-12T01:30:34.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf8674740 20 client.16101 trim_cache size 0 max 16384 2024-09-12T01:30:34.645 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:30:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:30:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "7a9894e1-fbf6-49b4-99a8-f550c08a4d6d", 2024-09-12T01:30:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:30:34.645 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:30:34.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf629b640 1 -- 172.21.15.81:0/2537749330 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0bd80a2cf0 msgr2=0x7f0bd80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:34.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf629b640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0bd80a2cf0 0x7f0bd80a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0be800add0 tx=0x7f0be800e720 comp rx=0 tx=0).stop 2024-09-12T01:30:34.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf629b640 1 -- 172.21.15.81:0/2537749330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0102790 msgr2=0x7f0bf0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:34.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf629b640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0102790 0x7f0bf0074a30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0be4006010 tx=0x7f0be40042f0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf629b640 1 -- 172.21.15.81:0/2537749330 shutdown_connections 2024-09-12T01:30:34.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf629b640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0bd80a2cf0 0x7f0bd80a51b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf629b640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf0106f10 0x7f0bf0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf629b640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf0102790 0x7f0bf0074a30 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf629b640 1 --2- 172.21.15.81:0/2537749330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0bf0101de0 0x7f0bf00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:34.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.636+0000 7f0bf629b640 1 -- 172.21.15.81:0/2537749330 >> 172.21.15.81:0/2537749330 conn(0x7f0bf00fd8c0 msgr2=0x7f0bf00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:34.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.637+0000 7f0bf629b640 1 -- 172.21.15.81:0/2537749330 shutdown_connections 2024-09-12T01:30:34.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:34.637+0000 7f0bf629b640 1 -- 172.21.15.81:0/2537749330 wait complete. 2024-09-12T01:30:34.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:34 smithi081 ceph-mon[30920]: pgmap v78: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.0 MiB/s wr, 892 op/s 2024-09-12T01:30:35.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:34 smithi100 ceph-mon[35275]: pgmap v78: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.0 MiB/s wr, 892 op/s 2024-09-12T01:30:35.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:34 smithi189 ceph-mon[35357]: pgmap v78: 97 pgs: 97 active+clean; 311 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.0 MiB/s wr, 892 op/s 2024-09-12T01:30:35.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:30:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:30:36.104 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:35 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:30:36.104 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:35 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:30:36.104 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:35 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:30:36.104 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:35 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:30:36.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.185+0000 7f1fd478e640 1 -- 172.21.15.81:0/3147470770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fcc106f10 msgr2=0x7f1fcc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:36.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.185+0000 7f1fd478e640 1 --2- 172.21.15.81:0/3147470770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fcc106f10 0x7f1fcc10ea90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009ca0 tx=0x7f1fc402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.185+0000 7f1fd478e640 1 -- 172.21.15.81:0/3147470770 shutdown_connections 2024-09-12T01:30:36.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.185+0000 7f1fd478e640 1 --2- 172.21.15.81:0/3147470770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fcc106f10 0x7f1fcc10ea90 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.185+0000 7f1fd478e640 1 --2- 172.21.15.81:0/3147470770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fcc102790 0x7f1fcc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.185+0000 7f1fd478e640 1 --2- 172.21.15.81:0/3147470770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fcc101de0 0x7f1fcc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.185+0000 7f1fd478e640 1 -- 172.21.15.81:0/3147470770 >> 172.21.15.81:0/3147470770 conn(0x7f1fcc0fd8c0 msgr2=0x7f1fcc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:36.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.185+0000 7f1fd478e640 1 -- 172.21.15.81:0/3147470770 shutdown_connections 2024-09-12T01:30:36.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.185+0000 7f1fd478e640 1 -- 172.21.15.81:0/3147470770 wait complete. 2024-09-12T01:30:36.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.186+0000 7f1fd478e640 1 Processor -- start 2024-09-12T01:30:36.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.186+0000 7f1fd478e640 1 -- start start 2024-09-12T01:30:36.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.186+0000 7f1fd478e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fcc101de0 0x7f1fcc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.186+0000 7f1fd478e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fcc102790 0x7f1fcc1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.186+0000 7f1fd478e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fcc106f10 0x7f1fcc19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.186+0000 7f1fd478e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc111f70 con 0x7f1fcc101de0 2024-09-12T01:30:36.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.186+0000 7f1fd478e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc111df0 con 0x7f1fcc102790 2024-09-12T01:30:36.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.186+0000 7f1fd478e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1120f0 con 0x7f1fcc106f10 2024-09-12T01:30:36.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.186+0000 7f1fd252a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fcc101de0 0x7f1fcc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.186+0000 7f1fd252a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fcc101de0 0x7f1fcc198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46920/0 (socket says 172.21.15.81:46920) 2024-09-12T01:30:36.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.186+0000 7f1fd252a640 1 -- 172.21.15.81:0/2620910908 learned_addr learned my addr 172.21.15.81:0/2620910908 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:36.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fd2d2b640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fcc106f10 0x7f1fcc19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fd1d29640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fcc102790 0x7f1fcc1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fd252a640 1 -- 172.21.15.81:0/2620910908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fcc106f10 msgr2=0x7f1fcc19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:36.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fd252a640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fcc106f10 0x7f1fcc19cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fd252a640 1 -- 172.21.15.81:0/2620910908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fcc102790 msgr2=0x7f1fcc1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:36.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fd252a640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fcc102790 0x7f1fcc1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fd252a640 1 -- 172.21.15.81:0/2620910908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fcc19d270 con 0x7f1fcc101de0 2024-09-12T01:30:36.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fd2d2b640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fcc106f10 0x7f1fcc19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:36.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fd1d29640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fcc102790 0x7f1fcc1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:30:36.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fd252a640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fcc101de0 0x7f1fcc198360 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800c920 tx=0x7f1fc800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:36.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fc37fe640 1 -- 172.21.15.81:0/2620910908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8007c70 con 0x7f1fcc101de0 2024-09-12T01:30:36.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fc37fe640 1 -- 172.21.15.81:0/2620910908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fc8007e10 con 0x7f1fcc101de0 2024-09-12T01:30:36.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fd478e640 1 -- 172.21.15.81:0/2620910908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fcc19d560 con 0x7f1fcc101de0 2024-09-12T01:30:36.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fc37fe640 1 -- 172.21.15.81:0/2620910908 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8018890 con 0x7f1fcc101de0 2024-09-12T01:30:36.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.187+0000 7f1fd478e640 1 -- 172.21.15.81:0/2620910908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fcc1a4e40 con 0x7f1fcc101de0 2024-09-12T01:30:36.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.189+0000 7f1fc37fe640 1 -- 172.21.15.81:0/2620910908 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f1fc8018a70 con 0x7f1fcc101de0 2024-09-12T01:30:36.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd6b67740 1 Processor -- start 2024-09-12T01:30:36.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd6b67740 1 -- start start 2024-09-12T01:30:36.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd6b67740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba64a0 0x562f7fba6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd6b67740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 0x562f7fbb1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd6b67740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fbb1680 0x562f7fbb3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd6b67740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562f7fb0c2e0 con 0x562f7fba6dc0 2024-09-12T01:30:36.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd6b67740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562f7fab3ce0 con 0x562f7fbb1680 2024-09-12T01:30:36.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd6b67740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562f7fb082a0 con 0x562f7fba64a0 2024-09-12T01:30:36.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fc37fe640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1fb80a2cf0 0x7f1fb80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd252a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 0x562f7fbb1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd252a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 0x562f7fbb1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46926/0 (socket says 172.21.15.81:46926) 2024-09-12T01:30:36.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd252a640 1 -- 172.21.15.81:0/3711655646 learned_addr learned my addr 172.21.15.81:0/3711655646 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:36.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd2d2b640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1fb80a2cf0 0x7f1fb80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd2d2b640 1 --2- 172.21.15.81:0/3711655646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba64a0 0x562f7fba6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fd1d29640 1 --2- 172.21.15.81:0/3711655646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fbb1680 0x562f7fbb3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.190+0000 7f1fc37fe640 1 -- 172.21.15.81:0/2620910908 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1fc80cf620 con 0x7f1fcc101de0 2024-09-12T01:30:36.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.191+0000 7f1fd252a640 1 -- 172.21.15.81:0/3711655646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba64a0 msgr2=0x562f7fba6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:36.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.191+0000 7f1fd252a640 1 --2- 172.21.15.81:0/3711655646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba64a0 0x562f7fba6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.191+0000 7f1fd252a640 1 -- 172.21.15.81:0/3711655646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fbb1680 msgr2=0x562f7fbb3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:36.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.191+0000 7f1fd252a640 1 --2- 172.21.15.81:0/3711655646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fbb1680 0x562f7fbb3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.191+0000 7f1fd252a640 1 -- 172.21.15.81:0/3711655646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f7fa98440 con 0x562f7fba6dc0 2024-09-12T01:30:36.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.191+0000 7f1fd252a640 1 --2- 172.21.15.81:0/3711655646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 0x562f7fbb1140 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80ccd10 tx=0x7f1fc806b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cf30813fb8ad18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:36.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.191+0000 7f1fd2d2b640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1fb80a2cf0 0x7f1fb80a51b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1fc402f540 tx=0x7f1fc4009880 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.191+0000 7f1fc0ff9640 1 -- 172.21.15.81:0/3711655646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc80c5e60 con 0x562f7fba6dc0 2024-09-12T01:30:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.191+0000 7f1fc0ff9640 1 -- 172.21.15.81:0/3711655646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fc800de20 con 0x562f7fba6dc0 2024-09-12T01:30:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.191+0000 7f1fc0ff9640 1 -- 172.21.15.81:0/3711655646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc80a47e0 con 0x562f7fba6dc0 2024-09-12T01:30:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.192+0000 7f1fd6b67740 1 -- 172.21.15.81:0/3711655646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 msgr2=0x562f7fbb1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.192+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/3711655646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 0x562f7fbb1140 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80ccd10 tx=0x7f1fc806b9d0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.192+0000 7f1fd6b67740 1 -- 172.21.15.81:0/3711655646 shutdown_connections 2024-09-12T01:30:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.192+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/3711655646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fbb1680 0x562f7fbb3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.192+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/3711655646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 0x562f7fbb1140 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.192+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/3711655646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba64a0 0x562f7fba6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.192+0000 7f1fd6b67740 1 -- 172.21.15.81:0/3711655646 >> 172.21.15.81:0/3711655646 conn(0x562f7fba2a30 msgr2=0x562f7fba2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.192+0000 7f1fd6b67740 1 -- 172.21.15.81:0/3711655646 shutdown_connections 2024-09-12T01:30:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.192+0000 7f1fd6b67740 1 -- 172.21.15.81:0/3711655646 wait complete. 2024-09-12T01:30:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.192+0000 7f1fd6b67740 1 -- start start 2024-09-12T01:30:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.192+0000 7f1fd6b67740 1 Processor -- start 2024-09-12T01:30:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.192+0000 7f1fd6b67740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba64a0 0x562f7fbb1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd6b67740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba6dc0 0x562f7fbae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd6b67740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 0x562f7fbae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd6b67740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562f7fbb4250 con 0x562f7fbb1680 2024-09-12T01:30:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd6b67740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562f7fac7050 con 0x562f7fba64a0 2024-09-12T01:30:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd6b67740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562f7fbb43d0 con 0x562f7fba6dc0 2024-09-12T01:30:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd6b67740 10 client.0 _ll_register_callbacks cb 0x562f7fb07160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd2d2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 0x562f7fbae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd2d2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 0x562f7fbae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46940/0 (socket says 172.21.15.81:46940) 2024-09-12T01:30:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd2d2b640 1 -- 172.21.15.81:0/754826483 learned_addr learned my addr 172.21.15.81:0/754826483 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd252a640 1 --2- 172.21.15.81:0/754826483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba64a0 0x562f7fbb1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd1d29640 1 --2- 172.21.15.81:0/754826483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba6dc0 0x562f7fbae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd2d2b640 1 -- 172.21.15.81:0/754826483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba6dc0 msgr2=0x562f7fbae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd2d2b640 1 --2- 172.21.15.81:0/754826483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba6dc0 0x562f7fbae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd2d2b640 1 -- 172.21.15.81:0/754826483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba64a0 msgr2=0x562f7fbb1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd2d2b640 1 --2- 172.21.15.81:0/754826483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba64a0 0x562f7fbb1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd2d2b640 1 -- 172.21.15.81:0/754826483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f7f87d3c0 con 0x562f7fbb1680 2024-09-12T01:30:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd2d2b640 1 --2- 172.21.15.81:0/754826483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 0x562f7fbae8f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4035000 tx=0x7f1fc404a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9233a470b03f89e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fb5ffb640 1 -- 172.21.15.81:0/754826483 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc402fd20 con 0x562f7fbb1680 2024-09-12T01:30:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fd6b67740 1 -- 172.21.15.81:0/754826483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fc800de20 con 0x562f7fbb1680 2024-09-12T01:30:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.193+0000 7f1fb5ffb640 1 -- 172.21.15.81:0/754826483 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1fc40305c0 con 0x562f7fbb1680 2024-09-12T01:30:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.194+0000 7f1fb5ffb640 1 -- 172.21.15.81:0/754826483 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1fc402fec0 con 0x562f7fbb1680 2024-09-12T01:30:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.194+0000 7f1fd6b67740 10 client.16113 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.194+0000 7f1fd6b67740 1 -- 172.21.15.81:0/754826483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562f7fbbfc80 con 0x562f7fbb1680 2024-09-12T01:30:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.194+0000 7f1fb5ffb640 1 -- 172.21.15.81:0/754826483 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fc800de20 con 0x562f7fbb1680 2024-09-12T01:30:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.194+0000 7f1fb5ffb640 1 -- 172.21.15.81:0/754826483 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1fc404a070 con 0x562f7fbb1680 2024-09-12T01:30:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.194+0000 7f1fd6b67740 10 client.16113 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.194+0000 7f1fd6b67740 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:30:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.194+0000 7f1fd6b67740 20 client.16113 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.194+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/754826483 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562f7fbc10e0 0x562f7fbc3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.194+0000 7f1fd6b67740 4 client.16113 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:30:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.194+0000 7f1fd6b67740 1 -- 172.21.15.81:0/754826483 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f7fb19850 con 0x562f7fbc10e0 2024-09-12T01:30:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.194+0000 7f1fd252a640 1 --2- 172.21.15.81:0/754826483 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562f7fbc10e0 0x562f7fbc3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fb5ffb640 10 client.16113 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fd252a640 1 --2- 172.21.15.81:0/754826483 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562f7fbc10e0 0x562f7fbc3540 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78aa66dc13e6139c server_cookie=6e3ea1996acdfc33 in_seq=0 out_seq=0 2024-09-12T01:30:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fb5ffb640 1 -- 172.21.15.81:0/754826483 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f7fb19850 con 0x562f7fbc10e0 2024-09-12T01:30:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fb5ffb640 10 client.16113 handle_command_reply: tid=0 2024-09-12T01:30:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fd6b67740 1 client.16113 shutdown 2024-09-12T01:30:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fd6b67740 1 -- 172.21.15.81:0/754826483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 msgr2=0x562f7fbae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/754826483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 0x562f7fbae8f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4035000 tx=0x7f1fc404a000 comp rx=0 tx=0).stop 2024-09-12T01:30:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fd6b67740 1 -- 172.21.15.81:0/754826483 shutdown_connections 2024-09-12T01:30:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/754826483 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562f7fbc10e0 0x562f7fbc3540 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/754826483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 0x562f7fbae8f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/754826483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba6dc0 0x562f7fbae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/754826483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba64a0 0x562f7fbb1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fd6b67740 1 -- 172.21.15.81:0/754826483 >> 172.21.15.81:0/754826483 conn(0x562f7fba2a30 msgr2=0x562f7fba8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.195+0000 7f1fb5ffb640 0 client.16113 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:36.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.196+0000 7f1fd6b67740 1 -- 172.21.15.81:0/754826483 shutdown_connections 2024-09-12T01:30:36.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.196+0000 7f1fd6b67740 1 -- 172.21.15.81:0/754826483 wait complete. 2024-09-12T01:30:36.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.196+0000 7f1fd6b67740 20 client.16113 trim_cache size 0 max 16384 2024-09-12T01:30:36.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.215+0000 7f1fd6b67740 1 Processor -- start 2024-09-12T01:30:36.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.215+0000 7f1fd6b67740 1 -- start start 2024-09-12T01:30:36.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.215+0000 7f1fd6b67740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba64a0 0x562f7fbb0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.215+0000 7f1fd6b67740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba6dc0 0x562f7fbc8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.216+0000 7f1fd6b67740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 0x562f7fbc9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.216+0000 7f1fd6b67740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1ad7a0 con 0x562f7fbb1680 2024-09-12T01:30:36.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.216+0000 7f1fd6b67740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1af2e0 con 0x562f7fba6dc0 2024-09-12T01:30:36.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.216+0000 7f1fd6b67740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1ade70 con 0x562f7fba64a0 2024-09-12T01:30:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.216+0000 7f1fd2d2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 0x562f7fbc9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.216+0000 7f1fd2d2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 0x562f7fbc9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46950/0 (socket says 172.21.15.81:46950) 2024-09-12T01:30:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.216+0000 7f1fd2d2b640 1 -- 172.21.15.81:0/189216660 learned_addr learned my addr 172.21.15.81:0/189216660 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.216+0000 7f1fd1d29640 1 --2- 172.21.15.81:0/189216660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba6dc0 0x562f7fbc8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.216+0000 7f1fd2d2b640 1 -- 172.21.15.81:0/189216660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba64a0 msgr2=0x562f7fbb0270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:30:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.216+0000 7f1fd2d2b640 1 --2- 172.21.15.81:0/189216660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba64a0 0x562f7fbb0270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.216+0000 7f1fd2d2b640 1 -- 172.21.15.81:0/189216660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba6dc0 msgr2=0x562f7fbc8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.216+0000 7f1fd2d2b640 1 --2- 172.21.15.81:0/189216660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba6dc0 0x562f7fbc8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.216+0000 7f1fd2d2b640 1 -- 172.21.15.81:0/189216660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f7fba6bf0 con 0x562f7fbb1680 2024-09-12T01:30:36.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.217+0000 7f1fd2d2b640 1 --2- 172.21.15.81:0/189216660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 0x562f7fbc9390 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009ca0 tx=0x7f1fc40314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd750769e6a2d64a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.217+0000 7f1fb7fff640 1 -- 172.21.15.81:0/189216660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4063030 con 0x562f7fbb1680 2024-09-12T01:30:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.217+0000 7f1fb7fff640 1 -- 172.21.15.81:0/189216660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fc4036040 con 0x562f7fbb1680 2024-09-12T01:30:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.217+0000 7f1fb7fff640 1 -- 172.21.15.81:0/189216660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4004b40 con 0x562f7fbb1680 2024-09-12T01:30:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.218+0000 7f1fd6b67740 1 -- 172.21.15.81:0/189216660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 msgr2=0x562f7fbc9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.218+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/189216660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 0x562f7fbc9390 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009ca0 tx=0x7f1fc40314e0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.218+0000 7f1fd6b67740 1 -- 172.21.15.81:0/189216660 shutdown_connections 2024-09-12T01:30:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.218+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/189216660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fbb1680 0x562f7fbc9390 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.218+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/189216660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba6dc0 0x562f7fbc8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.218+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/189216660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fba64a0 0x562f7fbb0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.218+0000 7f1fd6b67740 1 -- 172.21.15.81:0/189216660 >> 172.21.15.81:0/189216660 conn(0x562f7fba2a30 msgr2=0x562f7fbafb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.218+0000 7f1fd6b67740 1 -- 172.21.15.81:0/189216660 shutdown_connections 2024-09-12T01:30:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.219+0000 7f1fd6b67740 1 -- 172.21.15.81:0/189216660 wait complete. 2024-09-12T01:30:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.219+0000 7f1fd6b67740 1 -- start start 2024-09-12T01:30:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.219+0000 7f1fd6b67740 1 Processor -- start 2024-09-12T01:30:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.219+0000 7f1fd6b67740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba64a0 0x562f7fbb9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.219+0000 7f1fd6b67740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 0x562f7fc26e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.219+0000 7f1fd6b67740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fbb1680 0x562f7fc27350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd6b67740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1aec10 con 0x562f7fba6dc0 2024-09-12T01:30:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd6b67740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1ae540 con 0x562f7fba64a0 2024-09-12T01:30:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd6b67740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1ab780 con 0x562f7fbb1680 2024-09-12T01:30:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd6b67740 10 client.0 _ll_register_callbacks cb 0x7f1fc402f3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:30:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd1d29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 0x562f7fc26e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd1d29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 0x562f7fc26e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46960/0 (socket says 172.21.15.81:46960) 2024-09-12T01:30:36.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd1d29640 1 -- 172.21.15.81:0/3362833661 learned_addr learned my addr 172.21.15.81:0/3362833661 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:30:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd2d2b640 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fbb1680 0x562f7fc27350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd1d29640 1 -- 172.21.15.81:0/3362833661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fbb1680 msgr2=0x562f7fc27350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd1d29640 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fbb1680 0x562f7fc27350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd1d29640 1 -- 172.21.15.81:0/3362833661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba64a0 msgr2=0x562f7fbb9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:30:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd252a640 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba64a0 0x562f7fbb9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd1d29640 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba64a0 0x562f7fbb9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd1d29640 1 -- 172.21.15.81:0/3362833661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f7fc27910 con 0x562f7fba6dc0 2024-09-12T01:30:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd2d2b640 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fbb1680 0x562f7fc27350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.220+0000 7f1fd252a640 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba64a0 0x562f7fbb9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:30:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.221+0000 7f1fd1d29640 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 0x562f7fc26e10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0fe0c0 tx=0x7f1fbc010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de34a1d72a2f286 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:30:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.221+0000 7f1fb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:30:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.221+0000 7f1fb5ffb640 1 -- 172.21.15.81:0/3362833661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc00f8a0 con 0x562f7fba6dc0 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.221+0000 7f1fb5ffb640 1 -- 172.21.15.81:0/3362833661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f1fbc00fa40 con 0x562f7fba6dc0 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.221+0000 7f1fd6b67740 1 -- 172.21.15.81:0/3362833661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fc4036040 con 0x562f7fba6dc0 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.221+0000 7f1fb5ffb640 1 -- 172.21.15.81:0/3362833661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1fbc00fc40 con 0x562f7fba6dc0 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.221+0000 7f1fd6b67740 10 client.16119 fetch_fsmap learned FSMap version 28 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.221+0000 7f1fd6b67740 1 -- 172.21.15.81:0/3362833661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562f7fc30230 con 0x562f7fba6dc0 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.222+0000 7f1fb5ffb640 1 -- 172.21.15.81:0/3362833661 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fc4036040 con 0x562f7fba6dc0 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.222+0000 7f1fb5ffb640 1 -- 172.21.15.81:0/3362833661 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1fbc01a030 con 0x562f7fba6dc0 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.222+0000 7f1fd6b67740 10 client.16119 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.222+0000 7f1fd6b67740 10 client.16119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.222+0000 7f1fd6b67740 20 client.16119 populate_metadata read hostname 'smithi081' 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.222+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562f7fc308f0 0x562f7fc32d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.222+0000 7f1fd6b67740 4 client.16119 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.222+0000 7f1fd6b67740 1 -- 172.21.15.81:0/3362833661 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562f7fb13d60 con 0x562f7fc308f0 2024-09-12T01:30:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.222+0000 7f1fd252a640 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562f7fc308f0 0x562f7fc32d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:30:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.223+0000 7f1fb5ffb640 10 client.16119 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.223+0000 7f1fd252a640 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562f7fc308f0 0x562f7fc32d10 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9c9244be1bad1da server_cookie=a17cf8d6a1786457 in_seq=0 out_seq=0 2024-09-12T01:30:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.223+0000 7f1fb5ffb640 1 -- 172.21.15.81:0/3362833661 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562f7fb13d60 con 0x562f7fc308f0 2024-09-12T01:30:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.223+0000 7f1fb5ffb640 10 client.16119 handle_command_reply: tid=0 2024-09-12T01:30:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.223+0000 7f1fd6b67740 1 client.16119 shutdown 2024-09-12T01:30:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.224+0000 7f1fd6b67740 1 -- 172.21.15.81:0/3362833661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 msgr2=0x562f7fc26e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.224+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 0x562f7fc26e10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0fe0c0 tx=0x7f1fbc010e90 comp rx=0 tx=0).stop 2024-09-12T01:30:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.224+0000 7f1fd6b67740 1 -- 172.21.15.81:0/3362833661 shutdown_connections 2024-09-12T01:30:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.224+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562f7fc308f0 0x562f7fc32d10 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.224+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562f7fbb1680 0x562f7fc27350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.224+0000 7f1fb5ffb640 0 client.16119 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:30:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.224+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f7fba6dc0 0x562f7fc26e10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.224+0000 7f1fd6b67740 1 --2- 172.21.15.81:0/3362833661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f7fba64a0 0x562f7fbb9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.224+0000 7f1fd6b67740 1 -- 172.21.15.81:0/3362833661 >> 172.21.15.81:0/3362833661 conn(0x562f7fba2a30 msgr2=0x562f7fbb0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:36.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.224+0000 7f1fd6b67740 1 -- 172.21.15.81:0/3362833661 shutdown_connections 2024-09-12T01:30:36.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.225+0000 7f1fd6b67740 1 -- 172.21.15.81:0/3362833661 wait complete. 2024-09-12T01:30:36.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.225+0000 7f1fd6b67740 20 client.16119 trim_cache size 0 max 16384 2024-09-12T01:30:36.236 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:30:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:30:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-12T01:30:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "7a9894e1-fbf6-49b4-99a8-f550c08a4d6d": { 2024-09-12T01:30:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-09-12T01:30:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "7a9894e1-fbf6-49b4-99a8-f550c08a4d6d", 2024-09-12T01:30:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-12T01:30:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:30:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:30:36.237 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:30:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.226+0000 7f1fd478e640 1 -- 172.21.15.81:0/2620910908 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1fb80a2cf0 msgr2=0x7f1fb80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.226+0000 7f1fd478e640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1fb80a2cf0 0x7f1fb80a51b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1fc402f540 tx=0x7f1fc4009880 comp rx=0 tx=0).stop 2024-09-12T01:30:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.226+0000 7f1fd478e640 1 -- 172.21.15.81:0/2620910908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fcc101de0 msgr2=0x7f1fcc198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:30:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.226+0000 7f1fd478e640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fcc101de0 0x7f1fcc198360 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800c920 tx=0x7f1fc800cde0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.226+0000 7f1fd478e640 1 -- 172.21.15.81:0/2620910908 shutdown_connections 2024-09-12T01:30:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.226+0000 7f1fd478e640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f1fb80a2cf0 0x7f1fb80a51b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.226+0000 7f1fd478e640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1fcc106f10 0x7f1fcc19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.226+0000 7f1fd478e640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fcc102790 0x7f1fcc1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.226+0000 7f1fd478e640 1 --2- 172.21.15.81:0/2620910908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fcc101de0 0x7f1fcc198360 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:30:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.226+0000 7f1fd478e640 1 -- 172.21.15.81:0/2620910908 >> 172.21.15.81:0/2620910908 conn(0x7f1fcc0fd8c0 msgr2=0x7f1fcc0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:30:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.227+0000 7f1fd478e640 1 -- 172.21.15.81:0/2620910908 shutdown_connections 2024-09-12T01:30:36.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:30:36.227+0000 7f1fd478e640 1 -- 172.21.15.81:0/2620910908 wait complete. 2024-09-12T01:30:36.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:35 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:30:36.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:35 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:30:36.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:35 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:30:36.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:35 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:30:36.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:35 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:30:36.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:35 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:30:36.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:35 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:30:36.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:35 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:30:36.935 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:36 smithi081 ceph-mon[30920]: pgmap v79: 97 pgs: 97 active+clean; 454 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 902 op/s 2024-09-12T01:30:36.963 INFO:tasks.cephfs.filesystem:scrub status for tag:7a9894e1-fbf6-49b4-99a8-f550c08a4d6d - {'path': '/', 'tag': '7a9894e1-fbf6-49b4-99a8-f550c08a4d6d', 'options': 'recursive,force'} 2024-09-12T01:30:37.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:36 smithi100 ceph-mon[35275]: pgmap v79: 97 pgs: 97 active+clean; 454 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 902 op/s 2024-09-12T01:30:37.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:36 smithi189 ceph-mon[35357]: pgmap v79: 97 pgs: 97 active+clean; 454 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 902 op/s 2024-09-12T01:30:39.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:38 smithi081 ceph-mon[30920]: pgmap v80: 97 pgs: 97 active+clean; 454 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2024-09-12T01:30:39.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:38 smithi100 ceph-mon[35275]: pgmap v80: 97 pgs: 97 active+clean; 454 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2024-09-12T01:30:39.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:38 smithi189 ceph-mon[35357]: pgmap v80: 97 pgs: 97 active+clean; 454 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 15 MiB/s wr, 14 op/s 2024-09-12T01:30:40.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:39 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:30:40.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:39 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:30:40.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:39 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:30:41.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:40 smithi081 ceph-mon[30920]: pgmap v81: 97 pgs: 97 active+clean; 515 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 MiB/s wr, 21 op/s 2024-09-12T01:30:41.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:40 smithi100 ceph-mon[35275]: pgmap v81: 97 pgs: 97 active+clean; 515 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 MiB/s wr, 21 op/s 2024-09-12T01:30:41.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:40 smithi189 ceph-mon[35357]: pgmap v81: 97 pgs: 97 active+clean; 515 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 MiB/s wr, 21 op/s 2024-09-12T01:30:43.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:42 smithi081 ceph-mon[30920]: pgmap v82: 97 pgs: 97 active+clean; 515 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 21 MiB/s wr, 15 op/s 2024-09-12T01:30:43.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:42 smithi100 ceph-mon[35275]: pgmap v82: 97 pgs: 97 active+clean; 515 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 21 MiB/s wr, 15 op/s 2024-09-12T01:30:43.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:42 smithi189 ceph-mon[35357]: pgmap v82: 97 pgs: 97 active+clean; 515 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 21 MiB/s wr, 15 op/s 2024-09-12T01:30:45.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:44 smithi081 ceph-mon[30920]: pgmap v83: 97 pgs: 97 active+clean; 515 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 21 MiB/s wr, 15 op/s 2024-09-12T01:30:45.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:44 smithi100 ceph-mon[35275]: pgmap v83: 97 pgs: 97 active+clean; 515 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 21 MiB/s wr, 15 op/s 2024-09-12T01:30:45.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:44 smithi189 ceph-mon[35357]: pgmap v83: 97 pgs: 97 active+clean; 515 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 21 MiB/s wr, 15 op/s 2024-09-12T01:30:47.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:46 smithi081 ceph-mon[30920]: pgmap v84: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 21 MiB/s wr, 26 op/s 2024-09-12T01:30:47.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:46 smithi100 ceph-mon[35275]: pgmap v84: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 21 MiB/s wr, 26 op/s 2024-09-12T01:30:47.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:46 smithi189 ceph-mon[35357]: pgmap v84: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 21 MiB/s wr, 26 op/s 2024-09-12T01:30:49.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:48 smithi081 ceph-mon[30920]: pgmap v85: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.3 MiB/s wr, 16 op/s 2024-09-12T01:30:49.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:48 smithi100 ceph-mon[35275]: pgmap v85: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.3 MiB/s wr, 16 op/s 2024-09-12T01:30:49.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:48 smithi189 ceph-mon[35357]: pgmap v85: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.3 MiB/s wr, 16 op/s 2024-09-12T01:30:51.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:50 smithi081 ceph-mon[30920]: pgmap v86: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 MiB/s wr, 20 op/s 2024-09-12T01:30:51.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:50 smithi100 ceph-mon[35275]: pgmap v86: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 MiB/s wr, 20 op/s 2024-09-12T01:30:51.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:50 smithi189 ceph-mon[35357]: pgmap v86: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 MiB/s wr, 20 op/s 2024-09-12T01:30:53.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:52 smithi081 ceph-mon[30920]: pgmap v87: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-12T01:30:53.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:52 smithi100 ceph-mon[35275]: pgmap v87: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-12T01:30:53.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:52 smithi189 ceph-mon[35357]: pgmap v87: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-12T01:30:55.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:54 smithi081 ceph-mon[30920]: pgmap v88: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-12T01:30:55.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:54 smithi100 ceph-mon[35275]: pgmap v88: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-12T01:30:55.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:54 smithi189 ceph-mon[35357]: pgmap v88: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-12T01:30:57.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:56 smithi081 ceph-mon[30920]: pgmap v89: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.8 KiB/s wr, 18 op/s 2024-09-12T01:30:57.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:56 smithi100 ceph-mon[35275]: pgmap v89: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.8 KiB/s wr, 18 op/s 2024-09-12T01:30:57.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:56 smithi189 ceph-mon[35357]: pgmap v89: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.8 KiB/s wr, 18 op/s 2024-09-12T01:30:59.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:30:58 smithi081 ceph-mon[30920]: pgmap v90: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-12T01:30:59.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:30:58 smithi100 ceph-mon[35275]: pgmap v90: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-12T01:30:59.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:30:58 smithi189 ceph-mon[35357]: pgmap v90: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-12T01:31:01.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:00 smithi081 ceph-mon[30920]: pgmap v91: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-12T01:31:01.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:00 smithi100 ceph-mon[35275]: pgmap v91: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-12T01:31:01.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:00 smithi189 ceph-mon[35357]: pgmap v91: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-12T01:31:03.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:02 smithi081 ceph-mon[30920]: pgmap v92: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-12T01:31:03.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:02 smithi100 ceph-mon[35275]: pgmap v92: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-12T01:31:03.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:02 smithi189 ceph-mon[35357]: pgmap v92: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-12T01:31:05.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:04 smithi081 ceph-mon[30920]: pgmap v93: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-12T01:31:05.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:04 smithi100 ceph-mon[35275]: pgmap v93: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-12T01:31:05.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:04 smithi189 ceph-mon[35357]: pgmap v93: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-12T01:31:06.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:31:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:07.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:06 smithi081 ceph-mon[30920]: pgmap v94: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-12T01:31:07.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:06 smithi100 ceph-mon[35275]: pgmap v94: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-12T01:31:07.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:06 smithi189 ceph-mon[35357]: pgmap v94: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-12T01:31:07.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.853+0000 7ff33370c640 1 -- 172.21.15.81:0/4212384856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c105f40 msgr2=0x7ff32c1063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:07.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.853+0000 7ff33370c640 1 --2- 172.21.15.81:0/4212384856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c105f40 0x7ff32c1063d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff324009ca0 tx=0x7ff32402a940 comp rx=0 tx=0).stop 2024-09-12T01:31:07.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.853+0000 7ff33370c640 1 -- 172.21.15.81:0/4212384856 shutdown_connections 2024-09-12T01:31:07.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.853+0000 7ff33370c640 1 --2- 172.21.15.81:0/4212384856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c105f40 0x7ff32c1063d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.853+0000 7ff33370c640 1 --2- 172.21.15.81:0/4212384856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c101450 0x7ff32c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.853+0000 7ff33370c640 1 --2- 172.21.15.81:0/4212384856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c100b30 0x7ff32c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.853+0000 7ff33370c640 1 -- 172.21.15.81:0/4212384856 >> 172.21.15.81:0/4212384856 conn(0x7ff32c0fc7a0 msgr2=0x7ff32c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:07.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.853+0000 7ff33370c640 1 -- 172.21.15.81:0/4212384856 shutdown_connections 2024-09-12T01:31:07.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.853+0000 7ff33370c640 1 -- 172.21.15.81:0/4212384856 wait complete. 2024-09-12T01:31:07.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff33370c640 1 Processor -- start 2024-09-12T01:31:07.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff33370c640 1 -- start start 2024-09-12T01:31:07.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff33370c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c100b30 0x7ff32c1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff33370c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c101450 0x7ff32c1a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff33370c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c105f40 0x7ff32c19e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff33370c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c118580 con 0x7ff32c101450 2024-09-12T01:31:07.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff33370c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c118400 con 0x7ff32c100b30 2024-09-12T01:31:07.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff33370c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c118700 con 0x7ff32c105f40 2024-09-12T01:31:07.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff330ca7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c101450 0x7ff32c1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff330ca7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c101450 0x7ff32c1a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57278/0 (socket says 172.21.15.81:57278) 2024-09-12T01:31:07.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff330ca7640 1 -- 172.21.15.81:0/33715715 learned_addr learned my addr 172.21.15.81:0/33715715 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:07.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff331ca9640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c105f40 0x7ff32c19e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff3314a8640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c100b30 0x7ff32c1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff330ca7640 1 -- 172.21.15.81:0/33715715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c105f40 msgr2=0x7ff32c19e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:07.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff330ca7640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c105f40 0x7ff32c19e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff330ca7640 1 -- 172.21.15.81:0/33715715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c100b30 msgr2=0x7ff32c1a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:07.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff330ca7640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c100b30 0x7ff32c1a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff330ca7640 1 -- 172.21.15.81:0/33715715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c19eff0 con 0x7ff32c101450 2024-09-12T01:31:07.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.854+0000 7ff331ca9640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c105f40 0x7ff32c19e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:07.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.855+0000 7ff330ca7640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c101450 0x7ff32c1a4c10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00d750 tx=0x7ff31c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:07.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.855+0000 7ff3227fc640 1 -- 172.21.15.81:0/33715715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c017070 con 0x7ff32c101450 2024-09-12T01:31:07.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.855+0000 7ff33370c640 1 -- 172.21.15.81:0/33715715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32c19f2e0 con 0x7ff32c101450 2024-09-12T01:31:07.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.855+0000 7ff3227fc640 1 -- 172.21.15.81:0/33715715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff31c005020 con 0x7ff32c101450 2024-09-12T01:31:07.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.855+0000 7ff3227fc640 1 -- 172.21.15.81:0/33715715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c004d00 con 0x7ff32c101450 2024-09-12T01:31:07.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.855+0000 7ff33370c640 1 -- 172.21.15.81:0/33715715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32c1ab530 con 0x7ff32c101450 2024-09-12T01:31:07.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.857+0000 7ff3227fc640 1 -- 172.21.15.81:0/33715715 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff31c009a30 con 0x7ff32c101450 2024-09-12T01:31:07.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.857+0000 7ff335ae5740 1 Processor -- start 2024-09-12T01:31:07.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.857+0000 7ff335ae5740 1 -- start start 2024-09-12T01:31:07.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff335ae5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d24a0 0x55fc037d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff335ae5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d2dc0 0x55fc037dd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff335ae5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037dd680 0x55fc037dfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff335ae5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fc037382e0 con 0x55fc037d2dc0 2024-09-12T01:31:07.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff335ae5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fc036dfce0 con 0x55fc037d24a0 2024-09-12T01:31:07.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff335ae5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fc037342a0 con 0x55fc037dd680 2024-09-12T01:31:07.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff3314a8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d2dc0 0x55fc037dd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff3314a8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d2dc0 0x55fc037dd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57294/0 (socket says 172.21.15.81:57294) 2024-09-12T01:31:07.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff3314a8640 1 -- 172.21.15.81:0/3657649923 learned_addr learned my addr 172.21.15.81:0/3657649923 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:07.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff3227fc640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff3180a2cf0 0x7ff3180a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff331ca9640 1 --2- 172.21.15.81:0/3657649923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d24a0 0x55fc037d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff330ca7640 1 --2- 172.21.15.81:0/3657649923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037dd680 0x55fc037dfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff3314a8640 1 -- 172.21.15.81:0/3657649923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037dd680 msgr2=0x55fc037dfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:07.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff3314a8640 1 --2- 172.21.15.81:0/3657649923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037dd680 0x55fc037dfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff331ca9640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff3180a2cf0 0x7ff3180a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff3314a8640 1 -- 172.21.15.81:0/3657649923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d24a0 msgr2=0x55fc037d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:07.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff3314a8640 1 --2- 172.21.15.81:0/3657649923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d24a0 0x55fc037d2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff3314a8640 1 -- 172.21.15.81:0/3657649923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc036c4440 con 0x55fc037d2dc0 2024-09-12T01:31:07.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff3227fc640 1 -- 172.21.15.81:0/33715715 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff31c0cee90 con 0x7ff32c101450 2024-09-12T01:31:07.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.858+0000 7ff3314a8640 1 --2- 172.21.15.81:0/3657649923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d2dc0 0x55fc037dd140 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff32800bcb0 tx=0x7ff32800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1008ab7b15a6e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:07.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.859+0000 7ff3177fe640 1 -- 172.21.15.81:0/3657649923 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328015070 con 0x55fc037d2dc0 2024-09-12T01:31:07.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.859+0000 7ff331ca9640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff3180a2cf0 0x7ff3180a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff324004af0 tx=0x7ff32402a940 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:07.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.859+0000 7ff3177fe640 1 -- 172.21.15.81:0/3657649923 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff328011920 con 0x55fc037d2dc0 2024-09-12T01:31:07.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.859+0000 7ff3177fe640 1 -- 172.21.15.81:0/3657649923 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328010930 con 0x55fc037d2dc0 2024-09-12T01:31:07.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.859+0000 7ff335ae5740 1 -- 172.21.15.81:0/3657649923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d2dc0 msgr2=0x55fc037dd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:07.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.859+0000 7ff335ae5740 1 --2- 172.21.15.81:0/3657649923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d2dc0 0x55fc037dd140 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff32800bcb0 tx=0x7ff32800f730 comp rx=0 tx=0).stop 2024-09-12T01:31:07.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.859+0000 7ff335ae5740 1 -- 172.21.15.81:0/3657649923 shutdown_connections 2024-09-12T01:31:07.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.859+0000 7ff335ae5740 1 --2- 172.21.15.81:0/3657649923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037dd680 0x55fc037dfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.859+0000 7ff335ae5740 1 --2- 172.21.15.81:0/3657649923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d2dc0 0x55fc037dd140 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.859+0000 7ff335ae5740 1 --2- 172.21.15.81:0/3657649923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d24a0 0x55fc037d2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.859+0000 7ff335ae5740 1 -- 172.21.15.81:0/3657649923 >> 172.21.15.81:0/3657649923 conn(0x55fc037cea30 msgr2=0x55fc037cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:07.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.859+0000 7ff335ae5740 1 -- 172.21.15.81:0/3657649923 shutdown_connections 2024-09-12T01:31:07.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.859+0000 7ff335ae5740 1 -- 172.21.15.81:0/3657649923 wait complete. 2024-09-12T01:31:07.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.860+0000 7ff335ae5740 1 -- start start 2024-09-12T01:31:07.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.860+0000 7ff335ae5740 1 Processor -- start 2024-09-12T01:31:07.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.860+0000 7ff335ae5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d24a0 0x55fc037dcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.860+0000 7ff335ae5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d2dc0 0x55fc037da270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.860+0000 7ff335ae5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037dd680 0x55fc037da7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.860+0000 7ff335ae5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fc037e0250 con 0x55fc037dd680 2024-09-12T01:31:07.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.860+0000 7ff335ae5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fc036f3050 con 0x55fc037d2dc0 2024-09-12T01:31:07.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.860+0000 7ff335ae5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fc037e03d0 con 0x55fc037d24a0 2024-09-12T01:31:07.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.860+0000 7ff335ae5740 10 client.0 _ll_register_callbacks cb 0x55fc03733160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:07.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.860+0000 7ff331ca9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037dd680 0x55fc037da7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.860+0000 7ff331ca9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037dd680 0x55fc037da7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57296/0 (socket says 172.21.15.81:57296) 2024-09-12T01:31:07.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.860+0000 7ff331ca9640 1 -- 172.21.15.81:0/2744994147 learned_addr learned my addr 172.21.15.81:0/2744994147 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:07.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.860+0000 7ff330ca7640 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d2dc0 0x55fc037da270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff3314a8640 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d24a0 0x55fc037dcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff331ca9640 1 -- 172.21.15.81:0/2744994147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d24a0 msgr2=0x55fc037dcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:07.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff331ca9640 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d24a0 0x55fc037dcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff331ca9640 1 -- 172.21.15.81:0/2744994147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d2dc0 msgr2=0x55fc037da270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:07.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff331ca9640 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d2dc0 0x55fc037da270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff331ca9640 1 -- 172.21.15.81:0/2744994147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc034a93c0 con 0x55fc037dd680 2024-09-12T01:31:07.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff3314a8640 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d24a0 0x55fc037dcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:07.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff331ca9640 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037dd680 0x55fc037da7b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff324035000 tx=0x7ff3240095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a73842a4207572a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:07.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:07.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff314ff9640 1 -- 172.21.15.81:0/2744994147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324043040 con 0x55fc037dd680 2024-09-12T01:31:07.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff314ff9640 1 -- 172.21.15.81:0/2744994147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff32403cbd0 con 0x55fc037dd680 2024-09-12T01:31:07.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff335ae5740 1 -- 172.21.15.81:0/2744994147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff328011920 con 0x55fc037dd680 2024-09-12T01:31:07.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff314ff9640 1 -- 172.21.15.81:0/2744994147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff324058050 con 0x55fc037dd680 2024-09-12T01:31:07.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff335ae5740 10 client.16131 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:07.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff335ae5740 1 -- 172.21.15.81:0/2744994147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fc037ebc50 con 0x55fc037dd680 2024-09-12T01:31:07.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff314ff9640 1 -- 172.21.15.81:0/2744994147 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff328011920 con 0x55fc037dd680 2024-09-12T01:31:07.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff314ff9640 1 -- 172.21.15.81:0/2744994147 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff324049040 con 0x55fc037dd680 2024-09-12T01:31:07.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.861+0000 7ff335ae5740 10 client.16131 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.862+0000 7ff335ae5740 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:31:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.862+0000 7ff335ae5740 20 client.16131 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.862+0000 7ff335ae5740 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fc037ed110 0x55fc037ef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.862+0000 7ff335ae5740 4 client.16131 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:31:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.862+0000 7ff335ae5740 1 -- 172.21.15.81:0/2744994147 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc03745850 con 0x55fc037ed110 2024-09-12T01:31:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.862+0000 7ff3314a8640 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fc037ed110 0x55fc037ef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.862+0000 7ff314ff9640 10 client.16131 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.862+0000 7ff3314a8640 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fc037ed110 0x55fc037ef5d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=598bbbf4e3941645 server_cookie=a858b4938e0e6702 in_seq=0 out_seq=0 2024-09-12T01:31:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff314ff9640 1 -- 172.21.15.81:0/2744994147 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc03745850 con 0x55fc037ed110 2024-09-12T01:31:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff314ff9640 10 client.16131 handle_command_reply: tid=0 2024-09-12T01:31:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff335ae5740 1 client.16131 shutdown 2024-09-12T01:31:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff335ae5740 1 -- 172.21.15.81:0/2744994147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037dd680 msgr2=0x55fc037da7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:07.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff335ae5740 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037dd680 0x55fc037da7b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff324035000 tx=0x7ff3240095c0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff335ae5740 1 -- 172.21.15.81:0/2744994147 shutdown_connections 2024-09-12T01:31:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff335ae5740 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fc037ed110 0x55fc037ef5d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff335ae5740 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037dd680 0x55fc037da7b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff314ff9640 0 client.16131 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff335ae5740 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d2dc0 0x55fc037da270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff335ae5740 1 --2- 172.21.15.81:0/2744994147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d24a0 0x55fc037dcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff335ae5740 1 -- 172.21.15.81:0/2744994147 >> 172.21.15.81:0/2744994147 conn(0x55fc037cea30 msgr2=0x55fc037d4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff335ae5740 1 -- 172.21.15.81:0/2744994147 shutdown_connections 2024-09-12T01:31:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff335ae5740 1 -- 172.21.15.81:0/2744994147 wait complete. 2024-09-12T01:31:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.863+0000 7ff335ae5740 20 client.16131 trim_cache size 0 max 16384 2024-09-12T01:31:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff335ae5740 1 Processor -- start 2024-09-12T01:31:07.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff335ae5740 1 -- start start 2024-09-12T01:31:07.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff335ae5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037cea30 0x55fc037da230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff335ae5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d24a0 0x55fc037dc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff335ae5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d2dc0 0x55fc037f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff335ae5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b3dc0 con 0x55fc037cea30 2024-09-12T01:31:07.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff335ae5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b5900 con 0x55fc037d2dc0 2024-09-12T01:31:07.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff335ae5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b4490 con 0x55fc037d24a0 2024-09-12T01:31:07.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff3314a8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037cea30 0x55fc037da230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff3314a8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037cea30 0x55fc037da230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57308/0 (socket says 172.21.15.81:57308) 2024-09-12T01:31:07.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff3314a8640 1 -- 172.21.15.81:0/2912427540 learned_addr learned my addr 172.21.15.81:0/2912427540 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:07.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff331ca9640 1 --2- 172.21.15.81:0/2912427540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d2dc0 0x55fc037f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff330ca7640 1 --2- 172.21.15.81:0/2912427540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d24a0 0x55fc037dc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff3314a8640 1 -- 172.21.15.81:0/2912427540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d24a0 msgr2=0x55fc037dc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:07.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff3314a8640 1 --2- 172.21.15.81:0/2912427540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d24a0 0x55fc037dc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff3314a8640 1 -- 172.21.15.81:0/2912427540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d2dc0 msgr2=0x55fc037f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:07.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff3314a8640 1 --2- 172.21.15.81:0/2912427540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d2dc0 0x55fc037f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.881+0000 7ff3314a8640 1 -- 172.21.15.81:0/2912427540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc037d2bf0 con 0x55fc037cea30 2024-09-12T01:31:07.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.882+0000 7ff3314a8640 1 --2- 172.21.15.81:0/2912427540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037cea30 0x55fc037da230 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff3280104e0 tx=0x7ff3280103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a08bab49e3e67e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:07.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.882+0000 7ff316ffd640 1 -- 172.21.15.81:0/2912427540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32802b070 con 0x55fc037cea30 2024-09-12T01:31:07.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.882+0000 7ff316ffd640 1 -- 172.21.15.81:0/2912427540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff328005520 con 0x55fc037cea30 2024-09-12T01:31:07.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.882+0000 7ff316ffd640 1 -- 172.21.15.81:0/2912427540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328015040 con 0x55fc037cea30 2024-09-12T01:31:07.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.883+0000 7ff335ae5740 1 -- 172.21.15.81:0/2912427540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037cea30 msgr2=0x55fc037da230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:07.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.883+0000 7ff335ae5740 1 --2- 172.21.15.81:0/2912427540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037cea30 0x55fc037da230 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff3280104e0 tx=0x7ff3280103d0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.883+0000 7ff335ae5740 1 -- 172.21.15.81:0/2912427540 shutdown_connections 2024-09-12T01:31:07.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.883+0000 7ff335ae5740 1 --2- 172.21.15.81:0/2912427540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037d2dc0 0x55fc037f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.883+0000 7ff335ae5740 1 --2- 172.21.15.81:0/2912427540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d24a0 0x55fc037dc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.883+0000 7ff335ae5740 1 --2- 172.21.15.81:0/2912427540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037cea30 0x55fc037da230 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.883+0000 7ff335ae5740 1 -- 172.21.15.81:0/2912427540 >> 172.21.15.81:0/2912427540 conn(0x55fc037da910 msgr2=0x55fc037dbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:07.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.883+0000 7ff335ae5740 1 -- 172.21.15.81:0/2912427540 shutdown_connections 2024-09-12T01:31:07.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.883+0000 7ff335ae5740 1 -- 172.21.15.81:0/2912427540 wait complete. 2024-09-12T01:31:07.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.883+0000 7ff335ae5740 1 -- start start 2024-09-12T01:31:07.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.883+0000 7ff335ae5740 1 Processor -- start 2024-09-12T01:31:07.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff335ae5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037cea30 0x55fc037e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff335ae5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d24a0 0x55fc037e30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff335ae5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d2dc0 0x55fc037e3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff335ae5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b5230 con 0x55fc037d24a0 2024-09-12T01:31:07.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff335ae5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b4b60 con 0x55fc037cea30 2024-09-12T01:31:07.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff335ae5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b1da0 con 0x55fc037d2dc0 2024-09-12T01:31:07.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff335ae5740 10 client.0 _ll_register_callbacks cb 0x7ff324009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff330ca7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d24a0 0x55fc037e30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff330ca7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d24a0 0x55fc037e30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57318/0 (socket says 172.21.15.81:57318) 2024-09-12T01:31:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff330ca7640 1 -- 172.21.15.81:0/3145144542 learned_addr learned my addr 172.21.15.81:0/3145144542 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff3314a8640 1 --2- 172.21.15.81:0/3145144542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037cea30 0x55fc037e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff331ca9640 1 --2- 172.21.15.81:0/3145144542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d2dc0 0x55fc037e3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff330ca7640 1 -- 172.21.15.81:0/3145144542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d2dc0 msgr2=0x55fc037e3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff330ca7640 1 --2- 172.21.15.81:0/3145144542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d2dc0 0x55fc037e3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff330ca7640 1 -- 172.21.15.81:0/3145144542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037cea30 msgr2=0x55fc037e5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff330ca7640 1 --2- 172.21.15.81:0/3145144542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037cea30 0x55fc037e5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff330ca7640 1 -- 172.21.15.81:0/3145144542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc037e3e30 con 0x55fc037d24a0 2024-09-12T01:31:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff330ca7640 1 --2- 172.21.15.81:0/3145144542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d24a0 0x55fc037e30f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00b620 tx=0x7ff31c09b270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d212b44c4bbe503 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.884+0000 7ff314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff314ff9640 1 -- 172.21.15.81:0/3145144542 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c020040 con 0x55fc037d24a0 2024-09-12T01:31:07.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff314ff9640 1 -- 172.21.15.81:0/3145144542 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff31c0051d0 con 0x55fc037d24a0 2024-09-12T01:31:07.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff335ae5740 1 -- 172.21.15.81:0/3145144542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff328005520 con 0x55fc037d24a0 2024-09-12T01:31:07.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff314ff9640 1 -- 172.21.15.81:0/3145144542 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff31c0b8030 con 0x55fc037d24a0 2024-09-12T01:31:07.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff335ae5740 10 client.16137 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:07.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff335ae5740 1 -- 172.21.15.81:0/3145144542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fc03857f10 con 0x55fc037d24a0 2024-09-12T01:31:07.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff314ff9640 1 -- 172.21.15.81:0/3145144542 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff328005520 con 0x55fc037d24a0 2024-09-12T01:31:07.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff314ff9640 1 -- 172.21.15.81:0/3145144542 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff31c0b4260 con 0x55fc037d24a0 2024-09-12T01:31:07.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff335ae5740 10 client.16137 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:07.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff335ae5740 10 client.16137 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:31:07.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff335ae5740 20 client.16137 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:07.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff335ae5740 1 --2- 172.21.15.81:0/3145144542 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fc037dd680 0x55fc0385a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:07.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff335ae5740 4 client.16137 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:31:07.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.885+0000 7ff335ae5740 1 -- 172.21.15.81:0/3145144542 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fc0373fd60 con 0x55fc037dd680 2024-09-12T01:31:07.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff3314a8640 1 --2- 172.21.15.81:0/3145144542 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fc037dd680 0x55fc0385a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:07.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff314ff9640 10 client.16137 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:07.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff3314a8640 1 --2- 172.21.15.81:0/3145144542 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fc037dd680 0x55fc0385a650 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e39a437abb22ec82 server_cookie=740778015c933432 in_seq=0 out_seq=0 2024-09-12T01:31:07.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff314ff9640 1 -- 172.21.15.81:0/3145144542 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fc0373fd60 con 0x55fc037dd680 2024-09-12T01:31:07.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff314ff9640 10 client.16137 handle_command_reply: tid=0 2024-09-12T01:31:07.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff335ae5740 1 client.16137 shutdown 2024-09-12T01:31:07.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff335ae5740 1 -- 172.21.15.81:0/3145144542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d24a0 msgr2=0x55fc037e30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:07.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff335ae5740 1 --2- 172.21.15.81:0/3145144542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d24a0 0x55fc037e30f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00b620 tx=0x7ff31c09b270 comp rx=0 tx=0).stop 2024-09-12T01:31:07.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff335ae5740 1 -- 172.21.15.81:0/3145144542 shutdown_connections 2024-09-12T01:31:07.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff335ae5740 1 --2- 172.21.15.81:0/3145144542 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fc037dd680 0x55fc0385a650 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff335ae5740 1 --2- 172.21.15.81:0/3145144542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc037d2dc0 0x55fc037e3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff335ae5740 1 --2- 172.21.15.81:0/3145144542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc037d24a0 0x55fc037e30f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff335ae5740 1 --2- 172.21.15.81:0/3145144542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc037cea30 0x55fc037e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff335ae5740 1 -- 172.21.15.81:0/3145144542 >> 172.21.15.81:0/3145144542 conn(0x55fc037da910 msgr2=0x55fc037dc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:07.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.886+0000 7ff314ff9640 0 client.16137 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:07.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff335ae5740 1 -- 172.21.15.81:0/3145144542 shutdown_connections 2024-09-12T01:31:07.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff335ae5740 1 -- 172.21.15.81:0/3145144542 wait complete. 2024-09-12T01:31:07.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff335ae5740 20 client.16137 trim_cache size 0 max 16384 2024-09-12T01:31:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:31:07.904 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:31:07.904 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:31:07.904 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:31:07.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff33370c640 1 -- 172.21.15.81:0/33715715 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff3180a2cf0 msgr2=0x7ff3180a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:07.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff33370c640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff3180a2cf0 0x7ff3180a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff324004af0 tx=0x7ff32402a940 comp rx=0 tx=0).stop 2024-09-12T01:31:07.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff33370c640 1 -- 172.21.15.81:0/33715715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c101450 msgr2=0x7ff32c1a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:07.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff33370c640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c101450 0x7ff32c1a4c10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00d750 tx=0x7ff31c00dc10 comp rx=0 tx=0).stop 2024-09-12T01:31:07.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff33370c640 1 -- 172.21.15.81:0/33715715 shutdown_connections 2024-09-12T01:31:07.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff33370c640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff3180a2cf0 0x7ff3180a51b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff33370c640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c105f40 0x7ff32c19e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff33370c640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c101450 0x7ff32c1a4c10 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff33370c640 1 --2- 172.21.15.81:0/33715715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c100b30 0x7ff32c1a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:07.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff33370c640 1 -- 172.21.15.81:0/33715715 >> 172.21.15.81:0/33715715 conn(0x7ff32c0fc7a0 msgr2=0x7ff32c1038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:07.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.887+0000 7ff33370c640 1 -- 172.21.15.81:0/33715715 shutdown_connections 2024-09-12T01:31:07.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:07.888+0000 7ff33370c640 1 -- 172.21.15.81:0/33715715 wait complete. 2024-09-12T01:31:08.648 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:31:08.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:31:08.897 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:09.145 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:08 smithi081 ceph-mon[30920]: pgmap v95: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:31:09.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:08 smithi100 ceph-mon[35275]: pgmap v95: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:31:09.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:08 smithi189 ceph-mon[35357]: pgmap v95: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:31:09.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.371+0000 7f5a2ffff640 1 -- 172.21.15.81:0/544191029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30103550 msgr2=0x7f5a3010ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:09.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.371+0000 7f5a2ffff640 1 --2- 172.21.15.81:0/544191029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30103550 0x7f5a3010ba40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009900 tx=0x7f5a1802a480 comp rx=0 tx=0).stop 2024-09-12T01:31:09.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.371+0000 7f5a2ffff640 1 -- 172.21.15.81:0/544191029 shutdown_connections 2024-09-12T01:31:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.371+0000 7f5a2ffff640 1 --2- 172.21.15.81:0/544191029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a3010bfd0 0x7f5a3010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.371+0000 7f5a2ffff640 1 --2- 172.21.15.81:0/544191029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30103550 0x7f5a3010ba40 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.371+0000 7f5a2ffff640 1 --2- 172.21.15.81:0/544191029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a30102c30 0x7f5a30103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.371+0000 7f5a2ffff640 1 -- 172.21.15.81:0/544191029 >> 172.21.15.81:0/544191029 conn(0x7f5a300fc610 msgr2=0x7f5a300fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.371+0000 7f5a2ffff640 1 -- 172.21.15.81:0/544191029 shutdown_connections 2024-09-12T01:31:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.371+0000 7f5a2ffff640 1 -- 172.21.15.81:0/544191029 wait complete. 2024-09-12T01:31:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.372+0000 7f5a2ffff640 1 Processor -- start 2024-09-12T01:31:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.372+0000 7f5a2ffff640 1 -- start start 2024-09-12T01:31:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30102c30 0x7f5a301983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a30103550 0x7f5a30198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a3010bfd0 0x7f5a3019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2ffff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a30111e00 con 0x7f5a30102c30 2024-09-12T01:31:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2ffff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5a30111c80 con 0x7f5a30103550 2024-09-12T01:31:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2ffff640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a30111f80 con 0x7f5a3010bfd0 2024-09-12T01:31:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30102c30 0x7f5a301983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30102c30 0x7f5a301983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57334/0 (socket says 172.21.15.81:57334) 2024-09-12T01:31:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2effd640 1 -- 172.21.15.81:0/627024480 learned_addr learned my addr 172.21.15.81:0/627024480 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2e7fc640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a30103550 0x7f5a30198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2effd640 1 -- 172.21.15.81:0/627024480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a3010bfd0 msgr2=0x7f5a3019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2f7fe640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a3010bfd0 0x7f5a3019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2effd640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a3010bfd0 0x7f5a3019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2effd640 1 -- 172.21.15.81:0/627024480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a30103550 msgr2=0x7f5a30198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2effd640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a30103550 0x7f5a30198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2effd640 1 -- 172.21.15.81:0/627024480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3019d390 con 0x7f5a30102c30 2024-09-12T01:31:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2e7fc640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a30103550 0x7f5a30198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2f7fe640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a3010bfd0 0x7f5a3019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a2effd640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30102c30 0x7f5a301983e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000c890 tx=0x7f5a2000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.373+0000 7f5a34a00640 1 -- 172.21.15.81:0/627024480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a20004220 con 0x7f5a30102c30 2024-09-12T01:31:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.374+0000 7f5a2ffff640 1 -- 172.21.15.81:0/627024480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3019d680 con 0x7f5a30102c30 2024-09-12T01:31:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.374+0000 7f5a34a00640 1 -- 172.21.15.81:0/627024480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a200043c0 con 0x7f5a30102c30 2024-09-12T01:31:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.374+0000 7f5a34a00640 1 -- 172.21.15.81:0/627024480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a20004a00 con 0x7f5a30102c30 2024-09-12T01:31:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.374+0000 7f5a2ffff640 1 -- 172.21.15.81:0/627024480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a301a4f60 con 0x7f5a30102c30 2024-09-12T01:31:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.375+0000 7f5a2ffff640 1 -- 172.21.15.81:0/627024480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a30103010 con 0x7f5a30102c30 2024-09-12T01:31:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.376+0000 7f5a34a00640 1 -- 172.21.15.81:0/627024480 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5a200079b0 con 0x7f5a30102c30 2024-09-12T01:31:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.376+0000 7f5a34a00640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f5a1c0a2cf0 0x7f5a1c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.377+0000 7f5a2e7fc640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f5a1c0a2cf0 0x7f5a1c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.377+0000 7f5a34a00640 1 -- 172.21.15.81:0/627024480 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f5a200cf640 con 0x7f5a30102c30 2024-09-12T01:31:09.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.377+0000 7f5a2e7fc640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f5a1c0a2cf0 0x7f5a1c0a51b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a300fece0 tx=0x7f5a18005a20 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:09.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.380+0000 7f5a34a00640 1 -- 172.21.15.81:0/627024480 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a20014030 con 0x7f5a30102c30 2024-09-12T01:31:09.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.582+0000 7f5a2ffff640 1 -- 172.21.15.81:0/627024480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a30107050 con 0x7f5a30102c30 2024-09-12T01:31:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.583+0000 7f5a34a00640 1 -- 172.21.15.81:0/627024480 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f5a2009c230 con 0x7f5a30102c30 2024-09-12T01:31:09.582 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:31:09.582 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:31:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:31:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.585+0000 7f5a2ffff640 1 -- 172.21.15.81:0/627024480 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f5a1c0a2cf0 msgr2=0x7f5a1c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.585+0000 7f5a2ffff640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f5a1c0a2cf0 0x7f5a1c0a51b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a300fece0 tx=0x7f5a18005a20 comp rx=0 tx=0).stop 2024-09-12T01:31:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.585+0000 7f5a2ffff640 1 -- 172.21.15.81:0/627024480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30102c30 msgr2=0x7f5a301983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.585+0000 7f5a2ffff640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30102c30 0x7f5a301983e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000c890 tx=0x7f5a2000cd50 comp rx=0 tx=0).stop 2024-09-12T01:31:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.585+0000 7f5a2ffff640 1 -- 172.21.15.81:0/627024480 shutdown_connections 2024-09-12T01:31:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.585+0000 7f5a2ffff640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f5a1c0a2cf0 0x7f5a1c0a51b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.585+0000 7f5a2ffff640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a3010bfd0 0x7f5a3019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.585+0000 7f5a2ffff640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a30103550 0x7f5a30198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.585+0000 7f5a2ffff640 1 --2- 172.21.15.81:0/627024480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30102c30 0x7f5a301983e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.585+0000 7f5a2ffff640 1 -- 172.21.15.81:0/627024480 >> 172.21.15.81:0/627024480 conn(0x7f5a300fc610 msgr2=0x7f5a300fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.585+0000 7f5a2ffff640 1 -- 172.21.15.81:0/627024480 shutdown_connections 2024-09-12T01:31:09.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:09.585+0000 7f5a2ffff640 1 -- 172.21.15.81:0/627024480 wait complete. 2024-09-12T01:31:10.176 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:09 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/627024480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:31:10.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:31:10.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:09 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/627024480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:31:10.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:09 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/627024480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:31:10.454 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.904+0000 7f3d7f356640 1 -- 172.21.15.81:0/496651135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78102790 msgr2=0x7f3d781067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.904+0000 7f3d7f356640 1 --2- 172.21.15.81:0/496651135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78102790 0x7f3d781067e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009900 tx=0x7f3d6c02a410 comp rx=0 tx=0).stop 2024-09-12T01:31:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.904+0000 7f3d7f356640 1 -- 172.21.15.81:0/496651135 shutdown_connections 2024-09-12T01:31:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.904+0000 7f3d7f356640 1 --2- 172.21.15.81:0/496651135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d78106f10 0x7f3d7810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.904+0000 7f3d7f356640 1 --2- 172.21.15.81:0/496651135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78102790 0x7f3d781067e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.904+0000 7f3d7f356640 1 --2- 172.21.15.81:0/496651135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78101de0 0x7f3d781021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.904+0000 7f3d7f356640 1 -- 172.21.15.81:0/496651135 >> 172.21.15.81:0/496651135 conn(0x7f3d780fd8e0 msgr2=0x7f3d780ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.904+0000 7f3d7f356640 1 -- 172.21.15.81:0/496651135 shutdown_connections 2024-09-12T01:31:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.904+0000 7f3d7f356640 1 -- 172.21.15.81:0/496651135 wait complete. 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.905+0000 7f3d7f356640 1 Processor -- start 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.905+0000 7f3d7f356640 1 -- start start 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.905+0000 7f3d7f356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78101de0 0x7f3d78198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.905+0000 7f3d7f356640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d78102790 0x7f3d781989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.905+0000 7f3d7f356640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78106f10 0x7f3d7819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.905+0000 7f3d7f356640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78111f70 con 0x7f3d78101de0 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.905+0000 7f3d7f356640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78111df0 con 0x7f3d78106f10 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.905+0000 7f3d7f356640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781120f0 con 0x7f3d78102790 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.905+0000 7f3d7d0f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78101de0 0x7f3d78198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.905+0000 7f3d7d0f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78101de0 0x7f3d78198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57340/0 (socket says 172.21.15.81:57340) 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.905+0000 7f3d7d0f2640 1 -- 172.21.15.81:0/3635318273 learned_addr learned my addr 172.21.15.81:0/3635318273 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.905+0000 7f3d7c8f1640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d78102790 0x7f3d781989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.906+0000 7f3d7d8f3640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78106f10 0x7f3d7819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.906+0000 7f3d7d0f2640 1 -- 172.21.15.81:0/3635318273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d78102790 msgr2=0x7f3d781989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.906+0000 7f3d7d0f2640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d78102790 0x7f3d781989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.906+0000 7f3d7d0f2640 1 -- 172.21.15.81:0/3635318273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78106f10 msgr2=0x7f3d7819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.906+0000 7f3d7d0f2640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78106f10 0x7f3d7819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.906+0000 7f3d7d0f2640 1 -- 172.21.15.81:0/3635318273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7819d440 con 0x7f3d78101de0 2024-09-12T01:31:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.906+0000 7f3d7d0f2640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78101de0 0x7f3d78198490 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800ea80 tx=0x7f3d6800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.906+0000 7f3d767fc640 1 -- 172.21.15.81:0/3635318273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6800ce40 con 0x7f3d78101de0 2024-09-12T01:31:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.906+0000 7f3d767fc640 1 -- 172.21.15.81:0/3635318273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d68005020 con 0x7f3d78101de0 2024-09-12T01:31:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.906+0000 7f3d7f356640 1 -- 172.21.15.81:0/3635318273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7819d730 con 0x7f3d78101de0 2024-09-12T01:31:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.906+0000 7f3d767fc640 1 -- 172.21.15.81:0/3635318273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68011760 con 0x7f3d78101de0 2024-09-12T01:31:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.906+0000 7f3d7f356640 1 -- 172.21.15.81:0/3635318273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d781a5010 con 0x7f3d78101de0 2024-09-12T01:31:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.908+0000 7f3d767fc640 1 -- 172.21.15.81:0/3635318273 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f3d680051d0 con 0x7f3d78101de0 2024-09-12T01:31:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.909+0000 7f3d8172f740 1 Processor -- start 2024-09-12T01:31:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.909+0000 7f3d8172f740 1 -- start start 2024-09-12T01:31:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.909+0000 7f3d8172f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a04090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.909+0000 7f3d8172f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 0x55b559a04a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.909+0000 7f3d767fc640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3d600a2d70 0x7f3d600a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.909+0000 7f3d8172f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 0x55b559a15b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.909+0000 7f3d8172f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b55996a2f0 con 0x55b559a05b40 2024-09-12T01:31:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.909+0000 7f3d8172f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b559911cf0 con 0x55b559a045d0 2024-09-12T01:31:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.909+0000 7f3d8172f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b5599662b0 con 0x55b559a13780 2024-09-12T01:31:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.909+0000 7f3d7d8f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a04090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.909+0000 7f3d7d8f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a04090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57350/0 (socket says 172.21.15.81:57350) 2024-09-12T01:31:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.909+0000 7f3d7d8f3640 1 -- 172.21.15.81:0/799589490 learned_addr learned my addr 172.21.15.81:0/799589490 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.909+0000 7f3d7c8f1640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3d600a2d70 0x7f3d600a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.910+0000 7f3d767fc640 1 -- 172.21.15.81:0/3635318273 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f3d680cf990 con 0x7f3d78101de0 2024-09-12T01:31:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.910+0000 7f3d7d0f2640 1 --2- 172.21.15.81:0/799589490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 0x55b559a04a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.910+0000 7f3d7d8f3640 1 -- 172.21.15.81:0/799589490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 msgr2=0x55b559a15b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.910+0000 7f3d7d8f3640 1 --2- 172.21.15.81:0/799589490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 0x55b559a15b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.910+0000 7f3d7d8f3640 1 -- 172.21.15.81:0/799589490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 msgr2=0x55b559a04a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.910+0000 7f3d7d8f3640 1 --2- 172.21.15.81:0/799589490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 0x55b559a04a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.910+0000 7f3d7d8f3640 1 -- 172.21.15.81:0/799589490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5598f63a0 con 0x55b559a05b40 2024-09-12T01:31:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.910+0000 7f3d7d8f3640 1 --2- 172.21.15.81:0/799589490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a04090 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3d70004640 tx=0x7f3d7000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914aa3ab3156f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.910+0000 7f3d7c8f1640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3d600a2d70 0x7f3d600a5230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009230 tx=0x7f3d6c0058d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.910+0000 7f3d5f7fe640 1 -- 172.21.15.81:0/799589490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70003bd0 con 0x55b559a05b40 2024-09-12T01:31:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.910+0000 7f3d5f7fe640 1 -- 172.21.15.81:0/799589490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d70003d70 con 0x55b559a05b40 2024-09-12T01:31:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.910+0000 7f3d5f7fe640 1 -- 172.21.15.81:0/799589490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70010430 con 0x55b559a05b40 2024-09-12T01:31:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.911+0000 7f3d8172f740 1 -- 172.21.15.81:0/799589490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 msgr2=0x55b559a04090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.911+0000 7f3d8172f740 1 --2- 172.21.15.81:0/799589490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a04090 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3d70004640 tx=0x7f3d7000bb90 comp rx=0 tx=0).stop 2024-09-12T01:31:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.911+0000 7f3d8172f740 1 -- 172.21.15.81:0/799589490 shutdown_connections 2024-09-12T01:31:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.911+0000 7f3d8172f740 1 --2- 172.21.15.81:0/799589490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 0x55b559a15b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.911+0000 7f3d8172f740 1 --2- 172.21.15.81:0/799589490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 0x55b559a04a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.911+0000 7f3d8172f740 1 --2- 172.21.15.81:0/799589490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a04090 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.911+0000 7f3d8172f740 1 -- 172.21.15.81:0/799589490 >> 172.21.15.81:0/799589490 conn(0x55b5599cd310 msgr2=0x55b559a00c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.911+0000 7f3d8172f740 1 -- 172.21.15.81:0/799589490 shutdown_connections 2024-09-12T01:31:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.911+0000 7f3d8172f740 1 -- 172.21.15.81:0/799589490 wait complete. 2024-09-12T01:31:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.911+0000 7f3d8172f740 1 -- start start 2024-09-12T01:31:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.911+0000 7f3d8172f740 1 Processor -- start 2024-09-12T01:31:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d8172f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 0x55b559a13160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d8172f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a10410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d8172f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 0x55b559a109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d8172f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b559a16480 con 0x55b559a05b40 2024-09-12T01:31:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d8172f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b559925060 con 0x55b559a045d0 2024-09-12T01:31:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d8172f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b559a16600 con 0x55b559a13780 2024-09-12T01:31:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d8172f740 10 client.0 _ll_register_callbacks cb 0x55b5596788c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d7c8f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a10410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d7c8f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a10410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57352/0 (socket says 172.21.15.81:57352) 2024-09-12T01:31:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d7c8f1640 1 -- 172.21.15.81:0/986998472 learned_addr learned my addr 172.21.15.81:0/986998472 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d7d0f2640 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 0x55b559a13160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d7d8f3640 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 0x55b559a109e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d7c8f1640 1 -- 172.21.15.81:0/986998472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 msgr2=0x55b559a109e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d7c8f1640 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 0x55b559a109e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d7c8f1640 1 -- 172.21.15.81:0/986998472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 msgr2=0x55b559a13160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d7c8f1640 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 0x55b559a13160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d7c8f1640 1 -- 172.21.15.81:0/986998472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5596db3c0 con 0x55b559a05b40 2024-09-12T01:31:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d7d8f3640 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 0x55b559a109e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d7d0f2640 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 0x55b559a13160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d7c8f1640 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a10410 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009900 tx=0x7f3d6c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bd23bf73fa1863 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d5cff9640 1 -- 172.21.15.81:0/986998472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c04d020 con 0x55b559a05b40 2024-09-12T01:31:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d5cff9640 1 -- 172.21.15.81:0/986998472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f3d6c004450 con 0x55b559a05b40 2024-09-12T01:31:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.912+0000 7f3d8172f740 1 -- 172.21.15.81:0/986998472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d70003d70 con 0x55b559a05b40 2024-09-12T01:31:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.913+0000 7f3d5cff9640 1 -- 172.21.15.81:0/986998472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3d6c058050 con 0x55b559a05b40 2024-09-12T01:31:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.913+0000 7f3d8172f740 10 client.16155 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.913+0000 7f3d8172f740 1 -- 172.21.15.81:0/986998472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b559a21f00 con 0x55b559a05b40 2024-09-12T01:31:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.913+0000 7f3d5cff9640 1 -- 172.21.15.81:0/986998472 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d70003d70 con 0x55b559a05b40 2024-09-12T01:31:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.913+0000 7f3d5cff9640 1 -- 172.21.15.81:0/986998472 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3d6c049770 con 0x55b559a05b40 2024-09-12T01:31:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.913+0000 7f3d8172f740 10 client.16155 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.913+0000 7f3d8172f740 10 client.16155 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:31:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.913+0000 7f3d8172f740 20 client.16155 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.913+0000 7f3d8172f740 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55b559a23460 0x55b559a25880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.913+0000 7f3d8172f740 4 client.16155 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:31:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.913+0000 7f3d8172f740 1 -- 172.21.15.81:0/986998472 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b559977860 con 0x55b559a23460 2024-09-12T01:31:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.913+0000 7f3d7d0f2640 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55b559a23460 0x55b559a25880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.914+0000 7f3d5cff9640 10 client.16155 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:31:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.914+0000 7f3d7d0f2640 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55b559a23460 0x55b559a25880 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6a85ba80b9196027 server_cookie=9a2f8802645901ec in_seq=0 out_seq=0 2024-09-12T01:31:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.914+0000 7f3d5cff9640 1 -- 172.21.15.81:0/986998472 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b559977860 con 0x55b559a23460 2024-09-12T01:31:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.914+0000 7f3d5cff9640 10 client.16155 handle_command_reply: tid=0 2024-09-12T01:31:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.915+0000 7f3d8172f740 1 client.16155 shutdown 2024-09-12T01:31:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.915+0000 7f3d8172f740 1 -- 172.21.15.81:0/986998472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 msgr2=0x55b559a10410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.915+0000 7f3d8172f740 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a10410 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009900 tx=0x7f3d6c009260 comp rx=0 tx=0).stop 2024-09-12T01:31:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.915+0000 7f3d8172f740 1 -- 172.21.15.81:0/986998472 shutdown_connections 2024-09-12T01:31:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.915+0000 7f3d8172f740 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55b559a23460 0x55b559a25880 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.915+0000 7f3d8172f740 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 0x55b559a109e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.915+0000 7f3d8172f740 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a10410 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.915+0000 7f3d8172f740 1 --2- 172.21.15.81:0/986998472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 0x55b559a13160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.915+0000 7f3d5cff9640 0 client.16155 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:31:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.915+0000 7f3d8172f740 1 -- 172.21.15.81:0/986998472 >> 172.21.15.81:0/986998472 conn(0x55b5599cd310 msgr2=0x55b559a06960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.915+0000 7f3d8172f740 1 -- 172.21.15.81:0/986998472 shutdown_connections 2024-09-12T01:31:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.915+0000 7f3d8172f740 1 -- 172.21.15.81:0/986998472 wait complete. 2024-09-12T01:31:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.915+0000 7f3d8172f740 20 client.16155 trim_cache size 0 max 16384 2024-09-12T01:31:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d8172f740 1 Processor -- start 2024-09-12T01:31:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d8172f740 1 -- start start 2024-09-12T01:31:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d8172f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 0x55b559a0bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d8172f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a1f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d8172f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 0x55b5599ffc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d8172f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781ab600 con 0x55b559a05b40 2024-09-12T01:31:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d8172f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781ad140 con 0x55b559a045d0 2024-09-12T01:31:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d8172f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781abcd0 con 0x55b559a13780 2024-09-12T01:31:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d7c8f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a1f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d7c8f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a1f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57368/0 (socket says 172.21.15.81:57368) 2024-09-12T01:31:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d7c8f1640 1 -- 172.21.15.81:0/4097256110 learned_addr learned my addr 172.21.15.81:0/4097256110 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d7c8f1640 1 -- 172.21.15.81:0/4097256110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 msgr2=0x55b5599ffc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d7c8f1640 1 --2- 172.21.15.81:0/4097256110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 0x55b5599ffc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d7c8f1640 1 -- 172.21.15.81:0/4097256110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 msgr2=0x55b559a0bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d7c8f1640 1 --2- 172.21.15.81:0/4097256110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 0x55b559a0bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d7c8f1640 1 -- 172.21.15.81:0/4097256110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b559a0e960 con 0x55b559a05b40 2024-09-12T01:31:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d7c8f1640 1 --2- 172.21.15.81:0/4097256110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a1f720 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c049b90 tx=0x7f3d6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f05de9438c054a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d5effd640 1 -- 172.21.15.81:0/4097256110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c060070 con 0x55b559a05b40 2024-09-12T01:31:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d5effd640 1 -- 172.21.15.81:0/4097256110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d6c049960 con 0x55b559a05b40 2024-09-12T01:31:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.928+0000 7f3d5effd640 1 -- 172.21.15.81:0/4097256110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c04d050 con 0x55b559a05b40 2024-09-12T01:31:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.929+0000 7f3d8172f740 1 -- 172.21.15.81:0/4097256110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 msgr2=0x55b559a1f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.929+0000 7f3d8172f740 1 --2- 172.21.15.81:0/4097256110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a1f720 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c049b90 tx=0x7f3d6c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.929+0000 7f3d8172f740 1 -- 172.21.15.81:0/4097256110 shutdown_connections 2024-09-12T01:31:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.929+0000 7f3d8172f740 1 --2- 172.21.15.81:0/4097256110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a13780 0x55b5599ffc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.929+0000 7f3d8172f740 1 --2- 172.21.15.81:0/4097256110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a05b40 0x55b559a1f720 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.929+0000 7f3d8172f740 1 --2- 172.21.15.81:0/4097256110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a045d0 0x55b559a0bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.929+0000 7f3d8172f740 1 -- 172.21.15.81:0/4097256110 >> 172.21.15.81:0/4097256110 conn(0x55b5599cd310 msgr2=0x55b5599ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.929+0000 7f3d8172f740 1 -- 172.21.15.81:0/4097256110 shutdown_connections 2024-09-12T01:31:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.929+0000 7f3d8172f740 1 -- 172.21.15.81:0/4097256110 wait complete. 2024-09-12T01:31:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.929+0000 7f3d8172f740 1 -- start start 2024-09-12T01:31:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.929+0000 7f3d8172f740 1 Processor -- start 2024-09-12T01:31:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d8172f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a045d0 0x55b559a1bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d8172f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a05b40 0x55b559a17120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d8172f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a13780 0x55b559a17660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d8172f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781aca70 con 0x55b559a13780 2024-09-12T01:31:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d8172f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781ac3a0 con 0x55b559a05b40 2024-09-12T01:31:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d8172f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3d781a95e0 con 0x55b559a045d0 2024-09-12T01:31:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d8172f740 10 client.0 _ll_register_callbacks cb 0x7f3d6c040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d7d8f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a13780 0x55b559a17660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d7d8f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a13780 0x55b559a17660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57380/0 (socket says 172.21.15.81:57380) 2024-09-12T01:31:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d7d8f3640 1 -- 172.21.15.81:0/2195658894 learned_addr learned my addr 172.21.15.81:0/2195658894 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d7d0f2640 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a045d0 0x55b559a1bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d7c8f1640 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a05b40 0x55b559a17120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d7d8f3640 1 -- 172.21.15.81:0/2195658894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a045d0 msgr2=0x55b559a1bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d7d8f3640 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a045d0 0x55b559a1bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d7d8f3640 1 -- 172.21.15.81:0/2195658894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a05b40 msgr2=0x55b559a17120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d7d8f3640 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a05b40 0x55b559a17120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d7d8f3640 1 -- 172.21.15.81:0/2195658894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b559a17ca0 con 0x55b559a13780 2024-09-12T01:31:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d7d0f2640 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a045d0 0x55b559a1bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d7c8f1640 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a05b40 0x55b559a17120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d7d8f3640 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a13780 0x55b559a17660 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3d70004200 tx=0x7f3d70004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9128f8c56d275a08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.930+0000 7f3d5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d5cff9640 1 -- 172.21.15.81:0/2195658894 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70003bd0 con 0x55b559a13780 2024-09-12T01:31:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d8172f740 1 -- 172.21.15.81:0/2195658894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d6c049960 con 0x55b559a13780 2024-09-12T01:31:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d5cff9640 1 -- 172.21.15.81:0/2195658894 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f3d70003d70 con 0x55b559a13780 2024-09-12T01:31:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d5cff9640 1 -- 172.21.15.81:0/2195658894 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3d70005030 con 0x55b559a13780 2024-09-12T01:31:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d8172f740 10 client.16161 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d8172f740 1 -- 172.21.15.81:0/2195658894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b559a8df30 con 0x55b559a13780 2024-09-12T01:31:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d5cff9640 1 -- 172.21.15.81:0/2195658894 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d6c049960 con 0x55b559a13780 2024-09-12T01:31:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d5cff9640 1 -- 172.21.15.81:0/2195658894 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3d70026460 con 0x55b559a13780 2024-09-12T01:31:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d8172f740 10 client.16161 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d8172f740 10 client.16161 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:31:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d8172f740 20 client.16161 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d8172f740 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55b559a8e2c0 0x55b559a906b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d8172f740 4 client.16161 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:31:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.931+0000 7f3d8172f740 1 -- 172.21.15.81:0/2195658894 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b559971d70 con 0x55b559a8e2c0 2024-09-12T01:31:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d7d0f2640 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55b559a8e2c0 0x55b559a906b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d5cff9640 10 client.16161 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:31:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d7d0f2640 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55b559a8e2c0 0x55b559a906b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=89dbed5ae40a8642 server_cookie=52793b42605f83eb in_seq=0 out_seq=0 2024-09-12T01:31:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d5cff9640 1 -- 172.21.15.81:0/2195658894 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b559971d70 con 0x55b559a8e2c0 2024-09-12T01:31:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d5cff9640 10 client.16161 handle_command_reply: tid=0 2024-09-12T01:31:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d8172f740 1 client.16161 shutdown 2024-09-12T01:31:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d8172f740 1 -- 172.21.15.81:0/2195658894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a13780 msgr2=0x55b559a17660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d8172f740 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a13780 0x55b559a17660 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3d70004200 tx=0x7f3d70004230 comp rx=0 tx=0).stop 2024-09-12T01:31:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d8172f740 1 -- 172.21.15.81:0/2195658894 shutdown_connections 2024-09-12T01:31:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d8172f740 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b559a13780 0x55b559a17660 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d8172f740 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b559a05b40 0x55b559a17120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d8172f740 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55b559a8e2c0 0x55b559a906b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d8172f740 1 --2- 172.21.15.81:0/2195658894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b559a045d0 0x55b559a1bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d8172f740 1 -- 172.21.15.81:0/2195658894 >> 172.21.15.81:0/2195658894 conn(0x55b5599cd310 msgr2=0x55b559a12490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d5cff9640 0 client.16161 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:31:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d8172f740 1 -- 172.21.15.81:0/2195658894 shutdown_connections 2024-09-12T01:31:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.932+0000 7f3d8172f740 1 -- 172.21.15.81:0/2195658894 wait complete. 2024-09-12T01:31:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.933+0000 7f3d8172f740 20 client.16161 trim_cache size 0 max 16384 2024-09-12T01:31:10.954 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:31:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.933+0000 7f3d7f356640 1 -- 172.21.15.81:0/3635318273 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3d600a2d70 msgr2=0x7f3d600a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.933+0000 7f3d7f356640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3d600a2d70 0x7f3d600a5230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009230 tx=0x7f3d6c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.933+0000 7f3d7f356640 1 -- 172.21.15.81:0/3635318273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78101de0 msgr2=0x7f3d78198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.933+0000 7f3d7f356640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78101de0 0x7f3d78198490 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800ea80 tx=0x7f3d6800ef40 comp rx=0 tx=0).stop 2024-09-12T01:31:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.933+0000 7f3d7f356640 1 -- 172.21.15.81:0/3635318273 shutdown_connections 2024-09-12T01:31:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.933+0000 7f3d7f356640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3d600a2d70 0x7f3d600a5230 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.933+0000 7f3d7f356640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d78106f10 0x7f3d7819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.933+0000 7f3d7f356640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d78102790 0x7f3d781989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.933+0000 7f3d7f356640 1 --2- 172.21.15.81:0/3635318273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d78101de0 0x7f3d78198490 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.933+0000 7f3d7f356640 1 -- 172.21.15.81:0/3635318273 >> 172.21.15.81:0/3635318273 conn(0x7f3d780fd8e0 msgr2=0x7f3d780fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.933+0000 7f3d7f356640 1 -- 172.21.15.81:0/3635318273 shutdown_connections 2024-09-12T01:31:10.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:10.933+0000 7f3d7f356640 1 -- 172.21.15.81:0/3635318273 wait complete. 2024-09-12T01:31:11.234 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:10 smithi081 ceph-mon[30920]: pgmap v96: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:31:11.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:10 smithi100 ceph-mon[35275]: pgmap v96: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:31:11.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:10 smithi189 ceph-mon[35357]: pgmap v96: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:31:11.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:31:12.011 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.454+0000 7f596046d640 1 -- 172.21.15.81:0/2127124694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5958108290 msgr2=0x7f595810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:12.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.454+0000 7f596046d640 1 --2- 172.21.15.81:0/2127124694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5958108290 0x7f595810ec30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5948009cd0 tx=0x7f594802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.454+0000 7f596046d640 1 -- 172.21.15.81:0/2127124694 shutdown_connections 2024-09-12T01:31:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.454+0000 7f596046d640 1 --2- 172.21.15.81:0/2127124694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5958108290 0x7f595810ec30 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.454+0000 7f596046d640 1 --2- 172.21.15.81:0/2127124694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5958103740 0x7f5958107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.454+0000 7f596046d640 1 --2- 172.21.15.81:0/2127124694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5958102d90 0x7f5958103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.454+0000 7f596046d640 1 -- 172.21.15.81:0/2127124694 >> 172.21.15.81:0/2127124694 conn(0x7f59580fc7d0 msgr2=0x7f59580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.454+0000 7f596046d640 1 -- 172.21.15.81:0/2127124694 shutdown_connections 2024-09-12T01:31:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.454+0000 7f596046d640 1 -- 172.21.15.81:0/2127124694 wait complete. 2024-09-12T01:31:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.455+0000 7f596046d640 1 Processor -- start 2024-09-12T01:31:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.455+0000 7f596046d640 1 -- start start 2024-09-12T01:31:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.455+0000 7f596046d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5958102d90 0x7f59581984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.455+0000 7f596046d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5958103740 0x7f5958198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.455+0000 7f596046d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5958108290 0x7f595819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.455+0000 7f596046d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5958112090 con 0x7f5958103740 2024-09-12T01:31:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.455+0000 7f596046d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5958111f10 con 0x7f5958108290 2024-09-12T01:31:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.455+0000 7f596046d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5958112210 con 0x7f5958102d90 2024-09-12T01:31:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.455+0000 7f595da08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5958103740 0x7f5958198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.455+0000 7f595da08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5958103740 0x7f5958198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53322/0 (socket says 172.21.15.81:53322) 2024-09-12T01:31:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.455+0000 7f595da08640 1 -- 172.21.15.81:0/387420987 learned_addr learned my addr 172.21.15.81:0/387420987 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.455+0000 7f595e209640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5958102d90 0x7f59581984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.455+0000 7f595ea0a640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5958108290 0x7f595819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.456+0000 7f595da08640 1 -- 172.21.15.81:0/387420987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5958102d90 msgr2=0x7f59581984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.456+0000 7f595da08640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5958102d90 0x7f59581984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.456+0000 7f595da08640 1 -- 172.21.15.81:0/387420987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5958108290 msgr2=0x7f595819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:12.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.456+0000 7f595da08640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5958108290 0x7f595819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.456+0000 7f595da08640 1 -- 172.21.15.81:0/387420987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595819d480 con 0x7f5958103740 2024-09-12T01:31:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.456+0000 7f595ea0a640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5958108290 0x7f595819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.456+0000 7f595da08640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5958103740 0x7f5958198a10 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f594c00d770 tx=0x7f594c00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.456+0000 7f59577fe640 1 -- 172.21.15.81:0/387420987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c017070 con 0x7f5958103740 2024-09-12T01:31:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.456+0000 7f59577fe640 1 -- 172.21.15.81:0/387420987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f594c010460 con 0x7f5958103740 2024-09-12T01:31:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.456+0000 7f596046d640 1 -- 172.21.15.81:0/387420987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595819d770 con 0x7f5958103740 2024-09-12T01:31:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.456+0000 7f59577fe640 1 -- 172.21.15.81:0/387420987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c00f620 con 0x7f5958103740 2024-09-12T01:31:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.456+0000 7f596046d640 1 -- 172.21.15.81:0/387420987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59581a5050 con 0x7f5958103740 2024-09-12T01:31:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.458+0000 7f59577fe640 1 -- 172.21.15.81:0/387420987 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f594c01a070 con 0x7f5958103740 2024-09-12T01:31:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f5962846740 1 Processor -- start 2024-09-12T01:31:12.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f5962846740 1 -- start start 2024-09-12T01:31:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f5962846740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af6b40 0x55cb30af5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f5962846740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af55d0 0x55cb30af5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f5962846740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30b00370 0x55cb30b02760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f5962846740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cb30a5b2f0 con 0x55cb30af6b40 2024-09-12T01:31:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f5962846740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cb30a02cf0 con 0x55cb30b00370 2024-09-12T01:31:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f5962846740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cb30a572b0 con 0x55cb30af55d0 2024-09-12T01:31:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f59577fe640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f59400a2d70 0x7f59400a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f595ea0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af6b40 0x55cb30af5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f595ea0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af6b40 0x55cb30af5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53330/0 (socket says 172.21.15.81:53330) 2024-09-12T01:31:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f595ea0a640 1 -- 172.21.15.81:0/3144321980 learned_addr learned my addr 172.21.15.81:0/3144321980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:12.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f595ea0a640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f59400a2d70 0x7f59400a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f595da08640 1 --2- 172.21.15.81:0/3144321980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30b00370 0x55cb30b02760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.459+0000 7f595e209640 1 --2- 172.21.15.81:0/3144321980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af55d0 0x55cb30af5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.460+0000 7f59577fe640 1 -- 172.21.15.81:0/387420987 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f594c0cedf0 con 0x7f5958103740 2024-09-12T01:31:12.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.460+0000 7f595e209640 1 -- 172.21.15.81:0/3144321980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30b00370 msgr2=0x55cb30b02760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:12.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.460+0000 7f595e209640 1 --2- 172.21.15.81:0/3144321980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30b00370 0x55cb30b02760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.460+0000 7f595e209640 1 -- 172.21.15.81:0/3144321980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af6b40 msgr2=0x55cb30af5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:12.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.460+0000 7f595e209640 1 --2- 172.21.15.81:0/3144321980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af6b40 0x55cb30af5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.460+0000 7f595e209640 1 -- 172.21.15.81:0/3144321980 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb309e73a0 con 0x55cb30af55d0 2024-09-12T01:31:12.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.460+0000 7f595ea0a640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f59400a2d70 0x7f59400a5230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5948009430 tx=0x7f5948032fa0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:12.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.460+0000 7f595e209640 1 --2- 172.21.15.81:0/3144321980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af55d0 0x55cb30af5a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f595000abf0 tx=0x7f595000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c97ed2f024edaf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.460+0000 7f5954dea640 1 -- 172.21.15.81:0/3144321980 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950005220 con 0x55cb30af55d0 2024-09-12T01:31:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.460+0000 7f5954dea640 1 -- 172.21.15.81:0/3144321980 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5950004c80 con 0x55cb30af55d0 2024-09-12T01:31:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.460+0000 7f5954dea640 1 -- 172.21.15.81:0/3144321980 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950018860 con 0x55cb30af55d0 2024-09-12T01:31:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.461+0000 7f5962846740 1 -- 172.21.15.81:0/3144321980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af55d0 msgr2=0x55cb30af5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.461+0000 7f5962846740 1 --2- 172.21.15.81:0/3144321980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af55d0 0x55cb30af5a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f595000abf0 tx=0x7f595000f790 comp rx=0 tx=0).stop 2024-09-12T01:31:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.461+0000 7f5962846740 1 -- 172.21.15.81:0/3144321980 shutdown_connections 2024-09-12T01:31:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.461+0000 7f5962846740 1 --2- 172.21.15.81:0/3144321980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30b00370 0x55cb30b02760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.461+0000 7f5962846740 1 --2- 172.21.15.81:0/3144321980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af55d0 0x55cb30af5a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.461+0000 7f5962846740 1 --2- 172.21.15.81:0/3144321980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af6b40 0x55cb30af5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.461+0000 7f5962846740 1 -- 172.21.15.81:0/3144321980 >> 172.21.15.81:0/3144321980 conn(0x55cb30abe310 msgr2=0x55cb30af1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.461+0000 7f5962846740 1 -- 172.21.15.81:0/3144321980 shutdown_connections 2024-09-12T01:31:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.461+0000 7f5962846740 1 -- 172.21.15.81:0/3144321980 wait complete. 2024-09-12T01:31:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.461+0000 7f5962846740 1 -- start start 2024-09-12T01:31:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f5962846740 1 Processor -- start 2024-09-12T01:31:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f5962846740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 0x55cb30affce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f5962846740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30af6b40 0x55cb30afcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f5962846740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30b00370 0x55cb30afd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f5962846740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cb30b03070 con 0x55cb30af55d0 2024-09-12T01:31:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f5962846740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cb30a16060 con 0x55cb30af6b40 2024-09-12T01:31:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f5962846740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cb30b031f0 con 0x55cb30b00370 2024-09-12T01:31:12.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f5962846740 10 client.0 _ll_register_callbacks cb 0x55cb307698c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f595e209640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 0x55cb30affce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f595e209640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 0x55cb30affce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53344/0 (socket says 172.21.15.81:53344) 2024-09-12T01:31:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f595e209640 1 -- 172.21.15.81:0/1336504865 learned_addr learned my addr 172.21.15.81:0/1336504865 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f595da08640 1 --2- 172.21.15.81:0/1336504865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30af6b40 0x55cb30afcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f595ea0a640 1 --2- 172.21.15.81:0/1336504865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30b00370 0x55cb30afd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f595e209640 1 -- 172.21.15.81:0/1336504865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30b00370 msgr2=0x55cb30afd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f595e209640 1 --2- 172.21.15.81:0/1336504865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30b00370 0x55cb30afd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f595e209640 1 -- 172.21.15.81:0/1336504865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30af6b40 msgr2=0x55cb30afcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f595e209640 1 --2- 172.21.15.81:0/1336504865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30af6b40 0x55cb30afcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f595e209640 1 -- 172.21.15.81:0/1336504865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb307cc3c0 con 0x55cb30af55d0 2024-09-12T01:31:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f595e209640 1 --2- 172.21.15.81:0/1336504865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 0x55cb30affce0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5950005790 tx=0x7f59500050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ba52036dd434cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.462+0000 7f593dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f593dffb640 1 -- 172.21.15.81:0/1336504865 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950027070 con 0x55cb30af55d0 2024-09-12T01:31:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f593dffb640 1 -- 172.21.15.81:0/1336504865 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f59500185e0 con 0x55cb30af55d0 2024-09-12T01:31:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f5962846740 1 -- 172.21.15.81:0/1336504865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5950004c80 con 0x55cb30af55d0 2024-09-12T01:31:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f593dffb640 1 -- 172.21.15.81:0/1336504865 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5950033050 con 0x55cb30af55d0 2024-09-12T01:31:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f5962846740 10 client.16173 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:12.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f5962846740 1 -- 172.21.15.81:0/1336504865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb30b0ea80 con 0x55cb30af55d0 2024-09-12T01:31:12.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f593dffb640 1 -- 172.21.15.81:0/1336504865 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5950004c80 con 0x55cb30af55d0 2024-09-12T01:31:12.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f593dffb640 1 -- 172.21.15.81:0/1336504865 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f59500234c0 con 0x55cb30af55d0 2024-09-12T01:31:12.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f5962846740 10 client.16173 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:12.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f5962846740 10 client.16173 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:31:12.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f5962846740 20 client.16173 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:12.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f5962846740 1 --2- 172.21.15.81:0/1336504865 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55cb30b0fe90 0x55cb30b12280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f5962846740 4 client.16173 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:31:12.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.463+0000 7f5962846740 1 -- 172.21.15.81:0/1336504865 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb30a68860 con 0x55cb30b0fe90 2024-09-12T01:31:12.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.464+0000 7f595da08640 1 --2- 172.21.15.81:0/1336504865 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55cb30b0fe90 0x55cb30b12280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.464+0000 7f593dffb640 10 client.16173 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:31:12.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.464+0000 7f595da08640 1 --2- 172.21.15.81:0/1336504865 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55cb30b0fe90 0x55cb30b12280 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e7fcb0dbdd8f320b server_cookie=2b87c1870d46b5f9 in_seq=0 out_seq=0 2024-09-12T01:31:12.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f593dffb640 1 -- 172.21.15.81:0/1336504865 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb30a68860 con 0x55cb30b0fe90 2024-09-12T01:31:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f593dffb640 10 client.16173 handle_command_reply: tid=0 2024-09-12T01:31:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f5962846740 1 client.16173 shutdown 2024-09-12T01:31:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f5962846740 1 -- 172.21.15.81:0/1336504865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 msgr2=0x55cb30affce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f5962846740 1 --2- 172.21.15.81:0/1336504865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 0x55cb30affce0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5950005790 tx=0x7f59500050e0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f5962846740 1 -- 172.21.15.81:0/1336504865 shutdown_connections 2024-09-12T01:31:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f5962846740 1 --2- 172.21.15.81:0/1336504865 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55cb30b0fe90 0x55cb30b12280 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f5962846740 1 --2- 172.21.15.81:0/1336504865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30b00370 0x55cb30afd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f5962846740 1 --2- 172.21.15.81:0/1336504865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30af6b40 0x55cb30afcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f5962846740 1 --2- 172.21.15.81:0/1336504865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 0x55cb30affce0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f5962846740 1 -- 172.21.15.81:0/1336504865 >> 172.21.15.81:0/1336504865 conn(0x55cb30abe310 msgr2=0x55cb30af7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f593dffb640 0 client.16173 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:31:12.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f5962846740 1 -- 172.21.15.81:0/1336504865 shutdown_connections 2024-09-12T01:31:12.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f5962846740 1 -- 172.21.15.81:0/1336504865 wait complete. 2024-09-12T01:31:12.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.465+0000 7f5962846740 20 client.16173 trim_cache size 0 max 16384 2024-09-12T01:31:12.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f5962846740 1 Processor -- start 2024-09-12T01:31:12.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f5962846740 1 -- start start 2024-09-12T01:31:12.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f5962846740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30af55d0 0x55cb30afc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f5962846740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af6b40 0x55cb30af8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f5962846740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30b00370 0x55cb30af8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f5962846740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59581ab530 con 0x55cb30b00370 2024-09-12T01:31:12.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f5962846740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f59581ad070 con 0x55cb30af55d0 2024-09-12T01:31:12.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f5962846740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f59581abc00 con 0x55cb30af6b40 2024-09-12T01:31:12.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f595ea0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30b00370 0x55cb30af8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f595ea0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30b00370 0x55cb30af8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53352/0 (socket says 172.21.15.81:53352) 2024-09-12T01:31:12.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f595ea0a640 1 -- 172.21.15.81:0/1336473025 learned_addr learned my addr 172.21.15.81:0/1336473025 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:12.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f595e209640 1 --2- 172.21.15.81:0/1336473025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30af55d0 0x55cb30afc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f595da08640 1 --2- 172.21.15.81:0/1336473025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af6b40 0x55cb30af8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f595ea0a640 1 -- 172.21.15.81:0/1336473025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af6b40 msgr2=0x55cb30af8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:12.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f595ea0a640 1 --2- 172.21.15.81:0/1336473025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af6b40 0x55cb30af8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f595ea0a640 1 -- 172.21.15.81:0/1336473025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30af55d0 msgr2=0x55cb30afc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:12.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f595ea0a640 1 --2- 172.21.15.81:0/1336473025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30af55d0 0x55cb30afc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.478+0000 7f595ea0a640 1 -- 172.21.15.81:0/1336473025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb30af2960 con 0x55cb30b00370 2024-09-12T01:31:12.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.479+0000 7f595ea0a640 1 --2- 172.21.15.81:0/1336473025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30b00370 0x55cb30af8660 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f594802aea0 tx=0x7f59480095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25819b8baa100298 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:12.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.479+0000 7f593ffff640 1 -- 172.21.15.81:0/1336473025 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948003cf0 con 0x55cb30b00370 2024-09-12T01:31:12.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.479+0000 7f593ffff640 1 -- 172.21.15.81:0/1336473025 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5948036040 con 0x55cb30b00370 2024-09-12T01:31:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.479+0000 7f593ffff640 1 -- 172.21.15.81:0/1336473025 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948030aa0 con 0x55cb30b00370 2024-09-12T01:31:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.479+0000 7f5962846740 1 -- 172.21.15.81:0/1336473025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30b00370 msgr2=0x55cb30af8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.479+0000 7f5962846740 1 --2- 172.21.15.81:0/1336473025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30b00370 0x55cb30af8660 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f594802aea0 tx=0x7f59480095c0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.479+0000 7f5962846740 1 -- 172.21.15.81:0/1336473025 shutdown_connections 2024-09-12T01:31:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.479+0000 7f5962846740 1 --2- 172.21.15.81:0/1336473025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30b00370 0x55cb30af8660 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.479+0000 7f5962846740 1 --2- 172.21.15.81:0/1336473025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af6b40 0x55cb30af8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.479+0000 7f5962846740 1 --2- 172.21.15.81:0/1336473025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30af55d0 0x55cb30afc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.479+0000 7f5962846740 1 -- 172.21.15.81:0/1336473025 >> 172.21.15.81:0/1336473025 conn(0x55cb30abe310 msgr2=0x55cb30af0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.479+0000 7f5962846740 1 -- 172.21.15.81:0/1336473025 shutdown_connections 2024-09-12T01:31:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.479+0000 7f5962846740 1 -- 172.21.15.81:0/1336473025 wait complete. 2024-09-12T01:31:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f5962846740 1 -- start start 2024-09-12T01:31:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f5962846740 1 Processor -- start 2024-09-12T01:31:12.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f5962846740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 0x55cb30b08480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f5962846740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af6b40 0x55cb30b089c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f5962846740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30b00370 0x55cb30af9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f5962846740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59581ac9a0 con 0x55cb30af55d0 2024-09-12T01:31:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f5962846740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f59581ac2d0 con 0x55cb30b00370 2024-09-12T01:31:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f5962846740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f59581a9530 con 0x55cb30af6b40 2024-09-12T01:31:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f595e209640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 0x55cb30b08480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f5962846740 10 client.0 _ll_register_callbacks cb 0x7f5948009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f595e209640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 0x55cb30b08480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53364/0 (socket says 172.21.15.81:53364) 2024-09-12T01:31:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f595e209640 1 -- 172.21.15.81:0/888255954 learned_addr learned my addr 172.21.15.81:0/888255954 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f595ea0a640 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30b00370 0x55cb30af9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f595da08640 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af6b40 0x55cb30b089c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f595e209640 1 -- 172.21.15.81:0/888255954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af6b40 msgr2=0x55cb30b089c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f595e209640 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af6b40 0x55cb30b089c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f595e209640 1 -- 172.21.15.81:0/888255954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30b00370 msgr2=0x55cb30af9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f595e209640 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30b00370 0x55cb30af9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f595e209640 1 -- 172.21.15.81:0/888255954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb30af9860 con 0x55cb30af55d0 2024-09-12T01:31:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.480+0000 7f595da08640 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af6b40 0x55cb30b089c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f595e209640 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 0x55cb30b08480 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f595000f7d0 tx=0x7f5950004c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7da692fc8f97630 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f593dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f593dffb640 1 -- 172.21.15.81:0/888255954 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950027040 con 0x55cb30af55d0 2024-09-12T01:31:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f593dffb640 1 -- 172.21.15.81:0/888255954 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f5950023430 con 0x55cb30af55d0 2024-09-12T01:31:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f5962846740 1 -- 172.21.15.81:0/888255954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5948036040 con 0x55cb30af55d0 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f593dffb640 1 -- 172.21.15.81:0/888255954 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5950046050 con 0x55cb30af55d0 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f5962846740 10 client.16179 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f5962846740 1 -- 172.21.15.81:0/888255954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb30b79f40 con 0x55cb30af55d0 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f593dffb640 1 -- 172.21.15.81:0/888255954 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5948036040 con 0x55cb30af55d0 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f593dffb640 1 -- 172.21.15.81:0/888255954 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5950018920 con 0x55cb30af55d0 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f5962846740 10 client.16179 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f5962846740 10 client.16179 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f5962846740 20 client.16179 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f5962846740 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55cb30b7a5f0 0x55cb30b7c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f5962846740 4 client.16179 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.481+0000 7f5962846740 1 -- 172.21.15.81:0/888255954 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cb30a62d70 con 0x55cb30b7a5f0 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f595da08640 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55cb30b7a5f0 0x55cb30b7c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f593dffb640 10 client.16179 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:31:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f595da08640 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55cb30b7a5f0 0x55cb30b7c9e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ec2a83e585cc5539 server_cookie=1536b44ca0139b06 in_seq=0 out_seq=0 2024-09-12T01:31:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f593dffb640 1 -- 172.21.15.81:0/888255954 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cb30a62d70 con 0x55cb30b7a5f0 2024-09-12T01:31:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f593dffb640 10 client.16179 handle_command_reply: tid=0 2024-09-12T01:31:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f5962846740 1 client.16179 shutdown 2024-09-12T01:31:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f5962846740 1 -- 172.21.15.81:0/888255954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 msgr2=0x55cb30b08480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f5962846740 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 0x55cb30b08480 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f595000f7d0 tx=0x7f5950004c90 comp rx=0 tx=0).stop 2024-09-12T01:31:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f5962846740 1 -- 172.21.15.81:0/888255954 shutdown_connections 2024-09-12T01:31:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f5962846740 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55cb30b7a5f0 0x55cb30b7c9e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f5962846740 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cb30b00370 0x55cb30af9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f5962846740 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb30af6b40 0x55cb30b089c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f5962846740 1 --2- 172.21.15.81:0/888255954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cb30af55d0 0x55cb30b08480 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f5962846740 1 -- 172.21.15.81:0/888255954 >> 172.21.15.81:0/888255954 conn(0x55cb30abe310 msgr2=0x55cb30afe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.482+0000 7f593dffb640 0 client.16179 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:31:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f5962846740 1 -- 172.21.15.81:0/888255954 shutdown_connections 2024-09-12T01:31:12.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f5962846740 1 -- 172.21.15.81:0/888255954 wait complete. 2024-09-12T01:31:12.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f5962846740 20 client.16179 trim_cache size 0 max 16384 2024-09-12T01:31:12.489 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:31:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f596046d640 1 -- 172.21.15.81:0/387420987 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f59400a2d70 msgr2=0x7f59400a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f596046d640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f59400a2d70 0x7f59400a5230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5948009430 tx=0x7f5948032fa0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f596046d640 1 -- 172.21.15.81:0/387420987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5958103740 msgr2=0x7f5958198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f596046d640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5958103740 0x7f5958198a10 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f594c00d770 tx=0x7f594c00db70 comp rx=0 tx=0).stop 2024-09-12T01:31:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f596046d640 1 -- 172.21.15.81:0/387420987 shutdown_connections 2024-09-12T01:31:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f596046d640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f59400a2d70 0x7f59400a5230 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f596046d640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5958108290 0x7f595819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f596046d640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5958103740 0x7f5958198a10 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f596046d640 1 --2- 172.21.15.81:0/387420987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5958102d90 0x7f59581984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f596046d640 1 -- 172.21.15.81:0/387420987 >> 172.21.15.81:0/387420987 conn(0x7f59580fc7d0 msgr2=0x7f5958106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f596046d640 1 -- 172.21.15.81:0/387420987 shutdown_connections 2024-09-12T01:31:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:12.483+0000 7f596046d640 1 -- 172.21.15.81:0/387420987 wait complete. 2024-09-12T01:31:13.165 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:12 smithi081 ceph-mon[30920]: pgmap v97: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:31:13.200 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:31:13.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:12 smithi100 ceph-mon[35275]: pgmap v97: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:31:13.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:12 smithi189 ceph-mon[35357]: pgmap v97: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:31:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:13.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.948+0000 7fa2d8f13640 1 -- 172.21.15.81:0/3625358140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4101420 msgr2=0x7fa2d410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.948+0000 7fa2d8f13640 1 --2- 172.21.15.81:0/3625358140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4101420 0x7fa2d410d950 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009930 tx=0x7fa2c402a420 comp rx=0 tx=0).stop 2024-09-12T01:31:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.948+0000 7fa2d8f13640 1 -- 172.21.15.81:0/3625358140 shutdown_connections 2024-09-12T01:31:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.948+0000 7fa2d8f13640 1 --2- 172.21.15.81:0/3625358140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4101420 0x7fa2d410d950 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.948+0000 7fa2d8f13640 1 --2- 172.21.15.81:0/3625358140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2d4100a80 0x7fa2d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.948+0000 7fa2d8f13640 1 --2- 172.21.15.81:0/3625358140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2d4106a80 0x7fa2d4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.948+0000 7fa2d8f13640 1 -- 172.21.15.81:0/3625358140 >> 172.21.15.81:0/3625358140 conn(0x7fa2d40fc7a0 msgr2=0x7fa2d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.948+0000 7fa2d8f13640 1 -- 172.21.15.81:0/3625358140 shutdown_connections 2024-09-12T01:31:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.948+0000 7fa2d8f13640 1 -- 172.21.15.81:0/3625358140 wait complete. 2024-09-12T01:31:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.949+0000 7fa2d8f13640 1 Processor -- start 2024-09-12T01:31:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.949+0000 7fa2d8f13640 1 -- start start 2024-09-12T01:31:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.949+0000 7fa2d8f13640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4100a80 0x7fa2d41972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.949+0000 7fa2d8f13640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2d4101420 0x7fa2d4197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.949+0000 7fa2d8f13640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2d4106a80 0x7fa2d419bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.949+0000 7fa2d8f13640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4110e80 con 0x7fa2d4100a80 2024-09-12T01:31:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.949+0000 7fa2d8f13640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4110d00 con 0x7fa2d4106a80 2024-09-12T01:31:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.949+0000 7fa2d8f13640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4111000 con 0x7fa2d4101420 2024-09-12T01:31:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.949+0000 7fa2d259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4100a80 0x7fa2d41972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.949+0000 7fa2d259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4100a80 0x7fa2d41972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53372/0 (socket says 172.21.15.81:53372) 2024-09-12T01:31:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.949+0000 7fa2d259c640 1 -- 172.21.15.81:0/2534611413 learned_addr learned my addr 172.21.15.81:0/2534611413 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.949+0000 7fa2d1d9b640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2d4101420 0x7fa2d4197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.949+0000 7fa2d2d9d640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2d4106a80 0x7fa2d419bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.950+0000 7fa2d259c640 1 -- 172.21.15.81:0/2534611413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2d4101420 msgr2=0x7fa2d4197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.950+0000 7fa2d259c640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2d4101420 0x7fa2d4197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.950+0000 7fa2d259c640 1 -- 172.21.15.81:0/2534611413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2d4106a80 msgr2=0x7fa2d419bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.950+0000 7fa2d259c640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2d4106a80 0x7fa2d419bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.950+0000 7fa2d259c640 1 -- 172.21.15.81:0/2534611413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d419c270 con 0x7fa2d4100a80 2024-09-12T01:31:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.950+0000 7fa2d259c640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4100a80 0x7fa2d41972c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00ebc0 tx=0x7fa2cc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.950+0000 7fa2cb7fe640 1 -- 172.21.15.81:0/2534611413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc010430 con 0x7fa2d4100a80 2024-09-12T01:31:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.950+0000 7fa2cb7fe640 1 -- 172.21.15.81:0/2534611413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2cc010ab0 con 0x7fa2d4100a80 2024-09-12T01:31:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.950+0000 7fa2d8f13640 1 -- 172.21.15.81:0/2534611413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d419c560 con 0x7fa2d4100a80 2024-09-12T01:31:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.950+0000 7fa2cb7fe640 1 -- 172.21.15.81:0/2534611413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc018b30 con 0x7fa2d4100a80 2024-09-12T01:31:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.950+0000 7fa2d8f13640 1 -- 172.21.15.81:0/2534611413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d41a3e40 con 0x7fa2d4100a80 2024-09-12T01:31:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.952+0000 7fa2cb7fe640 1 -- 172.21.15.81:0/2534611413 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa2cc018cd0 con 0x7fa2d4100a80 2024-09-12T01:31:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2db2ec740 1 Processor -- start 2024-09-12T01:31:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2db2ec740 1 -- start start 2024-09-12T01:31:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2db2ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 0x55bebb2ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2db2ec740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2db2ec740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2db580 0x55bebb2dd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2db2ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bebb2342f0 con 0x55bebb2cfb40 2024-09-12T01:31:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2db2ec740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55bebb1dbcf0 con 0x55bebb2db580 2024-09-12T01:31:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2db2ec740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bebb2302b0 con 0x55bebb2ce5d0 2024-09-12T01:31:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2d2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 0x55bebb2ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2cb7fe640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa2c00a2cf0 0x7fa2c00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2d2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 0x55bebb2ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53376/0 (socket says 172.21.15.81:53376) 2024-09-12T01:31:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2d2d9d640 1 -- 172.21.15.81:0/3104610898 learned_addr learned my addr 172.21.15.81:0/3104610898 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2d259c640 1 --2- 172.21.15.81:0/3104610898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2d1d9b640 1 --2- 172.21.15.81:0/3104610898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2db580 0x55bebb2dd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.953+0000 7fa2cb7fe640 1 -- 172.21.15.81:0/2534611413 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fa2cc0cfac0 con 0x7fa2d4100a80 2024-09-12T01:31:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.954+0000 7fa2d1d9b640 1 -- 172.21.15.81:0/3104610898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 msgr2=0x55bebb2cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.954+0000 7fa2d1d9b640 1 --2- 172.21.15.81:0/3104610898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.954+0000 7fa2d1d9b640 1 -- 172.21.15.81:0/3104610898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 msgr2=0x55bebb2ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.954+0000 7fa2d1d9b640 1 --2- 172.21.15.81:0/3104610898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 0x55bebb2ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.954+0000 7fa2d1d9b640 1 -- 172.21.15.81:0/3104610898 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bebb1c03a0 con 0x55bebb2db580 2024-09-12T01:31:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.954+0000 7fa2d2d9d640 1 --2- 172.21.15.81:0/3104610898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 0x55bebb2ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:31:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.954+0000 7fa2d2d9d640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa2c00a2cf0 0x7fa2c00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.954+0000 7fa2d1d9b640 1 --2- 172.21.15.81:0/3104610898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2db580 0x55bebb2dd970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00abc0 tx=0x7fa2bc00f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e716de1a004740b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.954+0000 7fa2d2d9d640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa2c00a2cf0 0x7fa2c00a51b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4005c40 tx=0x7fa2c4009260 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.954+0000 7fa2c8ff9640 1 -- 172.21.15.81:0/3104610898 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc005020 con 0x55bebb2db580 2024-09-12T01:31:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.954+0000 7fa2c8ff9640 1 -- 172.21.15.81:0/3104610898 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2bc0056a0 con 0x55bebb2db580 2024-09-12T01:31:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.954+0000 7fa2c8ff9640 1 -- 172.21.15.81:0/3104610898 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc0187c0 con 0x55bebb2db580 2024-09-12T01:31:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.955+0000 7fa2db2ec740 1 -- 172.21.15.81:0/3104610898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2db580 msgr2=0x55bebb2dd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.955+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/3104610898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2db580 0x55bebb2dd970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00abc0 tx=0x7fa2bc00f3c0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.955+0000 7fa2db2ec740 1 -- 172.21.15.81:0/3104610898 shutdown_connections 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.955+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/3104610898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2db580 0x55bebb2dd970 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.955+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/3104610898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.955+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/3104610898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 0x55bebb2ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.955+0000 7fa2db2ec740 1 -- 172.21.15.81:0/3104610898 >> 172.21.15.81:0/3104610898 conn(0x55bebb297310 msgr2=0x55bebb2cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.955+0000 7fa2db2ec740 1 -- 172.21.15.81:0/3104610898 shutdown_connections 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.955+0000 7fa2db2ec740 1 -- 172.21.15.81:0/3104610898 wait complete. 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.955+0000 7fa2db2ec740 1 -- start start 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.955+0000 7fa2db2ec740 1 Processor -- start 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2db2ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2ce5d0 0x55bebb2daf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2db2ec740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2cfb40 0x55bebb2d81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2db2ec740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2db580 0x55bebb2d8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2db2ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bebb2de280 con 0x55bebb2ce5d0 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2db2ec740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55bebb1ef060 con 0x55bebb2cfb40 2024-09-12T01:31:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2db2ec740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bebb2de400 con 0x55bebb2db580 2024-09-12T01:31:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2db2ec740 10 client.0 _ll_register_callbacks cb 0x55bebaf428c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2d259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2ce5d0 0x55bebb2daf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2d259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2ce5d0 0x55bebb2daf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53392/0 (socket says 172.21.15.81:53392) 2024-09-12T01:31:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2d259c640 1 -- 172.21.15.81:0/2781049164 learned_addr learned my addr 172.21.15.81:0/2781049164 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2d1d9b640 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2cfb40 0x55bebb2d81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2d2d9d640 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2db580 0x55bebb2d8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2d259c640 1 -- 172.21.15.81:0/2781049164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2db580 msgr2=0x55bebb2d8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2d259c640 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2db580 0x55bebb2d8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2d259c640 1 -- 172.21.15.81:0/2781049164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2cfb40 msgr2=0x55bebb2d81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2d259c640 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2cfb40 0x55bebb2d81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2d259c640 1 -- 172.21.15.81:0/2781049164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bebafa53c0 con 0x55bebb2ce5d0 2024-09-12T01:31:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2d2d9d640 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2db580 0x55bebb2d8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2d259c640 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2ce5d0 0x55bebb2daf00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc098980 tx=0x7fa2cc06be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b11ac3e1e418c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2b9ffb640 1 -- 172.21.15.81:0/2781049164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc0cd660 con 0x55bebb2ce5d0 2024-09-12T01:31:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2b9ffb640 1 -- 172.21.15.81:0/2781049164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fa2cc09b400 con 0x55bebb2ce5d0 2024-09-12T01:31:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.956+0000 7fa2db2ec740 1 -- 172.21.15.81:0/2781049164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2bc0056a0 con 0x55bebb2ce5d0 2024-09-12T01:31:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.957+0000 7fa2b9ffb640 1 -- 172.21.15.81:0/2781049164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa2cc09bfb0 con 0x55bebb2ce5d0 2024-09-12T01:31:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.957+0000 7fa2db2ec740 10 client.16191 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.957+0000 7fa2db2ec740 1 -- 172.21.15.81:0/2781049164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bebb2e9cb0 con 0x55bebb2ce5d0 2024-09-12T01:31:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.957+0000 7fa2b9ffb640 1 -- 172.21.15.81:0/2781049164 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2bc0056a0 con 0x55bebb2ce5d0 2024-09-12T01:31:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.957+0000 7fa2b9ffb640 1 -- 172.21.15.81:0/2781049164 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa2cc096b20 con 0x55bebb2ce5d0 2024-09-12T01:31:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.957+0000 7fa2db2ec740 10 client.16191 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.957+0000 7fa2db2ec740 10 client.16191 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:31:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.957+0000 7fa2db2ec740 20 client.16191 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.957+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55bebb2eb170 0x55bebb2ed560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.957+0000 7fa2db2ec740 4 client.16191 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:31:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.957+0000 7fa2db2ec740 1 -- 172.21.15.81:0/2781049164 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bebb241860 con 0x55bebb2eb170 2024-09-12T01:31:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.957+0000 7fa2d1d9b640 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55bebb2eb170 0x55bebb2ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2b9ffb640 10 client.16191 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:31:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2d1d9b640 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55bebb2eb170 0x55bebb2ed560 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4f8ab88c7a8a964d server_cookie=c3e5d49fbc406e09 in_seq=0 out_seq=0 2024-09-12T01:31:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2b9ffb640 1 -- 172.21.15.81:0/2781049164 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bebb241860 con 0x55bebb2eb170 2024-09-12T01:31:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2b9ffb640 10 client.16191 handle_command_reply: tid=0 2024-09-12T01:31:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2db2ec740 1 client.16191 shutdown 2024-09-12T01:31:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2db2ec740 1 -- 172.21.15.81:0/2781049164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2ce5d0 msgr2=0x55bebb2daf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2ce5d0 0x55bebb2daf00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc098980 tx=0x7fa2cc06be10 comp rx=0 tx=0).stop 2024-09-12T01:31:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2db2ec740 1 -- 172.21.15.81:0/2781049164 shutdown_connections 2024-09-12T01:31:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55bebb2eb170 0x55bebb2ed560 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2db580 0x55bebb2d8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2cfb40 0x55bebb2d81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/2781049164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2ce5d0 0x55bebb2daf00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2b9ffb640 0 client.16191 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:31:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.958+0000 7fa2db2ec740 1 -- 172.21.15.81:0/2781049164 >> 172.21.15.81:0/2781049164 conn(0x55bebb297310 msgr2=0x55bebb2d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.959+0000 7fa2db2ec740 1 -- 172.21.15.81:0/2781049164 shutdown_connections 2024-09-12T01:31:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.959+0000 7fa2db2ec740 1 -- 172.21.15.81:0/2781049164 wait complete. 2024-09-12T01:31:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.959+0000 7fa2db2ec740 20 client.16191 trim_cache size 0 max 16384 2024-09-12T01:31:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.971+0000 7fa2db2ec740 1 Processor -- start 2024-09-12T01:31:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.971+0000 7fa2db2ec740 1 -- start start 2024-09-12T01:31:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.971+0000 7fa2db2ec740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2e7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.971+0000 7fa2db2ec740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2cfb40 0x55bebb2d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.971+0000 7fa2db2ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2db580 0x55bebb2d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2db2ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41ab620 con 0x55bebb2db580 2024-09-12T01:31:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2db2ec740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41ad160 con 0x55bebb2cfb40 2024-09-12T01:31:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2db2ec740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41abcf0 con 0x55bebb2ce5d0 2024-09-12T01:31:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2d2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2db580 0x55bebb2d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2d259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2e7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2d2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2db580 0x55bebb2d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53408/0 (socket says 172.21.15.81:53408) 2024-09-12T01:31:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2d2d9d640 1 -- 172.21.15.81:0/55777223 learned_addr learned my addr 172.21.15.81:0/55777223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2d1d9b640 1 --2- 172.21.15.81:0/55777223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2cfb40 0x55bebb2d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2d2d9d640 1 -- 172.21.15.81:0/55777223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 msgr2=0x55bebb2e7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2d2d9d640 1 --2- 172.21.15.81:0/55777223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2e7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2d2d9d640 1 -- 172.21.15.81:0/55777223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2cfb40 msgr2=0x55bebb2d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2d2d9d640 1 --2- 172.21.15.81:0/55777223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2cfb40 0x55bebb2d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2d2d9d640 1 -- 172.21.15.81:0/55777223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bebb2edbe0 con 0x55bebb2db580 2024-09-12T01:31:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2d1d9b640 1 --2- 172.21.15.81:0/55777223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2cfb40 0x55bebb2d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:31:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2d259c640 1 --2- 172.21.15.81:0/55777223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:31:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2d2d9d640 1 --2- 172.21.15.81:0/55777223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2db580 0x55bebb2d0d60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4033000 tx=0x7fa2c403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a841e5805b9935a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2bbfff640 1 -- 172.21.15.81:0/55777223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c404d070 con 0x55bebb2db580 2024-09-12T01:31:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2bbfff640 1 -- 172.21.15.81:0/55777223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c4041070 con 0x55bebb2db580 2024-09-12T01:31:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.972+0000 7fa2bbfff640 1 -- 172.21.15.81:0/55777223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4035040 con 0x55bebb2db580 2024-09-12T01:31:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.973+0000 7fa2db2ec740 1 -- 172.21.15.81:0/55777223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2db580 msgr2=0x55bebb2d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.973+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/55777223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2db580 0x55bebb2d0d60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4033000 tx=0x7fa2c403f000 comp rx=0 tx=0).stop 2024-09-12T01:31:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.973+0000 7fa2db2ec740 1 -- 172.21.15.81:0/55777223 shutdown_connections 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.973+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/55777223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2db580 0x55bebb2d0d60 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.973+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/55777223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2cfb40 0x55bebb2d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.973+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/55777223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.973+0000 7fa2db2ec740 1 -- 172.21.15.81:0/55777223 >> 172.21.15.81:0/55777223 conn(0x55bebb297310 msgr2=0x55bebb2d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.973+0000 7fa2db2ec740 1 -- 172.21.15.81:0/55777223 shutdown_connections 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.973+0000 7fa2db2ec740 1 -- 172.21.15.81:0/55777223 wait complete. 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.973+0000 7fa2db2ec740 1 -- start start 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2db2ec740 1 Processor -- start 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2db2ec740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2e3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2db2ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 0x55bebb2e3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2db2ec740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2db580 0x55bebb2e0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2db2ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41aca90 con 0x55bebb2cfb40 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2db2ec740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41ac3c0 con 0x55bebb2db580 2024-09-12T01:31:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2db2ec740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41a9600 con 0x55bebb2ce5d0 2024-09-12T01:31:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2db2ec740 10 client.0 _ll_register_callbacks cb 0x7fa2cc018420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2d1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 0x55bebb2e3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2d1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 0x55bebb2e3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53420/0 (socket says 172.21.15.81:53420) 2024-09-12T01:31:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2d1d9b640 1 -- 172.21.15.81:0/48162232 learned_addr learned my addr 172.21.15.81:0/48162232 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2d2d9d640 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2db580 0x55bebb2e0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2d259c640 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2d1d9b640 1 -- 172.21.15.81:0/48162232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 msgr2=0x55bebb2e3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2d1d9b640 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2e3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2d1d9b640 1 -- 172.21.15.81:0/48162232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2db580 msgr2=0x55bebb2e0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2d1d9b640 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2db580 0x55bebb2e0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2d1d9b640 1 -- 172.21.15.81:0/48162232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bebb2e0ba0 con 0x55bebb2cfb40 2024-09-12T01:31:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2d259c640 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2d1d9b640 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 0x55bebb2e3bd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00abc0 tx=0x7fa2bc005eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993255e90a857909 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.974+0000 7fa2b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2b9ffb640 1 -- 172.21.15.81:0/48162232 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc031020 con 0x55bebb2cfb40 2024-09-12T01:31:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2b9ffb640 1 -- 172.21.15.81:0/48162232 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fa2bc004870 con 0x55bebb2cfb40 2024-09-12T01:31:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2db2ec740 1 -- 172.21.15.81:0/48162232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2c4041070 con 0x55bebb2cfb40 2024-09-12T01:31:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2b9ffb640 1 -- 172.21.15.81:0/48162232 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa2bc03c050 con 0x55bebb2cfb40 2024-09-12T01:31:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2db2ec740 10 client.16197 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2db2ec740 1 -- 172.21.15.81:0/48162232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bebb3565c0 con 0x55bebb2cfb40 2024-09-12T01:31:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2b9ffb640 1 -- 172.21.15.81:0/48162232 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c4041070 con 0x55bebb2cfb40 2024-09-12T01:31:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2b9ffb640 1 -- 172.21.15.81:0/48162232 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa2bc02d5f0 con 0x55bebb2cfb40 2024-09-12T01:31:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2db2ec740 10 client.16197 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2db2ec740 10 client.16197 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:31:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2db2ec740 20 client.16197 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55bebb356a00 0x55bebb358df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2db2ec740 4 client.16197 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.975+0000 7fa2db2ec740 1 -- 172.21.15.81:0/48162232 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bebb23bd70 con 0x55bebb356a00 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2d259c640 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55bebb356a00 0x55bebb358df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2d259c640 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55bebb356a00 0x55bebb358df0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7a48487055f847b2 server_cookie=be4cc0064875a5c5 in_seq=0 out_seq=0 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2b9ffb640 10 client.16197 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2b9ffb640 1 -- 172.21.15.81:0/48162232 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bebb23bd70 con 0x55bebb356a00 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2b9ffb640 10 client.16197 handle_command_reply: tid=0 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2db2ec740 1 client.16197 shutdown 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2db2ec740 1 -- 172.21.15.81:0/48162232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 msgr2=0x55bebb2e3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 0x55bebb2e3bd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00abc0 tx=0x7fa2bc005eb0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2db2ec740 1 -- 172.21.15.81:0/48162232 shutdown_connections 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55bebb356a00 0x55bebb358df0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bebb2db580 0x55bebb2e0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bebb2cfb40 0x55bebb2e3bd0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2b9ffb640 0 client.16197 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:31:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2db2ec740 1 --2- 172.21.15.81:0/48162232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bebb2ce5d0 0x55bebb2e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2db2ec740 1 -- 172.21.15.81:0/48162232 >> 172.21.15.81:0/48162232 conn(0x55bebb297310 msgr2=0x55bebb2d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2db2ec740 1 -- 172.21.15.81:0/48162232 shutdown_connections 2024-09-12T01:31:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2db2ec740 1 -- 172.21.15.81:0/48162232 wait complete. 2024-09-12T01:31:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.976+0000 7fa2db2ec740 20 client.16197 trim_cache size 0 max 16384 2024-09-12T01:31:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:31:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.977+0000 7fa2d8f13640 1 -- 172.21.15.81:0/2534611413 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa2c00a2cf0 msgr2=0x7fa2c00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.977+0000 7fa2d8f13640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa2c00a2cf0 0x7fa2c00a51b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4005c40 tx=0x7fa2c4009260 comp rx=0 tx=0).stop 2024-09-12T01:31:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.977+0000 7fa2d8f13640 1 -- 172.21.15.81:0/2534611413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4100a80 msgr2=0x7fa2d41972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.977+0000 7fa2d8f13640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4100a80 0x7fa2d41972c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00ebc0 tx=0x7fa2cc00c2d0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.977+0000 7fa2d8f13640 1 -- 172.21.15.81:0/2534611413 shutdown_connections 2024-09-12T01:31:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.977+0000 7fa2d8f13640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa2c00a2cf0 0x7fa2c00a51b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.977+0000 7fa2d8f13640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2d4106a80 0x7fa2d419bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.977+0000 7fa2d8f13640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2d4101420 0x7fa2d4197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.977+0000 7fa2d8f13640 1 --2- 172.21.15.81:0/2534611413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d4100a80 0x7fa2d41972c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.977+0000 7fa2d8f13640 1 -- 172.21.15.81:0/2534611413 >> 172.21.15.81:0/2534611413 conn(0x7fa2d40fc7a0 msgr2=0x7fa2d40fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.977+0000 7fa2d8f13640 1 -- 172.21.15.81:0/2534611413 shutdown_connections 2024-09-12T01:31:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:13.977+0000 7fa2d8f13640 1 -- 172.21.15.81:0/2534611413 wait complete. 2024-09-12T01:31:14.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:13 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:31:14.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:13 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:31:14.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:13 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:31:14.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:13 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:31:14.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:13 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:31:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:13 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:31:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:13 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:31:14.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:13 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:31:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:13 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:31:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:13 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:31:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:13 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:31:14.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:13 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:31:14.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:31:15.115 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:15.237 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:14 smithi081 ceph-mon[30920]: pgmap v98: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:31:15.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:14 smithi100 ceph-mon[35275]: pgmap v98: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:31:15.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:14 smithi189 ceph-mon[35357]: pgmap v98: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:31:15.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.581+0000 7f01e88d0640 1 -- 172.21.15.81:0/4234656399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e4103660 msgr2=0x7f01e410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:15.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.581+0000 7f01e88d0640 1 --2- 172.21.15.81:0/4234656399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e4103660 0x7f01e410bb50 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009900 tx=0x7f01d802a480 comp rx=0 tx=0).stop 2024-09-12T01:31:15.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.581+0000 7f01e88d0640 1 -- 172.21.15.81:0/4234656399 shutdown_connections 2024-09-12T01:31:15.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.581+0000 7f01e88d0640 1 --2- 172.21.15.81:0/4234656399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e410c170 0x7f01e410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.581+0000 7f01e88d0640 1 --2- 172.21.15.81:0/4234656399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e4103660 0x7f01e410bb50 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.581+0000 7f01e88d0640 1 --2- 172.21.15.81:0/4234656399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e4102d40 0x7f01e4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.581+0000 7f01e88d0640 1 -- 172.21.15.81:0/4234656399 >> 172.21.15.81:0/4234656399 conn(0x7f01e40fc7a0 msgr2=0x7f01e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:15.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e88d0640 1 -- 172.21.15.81:0/4234656399 shutdown_connections 2024-09-12T01:31:15.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e88d0640 1 -- 172.21.15.81:0/4234656399 wait complete. 2024-09-12T01:31:15.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e88d0640 1 Processor -- start 2024-09-12T01:31:15.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e88d0640 1 -- start start 2024-09-12T01:31:15.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e88d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e4102d40 0x7f01e4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e88d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e4103660 0x7f01e41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e88d0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e410c170 0x7f01e419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e88d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4111f70 con 0x7f01e4102d40 2024-09-12T01:31:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e88d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4111df0 con 0x7f01e4103660 2024-09-12T01:31:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e88d0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41120f0 con 0x7f01e410c170 2024-09-12T01:31:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e4102d40 0x7f01e4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e4102d40 0x7f01e4198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53426/0 (socket says 172.21.15.81:53426) 2024-09-12T01:31:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e259c640 1 -- 172.21.15.81:0/763696585 learned_addr learned my addr 172.21.15.81:0/763696585 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e2d9d640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e410c170 0x7f01e419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e1d9b640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e4103660 0x7f01e41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e259c640 1 -- 172.21.15.81:0/763696585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e410c170 msgr2=0x7f01e419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e259c640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e410c170 0x7f01e419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e259c640 1 -- 172.21.15.81:0/763696585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e4103660 msgr2=0x7f01e41989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:15.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e259c640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e4103660 0x7f01e41989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e259c640 1 -- 172.21.15.81:0/763696585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e419d420 con 0x7f01e4102d40 2024-09-12T01:31:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e1d9b640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e4103660 0x7f01e41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e259c640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e4102d40 0x7f01e4198470 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f01d400d950 tx=0x7f01d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01d37fe640 1 -- 172.21.15.81:0/763696585 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4017070 con 0x7f01e4102d40 2024-09-12T01:31:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01d37fe640 1 -- 172.21.15.81:0/763696585 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01d4009c30 con 0x7f01e4102d40 2024-09-12T01:31:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e88d0640 1 -- 172.21.15.81:0/763696585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e419d710 con 0x7f01e4102d40 2024-09-12T01:31:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01d37fe640 1 -- 172.21.15.81:0/763696585 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d400f6b0 con 0x7f01e4102d40 2024-09-12T01:31:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.582+0000 7f01e88d0640 1 -- 172.21.15.81:0/763696585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e41a4ff0 con 0x7f01e4102d40 2024-09-12T01:31:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.584+0000 7f01d37fe640 1 -- 172.21.15.81:0/763696585 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f01d40109d0 con 0x7f01e4102d40 2024-09-12T01:31:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.585+0000 7f01eaca9740 1 Processor -- start 2024-09-12T01:31:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.585+0000 7f01eaca9740 1 -- start start 2024-09-12T01:31:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.585+0000 7f01eaca9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1778b40 0x55f7c1777090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.585+0000 7f01eaca9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 0x55f7c1777a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.585+0000 7f01eaca9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c1782370 0x55f7c1784760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.585+0000 7f01eaca9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f7c16dd2f0 con 0x55f7c17775d0 2024-09-12T01:31:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.585+0000 7f01eaca9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f7c1684cf0 con 0x55f7c1778b40 2024-09-12T01:31:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.585+0000 7f01eaca9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f7c16d92b0 con 0x55f7c1782370 2024-09-12T01:31:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.585+0000 7f01d37fe640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f01cc0a2cf0 0x7f01cc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.585+0000 7f01e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 0x55f7c1777a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.585+0000 7f01e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 0x55f7c1777a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53430/0 (socket says 172.21.15.81:53430) 2024-09-12T01:31:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.585+0000 7f01e259c640 1 -- 172.21.15.81:0/3881462147 learned_addr learned my addr 172.21.15.81:0/3881462147 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.585+0000 7f01e1d9b640 1 --2- 172.21.15.81:0/3881462147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c1782370 0x55f7c1784760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.586+0000 7f01e2d9d640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f01cc0a2cf0 0x7f01cc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.586+0000 7f01e2d9d640 1 --2- 172.21.15.81:0/3881462147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1778b40 0x55f7c1777090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.586+0000 7f01d37fe640 1 -- 172.21.15.81:0/763696585 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f01d40cf160 con 0x7f01e4102d40 2024-09-12T01:31:15.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.586+0000 7f01e259c640 1 -- 172.21.15.81:0/3881462147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c1782370 msgr2=0x55f7c1784760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.586+0000 7f01e259c640 1 --2- 172.21.15.81:0/3881462147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c1782370 0x55f7c1784760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.586+0000 7f01e259c640 1 -- 172.21.15.81:0/3881462147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1778b40 msgr2=0x55f7c1777090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.586+0000 7f01e259c640 1 --2- 172.21.15.81:0/3881462147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1778b40 0x55f7c1777090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.586+0000 7f01e259c640 1 -- 172.21.15.81:0/3881462147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7c16693a0 con 0x55f7c17775d0 2024-09-12T01:31:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.586+0000 7f01e259c640 1 --2- 172.21.15.81:0/3881462147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 0x55f7c1777a10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009610 tx=0x7f01d400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7dec21f63f1b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.586+0000 7f01e2d9d640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f01cc0a2cf0 0x7f01cc0a51b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01dc005c40 tx=0x7f01dc0099b0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.586+0000 7f01d0ff9640 1 -- 172.21.15.81:0/3881462147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4020070 con 0x55f7c17775d0 2024-09-12T01:31:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.586+0000 7f01d0ff9640 1 -- 172.21.15.81:0/3881462147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01d409bdb0 con 0x55f7c17775d0 2024-09-12T01:31:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.586+0000 7f01d0ff9640 1 -- 172.21.15.81:0/3881462147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4097d20 con 0x55f7c17775d0 2024-09-12T01:31:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.587+0000 7f01eaca9740 1 -- 172.21.15.81:0/3881462147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 msgr2=0x55f7c1777a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.587+0000 7f01eaca9740 1 --2- 172.21.15.81:0/3881462147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 0x55f7c1777a10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f01d4009610 tx=0x7f01d400bf60 comp rx=0 tx=0).stop 2024-09-12T01:31:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.587+0000 7f01eaca9740 1 -- 172.21.15.81:0/3881462147 shutdown_connections 2024-09-12T01:31:15.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.587+0000 7f01eaca9740 1 --2- 172.21.15.81:0/3881462147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c1782370 0x55f7c1784760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.587+0000 7f01eaca9740 1 --2- 172.21.15.81:0/3881462147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 0x55f7c1777a10 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.587+0000 7f01eaca9740 1 --2- 172.21.15.81:0/3881462147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1778b40 0x55f7c1777090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.587+0000 7f01eaca9740 1 -- 172.21.15.81:0/3881462147 >> 172.21.15.81:0/3881462147 conn(0x55f7c1740310 msgr2=0x55f7c1773c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.587+0000 7f01eaca9740 1 -- 172.21.15.81:0/3881462147 shutdown_connections 2024-09-12T01:31:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.587+0000 7f01eaca9740 1 -- 172.21.15.81:0/3881462147 wait complete. 2024-09-12T01:31:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.587+0000 7f01eaca9740 1 -- start start 2024-09-12T01:31:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.587+0000 7f01eaca9740 1 Processor -- start 2024-09-12T01:31:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01eaca9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c17775d0 0x55f7c1781db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01eaca9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1778b40 0x55f7c177f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01eaca9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1782370 0x55f7c177f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01eaca9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f7c1784fb0 con 0x55f7c1778b40 2024-09-12T01:31:15.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01eaca9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f7c1698060 con 0x55f7c1782370 2024-09-12T01:31:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01eaca9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f7c1785130 con 0x55f7c17775d0 2024-09-12T01:31:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01eaca9740 10 client.0 _ll_register_callbacks cb 0x55f7c13eb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01e1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1778b40 0x55f7c177f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01e1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1778b40 0x55f7c177f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53440/0 (socket says 172.21.15.81:53440) 2024-09-12T01:31:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01e1d9b640 1 -- 172.21.15.81:0/1943353431 learned_addr learned my addr 172.21.15.81:0/1943353431 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01e259c640 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c17775d0 0x55f7c1781db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01e2d9d640 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1782370 0x55f7c177f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01e1d9b640 1 -- 172.21.15.81:0/1943353431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c17775d0 msgr2=0x55f7c1781db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01e1d9b640 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c17775d0 0x55f7c1781db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01e1d9b640 1 -- 172.21.15.81:0/1943353431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1782370 msgr2=0x55f7c177f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01e1d9b640 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1782370 0x55f7c177f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01e1d9b640 1 -- 172.21.15.81:0/1943353431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7c144e3c0 con 0x55f7c1778b40 2024-09-12T01:31:15.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01e2d9d640 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1782370 0x55f7c177f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01e1d9b640 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1778b40 0x55f7c177f060 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009900 tx=0x7f01d8032ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be246d659aaa8f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01c9ffb640 1 -- 172.21.15.81:0/1943353431 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8040070 con 0x55f7c1778b40 2024-09-12T01:31:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01c9ffb640 1 -- 172.21.15.81:0/1943353431 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f01d8004040 con 0x55f7c1778b40 2024-09-12T01:31:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.588+0000 7f01eaca9740 1 -- 172.21.15.81:0/1943353431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01d409bdb0 con 0x55f7c1778b40 2024-09-12T01:31:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.589+0000 7f01c9ffb640 1 -- 172.21.15.81:0/1943353431 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f01d8035040 con 0x55f7c1778b40 2024-09-12T01:31:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.589+0000 7f01eaca9740 10 client.16209 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.589+0000 7f01eaca9740 1 -- 172.21.15.81:0/1943353431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f7c1790aa0 con 0x55f7c1778b40 2024-09-12T01:31:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.589+0000 7f01c9ffb640 1 -- 172.21.15.81:0/1943353431 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01d409bdb0 con 0x55f7c1778b40 2024-09-12T01:31:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.589+0000 7f01c9ffb640 1 -- 172.21.15.81:0/1943353431 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f01d8004850 con 0x55f7c1778b40 2024-09-12T01:31:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.589+0000 7f01eaca9740 10 client.16209 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.589+0000 7f01eaca9740 10 client.16209 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:31:15.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.589+0000 7f01eaca9740 20 client.16209 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.589+0000 7f01eaca9740 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f7c1791fb0 0x55f7c17943d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.589+0000 7f01eaca9740 4 client.16209 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:31:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.589+0000 7f01eaca9740 1 -- 172.21.15.81:0/1943353431 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7c16ea860 con 0x55f7c1791fb0 2024-09-12T01:31:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.589+0000 7f01e259c640 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f7c1791fb0 0x55f7c17943d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.590+0000 7f01c9ffb640 10 client.16209 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:31:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.590+0000 7f01e259c640 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f7c1791fb0 0x55f7c17943d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2e31c9c0d4a5db5 server_cookie=bb0d63eb6c0331a2 in_seq=0 out_seq=0 2024-09-12T01:31:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01c9ffb640 1 -- 172.21.15.81:0/1943353431 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f7c16ea860 con 0x55f7c1791fb0 2024-09-12T01:31:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01c9ffb640 10 client.16209 handle_command_reply: tid=0 2024-09-12T01:31:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01eaca9740 1 client.16209 shutdown 2024-09-12T01:31:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01eaca9740 1 -- 172.21.15.81:0/1943353431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1778b40 msgr2=0x55f7c177f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01eaca9740 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1778b40 0x55f7c177f060 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009900 tx=0x7f01d8032ee0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01eaca9740 1 -- 172.21.15.81:0/1943353431 shutdown_connections 2024-09-12T01:31:15.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01eaca9740 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1782370 0x55f7c177f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01eaca9740 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f7c1791fb0 0x55f7c17943d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01eaca9740 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1778b40 0x55f7c177f060 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01c9ffb640 0 client.16209 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:31:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01eaca9740 1 --2- 172.21.15.81:0/1943353431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c17775d0 0x55f7c1781db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01eaca9740 1 -- 172.21.15.81:0/1943353431 >> 172.21.15.81:0/1943353431 conn(0x55f7c1740310 msgr2=0x55f7c1779990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01eaca9740 1 -- 172.21.15.81:0/1943353431 shutdown_connections 2024-09-12T01:31:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01eaca9740 1 -- 172.21.15.81:0/1943353431 wait complete. 2024-09-12T01:31:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.591+0000 7f01eaca9740 20 client.16209 trim_cache size 0 max 16384 2024-09-12T01:31:15.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.603+0000 7f01eaca9740 1 Processor -- start 2024-09-12T01:31:15.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01eaca9740 1 -- start start 2024-09-12T01:31:15.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01eaca9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 0x55f7c1773d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01eaca9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c1778b40 0x55f7c177e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01eaca9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1782370 0x55f7c1799ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01eaca9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41ad920 con 0x55f7c17775d0 2024-09-12T01:31:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01eaca9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41af460 con 0x55f7c1782370 2024-09-12T01:31:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01eaca9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41adff0 con 0x55f7c1778b40 2024-09-12T01:31:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 0x55f7c1773d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 0x55f7c1773d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53450/0 (socket says 172.21.15.81:53450) 2024-09-12T01:31:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01e259c640 1 -- 172.21.15.81:0/3894515406 learned_addr learned my addr 172.21.15.81:0/3894515406 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01e1d9b640 1 --2- 172.21.15.81:0/3894515406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c1778b40 0x55f7c177e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01e2d9d640 1 --2- 172.21.15.81:0/3894515406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1782370 0x55f7c1799ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01e259c640 1 -- 172.21.15.81:0/3894515406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c1778b40 msgr2=0x55f7c177e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01e259c640 1 --2- 172.21.15.81:0/3894515406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c1778b40 0x55f7c177e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01e259c640 1 -- 172.21.15.81:0/3894515406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1782370 msgr2=0x55f7c1799ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01e259c640 1 --2- 172.21.15.81:0/3894515406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1782370 0x55f7c1799ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01e259c640 1 -- 172.21.15.81:0/3894515406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7c177d5d0 con 0x55f7c17775d0 2024-09-12T01:31:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01e259c640 1 --2- 172.21.15.81:0/3894515406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 0x55f7c1773d70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f01d40ccee0 tx=0x7f01d4010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21875157efe9c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01cbfff640 1 -- 172.21.15.81:0/3894515406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4020040 con 0x55f7c17775d0 2024-09-12T01:31:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01cbfff640 1 -- 172.21.15.81:0/3894515406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01d40a4320 con 0x55f7c17775d0 2024-09-12T01:31:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.604+0000 7f01cbfff640 1 -- 172.21.15.81:0/3894515406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d40cccf0 con 0x55f7c17775d0 2024-09-12T01:31:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.605+0000 7f01eaca9740 1 -- 172.21.15.81:0/3894515406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 msgr2=0x55f7c1773d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.605+0000 7f01eaca9740 1 --2- 172.21.15.81:0/3894515406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 0x55f7c1773d70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f01d40ccee0 tx=0x7f01d4010d70 comp rx=0 tx=0).stop 2024-09-12T01:31:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.605+0000 7f01eaca9740 1 -- 172.21.15.81:0/3894515406 shutdown_connections 2024-09-12T01:31:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.605+0000 7f01eaca9740 1 --2- 172.21.15.81:0/3894515406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1782370 0x55f7c1799ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.605+0000 7f01eaca9740 1 --2- 172.21.15.81:0/3894515406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c1778b40 0x55f7c177e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.605+0000 7f01eaca9740 1 --2- 172.21.15.81:0/3894515406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c17775d0 0x55f7c1773d70 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.605+0000 7f01eaca9740 1 -- 172.21.15.81:0/3894515406 >> 172.21.15.81:0/3894515406 conn(0x55f7c1740310 msgr2=0x55f7c177d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.605+0000 7f01eaca9740 1 -- 172.21.15.81:0/3894515406 shutdown_connections 2024-09-12T01:31:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.605+0000 7f01eaca9740 1 -- 172.21.15.81:0/3894515406 wait complete. 2024-09-12T01:31:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.605+0000 7f01eaca9740 1 -- start start 2024-09-12T01:31:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01eaca9740 1 Processor -- start 2024-09-12T01:31:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01eaca9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c17775d0 0x55f7c177c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01eaca9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1778b40 0x55f7c177c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01eaca9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1782370 0x55f7c177cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01eaca9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41aed90 con 0x55f7c1782370 2024-09-12T01:31:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01eaca9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41ae6c0 con 0x55f7c1778b40 2024-09-12T01:31:15.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01eaca9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41ab900 con 0x55f7c17775d0 2024-09-12T01:31:15.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01eaca9740 10 client.0 _ll_register_callbacks cb 0x7f01d8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:15.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01e2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1782370 0x55f7c177cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01e2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1782370 0x55f7c177cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53458/0 (socket says 172.21.15.81:53458) 2024-09-12T01:31:15.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01e2d9d640 1 -- 172.21.15.81:0/1739613814 learned_addr learned my addr 172.21.15.81:0/1739613814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:15.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01e1d9b640 1 --2- 172.21.15.81:0/1739613814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1778b40 0x55f7c177c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01e259c640 1 --2- 172.21.15.81:0/1739613814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c17775d0 0x55f7c177c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01e2d9d640 1 -- 172.21.15.81:0/1739613814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c17775d0 msgr2=0x55f7c177c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:15.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01e2d9d640 1 --2- 172.21.15.81:0/1739613814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c17775d0 0x55f7c177c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01e2d9d640 1 -- 172.21.15.81:0/1739613814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1778b40 msgr2=0x55f7c177c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:15.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01e2d9d640 1 --2- 172.21.15.81:0/1739613814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1778b40 0x55f7c177c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.606+0000 7f01e2d9d640 1 -- 172.21.15.81:0/1739613814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7c17fbd40 con 0x55f7c1782370 2024-09-12T01:31:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01e2d9d640 1 --2- 172.21.15.81:0/1739613814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1782370 0x55f7c177cbe0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0097f0 tx=0x7f01dc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc850620909a7db3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01c9ffb640 1 -- 172.21.15.81:0/1739613814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc02e060 con 0x55f7c1782370 2024-09-12T01:31:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01c9ffb640 1 -- 172.21.15.81:0/1739613814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f01dc01fb80 con 0x55f7c1782370 2024-09-12T01:31:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01eaca9740 1 -- 172.21.15.81:0/1739613814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f7c16e4d70 con 0x55f7c1782370 2024-09-12T01:31:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01c9ffb640 1 -- 172.21.15.81:0/1739613814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f01dc01fd80 con 0x55f7c1782370 2024-09-12T01:31:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01eaca9740 10 client.16215 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01eaca9740 1 -- 172.21.15.81:0/1739613814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f7c1801430 con 0x55f7c1782370 2024-09-12T01:31:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01c9ffb640 1 -- 172.21.15.81:0/1739613814 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f7c16e4d70 con 0x55f7c1782370 2024-09-12T01:31:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01c9ffb640 1 -- 172.21.15.81:0/1739613814 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f01dc01c430 con 0x55f7c1782370 2024-09-12T01:31:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01eaca9740 10 client.16215 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01eaca9740 10 client.16215 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:31:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01eaca9740 20 client.16215 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01eaca9740 1 --2- 172.21.15.81:0/1739613814 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f7c1801be0 0x55f7c1804000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01eaca9740 4 client.16215 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:31:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.607+0000 7f01eaca9740 1 -- 172.21.15.81:0/1739613814 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f7c1661170 con 0x55f7c1801be0 2024-09-12T01:31:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01e259c640 1 --2- 172.21.15.81:0/1739613814 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f7c1801be0 0x55f7c1804000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01c9ffb640 10 client.16215 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:31:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01e259c640 1 --2- 172.21.15.81:0/1739613814 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f7c1801be0 0x55f7c1804000 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a18b122adc8798a server_cookie=71bc387f31530e9e in_seq=0 out_seq=0 2024-09-12T01:31:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01c9ffb640 1 -- 172.21.15.81:0/1739613814 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f7c1661170 con 0x55f7c1801be0 2024-09-12T01:31:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01c9ffb640 10 client.16215 handle_command_reply: tid=0 2024-09-12T01:31:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01eaca9740 1 client.16215 shutdown 2024-09-12T01:31:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01eaca9740 1 -- 172.21.15.81:0/1739613814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1782370 msgr2=0x55f7c177cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01eaca9740 1 --2- 172.21.15.81:0/1739613814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1782370 0x55f7c177cbe0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0097f0 tx=0x7f01dc01a000 comp rx=0 tx=0).stop 2024-09-12T01:31:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01eaca9740 1 -- 172.21.15.81:0/1739613814 shutdown_connections 2024-09-12T01:31:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01eaca9740 1 --2- 172.21.15.81:0/1739613814 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f7c1801be0 0x55f7c1804000 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01eaca9740 1 --2- 172.21.15.81:0/1739613814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f7c1782370 0x55f7c177cbe0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01eaca9740 1 --2- 172.21.15.81:0/1739613814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f7c1778b40 0x55f7c177c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01c9ffb640 0 client.16215 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:31:15.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01eaca9740 1 --2- 172.21.15.81:0/1739613814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f7c17775d0 0x55f7c177c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01eaca9740 1 -- 172.21.15.81:0/1739613814 >> 172.21.15.81:0/1739613814 conn(0x55f7c1740310 msgr2=0x55f7c177e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:15.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01eaca9740 1 -- 172.21.15.81:0/1739613814 shutdown_connections 2024-09-12T01:31:15.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.608+0000 7f01eaca9740 1 -- 172.21.15.81:0/1739613814 wait complete. 2024-09-12T01:31:15.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.609+0000 7f01eaca9740 20 client.16215 trim_cache size 0 max 16384 2024-09-12T01:31:15.621 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:31:15.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.609+0000 7f01e88d0640 1 -- 172.21.15.81:0/763696585 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f01cc0a2cf0 msgr2=0x7f01cc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:15.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.609+0000 7f01e88d0640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f01cc0a2cf0 0x7f01cc0a51b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01dc005c40 tx=0x7f01dc0099b0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.609+0000 7f01e88d0640 1 -- 172.21.15.81:0/763696585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e4102d40 msgr2=0x7f01e4198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:15.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.609+0000 7f01e88d0640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e4102d40 0x7f01e4198470 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f01d400d950 tx=0x7f01d400de10 comp rx=0 tx=0).stop 2024-09-12T01:31:15.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.609+0000 7f01e88d0640 1 -- 172.21.15.81:0/763696585 shutdown_connections 2024-09-12T01:31:15.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.609+0000 7f01e88d0640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f01cc0a2cf0 0x7f01cc0a51b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.609+0000 7f01e88d0640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01e410c170 0x7f01e419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.609+0000 7f01e88d0640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e4103660 0x7f01e41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.609+0000 7f01e88d0640 1 --2- 172.21.15.81:0/763696585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e4102d40 0x7f01e4198470 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:15.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.609+0000 7f01e88d0640 1 -- 172.21.15.81:0/763696585 >> 172.21.15.81:0/763696585 conn(0x7f01e40fc7a0 msgr2=0x7f01e40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:15.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.609+0000 7f01e88d0640 1 -- 172.21.15.81:0/763696585 shutdown_connections 2024-09-12T01:31:15.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:15.609+0000 7f01e88d0640 1 -- 172.21.15.81:0/763696585 wait complete. 2024-09-12T01:31:16.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:31:16.705 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:17.140 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:16 smithi081 ceph-mon[30920]: pgmap v99: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:31:17.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.139+0000 7ff332d32640 1 -- 172.21.15.81:0/3729700408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c10c170 msgr2=0x7ff32c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:17.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.139+0000 7ff332d32640 1 --2- 172.21.15.81:0/3729700408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c10c170 0x7ff32c10e610 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff324009ca0 tx=0x7ff32402a950 comp rx=0 tx=0).stop 2024-09-12T01:31:17.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.139+0000 7ff332d32640 1 -- 172.21.15.81:0/3729700408 shutdown_connections 2024-09-12T01:31:17.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.139+0000 7ff332d32640 1 --2- 172.21.15.81:0/3729700408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c10c170 0x7ff32c10e610 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.139+0000 7ff332d32640 1 --2- 172.21.15.81:0/3729700408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c103660 0x7ff32c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.139+0000 7ff332d32640 1 --2- 172.21.15.81:0/3729700408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c102d40 0x7ff32c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.139+0000 7ff332d32640 1 -- 172.21.15.81:0/3729700408 >> 172.21.15.81:0/3729700408 conn(0x7ff32c0fc7a0 msgr2=0x7ff32c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.139+0000 7ff332d32640 1 -- 172.21.15.81:0/3729700408 shutdown_connections 2024-09-12T01:31:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.139+0000 7ff332d32640 1 -- 172.21.15.81:0/3729700408 wait complete. 2024-09-12T01:31:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.140+0000 7ff332d32640 1 Processor -- start 2024-09-12T01:31:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.140+0000 7ff332d32640 1 -- start start 2024-09-12T01:31:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.140+0000 7ff332d32640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c102d40 0x7ff32c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.140+0000 7ff332d32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c103660 0x7ff32c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.140+0000 7ff332d32640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c10c170 0x7ff32c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.140+0000 7ff332d32640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c111fb0 con 0x7ff32c103660 2024-09-12T01:31:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.140+0000 7ff332d32640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c111e30 con 0x7ff32c102d40 2024-09-12T01:31:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.140+0000 7ff332d32640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c112130 con 0x7ff32c10c170 2024-09-12T01:31:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.140+0000 7ff32bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c103660 0x7ff32c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff32bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c103660 0x7ff32c198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53474/0 (socket says 172.21.15.81:53474) 2024-09-12T01:31:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff32bfff640 1 -- 172.21.15.81:0/2552390904 learned_addr learned my addr 172.21.15.81:0/2552390904 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff330ace640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c102d40 0x7ff32c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff3312cf640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c10c170 0x7ff32c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff32bfff640 1 -- 172.21.15.81:0/2552390904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c10c170 msgr2=0x7ff32c19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff32bfff640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c10c170 0x7ff32c19cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff32bfff640 1 -- 172.21.15.81:0/2552390904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c102d40 msgr2=0x7ff32c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff32bfff640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c102d40 0x7ff32c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff32bfff640 1 -- 172.21.15.81:0/2552390904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c19d4c0 con 0x7ff32c103660 2024-09-12T01:31:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff330ace640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c102d40 0x7ff32c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff32bfff640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c103660 0x7ff32c198a50 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff31800b3f0 tx=0x7ff31800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff329ffb640 1 -- 172.21.15.81:0/2552390904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff318015020 con 0x7ff32c103660 2024-09-12T01:31:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff332d32640 1 -- 172.21.15.81:0/2552390904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32c19d7b0 con 0x7ff32c103660 2024-09-12T01:31:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff329ffb640 1 -- 172.21.15.81:0/2552390904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff318011d10 con 0x7ff32c103660 2024-09-12T01:31:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff329ffb640 1 -- 172.21.15.81:0/2552390904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31800f2e0 con 0x7ff32c103660 2024-09-12T01:31:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.141+0000 7ff332d32640 1 -- 172.21.15.81:0/2552390904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32c1a5090 con 0x7ff32c103660 2024-09-12T01:31:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff329ffb640 1 -- 172.21.15.81:0/2552390904 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff318018020 con 0x7ff32c103660 2024-09-12T01:31:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff33510b740 1 Processor -- start 2024-09-12T01:31:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff33510b740 1 -- start start 2024-09-12T01:31:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff33510b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 0x556bf0c77090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff33510b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c775d0 0x556bf0c77a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff33510b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c82370 0x556bf0c84760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff33510b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556bf0bdd2f0 con 0x556bf0c78b40 2024-09-12T01:31:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff33510b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556bf0b84cf0 con 0x556bf0c82370 2024-09-12T01:31:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff33510b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556bf0bd92b0 con 0x556bf0c775d0 2024-09-12T01:31:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff3312cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 0x556bf0c77090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff3312cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 0x556bf0c77090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53480/0 (socket says 172.21.15.81:53480) 2024-09-12T01:31:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff3312cf640 1 -- 172.21.15.81:0/3629346920 learned_addr learned my addr 172.21.15.81:0/3629346920 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff329ffb640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff31c0a2d70 0x7ff31c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff330ace640 1 --2- 172.21.15.81:0/3629346920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c775d0 0x556bf0c77a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.144+0000 7ff32bfff640 1 --2- 172.21.15.81:0/3629346920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c82370 0x556bf0c84760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.145+0000 7ff3312cf640 1 -- 172.21.15.81:0/3629346920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c775d0 msgr2=0x556bf0c77a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.145+0000 7ff3312cf640 1 --2- 172.21.15.81:0/3629346920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c775d0 0x556bf0c77a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.145+0000 7ff3312cf640 1 -- 172.21.15.81:0/3629346920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c82370 msgr2=0x556bf0c84760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.145+0000 7ff3312cf640 1 --2- 172.21.15.81:0/3629346920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c82370 0x556bf0c84760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.145+0000 7ff3312cf640 1 -- 172.21.15.81:0/3629346920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bf0b693a0 con 0x556bf0c78b40 2024-09-12T01:31:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.145+0000 7ff329ffb640 1 -- 172.21.15.81:0/2552390904 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff3180cecb0 con 0x7ff32c103660 2024-09-12T01:31:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.145+0000 7ff3312cf640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff31c0a2d70 0x7ff31c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.145+0000 7ff3312cf640 1 --2- 172.21.15.81:0/3629346920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 0x556bf0c77090 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff32402f9c0 tx=0x7ff32402f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505d6bf2893fa4a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.145+0000 7ff316ffd640 1 -- 172.21.15.81:0/3629346920 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324041040 con 0x556bf0c78b40 2024-09-12T01:31:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.145+0000 7ff316ffd640 1 -- 172.21.15.81:0/3629346920 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff32402fc10 con 0x556bf0c78b40 2024-09-12T01:31:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.145+0000 7ff316ffd640 1 -- 172.21.15.81:0/3629346920 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324034040 con 0x556bf0c78b40 2024-09-12T01:31:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.145+0000 7ff3312cf640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff31c0a2d70 0x7ff31c0a5230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff32404c000 tx=0x7ff32404d000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.146+0000 7ff33510b740 1 -- 172.21.15.81:0/3629346920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 msgr2=0x556bf0c77090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.146+0000 7ff33510b740 1 --2- 172.21.15.81:0/3629346920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 0x556bf0c77090 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff32402f9c0 tx=0x7ff32402f9f0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.146+0000 7ff33510b740 1 -- 172.21.15.81:0/3629346920 shutdown_connections 2024-09-12T01:31:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.146+0000 7ff33510b740 1 --2- 172.21.15.81:0/3629346920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c82370 0x556bf0c84760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.146+0000 7ff33510b740 1 --2- 172.21.15.81:0/3629346920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c775d0 0x556bf0c77a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.146+0000 7ff33510b740 1 --2- 172.21.15.81:0/3629346920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 0x556bf0c77090 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.146+0000 7ff33510b740 1 -- 172.21.15.81:0/3629346920 >> 172.21.15.81:0/3629346920 conn(0x556bf0c40310 msgr2=0x556bf0c73c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.146+0000 7ff33510b740 1 -- 172.21.15.81:0/3629346920 shutdown_connections 2024-09-12T01:31:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.146+0000 7ff33510b740 1 -- 172.21.15.81:0/3629346920 wait complete. 2024-09-12T01:31:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.146+0000 7ff33510b740 1 -- start start 2024-09-12T01:31:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff33510b740 1 Processor -- start 2024-09-12T01:31:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff33510b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 0x556bf0c81d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff33510b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c78b40 0x556bf0c7f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff33510b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c82370 0x556bf0c7f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff33510b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556bf0c89480 con 0x556bf0c775d0 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff33510b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556bf0b98060 con 0x556bf0c78b40 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff33510b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556bf0c89600 con 0x556bf0c82370 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff33510b740 10 client.0 _ll_register_callbacks cb 0x556bf08eb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff330ace640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 0x556bf0c81d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff330ace640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 0x556bf0c81d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53494/0 (socket says 172.21.15.81:53494) 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff330ace640 1 -- 172.21.15.81:0/1716502809 learned_addr learned my addr 172.21.15.81:0/1716502809 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff32bfff640 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c78b40 0x556bf0c7f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff3312cf640 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c82370 0x556bf0c7f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff330ace640 1 -- 172.21.15.81:0/1716502809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c82370 msgr2=0x556bf0c7f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff330ace640 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c82370 0x556bf0c7f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff330ace640 1 -- 172.21.15.81:0/1716502809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c78b40 msgr2=0x556bf0c7f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff330ace640 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c78b40 0x556bf0c7f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff330ace640 1 -- 172.21.15.81:0/1716502809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bf094e3c0 con 0x556bf0c775d0 2024-09-12T01:31:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff32bfff640 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c78b40 0x556bf0c7f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.147+0000 7ff3312cf640 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c82370 0x556bf0c7f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff330ace640 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 0x556bf0c81d90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff32000bb40 tx=0x7ff3200044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df96d51150a50165 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff30bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff30bfff640 1 -- 172.21.15.81:0/1716502809 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320005220 con 0x556bf0c775d0 2024-09-12T01:31:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff30bfff640 1 -- 172.21.15.81:0/1716502809 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff3200053c0 con 0x556bf0c775d0 2024-09-12T01:31:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff33510b740 1 -- 172.21.15.81:0/1716502809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff32402fc10 con 0x556bf0c775d0 2024-09-12T01:31:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff30bfff640 1 -- 172.21.15.81:0/1716502809 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff3200055c0 con 0x556bf0c775d0 2024-09-12T01:31:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff33510b740 10 client.16227 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff33510b740 1 -- 172.21.15.81:0/1716502809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556bf0c95000 con 0x556bf0c775d0 2024-09-12T01:31:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff30bfff640 1 -- 172.21.15.81:0/1716502809 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff32402fc10 con 0x556bf0c775d0 2024-09-12T01:31:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff30bfff640 1 -- 172.21.15.81:0/1716502809 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff320019030 con 0x556bf0c775d0 2024-09-12T01:31:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff33510b740 10 client.16227 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff33510b740 10 client.16227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:31:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff33510b740 20 client.16227 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff33510b740 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556bf0c964c0 0x556bf0c988f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff33510b740 4 client.16227 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:31:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.148+0000 7ff33510b740 1 -- 172.21.15.81:0/1716502809 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bf0bea860 con 0x556bf0c964c0 2024-09-12T01:31:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.149+0000 7ff32bfff640 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556bf0c964c0 0x556bf0c988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.149+0000 7ff30bfff640 10 client.16227 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.149+0000 7ff32bfff640 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556bf0c964c0 0x556bf0c988f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4f8fb03986e0fec server_cookie=417f84c1afccae37 in_seq=0 out_seq=0 2024-09-12T01:31:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff30bfff640 1 -- 172.21.15.81:0/1716502809 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556bf0bea860 con 0x556bf0c964c0 2024-09-12T01:31:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff30bfff640 10 client.16227 handle_command_reply: tid=0 2024-09-12T01:31:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff33510b740 1 client.16227 shutdown 2024-09-12T01:31:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff33510b740 1 -- 172.21.15.81:0/1716502809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 msgr2=0x556bf0c81d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff33510b740 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 0x556bf0c81d90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff32000bb40 tx=0x7ff3200044b0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff33510b740 1 -- 172.21.15.81:0/1716502809 shutdown_connections 2024-09-12T01:31:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff33510b740 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556bf0c964c0 0x556bf0c988f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff33510b740 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c82370 0x556bf0c7f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff33510b740 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c78b40 0x556bf0c7f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff33510b740 1 --2- 172.21.15.81:0/1716502809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 0x556bf0c81d90 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff33510b740 1 -- 172.21.15.81:0/1716502809 >> 172.21.15.81:0/1716502809 conn(0x556bf0c40310 msgr2=0x556bf0c79960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff30bfff640 0 client.16227 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff33510b740 1 -- 172.21.15.81:0/1716502809 shutdown_connections 2024-09-12T01:31:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff33510b740 1 -- 172.21.15.81:0/1716502809 wait complete. 2024-09-12T01:31:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.150+0000 7ff33510b740 20 client.16227 trim_cache size 0 max 16384 2024-09-12T01:31:17.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.163+0000 7ff33510b740 1 Processor -- start 2024-09-12T01:31:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.163+0000 7ff33510b740 1 -- start start 2024-09-12T01:31:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.163+0000 7ff33510b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c775d0 0x556bf0c7df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.163+0000 7ff33510b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 0x556bf0c72a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.163+0000 7ff33510b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c82370 0x556bf0c72f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.163+0000 7ff33510b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1ab580 con 0x556bf0c78b40 2024-09-12T01:31:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.163+0000 7ff33510b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1ad0c0 con 0x556bf0c775d0 2024-09-12T01:31:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.163+0000 7ff33510b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1abc50 con 0x556bf0c82370 2024-09-12T01:31:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff32bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 0x556bf0c72a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff32bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 0x556bf0c72a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53506/0 (socket says 172.21.15.81:53506) 2024-09-12T01:31:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff32bfff640 1 -- 172.21.15.81:0/3766444364 learned_addr learned my addr 172.21.15.81:0/3766444364 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff330ace640 1 --2- 172.21.15.81:0/3766444364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c775d0 0x556bf0c7df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff32bfff640 1 -- 172.21.15.81:0/3766444364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c82370 msgr2=0x556bf0c72f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff3312cf640 1 --2- 172.21.15.81:0/3766444364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c82370 0x556bf0c72f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff32bfff640 1 --2- 172.21.15.81:0/3766444364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c82370 0x556bf0c72f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff32bfff640 1 -- 172.21.15.81:0/3766444364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c775d0 msgr2=0x556bf0c7df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff32bfff640 1 --2- 172.21.15.81:0/3766444364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c775d0 0x556bf0c7df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff32bfff640 1 -- 172.21.15.81:0/3766444364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bf0c7ffb0 con 0x556bf0c78b40 2024-09-12T01:31:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff3312cf640 1 --2- 172.21.15.81:0/3766444364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c82370 0x556bf0c72f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff330ace640 1 --2- 172.21.15.81:0/3766444364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c775d0 0x556bf0c7df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff32bfff640 1 --2- 172.21.15.81:0/3766444364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 0x556bf0c72a20 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff31800bdb0 tx=0x7ff3180cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8094cd6750216435 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff3167fc640 1 -- 172.21.15.81:0/3766444364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31809f660 con 0x556bf0c78b40 2024-09-12T01:31:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff3167fc640 1 -- 172.21.15.81:0/3766444364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3180a3f20 con 0x556bf0c78b40 2024-09-12T01:31:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.164+0000 7ff3167fc640 1 -- 172.21.15.81:0/3766444364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180cc650 con 0x556bf0c78b40 2024-09-12T01:31:17.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.165+0000 7ff33510b740 1 -- 172.21.15.81:0/3766444364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 msgr2=0x556bf0c72a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.165+0000 7ff33510b740 1 --2- 172.21.15.81:0/3766444364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 0x556bf0c72a20 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff31800bdb0 tx=0x7ff3180cc040 comp rx=0 tx=0).stop 2024-09-12T01:31:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.165+0000 7ff33510b740 1 -- 172.21.15.81:0/3766444364 shutdown_connections 2024-09-12T01:31:17.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.165+0000 7ff33510b740 1 --2- 172.21.15.81:0/3766444364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c82370 0x556bf0c72f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.165+0000 7ff33510b740 1 --2- 172.21.15.81:0/3766444364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c78b40 0x556bf0c72a20 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.165+0000 7ff33510b740 1 --2- 172.21.15.81:0/3766444364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c775d0 0x556bf0c7df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.165+0000 7ff33510b740 1 -- 172.21.15.81:0/3766444364 >> 172.21.15.81:0/3766444364 conn(0x556bf0c40310 msgr2=0x556bf0c72310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.165+0000 7ff33510b740 1 -- 172.21.15.81:0/3766444364 shutdown_connections 2024-09-12T01:31:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.165+0000 7ff33510b740 1 -- 172.21.15.81:0/3766444364 wait complete. 2024-09-12T01:31:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.165+0000 7ff33510b740 1 -- start start 2024-09-12T01:31:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.165+0000 7ff33510b740 1 Processor -- start 2024-09-12T01:31:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff33510b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 0x556bf0c8ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff33510b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c78b40 0x556bf0c8f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff33510b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c82370 0x556bf0c7bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff33510b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1ac9f0 con 0x556bf0c775d0 2024-09-12T01:31:17.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff33510b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1ac320 con 0x556bf0c82370 2024-09-12T01:31:17.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff33510b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1a9560 con 0x556bf0c78b40 2024-09-12T01:31:17.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff33510b740 10 client.0 _ll_register_callbacks cb 0x7ff320004370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:17.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff330ace640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 0x556bf0c8ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff330ace640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 0x556bf0c8ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53518/0 (socket says 172.21.15.81:53518) 2024-09-12T01:31:17.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff330ace640 1 -- 172.21.15.81:0/1837831918 learned_addr learned my addr 172.21.15.81:0/1837831918 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:17.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff3312cf640 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c82370 0x556bf0c7bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff32bfff640 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c78b40 0x556bf0c8f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff330ace640 1 -- 172.21.15.81:0/1837831918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c78b40 msgr2=0x556bf0c8f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:17.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff330ace640 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c78b40 0x556bf0c8f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff330ace640 1 -- 172.21.15.81:0/1837831918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c82370 msgr2=0x556bf0c7bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:17.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff330ace640 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c82370 0x556bf0c7bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff330ace640 1 -- 172.21.15.81:0/1837831918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bf0c7c360 con 0x556bf0c775d0 2024-09-12T01:31:17.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff3312cf640 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c82370 0x556bf0c7bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff330ace640 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 0x556bf0c8ebb0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff320005d00 tx=0x7ff320004050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c79a6b05b8b114 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.166+0000 7ff30bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff30bfff640 1 -- 172.21.15.81:0/1837831918 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320031060 con 0x556bf0c775d0 2024-09-12T01:31:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff30bfff640 1 -- 172.21.15.81:0/1837831918 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff320005220 con 0x556bf0c775d0 2024-09-12T01:31:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff33510b740 1 -- 172.21.15.81:0/1837831918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3180a3f20 con 0x556bf0c775d0 2024-09-12T01:31:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff30bfff640 1 -- 172.21.15.81:0/1837831918 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff320027070 con 0x556bf0c775d0 2024-09-12T01:31:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff33510b740 10 client.16233 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff33510b740 1 -- 172.21.15.81:0/1837831918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556bf0d00d60 con 0x556bf0c775d0 2024-09-12T01:31:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff30bfff640 1 -- 172.21.15.81:0/1837831918 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3180a3f20 con 0x556bf0c775d0 2024-09-12T01:31:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff30bfff640 1 -- 172.21.15.81:0/1837831918 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff320019070 con 0x556bf0c775d0 2024-09-12T01:31:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff33510b740 10 client.16233 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff33510b740 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:31:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff33510b740 20 client.16233 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff33510b740 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556bf0d014e0 0x556bf0d03900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff33510b740 4 client.16233 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:31:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.167+0000 7ff33510b740 1 -- 172.21.15.81:0/1837831918 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556bf0be4d70 con 0x556bf0d014e0 2024-09-12T01:31:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff32bfff640 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556bf0d014e0 0x556bf0d03900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff30bfff640 10 client.16233 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff32bfff640 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556bf0d014e0 0x556bf0d03900 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e06f49afd2e3d394 server_cookie=1b89040b92adad5e in_seq=0 out_seq=0 2024-09-12T01:31:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff30bfff640 1 -- 172.21.15.81:0/1837831918 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556bf0be4d70 con 0x556bf0d014e0 2024-09-12T01:31:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff30bfff640 10 client.16233 handle_command_reply: tid=0 2024-09-12T01:31:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff33510b740 1 client.16233 shutdown 2024-09-12T01:31:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff33510b740 1 -- 172.21.15.81:0/1837831918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 msgr2=0x556bf0c8ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff33510b740 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 0x556bf0c8ebb0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff320005d00 tx=0x7ff320004050 comp rx=0 tx=0).stop 2024-09-12T01:31:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff33510b740 1 -- 172.21.15.81:0/1837831918 shutdown_connections 2024-09-12T01:31:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff33510b740 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556bf0d014e0 0x556bf0d03900 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff33510b740 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf0c82370 0x556bf0c7bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff33510b740 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf0c78b40 0x556bf0c8f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff33510b740 1 --2- 172.21.15.81:0/1837831918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf0c775d0 0x556bf0c8ebb0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff33510b740 1 -- 172.21.15.81:0/1837831918 >> 172.21.15.81:0/1837831918 conn(0x556bf0c40310 msgr2=0x556bf0c72b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff30bfff640 0 client.16233 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff33510b740 1 -- 172.21.15.81:0/1837831918 shutdown_connections 2024-09-12T01:31:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.168+0000 7ff33510b740 1 -- 172.21.15.81:0/1837831918 wait complete. 2024-09-12T01:31:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.169+0000 7ff33510b740 20 client.16233 trim_cache size 0 max 16384 2024-09-12T01:31:17.185 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:31:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.169+0000 7ff332d32640 1 -- 172.21.15.81:0/2552390904 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff31c0a2d70 msgr2=0x7ff31c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.169+0000 7ff332d32640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff31c0a2d70 0x7ff31c0a5230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff32404c000 tx=0x7ff32404d000 comp rx=0 tx=0).stop 2024-09-12T01:31:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.169+0000 7ff332d32640 1 -- 172.21.15.81:0/2552390904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c103660 msgr2=0x7ff32c198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.169+0000 7ff332d32640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c103660 0x7ff32c198a50 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff31800b3f0 tx=0x7ff31800b8b0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.169+0000 7ff332d32640 1 -- 172.21.15.81:0/2552390904 shutdown_connections 2024-09-12T01:31:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.169+0000 7ff332d32640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff31c0a2d70 0x7ff31c0a5230 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.169+0000 7ff332d32640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff32c10c170 0x7ff32c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.169+0000 7ff332d32640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c103660 0x7ff32c198a50 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.169+0000 7ff332d32640 1 --2- 172.21.15.81:0/2552390904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff32c102d40 0x7ff32c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:17.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.169+0000 7ff332d32640 1 -- 172.21.15.81:0/2552390904 >> 172.21.15.81:0/2552390904 conn(0x7ff32c0fc7a0 msgr2=0x7ff32c0fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:17.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.169+0000 7ff332d32640 1 -- 172.21.15.81:0/2552390904 shutdown_connections 2024-09-12T01:31:17.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:17.169+0000 7ff332d32640 1 -- 172.21.15.81:0/2552390904 wait complete. 2024-09-12T01:31:17.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:16 smithi100 ceph-mon[35275]: pgmap v99: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:31:17.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:16 smithi189 ceph-mon[35357]: pgmap v99: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:31:19.045 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:31:19.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:31:19.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:18 smithi081 ceph-mon[30920]: pgmap v100: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T01:31:19.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:18 smithi100 ceph-mon[35275]: pgmap v100: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T01:31:19.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:18 smithi189 ceph-mon[35357]: pgmap v100: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T01:31:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:19.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.758+0000 7ff27e777640 1 -- 172.21.15.81:0/58224189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff278102570 msgr2=0x7ff2781029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:19.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.758+0000 7ff27e777640 1 --2- 172.21.15.81:0/58224189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff278102570 0x7ff2781029b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009900 tx=0x7ff26c02a480 comp rx=0 tx=0).stop 2024-09-12T01:31:19.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.758+0000 7ff27e777640 1 -- 172.21.15.81:0/58224189 shutdown_connections 2024-09-12T01:31:19.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.758+0000 7ff27e777640 1 --2- 172.21.15.81:0/58224189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff278102ef0 0x7ff27810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.758+0000 7ff27e777640 1 --2- 172.21.15.81:0/58224189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff278102570 0x7ff2781029b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.758+0000 7ff27e777640 1 --2- 172.21.15.81:0/58224189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff278100e20 0x7ff278101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.758+0000 7ff27e777640 1 -- 172.21.15.81:0/58224189 >> 172.21.15.81:0/58224189 conn(0x7ff2780fc7d0 msgr2=0x7ff2780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:19.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.758+0000 7ff27e777640 1 -- 172.21.15.81:0/58224189 shutdown_connections 2024-09-12T01:31:19.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.758+0000 7ff27e777640 1 -- 172.21.15.81:0/58224189 wait complete. 2024-09-12T01:31:19.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.759+0000 7ff27e777640 1 Processor -- start 2024-09-12T01:31:19.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.759+0000 7ff27e777640 1 -- start start 2024-09-12T01:31:19.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.759+0000 7ff27e777640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff278100e20 0x7ff2780fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.759+0000 7ff27e777640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff278102570 0x7ff2780fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27e777640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff278102ef0 0x7ff2780fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27e777640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff278110fa0 con 0x7ff278102ef0 2024-09-12T01:31:19.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27e777640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff278110e20 con 0x7ff278100e20 2024-09-12T01:31:19.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27e777640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff278111120 con 0x7ff278102570 2024-09-12T01:31:19.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27cd14640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff278102ef0 0x7ff2780fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27cd14640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff278102ef0 0x7ff2780fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53536/0 (socket says 172.21.15.81:53536) 2024-09-12T01:31:19.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27cd14640 1 -- 172.21.15.81:0/715722343 learned_addr learned my addr 172.21.15.81:0/715722343 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:19.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff277fff640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff278100e20 0x7ff2780fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff2777fe640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff278102570 0x7ff2780fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27cd14640 1 -- 172.21.15.81:0/715722343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff278102570 msgr2=0x7ff2780fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27cd14640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff278102570 0x7ff2780fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27cd14640 1 -- 172.21.15.81:0/715722343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff278100e20 msgr2=0x7ff2780fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27cd14640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff278100e20 0x7ff2780fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27cd14640 1 -- 172.21.15.81:0/715722343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2781a6a20 con 0x7ff278102ef0 2024-09-12T01:31:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff2777fe640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff278102570 0x7ff2780fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27cd14640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff278102ef0 0x7ff2780fd700 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff27000eaa0 tx=0x7ff27000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff2757fa640 1 -- 172.21.15.81:0/715722343 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270004d20 con 0x7ff278102ef0 2024-09-12T01:31:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27e777640 1 -- 172.21.15.81:0/715722343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2781a6d10 con 0x7ff278102ef0 2024-09-12T01:31:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff2757fa640 1 -- 172.21.15.81:0/715722343 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff270005020 con 0x7ff278102ef0 2024-09-12T01:31:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff2757fa640 1 -- 172.21.15.81:0/715722343 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2700116d0 con 0x7ff278102ef0 2024-09-12T01:31:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.760+0000 7ff27e777640 1 -- 172.21.15.81:0/715722343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2781a7200 con 0x7ff278102ef0 2024-09-12T01:31:19.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.763+0000 7ff2757fa640 1 -- 172.21.15.81:0/715722343 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff2700051d0 con 0x7ff278102ef0 2024-09-12T01:31:19.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.763+0000 7ff280b50740 1 Processor -- start 2024-09-12T01:31:19.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.763+0000 7ff280b50740 1 -- start start 2024-09-12T01:31:19.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.763+0000 7ff280b50740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 0x55895002cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.763+0000 7ff280b50740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002d480 0x558950037800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.763+0000 7ff280b50740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 0x55895003a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff280b50740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55894ff92280 con 0x55895002cb60 2024-09-12T01:31:19.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff280b50740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55894ff39b10 con 0x558950037d40 2024-09-12T01:31:19.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff280b50740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55894ff8e240 con 0x55895002d480 2024-09-12T01:31:19.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 0x55895002cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 0x55895002cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53542/0 (socket says 172.21.15.81:53542) 2024-09-12T01:31:19.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff2777fe640 1 -- 172.21.15.81:0/2005187923 learned_addr learned my addr 172.21.15.81:0/2005187923 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff277fff640 1 --2- 172.21.15.81:0/2005187923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002d480 0x558950037800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff2777fe640 1 --2- 172.21.15.81:0/2005187923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 0x55895003a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff2757fa640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff2600a2cf0 0x7ff2600a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff2777fe640 1 -- 172.21.15.81:0/2005187923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002d480 msgr2=0x558950037800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff2777fe640 1 --2- 172.21.15.81:0/2005187923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002d480 0x558950037800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff2777fe640 1 -- 172.21.15.81:0/2005187923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 msgr2=0x55895003a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff2777fe640 1 --2- 172.21.15.81:0/2005187923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 0x55895003a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff2777fe640 1 -- 172.21.15.81:0/2005187923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894ff461f0 con 0x55895002cb60 2024-09-12T01:31:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff277fff640 1 --2- 172.21.15.81:0/2005187923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002d480 0x558950037800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff27cd14640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff2600a2cf0 0x7ff2600a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff2777fe640 1 --2- 172.21.15.81:0/2005187923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 0x55895002cf40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff26c005940 tx=0x7ff26c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166a321ad256a573 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff2757fa640 1 -- 172.21.15.81:0/715722343 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff2700cf6a0 con 0x7ff278102ef0 2024-09-12T01:31:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff25e7fc640 1 -- 172.21.15.81:0/2005187923 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c043020 con 0x55895002cb60 2024-09-12T01:31:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff25e7fc640 1 -- 172.21.15.81:0/2005187923 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c004ba0 con 0x55895002cb60 2024-09-12T01:31:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.764+0000 7ff25e7fc640 1 -- 172.21.15.81:0/2005187923 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c035070 con 0x55895002cb60 2024-09-12T01:31:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.765+0000 7ff280b50740 1 -- 172.21.15.81:0/2005187923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 msgr2=0x55895002cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.765+0000 7ff280b50740 1 --2- 172.21.15.81:0/2005187923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 0x55895002cf40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff26c005940 tx=0x7ff26c005bd0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.765+0000 7ff27cd14640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff2600a2cf0 0x7ff2600a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff2700cced0 tx=0x7ff27006ba50 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.765+0000 7ff280b50740 1 -- 172.21.15.81:0/2005187923 shutdown_connections 2024-09-12T01:31:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.765+0000 7ff280b50740 1 --2- 172.21.15.81:0/2005187923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 0x55895003a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.765+0000 7ff280b50740 1 --2- 172.21.15.81:0/2005187923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002d480 0x558950037800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.765+0000 7ff280b50740 1 --2- 172.21.15.81:0/2005187923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 0x55895002cf40 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.765+0000 7ff280b50740 1 -- 172.21.15.81:0/2005187923 >> 172.21.15.81:0/2005187923 conn(0x5589500290f0 msgr2=0x5589500294d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.765+0000 7ff280b50740 1 -- 172.21.15.81:0/2005187923 shutdown_connections 2024-09-12T01:31:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.765+0000 7ff280b50740 1 -- 172.21.15.81:0/2005187923 wait complete. 2024-09-12T01:31:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff280b50740 1 -- start start 2024-09-12T01:31:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff280b50740 1 Processor -- start 2024-09-12T01:31:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff280b50740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002cb60 0x558950034be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff280b50740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002d480 0x558950035120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff280b50740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 0x558950035660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff280b50740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55895003a910 con 0x55895002d480 2024-09-12T01:31:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff280b50740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55894ff4cf10 con 0x558950037d40 2024-09-12T01:31:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff280b50740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55895003aa90 con 0x55895002cb60 2024-09-12T01:31:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff280b50740 10 client.0 _ll_register_callbacks cb 0x55894ff15a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff277fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002d480 0x558950035120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff277fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002d480 0x558950035120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53550/0 (socket says 172.21.15.81:53550) 2024-09-12T01:31:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff277fff640 1 -- 172.21.15.81:0/758466555 learned_addr learned my addr 172.21.15.81:0/758466555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff2777fe640 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002cb60 0x558950034be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff2777fe640 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 0x558950035660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff277fff640 1 -- 172.21.15.81:0/758466555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002cb60 msgr2=0x558950034be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff277fff640 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002cb60 0x558950034be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff277fff640 1 -- 172.21.15.81:0/758466555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 msgr2=0x558950035660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff277fff640 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 0x558950035660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.766+0000 7ff277fff640 1 -- 172.21.15.81:0/758466555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55894fd036a0 con 0x55895002d480 2024-09-12T01:31:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff2777fe640 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002cb60 0x558950034be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff277fff640 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002d480 0x558950035120 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff268009f10 tx=0x7ff268011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b1146f20a6063f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff2577fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff2577fe640 1 -- 172.21.15.81:0/758466555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268019070 con 0x55895002d480 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff2577fe640 1 -- 172.21.15.81:0/758466555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff268015870 con 0x55895002d480 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff280b50740 1 -- 172.21.15.81:0/758466555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff26c004ba0 con 0x55895002d480 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff2577fe640 1 -- 172.21.15.81:0/758466555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff268025050 con 0x55895002d480 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff280b50740 10 client.16245 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff280b50740 1 -- 172.21.15.81:0/758466555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558950046570 con 0x55895002d480 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff2577fe640 1 -- 172.21.15.81:0/758466555 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c004ba0 con 0x55895002d480 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff2577fe640 1 -- 172.21.15.81:0/758466555 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff268014b20 con 0x55895002d480 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff280b50740 10 client.16245 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff280b50740 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff280b50740 20 client.16245 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff280b50740 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x558950047a20 0x558950049e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff280b50740 4 client.16245 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.767+0000 7ff280b50740 1 -- 172.21.15.81:0/758466555 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55894ff9f7f0 con 0x558950047a20 2024-09-12T01:31:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.768+0000 7ff2777fe640 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x558950047a20 0x558950049e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.768+0000 7ff2777fe640 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x558950047a20 0x558950049e40 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4742fc03e09f17 server_cookie=8f9a9ab01fdb25b8 in_seq=0 out_seq=0 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.768+0000 7ff2577fe640 10 client.16245 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff2577fe640 1 -- 172.21.15.81:0/758466555 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55894ff9f7f0 con 0x558950047a20 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff2577fe640 10 client.16245 handle_command_reply: tid=0 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff280b50740 1 client.16245 shutdown 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff280b50740 1 -- 172.21.15.81:0/758466555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002d480 msgr2=0x558950035120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff280b50740 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002d480 0x558950035120 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff268009f10 tx=0x7ff268011630 comp rx=0 tx=0).stop 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff280b50740 1 -- 172.21.15.81:0/758466555 shutdown_connections 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff280b50740 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x558950047a20 0x558950049e40 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff280b50740 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 0x558950035660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff280b50740 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002d480 0x558950035120 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff280b50740 1 --2- 172.21.15.81:0/758466555 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002cb60 0x558950034be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff280b50740 1 -- 172.21.15.81:0/758466555 >> 172.21.15.81:0/758466555 conn(0x5589500290f0 msgr2=0x55895002ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff2577fe640 0 client.16245 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff280b50740 1 -- 172.21.15.81:0/758466555 shutdown_connections 2024-09-12T01:31:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff280b50740 1 -- 172.21.15.81:0/758466555 wait complete. 2024-09-12T01:31:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.769+0000 7ff280b50740 20 client.16245 trim_cache size 0 max 16384 2024-09-12T01:31:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.787+0000 7ff280b50740 1 Processor -- start 2024-09-12T01:31:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.787+0000 7ff280b50740 1 -- start start 2024-09-12T01:31:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.787+0000 7ff280b50740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 0x558950033a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff280b50740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002d480 0x5589500354b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff280b50740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 0x55895004f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 0x558950033a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 0x558950033a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53556/0 (socket says 172.21.15.81:53556) 2024-09-12T01:31:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff2777fe640 1 -- 172.21.15.81:0/854947450 learned_addr learned my addr 172.21.15.81:0/854947450 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff280b50740 1 -- 172.21.15.81:0/854947450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781af9b0 con 0x55895002cb60 2024-09-12T01:31:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff280b50740 1 -- 172.21.15.81:0/854947450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781b14f0 con 0x558950037d40 2024-09-12T01:31:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff280b50740 1 -- 172.21.15.81:0/854947450 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781b0080 con 0x55895002d480 2024-09-12T01:31:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff2777fe640 1 --2- 172.21.15.81:0/854947450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 0x55895004f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff2777fe640 1 -- 172.21.15.81:0/854947450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002d480 msgr2=0x5589500354b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff2777fe640 1 --2- 172.21.15.81:0/854947450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002d480 0x5589500354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff2777fe640 1 -- 172.21.15.81:0/854947450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 msgr2=0x55895004f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff2777fe640 1 --2- 172.21.15.81:0/854947450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 0x55895004f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff2777fe640 1 -- 172.21.15.81:0/854947450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589500371c0 con 0x55895002cb60 2024-09-12T01:31:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.788+0000 7ff2777fe640 1 --2- 172.21.15.81:0/854947450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 0x558950033a90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009900 tx=0x7ff26c03f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b743b0769ce06eed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.789+0000 7ff25dffb640 1 -- 172.21.15.81:0/854947450 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c035070 con 0x55895002cb60 2024-09-12T01:31:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.789+0000 7ff25dffb640 1 -- 172.21.15.81:0/854947450 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c004ba0 con 0x55895002cb60 2024-09-12T01:31:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.789+0000 7ff25dffb640 1 -- 172.21.15.81:0/854947450 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c043070 con 0x55895002cb60 2024-09-12T01:31:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.789+0000 7ff280b50740 1 -- 172.21.15.81:0/854947450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 msgr2=0x558950033a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.789+0000 7ff280b50740 1 --2- 172.21.15.81:0/854947450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 0x558950033a90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009900 tx=0x7ff26c03f040 comp rx=0 tx=0).stop 2024-09-12T01:31:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.789+0000 7ff280b50740 1 -- 172.21.15.81:0/854947450 shutdown_connections 2024-09-12T01:31:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.789+0000 7ff280b50740 1 --2- 172.21.15.81:0/854947450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558950037d40 0x55895004f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.789+0000 7ff280b50740 1 --2- 172.21.15.81:0/854947450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002d480 0x5589500354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.789+0000 7ff280b50740 1 --2- 172.21.15.81:0/854947450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55895002cb60 0x558950033a90 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.789+0000 7ff280b50740 1 -- 172.21.15.81:0/854947450 >> 172.21.15.81:0/854947450 conn(0x5589500290f0 msgr2=0x558950033380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.790+0000 7ff280b50740 1 -- 172.21.15.81:0/854947450 shutdown_connections 2024-09-12T01:31:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.790+0000 7ff280b50740 1 -- 172.21.15.81:0/854947450 wait complete. 2024-09-12T01:31:19.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.790+0000 7ff280b50740 1 -- start start 2024-09-12T01:31:19.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.790+0000 7ff280b50740 1 Processor -- start 2024-09-12T01:31:19.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.790+0000 7ff280b50740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002cb60 0x55895003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.790+0000 7ff280b50740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55895002d480 0x55895003c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.790+0000 7ff280b50740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558950037d40 0x55895003c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.790+0000 7ff280b50740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781b0e20 con 0x558950037d40 2024-09-12T01:31:19.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.790+0000 7ff280b50740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781b0750 con 0x55895002d480 2024-09-12T01:31:19.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.790+0000 7ff280b50740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781ad990 con 0x55895002cb60 2024-09-12T01:31:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff280b50740 10 client.0 _ll_register_callbacks cb 0x7ff268009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558950037d40 0x55895003c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff2777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558950037d40 0x55895003c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53570/0 (socket says 172.21.15.81:53570) 2024-09-12T01:31:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff2777fe640 1 -- 172.21.15.81:0/178224461 learned_addr learned my addr 172.21.15.81:0/178224461 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff2777fe640 1 --2- 172.21.15.81:0/178224461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002cb60 0x55895003bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff277fff640 1 --2- 172.21.15.81:0/178224461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55895002d480 0x55895003c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff2777fe640 1 -- 172.21.15.81:0/178224461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002cb60 msgr2=0x55895003bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff2777fe640 1 --2- 172.21.15.81:0/178224461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002cb60 0x55895003bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff2777fe640 1 -- 172.21.15.81:0/178224461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55895002d480 msgr2=0x55895003c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff2777fe640 1 --2- 172.21.15.81:0/178224461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55895002d480 0x55895003c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff2777fe640 1 -- 172.21.15.81:0/178224461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589500b1770 con 0x558950037d40 2024-09-12T01:31:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff2777fe640 1 --2- 172.21.15.81:0/178224461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558950037d40 0x55895003c5a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff26c004650 tx=0x7ff26c04a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c229cfb28561b8c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:19.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff2577fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff2577fe640 1 -- 172.21.15.81:0/178224461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c035030 con 0x558950037d40 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff2577fe640 1 -- 172.21.15.81:0/178224461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff26c005140 con 0x558950037d40 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.791+0000 7ff280b50740 1 -- 172.21.15.81:0/178224461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff26c004ba0 con 0x558950037d40 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.792+0000 7ff2577fe640 1 -- 172.21.15.81:0/178224461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff26c043070 con 0x558950037d40 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.792+0000 7ff280b50740 10 client.16251 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.792+0000 7ff280b50740 1 -- 172.21.15.81:0/178224461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5589500b2a90 con 0x558950037d40 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.792+0000 7ff2577fe640 1 -- 172.21.15.81:0/178224461 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c004ba0 con 0x558950037d40 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.792+0000 7ff2577fe640 1 -- 172.21.15.81:0/178224461 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff26c031700 con 0x558950037d40 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.792+0000 7ff280b50740 10 client.16251 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.792+0000 7ff280b50740 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.792+0000 7ff280b50740 20 client.16251 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.792+0000 7ff280b50740 1 --2- 172.21.15.81:0/178224461 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5589500b2cc0 0x5589500b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.792+0000 7ff280b50740 4 client.16251 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:31:19.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.792+0000 7ff280b50740 1 -- 172.21.15.81:0/178224461 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55894ff99d00 con 0x5589500b2cc0 2024-09-12T01:31:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.792+0000 7ff277fff640 1 --2- 172.21.15.81:0/178224461 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5589500b2cc0 0x5589500b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.793+0000 7ff2577fe640 10 client.16251 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.793+0000 7ff277fff640 1 --2- 172.21.15.81:0/178224461 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5589500b2cc0 0x5589500b50b0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3e47738a90fc9ab server_cookie=6cd041200587eb1c in_seq=0 out_seq=0 2024-09-12T01:31:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff2577fe640 1 -- 172.21.15.81:0/178224461 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55894ff99d00 con 0x5589500b2cc0 2024-09-12T01:31:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff2577fe640 10 client.16251 handle_command_reply: tid=0 2024-09-12T01:31:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff280b50740 1 client.16251 shutdown 2024-09-12T01:31:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff280b50740 1 -- 172.21.15.81:0/178224461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558950037d40 msgr2=0x55895003c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff280b50740 1 --2- 172.21.15.81:0/178224461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558950037d40 0x55895003c5a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff26c004650 tx=0x7ff26c04a040 comp rx=0 tx=0).stop 2024-09-12T01:31:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff280b50740 1 -- 172.21.15.81:0/178224461 shutdown_connections 2024-09-12T01:31:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff280b50740 1 --2- 172.21.15.81:0/178224461 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5589500b2cc0 0x5589500b50b0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff280b50740 1 --2- 172.21.15.81:0/178224461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558950037d40 0x55895003c5a0 secure :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff26c004650 tx=0x7ff26c04a040 comp rx=0 tx=0).stop 2024-09-12T01:31:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff280b50740 1 --2- 172.21.15.81:0/178224461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55895002d480 0x55895003c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff280b50740 1 --2- 172.21.15.81:0/178224461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55895002cb60 0x55895003bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff280b50740 1 -- 172.21.15.81:0/178224461 >> 172.21.15.81:0/178224461 conn(0x5589500290f0 msgr2=0x558950028270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:19.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff2577fe640 0 client.16251 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:19.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff280b50740 1 -- 172.21.15.81:0/178224461 shutdown_connections 2024-09-12T01:31:19.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.794+0000 7ff280b50740 1 -- 172.21.15.81:0/178224461 wait complete. 2024-09-12T01:31:19.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.795+0000 7ff280b50740 20 client.16251 trim_cache size 0 max 16384 2024-09-12T01:31:19.809 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:31:19.809 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:31:19.809 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "0004cdd4-d3aa-4c99-bbff-0de24a12c080", 2024-09-12T01:31:19.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:31:19.809 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:31:19.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.795+0000 7ff27e777640 1 -- 172.21.15.81:0/715722343 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff2600a2cf0 msgr2=0x7ff2600a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:19.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.795+0000 7ff27e777640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff2600a2cf0 0x7ff2600a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff2700cced0 tx=0x7ff27006ba50 comp rx=0 tx=0).stop 2024-09-12T01:31:19.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.795+0000 7ff27e777640 1 -- 172.21.15.81:0/715722343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff278102ef0 msgr2=0x7ff2780fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:19.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.795+0000 7ff27e777640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff278102ef0 0x7ff2780fd700 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff27000eaa0 tx=0x7ff27000eea0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.795+0000 7ff27e777640 1 -- 172.21.15.81:0/715722343 shutdown_connections 2024-09-12T01:31:19.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.795+0000 7ff27e777640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff2600a2cf0 0x7ff2600a51b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.795+0000 7ff27e777640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff278102ef0 0x7ff2780fd700 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.795+0000 7ff27e777640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff278102570 0x7ff2780fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.795+0000 7ff27e777640 1 --2- 172.21.15.81:0/715722343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff278100e20 0x7ff2780fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:19.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.795+0000 7ff27e777640 1 -- 172.21.15.81:0/715722343 >> 172.21.15.81:0/715722343 conn(0x7ff2780fc7d0 msgr2=0x7ff27806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:19.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.795+0000 7ff27e777640 1 -- 172.21.15.81:0/715722343 shutdown_connections 2024-09-12T01:31:19.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:19.795+0000 7ff27e777640 1 -- 172.21.15.81:0/715722343 wait complete. 2024-09-12T01:31:20.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:31:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:21.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:20 smithi081 ceph-mon[30920]: pgmap v101: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T01:31:21.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:20 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:31:21.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:20 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:31:21.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:20 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:31:21.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:20 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:31:21.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:20 smithi100 ceph-mon[35275]: pgmap v101: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T01:31:21.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:20 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:31:21.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:20 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:31:21.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:20 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:31:21.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:20 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:31:21.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:20 smithi189 ceph-mon[35357]: pgmap v101: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T01:31:21.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:20 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:31:21.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:20 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:31:21.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:20 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:31:21.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:20 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:31:21.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.287+0000 7fb867c6c640 1 -- 172.21.15.81:0/1669689342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb860074590 msgr2=0x7fb860074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:21.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.287+0000 7fb867c6c640 1 --2- 172.21.15.81:0/1669689342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb860074590 0x7fb860074970 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009ca0 tx=0x7fb85c02a950 comp rx=0 tx=0).stop 2024-09-12T01:31:21.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.287+0000 7fb867c6c640 1 -- 172.21.15.81:0/1669689342 shutdown_connections 2024-09-12T01:31:21.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.287+0000 7fb867c6c640 1 --2- 172.21.15.81:0/1669689342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb860112ba0 0x7fb860114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.287+0000 7fb867c6c640 1 --2- 172.21.15.81:0/1669689342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb860074eb0 0x7fb860112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.287+0000 7fb867c6c640 1 --2- 172.21.15.81:0/1669689342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb860074590 0x7fb860074970 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.287+0000 7fb867c6c640 1 -- 172.21.15.81:0/1669689342 >> 172.21.15.81:0/1669689342 conn(0x7fb8600fd8b0 msgr2=0x7fb8600ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.287+0000 7fb867c6c640 1 -- 172.21.15.81:0/1669689342 shutdown_connections 2024-09-12T01:31:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.287+0000 7fb867c6c640 1 -- 172.21.15.81:0/1669689342 wait complete. 2024-09-12T01:31:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.287+0000 7fb867c6c640 1 Processor -- start 2024-09-12T01:31:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.287+0000 7fb867c6c640 1 -- start start 2024-09-12T01:31:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb867c6c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb860074590 0x7fb8601a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb867c6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb860074eb0 0x7fb8601a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb867c6c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb860112ba0 0x7fb86019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb867c6c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb860118580 con 0x7fb860074eb0 2024-09-12T01:31:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb867c6c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb860118400 con 0x7fb860112ba0 2024-09-12T01:31:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb867c6c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb860118700 con 0x7fb860074590 2024-09-12T01:31:21.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb865207640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb860074eb0 0x7fb8601a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb865207640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb860074eb0 0x7fb8601a4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53582/0 (socket says 172.21.15.81:53582) 2024-09-12T01:31:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb865207640 1 -- 172.21.15.81:0/3468489511 learned_addr learned my addr 172.21.15.81:0/3468489511 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb865a08640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb860074590 0x7fb8601a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb866209640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb860112ba0 0x7fb86019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb865207640 1 -- 172.21.15.81:0/3468489511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb860074590 msgr2=0x7fb8601a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb865207640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb860074590 0x7fb8601a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb865207640 1 -- 172.21.15.81:0/3468489511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb860112ba0 msgr2=0x7fb86019e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb865207640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb860112ba0 0x7fb86019e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb865207640 1 -- 172.21.15.81:0/3468489511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86019eff0 con 0x7fb860074eb0 2024-09-12T01:31:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb865207640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb860074eb0 0x7fb8601a4c40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb85000d770 tx=0x7fb85000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb856ffd640 1 -- 172.21.15.81:0/3468489511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850017070 con 0x7fb860074eb0 2024-09-12T01:31:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb856ffd640 1 -- 172.21.15.81:0/3468489511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb850005500 con 0x7fb860074eb0 2024-09-12T01:31:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb867c6c640 1 -- 172.21.15.81:0/3468489511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86019f2e0 con 0x7fb860074eb0 2024-09-12T01:31:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.288+0000 7fb856ffd640 1 -- 172.21.15.81:0/3468489511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850004e00 con 0x7fb860074eb0 2024-09-12T01:31:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.289+0000 7fb867c6c640 1 -- 172.21.15.81:0/3468489511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8601ab5d0 con 0x7fb860074eb0 2024-09-12T01:31:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.291+0000 7fb856ffd640 1 -- 172.21.15.81:0/3468489511 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb850004fa0 con 0x7fb860074eb0 2024-09-12T01:31:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.291+0000 7fb86a045740 1 Processor -- start 2024-09-12T01:31:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.291+0000 7fb86a045740 1 -- start start 2024-09-12T01:31:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.291+0000 7fb86a045740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd564a0 0x563c8cd56880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.291+0000 7fb86a045740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd56dc0 0x563c8cd61140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.291+0000 7fb86a045740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd61680 0x563c8cd63a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.291+0000 7fb86a045740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c8ccbc2e0 con 0x563c8cd564a0 2024-09-12T01:31:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.291+0000 7fb856ffd640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb84c0a2cf0 0x7fb84c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.291+0000 7fb86a045740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563c8cc63ce0 con 0x563c8cd61680 2024-09-12T01:31:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.291+0000 7fb86a045740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563c8ccb82a0 con 0x563c8cd56dc0 2024-09-12T01:31:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb866209640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd564a0 0x563c8cd56880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb866209640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd564a0 0x563c8cd56880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53590/0 (socket says 172.21.15.81:53590) 2024-09-12T01:31:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb866209640 1 -- 172.21.15.81:0/1791377150 learned_addr learned my addr 172.21.15.81:0/1791377150 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb866209640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb84c0a2cf0 0x7fb84c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb865207640 1 --2- 172.21.15.81:0/1791377150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd61680 0x563c8cd63a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb865a08640 1 --2- 172.21.15.81:0/1791377150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd56dc0 0x563c8cd61140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb856ffd640 1 -- 172.21.15.81:0/3468489511 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb8500ceea0 con 0x7fb860074eb0 2024-09-12T01:31:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb866209640 1 -- 172.21.15.81:0/1791377150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd56dc0 msgr2=0x563c8cd61140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb866209640 1 --2- 172.21.15.81:0/1791377150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd56dc0 0x563c8cd61140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb866209640 1 -- 172.21.15.81:0/1791377150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd61680 msgr2=0x563c8cd63a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb866209640 1 --2- 172.21.15.81:0/1791377150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd61680 0x563c8cd63a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb866209640 1 -- 172.21.15.81:0/1791377150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c8cc48440 con 0x563c8cd564a0 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb866209640 1 --2- 172.21.15.81:0/1791377150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd564a0 0x563c8cd56880 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb858014bb0 tx=0x7fb8580117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40b7cd86c37a5f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.292+0000 7fb866209640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb84c0a2cf0 0x7fb84c0a51b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb858011cb0 tx=0x7fb858016000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.293+0000 7fb84bfff640 1 -- 172.21.15.81:0/1791377150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858022070 con 0x563c8cd564a0 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.293+0000 7fb84bfff640 1 -- 172.21.15.81:0/1791377150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb85800c940 con 0x563c8cd564a0 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.293+0000 7fb84bfff640 1 -- 172.21.15.81:0/1791377150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858004a00 con 0x563c8cd564a0 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.293+0000 7fb86a045740 1 -- 172.21.15.81:0/1791377150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd564a0 msgr2=0x563c8cd56880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.293+0000 7fb86a045740 1 --2- 172.21.15.81:0/1791377150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd564a0 0x563c8cd56880 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb858014bb0 tx=0x7fb8580117b0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.293+0000 7fb86a045740 1 -- 172.21.15.81:0/1791377150 shutdown_connections 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.293+0000 7fb86a045740 1 --2- 172.21.15.81:0/1791377150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd61680 0x563c8cd63a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.293+0000 7fb86a045740 1 --2- 172.21.15.81:0/1791377150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd56dc0 0x563c8cd61140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.293+0000 7fb86a045740 1 --2- 172.21.15.81:0/1791377150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd564a0 0x563c8cd56880 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.293+0000 7fb86a045740 1 -- 172.21.15.81:0/1791377150 >> 172.21.15.81:0/1791377150 conn(0x563c8cd52a30 msgr2=0x563c8cd52e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.293+0000 7fb86a045740 1 -- 172.21.15.81:0/1791377150 shutdown_connections 2024-09-12T01:31:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.293+0000 7fb86a045740 1 -- 172.21.15.81:0/1791377150 wait complete. 2024-09-12T01:31:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.294+0000 7fb86a045740 1 -- start start 2024-09-12T01:31:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.294+0000 7fb86a045740 1 Processor -- start 2024-09-12T01:31:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.294+0000 7fb86a045740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd564a0 0x563c8cd60fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.294+0000 7fb86a045740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 0x563c8cd5e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.294+0000 7fb86a045740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd61680 0x563c8cd5e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.294+0000 7fb86a045740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c8cd64250 con 0x563c8cd56dc0 2024-09-12T01:31:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.294+0000 7fb86a045740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563c8cc77050 con 0x563c8cd564a0 2024-09-12T01:31:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.294+0000 7fb86a045740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563c8cd643d0 con 0x563c8cd61680 2024-09-12T01:31:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.294+0000 7fb86a045740 10 client.0 _ll_register_callbacks cb 0x563c8ccb7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb865207640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 0x563c8cd5e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb865207640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 0x563c8cd5e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53602/0 (socket says 172.21.15.81:53602) 2024-09-12T01:31:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb865207640 1 -- 172.21.15.81:0/2859920810 learned_addr learned my addr 172.21.15.81:0/2859920810 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb866209640 1 --2- 172.21.15.81:0/2859920810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd61680 0x563c8cd5e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb865a08640 1 --2- 172.21.15.81:0/2859920810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd564a0 0x563c8cd60fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb865207640 1 -- 172.21.15.81:0/2859920810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd61680 msgr2=0x563c8cd5e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb865207640 1 --2- 172.21.15.81:0/2859920810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd61680 0x563c8cd5e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb865207640 1 -- 172.21.15.81:0/2859920810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd564a0 msgr2=0x563c8cd60fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb865207640 1 --2- 172.21.15.81:0/2859920810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd564a0 0x563c8cd60fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb865207640 1 -- 172.21.15.81:0/2859920810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c8ca2d3c0 con 0x563c8cd56dc0 2024-09-12T01:31:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb865207640 1 --2- 172.21.15.81:0/2859920810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 0x563c8cd5e260 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb850097dc0 tx=0x7fb85009afb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894f975aeb77a9b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb8497fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb8497fa640 1 -- 172.21.15.81:0/2859920810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850020040 con 0x563c8cd56dc0 2024-09-12T01:31:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb8497fa640 1 -- 172.21.15.81:0/2859920810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb8500b4280 con 0x563c8cd56dc0 2024-09-12T01:31:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb86a045740 1 -- 172.21.15.81:0/2859920810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb85800c940 con 0x563c8cd56dc0 2024-09-12T01:31:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb8497fa640 1 -- 172.21.15.81:0/2859920810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb85009baf0 con 0x563c8cd56dc0 2024-09-12T01:31:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb86a045740 10 client.16263 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb86a045740 1 -- 172.21.15.81:0/2859920810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c8cd6fc00 con 0x563c8cd56dc0 2024-09-12T01:31:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.295+0000 7fb8497fa640 1 -- 172.21.15.81:0/2859920810 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb85800c940 con 0x563c8cd56dc0 2024-09-12T01:31:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.296+0000 7fb8497fa640 1 -- 172.21.15.81:0/2859920810 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb8500cc8a0 con 0x563c8cd56dc0 2024-09-12T01:31:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.296+0000 7fb86a045740 10 client.16263 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.296+0000 7fb86a045740 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:31:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.296+0000 7fb86a045740 20 client.16263 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.296+0000 7fb86a045740 1 --2- 172.21.15.81:0/2859920810 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8cd71060 0x563c8cd734b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.296+0000 7fb86a045740 4 client.16263 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:31:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.296+0000 7fb86a045740 1 -- 172.21.15.81:0/2859920810 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c8ccc9850 con 0x563c8cd71060 2024-09-12T01:31:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.296+0000 7fb865a08640 1 --2- 172.21.15.81:0/2859920810 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8cd71060 0x563c8cd734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.296+0000 7fb865a08640 1 --2- 172.21.15.81:0/2859920810 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8cd71060 0x563c8cd734b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc0c47ac243dd20a server_cookie=3a2c39c4f25940ea in_seq=0 out_seq=0 2024-09-12T01:31:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.296+0000 7fb8497fa640 10 client.16263 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb8497fa640 1 -- 172.21.15.81:0/2859920810 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c8ccc9850 con 0x563c8cd71060 2024-09-12T01:31:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb8497fa640 10 client.16263 handle_command_reply: tid=0 2024-09-12T01:31:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb86a045740 1 client.16263 shutdown 2024-09-12T01:31:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb86a045740 1 -- 172.21.15.81:0/2859920810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 msgr2=0x563c8cd5e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb86a045740 1 --2- 172.21.15.81:0/2859920810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 0x563c8cd5e260 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb850097dc0 tx=0x7fb85009afb0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb86a045740 1 -- 172.21.15.81:0/2859920810 shutdown_connections 2024-09-12T01:31:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb86a045740 1 --2- 172.21.15.81:0/2859920810 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8cd71060 0x563c8cd734b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb86a045740 1 --2- 172.21.15.81:0/2859920810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd61680 0x563c8cd5e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb86a045740 1 --2- 172.21.15.81:0/2859920810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 0x563c8cd5e260 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb8497fa640 0 client.16263 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb86a045740 1 --2- 172.21.15.81:0/2859920810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd564a0 0x563c8cd60fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb86a045740 1 -- 172.21.15.81:0/2859920810 >> 172.21.15.81:0/2859920810 conn(0x563c8cd52a30 msgr2=0x563c8cd51b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb86a045740 1 -- 172.21.15.81:0/2859920810 shutdown_connections 2024-09-12T01:31:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb86a045740 1 -- 172.21.15.81:0/2859920810 wait complete. 2024-09-12T01:31:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.297+0000 7fb86a045740 20 client.16263 trim_cache size 0 max 16384 2024-09-12T01:31:21.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.314+0000 7fb86a045740 1 Processor -- start 2024-09-12T01:31:21.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.314+0000 7fb86a045740 1 -- start start 2024-09-12T01:31:21.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.314+0000 7fb86a045740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd564a0 0x563c8cd6d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.314+0000 7fb86a045740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd56dc0 0x563c8cd78d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.314+0000 7fb86a045740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd61680 0x563c8cd792c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.314+0000 7fb86a045740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601b3e50 con 0x563c8cd61680 2024-09-12T01:31:21.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.314+0000 7fb86a045740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601b5990 con 0x563c8cd56dc0 2024-09-12T01:31:21.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.314+0000 7fb86a045740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601b4520 con 0x563c8cd564a0 2024-09-12T01:31:21.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb866209640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd61680 0x563c8cd792c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb866209640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd61680 0x563c8cd792c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53618/0 (socket says 172.21.15.81:53618) 2024-09-12T01:31:21.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb866209640 1 -- 172.21.15.81:0/1103497140 learned_addr learned my addr 172.21.15.81:0/1103497140 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:21.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb865207640 1 --2- 172.21.15.81:0/1103497140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd56dc0 0x563c8cd78d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb865a08640 1 --2- 172.21.15.81:0/1103497140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd564a0 0x563c8cd6d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb866209640 1 -- 172.21.15.81:0/1103497140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd564a0 msgr2=0x563c8cd6d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:21.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb866209640 1 --2- 172.21.15.81:0/1103497140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd564a0 0x563c8cd6d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb866209640 1 -- 172.21.15.81:0/1103497140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd56dc0 msgr2=0x563c8cd78d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:21.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb866209640 1 --2- 172.21.15.81:0/1103497140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd56dc0 0x563c8cd78d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb866209640 1 -- 172.21.15.81:0/1103497140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c8cd562d0 con 0x563c8cd61680 2024-09-12T01:31:21.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb866209640 1 --2- 172.21.15.81:0/1103497140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd61680 0x563c8cd792c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c420 tx=0x7fb85800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c6b766c74dd06f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:21.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb84b7fe640 1 -- 172.21.15.81:0/1103497140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858022040 con 0x563c8cd61680 2024-09-12T01:31:21.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb84b7fe640 1 -- 172.21.15.81:0/1103497140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb858005520 con 0x563c8cd61680 2024-09-12T01:31:21.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.315+0000 7fb84b7fe640 1 -- 172.21.15.81:0/1103497140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8580049b0 con 0x563c8cd61680 2024-09-12T01:31:21.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.316+0000 7fb86a045740 1 -- 172.21.15.81:0/1103497140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd61680 msgr2=0x563c8cd792c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:21.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.316+0000 7fb86a045740 1 --2- 172.21.15.81:0/1103497140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd61680 0x563c8cd792c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c420 tx=0x7fb85800c450 comp rx=0 tx=0).stop 2024-09-12T01:31:21.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.316+0000 7fb86a045740 1 -- 172.21.15.81:0/1103497140 shutdown_connections 2024-09-12T01:31:21.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.316+0000 7fb86a045740 1 --2- 172.21.15.81:0/1103497140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd61680 0x563c8cd792c0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.316+0000 7fb86a045740 1 --2- 172.21.15.81:0/1103497140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd56dc0 0x563c8cd78d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.316+0000 7fb86a045740 1 --2- 172.21.15.81:0/1103497140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd564a0 0x563c8cd6d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.316+0000 7fb86a045740 1 -- 172.21.15.81:0/1103497140 >> 172.21.15.81:0/1103497140 conn(0x563c8cd52a30 msgr2=0x563c8cd598c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:21.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.316+0000 7fb86a045740 1 -- 172.21.15.81:0/1103497140 shutdown_connections 2024-09-12T01:31:21.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.316+0000 7fb86a045740 1 -- 172.21.15.81:0/1103497140 wait complete. 2024-09-12T01:31:21.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.316+0000 7fb86a045740 1 -- start start 2024-09-12T01:31:21.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.316+0000 7fb86a045740 1 Processor -- start 2024-09-12T01:31:21.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb86a045740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd564a0 0x563c8cd5b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb86a045740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 0x563c8cd5b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb86a045740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd61680 0x563c8cd5bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb86a045740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601b52c0 con 0x563c8cd56dc0 2024-09-12T01:31:21.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb86a045740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601b4bf0 con 0x563c8cd564a0 2024-09-12T01:31:21.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb86a045740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601b1e30 con 0x563c8cd61680 2024-09-12T01:31:21.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb86a045740 10 client.0 _ll_register_callbacks cb 0x7fb85000d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:21.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb865207640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 0x563c8cd5b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb865207640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 0x563c8cd5b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53626/0 (socket says 172.21.15.81:53626) 2024-09-12T01:31:21.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb865207640 1 -- 172.21.15.81:0/3124469455 learned_addr learned my addr 172.21.15.81:0/3124469455 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:21.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb865a08640 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd564a0 0x563c8cd5b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb866209640 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd61680 0x563c8cd5bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb865207640 1 -- 172.21.15.81:0/3124469455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd61680 msgr2=0x563c8cd5bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:21.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb865207640 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd61680 0x563c8cd5bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb865207640 1 -- 172.21.15.81:0/3124469455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd564a0 msgr2=0x563c8cd5b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:21.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb865207640 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd564a0 0x563c8cd5b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb865207640 1 -- 172.21.15.81:0/3124469455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c8cddad50 con 0x563c8cd56dc0 2024-09-12T01:31:21.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb865a08640 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd564a0 0x563c8cd5b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:21.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb865207640 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 0x563c8cd5b6e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb8500cc6d0 tx=0x7fb85000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab5dc01a829bd5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:21.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.317+0000 7fb8497fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:21.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb8497fa640 1 -- 172.21.15.81:0/3124469455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850020070 con 0x563c8cd56dc0 2024-09-12T01:31:21.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb8497fa640 1 -- 172.21.15.81:0/3124469455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb850097140 con 0x563c8cd56dc0 2024-09-12T01:31:21.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb86a045740 1 -- 172.21.15.81:0/3124469455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb858005520 con 0x563c8cd56dc0 2024-09-12T01:31:21.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb8497fa640 1 -- 172.21.15.81:0/3124469455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb85009b3f0 con 0x563c8cd56dc0 2024-09-12T01:31:21.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb86a045740 10 client.16269 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:21.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb86a045740 1 -- 172.21.15.81:0/3124469455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c8cddbf60 con 0x563c8cd56dc0 2024-09-12T01:31:21.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb8497fa640 1 -- 172.21.15.81:0/3124469455 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb858005520 con 0x563c8cd56dc0 2024-09-12T01:31:21.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb8497fa640 1 -- 172.21.15.81:0/3124469455 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb850097340 con 0x563c8cd56dc0 2024-09-12T01:31:21.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb86a045740 10 client.16269 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:21.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb86a045740 10 client.16269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:31:21.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb86a045740 20 client.16269 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:21.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb86a045740 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8cddc570 0x563c8cdde990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:21.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb86a045740 4 client.16269 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:31:21.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.318+0000 7fb86a045740 1 -- 172.21.15.81:0/3124469455 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563c8ccc3d60 con 0x563c8cddc570 2024-09-12T01:31:21.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb865a08640 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8cddc570 0x563c8cdde990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:21.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb8497fa640 10 client.16269 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:21.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb865a08640 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8cddc570 0x563c8cdde990 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cd7128444a7422a server_cookie=eda5f78a9fa93370 in_seq=0 out_seq=0 2024-09-12T01:31:21.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb8497fa640 1 -- 172.21.15.81:0/3124469455 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563c8ccc3d60 con 0x563c8cddc570 2024-09-12T01:31:21.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb8497fa640 10 client.16269 handle_command_reply: tid=0 2024-09-12T01:31:21.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb86a045740 1 client.16269 shutdown 2024-09-12T01:31:21.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb86a045740 1 -- 172.21.15.81:0/3124469455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 msgr2=0x563c8cd5b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:21.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb86a045740 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 0x563c8cd5b6e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb8500cc6d0 tx=0x7fb85000b480 comp rx=0 tx=0).stop 2024-09-12T01:31:21.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb86a045740 1 -- 172.21.15.81:0/3124469455 shutdown_connections 2024-09-12T01:31:21.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb86a045740 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8cddc570 0x563c8cdde990 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb86a045740 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8cd61680 0x563c8cd5bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb86a045740 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8cd56dc0 0x563c8cd5b6e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb86a045740 1 --2- 172.21.15.81:0/3124469455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8cd564a0 0x563c8cd5b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb8497fa640 0 client.16269 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:21.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb86a045740 1 -- 172.21.15.81:0/3124469455 >> 172.21.15.81:0/3124469455 conn(0x563c8cd52a30 msgr2=0x563c8cd58fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:21.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb86a045740 1 -- 172.21.15.81:0/3124469455 shutdown_connections 2024-09-12T01:31:21.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.319+0000 7fb86a045740 1 -- 172.21.15.81:0/3124469455 wait complete. 2024-09-12T01:31:21.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.320+0000 7fb86a045740 20 client.16269 trim_cache size 0 max 16384 2024-09-12T01:31:21.336 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:31:21.337 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:31:21.337 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-12T01:31:21.337 INFO:teuthology.orchestra.run.smithi081.stdout: "0004cdd4-d3aa-4c99-bbff-0de24a12c080": { 2024-09-12T01:31:21.337 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-09-12T01:31:21.337 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "0004cdd4-d3aa-4c99-bbff-0de24a12c080", 2024-09-12T01:31:21.337 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-12T01:31:21.337 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:31:21.337 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:31:21.337 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:31:21.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.320+0000 7fb867c6c640 1 -- 172.21.15.81:0/3468489511 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb84c0a2cf0 msgr2=0x7fb84c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.320+0000 7fb867c6c640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb84c0a2cf0 0x7fb84c0a51b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb858011cb0 tx=0x7fb858016000 comp rx=0 tx=0).stop 2024-09-12T01:31:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.320+0000 7fb867c6c640 1 -- 172.21.15.81:0/3468489511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb860074eb0 msgr2=0x7fb8601a4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.320+0000 7fb867c6c640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb860074eb0 0x7fb8601a4c40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb85000d770 tx=0x7fb85000dc30 comp rx=0 tx=0).stop 2024-09-12T01:31:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.320+0000 7fb867c6c640 1 -- 172.21.15.81:0/3468489511 shutdown_connections 2024-09-12T01:31:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.320+0000 7fb867c6c640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb84c0a2cf0 0x7fb84c0a51b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.320+0000 7fb867c6c640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb860112ba0 0x7fb86019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.320+0000 7fb867c6c640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb860074eb0 0x7fb8601a4c40 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.320+0000 7fb867c6c640 1 --2- 172.21.15.81:0/3468489511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb860074590 0x7fb8601a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.320+0000 7fb867c6c640 1 -- 172.21.15.81:0/3468489511 >> 172.21.15.81:0/3468489511 conn(0x7fb8600fd8b0 msgr2=0x7fb8600ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.320+0000 7fb867c6c640 1 -- 172.21.15.81:0/3468489511 shutdown_connections 2024-09-12T01:31:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:21.320+0000 7fb867c6c640 1 -- 172.21.15.81:0/3468489511 wait complete. 2024-09-12T01:31:21.943 INFO:tasks.cephfs.filesystem:scrub status for tag:0004cdd4-d3aa-4c99-bbff-0de24a12c080 - {'path': '/', 'tag': '0004cdd4-d3aa-4c99-bbff-0de24a12c080', 'options': 'recursive,force'} 2024-09-12T01:31:23.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:22 smithi081 ceph-mon[30920]: pgmap v102: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:31:23.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:22 smithi100 ceph-mon[35275]: pgmap v102: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:31:23.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:22 smithi189 ceph-mon[35357]: pgmap v102: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:31:25.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:24 smithi081 ceph-mon[30920]: pgmap v103: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:31:25.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:24 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:31:25.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:24 smithi100 ceph-mon[35275]: pgmap v103: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:31:25.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:24 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:31:25.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:24 smithi189 ceph-mon[35357]: pgmap v103: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:31:25.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:24 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:31:27.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:26 smithi081 ceph-mon[30920]: pgmap v104: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:31:27.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:26 smithi100 ceph-mon[35275]: pgmap v104: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:31:27.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:26 smithi189 ceph-mon[35357]: pgmap v104: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:31:29.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:28 smithi081 ceph-mon[30920]: pgmap v105: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:31:29.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:28 smithi100 ceph-mon[35275]: pgmap v105: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:31:29.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:28 smithi189 ceph-mon[35357]: pgmap v105: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:31:31.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:30 smithi081 ceph-mon[30920]: pgmap v106: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:31:31.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:30 smithi100 ceph-mon[35275]: pgmap v106: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:31:31.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:30 smithi189 ceph-mon[35357]: pgmap v106: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:31:33.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:32 smithi081 ceph-mon[30920]: pgmap v107: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:31:33.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:32 smithi100 ceph-mon[35275]: pgmap v107: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:31:33.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:32 smithi189 ceph-mon[35357]: pgmap v107: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:31:35.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:34 smithi081 ceph-mon[30920]: pgmap v108: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:31:35.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:34 smithi100 ceph-mon[35275]: pgmap v108: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:31:35.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:34 smithi189 ceph-mon[35357]: pgmap v108: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:31:37.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:36 smithi081 ceph-mon[30920]: pgmap v109: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:31:37.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:36 smithi100 ceph-mon[35275]: pgmap v109: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:31:37.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:36 smithi189 ceph-mon[35357]: pgmap v109: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:31:39.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:38 smithi081 ceph-mon[30920]: pgmap v110: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:31:39.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:38 smithi100 ceph-mon[35275]: pgmap v110: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:31:39.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:38 smithi189 ceph-mon[35357]: pgmap v110: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:31:41.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:40 smithi081 ceph-mon[30920]: pgmap v111: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T01:31:41.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:40 smithi100 ceph-mon[35275]: pgmap v111: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T01:31:41.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:40 smithi189 ceph-mon[35357]: pgmap v111: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T01:31:43.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:42 smithi081 ceph-mon[30920]: pgmap v112: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T01:31:43.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:42 smithi100 ceph-mon[35275]: pgmap v112: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T01:31:43.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:42 smithi189 ceph-mon[35357]: pgmap v112: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T01:31:45.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:44 smithi081 ceph-mon[30920]: pgmap v113: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T01:31:45.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:44 smithi100 ceph-mon[35275]: pgmap v113: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T01:31:45.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:44 smithi189 ceph-mon[35357]: pgmap v113: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T01:31:47.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:46 smithi081 ceph-mon[30920]: pgmap v114: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T01:31:47.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:46 smithi100 ceph-mon[35275]: pgmap v114: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T01:31:47.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:46 smithi189 ceph-mon[35357]: pgmap v114: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T01:31:49.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:48 smithi081 ceph-mon[30920]: pgmap v115: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T01:31:49.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:48 smithi100 ceph-mon[35275]: pgmap v115: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T01:31:49.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:48 smithi189 ceph-mon[35357]: pgmap v115: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T01:31:51.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:50 smithi081 ceph-mon[30920]: pgmap v116: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T01:31:51.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:50 smithi100 ceph-mon[35275]: pgmap v116: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T01:31:51.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:50 smithi189 ceph-mon[35357]: pgmap v116: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T01:31:51.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:31:52.204 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:52.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.653+0000 7f7fb80b9640 1 -- 172.21.15.81:0/3951927108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0101420 msgr2=0x7f7fb010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:52.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.653+0000 7f7fb80b9640 1 --2- 172.21.15.81:0/3951927108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0101420 0x7f7fb010d950 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009cd0 tx=0x7f7fa802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.653+0000 7f7fb80b9640 1 -- 172.21.15.81:0/3951927108 shutdown_connections 2024-09-12T01:31:52.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.653+0000 7f7fb80b9640 1 --2- 172.21.15.81:0/3951927108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0101420 0x7f7fb010d950 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.653+0000 7f7fb80b9640 1 --2- 172.21.15.81:0/3951927108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fb0100a80 0x7f7fb0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.653+0000 7f7fb80b9640 1 --2- 172.21.15.81:0/3951927108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fb0106a80 0x7f7fb0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.653+0000 7f7fb80b9640 1 -- 172.21.15.81:0/3951927108 >> 172.21.15.81:0/3951927108 conn(0x7f7fb00fc7a0 msgr2=0x7f7fb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:52.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.653+0000 7f7fb80b9640 1 -- 172.21.15.81:0/3951927108 shutdown_connections 2024-09-12T01:31:52.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.653+0000 7f7fb80b9640 1 -- 172.21.15.81:0/3951927108 wait complete. 2024-09-12T01:31:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.653+0000 7f7fb80b9640 1 Processor -- start 2024-09-12T01:31:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.654+0000 7f7fb80b9640 1 -- start start 2024-09-12T01:31:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.654+0000 7f7fb80b9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fb0100a80 0x7f7fb0197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.654+0000 7f7fb80b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0101420 0x7f7fb0197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.654+0000 7f7fb80b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fb0106a80 0x7f7fb0197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.654+0000 7f7fb5654640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0101420 0x7f7fb0197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.654+0000 7f7fb80b9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb0110ea0 con 0x7f7fb0101420 2024-09-12T01:31:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.654+0000 7f7fb80b9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb0110d20 con 0x7f7fb0106a80 2024-09-12T01:31:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.654+0000 7f7fb80b9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb0111020 con 0x7f7fb0100a80 2024-09-12T01:31:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.654+0000 7f7fb5654640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0101420 0x7f7fb0197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36036/0 (socket says 172.21.15.81:36036) 2024-09-12T01:31:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.654+0000 7f7fb5654640 1 -- 172.21.15.81:0/3049356627 learned_addr learned my addr 172.21.15.81:0/3049356627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.654+0000 7f7fb5654640 1 -- 172.21.15.81:0/3049356627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fb0100a80 msgr2=0x7f7fb0197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:52.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.654+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/3049356627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fb0100a80 0x7f7fb0197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.655+0000 7f7fb5654640 1 --2- 172.21.15.81:0/3049356627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fb0100a80 0x7f7fb0197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.655+0000 7f7fb5654640 1 -- 172.21.15.81:0/3049356627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fb0106a80 msgr2=0x7f7fb0197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:52.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.655+0000 7f7fb5654640 1 --2- 172.21.15.81:0/3049356627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fb0106a80 0x7f7fb0197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.655+0000 7f7fb5654640 1 -- 172.21.15.81:0/3049356627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb01a68b0 con 0x7f7fb0101420 2024-09-12T01:31:52.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.655+0000 7f7fb5654640 1 --2- 172.21.15.81:0/3049356627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0101420 0x7f7fb0197580 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000b4a0 tx=0x7f7fa000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:52.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.655+0000 7f7fa6ffd640 1 -- 172.21.15.81:0/3049356627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0014070 con 0x7f7fb0101420 2024-09-12T01:31:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.655+0000 7f7fa6ffd640 1 -- 172.21.15.81:0/3049356627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fa0010af0 con 0x7f7fb0101420 2024-09-12T01:31:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.655+0000 7f7fb80b9640 1 -- 172.21.15.81:0/3049356627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb01a6ba0 con 0x7f7fb0101420 2024-09-12T01:31:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.655+0000 7f7fa6ffd640 1 -- 172.21.15.81:0/3049356627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0017d10 con 0x7f7fb0101420 2024-09-12T01:31:52.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.655+0000 7f7fb80b9640 1 -- 172.21.15.81:0/3049356627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb01a7130 con 0x7f7fb0101420 2024-09-12T01:31:52.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.658+0000 7f7fa6ffd640 1 -- 172.21.15.81:0/3049356627 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7fa0017070 con 0x7f7fb0101420 2024-09-12T01:31:52.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.658+0000 7f7fa6ffd640 1 --2- 172.21.15.81:0/3049356627 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7f9c0a2d70 0x7f7f9c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/3049356627 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7f9c0a2d70 0x7f7f9c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fa6ffd640 1 -- 172.21.15.81:0/3049356627 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7fa00ce6b0 con 0x7f7fb0101420 2024-09-12T01:31:52.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fba492740 1 Processor -- start 2024-09-12T01:31:52.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fba492740 1 -- start start 2024-09-12T01:31:52.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/3049356627 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7f9c0a2d70 0x7f7f9c0a5230 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00ba40 tx=0x7f7fac005cc0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:52.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fba492740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd885654a0 0x55fd88565880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fba492740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88565dc0 0x55fd88570140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fba492740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88570680 0x55fd88572a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fba492740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fd884cb2e0 con 0x55fd88570680 2024-09-12T01:31:52.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fba492740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fd88472ce0 con 0x55fd885654a0 2024-09-12T01:31:52.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fba492740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fd884c72a0 con 0x55fd88565dc0 2024-09-12T01:31:52.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fb6656640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88570680 0x55fd88572a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fb6656640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88570680 0x55fd88572a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36040/0 (socket says 172.21.15.81:36040) 2024-09-12T01:31:52.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.659+0000 7f7fb6656640 1 -- 172.21.15.81:0/626350773 learned_addr learned my addr 172.21.15.81:0/626350773 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:52.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.660+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/626350773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd885654a0 0x55fd88565880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.660+0000 7f7fb5654640 1 --2- 172.21.15.81:0/626350773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88565dc0 0x55fd88570140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.660+0000 7f7fb6656640 1 -- 172.21.15.81:0/626350773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88565dc0 msgr2=0x55fd88570140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:52.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.660+0000 7f7fb6656640 1 --2- 172.21.15.81:0/626350773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88565dc0 0x55fd88570140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.660+0000 7f7fb6656640 1 -- 172.21.15.81:0/626350773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd885654a0 msgr2=0x55fd88565880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:52.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.660+0000 7f7fb6656640 1 --2- 172.21.15.81:0/626350773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd885654a0 0x55fd88565880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.660+0000 7f7fb6656640 1 -- 172.21.15.81:0/626350773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd88457440 con 0x55fd88570680 2024-09-12T01:31:52.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.660+0000 7f7fb5654640 1 --2- 172.21.15.81:0/626350773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88565dc0 0x55fd88570140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:52.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.660+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/626350773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd885654a0 0x55fd88565880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:52.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.660+0000 7f7fb6656640 1 --2- 172.21.15.81:0/626350773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88570680 0x55fd88572a70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8005fc0 tx=0x7f7fa8009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd28c73a8bf1572 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.660+0000 7f7f9bfff640 1 -- 172.21.15.81:0/626350773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80318c0 con 0x55fd88570680 2024-09-12T01:31:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.660+0000 7f7f9bfff640 1 -- 172.21.15.81:0/626350773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fa8036040 con 0x55fd88570680 2024-09-12T01:31:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.660+0000 7f7f9bfff640 1 -- 172.21.15.81:0/626350773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8004590 con 0x55fd88570680 2024-09-12T01:31:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.661+0000 7f7fba492740 1 -- 172.21.15.81:0/626350773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88570680 msgr2=0x55fd88572a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.661+0000 7f7fba492740 1 --2- 172.21.15.81:0/626350773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88570680 0x55fd88572a70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8005fc0 tx=0x7f7fa8009a20 comp rx=0 tx=0).stop 2024-09-12T01:31:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.661+0000 7f7fba492740 1 -- 172.21.15.81:0/626350773 shutdown_connections 2024-09-12T01:31:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.661+0000 7f7fba492740 1 --2- 172.21.15.81:0/626350773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88570680 0x55fd88572a70 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.661+0000 7f7fba492740 1 --2- 172.21.15.81:0/626350773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88565dc0 0x55fd88570140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.661+0000 7f7fba492740 1 --2- 172.21.15.81:0/626350773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd885654a0 0x55fd88565880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.661+0000 7f7fba492740 1 -- 172.21.15.81:0/626350773 >> 172.21.15.81:0/626350773 conn(0x55fd88561a30 msgr2=0x55fd88561e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.661+0000 7f7fba492740 1 -- 172.21.15.81:0/626350773 shutdown_connections 2024-09-12T01:31:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.661+0000 7f7fba492740 1 -- 172.21.15.81:0/626350773 wait complete. 2024-09-12T01:31:52.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.661+0000 7f7fba492740 1 -- start start 2024-09-12T01:31:52.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.661+0000 7f7fba492740 1 Processor -- start 2024-09-12T01:31:52.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fba492740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd885654a0 0x55fd8856ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fba492740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88565dc0 0x55fd8856d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fba492740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88570680 0x55fd8856d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fba492740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fd88573250 con 0x55fd88565dc0 2024-09-12T01:31:52.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fba492740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fd88486050 con 0x55fd885654a0 2024-09-12T01:31:52.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fba492740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fd885733d0 con 0x55fd88570680 2024-09-12T01:31:52.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fba492740 10 client.0 _ll_register_callbacks cb 0x55fd884c6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:52.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fb5654640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88565dc0 0x55fd8856d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fb5654640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88565dc0 0x55fd8856d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36044/0 (socket says 172.21.15.81:36044) 2024-09-12T01:31:52.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fb5654640 1 -- 172.21.15.81:0/2803954982 learned_addr learned my addr 172.21.15.81:0/2803954982 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:52.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/2803954982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd885654a0 0x55fd8856ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fb5654640 1 -- 172.21.15.81:0/2803954982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88570680 msgr2=0x55fd8856d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:52.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fb5654640 1 --2- 172.21.15.81:0/2803954982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88570680 0x55fd8856d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fb5654640 1 -- 172.21.15.81:0/2803954982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd885654a0 msgr2=0x55fd8856ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:52.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fb5654640 1 --2- 172.21.15.81:0/2803954982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd885654a0 0x55fd8856ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fb5654640 1 -- 172.21.15.81:0/2803954982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd8823c3c0 con 0x55fd88565dc0 2024-09-12T01:31:52.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7fb5654640 1 --2- 172.21.15.81:0/2803954982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88565dc0 0x55fd8856d240 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009420 tx=0x7f7fa009add0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742e48ab4492837e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:52.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.662+0000 7f7f997fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:52.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7f997fa640 1 -- 172.21.15.81:0/2803954982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa001e040 con 0x55fd88565dc0 2024-09-12T01:31:52.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7f997fa640 1 -- 172.21.15.81:0/2803954982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7fa00cc0b0 con 0x55fd88565dc0 2024-09-12T01:31:52.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7fba492740 1 -- 172.21.15.81:0/2803954982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fa8036040 con 0x55fd88565dc0 2024-09-12T01:31:52.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7f997fa640 1 -- 172.21.15.81:0/2803954982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7fa0097380 con 0x55fd88565dc0 2024-09-12T01:31:52.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7fba492740 10 client.16281 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:52.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7fba492740 1 -- 172.21.15.81:0/2803954982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd8857ec30 con 0x55fd88565dc0 2024-09-12T01:31:52.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7f997fa640 1 -- 172.21.15.81:0/2803954982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fa0079b30 con 0x55fd88565dc0 2024-09-12T01:31:52.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7f997fa640 1 -- 172.21.15.81:0/2803954982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7fa009a2b0 con 0x55fd88565dc0 2024-09-12T01:31:52.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7fba492740 10 client.16281 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:52.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7fba492740 10 client.16281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:31:52.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7fba492740 20 client.16281 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:52.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7fba492740 1 --2- 172.21.15.81:0/2803954982 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fd88580090 0x55fd885824c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7fba492740 4 client.16281 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:31:52.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.663+0000 7f7fba492740 1 -- 172.21.15.81:0/2803954982 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7fa8036040 con 0x55fd88580090 2024-09-12T01:31:52.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.664+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/2803954982 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fd88580090 0x55fd885824c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.664+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/2803954982 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fd88580090 0x55fd885824c0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e41154994b507b4d server_cookie=9f8516ea37350e75 in_seq=0 out_seq=0 2024-09-12T01:31:52.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.664+0000 7f7f997fa640 10 client.16281 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:52.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7f997fa640 1 -- 172.21.15.81:0/2803954982 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7fa8036040 con 0x55fd88580090 2024-09-12T01:31:52.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7f997fa640 10 client.16281 handle_command_reply: tid=0 2024-09-12T01:31:52.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7fba492740 1 client.16281 shutdown 2024-09-12T01:31:52.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7fba492740 1 -- 172.21.15.81:0/2803954982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88565dc0 msgr2=0x55fd8856d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:52.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7fba492740 1 --2- 172.21.15.81:0/2803954982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88565dc0 0x55fd8856d240 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009420 tx=0x7f7fa009add0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7fba492740 1 -- 172.21.15.81:0/2803954982 shutdown_connections 2024-09-12T01:31:52.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7fba492740 1 --2- 172.21.15.81:0/2803954982 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fd88580090 0x55fd885824c0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7fba492740 1 --2- 172.21.15.81:0/2803954982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88570680 0x55fd8856d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7f997fa640 0 client.16281 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:52.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7fba492740 1 --2- 172.21.15.81:0/2803954982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd88565dc0 0x55fd8856d240 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7fba492740 1 --2- 172.21.15.81:0/2803954982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd885654a0 0x55fd8856ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7fba492740 1 -- 172.21.15.81:0/2803954982 >> 172.21.15.81:0/2803954982 conn(0x55fd88561a30 msgr2=0x55fd88567710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:52.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7fba492740 1 -- 172.21.15.81:0/2803954982 shutdown_connections 2024-09-12T01:31:52.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7fba492740 1 -- 172.21.15.81:0/2803954982 wait complete. 2024-09-12T01:31:52.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.665+0000 7f7fba492740 20 client.16281 trim_cache size 0 max 16384 2024-09-12T01:31:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.682+0000 7f7fba492740 1 Processor -- start 2024-09-12T01:31:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.682+0000 7f7fba492740 1 -- start start 2024-09-12T01:31:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.682+0000 7f7fba492740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 0x55fd8856f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.682+0000 7f7fba492740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd88565dc0 0x55fd88587d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.682+0000 7f7fba492740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88570680 0x55fd885882d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.682+0000 7f7fba492740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb01afab0 con 0x55fd885654a0 2024-09-12T01:31:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.682+0000 7f7fba492740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb01b15f0 con 0x55fd88565dc0 2024-09-12T01:31:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.682+0000 7f7fba492740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb01b0180 con 0x55fd88570680 2024-09-12T01:31:52.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7fb5e55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 0x55fd8856f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7fb5e55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 0x55fd8856f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36058/0 (socket says 172.21.15.81:36058) 2024-09-12T01:31:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7fb5e55640 1 -- 172.21.15.81:0/2851133790 learned_addr learned my addr 172.21.15.81:0/2851133790 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7fb5654640 1 --2- 172.21.15.81:0/2851133790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd88565dc0 0x55fd88587d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7fb6656640 1 --2- 172.21.15.81:0/2851133790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88570680 0x55fd885882d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7fb5e55640 1 -- 172.21.15.81:0/2851133790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88570680 msgr2=0x55fd885882d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:52.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/2851133790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88570680 0x55fd885882d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7fb5e55640 1 -- 172.21.15.81:0/2851133790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd88565dc0 msgr2=0x55fd88587d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:52.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/2851133790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd88565dc0 0x55fd88587d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7fb5e55640 1 -- 172.21.15.81:0/2851133790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd88570300 con 0x55fd885654a0 2024-09-12T01:31:52.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/2851133790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 0x55fd8856f1b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55fd88582d30 tx=0x7f7fac013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bf4836f53f5de2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:52.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7f9b7fe640 1 -- 172.21.15.81:0/2851133790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac0275b0 con 0x55fd885654a0 2024-09-12T01:31:52.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7f9b7fe640 1 -- 172.21.15.81:0/2851133790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fac02d070 con 0x55fd885654a0 2024-09-12T01:31:52.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.683+0000 7f7f9b7fe640 1 -- 172.21.15.81:0/2851133790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac00fc50 con 0x55fd885654a0 2024-09-12T01:31:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.684+0000 7f7fba492740 1 -- 172.21.15.81:0/2851133790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 msgr2=0x55fd8856f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.684+0000 7f7fba492740 1 --2- 172.21.15.81:0/2851133790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 0x55fd8856f1b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55fd88582d30 tx=0x7f7fac013000 comp rx=0 tx=0).stop 2024-09-12T01:31:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.684+0000 7f7fba492740 1 -- 172.21.15.81:0/2851133790 shutdown_connections 2024-09-12T01:31:52.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.684+0000 7f7fba492740 1 --2- 172.21.15.81:0/2851133790 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88570680 0x55fd885882d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.684+0000 7f7fba492740 1 --2- 172.21.15.81:0/2851133790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd88565dc0 0x55fd88587d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.684+0000 7f7fba492740 1 --2- 172.21.15.81:0/2851133790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 0x55fd8856f1b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.684+0000 7f7fba492740 1 -- 172.21.15.81:0/2851133790 >> 172.21.15.81:0/2851133790 conn(0x55fd88561a30 msgr2=0x55fd8856eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.684+0000 7f7fba492740 1 -- 172.21.15.81:0/2851133790 shutdown_connections 2024-09-12T01:31:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.684+0000 7f7fba492740 1 -- 172.21.15.81:0/2851133790 wait complete. 2024-09-12T01:31:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.684+0000 7f7fba492740 1 -- start start 2024-09-12T01:31:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fba492740 1 Processor -- start 2024-09-12T01:31:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fba492740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 0x55fd88576420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fba492740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88565dc0 0x55fd88576960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fba492740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd88570680 0x55fd88576ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fba492740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb01b0f20 con 0x55fd885654a0 2024-09-12T01:31:52.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fba492740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb01b0850 con 0x55fd88570680 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fba492740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb01ada90 con 0x55fd88565dc0 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fba492740 10 client.0 _ll_register_callbacks cb 0x7f7fa0097070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fb5e55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 0x55fd88576420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fb5e55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 0x55fd88576420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36074/0 (socket says 172.21.15.81:36074) 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fb5e55640 1 -- 172.21.15.81:0/4145391223 learned_addr learned my addr 172.21.15.81:0/4145391223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fb5654640 1 --2- 172.21.15.81:0/4145391223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88565dc0 0x55fd88576960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fb6656640 1 --2- 172.21.15.81:0/4145391223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd88570680 0x55fd88576ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fb5e55640 1 -- 172.21.15.81:0/4145391223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88565dc0 msgr2=0x55fd88576960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/4145391223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88565dc0 0x55fd88576960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fb5e55640 1 -- 172.21.15.81:0/4145391223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd88570680 msgr2=0x55fd88576ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/4145391223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd88570680 0x55fd88576ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.685+0000 7f7fb5e55640 1 -- 172.21.15.81:0/4145391223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd885e9df0 con 0x55fd885654a0 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7fb5e55640 1 --2- 172.21.15.81:0/4145391223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 0x55fd88576420 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7fac027fd0 tx=0x7f7fac0108a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f137bdf940576030 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7f997fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7f997fa640 1 -- 172.21.15.81:0/4145391223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac005040 con 0x55fd885654a0 2024-09-12T01:31:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7f997fa640 1 -- 172.21.15.81:0/4145391223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7fac0051e0 con 0x55fd885654a0 2024-09-12T01:31:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7fba492740 1 -- 172.21.15.81:0/4145391223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fac02d070 con 0x55fd885654a0 2024-09-12T01:31:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7f997fa640 1 -- 172.21.15.81:0/4145391223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7fac0053e0 con 0x55fd885654a0 2024-09-12T01:31:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7fba492740 10 client.16287 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7fba492740 1 -- 172.21.15.81:0/4145391223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd885eb0e0 con 0x55fd885654a0 2024-09-12T01:31:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7f997fa640 1 -- 172.21.15.81:0/4145391223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fac02d070 con 0x55fd885654a0 2024-09-12T01:31:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7f997fa640 1 -- 172.21.15.81:0/4145391223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7fac0275b0 con 0x55fd885654a0 2024-09-12T01:31:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7fba492740 10 client.16287 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7fba492740 10 client.16287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:31:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7fba492740 20 client.16287 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7fba492740 1 --2- 172.21.15.81:0/4145391223 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fd885eb7a0 0x55fd885edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7fba492740 4 client.16287 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:31:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.686+0000 7f7fba492740 1 -- 172.21.15.81:0/4145391223 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fd884d8850 con 0x55fd885eb7a0 2024-09-12T01:31:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7fb5654640 1 --2- 172.21.15.81:0/4145391223 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fd885eb7a0 0x55fd885edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7fb5654640 1 --2- 172.21.15.81:0/4145391223 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fd885eb7a0 0x55fd885edbc0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74e4fbdbf71421be server_cookie=558470ad7df2b8f8 in_seq=0 out_seq=0 2024-09-12T01:31:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7f997fa640 10 client.16287 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7f997fa640 1 -- 172.21.15.81:0/4145391223 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fd884d8850 con 0x55fd885eb7a0 2024-09-12T01:31:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7f997fa640 10 client.16287 handle_command_reply: tid=0 2024-09-12T01:31:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7fba492740 1 client.16287 shutdown 2024-09-12T01:31:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7fba492740 1 -- 172.21.15.81:0/4145391223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 msgr2=0x55fd88576420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7fba492740 1 --2- 172.21.15.81:0/4145391223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 0x55fd88576420 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7fac027fd0 tx=0x7f7fac0108a0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7fba492740 1 -- 172.21.15.81:0/4145391223 shutdown_connections 2024-09-12T01:31:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7fba492740 1 --2- 172.21.15.81:0/4145391223 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55fd885eb7a0 0x55fd885edbc0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7fba492740 1 --2- 172.21.15.81:0/4145391223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd88570680 0x55fd88576ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7fba492740 1 --2- 172.21.15.81:0/4145391223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fd88565dc0 0x55fd88576960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7f997fa640 0 client.16287 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:31:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7fba492740 1 --2- 172.21.15.81:0/4145391223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd885654a0 0x55fd88576420 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7fba492740 1 -- 172.21.15.81:0/4145391223 >> 172.21.15.81:0/4145391223 conn(0x55fd88561a30 msgr2=0x55fd88560b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7fba492740 1 -- 172.21.15.81:0/4145391223 shutdown_connections 2024-09-12T01:31:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.687+0000 7f7fba492740 1 -- 172.21.15.81:0/4145391223 wait complete. 2024-09-12T01:31:52.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.688+0000 7f7fba492740 20 client.16287 trim_cache size 0 max 16384 2024-09-12T01:31:52.694 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:31:52.695 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:31:52.695 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:31:52.695 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:31:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.688+0000 7f7fb80b9640 1 -- 172.21.15.81:0/3049356627 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7f9c0a2d70 msgr2=0x7f7f9c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.688+0000 7f7fb80b9640 1 --2- 172.21.15.81:0/3049356627 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7f9c0a2d70 0x7f7f9c0a5230 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00ba40 tx=0x7f7fac005cc0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.688+0000 7f7fb80b9640 1 -- 172.21.15.81:0/3049356627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0101420 msgr2=0x7f7fb0197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.688+0000 7f7fb80b9640 1 --2- 172.21.15.81:0/3049356627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0101420 0x7f7fb0197580 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000b4a0 tx=0x7f7fa000b960 comp rx=0 tx=0).stop 2024-09-12T01:31:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.688+0000 7f7fb80b9640 1 -- 172.21.15.81:0/3049356627 shutdown_connections 2024-09-12T01:31:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.688+0000 7f7fb80b9640 1 --2- 172.21.15.81:0/3049356627 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7f9c0a2d70 0x7f7f9c0a5230 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.688+0000 7f7fb80b9640 1 --2- 172.21.15.81:0/3049356627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fb0106a80 0x7f7fb0197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.688+0000 7f7fb80b9640 1 --2- 172.21.15.81:0/3049356627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0101420 0x7f7fb0197580 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.688+0000 7f7fb80b9640 1 --2- 172.21.15.81:0/3049356627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fb0100a80 0x7f7fb0197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.688+0000 7f7fb80b9640 1 -- 172.21.15.81:0/3049356627 >> 172.21.15.81:0/3049356627 conn(0x7f7fb00fc7a0 msgr2=0x7f7fb00fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.688+0000 7f7fb80b9640 1 -- 172.21.15.81:0/3049356627 shutdown_connections 2024-09-12T01:31:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:52.688+0000 7f7fb80b9640 1 -- 172.21.15.81:0/3049356627 wait complete. 2024-09-12T01:31:53.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:52 smithi081 ceph-mon[30920]: pgmap v117: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:31:53.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:52 smithi100 ceph-mon[35275]: pgmap v117: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:31:53.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:52 smithi189 ceph-mon[35357]: pgmap v117: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:31:53.529 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:31:53.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:31:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:54.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.311+0000 7f1634d63640 1 -- 172.21.15.81:0/1258341853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1630100eb0 msgr2=0x7f16301067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.311+0000 7f1634d63640 1 --2- 172.21.15.81:0/1258341853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1630100eb0 0x7f16301067a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1618009900 tx=0x7f161802a410 comp rx=0 tx=0).stop 2024-09-12T01:31:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.311+0000 7f1634d63640 1 -- 172.21.15.81:0/1258341853 shutdown_connections 2024-09-12T01:31:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.311+0000 7f1634d63640 1 --2- 172.21.15.81:0/1258341853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1630106ed0 0x7f163010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.311+0000 7f1634d63640 1 --2- 172.21.15.81:0/1258341853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1630100eb0 0x7f16301067a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.311+0000 7f1634d63640 1 --2- 172.21.15.81:0/1258341853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1630100500 0x7f16301008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.311+0000 7f1634d63640 1 -- 172.21.15.81:0/1258341853 >> 172.21.15.81:0/1258341853 conn(0x7f16300fc5c0 msgr2=0x7f16300fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.311+0000 7f1634d63640 1 -- 172.21.15.81:0/1258341853 shutdown_connections 2024-09-12T01:31:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.311+0000 7f1634d63640 1 -- 172.21.15.81:0/1258341853 wait complete. 2024-09-12T01:31:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.312+0000 7f1634d63640 1 Processor -- start 2024-09-12T01:31:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.312+0000 7f1634d63640 1 -- start start 2024-09-12T01:31:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.312+0000 7f1634d63640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1630100500 0x7f1630101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.312+0000 7f1634d63640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1630100eb0 0x7f16301019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.312+0000 7f1634d63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1630106ed0 0x7f1630101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.312+0000 7f1634d63640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1630111fa0 con 0x7f1630106ed0 2024-09-12T01:31:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.312+0000 7f1634d63640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1630111e20 con 0x7f1630100eb0 2024-09-12T01:31:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.312+0000 7f1634d63640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1630112120 con 0x7f1630100500 2024-09-12T01:31:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.312+0000 7f162ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1630106ed0 0x7f1630101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.312+0000 7f162ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1630106ed0 0x7f1630101f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36090/0 (socket says 172.21.15.81:36090) 2024-09-12T01:31:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.312+0000 7f162ed9d640 1 -- 172.21.15.81:0/3246898245 learned_addr learned my addr 172.21.15.81:0/3246898245 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.312+0000 7f162dd9b640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1630100eb0 0x7f16301019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.312+0000 7f162e59c640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1630100500 0x7f1630101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.313+0000 7f162ed9d640 1 -- 172.21.15.81:0/3246898245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1630100500 msgr2=0x7f1630101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.313+0000 7f162ed9d640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1630100500 0x7f1630101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.313+0000 7f162ed9d640 1 -- 172.21.15.81:0/3246898245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1630100eb0 msgr2=0x7f16301019c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.313+0000 7f162ed9d640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1630100eb0 0x7f16301019c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.313+0000 7f162ed9d640 1 -- 172.21.15.81:0/3246898245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16301a6960 con 0x7f1630106ed0 2024-09-12T01:31:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.313+0000 7f162ed9d640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1630106ed0 0x7f1630101f00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f162800b970 tx=0x7f162800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.313+0000 7f16277fe640 1 -- 172.21.15.81:0/3246898245 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628019070 con 0x7f1630106ed0 2024-09-12T01:31:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.313+0000 7f16277fe640 1 -- 172.21.15.81:0/3246898245 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f162800cb40 con 0x7f1630106ed0 2024-09-12T01:31:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.313+0000 7f1634d63640 1 -- 172.21.15.81:0/3246898245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16301a6c50 con 0x7f1630106ed0 2024-09-12T01:31:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.313+0000 7f16277fe640 1 -- 172.21.15.81:0/3246898245 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628007650 con 0x7f1630106ed0 2024-09-12T01:31:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.313+0000 7f1634d63640 1 -- 172.21.15.81:0/3246898245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16301a7110 con 0x7f1630106ed0 2024-09-12T01:31:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.314+0000 7f1634d63640 1 -- 172.21.15.81:0/3246898245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16301008e0 con 0x7f1630106ed0 2024-09-12T01:31:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.315+0000 7f16277fe640 1 -- 172.21.15.81:0/3246898245 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f162801c070 con 0x7f1630106ed0 2024-09-12T01:31:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.316+0000 7f16277fe640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f161c0a2cf0 0x7f161c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.316+0000 7f162e59c640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f161c0a2cf0 0x7f161c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.316+0000 7f16277fe640 1 -- 172.21.15.81:0/3246898245 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f16280ce8f0 con 0x7f1630106ed0 2024-09-12T01:31:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.317+0000 7f162e59c640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f161c0a2cf0 0x7f161c0a51b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1620005e10 tx=0x7f1620005da0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.320+0000 7f16277fe640 1 -- 172.21.15.81:0/3246898245 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f162809b000 con 0x7f1630106ed0 2024-09-12T01:31:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.524+0000 7f1634d63640 1 -- 172.21.15.81:0/3246898245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f163010a140 con 0x7f1630106ed0 2024-09-12T01:31:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.525+0000 7f16277fe640 1 -- 172.21.15.81:0/3246898245 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f162809f300 con 0x7f1630106ed0 2024-09-12T01:31:54.525 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:31:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:31:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:31:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.527+0000 7f1634d63640 1 -- 172.21.15.81:0/3246898245 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f161c0a2cf0 msgr2=0x7f161c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.527+0000 7f1634d63640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f161c0a2cf0 0x7f161c0a51b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1620005e10 tx=0x7f1620005da0 comp rx=0 tx=0).stop 2024-09-12T01:31:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.527+0000 7f1634d63640 1 -- 172.21.15.81:0/3246898245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1630106ed0 msgr2=0x7f1630101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.527+0000 7f1634d63640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1630106ed0 0x7f1630101f00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f162800b970 tx=0x7f162800be30 comp rx=0 tx=0).stop 2024-09-12T01:31:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.527+0000 7f1634d63640 1 -- 172.21.15.81:0/3246898245 shutdown_connections 2024-09-12T01:31:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.527+0000 7f1634d63640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f161c0a2cf0 0x7f161c0a51b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.527+0000 7f1634d63640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1630106ed0 0x7f1630101f00 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.527+0000 7f1634d63640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1630100eb0 0x7f16301019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.527+0000 7f1634d63640 1 --2- 172.21.15.81:0/3246898245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1630100500 0x7f1630101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.528+0000 7f1634d63640 1 -- 172.21.15.81:0/3246898245 >> 172.21.15.81:0/3246898245 conn(0x7f16300fc5c0 msgr2=0x7f1630105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.528+0000 7f1634d63640 1 -- 172.21.15.81:0/3246898245 shutdown_connections 2024-09-12T01:31:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:54.528+0000 7f1634d63640 1 -- 172.21.15.81:0/3246898245 wait complete. 2024-09-12T01:31:55.235 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:54 smithi081 ceph-mon[30920]: pgmap v118: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:31:55.235 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:54 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3246898245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:31:55.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:31:55.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:54 smithi100 ceph-mon[35275]: pgmap v118: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:31:55.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:54 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3246898245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:31:55.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:54 smithi189 ceph-mon[35357]: pgmap v118: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:31:55.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:54 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3246898245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:31:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:56.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.986+0000 7fa8368ea640 1 -- 172.21.15.81:0/87243549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa830102790 msgr2=0x7fa8301067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.986+0000 7fa8368ea640 1 --2- 172.21.15.81:0/87243549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa830102790 0x7fa8301067e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa824009900 tx=0x7fa82402a410 comp rx=0 tx=0).stop 2024-09-12T01:31:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.986+0000 7fa8368ea640 1 -- 172.21.15.81:0/87243549 shutdown_connections 2024-09-12T01:31:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.986+0000 7fa8368ea640 1 --2- 172.21.15.81:0/87243549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa830106f10 0x7fa83010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.986+0000 7fa8368ea640 1 --2- 172.21.15.81:0/87243549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa830102790 0x7fa8301067e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.986+0000 7fa8368ea640 1 --2- 172.21.15.81:0/87243549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa830101de0 0x7fa8301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.986+0000 7fa8368ea640 1 -- 172.21.15.81:0/87243549 >> 172.21.15.81:0/87243549 conn(0x7fa8300fd8c0 msgr2=0x7fa8300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.986+0000 7fa8368ea640 1 -- 172.21.15.81:0/87243549 shutdown_connections 2024-09-12T01:31:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.986+0000 7fa8368ea640 1 -- 172.21.15.81:0/87243549 wait complete. 2024-09-12T01:31:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.987+0000 7fa8368ea640 1 Processor -- start 2024-09-12T01:31:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.987+0000 7fa8368ea640 1 -- start start 2024-09-12T01:31:56.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.987+0000 7fa8368ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa830101de0 0x7fa830198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.987+0000 7fa8368ea640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa830102790 0x7fa8301989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.987+0000 7fa8368ea640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa830106f10 0x7fa83019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.987+0000 7fa8368ea640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa830111f90 con 0x7fa830101de0 2024-09-12T01:31:56.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.987+0000 7fa8368ea640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa830111e10 con 0x7fa830106f10 2024-09-12T01:31:56.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.987+0000 7fa8368ea640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa830112110 con 0x7fa830102790 2024-09-12T01:31:56.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.987+0000 7fa82ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa830101de0 0x7fa830198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.987+0000 7fa82ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa830101de0 0x7fa830198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36114/0 (socket says 172.21.15.81:36114) 2024-09-12T01:31:56.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.987+0000 7fa82ffff640 1 -- 172.21.15.81:0/547803422 learned_addr learned my addr 172.21.15.81:0/547803422 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:56.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.987+0000 7fa834e87640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa830106f10 0x7fa83019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.987+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa830102790 0x7fa8301989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.988+0000 7fa82ffff640 1 -- 172.21.15.81:0/547803422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa830102790 msgr2=0x7fa8301989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.988+0000 7fa82ffff640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa830102790 0x7fa8301989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.988+0000 7fa82ffff640 1 -- 172.21.15.81:0/547803422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa830106f10 msgr2=0x7fa83019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.988+0000 7fa82ffff640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa830106f10 0x7fa83019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.988+0000 7fa82ffff640 1 -- 172.21.15.81:0/547803422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83019d420 con 0x7fa830101de0 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.988+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa830102790 0x7fa8301989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.988+0000 7fa834e87640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa830106f10 0x7fa83019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.988+0000 7fa82ffff640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa830101de0 0x7fa830198470 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa82000d950 tx=0x7fa82000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.988+0000 7fa82d7fa640 1 -- 172.21.15.81:0/547803422 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820017030 con 0x7fa830101de0 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.988+0000 7fa82d7fa640 1 -- 172.21.15.81:0/547803422 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa820004020 con 0x7fa830101de0 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.988+0000 7fa8368ea640 1 -- 172.21.15.81:0/547803422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83019d710 con 0x7fa830101de0 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.988+0000 7fa82d7fa640 1 -- 172.21.15.81:0/547803422 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8200047a0 con 0x7fa830101de0 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.988+0000 7fa8368ea640 1 -- 172.21.15.81:0/547803422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8301a4ff0 con 0x7fa830101de0 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.990+0000 7fa82d7fa640 1 -- 172.21.15.81:0/547803422 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa8200041d0 con 0x7fa830101de0 2024-09-12T01:31:56.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa838cc3740 1 Processor -- start 2024-09-12T01:31:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa838cc3740 1 -- start start 2024-09-12T01:31:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa838cc3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e2b40 0x55d6184e1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa838cc3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184e15d0 0x55d6184e1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa838cc3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 0x55d6184ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa838cc3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d6184472f0 con 0x55d6184ec370 2024-09-12T01:31:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa838cc3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d6183eecf0 con 0x55d6184e2b40 2024-09-12T01:31:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa838cc3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d6184432b0 con 0x55d6184e15d0 2024-09-12T01:31:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa82f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 0x55d6184ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa82f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 0x55d6184ee760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36126/0 (socket says 172.21.15.81:36126) 2024-09-12T01:31:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa82f7fe640 1 -- 172.21.15.81:0/1235769303 learned_addr learned my addr 172.21.15.81:0/1235769303 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa834e87640 1 --2- 172.21.15.81:0/1235769303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e2b40 0x55d6184e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa82ffff640 1 --2- 172.21.15.81:0/1235769303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184e15d0 0x55d6184e1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa82d7fa640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8180a2d70 0x7fa8180a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa82f7fe640 1 -- 172.21.15.81:0/1235769303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184e15d0 msgr2=0x55d6184e1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/1235769303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184e15d0 0x55d6184e1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa82f7fe640 1 -- 172.21.15.81:0/1235769303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e2b40 msgr2=0x55d6184e1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/1235769303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e2b40 0x55d6184e1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa82f7fe640 1 -- 172.21.15.81:0/1235769303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6183d33a0 con 0x55d6184ec370 2024-09-12T01:31:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa834e87640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8180a2d70 0x7fa8180a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.991+0000 7fa82d7fa640 1 -- 172.21.15.81:0/547803422 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fa8200cee40 con 0x7fa830101de0 2024-09-12T01:31:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.992+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/1235769303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 0x55d6184ee760 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa824005c40 tx=0x7fa824032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53f5b9310301cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.992+0000 7fa8167fc640 1 -- 172.21.15.81:0/1235769303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82403f070 con 0x55d6184ec370 2024-09-12T01:31:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.992+0000 7fa8167fc640 1 -- 172.21.15.81:0/1235769303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8240317b0 con 0x55d6184ec370 2024-09-12T01:31:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.992+0000 7fa8167fc640 1 -- 172.21.15.81:0/1235769303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824035070 con 0x55d6184ec370 2024-09-12T01:31:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.992+0000 7fa838cc3740 1 -- 172.21.15.81:0/1235769303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 msgr2=0x55d6184ee760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.992+0000 7fa834e87640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8180a2d70 0x7fa8180a5230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa82800a4c0 tx=0x7fa82800c040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.992+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1235769303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 0x55d6184ee760 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa824005c40 tx=0x7fa824032cb0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.992+0000 7fa838cc3740 1 -- 172.21.15.81:0/1235769303 shutdown_connections 2024-09-12T01:31:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.992+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1235769303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 0x55d6184ee760 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1235769303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184e15d0 0x55d6184e1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1235769303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e2b40 0x55d6184e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 1 -- 172.21.15.81:0/1235769303 >> 172.21.15.81:0/1235769303 conn(0x55d6184aa310 msgr2=0x55d6184ddc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 1 -- 172.21.15.81:0/1235769303 shutdown_connections 2024-09-12T01:31:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 1 -- 172.21.15.81:0/1235769303 wait complete. 2024-09-12T01:31:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 1 -- start start 2024-09-12T01:31:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 1 Processor -- start 2024-09-12T01:31:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6184ebcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 0x55d6184e8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184ec370 0x55d6184e94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d6184ef010 con 0x55d6184e2b40 2024-09-12T01:31:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d618402060 con 0x55d6184e15d0 2024-09-12T01:31:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d6184ef190 con 0x55d6184ec370 2024-09-12T01:31:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa838cc3740 10 client.0 _ll_register_callbacks cb 0x55d6181558c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa82f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 0x55d6184e8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa82f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 0x55d6184e8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36136/0 (socket says 172.21.15.81:36136) 2024-09-12T01:31:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.993+0000 7fa82f7fe640 1 -- 172.21.15.81:0/1805681563 learned_addr learned my addr 172.21.15.81:0/1805681563 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa834e87640 1 --2- 172.21.15.81:0/1805681563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184ec370 0x55d6184e94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa82ffff640 1 --2- 172.21.15.81:0/1805681563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6184ebcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa82f7fe640 1 -- 172.21.15.81:0/1805681563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184ec370 msgr2=0x55d6184e94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/1805681563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184ec370 0x55d6184e94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa82f7fe640 1 -- 172.21.15.81:0/1805681563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 msgr2=0x55d6184ebcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/1805681563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6184ebcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa82f7fe640 1 -- 172.21.15.81:0/1805681563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6181b83c0 con 0x55d6184e2b40 2024-09-12T01:31:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/1805681563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 0x55d6184e8f80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa824031550 tx=0x7fa8240316a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c04638e5868d0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa80f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa80f7fe640 1 -- 172.21.15.81:0/1805681563 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82403f070 con 0x55d6184e2b40 2024-09-12T01:31:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa80f7fe640 1 -- 172.21.15.81:0/1805681563 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fa824004450 con 0x55d6184e2b40 2024-09-12T01:31:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa838cc3740 1 -- 172.21.15.81:0/1805681563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8240317b0 con 0x55d6184e2b40 2024-09-12T01:31:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa80f7fe640 1 -- 172.21.15.81:0/1805681563 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa824035040 con 0x55d6184e2b40 2024-09-12T01:31:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa838cc3740 10 client.16305 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa838cc3740 1 -- 172.21.15.81:0/1805681563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d6184faa20 con 0x55d6184e2b40 2024-09-12T01:31:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.994+0000 7fa80f7fe640 1 -- 172.21.15.81:0/1805681563 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8240317b0 con 0x55d6184e2b40 2024-09-12T01:31:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.995+0000 7fa80f7fe640 1 -- 172.21.15.81:0/1805681563 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa8240049f0 con 0x55d6184e2b40 2024-09-12T01:31:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.995+0000 7fa838cc3740 10 client.16305 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.995+0000 7fa838cc3740 10 client.16305 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:31:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.995+0000 7fa838cc3740 20 client.16305 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.995+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1805681563 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55d6184fbd70 0x55d6184fe160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.995+0000 7fa838cc3740 4 client.16305 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:31:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.995+0000 7fa838cc3740 1 -- 172.21.15.81:0/1805681563 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d618454860 con 0x55d6184fbd70 2024-09-12T01:31:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.995+0000 7fa82ffff640 1 --2- 172.21.15.81:0/1805681563 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55d6184fbd70 0x55d6184fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.995+0000 7fa80f7fe640 10 client.16305 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:31:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.995+0000 7fa82ffff640 1 --2- 172.21.15.81:0/1805681563 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55d6184fbd70 0x55d6184fe160 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=240276962b65b198 server_cookie=fb006b39c52296 in_seq=0 out_seq=0 2024-09-12T01:31:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa80f7fe640 1 -- 172.21.15.81:0/1805681563 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d618454860 con 0x55d6184fbd70 2024-09-12T01:31:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa80f7fe640 10 client.16305 handle_command_reply: tid=0 2024-09-12T01:31:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa838cc3740 1 client.16305 shutdown 2024-09-12T01:31:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa838cc3740 1 -- 172.21.15.81:0/1805681563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 msgr2=0x55d6184e8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1805681563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 0x55d6184e8f80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa824031550 tx=0x7fa8240316a0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa838cc3740 1 -- 172.21.15.81:0/1805681563 shutdown_connections 2024-09-12T01:31:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1805681563 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55d6184fbd70 0x55d6184fe160 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1805681563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184ec370 0x55d6184e94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1805681563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 0x55d6184e8f80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa80f7fe640 0 client.16305 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:31:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1805681563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6184ebcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa838cc3740 1 -- 172.21.15.81:0/1805681563 >> 172.21.15.81:0/1805681563 conn(0x55d6184aa310 msgr2=0x55d6184e3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa838cc3740 1 -- 172.21.15.81:0/1805681563 shutdown_connections 2024-09-12T01:31:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.996+0000 7fa838cc3740 1 -- 172.21.15.81:0/1805681563 wait complete. 2024-09-12T01:31:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:55.997+0000 7fa838cc3740 20 client.16305 trim_cache size 0 max 16384 2024-09-12T01:31:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.009+0000 7fa838cc3740 1 Processor -- start 2024-09-12T01:31:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.009+0000 7fa838cc3740 1 -- start start 2024-09-12T01:31:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.009+0000 7fa838cc3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6184f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.009+0000 7fa838cc3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184e2b40 0x55d6184e8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.009+0000 7fa838cc3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 0x55d6184ed760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.009+0000 7fa838cc3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8301ad7e0 con 0x55d6184ec370 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.009+0000 7fa838cc3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8301af320 con 0x55d6184e15d0 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.009+0000 7fa838cc3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8301adeb0 con 0x55d6184e2b40 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.009+0000 7fa834e87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 0x55d6184ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa834e87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 0x55d6184ed760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36150/0 (socket says 172.21.15.81:36150) 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa834e87640 1 -- 172.21.15.81:0/1369934408 learned_addr learned my addr 172.21.15.81:0/1369934408 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/1369934408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184e2b40 0x55d6184e8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa82ffff640 1 --2- 172.21.15.81:0/1369934408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6184f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa834e87640 1 -- 172.21.15.81:0/1369934408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184e2b40 msgr2=0x55d6184e8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa834e87640 1 --2- 172.21.15.81:0/1369934408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184e2b40 0x55d6184e8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa834e87640 1 -- 172.21.15.81:0/1369934408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 msgr2=0x55d6184f82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa834e87640 1 --2- 172.21.15.81:0/1369934408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6184f82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa834e87640 1 -- 172.21.15.81:0/1369934408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6184de960 con 0x55d6184ec370 2024-09-12T01:31:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa82ffff640 1 --2- 172.21.15.81:0/1369934408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6184f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa834e87640 1 --2- 172.21.15.81:0/1369934408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 0x55d6184ed760 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa8280177a0 tx=0x7fa828013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b4da97fa2353f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa815ffb640 1 -- 172.21.15.81:0/1369934408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8280078f0 con 0x55d6184ec370 2024-09-12T01:31:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa815ffb640 1 -- 172.21.15.81:0/1369934408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa828028070 con 0x55d6184ec370 2024-09-12T01:31:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.010+0000 7fa815ffb640 1 -- 172.21.15.81:0/1369934408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828022350 con 0x55d6184ec370 2024-09-12T01:31:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 -- 172.21.15.81:0/1369934408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 msgr2=0x55d6184ed760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1369934408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 0x55d6184ed760 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa8280177a0 tx=0x7fa828013000 comp rx=0 tx=0).stop 2024-09-12T01:31:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 -- 172.21.15.81:0/1369934408 shutdown_connections 2024-09-12T01:31:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1369934408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184ec370 0x55d6184ed760 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1369934408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184e2b40 0x55d6184e8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1369934408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6184f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 -- 172.21.15.81:0/1369934408 >> 172.21.15.81:0/1369934408 conn(0x55d6184aa310 msgr2=0x55d6184eb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 -- 172.21.15.81:0/1369934408 shutdown_connections 2024-09-12T01:31:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 -- 172.21.15.81:0/1369934408 wait complete. 2024-09-12T01:31:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 -- start start 2024-09-12T01:31:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 Processor -- start 2024-09-12T01:31:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6185033f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 0x55d618503930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184ec370 0x55d618503e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8301aec50 con 0x55d6184e2b40 2024-09-12T01:31:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.011+0000 7fa838cc3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8301ae580 con 0x55d6184e15d0 2024-09-12T01:31:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa838cc3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8301ab7c0 con 0x55d6184ec370 2024-09-12T01:31:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa838cc3740 10 client.0 _ll_register_callbacks cb 0x7fa824009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa82f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 0x55d618503930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa82f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 0x55d618503930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36152/0 (socket says 172.21.15.81:36152) 2024-09-12T01:31:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa82f7fe640 1 -- 172.21.15.81:0/1976760886 learned_addr learned my addr 172.21.15.81:0/1976760886 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa82ffff640 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6185033f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa834e87640 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184ec370 0x55d618503e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa82f7fe640 1 -- 172.21.15.81:0/1976760886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184ec370 msgr2=0x55d618503e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184ec370 0x55d618503e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa82f7fe640 1 -- 172.21.15.81:0/1976760886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 msgr2=0x55d6185033f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6185033f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa82f7fe640 1 -- 172.21.15.81:0/1976760886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6184fe5c0 con 0x55d6184e2b40 2024-09-12T01:31:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa82ffff640 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6185033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 0x55d618503930 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa824004dc0 tx=0x7fa8240056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e4ae966571e179 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa80f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa80f7fe640 1 -- 172.21.15.81:0/1976760886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82403f040 con 0x55d6184e2b40 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa80f7fe640 1 -- 172.21.15.81:0/1976760886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fa824031710 con 0x55d6184e2b40 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa838cc3740 1 -- 172.21.15.81:0/1976760886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa828028070 con 0x55d6184e2b40 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa80f7fe640 1 -- 172.21.15.81:0/1976760886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa824066050 con 0x55d6184e2b40 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa838cc3740 10 client.16311 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa838cc3740 1 -- 172.21.15.81:0/1976760886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d618566880 con 0x55d6184e2b40 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.012+0000 7fa80f7fe640 1 -- 172.21.15.81:0/1976760886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa828028070 con 0x55d6184e2b40 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.013+0000 7fa80f7fe640 1 -- 172.21.15.81:0/1976760886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa8240042e0 con 0x55d6184e2b40 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.013+0000 7fa838cc3740 10 client.16311 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.013+0000 7fa838cc3740 10 client.16311 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.013+0000 7fa838cc3740 20 client.16311 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.013+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55d618566f40 0x55d618569360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.013+0000 7fa838cc3740 4 client.16311 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.013+0000 7fa838cc3740 1 -- 172.21.15.81:0/1976760886 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d61844ed70 con 0x55d618566f40 2024-09-12T01:31:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.013+0000 7fa82ffff640 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55d618566f40 0x55d618569360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.013+0000 7fa80f7fe640 10 client.16311 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:31:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.013+0000 7fa82ffff640 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55d618566f40 0x55d618569360 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2eea7f150ed12e7e server_cookie=96a1bd98cec87f48 in_seq=0 out_seq=0 2024-09-12T01:31:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa80f7fe640 1 -- 172.21.15.81:0/1976760886 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d61844ed70 con 0x55d618566f40 2024-09-12T01:31:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa80f7fe640 10 client.16311 handle_command_reply: tid=0 2024-09-12T01:31:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa838cc3740 1 client.16311 shutdown 2024-09-12T01:31:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa838cc3740 1 -- 172.21.15.81:0/1976760886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 msgr2=0x55d618503930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 0x55d618503930 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa824004dc0 tx=0x7fa8240056b0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa838cc3740 1 -- 172.21.15.81:0/1976760886 shutdown_connections 2024-09-12T01:31:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55d618566f40 0x55d618569360 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d6184ec370 0x55d618503e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d6184e2b40 0x55d618503930 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa838cc3740 1 --2- 172.21.15.81:0/1976760886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6184e15d0 0x55d6185033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa838cc3740 1 -- 172.21.15.81:0/1976760886 >> 172.21.15.81:0/1976760886 conn(0x55d6184aa310 msgr2=0x55d6184e7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa80f7fe640 0 client.16311 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:31:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa838cc3740 1 -- 172.21.15.81:0/1976760886 shutdown_connections 2024-09-12T01:31:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa838cc3740 1 -- 172.21.15.81:0/1976760886 wait complete. 2024-09-12T01:31:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.014+0000 7fa838cc3740 20 client.16311 trim_cache size 0 max 16384 2024-09-12T01:31:56.033 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:31:56.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.015+0000 7fa8368ea640 1 -- 172.21.15.81:0/547803422 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8180a2d70 msgr2=0x7fa8180a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:56.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.015+0000 7fa8368ea640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8180a2d70 0x7fa8180a5230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa82800a4c0 tx=0x7fa82800c040 comp rx=0 tx=0).stop 2024-09-12T01:31:56.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.015+0000 7fa8368ea640 1 -- 172.21.15.81:0/547803422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa830101de0 msgr2=0x7fa830198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:56.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.015+0000 7fa8368ea640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa830101de0 0x7fa830198470 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa82000d950 tx=0x7fa82000de10 comp rx=0 tx=0).stop 2024-09-12T01:31:56.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.015+0000 7fa8368ea640 1 -- 172.21.15.81:0/547803422 shutdown_connections 2024-09-12T01:31:56.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.015+0000 7fa8368ea640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8180a2d70 0x7fa8180a5230 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.015+0000 7fa8368ea640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa830106f10 0x7fa83019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.015+0000 7fa8368ea640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa830102790 0x7fa8301989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.015+0000 7fa8368ea640 1 --2- 172.21.15.81:0/547803422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa830101de0 0x7fa830198470 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:56.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.015+0000 7fa8368ea640 1 -- 172.21.15.81:0/547803422 >> 172.21.15.81:0/547803422 conn(0x7fa8300fd8c0 msgr2=0x7fa8300fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:56.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.015+0000 7fa8368ea640 1 -- 172.21.15.81:0/547803422 shutdown_connections 2024-09-12T01:31:56.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:56.015+0000 7fa8368ea640 1 -- 172.21.15.81:0/547803422 wait complete. 2024-09-12T01:31:56.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:31:57.090 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:57.195 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:56 smithi081 ceph-mon[30920]: pgmap v119: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-09-12T01:31:57.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:56 smithi100 ceph-mon[35275]: pgmap v119: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-09-12T01:31:57.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:56 smithi189 ceph-mon[35357]: pgmap v119: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-09-12T01:31:57.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.539+0000 7f79ce183640 1 -- 172.21.15.81:0/1943020968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79c8106f10 msgr2=0x7f79c810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:57.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.539+0000 7f79ce183640 1 --2- 172.21.15.81:0/1943020968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79c8106f10 0x7f79c810ea90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009ca0 tx=0x7f79c002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.539+0000 7f79ce183640 1 -- 172.21.15.81:0/1943020968 shutdown_connections 2024-09-12T01:31:57.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.539+0000 7f79ce183640 1 --2- 172.21.15.81:0/1943020968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79c8106f10 0x7f79c810ea90 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.539+0000 7f79ce183640 1 --2- 172.21.15.81:0/1943020968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79c8102790 0x7f79c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.539+0000 7f79ce183640 1 --2- 172.21.15.81:0/1943020968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c8101de0 0x7f79c81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.539+0000 7f79ce183640 1 -- 172.21.15.81:0/1943020968 >> 172.21.15.81:0/1943020968 conn(0x7f79c80fd8c0 msgr2=0x7f79c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:57.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.539+0000 7f79ce183640 1 -- 172.21.15.81:0/1943020968 shutdown_connections 2024-09-12T01:31:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.539+0000 7f79ce183640 1 -- 172.21.15.81:0/1943020968 wait complete. 2024-09-12T01:31:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79ce183640 1 Processor -- start 2024-09-12T01:31:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79ce183640 1 -- start start 2024-09-12T01:31:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79ce183640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c8101de0 0x7f79c81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79ce183640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79c8102790 0x7f79c8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79ce183640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79c8106f10 0x7f79c819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79ce183640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f79c8111f70 con 0x7f79c8102790 2024-09-12T01:31:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79ce183640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f79c8111df0 con 0x7f79c8101de0 2024-09-12T01:31:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79ce183640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f79c81120f0 con 0x7f79c8106f10 2024-09-12T01:31:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79c8102790 0x7f79c8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79c8102790 0x7f79c8198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36172/0 (socket says 172.21.15.81:36172) 2024-09-12T01:31:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79bffff640 1 -- 172.21.15.81:0/3210142843 learned_addr learned my addr 172.21.15.81:0/3210142843 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:57.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79c77fe640 1 --2- 172.21.15.81:0/3210142843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c8101de0 0x7f79c81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79bffff640 1 -- 172.21.15.81:0/3210142843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79c8106f10 msgr2=0x7f79c819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79bffff640 1 --2- 172.21.15.81:0/3210142843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79c8106f10 0x7f79c819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79bffff640 1 -- 172.21.15.81:0/3210142843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c8101de0 msgr2=0x7f79c81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79bffff640 1 --2- 172.21.15.81:0/3210142843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c8101de0 0x7f79c81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79bffff640 1 -- 172.21.15.81:0/3210142843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c819d3a0 con 0x7f79c8102790 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79bffff640 1 --2- 172.21.15.81:0/3210142843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79c8102790 0x7f79c8198930 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f79b000d770 tx=0x7f79b000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.540+0000 7f79c57fa640 1 -- 172.21.15.81:0/3210142843 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0017070 con 0x7f79c8102790 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.541+0000 7f79c57fa640 1 -- 172.21.15.81:0/3210142843 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b0005500 con 0x7f79c8102790 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.541+0000 7f79ce183640 1 -- 172.21.15.81:0/3210142843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c819d690 con 0x7f79c8102790 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.541+0000 7f79c57fa640 1 -- 172.21.15.81:0/3210142843 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0004e00 con 0x7f79c8102790 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.541+0000 7f79ce183640 1 -- 172.21.15.81:0/3210142843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c81a4f70 con 0x7f79c8102790 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.543+0000 7f79c57fa640 1 -- 172.21.15.81:0/3210142843 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f79b0004fa0 con 0x7f79c8102790 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.543+0000 7f79d055c740 1 Processor -- start 2024-09-12T01:31:57.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.543+0000 7f79d055c740 1 -- start start 2024-09-12T01:31:57.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.543+0000 7f79d055c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc54db40 0x558adc54c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.543+0000 7f79d055c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54c5d0 0x558adc54ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.543+0000 7f79d055c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc557370 0x558adc559760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.543+0000 7f79d055c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558adc4b22f0 con 0x558adc557370 2024-09-12T01:31:57.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.543+0000 7f79d055c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558adc459cf0 con 0x558adc54c5d0 2024-09-12T01:31:57.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.543+0000 7f79d055c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558adc4ae2b0 con 0x558adc54db40 2024-09-12T01:31:57.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.543+0000 7f79bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc557370 0x558adc559760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.543+0000 7f79c77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54c5d0 0x558adc54ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc557370 0x558adc559760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36184/0 (socket says 172.21.15.81:36184) 2024-09-12T01:31:57.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79c77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54c5d0 0x558adc54ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:43026/0 (socket says 172.21.15.81:43026) 2024-09-12T01:31:57.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79c7fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc54db40 0x558adc54c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79bffff640 1 -- 172.21.15.81:0/3297724695 learned_addr learned my addr 172.21.15.81:0/3297724695 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:57.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79c57fa640 1 --2- 172.21.15.81:0/3210142843 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f79b40a2cf0 0x7f79b40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79bffff640 1 -- 172.21.15.81:0/3297724695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc54db40 msgr2=0x558adc54c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:57.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79bffff640 1 --2- 172.21.15.81:0/3297724695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc54db40 0x558adc54c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79bffff640 1 -- 172.21.15.81:0/3297724695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54c5d0 msgr2=0x558adc54ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:57.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79bffff640 1 --2- 172.21.15.81:0/3297724695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54c5d0 0x558adc54ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79bffff640 1 -- 172.21.15.81:0/3297724695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558adc43e3a0 con 0x558adc557370 2024-09-12T01:31:57.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79c7fff640 1 --2- 172.21.15.81:0/3210142843 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f79b40a2cf0 0x7f79b40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79c77fe640 1 --2- 172.21.15.81:0/3297724695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54c5d0 0x558adc54ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:31:57.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79c57fa640 1 -- 172.21.15.81:0/3210142843 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f79b00cef50 con 0x7f79c8102790 2024-09-12T01:31:57.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79bffff640 1 --2- 172.21.15.81:0/3297724695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc557370 0x558adc559760 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f79b00cc5b0 tx=0x7f79b0022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94da30952df0eff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:57.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79bdffb640 1 -- 172.21.15.81:0/3297724695 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b009b210 con 0x558adc557370 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79c7fff640 1 --2- 172.21.15.81:0/3210142843 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f79b40a2cf0 0x7f79b40a51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f79c0005e30 tx=0x7f79c00093d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79bdffb640 1 -- 172.21.15.81:0/3297724695 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b0053540 con 0x558adc557370 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.544+0000 7f79bdffb640 1 -- 172.21.15.81:0/3297724695 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0053340 con 0x558adc557370 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.545+0000 7f79d055c740 1 -- 172.21.15.81:0/3297724695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc557370 msgr2=0x558adc559760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.545+0000 7f79d055c740 1 --2- 172.21.15.81:0/3297724695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc557370 0x558adc559760 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f79b00cc5b0 tx=0x7f79b0022000 comp rx=0 tx=0).stop 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.545+0000 7f79d055c740 1 -- 172.21.15.81:0/3297724695 shutdown_connections 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.545+0000 7f79d055c740 1 --2- 172.21.15.81:0/3297724695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc557370 0x558adc559760 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.545+0000 7f79d055c740 1 --2- 172.21.15.81:0/3297724695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54c5d0 0x558adc54ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.545+0000 7f79d055c740 1 --2- 172.21.15.81:0/3297724695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc54db40 0x558adc54c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.545+0000 7f79d055c740 1 -- 172.21.15.81:0/3297724695 >> 172.21.15.81:0/3297724695 conn(0x558adc515310 msgr2=0x558adc548c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.545+0000 7f79d055c740 1 -- 172.21.15.81:0/3297724695 shutdown_connections 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.545+0000 7f79d055c740 1 -- 172.21.15.81:0/3297724695 wait complete. 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.545+0000 7f79d055c740 1 -- start start 2024-09-12T01:31:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79d055c740 1 Processor -- start 2024-09-12T01:31:57.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79d055c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54c5d0 0x558adc556d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79d055c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54db40 0x558adc553fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79d055c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc557370 0x558adc554570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79d055c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558adc559fb0 con 0x558adc54c5d0 2024-09-12T01:31:57.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79d055c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558adc46d060 con 0x558adc54db40 2024-09-12T01:31:57.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79d055c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558adc55a130 con 0x558adc557370 2024-09-12T01:31:57.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79d055c740 10 client.0 _ll_register_callbacks cb 0x558adc1c08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:57.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79c77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54c5d0 0x558adc556d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79c77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54c5d0 0x558adc556d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36186/0 (socket says 172.21.15.81:36186) 2024-09-12T01:31:57.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79c77fe640 1 -- 172.21.15.81:0/734252249 learned_addr learned my addr 172.21.15.81:0/734252249 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:57.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79bffff640 1 --2- 172.21.15.81:0/734252249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54db40 0x558adc553fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79c77fe640 1 -- 172.21.15.81:0/734252249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc557370 msgr2=0x558adc554570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:57.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79c77fe640 1 --2- 172.21.15.81:0/734252249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc557370 0x558adc554570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79c77fe640 1 -- 172.21.15.81:0/734252249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54db40 msgr2=0x558adc553fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:57.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79c77fe640 1 --2- 172.21.15.81:0/734252249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54db40 0x558adc553fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.546+0000 7f79c77fe640 1 -- 172.21.15.81:0/734252249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558adc2233c0 con 0x558adc54c5d0 2024-09-12T01:31:57.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79c77fe640 1 --2- 172.21.15.81:0/734252249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54c5d0 0x558adc556d20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f79b8011780 tx=0x7f79b8011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf1f43f99f0cb93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:57.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:57.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79a6ffd640 1 -- 172.21.15.81:0/734252249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b800fdb0 con 0x558adc54c5d0 2024-09-12T01:31:57.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79a6ffd640 1 -- 172.21.15.81:0/734252249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f79b8004020 con 0x558adc54c5d0 2024-09-12T01:31:57.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79d055c740 1 -- 172.21.15.81:0/734252249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558adc4bf860 con 0x558adc54c5d0 2024-09-12T01:31:57.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79a6ffd640 1 -- 172.21.15.81:0/734252249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f79b8004220 con 0x558adc54c5d0 2024-09-12T01:31:57.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79d055c740 10 client.16323 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:57.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79d055c740 1 -- 172.21.15.81:0/734252249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558adc565a60 con 0x558adc54c5d0 2024-09-12T01:31:57.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79a6ffd640 1 -- 172.21.15.81:0/734252249 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558adc4bf860 con 0x558adc54c5d0 2024-09-12T01:31:57.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79a6ffd640 1 -- 172.21.15.81:0/734252249 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f79b8018030 con 0x558adc54c5d0 2024-09-12T01:31:57.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79d055c740 10 client.16323 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:57.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79d055c740 10 client.16323 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:31:57.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79d055c740 20 client.16323 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:57.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79d055c740 1 --2- 172.21.15.81:0/734252249 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x558adc566f20 0x558adc5693e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79d055c740 4 client.16323 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:31:57.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.547+0000 7f79d055c740 1 -- 172.21.15.81:0/734252249 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558adc4b9d70 con 0x558adc566f20 2024-09-12T01:31:57.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.548+0000 7f79bffff640 1 --2- 172.21.15.81:0/734252249 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x558adc566f20 0x558adc5693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.548+0000 7f79a6ffd640 10 client.16323 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:31:57.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.548+0000 7f79bffff640 1 --2- 172.21.15.81:0/734252249 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x558adc566f20 0x558adc5693e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=53723b1513422f43 server_cookie=cf95095344ddd20e in_seq=0 out_seq=0 2024-09-12T01:31:57.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79a6ffd640 1 -- 172.21.15.81:0/734252249 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558adc4b9d70 con 0x558adc566f20 2024-09-12T01:31:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79a6ffd640 10 client.16323 handle_command_reply: tid=0 2024-09-12T01:31:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79d055c740 1 client.16323 shutdown 2024-09-12T01:31:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79d055c740 1 -- 172.21.15.81:0/734252249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54c5d0 msgr2=0x558adc556d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79d055c740 1 --2- 172.21.15.81:0/734252249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54c5d0 0x558adc556d20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f79b8011780 tx=0x7f79b8011c40 comp rx=0 tx=0).stop 2024-09-12T01:31:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79d055c740 1 -- 172.21.15.81:0/734252249 shutdown_connections 2024-09-12T01:31:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79d055c740 1 --2- 172.21.15.81:0/734252249 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x558adc566f20 0x558adc5693e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79d055c740 1 --2- 172.21.15.81:0/734252249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc557370 0x558adc554570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79d055c740 1 --2- 172.21.15.81:0/734252249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54db40 0x558adc553fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79a6ffd640 0 client.16323 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:31:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79d055c740 1 --2- 172.21.15.81:0/734252249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54c5d0 0x558adc556d20 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79d055c740 1 -- 172.21.15.81:0/734252249 >> 172.21.15.81:0/734252249 conn(0x558adc515310 msgr2=0x558adc54e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79d055c740 1 -- 172.21.15.81:0/734252249 shutdown_connections 2024-09-12T01:31:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79d055c740 1 -- 172.21.15.81:0/734252249 wait complete. 2024-09-12T01:31:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.549+0000 7f79d055c740 20 client.16323 trim_cache size 0 max 16384 2024-09-12T01:31:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.562+0000 7f79d055c740 1 Processor -- start 2024-09-12T01:31:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.562+0000 7f79d055c740 1 -- start start 2024-09-12T01:31:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.562+0000 7f79d055c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc54c5d0 0x558adc563250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.562+0000 7f79d055c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 0x558adc547bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.562+0000 7f79d055c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc557370 0x558adc56ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.562+0000 7f79d055c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f79c81ad8b0 con 0x558adc54db40 2024-09-12T01:31:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.562+0000 7f79d055c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f79c81af3f0 con 0x558adc557370 2024-09-12T01:31:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.562+0000 7f79d055c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f79c81adf80 con 0x558adc54c5d0 2024-09-12T01:31:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.562+0000 7f79bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 0x558adc547bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.562+0000 7f79bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 0x558adc547bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36200/0 (socket says 172.21.15.81:36200) 2024-09-12T01:31:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.562+0000 7f79bffff640 1 -- 172.21.15.81:0/3579559159 learned_addr learned my addr 172.21.15.81:0/3579559159 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.562+0000 7f79c77fe640 1 --2- 172.21.15.81:0/3579559159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc54c5d0 0x558adc563250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79bffff640 1 -- 172.21.15.81:0/3579559159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc54c5d0 msgr2=0x558adc563250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79bffff640 1 --2- 172.21.15.81:0/3579559159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc54c5d0 0x558adc563250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79bffff640 1 -- 172.21.15.81:0/3579559159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc557370 msgr2=0x558adc56ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79c7fff640 1 --2- 172.21.15.81:0/3579559159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc557370 0x558adc56ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79bffff640 1 --2- 172.21.15.81:0/3579559159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc557370 0x558adc56ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79bffff640 1 -- 172.21.15.81:0/3579559159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558adc54f120 con 0x558adc54db40 2024-09-12T01:31:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79c77fe640 1 --2- 172.21.15.81:0/3579559159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc54c5d0 0x558adc563250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79bffff640 1 --2- 172.21.15.81:0/3579559159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 0x558adc547bf0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009610 tx=0x7f79b00d2a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05f34dbb3945c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79bd7fa640 1 -- 172.21.15.81:0/3579559159 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b009ada0 con 0x558adc54db40 2024-09-12T01:31:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79bd7fa640 1 -- 172.21.15.81:0/3579559159 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b009bb40 con 0x558adc54db40 2024-09-12T01:31:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79bd7fa640 1 -- 172.21.15.81:0/3579559159 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b009af80 con 0x558adc54db40 2024-09-12T01:31:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79d055c740 1 -- 172.21.15.81:0/3579559159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 msgr2=0x558adc547bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79d055c740 1 --2- 172.21.15.81:0/3579559159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 0x558adc547bf0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009610 tx=0x7f79b00d2a00 comp rx=0 tx=0).stop 2024-09-12T01:31:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79d055c740 1 -- 172.21.15.81:0/3579559159 shutdown_connections 2024-09-12T01:31:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79d055c740 1 --2- 172.21.15.81:0/3579559159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc557370 0x558adc56ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79d055c740 1 --2- 172.21.15.81:0/3579559159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 0x558adc547bf0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79d055c740 1 --2- 172.21.15.81:0/3579559159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc54c5d0 0x558adc563250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.563+0000 7f79d055c740 1 -- 172.21.15.81:0/3579559159 >> 172.21.15.81:0/3579559159 conn(0x558adc515310 msgr2=0x558adc5474e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79d055c740 1 -- 172.21.15.81:0/3579559159 shutdown_connections 2024-09-12T01:31:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79d055c740 1 -- 172.21.15.81:0/3579559159 wait complete. 2024-09-12T01:31:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79d055c740 1 -- start start 2024-09-12T01:31:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79d055c740 1 Processor -- start 2024-09-12T01:31:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79d055c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54c5d0 0x558adc55f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79d055c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 0x558adc55c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79d055c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc557370 0x558adc55c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79d055c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f79c81aed20 con 0x558adc54db40 2024-09-12T01:31:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79d055c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f79c81ae650 con 0x558adc54c5d0 2024-09-12T01:31:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79d055c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f79c81ab890 con 0x558adc557370 2024-09-12T01:31:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79d055c740 10 client.0 _ll_register_callbacks cb 0x7f79b800c750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 0x558adc55c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 0x558adc55c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36204/0 (socket says 172.21.15.81:36204) 2024-09-12T01:31:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.564+0000 7f79bffff640 1 -- 172.21.15.81:0/1208371920 learned_addr learned my addr 172.21.15.81:0/1208371920 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79c7fff640 1 --2- 172.21.15.81:0/1208371920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc557370 0x558adc55c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79c77fe640 1 --2- 172.21.15.81:0/1208371920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54c5d0 0x558adc55f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79bffff640 1 -- 172.21.15.81:0/1208371920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc557370 msgr2=0x558adc55c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79bffff640 1 --2- 172.21.15.81:0/1208371920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc557370 0x558adc55c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79bffff640 1 -- 172.21.15.81:0/1208371920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54c5d0 msgr2=0x558adc55f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79bffff640 1 --2- 172.21.15.81:0/1208371920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54c5d0 0x558adc55f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79bffff640 1 -- 172.21.15.81:0/1208371920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558adc55cf70 con 0x558adc54db40 2024-09-12T01:31:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79bffff640 1 --2- 172.21.15.81:0/1208371920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 0x558adc55c390 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f79b0097e10 tx=0x7f79b000d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effb60da013d5550 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79a6ffd640 1 -- 172.21.15.81:0/1208371920 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b009af80 con 0x558adc54db40 2024-09-12T01:31:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79a6ffd640 1 -- 172.21.15.81:0/1208371920 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f79b0009cc0 con 0x558adc54db40 2024-09-12T01:31:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79d055c740 1 -- 172.21.15.81:0/1208371920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79b009bb40 con 0x558adc54db40 2024-09-12T01:31:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79a6ffd640 1 -- 172.21.15.81:0/1208371920 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f79b009ada0 con 0x558adc54db40 2024-09-12T01:31:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79d055c740 10 client.16329 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79d055c740 1 -- 172.21.15.81:0/1208371920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558adc5d2b00 con 0x558adc54db40 2024-09-12T01:31:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.565+0000 7f79a6ffd640 1 -- 172.21.15.81:0/1208371920 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b009b440 con 0x558adc54db40 2024-09-12T01:31:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.566+0000 7f79a6ffd640 1 -- 172.21.15.81:0/1208371920 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f79b00d0030 con 0x558adc54db40 2024-09-12T01:31:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.566+0000 7f79d055c740 10 client.16329 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.566+0000 7f79d055c740 10 client.16329 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:31:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.566+0000 7f79d055c740 20 client.16329 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.566+0000 7f79d055c740 1 --2- 172.21.15.81:0/1208371920 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x558adc5d2d30 0x558adc5d5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.566+0000 7f79d055c740 4 client.16329 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:31:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.566+0000 7f79d055c740 1 -- 172.21.15.81:0/1208371920 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f79b009bb40 con 0x558adc5d2d30 2024-09-12T01:31:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.566+0000 7f79c77fe640 1 --2- 172.21.15.81:0/1208371920 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x558adc5d2d30 0x558adc5d5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.566+0000 7f79c77fe640 1 --2- 172.21.15.81:0/1208371920 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x558adc5d2d30 0x558adc5d5120 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=49f90f4354cf04d7 server_cookie=92b98866da7084d2 in_seq=0 out_seq=0 2024-09-12T01:31:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.566+0000 7f79a6ffd640 10 client.16329 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:31:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79a6ffd640 1 -- 172.21.15.81:0/1208371920 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f79b009bb40 con 0x558adc5d2d30 2024-09-12T01:31:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79a6ffd640 10 client.16329 handle_command_reply: tid=0 2024-09-12T01:31:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79d055c740 1 client.16329 shutdown 2024-09-12T01:31:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79d055c740 1 -- 172.21.15.81:0/1208371920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 msgr2=0x558adc55c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79d055c740 1 --2- 172.21.15.81:0/1208371920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 0x558adc55c390 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f79b0097e10 tx=0x7f79b000d6c0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79d055c740 1 -- 172.21.15.81:0/1208371920 shutdown_connections 2024-09-12T01:31:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79d055c740 1 --2- 172.21.15.81:0/1208371920 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x558adc5d2d30 0x558adc5d5120 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79a6ffd640 0 client.16329 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:31:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79d055c740 1 --2- 172.21.15.81:0/1208371920 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558adc557370 0x558adc55c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79d055c740 1 --2- 172.21.15.81:0/1208371920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558adc54db40 0x558adc55c390 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79d055c740 1 --2- 172.21.15.81:0/1208371920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558adc54c5d0 0x558adc55f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79d055c740 1 -- 172.21.15.81:0/1208371920 >> 172.21.15.81:0/1208371920 conn(0x558adc515310 msgr2=0x558adc54e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79d055c740 1 -- 172.21.15.81:0/1208371920 shutdown_connections 2024-09-12T01:31:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79d055c740 1 -- 172.21.15.81:0/1208371920 wait complete. 2024-09-12T01:31:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.567+0000 7f79d055c740 20 client.16329 trim_cache size 0 max 16384 2024-09-12T01:31:57.586 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:31:57.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.568+0000 7f79ce183640 1 -- 172.21.15.81:0/3210142843 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f79b40a2cf0 msgr2=0x7f79b40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:57.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.568+0000 7f79ce183640 1 --2- 172.21.15.81:0/3210142843 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f79b40a2cf0 0x7f79b40a51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f79c0005e30 tx=0x7f79c00093d0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.568+0000 7f79ce183640 1 -- 172.21.15.81:0/3210142843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79c8102790 msgr2=0x7f79c8198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:57.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.568+0000 7f79ce183640 1 --2- 172.21.15.81:0/3210142843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79c8102790 0x7f79c8198930 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f79b000d770 tx=0x7f79b000dc30 comp rx=0 tx=0).stop 2024-09-12T01:31:57.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.568+0000 7f79ce183640 1 -- 172.21.15.81:0/3210142843 shutdown_connections 2024-09-12T01:31:57.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.568+0000 7f79ce183640 1 --2- 172.21.15.81:0/3210142843 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f79b40a2cf0 0x7f79b40a51b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.568+0000 7f79ce183640 1 --2- 172.21.15.81:0/3210142843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79c8106f10 0x7f79c819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.568+0000 7f79ce183640 1 --2- 172.21.15.81:0/3210142843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79c8102790 0x7f79c8198930 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.568+0000 7f79ce183640 1 --2- 172.21.15.81:0/3210142843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c8101de0 0x7f79c81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:57.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.568+0000 7f79ce183640 1 -- 172.21.15.81:0/3210142843 >> 172.21.15.81:0/3210142843 conn(0x7f79c80fd8c0 msgr2=0x7f79c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:57.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.568+0000 7f79ce183640 1 -- 172.21.15.81:0/3210142843 shutdown_connections 2024-09-12T01:31:57.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:57.568+0000 7f79ce183640 1 -- 172.21.15.81:0/3210142843 wait complete. 2024-09-12T01:31:58.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:31:58.489 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:31:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.988+0000 7f02b99c9640 1 -- 172.21.15.81:0/4282292427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b410e3d0 msgr2=0x7f02b4110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.988+0000 7f02b99c9640 1 --2- 172.21.15.81:0/4282292427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b410e3d0 0x7f02b4110820 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009900 tx=0x7f02ac02a480 comp rx=0 tx=0).stop 2024-09-12T01:31:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.989+0000 7f02b99c9640 1 -- 172.21.15.81:0/4282292427 shutdown_connections 2024-09-12T01:31:59.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.989+0000 7f02b99c9640 1 --2- 172.21.15.81:0/4282292427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b410e3d0 0x7f02b4110820 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.989+0000 7f02b99c9640 1 --2- 172.21.15.81:0/4282292427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b4074f40 0x7f02b410de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.989+0000 7f02b99c9640 1 --2- 172.21.15.81:0/4282292427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02b4074620 0x7f02b4074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.989+0000 7f02b99c9640 1 -- 172.21.15.81:0/4282292427 >> 172.21.15.81:0/4282292427 conn(0x7f02b40fd8f0 msgr2=0x7f02b40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:59.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.989+0000 7f02b99c9640 1 -- 172.21.15.81:0/4282292427 shutdown_connections 2024-09-12T01:31:59.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.989+0000 7f02b99c9640 1 -- 172.21.15.81:0/4282292427 wait complete. 2024-09-12T01:31:59.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.989+0000 7f02b99c9640 1 Processor -- start 2024-09-12T01:31:59.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.989+0000 7f02b99c9640 1 -- start start 2024-09-12T01:31:59.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b99c9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02b4074620 0x7f02b419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b99c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b4074f40 0x7f02b419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b99c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b410e3d0 0x7f02b419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b99c9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02b41141d0 con 0x7f02b410e3d0 2024-09-12T01:31:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b99c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02b4114050 con 0x7f02b4074f40 2024-09-12T01:31:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b99c9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02b4114350 con 0x7f02b4074620 2024-09-12T01:31:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b410e3d0 0x7f02b419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b410e3d0 0x7f02b419eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36226/0 (socket says 172.21.15.81:36226) 2024-09-12T01:31:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b37fe640 1 -- 172.21.15.81:0/2033668421 learned_addr learned my addr 172.21.15.81:0/2033668421 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b2ffd640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02b4074620 0x7f02b419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b27fc640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b4074f40 0x7f02b419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b37fe640 1 -- 172.21.15.81:0/2033668421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02b4074620 msgr2=0x7f02b419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b37fe640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02b4074620 0x7f02b419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b37fe640 1 -- 172.21.15.81:0/2033668421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b4074f40 msgr2=0x7f02b419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b37fe640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b4074f40 0x7f02b419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b37fe640 1 -- 172.21.15.81:0/2033668421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b419f580 con 0x7f02b410e3d0 2024-09-12T01:31:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b27fc640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b4074f40 0x7f02b419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b37fe640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b410e3d0 0x7f02b419eea0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009230 tx=0x7f02ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b89c7640 1 -- 172.21.15.81:0/2033668421 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac03f030 con 0x7f02b410e3d0 2024-09-12T01:31:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b89c7640 1 -- 172.21.15.81:0/2033668421 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02ac003ce0 con 0x7f02b410e3d0 2024-09-12T01:31:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b99c9640 1 -- 172.21.15.81:0/2033668421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b419f810 con 0x7f02b410e3d0 2024-09-12T01:31:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b89c7640 1 -- 172.21.15.81:0/2033668421 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac035070 con 0x7f02b410e3d0 2024-09-12T01:31:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.990+0000 7f02b99c9640 1 -- 172.21.15.81:0/2033668421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b41a7150 con 0x7f02b410e3d0 2024-09-12T01:31:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.993+0000 7f02b89c7640 1 -- 172.21.15.81:0/2033668421 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f02ac042030 con 0x7f02b410e3d0 2024-09-12T01:31:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.993+0000 7f02bbda2740 1 Processor -- start 2024-09-12T01:31:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.993+0000 7f02bbda2740 1 -- start start 2024-09-12T01:31:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.993+0000 7f02bbda2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff38cb40 0x55e3ff38b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.993+0000 7f02bbda2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38b5d0 0x55e3ff38ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.993+0000 7f02bbda2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff396370 0x55e3ff398760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.993+0000 7f02bbda2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff2f12f0 con 0x55e3ff396370 2024-09-12T01:31:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.993+0000 7f02bbda2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff298cf0 con 0x55e3ff38b5d0 2024-09-12T01:31:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.993+0000 7f02bbda2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff2ed2b0 con 0x55e3ff38cb40 2024-09-12T01:31:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.993+0000 7f02b89c7640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f029c0a2cf0 0x7f029c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff396370 0x55e3ff398760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff396370 0x55e3ff398760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36234/0 (socket says 172.21.15.81:36234) 2024-09-12T01:31:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b27fc640 1 -- 172.21.15.81:0/2257865728 learned_addr learned my addr 172.21.15.81:0/2257865728 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b27fc640 1 --2- 172.21.15.81:0/2257865728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff38cb40 0x55e3ff38b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b37fe640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f029c0a2cf0 0x7f029c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b2ffd640 1 --2- 172.21.15.81:0/2257865728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38b5d0 0x55e3ff38ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b89c7640 1 -- 172.21.15.81:0/2033668421 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f02ac0ef950 con 0x7f02b410e3d0 2024-09-12T01:31:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b27fc640 1 -- 172.21.15.81:0/2257865728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff38cb40 msgr2=0x55e3ff38b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b27fc640 1 --2- 172.21.15.81:0/2257865728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff38cb40 0x55e3ff38b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b27fc640 1 -- 172.21.15.81:0/2257865728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38b5d0 msgr2=0x55e3ff38ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:59.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b27fc640 1 --2- 172.21.15.81:0/2257865728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38b5d0 0x55e3ff38ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b27fc640 1 -- 172.21.15.81:0/2257865728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3ff27d3a0 con 0x55e3ff396370 2024-09-12T01:31:59.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b27fc640 1 --2- 172.21.15.81:0/2257865728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff396370 0x55e3ff398760 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f02a80139d0 tx=0x7f02a800b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b608384ed40126 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:59.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f02b37fe640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f029c0a2cf0 0x7f029c0a51b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0ed180 tx=0x7f02ac0dc040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:59.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f0299ffb640 1 -- 172.21.15.81:0/2257865728 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a8004030 con 0x55e3ff396370 2024-09-12T01:31:59.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f0299ffb640 1 -- 172.21.15.81:0/2257865728 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02a800ee40 con 0x55e3ff396370 2024-09-12T01:31:59.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.994+0000 7f0299ffb640 1 -- 172.21.15.81:0/2257865728 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a80039b0 con 0x55e3ff396370 2024-09-12T01:31:59.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.995+0000 7f02bbda2740 1 -- 172.21.15.81:0/2257865728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff396370 msgr2=0x55e3ff398760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:59.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.995+0000 7f02bbda2740 1 --2- 172.21.15.81:0/2257865728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff396370 0x55e3ff398760 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f02a80139d0 tx=0x7f02a800b500 comp rx=0 tx=0).stop 2024-09-12T01:31:59.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.995+0000 7f02bbda2740 1 -- 172.21.15.81:0/2257865728 shutdown_connections 2024-09-12T01:31:59.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.995+0000 7f02bbda2740 1 --2- 172.21.15.81:0/2257865728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff396370 0x55e3ff398760 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.995+0000 7f02bbda2740 1 --2- 172.21.15.81:0/2257865728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38b5d0 0x55e3ff38ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.995+0000 7f02bbda2740 1 --2- 172.21.15.81:0/2257865728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff38cb40 0x55e3ff38b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.995+0000 7f02bbda2740 1 -- 172.21.15.81:0/2257865728 >> 172.21.15.81:0/2257865728 conn(0x55e3ff354310 msgr2=0x55e3ff387c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.995+0000 7f02bbda2740 1 -- 172.21.15.81:0/2257865728 shutdown_connections 2024-09-12T01:31:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.995+0000 7f02bbda2740 1 -- 172.21.15.81:0/2257865728 wait complete. 2024-09-12T01:31:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.995+0000 7f02bbda2740 1 -- start start 2024-09-12T01:31:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02bbda2740 1 Processor -- start 2024-09-12T01:31:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02bbda2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38b5d0 0x55e3ff395d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02bbda2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 0x55e3ff393020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02bbda2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff396370 0x55e3ff393610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02bbda2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff399070 con 0x55e3ff38cb40 2024-09-12T01:31:59.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02bbda2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff2ac060 con 0x55e3ff38b5d0 2024-09-12T01:31:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02bbda2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e3ff3991f0 con 0x55e3ff396370 2024-09-12T01:31:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02bbda2740 10 client.0 _ll_register_callbacks cb 0x55e3fefff8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02b2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 0x55e3ff393020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02b2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 0x55e3ff393020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36250/0 (socket says 172.21.15.81:36250) 2024-09-12T01:31:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02b2ffd640 1 -- 172.21.15.81:0/3461200957 learned_addr learned my addr 172.21.15.81:0/3461200957 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02b27fc640 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38b5d0 0x55e3ff395d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02b27fc640 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff396370 0x55e3ff393610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02b2ffd640 1 -- 172.21.15.81:0/3461200957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff396370 msgr2=0x55e3ff393610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02b2ffd640 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff396370 0x55e3ff393610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02b2ffd640 1 -- 172.21.15.81:0/3461200957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38b5d0 msgr2=0x55e3ff395d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02b2ffd640 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38b5d0 0x55e3ff395d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02b2ffd640 1 -- 172.21.15.81:0/3461200957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3ff0623c0 con 0x55e3ff38cb40 2024-09-12T01:31:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02b27fc640 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38b5d0 0x55e3ff395d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:31:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f02b2ffd640 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 0x55e3ff393020 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f02a400ab60 tx=0x7f02a4011580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c13f3a953a0223 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.996+0000 7f0292ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f0292ffd640 1 -- 172.21.15.81:0/3461200957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a401a070 con 0x55e3ff38cb40 2024-09-12T01:31:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f0292ffd640 1 -- 172.21.15.81:0/3461200957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f02a4016450 con 0x55e3ff38cb40 2024-09-12T01:31:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f02bbda2740 1 -- 172.21.15.81:0/3461200957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02a800ee40 con 0x55e3ff38cb40 2024-09-12T01:31:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f0292ffd640 1 -- 172.21.15.81:0/3461200957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02a4026050 con 0x55e3ff38cb40 2024-09-12T01:31:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f02bbda2740 10 client.16341 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f02bbda2740 1 -- 172.21.15.81:0/3461200957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e3ff3a4b70 con 0x55e3ff38cb40 2024-09-12T01:31:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f0292ffd640 1 -- 172.21.15.81:0/3461200957 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02a800ee40 con 0x55e3ff38cb40 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f0292ffd640 1 -- 172.21.15.81:0/3461200957 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f02a401e760 con 0x55e3ff38cb40 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f02bbda2740 10 client.16341 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f02bbda2740 10 client.16341 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f02bbda2740 20 client.16341 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f02bbda2740 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55e3ff3a6020 0x55e3ff3a8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f02bbda2740 4 client.16341 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.997+0000 7f02bbda2740 1 -- 172.21.15.81:0/3461200957 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3ff2fe860 con 0x55e3ff3a6020 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.998+0000 7f02b27fc640 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55e3ff3a6020 0x55e3ff3a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.998+0000 7f02b27fc640 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55e3ff3a6020 0x55e3ff3a8440 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=14572e73fdf9200c server_cookie=6761f9a08510fc2f in_seq=0 out_seq=0 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.998+0000 7f0292ffd640 10 client.16341 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f0292ffd640 1 -- 172.21.15.81:0/3461200957 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3ff2fe860 con 0x55e3ff3a6020 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f0292ffd640 10 client.16341 handle_command_reply: tid=0 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f02bbda2740 1 client.16341 shutdown 2024-09-12T01:31:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f02bbda2740 1 -- 172.21.15.81:0/3461200957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 msgr2=0x55e3ff393020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f02bbda2740 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 0x55e3ff393020 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f02a400ab60 tx=0x7f02a4011580 comp rx=0 tx=0).stop 2024-09-12T01:31:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f02bbda2740 1 -- 172.21.15.81:0/3461200957 shutdown_connections 2024-09-12T01:31:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f02bbda2740 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55e3ff3a6020 0x55e3ff3a8440 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f02bbda2740 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff396370 0x55e3ff393610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f02bbda2740 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 0x55e3ff393020 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f02bbda2740 1 --2- 172.21.15.81:0/3461200957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38b5d0 0x55e3ff395d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f02bbda2740 1 -- 172.21.15.81:0/3461200957 >> 172.21.15.81:0/3461200957 conn(0x55e3ff354310 msgr2=0x55e3ff38d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f0292ffd640 0 client.16341 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:31:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f02bbda2740 1 -- 172.21.15.81:0/3461200957 shutdown_connections 2024-09-12T01:31:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f02bbda2740 1 -- 172.21.15.81:0/3461200957 wait complete. 2024-09-12T01:31:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:58.999+0000 7f02bbda2740 20 client.16341 trim_cache size 0 max 16384 2024-09-12T01:31:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02bbda2740 1 Processor -- start 2024-09-12T01:31:59.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02bbda2740 1 -- start start 2024-09-12T01:31:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02bbda2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff38b5d0 0x55e3ff387e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02bbda2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 0x55e3ff3a2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02bbda2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff396370 0x55e3ff3928e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02bbda2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02b41af960 con 0x55e3ff38cb40 2024-09-12T01:31:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02bbda2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02b41b14a0 con 0x55e3ff396370 2024-09-12T01:31:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02bbda2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02b41b0030 con 0x55e3ff38b5d0 2024-09-12T01:31:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02b2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 0x55e3ff3a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02b2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 0x55e3ff3a2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36254/0 (socket says 172.21.15.81:36254) 2024-09-12T01:31:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02b2ffd640 1 -- 172.21.15.81:0/4260787527 learned_addr learned my addr 172.21.15.81:0/4260787527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02b27fc640 1 --2- 172.21.15.81:0/4260787527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff396370 0x55e3ff3928e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02b2ffd640 1 -- 172.21.15.81:0/4260787527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff38b5d0 msgr2=0x55e3ff387e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02b2ffd640 1 --2- 172.21.15.81:0/4260787527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff38b5d0 0x55e3ff387e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02b2ffd640 1 -- 172.21.15.81:0/4260787527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff396370 msgr2=0x55e3ff3928e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02b2ffd640 1 --2- 172.21.15.81:0/4260787527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff396370 0x55e3ff3928e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02b2ffd640 1 -- 172.21.15.81:0/4260787527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3ff388960 con 0x55e3ff38cb40 2024-09-12T01:31:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.012+0000 7f02b2ffd640 1 --2- 172.21.15.81:0/4260787527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 0x55e3ff3a2310 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f02a4002230 tx=0x7f02a4009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f7da352c4fe63c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.013+0000 7f02997fa640 1 -- 172.21.15.81:0/4260787527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a402f070 con 0x55e3ff38cb40 2024-09-12T01:31:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.013+0000 7f02997fa640 1 -- 172.21.15.81:0/4260787527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02a401e890 con 0x55e3ff38cb40 2024-09-12T01:31:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.013+0000 7f02997fa640 1 -- 172.21.15.81:0/4260787527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a401a040 con 0x55e3ff38cb40 2024-09-12T01:31:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.013+0000 7f02bbda2740 1 -- 172.21.15.81:0/4260787527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 msgr2=0x55e3ff3a2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.013+0000 7f02bbda2740 1 --2- 172.21.15.81:0/4260787527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 0x55e3ff3a2310 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f02a4002230 tx=0x7f02a4009740 comp rx=0 tx=0).stop 2024-09-12T01:31:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.013+0000 7f02bbda2740 1 -- 172.21.15.81:0/4260787527 shutdown_connections 2024-09-12T01:31:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.013+0000 7f02bbda2740 1 --2- 172.21.15.81:0/4260787527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff396370 0x55e3ff3928e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.013+0000 7f02bbda2740 1 --2- 172.21.15.81:0/4260787527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38cb40 0x55e3ff3a2310 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.013+0000 7f02bbda2740 1 --2- 172.21.15.81:0/4260787527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff38b5d0 0x55e3ff387e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.013+0000 7f02bbda2740 1 -- 172.21.15.81:0/4260787527 >> 172.21.15.81:0/4260787527 conn(0x55e3ff354310 msgr2=0x55e3ff387700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.013+0000 7f02bbda2740 1 -- 172.21.15.81:0/4260787527 shutdown_connections 2024-09-12T01:31:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.013+0000 7f02bbda2740 1 -- 172.21.15.81:0/4260787527 wait complete. 2024-09-12T01:31:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02bbda2740 1 -- start start 2024-09-12T01:31:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02bbda2740 1 Processor -- start 2024-09-12T01:31:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02bbda2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38b5d0 0x55e3ff39e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02bbda2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38cb40 0x55e3ff39e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02bbda2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff396370 0x55e3ff38f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02bbda2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02b41b0dd0 con 0x55e3ff38b5d0 2024-09-12T01:31:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02bbda2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02b41b0700 con 0x55e3ff38cb40 2024-09-12T01:31:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02bbda2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02b41ad940 con 0x55e3ff396370 2024-09-12T01:31:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02bbda2740 10 client.0 _ll_register_callbacks cb 0x7f02a4009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:31:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02b27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38b5d0 0x55e3ff39e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02b27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38b5d0 0x55e3ff39e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36266/0 (socket says 172.21.15.81:36266) 2024-09-12T01:31:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02b27fc640 1 -- 172.21.15.81:0/3981813900 learned_addr learned my addr 172.21.15.81:0/3981813900 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:31:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02b27fc640 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff396370 0x55e3ff38f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02b2ffd640 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38cb40 0x55e3ff39e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02b27fc640 1 -- 172.21.15.81:0/3981813900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff396370 msgr2=0x55e3ff38f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02b27fc640 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff396370 0x55e3ff38f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02b27fc640 1 -- 172.21.15.81:0/3981813900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38cb40 msgr2=0x55e3ff39e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:31:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02b27fc640 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38cb40 0x55e3ff39e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02b27fc640 1 -- 172.21.15.81:0/3981813900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3ff3874f0 con 0x55e3ff38b5d0 2024-09-12T01:31:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.014+0000 7f02b2ffd640 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38cb40 0x55e3ff39e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:31:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f02b27fc640 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38b5d0 0x55e3ff39e480 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f02a800bb20 tx=0x7f02a80035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adaa90667b3ef0c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:31:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f0292ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:31:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f0292ffd640 1 -- 172.21.15.81:0/3981813900 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a8028040 con 0x55e3ff38b5d0 2024-09-12T01:31:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f0292ffd640 1 -- 172.21.15.81:0/3981813900 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f02a800ea20 con 0x55e3ff38b5d0 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f02bbda2740 1 -- 172.21.15.81:0/3981813900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02a401e890 con 0x55e3ff38b5d0 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f0292ffd640 1 -- 172.21.15.81:0/3981813900 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02a800ec20 con 0x55e3ff38b5d0 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f02bbda2740 10 client.16347 fetch_fsmap learned FSMap version 28 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f02bbda2740 1 -- 172.21.15.81:0/3981813900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e3ff4103e0 con 0x55e3ff38b5d0 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f0292ffd640 1 -- 172.21.15.81:0/3981813900 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02a401e890 con 0x55e3ff38b5d0 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f0292ffd640 1 -- 172.21.15.81:0/3981813900 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f02a8034080 con 0x55e3ff38b5d0 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f02bbda2740 10 client.16347 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f02bbda2740 10 client.16347 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f02bbda2740 20 client.16347 populate_metadata read hostname 'smithi081' 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f02bbda2740 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55e3ff410890 0x55e3ff412cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.015+0000 7f02bbda2740 4 client.16347 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.016+0000 7f02bbda2740 1 -- 172.21.15.81:0/3981813900 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e3ff2f8d70 con 0x55e3ff410890 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.016+0000 7f02b2ffd640 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55e3ff410890 0x55e3ff412cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:31:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.016+0000 7f0292ffd640 10 client.16347 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:31:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.016+0000 7f02b2ffd640 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55e3ff410890 0x55e3ff412cb0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ddb246c7cfc441b5 server_cookie=d768f40cf93ca034 in_seq=0 out_seq=0 2024-09-12T01:31:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.016+0000 7f0292ffd640 1 -- 172.21.15.81:0/3981813900 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e3ff2f8d70 con 0x55e3ff410890 2024-09-12T01:31:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.016+0000 7f0292ffd640 10 client.16347 handle_command_reply: tid=0 2024-09-12T01:31:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.016+0000 7f02bbda2740 1 client.16347 shutdown 2024-09-12T01:31:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.016+0000 7f02bbda2740 1 -- 172.21.15.81:0/3981813900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38b5d0 msgr2=0x55e3ff39e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.016+0000 7f02bbda2740 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38b5d0 0x55e3ff39e480 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f02a800bb20 tx=0x7f02a80035f0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02bbda2740 1 -- 172.21.15.81:0/3981813900 shutdown_connections 2024-09-12T01:31:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02bbda2740 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55e3ff410890 0x55e3ff412cb0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02bbda2740 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e3ff396370 0x55e3ff38f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02bbda2740 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3ff38cb40 0x55e3ff39e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02bbda2740 1 --2- 172.21.15.81:0/3981813900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e3ff38b5d0 0x55e3ff39e480 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02bbda2740 1 -- 172.21.15.81:0/3981813900 >> 172.21.15.81:0/3981813900 conn(0x55e3ff354310 msgr2=0x55e3ff392890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f0292ffd640 0 client.16347 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:31:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02bbda2740 1 -- 172.21.15.81:0/3981813900 shutdown_connections 2024-09-12T01:31:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02bbda2740 1 -- 172.21.15.81:0/3981813900 wait complete. 2024-09-12T01:31:59.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02bbda2740 20 client.16347 trim_cache size 0 max 16384 2024-09-12T01:31:59.033 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:31:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02b99c9640 1 -- 172.21.15.81:0/2033668421 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f029c0a2cf0 msgr2=0x7f029c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02b99c9640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f029c0a2cf0 0x7f029c0a51b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0ed180 tx=0x7f02ac0dc040 comp rx=0 tx=0).stop 2024-09-12T01:31:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02b99c9640 1 -- 172.21.15.81:0/2033668421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b410e3d0 msgr2=0x7f02b419eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:31:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02b99c9640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b410e3d0 0x7f02b419eea0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009230 tx=0x7f02ac0042f0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02b99c9640 1 -- 172.21.15.81:0/2033668421 shutdown_connections 2024-09-12T01:31:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02b99c9640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f029c0a2cf0 0x7f029c0a51b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02b99c9640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b410e3d0 0x7f02b419eea0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02b99c9640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b4074f40 0x7f02b419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02b99c9640 1 --2- 172.21.15.81:0/2033668421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02b4074620 0x7f02b419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:31:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02b99c9640 1 -- 172.21.15.81:0/2033668421 >> 172.21.15.81:0/2033668421 conn(0x7f02b40fd8f0 msgr2=0x7f02b40fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:31:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02b99c9640 1 -- 172.21.15.81:0/2033668421 shutdown_connections 2024-09-12T01:31:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:31:59.017+0000 7f02b99c9640 1 -- 172.21.15.81:0/2033668421 wait complete. 2024-09-12T01:31:59.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:31:58 smithi081 ceph-mon[30920]: pgmap v120: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-12T01:31:59.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:31:58 smithi100 ceph-mon[35275]: pgmap v120: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-12T01:31:59.285 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:31:58 smithi189 ceph-mon[35357]: pgmap v120: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-12T01:31:59.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:32:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:32:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.504+0000 7ff1c9872640 1 -- 172.21.15.81:0/1030701633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4101430 msgr2=0x7ff1c410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.504+0000 7ff1c9872640 1 --2- 172.21.15.81:0/1030701633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4101430 0x7ff1c410d960 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009cd0 tx=0x7ff1bc02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.504+0000 7ff1c9872640 1 -- 172.21.15.81:0/1030701633 shutdown_connections 2024-09-12T01:32:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.504+0000 7ff1c9872640 1 --2- 172.21.15.81:0/1030701633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4101430 0x7ff1c410d960 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.504+0000 7ff1c9872640 1 --2- 172.21.15.81:0/1030701633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1c4100a90 0x7ff1c4100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.504+0000 7ff1c9872640 1 --2- 172.21.15.81:0/1030701633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c4106a90 0x7ff1c4106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.504+0000 7ff1c9872640 1 -- 172.21.15.81:0/1030701633 >> 172.21.15.81:0/1030701633 conn(0x7ff1c40fc7d0 msgr2=0x7ff1c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:00.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.504+0000 7ff1c9872640 1 -- 172.21.15.81:0/1030701633 shutdown_connections 2024-09-12T01:32:00.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.504+0000 7ff1c9872640 1 -- 172.21.15.81:0/1030701633 wait complete. 2024-09-12T01:32:00.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.505+0000 7ff1c9872640 1 Processor -- start 2024-09-12T01:32:00.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.505+0000 7ff1c9872640 1 -- start start 2024-09-12T01:32:00.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.505+0000 7ff1c9872640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1c4100a90 0x7ff1c4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.505+0000 7ff1c9872640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4101430 0x7ff1c41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.505+0000 7ff1c9872640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c4106a90 0x7ff1c419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.505+0000 7ff1c9872640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4111fb0 con 0x7ff1c4101430 2024-09-12T01:32:00.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.505+0000 7ff1c9872640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4111e30 con 0x7ff1c4100a90 2024-09-12T01:32:00.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.505+0000 7ff1c9872640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4112130 con 0x7ff1c4106a90 2024-09-12T01:32:00.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.505+0000 7ff1ba7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4101430 0x7ff1c41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.505+0000 7ff1ba7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4101430 0x7ff1c41989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36290/0 (socket says 172.21.15.81:36290) 2024-09-12T01:32:00.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.505+0000 7ff1ba7fc640 1 -- 172.21.15.81:0/2626578505 learned_addr learned my addr 172.21.15.81:0/2626578505 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:00.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.505+0000 7ff1c2ffd640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1c4100a90 0x7ff1c4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.506+0000 7ff1c37fe640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c4106a90 0x7ff1c419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.506+0000 7ff1ba7fc640 1 -- 172.21.15.81:0/2626578505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c4106a90 msgr2=0x7ff1c419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:00.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.506+0000 7ff1ba7fc640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c4106a90 0x7ff1c419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.506+0000 7ff1ba7fc640 1 -- 172.21.15.81:0/2626578505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1c4100a90 msgr2=0x7ff1c4198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:00.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.506+0000 7ff1ba7fc640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1c4100a90 0x7ff1c4198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.506+0000 7ff1ba7fc640 1 -- 172.21.15.81:0/2626578505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c419d440 con 0x7ff1c4101430 2024-09-12T01:32:00.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.506+0000 7ff1c2ffd640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1c4100a90 0x7ff1c4198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:00.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.506+0000 7ff1ba7fc640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4101430 0x7ff1c41989d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00d950 tx=0x7ff1ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:00.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.506+0000 7ff1c8870640 1 -- 172.21.15.81:0/2626578505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac017070 con 0x7ff1c4101430 2024-09-12T01:32:00.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.506+0000 7ff1c8870640 1 -- 172.21.15.81:0/2626578505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1ac009c30 con 0x7ff1c4101430 2024-09-12T01:32:00.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.506+0000 7ff1c9872640 1 -- 172.21.15.81:0/2626578505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c419d730 con 0x7ff1c4101430 2024-09-12T01:32:00.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.506+0000 7ff1c8870640 1 -- 172.21.15.81:0/2626578505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00f6b0 con 0x7ff1c4101430 2024-09-12T01:32:00.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.506+0000 7ff1c9872640 1 -- 172.21.15.81:0/2626578505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c41a5010 con 0x7ff1c4101430 2024-09-12T01:32:00.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.508+0000 7ff1c8870640 1 -- 172.21.15.81:0/2626578505 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff1ac0109d0 con 0x7ff1c4101430 2024-09-12T01:32:00.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1cbc4b740 1 Processor -- start 2024-09-12T01:32:00.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1cbc4b740 1 -- start start 2024-09-12T01:32:00.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1cbc4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 0x55c22f7ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1cbc4b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7ca5d0 0x55c22f7caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1cbc4b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7d5370 0x55c22f7d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1cbc4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c22f7302f0 con 0x55c22f7cbb40 2024-09-12T01:32:00.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1cbc4b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c22f6d7cf0 con 0x55c22f7d5370 2024-09-12T01:32:00.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1cbc4b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c22f72c2b0 con 0x55c22f7ca5d0 2024-09-12T01:32:00.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1c8870640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1b00a2cf0 0x7ff1b00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 0x55c22f7ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1c2ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7ca5d0 0x55c22f7caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 0x55c22f7ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36292/0 (socket says 172.21.15.81:36292) 2024-09-12T01:32:00.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1c37fe640 1 -- 172.21.15.81:0/2772214775 learned_addr learned my addr 172.21.15.81:0/2772214775 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:00.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1c37fe640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1b00a2cf0 0x7ff1b00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1c8870640 1 -- 172.21.15.81:0/2626578505 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff1ac0cf0c0 con 0x7ff1c4101430 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.509+0000 7ff1ba7fc640 1 --2- 172.21.15.81:0/2772214775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7d5370 0x55c22f7d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.510+0000 7ff1c37fe640 1 -- 172.21.15.81:0/2772214775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7ca5d0 msgr2=0x55c22f7caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.510+0000 7ff1c37fe640 1 --2- 172.21.15.81:0/2772214775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7ca5d0 0x55c22f7caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.510+0000 7ff1c37fe640 1 -- 172.21.15.81:0/2772214775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7d5370 msgr2=0x55c22f7d7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.510+0000 7ff1c37fe640 1 --2- 172.21.15.81:0/2772214775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7d5370 0x55c22f7d7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.510+0000 7ff1c37fe640 1 -- 172.21.15.81:0/2772214775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22f6bc3a0 con 0x55c22f7cbb40 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.510+0000 7ff1c2ffd640 1 --2- 172.21.15.81:0/2772214775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7ca5d0 0x55c22f7caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.510+0000 7ff1c37fe640 1 --2- 172.21.15.81:0/2772214775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 0x55c22f7ca090 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009430 tx=0x7ff1bc031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9740ab18d041a6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.510+0000 7ff1c37fe640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1b00a2cf0 0x7ff1b00a51b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009a60 tx=0x7ff1bc048000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.510+0000 7ff1b9ffb640 1 -- 172.21.15.81:0/2772214775 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc04e070 con 0x55c22f7cbb40 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.510+0000 7ff1b9ffb640 1 -- 172.21.15.81:0/2772214775 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1bc036040 con 0x55c22f7cbb40 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.510+0000 7ff1b9ffb640 1 -- 172.21.15.81:0/2772214775 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc030800 con 0x55c22f7cbb40 2024-09-12T01:32:00.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.511+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/2772214775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 msgr2=0x55c22f7ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:00.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.511+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/2772214775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 0x55c22f7ca090 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009430 tx=0x7ff1bc031cc0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.511+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/2772214775 shutdown_connections 2024-09-12T01:32:00.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.511+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/2772214775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7d5370 0x55c22f7d7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.511+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/2772214775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7ca5d0 0x55c22f7caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.511+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/2772214775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 0x55c22f7ca090 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.511+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/2772214775 >> 172.21.15.81:0/2772214775 conn(0x55c22f793310 msgr2=0x55c22f7c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:00.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.511+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/2772214775 shutdown_connections 2024-09-12T01:32:00.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.511+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/2772214775 wait complete. 2024-09-12T01:32:00.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.511+0000 7ff1cbc4b740 1 -- start start 2024-09-12T01:32:00.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.511+0000 7ff1cbc4b740 1 Processor -- start 2024-09-12T01:32:00.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1cbc4b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7ca5d0 0x55c22f7d4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1cbc4b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7cbb40 0x55c22f7d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1cbc4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 0x55c22f7d27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1cbc4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c22f7d8010 con 0x55c22f7d5370 2024-09-12T01:32:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1cbc4b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c22f6eb060 con 0x55c22f7cbb40 2024-09-12T01:32:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1cbc4b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c22f7d8190 con 0x55c22f7ca5d0 2024-09-12T01:32:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1cbc4b740 10 client.0 _ll_register_callbacks cb 0x55c22f43e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 0x55c22f7d27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 0x55c22f7d27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36308/0 (socket says 172.21.15.81:36308) 2024-09-12T01:32:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1c37fe640 1 -- 172.21.15.81:0/1506789045 learned_addr learned my addr 172.21.15.81:0/1506789045 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1c2ffd640 1 --2- 172.21.15.81:0/1506789045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7ca5d0 0x55c22f7d4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1ba7fc640 1 --2- 172.21.15.81:0/1506789045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7cbb40 0x55c22f7d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1c37fe640 1 -- 172.21.15.81:0/1506789045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7ca5d0 msgr2=0x55c22f7d4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1c37fe640 1 --2- 172.21.15.81:0/1506789045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7ca5d0 0x55c22f7d4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1c37fe640 1 -- 172.21.15.81:0/1506789045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7cbb40 msgr2=0x55c22f7d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1c37fe640 1 --2- 172.21.15.81:0/1506789045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7cbb40 0x55c22f7d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1c37fe640 1 -- 172.21.15.81:0/1506789045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c22f4a13c0 con 0x55c22f7d5370 2024-09-12T01:32:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1c37fe640 1 --2- 172.21.15.81:0/1506789045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 0x55c22f7d27d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc031960 tx=0x7ff1bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0532391637c7d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1a2ffd640 1 -- 172.21.15.81:0/1506789045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc057020 con 0x55c22f7d5370 2024-09-12T01:32:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1a2ffd640 1 -- 172.21.15.81:0/1506789045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff1bc0309b0 con 0x55c22f7d5370 2024-09-12T01:32:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.512+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1506789045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1bc036040 con 0x55c22f7d5370 2024-09-12T01:32:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.513+0000 7ff1a2ffd640 1 -- 172.21.15.81:0/1506789045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff1bc062050 con 0x55c22f7d5370 2024-09-12T01:32:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.513+0000 7ff1cbc4b740 10 client.16359 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.513+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1506789045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c22f7e3b40 con 0x55c22f7d5370 2024-09-12T01:32:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.513+0000 7ff1a2ffd640 1 -- 172.21.15.81:0/1506789045 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1bc036040 con 0x55c22f7d5370 2024-09-12T01:32:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.513+0000 7ff1a2ffd640 1 -- 172.21.15.81:0/1506789045 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff1bc030070 con 0x55c22f7d5370 2024-09-12T01:32:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.513+0000 7ff1cbc4b740 10 client.16359 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.513+0000 7ff1cbc4b740 10 client.16359 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:32:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.513+0000 7ff1cbc4b740 20 client.16359 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.513+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1506789045 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c22f7e4e90 0x55c22f7e7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.513+0000 7ff1cbc4b740 4 client.16359 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:32:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.513+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1506789045 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c22f73d860 con 0x55c22f7e4e90 2024-09-12T01:32:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.513+0000 7ff1c2ffd640 1 --2- 172.21.15.81:0/1506789045 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c22f7e4e90 0x55c22f7e7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.514+0000 7ff1a2ffd640 10 client.16359 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:32:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.514+0000 7ff1c2ffd640 1 --2- 172.21.15.81:0/1506789045 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c22f7e4e90 0x55c22f7e7280 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=58f1d198f429430f server_cookie=a905c6d0d06ae455 in_seq=0 out_seq=0 2024-09-12T01:32:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.514+0000 7ff1a2ffd640 1 -- 172.21.15.81:0/1506789045 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c22f73d860 con 0x55c22f7e4e90 2024-09-12T01:32:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.514+0000 7ff1a2ffd640 10 client.16359 handle_command_reply: tid=0 2024-09-12T01:32:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.514+0000 7ff1cbc4b740 1 client.16359 shutdown 2024-09-12T01:32:00.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.515+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1506789045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 msgr2=0x55c22f7d27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:00.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.515+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1506789045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 0x55c22f7d27d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc031960 tx=0x7ff1bc0042f0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.515+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1506789045 shutdown_connections 2024-09-12T01:32:00.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.515+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1506789045 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c22f7e4e90 0x55c22f7e7280 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.515+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1506789045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 0x55c22f7d27d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.515+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1506789045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7cbb40 0x55c22f7d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.515+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1506789045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7ca5d0 0x55c22f7d4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.515+0000 7ff1a2ffd640 0 client.16359 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:32:00.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.515+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1506789045 >> 172.21.15.81:0/1506789045 conn(0x55c22f793310 msgr2=0x55c22f7cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:00.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.515+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1506789045 shutdown_connections 2024-09-12T01:32:00.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.515+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1506789045 wait complete. 2024-09-12T01:32:00.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.515+0000 7ff1cbc4b740 20 client.16359 trim_cache size 0 max 16384 2024-09-12T01:32:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1cbc4b740 1 Processor -- start 2024-09-12T01:32:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1cbc4b740 1 -- start start 2024-09-12T01:32:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1cbc4b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7ca5d0 0x55c22f7e12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1cbc4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 0x55c22f7d1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1cbc4b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7d5370 0x55c22f7dd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1cbc4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41ad860 con 0x55c22f7cbb40 2024-09-12T01:32:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1cbc4b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41af3a0 con 0x55c22f7ca5d0 2024-09-12T01:32:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1cbc4b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41adf30 con 0x55c22f7d5370 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1ba7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 0x55c22f7d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1ba7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 0x55c22f7d1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36310/0 (socket says 172.21.15.81:36310) 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1ba7fc640 1 -- 172.21.15.81:0/1159422899 learned_addr learned my addr 172.21.15.81:0/1159422899 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1c2ffd640 1 --2- 172.21.15.81:0/1159422899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7ca5d0 0x55c22f7e12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1ba7fc640 1 -- 172.21.15.81:0/1159422899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7d5370 msgr2=0x55c22f7dd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1ba7fc640 1 --2- 172.21.15.81:0/1159422899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7d5370 0x55c22f7dd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1ba7fc640 1 -- 172.21.15.81:0/1159422899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7ca5d0 msgr2=0x55c22f7e12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1ba7fc640 1 --2- 172.21.15.81:0/1159422899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7ca5d0 0x55c22f7e12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1ba7fc640 1 -- 172.21.15.81:0/1159422899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22f7e17f0 con 0x55c22f7cbb40 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.528+0000 7ff1c2ffd640 1 --2- 172.21.15.81:0/1159422899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7ca5d0 0x55c22f7e12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.529+0000 7ff1ba7fc640 1 --2- 172.21.15.81:0/1159422899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 0x55c22f7d1070 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac09b640 tx=0x7ff1ac086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60262c6753c335a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.529+0000 7ff1b97fa640 1 -- 172.21.15.81:0/1159422899 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac020040 con 0x55c22f7cbb40 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.529+0000 7ff1b97fa640 1 -- 172.21.15.81:0/1159422899 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1ac009de0 con 0x55c22f7cbb40 2024-09-12T01:32:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.529+0000 7ff1b97fa640 1 -- 172.21.15.81:0/1159422899 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac09ab00 con 0x55c22f7cbb40 2024-09-12T01:32:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.529+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1159422899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 msgr2=0x55c22f7d1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.529+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1159422899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 0x55c22f7d1070 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac09b640 tx=0x7ff1ac086040 comp rx=0 tx=0).stop 2024-09-12T01:32:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.529+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1159422899 shutdown_connections 2024-09-12T01:32:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.529+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1159422899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7d5370 0x55c22f7dd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.529+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1159422899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7cbb40 0x55c22f7d1070 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.529+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1159422899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7ca5d0 0x55c22f7e12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.529+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1159422899 >> 172.21.15.81:0/1159422899 conn(0x55c22f793310 msgr2=0x55c22f7d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.530+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1159422899 shutdown_connections 2024-09-12T01:32:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.530+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1159422899 wait complete. 2024-09-12T01:32:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.530+0000 7ff1cbc4b740 1 -- start start 2024-09-12T01:32:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.530+0000 7ff1cbc4b740 1 Processor -- start 2024-09-12T01:32:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.530+0000 7ff1cbc4b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7ca5d0 0x55c22f84c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.530+0000 7ff1cbc4b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7cbb40 0x55c22f84c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.530+0000 7ff1cbc4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 0x55c22f7ec5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.530+0000 7ff1cbc4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41aecd0 con 0x55c22f7d5370 2024-09-12T01:32:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.530+0000 7ff1cbc4b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41ae600 con 0x55c22f7ca5d0 2024-09-12T01:32:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.530+0000 7ff1cbc4b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41ab840 con 0x55c22f7cbb40 2024-09-12T01:32:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.530+0000 7ff1cbc4b740 10 client.0 _ll_register_callbacks cb 0x7ff1ac00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 0x55c22f7ec5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 0x55c22f7ec5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36314/0 (socket says 172.21.15.81:36314) 2024-09-12T01:32:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1c37fe640 1 -- 172.21.15.81:0/1343385326 learned_addr learned my addr 172.21.15.81:0/1343385326 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1c2ffd640 1 --2- 172.21.15.81:0/1343385326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7ca5d0 0x55c22f84c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1ba7fc640 1 --2- 172.21.15.81:0/1343385326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7cbb40 0x55c22f84c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1c37fe640 1 -- 172.21.15.81:0/1343385326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7cbb40 msgr2=0x55c22f84c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1c37fe640 1 --2- 172.21.15.81:0/1343385326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7cbb40 0x55c22f84c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1c37fe640 1 -- 172.21.15.81:0/1343385326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7ca5d0 msgr2=0x55c22f84c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1c37fe640 1 --2- 172.21.15.81:0/1343385326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7ca5d0 0x55c22f84c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1c37fe640 1 -- 172.21.15.81:0/1343385326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c22f7ece00 con 0x55c22f7d5370 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1c37fe640 1 --2- 172.21.15.81:0/1343385326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 0x55c22f7ec5d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc02ae00 tx=0x7ff1bc031990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f1a49f4718a7e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1a2ffd640 1 -- 172.21.15.81:0/1343385326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc057040 con 0x55c22f7d5370 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1343385326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1ac009de0 con 0x55c22f7d5370 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1a2ffd640 1 -- 172.21.15.81:0/1343385326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff1bc02e040 con 0x55c22f7d5370 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1a2ffd640 1 -- 172.21.15.81:0/1343385326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff1bc06d050 con 0x55c22f7d5370 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1cbc4b740 10 client.16365 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.531+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1343385326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c22f853aa0 con 0x55c22f7d5370 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.532+0000 7ff1a2ffd640 1 -- 172.21.15.81:0/1343385326 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1ac009de0 con 0x55c22f7d5370 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.532+0000 7ff1a2ffd640 1 -- 172.21.15.81:0/1343385326 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff1bc04a8d0 con 0x55c22f7d5370 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.532+0000 7ff1cbc4b740 10 client.16365 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.532+0000 7ff1cbc4b740 10 client.16365 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:32:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.532+0000 7ff1cbc4b740 20 client.16365 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.532+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1343385326 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c22f854100 0x55c22f856520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.532+0000 7ff1cbc4b740 4 client.16365 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:32:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.532+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1343385326 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c22f737d70 con 0x55c22f854100 2024-09-12T01:32:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.532+0000 7ff1c2ffd640 1 --2- 172.21.15.81:0/1343385326 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c22f854100 0x55c22f856520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.532+0000 7ff1a2ffd640 10 client.16365 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:32:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.532+0000 7ff1c2ffd640 1 --2- 172.21.15.81:0/1343385326 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c22f854100 0x55c22f856520 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ce550b2aa94f5deb server_cookie=391aafbfa9a6cb60 in_seq=0 out_seq=0 2024-09-12T01:32:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1a2ffd640 1 -- 172.21.15.81:0/1343385326 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c22f737d70 con 0x55c22f854100 2024-09-12T01:32:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1a2ffd640 10 client.16365 handle_command_reply: tid=0 2024-09-12T01:32:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1cbc4b740 1 client.16365 shutdown 2024-09-12T01:32:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1343385326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 msgr2=0x55c22f7ec5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1343385326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 0x55c22f7ec5d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc02ae00 tx=0x7ff1bc031990 comp rx=0 tx=0).stop 2024-09-12T01:32:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1343385326 shutdown_connections 2024-09-12T01:32:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1343385326 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c22f854100 0x55c22f856520 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1343385326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c22f7d5370 0x55c22f7ec5d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1343385326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c22f7cbb40 0x55c22f84c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1cbc4b740 1 --2- 172.21.15.81:0/1343385326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c22f7ca5d0 0x55c22f84c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1343385326 >> 172.21.15.81:0/1343385326 conn(0x55c22f793310 msgr2=0x55c22f7d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1a2ffd640 0 client.16365 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:32:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1343385326 shutdown_connections 2024-09-12T01:32:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1cbc4b740 1 -- 172.21.15.81:0/1343385326 wait complete. 2024-09-12T01:32:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.533+0000 7ff1cbc4b740 20 client.16365 trim_cache size 0 max 16384 2024-09-12T01:32:00.540 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:32:00.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.534+0000 7ff1c9872640 1 -- 172.21.15.81:0/2626578505 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1b00a2cf0 msgr2=0x7ff1b00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.534+0000 7ff1c9872640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1b00a2cf0 0x7ff1b00a51b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009a60 tx=0x7ff1bc048000 comp rx=0 tx=0).stop 2024-09-12T01:32:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.534+0000 7ff1c9872640 1 -- 172.21.15.81:0/2626578505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4101430 msgr2=0x7ff1c41989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.534+0000 7ff1c9872640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4101430 0x7ff1c41989d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00d950 tx=0x7ff1ac00de10 comp rx=0 tx=0).stop 2024-09-12T01:32:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.534+0000 7ff1c9872640 1 -- 172.21.15.81:0/2626578505 shutdown_connections 2024-09-12T01:32:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.534+0000 7ff1c9872640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1b00a2cf0 0x7ff1b00a51b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.534+0000 7ff1c9872640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1c4106a90 0x7ff1c419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.534+0000 7ff1c9872640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c4101430 0x7ff1c41989d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.534+0000 7ff1c9872640 1 --2- 172.21.15.81:0/2626578505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1c4100a90 0x7ff1c4198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.534+0000 7ff1c9872640 1 -- 172.21.15.81:0/2626578505 >> 172.21.15.81:0/2626578505 conn(0x7ff1c40fc7d0 msgr2=0x7ff1c40fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.534+0000 7ff1c9872640 1 -- 172.21.15.81:0/2626578505 shutdown_connections 2024-09-12T01:32:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:00.534+0000 7ff1c9872640 1 -- 172.21.15.81:0/2626578505 wait complete. 2024-09-12T01:32:01.160 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:00 smithi081 ceph-mon[30920]: pgmap v121: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-09-12T01:32:01.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:32:01.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:00 smithi100 ceph-mon[35275]: pgmap v121: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-09-12T01:32:01.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:00 smithi189 ceph-mon[35357]: pgmap v121: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-09-12T01:32:01.430 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:32:01.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.914+0000 7f6335188640 1 -- 172.21.15.81:0/276557613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6330101de0 msgr2=0x7f63301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:01.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.914+0000 7f6335188640 1 --2- 172.21.15.81:0/276557613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6330101de0 0x7f63301021c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6320009900 tx=0x7f632002a410 comp rx=0 tx=0).stop 2024-09-12T01:32:01.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.914+0000 7f6335188640 1 -- 172.21.15.81:0/276557613 shutdown_connections 2024-09-12T01:32:01.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.914+0000 7f6335188640 1 --2- 172.21.15.81:0/276557613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6330106f10 0x7f633010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.914+0000 7f6335188640 1 --2- 172.21.15.81:0/276557613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6330102790 0x7f63301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.914+0000 7f6335188640 1 --2- 172.21.15.81:0/276557613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6330101de0 0x7f63301021c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.914+0000 7f6335188640 1 -- 172.21.15.81:0/276557613 >> 172.21.15.81:0/276557613 conn(0x7f63300fd8c0 msgr2=0x7f63300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:01.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.914+0000 7f6335188640 1 -- 172.21.15.81:0/276557613 shutdown_connections 2024-09-12T01:32:01.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.914+0000 7f6335188640 1 -- 172.21.15.81:0/276557613 wait complete. 2024-09-12T01:32:01.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.914+0000 7f6335188640 1 Processor -- start 2024-09-12T01:32:01.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f6335188640 1 -- start start 2024-09-12T01:32:01.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f6335188640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6330101de0 0x7f63301983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f6335188640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6330102790 0x7f6330198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f6335188640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6330106f10 0x7f633019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f6335188640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6330111f90 con 0x7f6330102790 2024-09-12T01:32:01.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f6335188640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6330111e10 con 0x7f6330106f10 2024-09-12T01:32:01.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f6335188640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6330112110 con 0x7f6330101de0 2024-09-12T01:32:01.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f632e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6330102790 0x7f6330198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f632e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6330102790 0x7f6330198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36328/0 (socket says 172.21.15.81:36328) 2024-09-12T01:32:01.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f632e59c640 1 -- 172.21.15.81:0/1498685462 learned_addr learned my addr 172.21.15.81:0/1498685462 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:01.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f632f59e640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6330106f10 0x7f633019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f632ed9d640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6330101de0 0x7f63301983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f632e59c640 1 -- 172.21.15.81:0/1498685462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6330101de0 msgr2=0x7f63301983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:01.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f632e59c640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6330101de0 0x7f63301983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f632e59c640 1 -- 172.21.15.81:0/1498685462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6330106f10 msgr2=0x7f633019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:01.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f632e59c640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6330106f10 0x7f633019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.915+0000 7f632e59c640 1 -- 172.21.15.81:0/1498685462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633019d380 con 0x7f6330102790 2024-09-12T01:32:01.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.916+0000 7f632e59c640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6330102790 0x7f6330198910 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f632400c920 tx=0x7f632400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:01.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.916+0000 7f6317fff640 1 -- 172.21.15.81:0/1498685462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324007c70 con 0x7f6330102790 2024-09-12T01:32:01.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.916+0000 7f6335188640 1 -- 172.21.15.81:0/1498685462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633019d670 con 0x7f6330102790 2024-09-12T01:32:01.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.916+0000 7f6317fff640 1 -- 172.21.15.81:0/1498685462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6324007e10 con 0x7f6330102790 2024-09-12T01:32:01.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.916+0000 7f6317fff640 1 -- 172.21.15.81:0/1498685462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324018890 con 0x7f6330102790 2024-09-12T01:32:01.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.916+0000 7f6335188640 1 -- 172.21.15.81:0/1498685462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63301a4f50 con 0x7f6330102790 2024-09-12T01:32:01.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.918+0000 7f6317fff640 1 -- 172.21.15.81:0/1498685462 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6324018a70 con 0x7f6330102790 2024-09-12T01:32:01.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.918+0000 7f6337561740 1 Processor -- start 2024-09-12T01:32:01.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f6337561740 1 -- start start 2024-09-12T01:32:01.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f6337561740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a8b40 0x5620b44a7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f6337561740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44a75d0 0x5620b44a7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f6317fff640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f63180a2cf0 0x7f63180a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f6337561740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44b2370 0x5620b44b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f6337561740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5620b440d2f0 con 0x5620b44b2370 2024-09-12T01:32:01.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f6337561740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5620b43b4cf0 con 0x5620b44a8b40 2024-09-12T01:32:01.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f6337561740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5620b44092b0 con 0x5620b44a75d0 2024-09-12T01:32:01.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f632f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44b2370 0x5620b44b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f632f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44b2370 0x5620b44b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36332/0 (socket says 172.21.15.81:36332) 2024-09-12T01:32:01.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f632f59e640 1 -- 172.21.15.81:0/3151991449 learned_addr learned my addr 172.21.15.81:0/3151991449 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:01.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f632e59c640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f63180a2cf0 0x7f63180a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f6317fff640 1 -- 172.21.15.81:0/1498685462 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f63240cf520 con 0x7f6330102790 2024-09-12T01:32:01.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f632f59e640 1 --2- 172.21.15.81:0/3151991449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a8b40 0x5620b44a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f632ed9d640 1 --2- 172.21.15.81:0/3151991449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44a75d0 0x5620b44a7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f632f59e640 1 -- 172.21.15.81:0/3151991449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44a75d0 msgr2=0x5620b44a7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:01.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f632f59e640 1 --2- 172.21.15.81:0/3151991449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44a75d0 0x5620b44a7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f632f59e640 1 -- 172.21.15.81:0/3151991449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a8b40 msgr2=0x5620b44a7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:01.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f632f59e640 1 --2- 172.21.15.81:0/3151991449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a8b40 0x5620b44a7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f632f59e640 1 -- 172.21.15.81:0/3151991449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620b43993a0 con 0x5620b44b2370 2024-09-12T01:32:01.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f632f59e640 1 --2- 172.21.15.81:0/3151991449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44b2370 0x5620b44b4760 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f632800b830 tx=0x7f6328009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d712785e9ef5e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:01.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.919+0000 7f632e59c640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f63180a2cf0 0x7f63180a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f632400ff50 tx=0x7f632406d9d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:01.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.920+0000 7f63157fa640 1 -- 172.21.15.81:0/3151991449 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632800b260 con 0x5620b44b2370 2024-09-12T01:32:01.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.920+0000 7f63157fa640 1 -- 172.21.15.81:0/3151991449 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6328008ca0 con 0x5620b44b2370 2024-09-12T01:32:01.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.920+0000 7f63157fa640 1 -- 172.21.15.81:0/3151991449 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632800ac10 con 0x5620b44b2370 2024-09-12T01:32:01.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.920+0000 7f6337561740 1 -- 172.21.15.81:0/3151991449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44b2370 msgr2=0x5620b44b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:01.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.920+0000 7f6337561740 1 --2- 172.21.15.81:0/3151991449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44b2370 0x5620b44b4760 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f632800b830 tx=0x7f6328009c30 comp rx=0 tx=0).stop 2024-09-12T01:32:01.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.920+0000 7f6337561740 1 -- 172.21.15.81:0/3151991449 shutdown_connections 2024-09-12T01:32:01.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.920+0000 7f6337561740 1 --2- 172.21.15.81:0/3151991449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44b2370 0x5620b44b4760 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.920+0000 7f6337561740 1 --2- 172.21.15.81:0/3151991449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44a75d0 0x5620b44a7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.920+0000 7f6337561740 1 --2- 172.21.15.81:0/3151991449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a8b40 0x5620b44a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.920+0000 7f6337561740 1 -- 172.21.15.81:0/3151991449 >> 172.21.15.81:0/3151991449 conn(0x5620b4470310 msgr2=0x5620b44a3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:01.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.920+0000 7f6337561740 1 -- 172.21.15.81:0/3151991449 shutdown_connections 2024-09-12T01:32:01.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.920+0000 7f6337561740 1 -- 172.21.15.81:0/3151991449 wait complete. 2024-09-12T01:32:01.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f6337561740 1 -- start start 2024-09-12T01:32:01.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f6337561740 1 Processor -- start 2024-09-12T01:32:01.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f6337561740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a75d0 0x5620b44b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f6337561740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 0x5620b44aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f6337561740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44b2370 0x5620b44af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f6337561740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5620b44b5070 con 0x5620b44a8b40 2024-09-12T01:32:01.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f6337561740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5620b43c8060 con 0x5620b44a75d0 2024-09-12T01:32:01.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f6337561740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5620b44b51f0 con 0x5620b44b2370 2024-09-12T01:32:01.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f6337561740 10 client.0 _ll_register_callbacks cb 0x5620b411b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:01.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f632ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 0x5620b44aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f632ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 0x5620b44aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36334/0 (socket says 172.21.15.81:36334) 2024-09-12T01:32:01.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f632ed9d640 1 -- 172.21.15.81:0/931807873 learned_addr learned my addr 172.21.15.81:0/931807873 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:01.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f632f59e640 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a75d0 0x5620b44b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f632f59e640 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44b2370 0x5620b44af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f632ed9d640 1 -- 172.21.15.81:0/931807873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44b2370 msgr2=0x5620b44af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f632ed9d640 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44b2370 0x5620b44af5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f632ed9d640 1 -- 172.21.15.81:0/931807873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a75d0 msgr2=0x5620b44b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f632ed9d640 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a75d0 0x5620b44b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f632ed9d640 1 -- 172.21.15.81:0/931807873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620b417e3c0 con 0x5620b44a8b40 2024-09-12T01:32:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.921+0000 7f632f59e640 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44b2370 0x5620b44af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f632ed9d640 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 0x5620b44aeff0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6320009900 tx=0x7f63200318b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56f4c33462cd6a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6312ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:01.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6312ff5640 1 -- 172.21.15.81:0/931807873 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320035040 con 0x5620b44a8b40 2024-09-12T01:32:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6312ff5640 1 -- 172.21.15.81:0/931807873 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f6320004240 con 0x5620b44a8b40 2024-09-12T01:32:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6337561740 1 -- 172.21.15.81:0/931807873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6328008ca0 con 0x5620b44a8b40 2024-09-12T01:32:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6312ff5640 1 -- 172.21.15.81:0/931807873 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6320004440 con 0x5620b44a8b40 2024-09-12T01:32:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6337561740 10 client.16377 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6337561740 1 -- 172.21.15.81:0/931807873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620b44c0ae0 con 0x5620b44a8b40 2024-09-12T01:32:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6312ff5640 1 -- 172.21.15.81:0/931807873 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6328008ca0 con 0x5620b44a8b40 2024-09-12T01:32:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6312ff5640 1 -- 172.21.15.81:0/931807873 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6320045750 con 0x5620b44a8b40 2024-09-12T01:32:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6337561740 10 client.16377 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6337561740 10 client.16377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6337561740 20 client.16377 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6337561740 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5620b44c1ff0 0x5620b44c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6337561740 4 client.16377 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:32:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.922+0000 7f6337561740 1 -- 172.21.15.81:0/931807873 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620b441a860 con 0x5620b44c1ff0 2024-09-12T01:32:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.923+0000 7f632f59e640 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5620b44c1ff0 0x5620b44c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.923+0000 7f6312ff5640 10 client.16377 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.923+0000 7f632f59e640 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5620b44c1ff0 0x5620b44c4430 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42dd7c2daa9278d6 server_cookie=76f5c0c624b10f26 in_seq=0 out_seq=0 2024-09-12T01:32:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6312ff5640 1 -- 172.21.15.81:0/931807873 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620b441a860 con 0x5620b44c1ff0 2024-09-12T01:32:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6312ff5640 10 client.16377 handle_command_reply: tid=0 2024-09-12T01:32:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6337561740 1 client.16377 shutdown 2024-09-12T01:32:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6337561740 1 -- 172.21.15.81:0/931807873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 msgr2=0x5620b44aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6337561740 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 0x5620b44aeff0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6320009900 tx=0x7f63200318b0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6337561740 1 -- 172.21.15.81:0/931807873 shutdown_connections 2024-09-12T01:32:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6337561740 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5620b44c1ff0 0x5620b44c4430 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6337561740 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44b2370 0x5620b44af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6337561740 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 0x5620b44aeff0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6312ff5640 0 client.16377 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6337561740 1 --2- 172.21.15.81:0/931807873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a75d0 0x5620b44b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6337561740 1 -- 172.21.15.81:0/931807873 >> 172.21.15.81:0/931807873 conn(0x5620b4470310 msgr2=0x5620b44a9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6337561740 1 -- 172.21.15.81:0/931807873 shutdown_connections 2024-09-12T01:32:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6337561740 1 -- 172.21.15.81:0/931807873 wait complete. 2024-09-12T01:32:01.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.924+0000 7f6337561740 20 client.16377 trim_cache size 0 max 16384 2024-09-12T01:32:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f6337561740 1 Processor -- start 2024-09-12T01:32:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f6337561740 1 -- start start 2024-09-12T01:32:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f6337561740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44a75d0 0x5620b44be310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f6337561740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 0x5620b44b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f6337561740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44b2370 0x5620b44c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f6337561740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63301ad810 con 0x5620b44a8b40 2024-09-12T01:32:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f6337561740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63301af350 con 0x5620b44b2370 2024-09-12T01:32:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f6337561740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f63301adee0 con 0x5620b44a75d0 2024-09-12T01:32:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f632ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 0x5620b44b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f632ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 0x5620b44b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36344/0 (socket says 172.21.15.81:36344) 2024-09-12T01:32:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f632ed9d640 1 -- 172.21.15.81:0/1124334594 learned_addr learned my addr 172.21.15.81:0/1124334594 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f632f59e640 1 --2- 172.21.15.81:0/1124334594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44a75d0 0x5620b44be310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f632f59e640 1 --2- 172.21.15.81:0/1124334594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44b2370 0x5620b44c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f632ed9d640 1 -- 172.21.15.81:0/1124334594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44a75d0 msgr2=0x5620b44be310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f632ed9d640 1 --2- 172.21.15.81:0/1124334594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44a75d0 0x5620b44be310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f632ed9d640 1 -- 172.21.15.81:0/1124334594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44b2370 msgr2=0x5620b44c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f632ed9d640 1 --2- 172.21.15.81:0/1124334594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44b2370 0x5620b44c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f632ed9d640 1 -- 172.21.15.81:0/1124334594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620b44c4ab0 con 0x5620b44a8b40 2024-09-12T01:32:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f632f59e640 1 --2- 172.21.15.81:0/1124334594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44a75d0 0x5620b44be310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.937+0000 7f632ed9d640 1 --2- 172.21.15.81:0/1124334594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 0x5620b44b0f60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6320045d10 tx=0x7f632002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75d959a649e1770 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.938+0000 7f6314ff9640 1 -- 172.21.15.81:0/1124334594 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632005a070 con 0x5620b44a8b40 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.938+0000 7f6314ff9640 1 -- 172.21.15.81:0/1124334594 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f632003cb50 con 0x5620b44a8b40 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.938+0000 7f6314ff9640 1 -- 172.21.15.81:0/1124334594 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320035030 con 0x5620b44a8b40 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.938+0000 7f6337561740 1 -- 172.21.15.81:0/1124334594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 msgr2=0x5620b44b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.938+0000 7f6337561740 1 --2- 172.21.15.81:0/1124334594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 0x5620b44b0f60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6320045d10 tx=0x7f632002a410 comp rx=0 tx=0).stop 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.938+0000 7f6337561740 1 -- 172.21.15.81:0/1124334594 shutdown_connections 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.938+0000 7f6337561740 1 --2- 172.21.15.81:0/1124334594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44b2370 0x5620b44c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.938+0000 7f6337561740 1 --2- 172.21.15.81:0/1124334594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a8b40 0x5620b44b0f60 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.938+0000 7f6337561740 1 --2- 172.21.15.81:0/1124334594 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44a75d0 0x5620b44be310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.938+0000 7f6337561740 1 -- 172.21.15.81:0/1124334594 >> 172.21.15.81:0/1124334594 conn(0x5620b4470310 msgr2=0x5620b44b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.938+0000 7f6337561740 1 -- 172.21.15.81:0/1124334594 shutdown_connections 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.938+0000 7f6337561740 1 -- 172.21.15.81:0/1124334594 wait complete. 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f6337561740 1 -- start start 2024-09-12T01:32:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f6337561740 1 Processor -- start 2024-09-12T01:32:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f6337561740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a75d0 0x5620b44ba480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f6337561740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a8b40 0x5620b44ba9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f6337561740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44b2370 0x5620b44b7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f6337561740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63301aec80 con 0x5620b44a75d0 2024-09-12T01:32:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f6337561740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63301ae5b0 con 0x5620b44a8b40 2024-09-12T01:32:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f6337561740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f63301ab7f0 con 0x5620b44b2370 2024-09-12T01:32:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f6337561740 10 client.0 _ll_register_callbacks cb 0x7f6320005d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f632f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a75d0 0x5620b44ba480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f632f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a75d0 0x5620b44ba480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36356/0 (socket says 172.21.15.81:36356) 2024-09-12T01:32:01.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f632f59e640 1 -- 172.21.15.81:0/1333071829 learned_addr learned my addr 172.21.15.81:0/1333071829 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:01.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f632ed9d640 1 --2- 172.21.15.81:0/1333071829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a8b40 0x5620b44ba9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f632f59e640 1 --2- 172.21.15.81:0/1333071829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44b2370 0x5620b44b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f632f59e640 1 -- 172.21.15.81:0/1333071829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44b2370 msgr2=0x5620b44b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:01.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f632f59e640 1 --2- 172.21.15.81:0/1333071829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44b2370 0x5620b44b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f632f59e640 1 -- 172.21.15.81:0/1333071829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a8b40 msgr2=0x5620b44ba9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:01.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f632f59e640 1 --2- 172.21.15.81:0/1333071829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a8b40 0x5620b44ba9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.939+0000 7f632f59e640 1 -- 172.21.15.81:0/1333071829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620b44b7990 con 0x5620b44a75d0 2024-09-12T01:32:01.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f632f59e640 1 --2- 172.21.15.81:0/1333071829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a75d0 0x5620b44ba480 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f63280094c0 tx=0x7f632801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428a7fef9b81d495 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:01.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6312ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:01.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6312ff5640 1 -- 172.21.15.81:0/1333071829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328035060 con 0x5620b44a75d0 2024-09-12T01:32:01.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6312ff5640 1 -- 172.21.15.81:0/1333071829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f632800b260 con 0x5620b44a75d0 2024-09-12T01:32:01.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6337561740 1 -- 172.21.15.81:0/1333071829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f632003cb50 con 0x5620b44a75d0 2024-09-12T01:32:01.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6312ff5640 1 -- 172.21.15.81:0/1333071829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f63280087c0 con 0x5620b44a75d0 2024-09-12T01:32:01.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6337561740 10 client.16383 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:01.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6337561740 1 -- 172.21.15.81:0/1333071829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620b4531770 con 0x5620b44a75d0 2024-09-12T01:32:01.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6312ff5640 1 -- 172.21.15.81:0/1333071829 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f632003cb50 con 0x5620b44a75d0 2024-09-12T01:32:01.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6312ff5640 1 -- 172.21.15.81:0/1333071829 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f632802f040 con 0x5620b44a75d0 2024-09-12T01:32:01.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6337561740 10 client.16383 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6337561740 10 client.16383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6337561740 20 client.16383 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6337561740 1 --2- 172.21.15.81:0/1333071829 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5620b4531d00 0x5620b45340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6337561740 4 client.16383 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:32:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.940+0000 7f6337561740 1 -- 172.21.15.81:0/1333071829 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5620b4414d70 con 0x5620b4531d00 2024-09-12T01:32:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f632ed9d640 1 --2- 172.21.15.81:0/1333071829 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5620b4531d00 0x5620b45340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:01.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f632ed9d640 1 --2- 172.21.15.81:0/1333071829 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5620b4531d00 0x5620b45340f0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b26327564dcd66ad server_cookie=fd697aee3a696a84 in_seq=0 out_seq=0 2024-09-12T01:32:01.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6312ff5640 10 client.16383 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:01.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6312ff5640 1 -- 172.21.15.81:0/1333071829 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5620b4414d70 con 0x5620b4531d00 2024-09-12T01:32:01.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6312ff5640 10 client.16383 handle_command_reply: tid=0 2024-09-12T01:32:01.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6337561740 1 client.16383 shutdown 2024-09-12T01:32:01.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6337561740 1 -- 172.21.15.81:0/1333071829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a75d0 msgr2=0x5620b44ba480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:01.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6337561740 1 --2- 172.21.15.81:0/1333071829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a75d0 0x5620b44ba480 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f63280094c0 tx=0x7f632801c040 comp rx=0 tx=0).stop 2024-09-12T01:32:01.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6337561740 1 -- 172.21.15.81:0/1333071829 shutdown_connections 2024-09-12T01:32:01.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6337561740 1 --2- 172.21.15.81:0/1333071829 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5620b4531d00 0x5620b45340f0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6337561740 1 --2- 172.21.15.81:0/1333071829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620b44b2370 0x5620b44b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6337561740 1 --2- 172.21.15.81:0/1333071829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620b44a8b40 0x5620b44ba9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6337561740 1 --2- 172.21.15.81:0/1333071829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620b44a75d0 0x5620b44ba480 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6337561740 1 -- 172.21.15.81:0/1333071829 >> 172.21.15.81:0/1333071829 conn(0x5620b4470310 msgr2=0x5620b44a9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:01.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6312ff5640 0 client.16383 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:01.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.941+0000 7f6337561740 1 -- 172.21.15.81:0/1333071829 shutdown_connections 2024-09-12T01:32:01.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6337561740 1 -- 172.21.15.81:0/1333071829 wait complete. 2024-09-12T01:32:01.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6337561740 20 client.16383 trim_cache size 0 max 16384 2024-09-12T01:32:01.952 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:32:01.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6335188640 1 -- 172.21.15.81:0/1498685462 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f63180a2cf0 msgr2=0x7f63180a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:01.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6335188640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f63180a2cf0 0x7f63180a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f632400ff50 tx=0x7f632406d9d0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6335188640 1 -- 172.21.15.81:0/1498685462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6330102790 msgr2=0x7f6330198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:01.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6335188640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6330102790 0x7f6330198910 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f632400c920 tx=0x7f632400cde0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6335188640 1 -- 172.21.15.81:0/1498685462 shutdown_connections 2024-09-12T01:32:01.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6335188640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f63180a2cf0 0x7f63180a51b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6335188640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6330106f10 0x7f633019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6335188640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6330102790 0x7f6330198910 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6335188640 1 --2- 172.21.15.81:0/1498685462 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6330101de0 0x7f63301983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:01.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6335188640 1 -- 172.21.15.81:0/1498685462 >> 172.21.15.81:0/1498685462 conn(0x7f63300fd8c0 msgr2=0x7f63300fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:01.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6335188640 1 -- 172.21.15.81:0/1498685462 shutdown_connections 2024-09-12T01:32:01.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:01.942+0000 7f6335188640 1 -- 172.21.15.81:0/1498685462 wait complete. 2024-09-12T01:32:03.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:02 smithi081 ceph-mon[30920]: pgmap v122: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:32:03.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:02 smithi100 ceph-mon[35275]: pgmap v122: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:32:03.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:02 smithi189 ceph-mon[35357]: pgmap v122: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:32:03.817 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:32:03.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:32:04.077 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:32:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.540+0000 7ff19f340640 1 -- 172.21.15.81:0/3346672442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff198101de0 msgr2=0x7ff1981021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.540+0000 7ff19f340640 1 --2- 172.21.15.81:0/3346672442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff198101de0 0x7ff1981021c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009900 tx=0x7ff18c02a410 comp rx=0 tx=0).stop 2024-09-12T01:32:04.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.540+0000 7ff19f340640 1 -- 172.21.15.81:0/3346672442 shutdown_connections 2024-09-12T01:32:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.540+0000 7ff19f340640 1 --2- 172.21.15.81:0/3346672442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff198106f10 0x7ff19810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.540+0000 7ff19f340640 1 --2- 172.21.15.81:0/3346672442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff198102790 0x7ff1981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.540+0000 7ff19f340640 1 --2- 172.21.15.81:0/3346672442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff198101de0 0x7ff1981021c0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.540+0000 7ff19f340640 1 -- 172.21.15.81:0/3346672442 >> 172.21.15.81:0/3346672442 conn(0x7ff1980fd8c0 msgr2=0x7ff1980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.541+0000 7ff19f340640 1 -- 172.21.15.81:0/3346672442 shutdown_connections 2024-09-12T01:32:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.541+0000 7ff19f340640 1 -- 172.21.15.81:0/3346672442 wait complete. 2024-09-12T01:32:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.541+0000 7ff19f340640 1 Processor -- start 2024-09-12T01:32:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.541+0000 7ff19f340640 1 -- start start 2024-09-12T01:32:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.541+0000 7ff19f340640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff198101de0 0x7ff1980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.541+0000 7ff19f340640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff198102790 0x7ff198074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.541+0000 7ff19f340640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff198106f10 0x7ff198074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.541+0000 7ff19f340640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff198111f70 con 0x7ff198102790 2024-09-12T01:32:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.541+0000 7ff19f340640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff198111df0 con 0x7ff198101de0 2024-09-12T01:32:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.541+0000 7ff19f340640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1981120f0 con 0x7ff198106f10 2024-09-12T01:32:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.541+0000 7ff19c8db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff198102790 0x7ff198074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.541+0000 7ff19c8db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff198102790 0x7ff198074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51892/0 (socket says 172.21.15.81:51892) 2024-09-12T01:32:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.541+0000 7ff19c8db640 1 -- 172.21.15.81:0/2711403039 learned_addr learned my addr 172.21.15.81:0/2711403039 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff19d8dd640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff198106f10 0x7ff198074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff198101de0 0x7ff1980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff19c8db640 1 -- 172.21.15.81:0/2711403039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff198106f10 msgr2=0x7ff198074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff19c8db640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff198106f10 0x7ff198074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff19c8db640 1 -- 172.21.15.81:0/2711403039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff198101de0 msgr2=0x7ff1980744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff19c8db640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff198101de0 0x7ff1980744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff19c8db640 1 -- 172.21.15.81:0/2711403039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1981a6890 con 0x7ff198102790 2024-09-12T01:32:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff19d8dd640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff198106f10 0x7ff198074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff198101de0 0x7ff1980744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff19c8db640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff198102790 0x7ff198074a30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff19400c890 tx=0x7ff19400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff18a7fc640 1 -- 172.21.15.81:0/2711403039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194004220 con 0x7ff198102790 2024-09-12T01:32:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff19f340640 1 -- 172.21.15.81:0/2711403039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1981a6b80 con 0x7ff198102790 2024-09-12T01:32:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff18a7fc640 1 -- 172.21.15.81:0/2711403039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1940043c0 con 0x7ff198102790 2024-09-12T01:32:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff18a7fc640 1 -- 172.21.15.81:0/2711403039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194004a00 con 0x7ff198102790 2024-09-12T01:32:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.542+0000 7ff19f340640 1 -- 172.21.15.81:0/2711403039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1981a7110 con 0x7ff198102790 2024-09-12T01:32:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.544+0000 7ff18a7fc640 1 -- 172.21.15.81:0/2711403039 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff1940079b0 con 0x7ff198102790 2024-09-12T01:32:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.545+0000 7ff1a1719740 1 Processor -- start 2024-09-12T01:32:04.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.545+0000 7ff1a1719740 1 -- start start 2024-09-12T01:32:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.545+0000 7ff1a1719740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 0x5640f7a70f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.545+0000 7ff1a1719740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 0x5640f7a7b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.545+0000 7ff1a1719740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a7bd40 0x5640f7a7e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.545+0000 7ff1a1719740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5640f79d6280 con 0x5640f7a71480 2024-09-12T01:32:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.545+0000 7ff1a1719740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5640f797db10 con 0x5640f7a7bd40 2024-09-12T01:32:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.545+0000 7ff1a1719740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5640f79d2240 con 0x5640f7a70b60 2024-09-12T01:32:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.545+0000 7ff19d0dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 0x5640f7a7b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.545+0000 7ff18a7fc640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1840a2cf0 0x7ff1840a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.545+0000 7ff19d0dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 0x5640f7a7b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51896/0 (socket says 172.21.15.81:51896) 2024-09-12T01:32:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.545+0000 7ff19d0dc640 1 -- 172.21.15.81:0/2704359041 learned_addr learned my addr 172.21.15.81:0/2704359041 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff19d8dd640 1 --2- 172.21.15.81:0/2704359041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 0x5640f7a70f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff19d8dd640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1840a2cf0 0x7ff1840a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff18a7fc640 1 -- 172.21.15.81:0/2711403039 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff1940cf230 con 0x7ff198102790 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff19c8db640 1 --2- 172.21.15.81:0/2704359041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a7bd40 0x5640f7a7e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff19d0dc640 1 -- 172.21.15.81:0/2704359041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 msgr2=0x5640f7a70f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/2704359041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 0x5640f7a70f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff19d0dc640 1 -- 172.21.15.81:0/2704359041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a7bd40 msgr2=0x5640f7a7e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/2704359041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a7bd40 0x5640f7a7e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff19d0dc640 1 -- 172.21.15.81:0/2704359041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640f798a1f0 con 0x5640f7a71480 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/2704359041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 0x5640f7a7b800 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff18c000c00 tx=0x7ff18c032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895706a3bb8fee2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff19d8dd640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1840a2cf0 0x7ff1840a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff19000afd0 tx=0x7ff190005f90 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff1837fe640 1 -- 172.21.15.81:0/2704359041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c03f070 con 0x5640f7a71480 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff1837fe640 1 -- 172.21.15.81:0/2704359041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff18c0317b0 con 0x5640f7a71480 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.546+0000 7ff1837fe640 1 -- 172.21.15.81:0/2704359041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c035070 con 0x5640f7a71480 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.547+0000 7ff1a1719740 1 -- 172.21.15.81:0/2704359041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 msgr2=0x5640f7a7b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.547+0000 7ff1a1719740 1 --2- 172.21.15.81:0/2704359041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 0x5640f7a7b800 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff18c000c00 tx=0x7ff18c032d70 comp rx=0 tx=0).stop 2024-09-12T01:32:04.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.547+0000 7ff1a1719740 1 -- 172.21.15.81:0/2704359041 shutdown_connections 2024-09-12T01:32:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.547+0000 7ff1a1719740 1 --2- 172.21.15.81:0/2704359041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a7bd40 0x5640f7a7e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.547+0000 7ff1a1719740 1 --2- 172.21.15.81:0/2704359041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 0x5640f7a7b800 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.547+0000 7ff1a1719740 1 --2- 172.21.15.81:0/2704359041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 0x5640f7a70f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.547+0000 7ff1a1719740 1 -- 172.21.15.81:0/2704359041 >> 172.21.15.81:0/2704359041 conn(0x5640f7a6d0f0 msgr2=0x5640f7a6d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.547+0000 7ff1a1719740 1 -- 172.21.15.81:0/2704359041 shutdown_connections 2024-09-12T01:32:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.547+0000 7ff1a1719740 1 -- 172.21.15.81:0/2704359041 wait complete. 2024-09-12T01:32:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.547+0000 7ff1a1719740 1 -- start start 2024-09-12T01:32:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.547+0000 7ff1a1719740 1 Processor -- start 2024-09-12T01:32:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff1a1719740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 0x5640f7a7b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff1a1719740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a71480 0x5640f7a78b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff1a1719740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a7bd40 0x5640f7a79240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff1a1719740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5640f7a7e910 con 0x5640f7a7bd40 2024-09-12T01:32:04.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff1a1719740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5640f7990f10 con 0x5640f7a71480 2024-09-12T01:32:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff1a1719740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5640f7a7ea90 con 0x5640f7a70b60 2024-09-12T01:32:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff1a1719740 10 client.0 _ll_register_callbacks cb 0x5640f7959a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff19d8dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a7bd40 0x5640f7a79240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff19d8dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a7bd40 0x5640f7a79240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51900/0 (socket says 172.21.15.81:51900) 2024-09-12T01:32:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff19d8dd640 1 -- 172.21.15.81:0/3041203894 learned_addr learned my addr 172.21.15.81:0/3041203894 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff19c8db640 1 --2- 172.21.15.81:0/3041203894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a71480 0x5640f7a78b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/3041203894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 0x5640f7a7b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff19d8dd640 1 -- 172.21.15.81:0/3041203894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 msgr2=0x5640f7a7b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff19d8dd640 1 --2- 172.21.15.81:0/3041203894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 0x5640f7a7b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff19d8dd640 1 -- 172.21.15.81:0/3041203894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a71480 msgr2=0x5640f7a78b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff19d8dd640 1 --2- 172.21.15.81:0/3041203894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a71480 0x5640f7a78b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff19d8dd640 1 -- 172.21.15.81:0/3041203894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640f77476a0 con 0x5640f7a7bd40 2024-09-12T01:32:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff19d8dd640 1 --2- 172.21.15.81:0/3041203894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a7bd40 0x5640f7a79240 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff19000fa30 tx=0x7ff190004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfef7004818bc284 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.548+0000 7ff180ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff180ff9640 1 -- 172.21.15.81:0/3041203894 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff190022070 con 0x5640f7a7bd40 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff180ff9640 1 -- 172.21.15.81:0/3041203894 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff19000dd90 con 0x5640f7a7bd40 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff1a1719740 1 -- 172.21.15.81:0/3041203894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff18c0317b0 con 0x5640f7a7bd40 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff180ff9640 1 -- 172.21.15.81:0/3041203894 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff190027460 con 0x5640f7a7bd40 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff1a1719740 10 client.16395 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff1a1719740 1 -- 172.21.15.81:0/3041203894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640f7a8a490 con 0x5640f7a7bd40 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff180ff9640 1 -- 172.21.15.81:0/3041203894 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff18c0317b0 con 0x5640f7a7bd40 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff180ff9640 1 -- 172.21.15.81:0/3041203894 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff19001e530 con 0x5640f7a7bd40 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff1a1719740 10 client.16395 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff1a1719740 10 client.16395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff1a1719740 20 client.16395 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff1a1719740 1 --2- 172.21.15.81:0/3041203894 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5640f7a8b8a0 0x5640f7a8dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff1a1719740 4 client.16395 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:32:04.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.549+0000 7ff1a1719740 1 -- 172.21.15.81:0/3041203894 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640f79e37f0 con 0x5640f7a8b8a0 2024-09-12T01:32:04.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.550+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/3041203894 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5640f7a8b8a0 0x5640f7a8dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.550+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/3041203894 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5640f7a8b8a0 0x5640f7a8dd10 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c64306b19be775b server_cookie=90ebe8091bf00dcc in_seq=0 out_seq=0 2024-09-12T01:32:04.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.550+0000 7ff180ff9640 10 client.16395 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:04.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff180ff9640 1 -- 172.21.15.81:0/3041203894 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640f79e37f0 con 0x5640f7a8b8a0 2024-09-12T01:32:04.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff180ff9640 10 client.16395 handle_command_reply: tid=0 2024-09-12T01:32:04.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff1a1719740 1 client.16395 shutdown 2024-09-12T01:32:04.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff1a1719740 1 -- 172.21.15.81:0/3041203894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a7bd40 msgr2=0x5640f7a79240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:04.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff1a1719740 1 --2- 172.21.15.81:0/3041203894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a7bd40 0x5640f7a79240 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff19000fa30 tx=0x7ff190004a40 comp rx=0 tx=0).stop 2024-09-12T01:32:04.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff1a1719740 1 -- 172.21.15.81:0/3041203894 shutdown_connections 2024-09-12T01:32:04.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff1a1719740 1 --2- 172.21.15.81:0/3041203894 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5640f7a8b8a0 0x5640f7a8dd10 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff1a1719740 1 --2- 172.21.15.81:0/3041203894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a7bd40 0x5640f7a79240 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff1a1719740 1 --2- 172.21.15.81:0/3041203894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a71480 0x5640f7a78b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff1a1719740 1 --2- 172.21.15.81:0/3041203894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 0x5640f7a7b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff1a1719740 1 -- 172.21.15.81:0/3041203894 >> 172.21.15.81:0/3041203894 conn(0x5640f7a6d0f0 msgr2=0x5640f7a6c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:04.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff180ff9640 0 client.16395 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:04.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff1a1719740 1 -- 172.21.15.81:0/3041203894 shutdown_connections 2024-09-12T01:32:04.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff1a1719740 1 -- 172.21.15.81:0/3041203894 wait complete. 2024-09-12T01:32:04.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.551+0000 7ff1a1719740 20 client.16395 trim_cache size 0 max 16384 2024-09-12T01:32:04.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.568+0000 7ff1a1719740 1 Processor -- start 2024-09-12T01:32:04.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.568+0000 7ff1a1719740 1 -- start start 2024-09-12T01:32:04.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.568+0000 7ff1a1719740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a70b60 0x5640f7a735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.568+0000 7ff1a1719740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a71480 0x5640f7a87ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.568+0000 7ff1a1719740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a7bd40 0x5640f7a935e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.568+0000 7ff1a1719740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1981af9e0 con 0x5640f7a70b60 2024-09-12T01:32:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.568+0000 7ff1a1719740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff1981b1520 con 0x5640f7a71480 2024-09-12T01:32:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.568+0000 7ff1a1719740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1981b00b0 con 0x5640f7a7bd40 2024-09-12T01:32:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.568+0000 7ff19d0dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a70b60 0x5640f7a735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff19d0dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a70b60 0x5640f7a735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51906/0 (socket says 172.21.15.81:51906) 2024-09-12T01:32:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff19d0dc640 1 -- 172.21.15.81:0/3549850057 learned_addr learned my addr 172.21.15.81:0/3549850057 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff19d8dd640 1 --2- 172.21.15.81:0/3549850057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a7bd40 0x5640f7a935e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff19c8db640 1 --2- 172.21.15.81:0/3549850057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a71480 0x5640f7a87ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff19d0dc640 1 -- 172.21.15.81:0/3549850057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a7bd40 msgr2=0x5640f7a935e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/3549850057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a7bd40 0x5640f7a935e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff19d0dc640 1 -- 172.21.15.81:0/3549850057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a71480 msgr2=0x5640f7a87ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/3549850057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a71480 0x5640f7a87ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff19d0dc640 1 -- 172.21.15.81:0/3549850057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640f7a712b0 con 0x5640f7a70b60 2024-09-12T01:32:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff19d8dd640 1 --2- 172.21.15.81:0/3549850057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a7bd40 0x5640f7a935e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/3549850057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a70b60 0x5640f7a735c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff18c000c00 tx=0x7ff18c005370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a4aa6044ca6250 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff182ffd640 1 -- 172.21.15.81:0/3549850057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c03f040 con 0x5640f7a70b60 2024-09-12T01:32:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff182ffd640 1 -- 172.21.15.81:0/3549850057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff18c031c50 con 0x5640f7a70b60 2024-09-12T01:32:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.569+0000 7ff182ffd640 1 -- 172.21.15.81:0/3549850057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c035040 con 0x5640f7a70b60 2024-09-12T01:32:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.570+0000 7ff1a1719740 1 -- 172.21.15.81:0/3549850057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a70b60 msgr2=0x5640f7a735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.570+0000 7ff1a1719740 1 --2- 172.21.15.81:0/3549850057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a70b60 0x5640f7a735c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff18c000c00 tx=0x7ff18c005370 comp rx=0 tx=0).stop 2024-09-12T01:32:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.570+0000 7ff1a1719740 1 -- 172.21.15.81:0/3549850057 shutdown_connections 2024-09-12T01:32:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.570+0000 7ff1a1719740 1 --2- 172.21.15.81:0/3549850057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a7bd40 0x5640f7a935e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.570+0000 7ff1a1719740 1 --2- 172.21.15.81:0/3549850057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a71480 0x5640f7a87ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.570+0000 7ff1a1719740 1 --2- 172.21.15.81:0/3549850057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a70b60 0x5640f7a735c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.570+0000 7ff1a1719740 1 -- 172.21.15.81:0/3549850057 >> 172.21.15.81:0/3549850057 conn(0x5640f7a6d0f0 msgr2=0x5640f7a77bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.570+0000 7ff1a1719740 1 -- 172.21.15.81:0/3549850057 shutdown_connections 2024-09-12T01:32:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.570+0000 7ff1a1719740 1 -- 172.21.15.81:0/3549850057 wait complete. 2024-09-12T01:32:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.570+0000 7ff1a1719740 1 -- start start 2024-09-12T01:32:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.570+0000 7ff1a1719740 1 Processor -- start 2024-09-12T01:32:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff1a1719740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 0x5640f7a83d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff1a1719740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 0x5640f7a84250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff1a1719740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a7bd40 0x5640f7a80ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff1a1719740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1981b0e50 con 0x5640f7a71480 2024-09-12T01:32:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff1a1719740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff1981b0780 con 0x5640f7a7bd40 2024-09-12T01:32:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff1a1719740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1981ad9c0 con 0x5640f7a70b60 2024-09-12T01:32:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff1a1719740 10 client.0 _ll_register_callbacks cb 0x7ff190012f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff19c8db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 0x5640f7a84250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff19c8db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 0x5640f7a84250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51914/0 (socket says 172.21.15.81:51914) 2024-09-12T01:32:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff19c8db640 1 -- 172.21.15.81:0/1662806933 learned_addr learned my addr 172.21.15.81:0/1662806933 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff19d8dd640 1 --2- 172.21.15.81:0/1662806933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a7bd40 0x5640f7a80ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/1662806933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 0x5640f7a83d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff19c8db640 1 -- 172.21.15.81:0/1662806933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 msgr2=0x5640f7a83d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff19c8db640 1 --2- 172.21.15.81:0/1662806933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 0x5640f7a83d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff19c8db640 1 -- 172.21.15.81:0/1662806933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a7bd40 msgr2=0x5640f7a80ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff19c8db640 1 --2- 172.21.15.81:0/1662806933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a7bd40 0x5640f7a80ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff19c8db640 1 -- 172.21.15.81:0/1662806933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640f7a81250 con 0x5640f7a71480 2024-09-12T01:32:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff19c8db640 1 --2- 172.21.15.81:0/1662806933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 0x5640f7a84250 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ff194000c00 tx=0x7ff19409b080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fc346129b7d08c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff180ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff180ff9640 1 -- 172.21.15.81:0/1662806933 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1940b3020 con 0x5640f7a71480 2024-09-12T01:32:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff180ff9640 1 -- 172.21.15.81:0/1662806933 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7ff1940ccbd0 con 0x5640f7a71480 2024-09-12T01:32:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.571+0000 7ff1a1719740 1 -- 172.21.15.81:0/1662806933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff18c031c50 con 0x5640f7a71480 2024-09-12T01:32:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.572+0000 7ff180ff9640 1 -- 172.21.15.81:0/1662806933 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff19401d040 con 0x5640f7a71480 2024-09-12T01:32:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.572+0000 7ff1a1719740 10 client.16401 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.572+0000 7ff1a1719740 1 -- 172.21.15.81:0/1662806933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640f7af6dd0 con 0x5640f7a71480 2024-09-12T01:32:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.572+0000 7ff180ff9640 1 -- 172.21.15.81:0/1662806933 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff18c031c50 con 0x5640f7a71480 2024-09-12T01:32:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.572+0000 7ff180ff9640 1 -- 172.21.15.81:0/1662806933 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff19409ac00 con 0x5640f7a71480 2024-09-12T01:32:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.572+0000 7ff1a1719740 10 client.16401 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.572+0000 7ff1a1719740 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.572+0000 7ff1a1719740 20 client.16401 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.572+0000 7ff1a1719740 1 --2- 172.21.15.81:0/1662806933 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5640f7af75f0 0x5640f7af9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.572+0000 7ff1a1719740 4 client.16401 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:32:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.572+0000 7ff1a1719740 1 -- 172.21.15.81:0/1662806933 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5640f79ddd00 con 0x5640f7af75f0 2024-09-12T01:32:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.572+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/1662806933 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5640f7af75f0 0x5640f7af9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.573+0000 7ff180ff9640 10 client.16401 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.573+0000 7ff19d0dc640 1 --2- 172.21.15.81:0/1662806933 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5640f7af75f0 0x5640f7af9a10 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b0b77782f759cea server_cookie=3bd2935c8c47aee6 in_seq=0 out_seq=0 2024-09-12T01:32:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff180ff9640 1 -- 172.21.15.81:0/1662806933 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5640f79ddd00 con 0x5640f7af75f0 2024-09-12T01:32:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff180ff9640 10 client.16401 handle_command_reply: tid=0 2024-09-12T01:32:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff1a1719740 1 client.16401 shutdown 2024-09-12T01:32:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff1a1719740 1 -- 172.21.15.81:0/1662806933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 msgr2=0x5640f7a84250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff1a1719740 1 --2- 172.21.15.81:0/1662806933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 0x5640f7a84250 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ff194000c00 tx=0x7ff19409b080 comp rx=0 tx=0).stop 2024-09-12T01:32:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff1a1719740 1 -- 172.21.15.81:0/1662806933 shutdown_connections 2024-09-12T01:32:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff1a1719740 1 --2- 172.21.15.81:0/1662806933 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5640f7af75f0 0x5640f7af9a10 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff1a1719740 1 --2- 172.21.15.81:0/1662806933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640f7a7bd40 0x5640f7a80ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff1a1719740 1 --2- 172.21.15.81:0/1662806933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5640f7a71480 0x5640f7a84250 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff1a1719740 1 --2- 172.21.15.81:0/1662806933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640f7a70b60 0x5640f7a83d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff1a1719740 1 -- 172.21.15.81:0/1662806933 >> 172.21.15.81:0/1662806933 conn(0x5640f7a6d0f0 msgr2=0x5640f7a6ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff180ff9640 0 client.16401 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff1a1719740 1 -- 172.21.15.81:0/1662806933 shutdown_connections 2024-09-12T01:32:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff1a1719740 1 -- 172.21.15.81:0/1662806933 wait complete. 2024-09-12T01:32:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.574+0000 7ff1a1719740 20 client.16401 trim_cache size 0 max 16384 2024-09-12T01:32:04.581 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:32:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:32:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "f4b54088-a419-4293-b560-ea67cb6f05e0", 2024-09-12T01:32:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:32:04.581 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:32:04.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.575+0000 7ff19f340640 1 -- 172.21.15.81:0/2711403039 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1840a2cf0 msgr2=0x7ff1840a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:04.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.575+0000 7ff19f340640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1840a2cf0 0x7ff1840a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff19000afd0 tx=0x7ff190005f90 comp rx=0 tx=0).stop 2024-09-12T01:32:04.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.575+0000 7ff19f340640 1 -- 172.21.15.81:0/2711403039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff198102790 msgr2=0x7ff198074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:04.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.575+0000 7ff19f340640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff198102790 0x7ff198074a30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff19400c890 tx=0x7ff19400cd50 comp rx=0 tx=0).stop 2024-09-12T01:32:04.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.575+0000 7ff19f340640 1 -- 172.21.15.81:0/2711403039 shutdown_connections 2024-09-12T01:32:04.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.575+0000 7ff19f340640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff1840a2cf0 0x7ff1840a51b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.575+0000 7ff19f340640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff198106f10 0x7ff198074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.575+0000 7ff19f340640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff198102790 0x7ff198074a30 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.575+0000 7ff19f340640 1 --2- 172.21.15.81:0/2711403039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff198101de0 0x7ff1980744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:04.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.575+0000 7ff19f340640 1 -- 172.21.15.81:0/2711403039 >> 172.21.15.81:0/2711403039 conn(0x7ff1980fd8c0 msgr2=0x7ff1980febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:04.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.575+0000 7ff19f340640 1 -- 172.21.15.81:0/2711403039 shutdown_connections 2024-09-12T01:32:04.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:04.575+0000 7ff19f340640 1 -- 172.21.15.81:0/2711403039 wait complete. 2024-09-12T01:32:05.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:04 smithi081 ceph-mon[30920]: pgmap v123: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:32:05.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:04 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:32:05.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:04 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:32:05.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:04 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:32:05.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:04 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:32:05.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:04 smithi100 ceph-mon[35275]: pgmap v123: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:32:05.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:04 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:32:05.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:04 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:32:05.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:04 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:32:05.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:04 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:32:05.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:04 smithi189 ceph-mon[35357]: pgmap v123: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T01:32:05.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:04 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:32:05.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:04 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:32:05.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:04 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:32:05.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:04 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:32:05.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:32:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:32:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.071+0000 7f52e6d97640 1 -- 172.21.15.81:0/829836583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52e0102d40 msgr2=0x7f52e0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.071+0000 7f52e6d97640 1 --2- 172.21.15.81:0/829836583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52e0102d40 0x7f52e0103120 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009900 tx=0x7f52d402a480 comp rx=0 tx=0).stop 2024-09-12T01:32:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.071+0000 7f52e6d97640 1 -- 172.21.15.81:0/829836583 shutdown_connections 2024-09-12T01:32:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.071+0000 7f52e6d97640 1 --2- 172.21.15.81:0/829836583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e010c170 0x7f52e010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.071+0000 7f52e6d97640 1 --2- 172.21.15.81:0/829836583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52e0103660 0x7f52e010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.071+0000 7f52e6d97640 1 --2- 172.21.15.81:0/829836583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52e0102d40 0x7f52e0103120 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.071+0000 7f52e6d97640 1 -- 172.21.15.81:0/829836583 >> 172.21.15.81:0/829836583 conn(0x7f52e00fc7a0 msgr2=0x7f52e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.071+0000 7f52e6d97640 1 -- 172.21.15.81:0/829836583 shutdown_connections 2024-09-12T01:32:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.072+0000 7f52e6d97640 1 -- 172.21.15.81:0/829836583 wait complete. 2024-09-12T01:32:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.072+0000 7f52e6d97640 1 Processor -- start 2024-09-12T01:32:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.072+0000 7f52e6d97640 1 -- start start 2024-09-12T01:32:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.072+0000 7f52e6d97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52e0102d40 0x7f52e0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.072+0000 7f52e6d97640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e0103660 0x7f52e01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.072+0000 7f52e6d97640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52e010c170 0x7f52e019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.072+0000 7f52e6d97640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52e0111fb0 con 0x7f52e0102d40 2024-09-12T01:32:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.072+0000 7f52e6d97640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f52e0111e30 con 0x7f52e0103660 2024-09-12T01:32:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.072+0000 7f52e6d97640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52e0112130 con 0x7f52e010c170 2024-09-12T01:32:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.072+0000 7f52e4b33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52e0102d40 0x7f52e0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.072+0000 7f52e4b33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52e0102d40 0x7f52e0198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51944/0 (socket says 172.21.15.81:51944) 2024-09-12T01:32:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.072+0000 7f52e4b33640 1 -- 172.21.15.81:0/2862064170 learned_addr learned my addr 172.21.15.81:0/2862064170 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52e5334640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52e010c170 0x7f52e019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52dffff640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e0103660 0x7f52e01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52e4b33640 1 -- 172.21.15.81:0/2862064170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52e010c170 msgr2=0x7f52e019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52e4b33640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52e010c170 0x7f52e019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52e4b33640 1 -- 172.21.15.81:0/2862064170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e0103660 msgr2=0x7f52e01989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52e4b33640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e0103660 0x7f52e01989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52e4b33640 1 -- 172.21.15.81:0/2862064170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e019d440 con 0x7f52e0102d40 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52e5334640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52e010c170 0x7f52e019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52e4b33640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52e0102d40 0x7f52e0198490 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f52d4005ab0 tx=0x7f52d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52ddffb640 1 -- 172.21.15.81:0/2862064170 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d403f030 con 0x7f52e0102d40 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52ddffb640 1 -- 172.21.15.81:0/2862064170 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52d4003ce0 con 0x7f52e0102d40 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52e6d97640 1 -- 172.21.15.81:0/2862064170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e019d6d0 con 0x7f52e0102d40 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52ddffb640 1 -- 172.21.15.81:0/2862064170 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d4035070 con 0x7f52e0102d40 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.073+0000 7f52e6d97640 1 -- 172.21.15.81:0/2862064170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e01a5010 con 0x7f52e0102d40 2024-09-12T01:32:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52ddffb640 1 -- 172.21.15.81:0/2862064170 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f52d4042030 con 0x7f52e0102d40 2024-09-12T01:32:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52e9170740 1 Processor -- start 2024-09-12T01:32:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52e9170740 1 -- start start 2024-09-12T01:32:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52e9170740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb785314a0 0x55bb78531880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52e9170740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb78531dc0 0x55bb7853c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52e9170740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb7853c680 0x55bb7853ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52e9170740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bb784972e0 con 0x55bb7853c680 2024-09-12T01:32:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52e9170740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55bb7843ece0 con 0x55bb785314a0 2024-09-12T01:32:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52e9170740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bb784932a0 con 0x55bb78531dc0 2024-09-12T01:32:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52ddffb640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f52d00a2d70 0x7f52d00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb7853c680 0x55bb7853ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb7853c680 0x55bb7853ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51958/0 (socket says 172.21.15.81:51958) 2024-09-12T01:32:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52dffff640 1 -- 172.21.15.81:0/4007155639 learned_addr learned my addr 172.21.15.81:0/4007155639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.076+0000 7f52e5334640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f52d00a2d70 0x7f52d00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.077+0000 7f52ddffb640 1 -- 172.21.15.81:0/2862064170 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f52d40efd50 con 0x7f52e0102d40 2024-09-12T01:32:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.077+0000 7f52e5334640 1 --2- 172.21.15.81:0/4007155639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb785314a0 0x55bb78531880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.077+0000 7f52e4b33640 1 --2- 172.21.15.81:0/4007155639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb78531dc0 0x55bb7853c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.077+0000 7f52dffff640 1 -- 172.21.15.81:0/4007155639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb78531dc0 msgr2=0x55bb7853c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.077+0000 7f52dffff640 1 --2- 172.21.15.81:0/4007155639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb78531dc0 0x55bb7853c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.077+0000 7f52dffff640 1 -- 172.21.15.81:0/4007155639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb785314a0 msgr2=0x55bb78531880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.077+0000 7f52dffff640 1 --2- 172.21.15.81:0/4007155639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb785314a0 0x55bb78531880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.077+0000 7f52dffff640 1 -- 172.21.15.81:0/4007155639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb78423440 con 0x55bb7853c680 2024-09-12T01:32:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.077+0000 7f52dffff640 1 --2- 172.21.15.81:0/4007155639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb7853c680 0x55bb7853ea70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00cbb0 tx=0x7f52cc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd21e8a98611932 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.077+0000 7f52e5334640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f52d00a2d70 0x7f52d00a5230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009440 tx=0x7f52d8009e20 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.077+0000 7f52caffd640 1 -- 172.21.15.81:0/4007155639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc014070 con 0x55bb7853c680 2024-09-12T01:32:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.077+0000 7f52caffd640 1 -- 172.21.15.81:0/4007155639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52cc019b40 con 0x55bb7853c680 2024-09-12T01:32:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.077+0000 7f52caffd640 1 -- 172.21.15.81:0/4007155639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc010a30 con 0x55bb7853c680 2024-09-12T01:32:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.078+0000 7f52e9170740 1 -- 172.21.15.81:0/4007155639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb7853c680 msgr2=0x55bb7853ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.078+0000 7f52e9170740 1 --2- 172.21.15.81:0/4007155639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb7853c680 0x55bb7853ea70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00cbb0 tx=0x7f52cc00e720 comp rx=0 tx=0).stop 2024-09-12T01:32:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.078+0000 7f52e9170740 1 -- 172.21.15.81:0/4007155639 shutdown_connections 2024-09-12T01:32:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.078+0000 7f52e9170740 1 --2- 172.21.15.81:0/4007155639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb7853c680 0x55bb7853ea70 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.078+0000 7f52e9170740 1 --2- 172.21.15.81:0/4007155639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb78531dc0 0x55bb7853c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.078+0000 7f52e9170740 1 --2- 172.21.15.81:0/4007155639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb785314a0 0x55bb78531880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.078+0000 7f52e9170740 1 -- 172.21.15.81:0/4007155639 >> 172.21.15.81:0/4007155639 conn(0x55bb7852da30 msgr2=0x55bb7852de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.078+0000 7f52e9170740 1 -- 172.21.15.81:0/4007155639 shutdown_connections 2024-09-12T01:32:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.078+0000 7f52e9170740 1 -- 172.21.15.81:0/4007155639 wait complete. 2024-09-12T01:32:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.078+0000 7f52e9170740 1 -- start start 2024-09-12T01:32:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.078+0000 7f52e9170740 1 Processor -- start 2024-09-12T01:32:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e9170740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 0x55bb7853bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e9170740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb78531dc0 0x55bb785391e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e9170740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 0x55bb78539720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e9170740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bb7853f250 con 0x55bb785314a0 2024-09-12T01:32:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e9170740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55bb78452050 con 0x55bb78531dc0 2024-09-12T01:32:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e9170740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bb7853f3d0 con 0x55bb7853c680 2024-09-12T01:32:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e9170740 10 client.0 _ll_register_callbacks cb 0x55bb78492160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e4b33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 0x55bb7853bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e4b33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 0x55bb7853bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51964/0 (socket says 172.21.15.81:51964) 2024-09-12T01:32:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e4b33640 1 -- 172.21.15.81:0/3585906789 learned_addr learned my addr 172.21.15.81:0/3585906789 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52dffff640 1 --2- 172.21.15.81:0/3585906789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb78531dc0 0x55bb785391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e4b33640 1 -- 172.21.15.81:0/3585906789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 msgr2=0x55bb78539720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e4b33640 1 --2- 172.21.15.81:0/3585906789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 0x55bb78539720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e4b33640 1 -- 172.21.15.81:0/3585906789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb78531dc0 msgr2=0x55bb785391e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e4b33640 1 --2- 172.21.15.81:0/3585906789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb78531dc0 0x55bb785391e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e4b33640 1 -- 172.21.15.81:0/3585906789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb782083c0 con 0x55bb785314a0 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52e4b33640 1 --2- 172.21.15.81:0/3585906789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 0x55bb7853bf30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f52d40ed530 tx=0x7f52d4009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5cc0917d5ae1d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52bffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.079+0000 7f52bffff640 1 -- 172.21.15.81:0/3585906789 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d4049050 con 0x55bb785314a0 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52bffff640 1 -- 172.21.15.81:0/3585906789 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f52d40b8910 con 0x55bb785314a0 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52e9170740 1 -- 172.21.15.81:0/3585906789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52cc019b40 con 0x55bb785314a0 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52bffff640 1 -- 172.21.15.81:0/3585906789 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52d40bbc00 con 0x55bb785314a0 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52e9170740 10 client.16413 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52e9170740 1 -- 172.21.15.81:0/3585906789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb7854ab70 con 0x55bb785314a0 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52bffff640 1 -- 172.21.15.81:0/3585906789 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52cc019b40 con 0x55bb785314a0 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52bffff640 1 -- 172.21.15.81:0/3585906789 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f52d403b460 con 0x55bb785314a0 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52e9170740 10 client.16413 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52e9170740 10 client.16413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:06.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52e9170740 20 client.16413 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:06.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52e9170740 1 --2- 172.21.15.81:0/3585906789 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bb7854bf10 0x55bb7854e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52e9170740 4 client.16413 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:32:06.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52e9170740 1 -- 172.21.15.81:0/3585906789 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb784a4850 con 0x55bb7854bf10 2024-09-12T01:32:06.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.080+0000 7f52dffff640 1 --2- 172.21.15.81:0/3585906789 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bb7854bf10 0x55bb7854e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.081+0000 7f52bffff640 10 client.16413 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:06.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.081+0000 7f52dffff640 1 --2- 172.21.15.81:0/3585906789 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bb7854bf10 0x55bb7854e380 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b409f95f25a4e27 server_cookie=458c029cbfd024ac in_seq=0 out_seq=0 2024-09-12T01:32:06.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52bffff640 1 -- 172.21.15.81:0/3585906789 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bb784a4850 con 0x55bb7854bf10 2024-09-12T01:32:06.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52bffff640 10 client.16413 handle_command_reply: tid=0 2024-09-12T01:32:06.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52e9170740 1 client.16413 shutdown 2024-09-12T01:32:06.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52e9170740 1 -- 172.21.15.81:0/3585906789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 msgr2=0x55bb7853bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:06.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52e9170740 1 --2- 172.21.15.81:0/3585906789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 0x55bb7853bf30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f52d40ed530 tx=0x7f52d4009620 comp rx=0 tx=0).stop 2024-09-12T01:32:06.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52e9170740 1 -- 172.21.15.81:0/3585906789 shutdown_connections 2024-09-12T01:32:06.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52e9170740 1 --2- 172.21.15.81:0/3585906789 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bb7854bf10 0x55bb7854e380 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52e9170740 1 --2- 172.21.15.81:0/3585906789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 0x55bb78539720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52e9170740 1 --2- 172.21.15.81:0/3585906789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb78531dc0 0x55bb785391e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52bffff640 0 client.16413 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:06.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52e9170740 1 --2- 172.21.15.81:0/3585906789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 0x55bb7853bf30 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52e9170740 1 -- 172.21.15.81:0/3585906789 >> 172.21.15.81:0/3585906789 conn(0x55bb7852da30 msgr2=0x55bb78533710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:06.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52e9170740 1 -- 172.21.15.81:0/3585906789 shutdown_connections 2024-09-12T01:32:06.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52e9170740 1 -- 172.21.15.81:0/3585906789 wait complete. 2024-09-12T01:32:06.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.082+0000 7f52e9170740 20 client.16413 trim_cache size 0 max 16384 2024-09-12T01:32:06.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52e9170740 1 Processor -- start 2024-09-12T01:32:06.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52e9170740 1 -- start start 2024-09-12T01:32:06.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52e9170740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb785314a0 0x55bb785484b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52e9170740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb78531dc0 0x55bb78553bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52e9170740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 0x55bb78554130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52e9170740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52e01ad7f0 con 0x55bb78531dc0 2024-09-12T01:32:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52e9170740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f52e01af330 con 0x55bb785314a0 2024-09-12T01:32:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52e9170740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52e01adec0 con 0x55bb7853c680 2024-09-12T01:32:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb78531dc0 0x55bb78553bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb78531dc0 0x55bb78553bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51968/0 (socket says 172.21.15.81:51968) 2024-09-12T01:32:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52dffff640 1 -- 172.21.15.81:0/707858284 learned_addr learned my addr 172.21.15.81:0/707858284 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52e5334640 1 --2- 172.21.15.81:0/707858284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 0x55bb78554130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52e4b33640 1 --2- 172.21.15.81:0/707858284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb785314a0 0x55bb785484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52dffff640 1 -- 172.21.15.81:0/707858284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 msgr2=0x55bb78554130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52dffff640 1 --2- 172.21.15.81:0/707858284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 0x55bb78554130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52dffff640 1 -- 172.21.15.81:0/707858284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb785314a0 msgr2=0x55bb785484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52dffff640 1 --2- 172.21.15.81:0/707858284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb785314a0 0x55bb785484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52dffff640 1 -- 172.21.15.81:0/707858284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb7852d860 con 0x55bb78531dc0 2024-09-12T01:32:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.099+0000 7f52e4b33640 1 --2- 172.21.15.81:0/707858284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb785314a0 0x55bb785484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.100+0000 7f52dffff640 1 --2- 172.21.15.81:0/707858284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb78531dc0 0x55bb78553bf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00d010 tx=0x7f52cc00c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfcda323ac2beb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.100+0000 7f52ca7fc640 1 -- 172.21.15.81:0/707858284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc014040 con 0x55bb78531dc0 2024-09-12T01:32:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.100+0000 7f52ca7fc640 1 -- 172.21.15.81:0/707858284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52cc010670 con 0x55bb78531dc0 2024-09-12T01:32:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.100+0000 7f52ca7fc640 1 -- 172.21.15.81:0/707858284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc0048a0 con 0x55bb78531dc0 2024-09-12T01:32:06.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.100+0000 7f52e9170740 1 -- 172.21.15.81:0/707858284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb78531dc0 msgr2=0x55bb78553bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:06.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.100+0000 7f52e9170740 1 --2- 172.21.15.81:0/707858284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb78531dc0 0x55bb78553bf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00d010 tx=0x7f52cc00c4a0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.100+0000 7f52e9170740 1 -- 172.21.15.81:0/707858284 shutdown_connections 2024-09-12T01:32:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.100+0000 7f52e9170740 1 --2- 172.21.15.81:0/707858284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 0x55bb78554130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.100+0000 7f52e9170740 1 --2- 172.21.15.81:0/707858284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb78531dc0 0x55bb78553bf0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.100+0000 7f52e9170740 1 --2- 172.21.15.81:0/707858284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb785314a0 0x55bb785484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.100+0000 7f52e9170740 1 -- 172.21.15.81:0/707858284 >> 172.21.15.81:0/707858284 conn(0x55bb7852da30 msgr2=0x55bb78537ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e9170740 1 -- 172.21.15.81:0/707858284 shutdown_connections 2024-09-12T01:32:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e9170740 1 -- 172.21.15.81:0/707858284 wait complete. 2024-09-12T01:32:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e9170740 1 -- start start 2024-09-12T01:32:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e9170740 1 Processor -- start 2024-09-12T01:32:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e9170740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 0x55bb78544630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e9170740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb78531dc0 0x55bb78544b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e9170740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 0x55bb7853f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e9170740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52e01aec60 con 0x55bb785314a0 2024-09-12T01:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e9170740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f52e01ae590 con 0x55bb78531dc0 2024-09-12T01:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e9170740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52e01ab7d0 con 0x55bb7853c680 2024-09-12T01:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e9170740 10 client.0 _ll_register_callbacks cb 0x7f52d4009290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e4b33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 0x55bb78544630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e4b33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 0x55bb78544630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51984/0 (socket says 172.21.15.81:51984) 2024-09-12T01:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.101+0000 7f52e4b33640 1 -- 172.21.15.81:0/3185636018 learned_addr learned my addr 172.21.15.81:0/3185636018 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52e5334640 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 0x55bb7853f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52e4b33640 1 -- 172.21.15.81:0/3185636018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 msgr2=0x55bb7853f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52dffff640 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb78531dc0 0x55bb78544b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52e4b33640 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 0x55bb7853f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52e4b33640 1 -- 172.21.15.81:0/3185636018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb78531dc0 msgr2=0x55bb78544b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52e4b33640 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb78531dc0 0x55bb78544b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52e4b33640 1 -- 172.21.15.81:0/3185636018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb7853fc20 con 0x55bb785314a0 2024-09-12T01:32:06.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52e5334640 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 0x55bb7853f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:06.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52dffff640 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb78531dc0 0x55bb78544b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:06.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52e4b33640 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 0x55bb78544630 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f52d4000c00 tx=0x7f52d40ed980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b89d47fdd9747ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:06.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52bffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:06.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52bffff640 1 -- 172.21.15.81:0/3185636018 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d4049030 con 0x55bb785314a0 2024-09-12T01:32:06.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52bffff640 1 -- 172.21.15.81:0/3185636018 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f52d40c4c80 con 0x55bb785314a0 2024-09-12T01:32:06.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52e9170740 1 -- 172.21.15.81:0/3185636018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52cc010670 con 0x55bb785314a0 2024-09-12T01:32:06.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52bffff640 1 -- 172.21.15.81:0/3185636018 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52d40bc500 con 0x55bb785314a0 2024-09-12T01:32:06.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52e9170740 10 client.16419 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52e9170740 1 -- 172.21.15.81:0/3185636018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb785bb890 con 0x55bb785314a0 2024-09-12T01:32:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.102+0000 7f52bffff640 1 -- 172.21.15.81:0/3185636018 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52cc010670 con 0x55bb785314a0 2024-09-12T01:32:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.103+0000 7f52bffff640 1 -- 172.21.15.81:0/3185636018 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f52d4031ba0 con 0x55bb785314a0 2024-09-12T01:32:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.103+0000 7f52e9170740 10 client.16419 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.103+0000 7f52e9170740 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.103+0000 7f52e9170740 20 client.16419 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.103+0000 7f52e9170740 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bb785bbe10 0x55bb785be200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.103+0000 7f52e9170740 4 client.16419 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:32:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.103+0000 7f52e9170740 1 -- 172.21.15.81:0/3185636018 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bb7853a330 con 0x55bb785bbe10 2024-09-12T01:32:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.103+0000 7f52dffff640 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bb785bbe10 0x55bb785be200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.103+0000 7f52bffff640 10 client.16419 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.103+0000 7f52dffff640 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bb785bbe10 0x55bb785be200 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7861d4e6dc3b8380 server_cookie=494b046512f045f9 in_seq=0 out_seq=0 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52bffff640 1 -- 172.21.15.81:0/3185636018 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55bb7853a330 con 0x55bb785bbe10 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52bffff640 10 client.16419 handle_command_reply: tid=0 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52e9170740 1 client.16419 shutdown 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52e9170740 1 -- 172.21.15.81:0/3185636018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 msgr2=0x55bb78544630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52e9170740 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 0x55bb78544630 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f52d4000c00 tx=0x7f52d40ed980 comp rx=0 tx=0).stop 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52e9170740 1 -- 172.21.15.81:0/3185636018 shutdown_connections 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52e9170740 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bb785bbe10 0x55bb785be200 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52e9170740 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bb7853c680 0x55bb7853f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52bffff640 0 client.16419 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52e9170740 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb78531dc0 0x55bb78544b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52e9170740 1 --2- 172.21.15.81:0/3185636018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bb785314a0 0x55bb78544630 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52e9170740 1 -- 172.21.15.81:0/3185636018 >> 172.21.15.81:0/3185636018 conn(0x55bb7852da30 msgr2=0x55bb78532ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52e9170740 1 -- 172.21.15.81:0/3185636018 shutdown_connections 2024-09-12T01:32:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52e9170740 1 -- 172.21.15.81:0/3185636018 wait complete. 2024-09-12T01:32:06.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.104+0000 7f52e9170740 20 client.16419 trim_cache size 0 max 16384 2024-09-12T01:32:06.111 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:32:06.111 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:32:06.111 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-12T01:32:06.111 INFO:teuthology.orchestra.run.smithi081.stdout: "f4b54088-a419-4293-b560-ea67cb6f05e0": { 2024-09-12T01:32:06.111 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-09-12T01:32:06.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "f4b54088-a419-4293-b560-ea67cb6f05e0", 2024-09-12T01:32:06.111 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-12T01:32:06.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:32:06.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:32:06.112 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:32:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.105+0000 7f52e6d97640 1 -- 172.21.15.81:0/2862064170 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f52d00a2d70 msgr2=0x7f52d00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.105+0000 7f52e6d97640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f52d00a2d70 0x7f52d00a5230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009440 tx=0x7f52d8009e20 comp rx=0 tx=0).stop 2024-09-12T01:32:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.105+0000 7f52e6d97640 1 -- 172.21.15.81:0/2862064170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52e0102d40 msgr2=0x7f52e0198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.105+0000 7f52e6d97640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52e0102d40 0x7f52e0198490 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f52d4005ab0 tx=0x7f52d40042f0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.105+0000 7f52e6d97640 1 -- 172.21.15.81:0/2862064170 shutdown_connections 2024-09-12T01:32:06.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.105+0000 7f52e6d97640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f52d00a2d70 0x7f52d00a5230 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.105+0000 7f52e6d97640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52e010c170 0x7f52e019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.105+0000 7f52e6d97640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e0103660 0x7f52e01989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.105+0000 7f52e6d97640 1 --2- 172.21.15.81:0/2862064170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52e0102d40 0x7f52e0198490 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:06.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.105+0000 7f52e6d97640 1 -- 172.21.15.81:0/2862064170 >> 172.21.15.81:0/2862064170 conn(0x7f52e00fc7a0 msgr2=0x7f52e00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:06.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.105+0000 7f52e6d97640 1 -- 172.21.15.81:0/2862064170 shutdown_connections 2024-09-12T01:32:06.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:06.105+0000 7f52e6d97640 1 -- 172.21.15.81:0/2862064170 wait complete. 2024-09-12T01:32:06.942 INFO:tasks.cephfs.filesystem:scrub status for tag:f4b54088-a419-4293-b560-ea67cb6f05e0 - {'path': '/', 'tag': 'f4b54088-a419-4293-b560-ea67cb6f05e0', 'options': 'recursive,force'} 2024-09-12T01:32:07.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:06 smithi081 ceph-mon[30920]: pgmap v124: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:32:07.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:06 smithi100 ceph-mon[35275]: pgmap v124: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:32:07.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:06 smithi189 ceph-mon[35357]: pgmap v124: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:32:09.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:08 smithi081 ceph-mon[30920]: pgmap v125: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:32:09.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:08 smithi100 ceph-mon[35275]: pgmap v125: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:32:09.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:08 smithi189 ceph-mon[35357]: pgmap v125: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:32:10.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:09 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:32:10.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:09 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:32:10.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:09 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:32:11.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:10 smithi100 ceph-mon[35275]: pgmap v126: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:32:11.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:10 smithi189 ceph-mon[35357]: pgmap v126: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:32:11.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:10 smithi081 ceph-mon[30920]: pgmap v126: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:32:13.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:12 smithi100 ceph-mon[35275]: pgmap v127: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:32:13.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:12 smithi189 ceph-mon[35357]: pgmap v127: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:32:13.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:12 smithi081 ceph-mon[30920]: pgmap v127: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:32:14.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:14 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:32:14.281 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:14 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:32:14.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:14 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:32:15.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:15 smithi100 ceph-mon[35275]: pgmap v128: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:32:15.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:15 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:32:15.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:15 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:32:15.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:15 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:32:15.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:15 smithi189 ceph-mon[35357]: pgmap v128: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:32:15.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:15 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:32:15.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:15 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:32:15.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:15 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:32:15.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:15 smithi081 ceph-mon[30920]: pgmap v128: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:32:15.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:15 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:32:15.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:15 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:32:15.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:15 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:32:17.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:17 smithi100 ceph-mon[35275]: pgmap v129: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:32:17.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:17 smithi189 ceph-mon[35357]: pgmap v129: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:32:17.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:17 smithi081 ceph-mon[30920]: pgmap v129: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:32:19.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:19 smithi100 ceph-mon[35275]: pgmap v130: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T01:32:19.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:19 smithi189 ceph-mon[35357]: pgmap v130: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T01:32:19.291 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:19 smithi081 ceph-mon[30920]: pgmap v130: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T01:32:21.268 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:21 smithi100 ceph-mon[35275]: pgmap v131: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T01:32:21.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:21 smithi189 ceph-mon[35357]: pgmap v131: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T01:32:21.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:21 smithi081 ceph-mon[30920]: pgmap v131: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T01:32:23.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:23 smithi100 ceph-mon[35275]: pgmap v132: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:23.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:23 smithi189 ceph-mon[35357]: pgmap v132: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:23.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:23 smithi081 ceph-mon[30920]: pgmap v132: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:25.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:25 smithi189 ceph-mon[35357]: pgmap v133: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:25.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:25 smithi081 ceph-mon[30920]: pgmap v133: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:25.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:25 smithi100 ceph-mon[35275]: pgmap v133: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:27.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:27 smithi189 ceph-mon[35357]: pgmap v134: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:32:27.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:27 smithi081 ceph-mon[30920]: pgmap v134: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:32:27.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:27 smithi100 ceph-mon[35275]: pgmap v134: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:32:29.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:29 smithi189 ceph-mon[35357]: pgmap v135: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:29.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:29 smithi081 ceph-mon[30920]: pgmap v135: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:29.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:29 smithi100 ceph-mon[35275]: pgmap v135: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:31.282 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:31 smithi189 ceph-mon[35357]: pgmap v136: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:32:31.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:31 smithi081 ceph-mon[30920]: pgmap v136: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:32:31.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:31 smithi100 ceph-mon[35275]: pgmap v136: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:32:33.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:33 smithi081 ceph-mon[30920]: pgmap v137: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:33.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:33 smithi100 ceph-mon[35275]: pgmap v137: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:33.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:33 smithi189 ceph-mon[35357]: pgmap v137: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:35.321 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:35 smithi100 ceph-mon[35275]: pgmap v138: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:35.334 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:35 smithi189 ceph-mon[35357]: pgmap v138: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:35.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:35 smithi081 ceph-mon[30920]: pgmap v138: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:36.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:32:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:32:37.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:37 smithi081 ceph-mon[30920]: pgmap v139: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:32:37.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:37 smithi100 ceph-mon[35275]: pgmap v139: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:32:37.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:37 smithi189 ceph-mon[35357]: pgmap v139: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:32:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.685+0000 7f9dc8d8e640 1 -- 172.21.15.81:0/354847242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc410c180 msgr2=0x7f9dc410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.685+0000 7f9dc8d8e640 1 --2- 172.21.15.81:0/354847242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc410c180 0x7f9dc410e610 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009ca0 tx=0x7f9db402a950 comp rx=0 tx=0).stop 2024-09-12T01:32:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.685+0000 7f9dc8d8e640 1 -- 172.21.15.81:0/354847242 shutdown_connections 2024-09-12T01:32:37.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.685+0000 7f9dc8d8e640 1 --2- 172.21.15.81:0/354847242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc410c180 0x7f9dc410e610 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.685+0000 7f9dc8d8e640 1 --2- 172.21.15.81:0/354847242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dc4103700 0x7f9dc410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.685+0000 7f9dc8d8e640 1 --2- 172.21.15.81:0/354847242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc4102de0 0x7f9dc41031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.685+0000 7f9dc8d8e640 1 -- 172.21.15.81:0/354847242 >> 172.21.15.81:0/354847242 conn(0x7f9dc40fc7a0 msgr2=0x7f9dc40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.685+0000 7f9dc8d8e640 1 -- 172.21.15.81:0/354847242 shutdown_connections 2024-09-12T01:32:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.685+0000 7f9dc8d8e640 1 -- 172.21.15.81:0/354847242 wait complete. 2024-09-12T01:32:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.686+0000 7f9dc8d8e640 1 Processor -- start 2024-09-12T01:32:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.686+0000 7f9dc8d8e640 1 -- start start 2024-09-12T01:32:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.686+0000 7f9dc8d8e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dc4102de0 0x7f9dc4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.686+0000 7f9dc8d8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc4103700 0x7f9dc41988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.686+0000 7f9dc8d8e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc410c180 0x7f9dc419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.686+0000 7f9dc8d8e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc4111fb0 con 0x7f9dc4103700 2024-09-12T01:32:37.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.686+0000 7f9dc8d8e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc4111e30 con 0x7f9dc410c180 2024-09-12T01:32:37.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.686+0000 7f9dc8d8e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc4112130 con 0x7f9dc4102de0 2024-09-12T01:32:37.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.686+0000 7f9dc1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc4103700 0x7f9dc41988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.686+0000 7f9dc1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc4103700 0x7f9dc41988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48710/0 (socket says 172.21.15.81:48710) 2024-09-12T01:32:37.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.686+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/4006825694 learned_addr learned my addr 172.21.15.81:0/4006825694 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:37.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.686+0000 7f9dc2d9d640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc410c180 0x7f9dc419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.687+0000 7f9dc259c640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dc4102de0 0x7f9dc4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.687+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/4006825694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dc4102de0 msgr2=0x7f9dc4198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.687+0000 7f9dc1d9b640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dc4102de0 0x7f9dc4198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.687+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/4006825694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc410c180 msgr2=0x7f9dc419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.687+0000 7f9dc1d9b640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc410c180 0x7f9dc419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.687+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/4006825694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc419d320 con 0x7f9dc4103700 2024-09-12T01:32:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.687+0000 7f9dc2d9d640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc410c180 0x7f9dc419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:32:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.687+0000 7f9dc1d9b640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc4103700 0x7f9dc41988b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f9db800b520 tx=0x7f9db800b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.687+0000 7f9db37fe640 1 -- 172.21.15.81:0/4006825694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db801d070 con 0x7f9dc4103700 2024-09-12T01:32:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.687+0000 7f9db37fe640 1 -- 172.21.15.81:0/4006825694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9db8018440 con 0x7f9dc4103700 2024-09-12T01:32:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.687+0000 7f9db37fe640 1 -- 172.21.15.81:0/4006825694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db8016580 con 0x7f9dc4103700 2024-09-12T01:32:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.687+0000 7f9dc8d8e640 1 -- 172.21.15.81:0/4006825694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc419d610 con 0x7f9dc4103700 2024-09-12T01:32:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.687+0000 7f9dc8d8e640 1 -- 172.21.15.81:0/4006825694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc4100970 con 0x7f9dc4103700 2024-09-12T01:32:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.690+0000 7f9db37fe640 1 -- 172.21.15.81:0/4006825694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9db8020070 con 0x7f9dc4103700 2024-09-12T01:32:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.690+0000 7f9dcb167740 1 Processor -- start 2024-09-12T01:32:37.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.690+0000 7f9dcb167740 1 -- start start 2024-09-12T01:32:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.690+0000 7f9dcb167740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a414a0 0x55b7f2a41880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.690+0000 7f9dcb167740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a4c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.690+0000 7f9dcb167740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 0x55b7f2a4ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.690+0000 7f9dcb167740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7f29a72e0 con 0x55b7f2a414a0 2024-09-12T01:32:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.690+0000 7f9dcb167740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7f294ece0 con 0x55b7f2a4c680 2024-09-12T01:32:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.690+0000 7f9dcb167740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7f29a32a0 con 0x55b7f2a41dc0 2024-09-12T01:32:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.690+0000 7f9dc2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a414a0 0x55b7f2a41880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9dc2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a414a0 0x55b7f2a41880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48712/0 (socket says 172.21.15.81:48712) 2024-09-12T01:32:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9dc2d9d640 1 -- 172.21.15.81:0/321048190 learned_addr learned my addr 172.21.15.81:0/321048190 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9dc259c640 1 --2- 172.21.15.81:0/321048190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a4c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9dc1d9b640 1 --2- 172.21.15.81:0/321048190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 0x55b7f2a4ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9db37fe640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9dac0a2cf0 0x7f9dac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9dc259c640 1 -- 172.21.15.81:0/321048190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 msgr2=0x55b7f2a4ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9dc259c640 1 --2- 172.21.15.81:0/321048190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 0x55b7f2a4ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9dc259c640 1 -- 172.21.15.81:0/321048190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a414a0 msgr2=0x55b7f2a41880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9dc259c640 1 --2- 172.21.15.81:0/321048190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a414a0 0x55b7f2a41880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9dc259c640 1 -- 172.21.15.81:0/321048190 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f2933440 con 0x55b7f2a41dc0 2024-09-12T01:32:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9dc2d9d640 1 --2- 172.21.15.81:0/321048190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a414a0 0x55b7f2a41880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:32:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9db37fe640 1 -- 172.21.15.81:0/4006825694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f9db80d2480 con 0x7f9dc4103700 2024-09-12T01:32:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9dc2d9d640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9dac0a2cf0 0x7f9dac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.691+0000 7f9dc259c640 1 --2- 172.21.15.81:0/321048190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a4c140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00abf0 tx=0x7f9dbc00f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66e03ab77ade9150 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:37.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.692+0000 7f9db0ff9640 1 -- 172.21.15.81:0/321048190 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc005020 con 0x55b7f2a41dc0 2024-09-12T01:32:37.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.692+0000 7f9db0ff9640 1 -- 172.21.15.81:0/321048190 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dbc0047a0 con 0x55b7f2a41dc0 2024-09-12T01:32:37.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.692+0000 7f9db0ff9640 1 -- 172.21.15.81:0/321048190 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc018800 con 0x55b7f2a41dc0 2024-09-12T01:32:37.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.692+0000 7f9dcb167740 1 -- 172.21.15.81:0/321048190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a41dc0 msgr2=0x55b7f2a4c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:37.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.692+0000 7f9dcb167740 1 --2- 172.21.15.81:0/321048190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a4c140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00abf0 tx=0x7f9dbc00f3c0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.692+0000 7f9dc2d9d640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9dac0a2cf0 0x7f9dac0a51b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9db402fd90 tx=0x7f9db403c040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:37.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.692+0000 7f9dcb167740 1 -- 172.21.15.81:0/321048190 shutdown_connections 2024-09-12T01:32:37.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.692+0000 7f9dcb167740 1 --2- 172.21.15.81:0/321048190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 0x55b7f2a4ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.692+0000 7f9dcb167740 1 --2- 172.21.15.81:0/321048190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a4c140 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.692+0000 7f9dcb167740 1 --2- 172.21.15.81:0/321048190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a414a0 0x55b7f2a41880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.692+0000 7f9dcb167740 1 -- 172.21.15.81:0/321048190 >> 172.21.15.81:0/321048190 conn(0x55b7f2a3da30 msgr2=0x55b7f2a3de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:37.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.692+0000 7f9dcb167740 1 -- 172.21.15.81:0/321048190 shutdown_connections 2024-09-12T01:32:37.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dcb167740 1 -- 172.21.15.81:0/321048190 wait complete. 2024-09-12T01:32:37.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dcb167740 1 -- start start 2024-09-12T01:32:37.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dcb167740 1 Processor -- start 2024-09-12T01:32:37.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dcb167740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a414a0 0x55b7f2a4bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dcb167740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a49210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dcb167740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 0x55b7f2a49750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dcb167740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7f2a4f250 con 0x55b7f2a41dc0 2024-09-12T01:32:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dcb167740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b7f2962050 con 0x55b7f2a4c680 2024-09-12T01:32:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dcb167740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7f2a4f3d0 con 0x55b7f2a414a0 2024-09-12T01:32:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dcb167740 10 client.0 _ll_register_callbacks cb 0x55b7f29a2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dc1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a49210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dc1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a49210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48726/0 (socket says 172.21.15.81:48726) 2024-09-12T01:32:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/1050181835 learned_addr learned my addr 172.21.15.81:0/1050181835 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.693+0000 7f9dc259c640 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a414a0 0x55b7f2a4bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9dc2d9d640 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 0x55b7f2a49750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/1050181835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a414a0 msgr2=0x55b7f2a4bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9dc1d9b640 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a414a0 0x55b7f2a4bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/1050181835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 msgr2=0x55b7f2a49750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9dc1d9b640 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 0x55b7f2a49750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/1050181835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7f27183c0 con 0x55b7f2a41dc0 2024-09-12T01:32:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9dc2d9d640 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 0x55b7f2a49750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9dc1d9b640 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a49210 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9db80cfd10 tx=0x7f9db80093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408324b441b200cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9da9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9da9ffb640 1 -- 172.21.15.81:0/1050181835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db80d0020 con 0x55b7f2a41dc0 2024-09-12T01:32:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9dcb167740 1 -- 172.21.15.81:0/1050181835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dbc0047a0 con 0x55b7f2a41dc0 2024-09-12T01:32:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9da9ffb640 1 -- 172.21.15.81:0/1050181835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f9db809ed90 con 0x55b7f2a41dc0 2024-09-12T01:32:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9da9ffb640 1 -- 172.21.15.81:0/1050181835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9db809eb30 con 0x55b7f2a41dc0 2024-09-12T01:32:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9dcb167740 10 client.16431 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9dcb167740 1 -- 172.21.15.81:0/1050181835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b7f2a5ac70 con 0x55b7f2a41dc0 2024-09-12T01:32:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.694+0000 7f9da9ffb640 1 -- 172.21.15.81:0/1050181835 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dbc0047a0 con 0x55b7f2a41dc0 2024-09-12T01:32:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.695+0000 7f9da9ffb640 1 -- 172.21.15.81:0/1050181835 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9db80d1070 con 0x55b7f2a41dc0 2024-09-12T01:32:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.695+0000 7f9dcb167740 10 client.16431 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.695+0000 7f9dcb167740 10 client.16431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.695+0000 7f9dcb167740 20 client.16431 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.695+0000 7f9dcb167740 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7f2a5c080 0x55b7f2a5e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.695+0000 7f9dcb167740 4 client.16431 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:32:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.695+0000 7f9dcb167740 1 -- 172.21.15.81:0/1050181835 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7f29b4850 con 0x55b7f2a5c080 2024-09-12T01:32:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.695+0000 7f9dc259c640 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7f2a5c080 0x55b7f2a5e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.695+0000 7f9dc259c640 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7f2a5c080 0x55b7f2a5e470 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a012d47d68301484 server_cookie=848e5ed1abaef092 in_seq=0 out_seq=0 2024-09-12T01:32:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.695+0000 7f9da9ffb640 10 client.16431 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9da9ffb640 1 -- 172.21.15.81:0/1050181835 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7f29b4850 con 0x55b7f2a5c080 2024-09-12T01:32:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9da9ffb640 10 client.16431 handle_command_reply: tid=0 2024-09-12T01:32:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9dcb167740 1 client.16431 shutdown 2024-09-12T01:32:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9dcb167740 1 -- 172.21.15.81:0/1050181835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 msgr2=0x55b7f2a49210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9dcb167740 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a49210 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9db80cfd10 tx=0x7f9db80093b0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9dcb167740 1 -- 172.21.15.81:0/1050181835 shutdown_connections 2024-09-12T01:32:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9dcb167740 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7f2a5c080 0x55b7f2a5e470 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9dcb167740 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 0x55b7f2a49750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9dcb167740 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a49210 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9dcb167740 1 --2- 172.21.15.81:0/1050181835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a414a0 0x55b7f2a4bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9da9ffb640 0 client.16431 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9dcb167740 1 -- 172.21.15.81:0/1050181835 >> 172.21.15.81:0/1050181835 conn(0x55b7f2a3da30 msgr2=0x55b7f2a43760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9dcb167740 1 -- 172.21.15.81:0/1050181835 shutdown_connections 2024-09-12T01:32:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9dcb167740 1 -- 172.21.15.81:0/1050181835 wait complete. 2024-09-12T01:32:37.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.696+0000 7f9dcb167740 20 client.16431 trim_cache size 0 max 16384 2024-09-12T01:32:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.713+0000 7f9dcb167740 1 Processor -- start 2024-09-12T01:32:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.713+0000 7f9dcb167740 1 -- start start 2024-09-12T01:32:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.713+0000 7f9dcb167740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a414a0 0x55b7f2a3de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.713+0000 7f9dcb167740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a63d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.713+0000 7f9dcb167740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 0x55b7f2a64260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.713+0000 7f9dcb167740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41ab540 con 0x55b7f2a41dc0 2024-09-12T01:32:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.713+0000 7f9dcb167740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41ad080 con 0x55b7f2a4c680 2024-09-12T01:32:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.713+0000 7f9dcb167740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41abc10 con 0x55b7f2a414a0 2024-09-12T01:32:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dc1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a63d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dc1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a63d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48736/0 (socket says 172.21.15.81:48736) 2024-09-12T01:32:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/2716382753 learned_addr learned my addr 172.21.15.81:0/2716382753 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:37.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dc259c640 1 --2- 172.21.15.81:0/2716382753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a414a0 0x55b7f2a3de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dc2d9d640 1 --2- 172.21.15.81:0/2716382753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 0x55b7f2a64260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/2716382753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a414a0 msgr2=0x55b7f2a3de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dc1d9b640 1 --2- 172.21.15.81:0/2716382753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a414a0 0x55b7f2a3de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/2716382753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 msgr2=0x55b7f2a64260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:37.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dc1d9b640 1 --2- 172.21.15.81:0/2716382753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 0x55b7f2a64260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/2716382753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f2a481e0 con 0x55b7f2a41dc0 2024-09-12T01:32:37.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dc259c640 1 --2- 172.21.15.81:0/2716382753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a414a0 0x55b7f2a3de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:37.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dc1d9b640 1 --2- 172.21.15.81:0/2716382753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a63d20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009420 tx=0x7f9db80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261bcea0bec68648 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:37.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dabfff640 1 -- 172.21.15.81:0/2716382753 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db80a2e30 con 0x55b7f2a41dc0 2024-09-12T01:32:37.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dabfff640 1 -- 172.21.15.81:0/2716382753 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9db80cfd90 con 0x55b7f2a41dc0 2024-09-12T01:32:37.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.714+0000 7f9dabfff640 1 -- 172.21.15.81:0/2716382753 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db809a880 con 0x55b7f2a41dc0 2024-09-12T01:32:37.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.715+0000 7f9dcb167740 1 -- 172.21.15.81:0/2716382753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 msgr2=0x55b7f2a63d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:37.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.715+0000 7f9dcb167740 1 --2- 172.21.15.81:0/2716382753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a63d20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009420 tx=0x7f9db80046c0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.715+0000 7f9dcb167740 1 -- 172.21.15.81:0/2716382753 shutdown_connections 2024-09-12T01:32:37.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.715+0000 7f9dcb167740 1 --2- 172.21.15.81:0/2716382753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a4c680 0x55b7f2a64260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.715+0000 7f9dcb167740 1 --2- 172.21.15.81:0/2716382753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a63d20 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.715+0000 7f9dcb167740 1 --2- 172.21.15.81:0/2716382753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a414a0 0x55b7f2a3de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.715+0000 7f9dcb167740 1 -- 172.21.15.81:0/2716382753 >> 172.21.15.81:0/2716382753 conn(0x55b7f2a3da30 msgr2=0x55b7f2a4b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:37.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.715+0000 7f9dcb167740 1 -- 172.21.15.81:0/2716382753 shutdown_connections 2024-09-12T01:32:37.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.715+0000 7f9dcb167740 1 -- 172.21.15.81:0/2716382753 wait complete. 2024-09-12T01:32:37.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dcb167740 1 -- start start 2024-09-12T01:32:37.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dcb167740 1 Processor -- start 2024-09-12T01:32:37.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dcb167740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a414a0 0x55b7f2a54e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dcb167740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a521b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dcb167740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a4c680 0x55b7f2a527a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dcb167740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41ac9b0 con 0x55b7f2a41dc0 2024-09-12T01:32:37.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dcb167740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41ac2e0 con 0x55b7f2a414a0 2024-09-12T01:32:37.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dcb167740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41a9540 con 0x55b7f2a4c680 2024-09-12T01:32:37.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dcb167740 10 client.0 _ll_register_callbacks cb 0x7f9db809add0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:37.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dc1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dc1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a521b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48748/0 (socket says 172.21.15.81:48748) 2024-09-12T01:32:37.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/3810464311 learned_addr learned my addr 172.21.15.81:0/3810464311 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dc2d9d640 1 --2- 172.21.15.81:0/3810464311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a4c680 0x55b7f2a527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.716+0000 7f9dc259c640 1 --2- 172.21.15.81:0/3810464311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a414a0 0x55b7f2a54e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/3810464311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a4c680 msgr2=0x55b7f2a527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9dc1d9b640 1 --2- 172.21.15.81:0/3810464311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a4c680 0x55b7f2a527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/3810464311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a414a0 msgr2=0x55b7f2a54e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9dc1d9b640 1 --2- 172.21.15.81:0/3810464311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a414a0 0x55b7f2a54e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9dc1d9b640 1 -- 172.21.15.81:0/3810464311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7f2a41bf0 con 0x55b7f2a41dc0 2024-09-12T01:32:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9dc1d9b640 1 --2- 172.21.15.81:0/3810464311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a521b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9db809cde0 tx=0x7f9db80a7600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd014ce58cc71e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9da9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9da9ffb640 1 -- 172.21.15.81:0/3810464311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db8010c90 con 0x55b7f2a41dc0 2024-09-12T01:32:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9da9ffb640 1 -- 172.21.15.81:0/3810464311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f9db809a880 con 0x55b7f2a41dc0 2024-09-12T01:32:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9dcb167740 1 -- 172.21.15.81:0/3810464311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9db80cfd90 con 0x55b7f2a41dc0 2024-09-12T01:32:37.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9da9ffb640 1 -- 172.21.15.81:0/3810464311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9db80a2e30 con 0x55b7f2a41dc0 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9dcb167740 10 client.16437 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9dcb167740 1 -- 172.21.15.81:0/3810464311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b7f2a41bf0 con 0x55b7f2a41dc0 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.717+0000 7f9da9ffb640 1 -- 172.21.15.81:0/3810464311 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9db80cfd90 con 0x55b7f2a41dc0 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.718+0000 7f9da9ffb640 1 -- 172.21.15.81:0/3810464311 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9db80d1040 con 0x55b7f2a41dc0 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.718+0000 7f9dcb167740 10 client.16437 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.718+0000 7f9dcb167740 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.718+0000 7f9dcb167740 20 client.16437 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.718+0000 7f9dcb167740 1 --2- 172.21.15.81:0/3810464311 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7f2ac6ed0 0x55b7f2ac92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.718+0000 7f9dcb167740 4 client.16437 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.718+0000 7f9dcb167740 1 -- 172.21.15.81:0/3810464311 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b7f29aed60 con 0x55b7f2ac6ed0 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.718+0000 7f9dc259c640 1 --2- 172.21.15.81:0/3810464311 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7f2ac6ed0 0x55b7f2ac92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.718+0000 7f9da9ffb640 10 client.16437 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.718+0000 7f9dc259c640 1 --2- 172.21.15.81:0/3810464311 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7f2ac6ed0 0x55b7f2ac92c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=603e8ddc54ae408f server_cookie=d2d17c32a31f26d5 in_seq=0 out_seq=0 2024-09-12T01:32:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9da9ffb640 1 -- 172.21.15.81:0/3810464311 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b7f29aed60 con 0x55b7f2ac6ed0 2024-09-12T01:32:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9da9ffb640 10 client.16437 handle_command_reply: tid=0 2024-09-12T01:32:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9dcb167740 1 client.16437 shutdown 2024-09-12T01:32:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9dcb167740 1 -- 172.21.15.81:0/3810464311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 msgr2=0x55b7f2a521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9dcb167740 1 --2- 172.21.15.81:0/3810464311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a521b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9db809cde0 tx=0x7f9db80a7600 comp rx=0 tx=0).stop 2024-09-12T01:32:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9dcb167740 1 -- 172.21.15.81:0/3810464311 shutdown_connections 2024-09-12T01:32:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9dcb167740 1 --2- 172.21.15.81:0/3810464311 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7f2ac6ed0 0x55b7f2ac92c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9da9ffb640 0 client.16437 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9dcb167740 1 --2- 172.21.15.81:0/3810464311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f2a4c680 0x55b7f2a527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9dcb167740 1 --2- 172.21.15.81:0/3810464311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7f2a41dc0 0x55b7f2a521b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9dcb167740 1 --2- 172.21.15.81:0/3810464311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b7f2a414a0 0x55b7f2a54e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9dcb167740 1 -- 172.21.15.81:0/3810464311 >> 172.21.15.81:0/3810464311 conn(0x55b7f2a3da30 msgr2=0x55b7f2a3c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9dcb167740 1 -- 172.21.15.81:0/3810464311 shutdown_connections 2024-09-12T01:32:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9dcb167740 1 -- 172.21.15.81:0/3810464311 wait complete. 2024-09-12T01:32:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.719+0000 7f9dcb167740 20 client.16437 trim_cache size 0 max 16384 2024-09-12T01:32:37.725 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:32:37.725 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:32:37.725 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:32:37.725 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:32:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.720+0000 7f9dc8d8e640 1 -- 172.21.15.81:0/4006825694 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9dac0a2cf0 msgr2=0x7f9dac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.720+0000 7f9dc8d8e640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9dac0a2cf0 0x7f9dac0a51b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9db402fd90 tx=0x7f9db403c040 comp rx=0 tx=0).stop 2024-09-12T01:32:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.720+0000 7f9dc8d8e640 1 -- 172.21.15.81:0/4006825694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc4103700 msgr2=0x7f9dc41988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.720+0000 7f9dc8d8e640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc4103700 0x7f9dc41988b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f9db800b520 tx=0x7f9db800b920 comp rx=0 tx=0).stop 2024-09-12T01:32:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.720+0000 7f9dc8d8e640 1 -- 172.21.15.81:0/4006825694 shutdown_connections 2024-09-12T01:32:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.720+0000 7f9dc8d8e640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9dac0a2cf0 0x7f9dac0a51b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.720+0000 7f9dc8d8e640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dc410c180 0x7f9dc419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.720+0000 7f9dc8d8e640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc4103700 0x7f9dc41988b0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.720+0000 7f9dc8d8e640 1 --2- 172.21.15.81:0/4006825694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9dc4102de0 0x7f9dc4198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.720+0000 7f9dc8d8e640 1 -- 172.21.15.81:0/4006825694 >> 172.21.15.81:0/4006825694 conn(0x7f9dc40fc7a0 msgr2=0x7f9dc40fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.720+0000 7f9dc8d8e640 1 -- 172.21.15.81:0/4006825694 shutdown_connections 2024-09-12T01:32:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:37.720+0000 7f9dc8d8e640 1 -- 172.21.15.81:0/4006825694 wait complete. 2024-09-12T01:32:38.588 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:32:38.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:32:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:32:39.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:39 smithi081 ceph-mon[30920]: pgmap v140: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.298+0000 7fd3bab29640 1 -- 172.21.15.81:0/2581907910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b4101420 msgr2=0x7fd3b410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.298+0000 7fd3bab29640 1 --2- 172.21.15.81:0/2581907910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b4101420 0x7fd3b410d950 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009cd0 tx=0x7fd3ac02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:32:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.298+0000 7fd3bab29640 1 -- 172.21.15.81:0/2581907910 shutdown_connections 2024-09-12T01:32:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.298+0000 7fd3bab29640 1 --2- 172.21.15.81:0/2581907910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b4101420 0x7fd3b410d950 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.298+0000 7fd3bab29640 1 --2- 172.21.15.81:0/2581907910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3b4100a80 0x7fd3b4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.298+0000 7fd3bab29640 1 --2- 172.21.15.81:0/2581907910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b4106a80 0x7fd3b4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.298+0000 7fd3bab29640 1 -- 172.21.15.81:0/2581907910 >> 172.21.15.81:0/2581907910 conn(0x7fd3b40fc7a0 msgr2=0x7fd3b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.298+0000 7fd3bab29640 1 -- 172.21.15.81:0/2581907910 shutdown_connections 2024-09-12T01:32:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.298+0000 7fd3bab29640 1 -- 172.21.15.81:0/2581907910 wait complete. 2024-09-12T01:32:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.299+0000 7fd3bab29640 1 Processor -- start 2024-09-12T01:32:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.299+0000 7fd3bab29640 1 -- start start 2024-09-12T01:32:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.299+0000 7fd3bab29640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b4100a80 0x7fd3b419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.299+0000 7fd3bab29640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3b4101420 0x7fd3b419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.299+0000 7fd3bab29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b4106a80 0x7fd3b419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.299+0000 7fd3bab29640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b4110e80 con 0x7fd3b4106a80 2024-09-12T01:32:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.299+0000 7fd3bab29640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b4110d00 con 0x7fd3b4100a80 2024-09-12T01:32:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.299+0000 7fd3bab29640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b4111000 con 0x7fd3b4101420 2024-09-12T01:32:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.299+0000 7fd3b90c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b4106a80 0x7fd3b419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.299+0000 7fd3b90c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b4106a80 0x7fd3b419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48762/0 (socket says 172.21.15.81:48762) 2024-09-12T01:32:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.299+0000 7fd3b90c6640 1 -- 172.21.15.81:0/4084076487 learned_addr learned my addr 172.21.15.81:0/4084076487 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.299+0000 7fd3b88c5640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b4100a80 0x7fd3b419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.300+0000 7fd3b3fff640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3b4101420 0x7fd3b419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.300+0000 7fd3b90c6640 1 -- 172.21.15.81:0/4084076487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3b4101420 msgr2=0x7fd3b419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.300+0000 7fd3b90c6640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3b4101420 0x7fd3b419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.300+0000 7fd3b90c6640 1 -- 172.21.15.81:0/4084076487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b4100a80 msgr2=0x7fd3b419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.300+0000 7fd3b90c6640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b4100a80 0x7fd3b419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.300+0000 7fd3b90c6640 1 -- 172.21.15.81:0/4084076487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b419f660 con 0x7fd3b4106a80 2024-09-12T01:32:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.300+0000 7fd3b90c6640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b4106a80 0x7fd3b419ef80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac005cc0 tx=0x7fd3ac032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.300+0000 7fd3b1ffb640 1 -- 172.21.15.81:0/4084076487 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac004040 con 0x7fd3b4106a80 2024-09-12T01:32:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.300+0000 7fd3b1ffb640 1 -- 172.21.15.81:0/4084076487 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3ac0046c0 con 0x7fd3b4106a80 2024-09-12T01:32:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.300+0000 7fd3bab29640 1 -- 172.21.15.81:0/4084076487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b419f8f0 con 0x7fd3b4106a80 2024-09-12T01:32:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.300+0000 7fd3b1ffb640 1 -- 172.21.15.81:0/4084076487 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac030e00 con 0x7fd3b4106a80 2024-09-12T01:32:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.300+0000 7fd3bab29640 1 -- 172.21.15.81:0/4084076487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b41a7230 con 0x7fd3b4106a80 2024-09-12T01:32:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.301+0000 7fd3bab29640 1 -- 172.21.15.81:0/4084076487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3b4100ee0 con 0x7fd3b4106a80 2024-09-12T01:32:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.302+0000 7fd3b1ffb640 1 -- 172.21.15.81:0/4084076487 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fd3ac0305a0 con 0x7fd3b4106a80 2024-09-12T01:32:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.303+0000 7fd3b1ffb640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3a40a2cf0 0x7fd3a40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.303+0000 7fd3b1ffb640 1 -- 172.21.15.81:0/4084076487 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fd3ac02e030 con 0x7fd3b4106a80 2024-09-12T01:32:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.303+0000 7fd3b88c5640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3a40a2cf0 0x7fd3a40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.303+0000 7fd3b88c5640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3a40a2cf0 0x7fd3a40a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009b50 tx=0x7fd3a8005f90 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.306+0000 7fd3b1ffb640 1 -- 172.21.15.81:0/4084076487 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3ac04b060 con 0x7fd3b4106a80 2024-09-12T01:32:39.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.510+0000 7fd3bab29640 1 -- 172.21.15.81:0/4084076487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3b41a7400 con 0x7fd3b4106a80 2024-09-12T01:32:39.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.511+0000 7fd3b1ffb640 1 -- 172.21.15.81:0/4084076487 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fd3ac0bd9c0 con 0x7fd3b4106a80 2024-09-12T01:32:39.511 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:32:39.511 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:32:39.511 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:32:39.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.513+0000 7fd3bab29640 1 -- 172.21.15.81:0/4084076487 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3a40a2cf0 msgr2=0x7fd3a40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:39.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.513+0000 7fd3bab29640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3a40a2cf0 0x7fd3a40a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009b50 tx=0x7fd3a8005f90 comp rx=0 tx=0).stop 2024-09-12T01:32:39.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.513+0000 7fd3bab29640 1 -- 172.21.15.81:0/4084076487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b4106a80 msgr2=0x7fd3b419ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:39.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.513+0000 7fd3bab29640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b4106a80 0x7fd3b419ef80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac005cc0 tx=0x7fd3ac032f40 comp rx=0 tx=0).stop 2024-09-12T01:32:39.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.513+0000 7fd3bab29640 1 -- 172.21.15.81:0/4084076487 shutdown_connections 2024-09-12T01:32:39.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.513+0000 7fd3bab29640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3a40a2cf0 0x7fd3a40a51b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:39.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.513+0000 7fd3bab29640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b4106a80 0x7fd3b419ef80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:39.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.513+0000 7fd3bab29640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3b4101420 0x7fd3b419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:39.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.513+0000 7fd3bab29640 1 --2- 172.21.15.81:0/4084076487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b4100a80 0x7fd3b419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:39.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.513+0000 7fd3bab29640 1 -- 172.21.15.81:0/4084076487 >> 172.21.15.81:0/4084076487 conn(0x7fd3b40fc7a0 msgr2=0x7fd3b406a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:39.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.513+0000 7fd3bab29640 1 -- 172.21.15.81:0/4084076487 shutdown_connections 2024-09-12T01:32:39.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:39.513+0000 7fd3bab29640 1 -- 172.21.15.81:0/4084076487 wait complete. 2024-09-12T01:32:39.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:39 smithi100 ceph-mon[35275]: pgmap v140: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:39.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:39 smithi189 ceph-mon[35357]: pgmap v140: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:40.222 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:32:40.246 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:40 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/4084076487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:32:40.473 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:32:40.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:40 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/4084076487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:32:40.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:40 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/4084076487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:32:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.917+0000 7fb246ccc640 1 -- 172.21.15.81:0/3126873941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240102570 msgr2=0x7fb2401029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.917+0000 7fb246ccc640 1 --2- 172.21.15.81:0/3126873941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240102570 0x7fb2401029b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009900 tx=0x7fb22c02a480 comp rx=0 tx=0).stop 2024-09-12T01:32:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.917+0000 7fb246ccc640 1 -- 172.21.15.81:0/3126873941 shutdown_connections 2024-09-12T01:32:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.917+0000 7fb246ccc640 1 --2- 172.21.15.81:0/3126873941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb240102ef0 0x7fb24010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.917+0000 7fb246ccc640 1 --2- 172.21.15.81:0/3126873941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240102570 0x7fb2401029b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.917+0000 7fb246ccc640 1 --2- 172.21.15.81:0/3126873941 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb240100e20 0x7fb240101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.917+0000 7fb246ccc640 1 -- 172.21.15.81:0/3126873941 >> 172.21.15.81:0/3126873941 conn(0x7fb2400fc7d0 msgr2=0x7fb2400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.917+0000 7fb246ccc640 1 -- 172.21.15.81:0/3126873941 shutdown_connections 2024-09-12T01:32:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.917+0000 7fb246ccc640 1 -- 172.21.15.81:0/3126873941 wait complete. 2024-09-12T01:32:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb246ccc640 1 Processor -- start 2024-09-12T01:32:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb246ccc640 1 -- start start 2024-09-12T01:32:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb246ccc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb240100e20 0x7fb240199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb246ccc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240102570 0x7fb2401998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb246ccc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb240102ef0 0x7fb2401a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb246ccc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb240110f80 con 0x7fb240102570 2024-09-12T01:32:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb246ccc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb240110e00 con 0x7fb240102ef0 2024-09-12T01:32:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb246ccc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb240111100 con 0x7fb240100e20 2024-09-12T01:32:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb23ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240102570 0x7fb2401998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb23ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240102570 0x7fb2401998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48784/0 (socket says 172.21.15.81:48784) 2024-09-12T01:32:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb23ffff640 1 -- 172.21.15.81:0/1910112324 learned_addr learned my addr 172.21.15.81:0/1910112324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb244a68640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb240100e20 0x7fb240199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb245269640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb240102ef0 0x7fb2401a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb23ffff640 1 -- 172.21.15.81:0/1910112324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb240100e20 msgr2=0x7fb240199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb23ffff640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb240100e20 0x7fb240199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb23ffff640 1 -- 172.21.15.81:0/1910112324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb240102ef0 msgr2=0x7fb2401a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb23ffff640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb240102ef0 0x7fb2401a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.918+0000 7fb23ffff640 1 -- 172.21.15.81:0/1910112324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2401a4950 con 0x7fb240102570 2024-09-12T01:32:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.919+0000 7fb23ffff640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240102570 0x7fb2401998d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb22c006010 tx=0x7fb22c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.919+0000 7fb23dffb640 1 -- 172.21.15.81:0/1910112324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c03f070 con 0x7fb240102570 2024-09-12T01:32:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.919+0000 7fb23dffb640 1 -- 172.21.15.81:0/1910112324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb22c031c30 con 0x7fb240102570 2024-09-12T01:32:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.919+0000 7fb246ccc640 1 -- 172.21.15.81:0/1910112324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2401a4b20 con 0x7fb240102570 2024-09-12T01:32:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.919+0000 7fb23dffb640 1 -- 172.21.15.81:0/1910112324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c035030 con 0x7fb240102570 2024-09-12T01:32:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.919+0000 7fb246ccc640 1 -- 172.21.15.81:0/1910112324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2401a4f70 con 0x7fb240102570 2024-09-12T01:32:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.922+0000 7fb23dffb640 1 -- 172.21.15.81:0/1910112324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb22c042070 con 0x7fb240102570 2024-09-12T01:32:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.922+0000 7fb2490a5740 1 Processor -- start 2024-09-12T01:32:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.922+0000 7fb2490a5740 1 -- start start 2024-09-12T01:32:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb2490a5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda06db40 0x562fda06c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb2490a5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06c5d0 0x562fda06ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb2490a5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 0x562fda079760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb2490a5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562fd9fd22f0 con 0x562fda077370 2024-09-12T01:32:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb2490a5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562fd9f79cf0 con 0x562fda06db40 2024-09-12T01:32:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb2490a5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562fd9fce2b0 con 0x562fda06c5d0 2024-09-12T01:32:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb23dffb640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb2300a2cf0 0x7fb2300a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb23ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 0x562fda079760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb23ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 0x562fda079760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48796/0 (socket says 172.21.15.81:48796) 2024-09-12T01:32:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb23ffff640 1 -- 172.21.15.81:0/2359002211 learned_addr learned my addr 172.21.15.81:0/2359002211 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb245269640 1 --2- 172.21.15.81:0/2359002211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda06db40 0x562fda06c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb244a68640 1 --2- 172.21.15.81:0/2359002211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06c5d0 0x562fda06ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb245269640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb2300a2cf0 0x7fb2300a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb23dffb640 1 -- 172.21.15.81:0/1910112324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb22c0efc80 con 0x7fb240102570 2024-09-12T01:32:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb23ffff640 1 -- 172.21.15.81:0/2359002211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06c5d0 msgr2=0x562fda06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb23ffff640 1 --2- 172.21.15.81:0/2359002211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06c5d0 0x562fda06ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb23ffff640 1 -- 172.21.15.81:0/2359002211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda06db40 msgr2=0x562fda06c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb23ffff640 1 --2- 172.21.15.81:0/2359002211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda06db40 0x562fda06c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb23ffff640 1 -- 172.21.15.81:0/2359002211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fd9f5e3a0 con 0x562fda077370 2024-09-12T01:32:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb244a68640 1 --2- 172.21.15.81:0/2359002211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06c5d0 0x562fda06ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:32:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb23ffff640 1 --2- 172.21.15.81:0/2359002211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 0x562fda079760 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0b8ba0 tx=0x7fb22c0dad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abc4c893598e9bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.923+0000 7fb22affd640 1 -- 172.21.15.81:0/2359002211 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c049070 con 0x562fda077370 2024-09-12T01:32:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.924+0000 7fb245269640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb2300a2cf0 0x7fb2300a51b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb238005fd0 tx=0x7fb238009a00 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.924+0000 7fb22affd640 1 -- 172.21.15.81:0/2359002211 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb22c0bc8d0 con 0x562fda077370 2024-09-12T01:32:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.924+0000 7fb22affd640 1 -- 172.21.15.81:0/2359002211 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c0d50e0 con 0x562fda077370 2024-09-12T01:32:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.924+0000 7fb2490a5740 1 -- 172.21.15.81:0/2359002211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 msgr2=0x562fda079760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.924+0000 7fb2490a5740 1 --2- 172.21.15.81:0/2359002211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 0x562fda079760 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0b8ba0 tx=0x7fb22c0dad20 comp rx=0 tx=0).stop 2024-09-12T01:32:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.924+0000 7fb2490a5740 1 -- 172.21.15.81:0/2359002211 shutdown_connections 2024-09-12T01:32:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.924+0000 7fb2490a5740 1 --2- 172.21.15.81:0/2359002211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 0x562fda079760 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.924+0000 7fb2490a5740 1 --2- 172.21.15.81:0/2359002211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06c5d0 0x562fda06ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.924+0000 7fb2490a5740 1 --2- 172.21.15.81:0/2359002211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda06db40 0x562fda06c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.924+0000 7fb2490a5740 1 -- 172.21.15.81:0/2359002211 >> 172.21.15.81:0/2359002211 conn(0x562fda035310 msgr2=0x562fda068c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.924+0000 7fb2490a5740 1 -- 172.21.15.81:0/2359002211 shutdown_connections 2024-09-12T01:32:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.924+0000 7fb2490a5740 1 -- 172.21.15.81:0/2359002211 wait complete. 2024-09-12T01:32:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.925+0000 7fb2490a5740 1 -- start start 2024-09-12T01:32:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.925+0000 7fb2490a5740 1 Processor -- start 2024-09-12T01:32:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.925+0000 7fb2490a5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06c5d0 0x562fda076d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.925+0000 7fb2490a5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06db40 0x562fda074000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.925+0000 7fb2490a5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda077370 0x562fda0745d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.925+0000 7fb2490a5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562fda079e30 con 0x562fda06c5d0 2024-09-12T01:32:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.925+0000 7fb2490a5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562fd9f8d060 con 0x562fda077370 2024-09-12T01:32:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.925+0000 7fb2490a5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562fda079fb0 con 0x562fda06db40 2024-09-12T01:32:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.925+0000 7fb2490a5740 10 client.0 _ll_register_callbacks cb 0x562fd9ce08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.925+0000 7fb244a68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06c5d0 0x562fda076d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.925+0000 7fb244a68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06c5d0 0x562fda076d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48800/0 (socket says 172.21.15.81:48800) 2024-09-12T01:32:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.925+0000 7fb244a68640 1 -- 172.21.15.81:0/2736535080 learned_addr learned my addr 172.21.15.81:0/2736535080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.925+0000 7fb23ffff640 1 --2- 172.21.15.81:0/2736535080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06db40 0x562fda074000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb245269640 1 --2- 172.21.15.81:0/2736535080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda077370 0x562fda0745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb244a68640 1 -- 172.21.15.81:0/2736535080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06db40 msgr2=0x562fda074000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb244a68640 1 --2- 172.21.15.81:0/2736535080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06db40 0x562fda074000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb244a68640 1 -- 172.21.15.81:0/2736535080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda077370 msgr2=0x562fda0745d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb244a68640 1 --2- 172.21.15.81:0/2736535080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda077370 0x562fda0745d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb244a68640 1 -- 172.21.15.81:0/2736535080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fd9d433c0 con 0x562fda06c5d0 2024-09-12T01:32:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb244a68640 1 --2- 172.21.15.81:0/2736535080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06c5d0 0x562fda076d50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb234010820 tx=0x7fb234010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85efa820da518fd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb21ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:40.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb21ffff640 1 -- 172.21.15.81:0/2736535080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23400fb10 con 0x562fda06c5d0 2024-09-12T01:32:40.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb21ffff640 1 -- 172.21.15.81:0/2736535080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb23400fcb0 con 0x562fda06c5d0 2024-09-12T01:32:40.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb2490a5740 1 -- 172.21.15.81:0/2736535080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb22c0bc8d0 con 0x562fda06c5d0 2024-09-12T01:32:40.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb21ffff640 1 -- 172.21.15.81:0/2736535080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb234004020 con 0x562fda06c5d0 2024-09-12T01:32:40.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb2490a5740 10 client.16455 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:40.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb2490a5740 1 -- 172.21.15.81:0/2736535080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562fda0858a0 con 0x562fda06c5d0 2024-09-12T01:32:40.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb21ffff640 1 -- 172.21.15.81:0/2736535080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb22c0bc8d0 con 0x562fda06c5d0 2024-09-12T01:32:40.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.926+0000 7fb21ffff640 1 -- 172.21.15.81:0/2736535080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb234019410 con 0x562fda06c5d0 2024-09-12T01:32:40.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.927+0000 7fb2490a5740 10 client.16455 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:40.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.927+0000 7fb2490a5740 10 client.16455 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:32:40.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.927+0000 7fb2490a5740 20 client.16455 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:40.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.927+0000 7fb2490a5740 1 --2- 172.21.15.81:0/2736535080 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x562fda086d60 0x562fda0891c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.927+0000 7fb2490a5740 4 client.16455 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:32:40.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.927+0000 7fb2490a5740 1 -- 172.21.15.81:0/2736535080 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fd9fdf860 con 0x562fda086d60 2024-09-12T01:32:40.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.927+0000 7fb23ffff640 1 --2- 172.21.15.81:0/2736535080 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x562fda086d60 0x562fda0891c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.927+0000 7fb23ffff640 1 --2- 172.21.15.81:0/2736535080 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x562fda086d60 0x562fda0891c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a22eff576e4207b2 server_cookie=472fd4820d934332 in_seq=0 out_seq=0 2024-09-12T01:32:40.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.927+0000 7fb21ffff640 10 client.16455 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:32:40.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb21ffff640 1 -- 172.21.15.81:0/2736535080 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562fd9fdf860 con 0x562fda086d60 2024-09-12T01:32:40.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb21ffff640 10 client.16455 handle_command_reply: tid=0 2024-09-12T01:32:40.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb2490a5740 1 client.16455 shutdown 2024-09-12T01:32:40.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb2490a5740 1 -- 172.21.15.81:0/2736535080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06c5d0 msgr2=0x562fda076d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:40.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb2490a5740 1 --2- 172.21.15.81:0/2736535080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06c5d0 0x562fda076d50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb234010820 tx=0x7fb234010ce0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb2490a5740 1 -- 172.21.15.81:0/2736535080 shutdown_connections 2024-09-12T01:32:40.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb2490a5740 1 --2- 172.21.15.81:0/2736535080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda077370 0x562fda0745d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb2490a5740 1 --2- 172.21.15.81:0/2736535080 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x562fda086d60 0x562fda0891c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb2490a5740 1 --2- 172.21.15.81:0/2736535080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06db40 0x562fda074000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb2490a5740 1 --2- 172.21.15.81:0/2736535080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06c5d0 0x562fda076d50 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb21ffff640 0 client.16455 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:32:40.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb2490a5740 1 -- 172.21.15.81:0/2736535080 >> 172.21.15.81:0/2736535080 conn(0x562fda035310 msgr2=0x562fda06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:40.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb2490a5740 1 -- 172.21.15.81:0/2736535080 shutdown_connections 2024-09-12T01:32:40.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.928+0000 7fb2490a5740 1 -- 172.21.15.81:0/2736535080 wait complete. 2024-09-12T01:32:40.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.929+0000 7fb2490a5740 20 client.16455 trim_cache size 0 max 16384 2024-09-12T01:32:40.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.941+0000 7fb2490a5740 1 Processor -- start 2024-09-12T01:32:40.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.941+0000 7fb2490a5740 1 -- start start 2024-09-12T01:32:40.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.941+0000 7fb2490a5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06db40 0x562fda06d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.941+0000 7fb2490a5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda077370 0x562fda063ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.941+0000 7fb2490a5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda068f20 0x562fda067bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.941+0000 7fb2490a5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2401ad770 con 0x562fda06db40 2024-09-12T01:32:40.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.941+0000 7fb2490a5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb2401af2b0 con 0x562fda077370 2024-09-12T01:32:40.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.941+0000 7fb2490a5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb2401ade40 con 0x562fda068f20 2024-09-12T01:32:40.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb244a68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06db40 0x562fda06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb244a68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06db40 0x562fda06d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48810/0 (socket says 172.21.15.81:48810) 2024-09-12T01:32:40.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb244a68640 1 -- 172.21.15.81:0/666150265 learned_addr learned my addr 172.21.15.81:0/666150265 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:40.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb23ffff640 1 --2- 172.21.15.81:0/666150265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda077370 0x562fda063ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb244a68640 1 -- 172.21.15.81:0/666150265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda068f20 msgr2=0x562fda067bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:40.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb244a68640 1 --2- 172.21.15.81:0/666150265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda068f20 0x562fda067bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb244a68640 1 -- 172.21.15.81:0/666150265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda077370 msgr2=0x562fda063ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:40.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb244a68640 1 --2- 172.21.15.81:0/666150265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda077370 0x562fda063ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb244a68640 1 -- 172.21.15.81:0/666150265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fda089840 con 0x562fda06db40 2024-09-12T01:32:40.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb23ffff640 1 --2- 172.21.15.81:0/666150265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda077370 0x562fda063ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:40.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb244a68640 1 --2- 172.21.15.81:0/666150265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06db40 0x562fda06d300 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb234001eb0 tx=0x7fb23400a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6959d0bd69f51f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:40.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb22a7fc640 1 -- 172.21.15.81:0/666150265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234019aa0 con 0x562fda06db40 2024-09-12T01:32:40.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb22a7fc640 1 -- 172.21.15.81:0/666150265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb234019c40 con 0x562fda06db40 2024-09-12T01:32:40.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.942+0000 7fb22a7fc640 1 -- 172.21.15.81:0/666150265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2340052d0 con 0x562fda06db40 2024-09-12T01:32:40.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.943+0000 7fb2490a5740 1 -- 172.21.15.81:0/666150265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06db40 msgr2=0x562fda06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:40.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.943+0000 7fb2490a5740 1 --2- 172.21.15.81:0/666150265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06db40 0x562fda06d300 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb234001eb0 tx=0x7fb23400a6c0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.943+0000 7fb2490a5740 1 -- 172.21.15.81:0/666150265 shutdown_connections 2024-09-12T01:32:40.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.943+0000 7fb2490a5740 1 --2- 172.21.15.81:0/666150265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda068f20 0x562fda067bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.943+0000 7fb2490a5740 1 --2- 172.21.15.81:0/666150265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda077370 0x562fda063ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.943+0000 7fb2490a5740 1 --2- 172.21.15.81:0/666150265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda06db40 0x562fda06d300 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.943+0000 7fb2490a5740 1 -- 172.21.15.81:0/666150265 >> 172.21.15.81:0/666150265 conn(0x562fda035310 msgr2=0x562fda0674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:40.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.943+0000 7fb2490a5740 1 -- 172.21.15.81:0/666150265 shutdown_connections 2024-09-12T01:32:40.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.943+0000 7fb2490a5740 1 -- 172.21.15.81:0/666150265 wait complete. 2024-09-12T01:32:40.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.943+0000 7fb2490a5740 1 -- start start 2024-09-12T01:32:40.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.943+0000 7fb2490a5740 1 Processor -- start 2024-09-12T01:32:40.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb2490a5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda068f20 0x562fda07fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb2490a5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06db40 0x562fda07ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb2490a5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 0x562fda07b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb2490a5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2401aebe0 con 0x562fda077370 2024-09-12T01:32:40.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb2490a5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb2401ae510 con 0x562fda068f20 2024-09-12T01:32:40.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb2490a5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb2401ab770 con 0x562fda06db40 2024-09-12T01:32:40.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb2490a5740 10 client.0 _ll_register_callbacks cb 0x7fb23400a780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:40.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb245269640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 0x562fda07b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb245269640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 0x562fda07b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48814/0 (socket says 172.21.15.81:48814) 2024-09-12T01:32:40.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb245269640 1 -- 172.21.15.81:0/79794608 learned_addr learned my addr 172.21.15.81:0/79794608 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:40.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb244a68640 1 --2- 172.21.15.81:0/79794608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda068f20 0x562fda07fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb245269640 1 -- 172.21.15.81:0/79794608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06db40 msgr2=0x562fda07ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb245269640 1 --2- 172.21.15.81:0/79794608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06db40 0x562fda07ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb245269640 1 -- 172.21.15.81:0/79794608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda068f20 msgr2=0x562fda07fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb245269640 1 --2- 172.21.15.81:0/79794608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda068f20 0x562fda07fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb245269640 1 -- 172.21.15.81:0/79794608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fda07bb20 con 0x562fda077370 2024-09-12T01:32:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb244a68640 1 --2- 172.21.15.81:0/79794608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda068f20 0x562fda07fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb245269640 1 --2- 172.21.15.81:0/79794608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 0x562fda07b2f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb238003ba0 tx=0x7fb238004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3fe812bc3d3d63 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb21ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb21ffff640 1 -- 172.21.15.81:0/79794608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238013220 con 0x562fda077370 2024-09-12T01:32:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.944+0000 7fb21ffff640 1 -- 172.21.15.81:0/79794608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb238012450 con 0x562fda077370 2024-09-12T01:32:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.945+0000 7fb2490a5740 1 -- 172.21.15.81:0/79794608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb234019c40 con 0x562fda077370 2024-09-12T01:32:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.945+0000 7fb21ffff640 1 -- 172.21.15.81:0/79794608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb238012650 con 0x562fda077370 2024-09-12T01:32:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.945+0000 7fb2490a5740 10 client.16461 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:40.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.945+0000 7fb2490a5740 1 -- 172.21.15.81:0/79794608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562fda0f1b80 con 0x562fda077370 2024-09-12T01:32:40.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.945+0000 7fb21ffff640 1 -- 172.21.15.81:0/79794608 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb238012cd0 con 0x562fda077370 2024-09-12T01:32:40.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.945+0000 7fb21ffff640 1 -- 172.21.15.81:0/79794608 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb23802b7f0 con 0x562fda077370 2024-09-12T01:32:40.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.945+0000 7fb2490a5740 10 client.16461 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:40.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.945+0000 7fb2490a5740 10 client.16461 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:32:40.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.945+0000 7fb2490a5740 20 client.16461 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:40.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.945+0000 7fb2490a5740 1 --2- 172.21.15.81:0/79794608 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x562fda0f2300 0x562fda0f4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:40.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.945+0000 7fb2490a5740 4 client.16461 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:32:40.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.945+0000 7fb2490a5740 1 -- 172.21.15.81:0/79794608 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb234019c40 con 0x562fda0f2300 2024-09-12T01:32:40.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb244a68640 1 --2- 172.21.15.81:0/79794608 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x562fda0f2300 0x562fda0f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:40.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb244a68640 1 --2- 172.21.15.81:0/79794608 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x562fda0f2300 0x562fda0f4720 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dabf18cb84f0be31 server_cookie=1a79d9c981ab6d8e in_seq=0 out_seq=0 2024-09-12T01:32:40.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb21ffff640 10 client.16461 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:32:40.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb21ffff640 1 -- 172.21.15.81:0/79794608 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb234019c40 con 0x562fda0f2300 2024-09-12T01:32:40.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb21ffff640 10 client.16461 handle_command_reply: tid=0 2024-09-12T01:32:40.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb2490a5740 1 client.16461 shutdown 2024-09-12T01:32:40.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb2490a5740 1 -- 172.21.15.81:0/79794608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 msgr2=0x562fda07b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:40.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb2490a5740 1 --2- 172.21.15.81:0/79794608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 0x562fda07b2f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb238003ba0 tx=0x7fb238004ab0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb2490a5740 1 -- 172.21.15.81:0/79794608 shutdown_connections 2024-09-12T01:32:40.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb2490a5740 1 --2- 172.21.15.81:0/79794608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fda077370 0x562fda07b2f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb2490a5740 1 --2- 172.21.15.81:0/79794608 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x562fda0f2300 0x562fda0f4720 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb2490a5740 1 --2- 172.21.15.81:0/79794608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562fda06db40 0x562fda07ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb2490a5740 1 --2- 172.21.15.81:0/79794608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562fda068f20 0x562fda07fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb2490a5740 1 -- 172.21.15.81:0/79794608 >> 172.21.15.81:0/79794608 conn(0x562fda035310 msgr2=0x562fda067d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:40.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.946+0000 7fb21ffff640 0 client.16461 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:32:40.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.947+0000 7fb2490a5740 1 -- 172.21.15.81:0/79794608 shutdown_connections 2024-09-12T01:32:40.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.947+0000 7fb2490a5740 1 -- 172.21.15.81:0/79794608 wait complete. 2024-09-12T01:32:40.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.947+0000 7fb2490a5740 20 client.16461 trim_cache size 0 max 16384 2024-09-12T01:32:40.969 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:32:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.947+0000 7fb246ccc640 1 -- 172.21.15.81:0/1910112324 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb2300a2cf0 msgr2=0x7fb2300a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.947+0000 7fb246ccc640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb2300a2cf0 0x7fb2300a51b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb238005fd0 tx=0x7fb238009a00 comp rx=0 tx=0).stop 2024-09-12T01:32:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.947+0000 7fb246ccc640 1 -- 172.21.15.81:0/1910112324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240102570 msgr2=0x7fb2401998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.947+0000 7fb246ccc640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240102570 0x7fb2401998d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb22c006010 tx=0x7fb22c003c10 comp rx=0 tx=0).stop 2024-09-12T01:32:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.947+0000 7fb246ccc640 1 -- 172.21.15.81:0/1910112324 shutdown_connections 2024-09-12T01:32:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.947+0000 7fb246ccc640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb2300a2cf0 0x7fb2300a51b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.947+0000 7fb246ccc640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb240102ef0 0x7fb2401a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.947+0000 7fb246ccc640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb240102570 0x7fb2401998d0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.947+0000 7fb246ccc640 1 --2- 172.21.15.81:0/1910112324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb240100e20 0x7fb240199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.948+0000 7fb246ccc640 1 -- 172.21.15.81:0/1910112324 >> 172.21.15.81:0/1910112324 conn(0x7fb2400fc7d0 msgr2=0x7fb2400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.948+0000 7fb246ccc640 1 -- 172.21.15.81:0/1910112324 shutdown_connections 2024-09-12T01:32:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:40.948+0000 7fb246ccc640 1 -- 172.21.15.81:0/1910112324 wait complete. 2024-09-12T01:32:41.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:41 smithi081 ceph-mon[30920]: pgmap v141: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:32:41.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:41 smithi100 ceph-mon[35275]: pgmap v141: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:32:41.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:41 smithi189 ceph-mon[35357]: pgmap v141: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:32:41.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:32:42.050 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:32:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.518+0000 7f8813641640 1 -- 172.21.15.81:0/1781301484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c101df0 msgr2=0x7f880c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.518+0000 7f8813641640 1 --2- 172.21.15.81:0/1781301484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c101df0 0x7f880c1021d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009ca0 tx=0x7f87fc02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.519+0000 7f8813641640 1 -- 172.21.15.81:0/1781301484 shutdown_connections 2024-09-12T01:32:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.519+0000 7f8813641640 1 --2- 172.21.15.81:0/1781301484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f880c106f20 0x7f880c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.519+0000 7f8813641640 1 --2- 172.21.15.81:0/1781301484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f880c1027a0 0x7f880c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.519+0000 7f8813641640 1 --2- 172.21.15.81:0/1781301484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c101df0 0x7f880c1021d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.519+0000 7f8813641640 1 -- 172.21.15.81:0/1781301484 >> 172.21.15.81:0/1781301484 conn(0x7f880c0fd8f0 msgr2=0x7f880c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.519+0000 7f8813641640 1 -- 172.21.15.81:0/1781301484 shutdown_connections 2024-09-12T01:32:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.519+0000 7f8813641640 1 -- 172.21.15.81:0/1781301484 wait complete. 2024-09-12T01:32:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.519+0000 7f8813641640 1 Processor -- start 2024-09-12T01:32:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.519+0000 7f8813641640 1 -- start start 2024-09-12T01:32:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.519+0000 7f8813641640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f880c101df0 0x7f880c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.519+0000 7f8813641640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c1027a0 0x7f880c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.519+0000 7f8813641640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f880c106f20 0x7f880c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8813641640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f880c112020 con 0x7f880c1027a0 2024-09-12T01:32:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8813641640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f880c111ea0 con 0x7f880c101df0 2024-09-12T01:32:42.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8813641640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1121a0 con 0x7f880c106f20 2024-09-12T01:32:42.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8810bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c1027a0 0x7f880c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8810bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c1027a0 0x7f880c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54650/0 (socket says 172.21.15.81:54650) 2024-09-12T01:32:42.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8810bdc640 1 -- 172.21.15.81:0/2599913133 learned_addr learned my addr 172.21.15.81:0/2599913133 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:42.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f88113dd640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f880c101df0 0x7f880c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8811bde640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f880c106f20 0x7f880c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8810bdc640 1 -- 172.21.15.81:0/2599913133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f880c106f20 msgr2=0x7f880c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:42.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8810bdc640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f880c106f20 0x7f880c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8810bdc640 1 -- 172.21.15.81:0/2599913133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f880c101df0 msgr2=0x7f880c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:42.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8810bdc640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f880c101df0 0x7f880c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8810bdc640 1 -- 172.21.15.81:0/2599913133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880c1a6a30 con 0x7f880c1027a0 2024-09-12T01:32:42.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8810bdc640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c1027a0 0x7f880c074a30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f880000b4a0 tx=0x7f880000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:42.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f880a7fc640 1 -- 172.21.15.81:0/2599913133 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800014070 con 0x7f880c1027a0 2024-09-12T01:32:42.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f880a7fc640 1 -- 172.21.15.81:0/2599913133 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8800010af0 con 0x7f880c1027a0 2024-09-12T01:32:42.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f8813641640 1 -- 172.21.15.81:0/2599913133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880c1a6d20 con 0x7f880c1027a0 2024-09-12T01:32:42.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.520+0000 7f880a7fc640 1 -- 172.21.15.81:0/2599913133 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800017d10 con 0x7f880c1027a0 2024-09-12T01:32:42.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.521+0000 7f8813641640 1 -- 172.21.15.81:0/2599913133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f880c1a7250 con 0x7f880c1027a0 2024-09-12T01:32:42.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.523+0000 7f880a7fc640 1 -- 172.21.15.81:0/2599913133 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f8800017070 con 0x7f880c1027a0 2024-09-12T01:32:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.523+0000 7f8815a1a740 1 Processor -- start 2024-09-12T01:32:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.523+0000 7f8815a1a740 1 -- start start 2024-09-12T01:32:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.523+0000 7f8815a1a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346d1b40 0x55e2346d0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.523+0000 7f8815a1a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 0x55e2346d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.523+0000 7f8815a1a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346db370 0x55e2346dd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.523+0000 7f8815a1a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e2346362f0 con 0x55e2346d05d0 2024-09-12T01:32:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.523+0000 7f8815a1a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e2345ddcf0 con 0x55e2346db370 2024-09-12T01:32:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.523+0000 7f8815a1a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e2346322b0 con 0x55e2346d1b40 2024-09-12T01:32:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.523+0000 7f880a7fc640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f87f40a2d70 0x7f87f40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f88113dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 0x55e2346d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f8811bde640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f87f40a2d70 0x7f87f40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f88113dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 0x55e2346d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54662/0 (socket says 172.21.15.81:54662) 2024-09-12T01:32:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f88113dd640 1 -- 172.21.15.81:0/1699373417 learned_addr learned my addr 172.21.15.81:0/1699373417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f8811bde640 1 --2- 172.21.15.81:0/1699373417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346d1b40 0x55e2346d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f880a7fc640 1 -- 172.21.15.81:0/2599913133 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f88000ce5b0 con 0x7f880c1027a0 2024-09-12T01:32:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f8810bdc640 1 --2- 172.21.15.81:0/1699373417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346db370 0x55e2346dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f88113dd640 1 -- 172.21.15.81:0/1699373417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346d1b40 msgr2=0x55e2346d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f88113dd640 1 --2- 172.21.15.81:0/1699373417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346d1b40 0x55e2346d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f88113dd640 1 -- 172.21.15.81:0/1699373417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346db370 msgr2=0x55e2346dd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f88113dd640 1 --2- 172.21.15.81:0/1699373417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346db370 0x55e2346dd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f88113dd640 1 -- 172.21.15.81:0/1699373417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2345c23a0 con 0x55e2346d05d0 2024-09-12T01:32:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f8811bde640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f87f40a2d70 0x7f87f40a5230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8804006e10 tx=0x7f88040098b0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f88113dd640 1 --2- 172.21.15.81:0/1699373417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 0x55e2346d0a10 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009ca0 tx=0x7f87fc02f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2005f3984d9ad14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f87f37fe640 1 -- 172.21.15.81:0/1699373417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc049070 con 0x55e2346d05d0 2024-09-12T01:32:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f87f37fe640 1 -- 172.21.15.81:0/1699373417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87fc036040 con 0x55e2346d05d0 2024-09-12T01:32:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.524+0000 7f87f37fe640 1 -- 172.21.15.81:0/1699373417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc02fc60 con 0x55e2346d05d0 2024-09-12T01:32:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.525+0000 7f8815a1a740 1 -- 172.21.15.81:0/1699373417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 msgr2=0x55e2346d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.525+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1699373417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 0x55e2346d0a10 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009ca0 tx=0x7f87fc02f450 comp rx=0 tx=0).stop 2024-09-12T01:32:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.525+0000 7f8815a1a740 1 -- 172.21.15.81:0/1699373417 shutdown_connections 2024-09-12T01:32:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.525+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1699373417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346db370 0x55e2346dd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.525+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1699373417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 0x55e2346d0a10 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.525+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1699373417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346d1b40 0x55e2346d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.525+0000 7f8815a1a740 1 -- 172.21.15.81:0/1699373417 >> 172.21.15.81:0/1699373417 conn(0x55e234699310 msgr2=0x55e2346ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.525+0000 7f8815a1a740 1 -- 172.21.15.81:0/1699373417 shutdown_connections 2024-09-12T01:32:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.525+0000 7f8815a1a740 1 -- 172.21.15.81:0/1699373417 wait complete. 2024-09-12T01:32:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.526+0000 7f8815a1a740 1 -- start start 2024-09-12T01:32:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.526+0000 7f8815a1a740 1 Processor -- start 2024-09-12T01:32:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.526+0000 7f8815a1a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346d05d0 0x55e2346dad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.526+0000 7f8815a1a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 0x55e2346d7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.526+0000 7f8815a1a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346db370 0x55e2346d8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.526+0000 7f8815a1a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e2346dde90 con 0x55e2346d1b40 2024-09-12T01:32:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.526+0000 7f8815a1a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e2345f1060 con 0x55e2346d05d0 2024-09-12T01:32:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.526+0000 7f8815a1a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e2346de010 con 0x55e2346db370 2024-09-12T01:32:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.526+0000 7f8815a1a740 10 client.0 _ll_register_callbacks cb 0x55e2343448c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.526+0000 7f8810bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 0x55e2346d7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.526+0000 7f8810bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 0x55e2346d7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54666/0 (socket says 172.21.15.81:54666) 2024-09-12T01:32:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.526+0000 7f8810bdc640 1 -- 172.21.15.81:0/1987704847 learned_addr learned my addr 172.21.15.81:0/1987704847 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.526+0000 7f88113dd640 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346d05d0 0x55e2346dad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8810bdc640 1 -- 172.21.15.81:0/1987704847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346db370 msgr2=0x55e2346d8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8811bde640 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346db370 0x55e2346d8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8810bdc640 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346db370 0x55e2346d8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8810bdc640 1 -- 172.21.15.81:0/1987704847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346d05d0 msgr2=0x55e2346dad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8810bdc640 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346d05d0 0x55e2346dad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8810bdc640 1 -- 172.21.15.81:0/1987704847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2343a73c0 con 0x55e2346d1b40 2024-09-12T01:32:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f88113dd640 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346d05d0 0x55e2346dad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8811bde640 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346db370 0x55e2346d8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8810bdc640 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 0x55e2346d7fd0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f880009abf0 tx=0x7f880009a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a5823c5f7efdfb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f87f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f87f0ff9640 1 -- 172.21.15.81:0/1987704847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88000b1020 con 0x55e2346d1b40 2024-09-12T01:32:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f87f0ff9640 1 -- 172.21.15.81:0/1987704847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f88000982b0 con 0x55e2346d1b40 2024-09-12T01:32:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8815a1a740 1 -- 172.21.15.81:0/1987704847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87fc036040 con 0x55e2346d1b40 2024-09-12T01:32:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f87f0ff9640 1 -- 172.21.15.81:0/1987704847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f880001e040 con 0x55e2346d1b40 2024-09-12T01:32:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8815a1a740 10 client.16473 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8815a1a740 1 -- 172.21.15.81:0/1987704847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e2346e98e0 con 0x55e2346d1b40 2024-09-12T01:32:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f87f0ff9640 1 -- 172.21.15.81:0/1987704847 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87fc036040 con 0x55e2346d1b40 2024-09-12T01:32:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f87f0ff9640 1 -- 172.21.15.81:0/1987704847 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f88000cbf50 con 0x55e2346d1b40 2024-09-12T01:32:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8815a1a740 10 client.16473 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8815a1a740 10 client.16473 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:32:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8815a1a740 20 client.16473 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.527+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55e2346eac80 0x55e2346ed090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.528+0000 7f8815a1a740 4 client.16473 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:32:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.528+0000 7f8815a1a740 1 -- 172.21.15.81:0/1987704847 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e234643860 con 0x55e2346eac80 2024-09-12T01:32:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.528+0000 7f88113dd640 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55e2346eac80 0x55e2346ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.528+0000 7f88113dd640 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55e2346eac80 0x55e2346ed090 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=331ca58def003cc6 server_cookie=e9eb61f3112d6b52 in_seq=0 out_seq=0 2024-09-12T01:32:42.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.528+0000 7f87f0ff9640 10 client.16473 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:32:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f87f0ff9640 1 -- 172.21.15.81:0/1987704847 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e234643860 con 0x55e2346eac80 2024-09-12T01:32:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f87f0ff9640 10 client.16473 handle_command_reply: tid=0 2024-09-12T01:32:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f8815a1a740 1 client.16473 shutdown 2024-09-12T01:32:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f8815a1a740 1 -- 172.21.15.81:0/1987704847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 msgr2=0x55e2346d7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 0x55e2346d7fd0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f880009abf0 tx=0x7f880009a680 comp rx=0 tx=0).stop 2024-09-12T01:32:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f8815a1a740 1 -- 172.21.15.81:0/1987704847 shutdown_connections 2024-09-12T01:32:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55e2346eac80 0x55e2346ed090 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346db370 0x55e2346d8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 0x55e2346d7fd0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1987704847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346d05d0 0x55e2346dad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f8815a1a740 1 -- 172.21.15.81:0/1987704847 >> 172.21.15.81:0/1987704847 conn(0x55e234699310 msgr2=0x55e2346d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:42.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f87f0ff9640 0 client.16473 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:32:42.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f8815a1a740 1 -- 172.21.15.81:0/1987704847 shutdown_connections 2024-09-12T01:32:42.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f8815a1a740 1 -- 172.21.15.81:0/1987704847 wait complete. 2024-09-12T01:32:42.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.529+0000 7f8815a1a740 20 client.16473 trim_cache size 0 max 16384 2024-09-12T01:32:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.542+0000 7f8815a1a740 1 Processor -- start 2024-09-12T01:32:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.542+0000 7f8815a1a740 1 -- start start 2024-09-12T01:32:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.542+0000 7f8815a1a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346d05d0 0x55e2346cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.542+0000 7f8815a1a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 0x55e2346e7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.542+0000 7f8815a1a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346db370 0x55e2346d3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.542+0000 7f8815a1a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1af910 con 0x55e2346d1b40 2024-09-12T01:32:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.542+0000 7f8815a1a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1b1450 con 0x55e2346db370 2024-09-12T01:32:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.542+0000 7f8815a1a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1affe0 con 0x55e2346d05d0 2024-09-12T01:32:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.542+0000 7f8810bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 0x55e2346e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f8810bdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 0x55e2346e7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54668/0 (socket says 172.21.15.81:54668) 2024-09-12T01:32:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f8810bdc640 1 -- 172.21.15.81:0/1744685075 learned_addr learned my addr 172.21.15.81:0/1744685075 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f8811bde640 1 --2- 172.21.15.81:0/1744685075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346db370 0x55e2346d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f88113dd640 1 --2- 172.21.15.81:0/1744685075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346d05d0 0x55e2346cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f8810bdc640 1 -- 172.21.15.81:0/1744685075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346d05d0 msgr2=0x55e2346cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f8810bdc640 1 --2- 172.21.15.81:0/1744685075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346d05d0 0x55e2346cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f8810bdc640 1 -- 172.21.15.81:0/1744685075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346db370 msgr2=0x55e2346d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f8810bdc640 1 --2- 172.21.15.81:0/1744685075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346db370 0x55e2346d3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f8810bdc640 1 -- 172.21.15.81:0/1744685075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2346c7a30 con 0x55e2346d1b40 2024-09-12T01:32:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f8811bde640 1 --2- 172.21.15.81:0/1744685075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346db370 0x55e2346d3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f8810bdc640 1 --2- 172.21.15.81:0/1744685075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 0x55e2346e7130 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f88000b7040 tx=0x7f880009a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d23d59cc2c8f38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f87f2ffd640 1 -- 172.21.15.81:0/1744685075 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88000b1070 con 0x55e2346d1b40 2024-09-12T01:32:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f87f2ffd640 1 -- 172.21.15.81:0/1744685075 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88000a3820 con 0x55e2346d1b40 2024-09-12T01:32:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.543+0000 7f87f2ffd640 1 -- 172.21.15.81:0/1744685075 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88000996f0 con 0x55e2346d1b40 2024-09-12T01:32:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.544+0000 7f8815a1a740 1 -- 172.21.15.81:0/1744685075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 msgr2=0x55e2346e7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.544+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1744685075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 0x55e2346e7130 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f88000b7040 tx=0x7f880009a6f0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.544+0000 7f8815a1a740 1 -- 172.21.15.81:0/1744685075 shutdown_connections 2024-09-12T01:32:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.544+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1744685075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346db370 0x55e2346d3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.544+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1744685075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d1b40 0x55e2346e7130 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.544+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1744685075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346d05d0 0x55e2346cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.544+0000 7f8815a1a740 1 -- 172.21.15.81:0/1744685075 >> 172.21.15.81:0/1744685075 conn(0x55e234699310 msgr2=0x55e2346cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.544+0000 7f8815a1a740 1 -- 172.21.15.81:0/1744685075 shutdown_connections 2024-09-12T01:32:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.544+0000 7f8815a1a740 1 -- 172.21.15.81:0/1744685075 wait complete. 2024-09-12T01:32:42.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.544+0000 7f8815a1a740 1 -- start start 2024-09-12T01:32:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.544+0000 7f8815a1a740 1 Processor -- start 2024-09-12T01:32:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f8815a1a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 0x55e2346e3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f8815a1a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346d1b40 0x55e2346dea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f8815a1a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346db370 0x55e2346defb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f8815a1a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1b0d80 con 0x55e2346d05d0 2024-09-12T01:32:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f8815a1a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1b06b0 con 0x55e2346d1b40 2024-09-12T01:32:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f8815a1a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f880c1ad8f0 con 0x55e2346db370 2024-09-12T01:32:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f8815a1a740 10 client.0 _ll_register_callbacks cb 0x7f880000b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f88113dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 0x55e2346e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f88113dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 0x55e2346e3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54674/0 (socket says 172.21.15.81:54674) 2024-09-12T01:32:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f88113dd640 1 -- 172.21.15.81:0/1386772355 learned_addr learned my addr 172.21.15.81:0/1386772355 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f8810bdc640 1 --2- 172.21.15.81:0/1386772355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346d1b40 0x55e2346dea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f88113dd640 1 -- 172.21.15.81:0/1386772355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346db370 msgr2=0x55e2346defb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f88113dd640 1 --2- 172.21.15.81:0/1386772355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346db370 0x55e2346defb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f88113dd640 1 -- 172.21.15.81:0/1386772355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346d1b40 msgr2=0x55e2346dea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f88113dd640 1 --2- 172.21.15.81:0/1386772355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346d1b40 0x55e2346dea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f88113dd640 1 -- 172.21.15.81:0/1386772355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2346df4f0 con 0x55e2346d05d0 2024-09-12T01:32:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f8810bdc640 1 --2- 172.21.15.81:0/1386772355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346d1b40 0x55e2346dea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f88113dd640 1 --2- 172.21.15.81:0/1386772355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 0x55e2346e3740 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f87fc047040 tx=0x7f87fc02f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddbff567543e271 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f87f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f87f0ff9640 1 -- 172.21.15.81:0/1386772355 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87fc049040 con 0x55e2346d05d0 2024-09-12T01:32:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f87f0ff9640 1 -- 172.21.15.81:0/1386772355 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f87fc003970 con 0x55e2346d05d0 2024-09-12T01:32:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f8815a1a740 1 -- 172.21.15.81:0/1386772355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88000a3820 con 0x55e2346d05d0 2024-09-12T01:32:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.545+0000 7f87f0ff9640 1 -- 172.21.15.81:0/1386772355 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f87fc060050 con 0x55e2346d05d0 2024-09-12T01:32:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.546+0000 7f8815a1a740 10 client.16479 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.546+0000 7f8815a1a740 1 -- 172.21.15.81:0/1386772355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e2347556e0 con 0x55e2346d05d0 2024-09-12T01:32:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.546+0000 7f87f0ff9640 1 -- 172.21.15.81:0/1386772355 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88000a3820 con 0x55e2346d05d0 2024-09-12T01:32:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.546+0000 7f87f0ff9640 1 -- 172.21.15.81:0/1386772355 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f87fc02f8f0 con 0x55e2346d05d0 2024-09-12T01:32:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.546+0000 7f8815a1a740 10 client.16479 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.546+0000 7f8815a1a740 10 client.16479 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:32:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.546+0000 7f8815a1a740 20 client.16479 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.546+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1386772355 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55e234755b30 0x55e234757f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.546+0000 7f8815a1a740 4 client.16479 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:32:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.546+0000 7f8815a1a740 1 -- 172.21.15.81:0/1386772355 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e23463dd70 con 0x55e234755b30 2024-09-12T01:32:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.546+0000 7f8810bdc640 1 --2- 172.21.15.81:0/1386772355 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55e234755b30 0x55e234757f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f87f0ff9640 10 client.16479 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:32:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f8810bdc640 1 --2- 172.21.15.81:0/1386772355 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55e234755b30 0x55e234757f20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f83bca2cd9c148c5 server_cookie=57bcb5846d70a665 in_seq=0 out_seq=0 2024-09-12T01:32:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f87f0ff9640 1 -- 172.21.15.81:0/1386772355 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e23463dd70 con 0x55e234755b30 2024-09-12T01:32:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f87f0ff9640 10 client.16479 handle_command_reply: tid=0 2024-09-12T01:32:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f8815a1a740 1 client.16479 shutdown 2024-09-12T01:32:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f8815a1a740 1 -- 172.21.15.81:0/1386772355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 msgr2=0x55e2346e3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1386772355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 0x55e2346e3740 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f87fc047040 tx=0x7f87fc02f720 comp rx=0 tx=0).stop 2024-09-12T01:32:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f8815a1a740 1 -- 172.21.15.81:0/1386772355 shutdown_connections 2024-09-12T01:32:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1386772355 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55e234755b30 0x55e234757f20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1386772355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2346db370 0x55e2346defb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1386772355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e2346d1b40 0x55e2346dea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f87f0ff9640 0 client.16479 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:32:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f8815a1a740 1 --2- 172.21.15.81:0/1386772355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2346d05d0 0x55e2346e3740 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f8815a1a740 1 -- 172.21.15.81:0/1386772355 >> 172.21.15.81:0/1386772355 conn(0x55e234699310 msgr2=0x55e2346d9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f8815a1a740 1 -- 172.21.15.81:0/1386772355 shutdown_connections 2024-09-12T01:32:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f8815a1a740 1 -- 172.21.15.81:0/1386772355 wait complete. 2024-09-12T01:32:42.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.547+0000 7f8815a1a740 20 client.16479 trim_cache size 0 max 16384 2024-09-12T01:32:42.554 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:32:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.548+0000 7f8813641640 1 -- 172.21.15.81:0/2599913133 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f87f40a2d70 msgr2=0x7f87f40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.548+0000 7f8813641640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f87f40a2d70 0x7f87f40a5230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8804006e10 tx=0x7f88040098b0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.548+0000 7f8813641640 1 -- 172.21.15.81:0/2599913133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c1027a0 msgr2=0x7f880c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.548+0000 7f8813641640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c1027a0 0x7f880c074a30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f880000b4a0 tx=0x7f880000b960 comp rx=0 tx=0).stop 2024-09-12T01:32:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.548+0000 7f8813641640 1 -- 172.21.15.81:0/2599913133 shutdown_connections 2024-09-12T01:32:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.548+0000 7f8813641640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f87f40a2d70 0x7f87f40a5230 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.548+0000 7f8813641640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f880c106f20 0x7f880c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.548+0000 7f8813641640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c1027a0 0x7f880c074a30 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.548+0000 7f8813641640 1 --2- 172.21.15.81:0/2599913133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f880c101df0 0x7f880c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.548+0000 7f8813641640 1 -- 172.21.15.81:0/2599913133 >> 172.21.15.81:0/2599913133 conn(0x7f880c0fd8f0 msgr2=0x7f880c0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.548+0000 7f8813641640 1 -- 172.21.15.81:0/2599913133 shutdown_connections 2024-09-12T01:32:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:42.548+0000 7f8813641640 1 -- 172.21.15.81:0/2599913133 wait complete. 2024-09-12T01:32:43.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:32:43.317 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:43 smithi081 ceph-mon[30920]: pgmap v142: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:43.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:43 smithi100 ceph-mon[35275]: pgmap v142: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:43.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:43 smithi189 ceph-mon[35357]: pgmap v142: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:43.538 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:32:44.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.027+0000 7f27d2f2b640 1 -- 172.21.15.81:0/1863005109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27cc102570 msgr2=0x7f27cc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.027+0000 7f27d2f2b640 1 --2- 172.21.15.81:0/1863005109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27cc102570 0x7f27cc1029b0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009900 tx=0x7f27b402a480 comp rx=0 tx=0).stop 2024-09-12T01:32:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.027+0000 7f27d2f2b640 1 -- 172.21.15.81:0/1863005109 shutdown_connections 2024-09-12T01:32:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.027+0000 7f27d2f2b640 1 --2- 172.21.15.81:0/1863005109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc102ef0 0x7f27cc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.027+0000 7f27d2f2b640 1 --2- 172.21.15.81:0/1863005109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27cc102570 0x7f27cc1029b0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.027+0000 7f27d2f2b640 1 --2- 172.21.15.81:0/1863005109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc100e20 0x7f27cc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.027+0000 7f27d2f2b640 1 -- 172.21.15.81:0/1863005109 >> 172.21.15.81:0/1863005109 conn(0x7f27cc0fc7d0 msgr2=0x7f27cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.027+0000 7f27d2f2b640 1 -- 172.21.15.81:0/1863005109 shutdown_connections 2024-09-12T01:32:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.027+0000 7f27d2f2b640 1 -- 172.21.15.81:0/1863005109 wait complete. 2024-09-12T01:32:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.027+0000 7f27d2f2b640 1 Processor -- start 2024-09-12T01:32:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.027+0000 7f27d2f2b640 1 -- start start 2024-09-12T01:32:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d2f2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27cc100e20 0x7f27cc197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d2f2b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc102570 0x7f27cc1976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d2f2b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc102ef0 0x7f27cc197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d2f2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc110fa0 con 0x7f27cc100e20 2024-09-12T01:32:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d2f2b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc110e20 con 0x7f27cc102570 2024-09-12T01:32:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d2f2b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc111120 con 0x7f27cc102ef0 2024-09-12T01:32:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d0cc7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27cc100e20 0x7f27cc197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d0cc7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27cc100e20 0x7f27cc197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54690/0 (socket says 172.21.15.81:54690) 2024-09-12T01:32:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d0cc7640 1 -- 172.21.15.81:0/4035153615 learned_addr learned my addr 172.21.15.81:0/4035153615 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d14c8640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc102ef0 0x7f27cc197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27cbfff640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc102570 0x7f27cc1976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d0cc7640 1 -- 172.21.15.81:0/4035153615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc102ef0 msgr2=0x7f27cc197be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d0cc7640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc102ef0 0x7f27cc197be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d0cc7640 1 -- 172.21.15.81:0/4035153615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc102570 msgr2=0x7f27cc1976a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d0cc7640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc102570 0x7f27cc1976a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d0cc7640 1 -- 172.21.15.81:0/4035153615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc1a69d0 con 0x7f27cc100e20 2024-09-12T01:32:44.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27cbfff640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc102570 0x7f27cc1976a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:44.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d0cc7640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27cc100e20 0x7f27cc197160 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00ba50 tx=0x7f27bc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:44.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27c9ffb640 1 -- 172.21.15.81:0/4035153615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc019070 con 0x7f27cc100e20 2024-09-12T01:32:44.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27c9ffb640 1 -- 172.21.15.81:0/4035153615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27bc00cbe0 con 0x7f27cc100e20 2024-09-12T01:32:44.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.028+0000 7f27d2f2b640 1 -- 172.21.15.81:0/4035153615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27cc1a6cc0 con 0x7f27cc100e20 2024-09-12T01:32:44.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.029+0000 7f27c9ffb640 1 -- 172.21.15.81:0/4035153615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0076e0 con 0x7f27cc100e20 2024-09-12T01:32:44.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.029+0000 7f27d2f2b640 1 -- 172.21.15.81:0/4035153615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27cc1a7270 con 0x7f27cc100e20 2024-09-12T01:32:44.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.031+0000 7f27c9ffb640 1 -- 172.21.15.81:0/4035153615 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f27bc01c070 con 0x7f27cc100e20 2024-09-12T01:32:44.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.031+0000 7f27d5304740 1 Processor -- start 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.031+0000 7f27d5304740 1 -- start start 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.031+0000 7f27c9ffb640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f27b80a2d70 0x7f27b80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d5304740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557271809b40 0x557271808090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d5304740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572718085d0 0x557271808a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d14c8640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f27b80a2d70 0x7f27b80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27c9ffb640 1 -- 172.21.15.81:0/4035153615 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f27bc0ce8c0 con 0x7f27cc100e20 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d5304740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x557271815760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d5304740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55727176e2f0 con 0x557271813370 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d5304740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557271715cf0 con 0x557271809b40 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d5304740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55727176a2b0 con 0x5572718085d0 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d0cc7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557271809b40 0x557271808090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d14c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x557271815760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d0cc7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557271809b40 0x557271808090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:48008/0 (socket says 172.21.15.81:48008) 2024-09-12T01:32:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d0cc7640 1 -- 172.21.15.81:0/4265761172 learned_addr learned my addr 172.21.15.81:0/4265761172 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d14c8640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f27b80a2d70 0x7f27b80a5230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f27c4013460 tx=0x7f27c4013860 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d14c8640 1 -- 172.21.15.81:0/4265761172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572718085d0 msgr2=0x557271808a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:32:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d14c8640 1 --2- 172.21.15.81:0/4265761172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572718085d0 0x557271808a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d14c8640 1 -- 172.21.15.81:0/4265761172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557271809b40 msgr2=0x557271808090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d14c8640 1 --2- 172.21.15.81:0/4265761172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557271809b40 0x557271808090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d14c8640 1 -- 172.21.15.81:0/4265761172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572716fa3a0 con 0x557271813370 2024-09-12T01:32:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.032+0000 7f27d14c8640 1 --2- 172.21.15.81:0/4265761172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x557271815760 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f27c40117a0 tx=0x7f27c401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf422abd4502b85d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.033+0000 7f27c2ffd640 1 -- 172.21.15.81:0/4265761172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4005020 con 0x557271813370 2024-09-12T01:32:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.033+0000 7f27c2ffd640 1 -- 172.21.15.81:0/4265761172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c401e830 con 0x557271813370 2024-09-12T01:32:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.033+0000 7f27c2ffd640 1 -- 172.21.15.81:0/4265761172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4004b00 con 0x557271813370 2024-09-12T01:32:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.033+0000 7f27d5304740 1 -- 172.21.15.81:0/4265761172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 msgr2=0x557271815760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.033+0000 7f27d5304740 1 --2- 172.21.15.81:0/4265761172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x557271815760 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f27c40117a0 tx=0x7f27c401e000 comp rx=0 tx=0).stop 2024-09-12T01:32:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.033+0000 7f27d5304740 1 -- 172.21.15.81:0/4265761172 shutdown_connections 2024-09-12T01:32:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.033+0000 7f27d5304740 1 --2- 172.21.15.81:0/4265761172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x557271815760 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.033+0000 7f27d5304740 1 --2- 172.21.15.81:0/4265761172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572718085d0 0x557271808a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.033+0000 7f27d5304740 1 --2- 172.21.15.81:0/4265761172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557271809b40 0x557271808090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.033+0000 7f27d5304740 1 -- 172.21.15.81:0/4265761172 >> 172.21.15.81:0/4265761172 conn(0x5572717d1310 msgr2=0x557271804c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.033+0000 7f27d5304740 1 -- 172.21.15.81:0/4265761172 shutdown_connections 2024-09-12T01:32:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.033+0000 7f27d5304740 1 -- 172.21.15.81:0/4265761172 wait complete. 2024-09-12T01:32:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.034+0000 7f27d5304740 1 -- start start 2024-09-12T01:32:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.034+0000 7f27d5304740 1 Processor -- start 2024-09-12T01:32:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.034+0000 7f27d5304740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5572718085d0 0x557271812d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.034+0000 7f27d5304740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271809b40 0x557271810010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.034+0000 7f27d5304740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557271813370 0x557271810600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.034+0000 7f27d5304740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557271816010 con 0x557271809b40 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.034+0000 7f27d5304740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557271729060 con 0x5572718085d0 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.034+0000 7f27d5304740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557271816190 con 0x557271813370 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.034+0000 7f27d5304740 10 client.0 _ll_register_callbacks cb 0x55727147c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.034+0000 7f27cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271809b40 0x557271810010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.034+0000 7f27cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271809b40 0x557271810010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54708/0 (socket says 172.21.15.81:54708) 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.034+0000 7f27cbfff640 1 -- 172.21.15.81:0/3241211225 learned_addr learned my addr 172.21.15.81:0/3241211225 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.034+0000 7f27d14c8640 1 --2- 172.21.15.81:0/3241211225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557271813370 0x557271810600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27d0cc7640 1 --2- 172.21.15.81:0/3241211225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5572718085d0 0x557271812d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27cbfff640 1 -- 172.21.15.81:0/3241211225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557271813370 msgr2=0x557271810600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27cbfff640 1 --2- 172.21.15.81:0/3241211225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557271813370 0x557271810600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27cbfff640 1 -- 172.21.15.81:0/3241211225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5572718085d0 msgr2=0x557271812d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27cbfff640 1 --2- 172.21.15.81:0/3241211225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5572718085d0 0x557271812d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27cbfff640 1 -- 172.21.15.81:0/3241211225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572714df3c0 con 0x557271809b40 2024-09-12T01:32:44.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27cbfff640 1 --2- 172.21.15.81:0/3241211225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271809b40 0x557271810010 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f27b4005ab0 tx=0x7f27b4004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a50e234df452b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:44.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27abfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:44.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27abfff640 1 -- 172.21.15.81:0/3241211225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4035030 con 0x557271809b40 2024-09-12T01:32:44.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27d5304740 1 -- 172.21.15.81:0/3241211225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27c401e830 con 0x557271809b40 2024-09-12T01:32:44.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27abfff640 1 -- 172.21.15.81:0/3241211225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f27b4003a00 con 0x557271809b40 2024-09-12T01:32:44.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27abfff640 1 -- 172.21.15.81:0/3241211225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f27b4003c00 con 0x557271809b40 2024-09-12T01:32:44.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27d5304740 10 client.16491 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:44.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27d5304740 1 -- 172.21.15.81:0/3241211225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557271821ab0 con 0x557271809b40 2024-09-12T01:32:44.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.035+0000 7f27abfff640 1 -- 172.21.15.81:0/3241211225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c401e830 con 0x557271809b40 2024-09-12T01:32:44.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.036+0000 7f27abfff640 1 -- 172.21.15.81:0/3241211225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f27b404d4e0 con 0x557271809b40 2024-09-12T01:32:44.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.036+0000 7f27d5304740 10 client.16491 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:44.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.036+0000 7f27d5304740 10 client.16491 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:32:44.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.036+0000 7f27d5304740 20 client.16491 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:44.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.036+0000 7f27d5304740 1 --2- 172.21.15.81:0/3241211225 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x557271822ec0 0x5572718252f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.036+0000 7f27d5304740 4 client.16491 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:32:44.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.036+0000 7f27d5304740 1 -- 172.21.15.81:0/3241211225 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55727177b860 con 0x557271822ec0 2024-09-12T01:32:44.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.036+0000 7f27d0cc7640 1 --2- 172.21.15.81:0/3241211225 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x557271822ec0 0x5572718252f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.036+0000 7f27d0cc7640 1 --2- 172.21.15.81:0/3241211225 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x557271822ec0 0x5572718252f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d29c21f8468763db server_cookie=7794cd3c360b0be5 in_seq=0 out_seq=0 2024-09-12T01:32:44.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.036+0000 7f27abfff640 10 client.16491 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:32:44.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27abfff640 1 -- 172.21.15.81:0/3241211225 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55727177b860 con 0x557271822ec0 2024-09-12T01:32:44.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27abfff640 10 client.16491 handle_command_reply: tid=0 2024-09-12T01:32:44.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27d5304740 1 client.16491 shutdown 2024-09-12T01:32:44.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27d5304740 1 -- 172.21.15.81:0/3241211225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271809b40 msgr2=0x557271810010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:44.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27d5304740 1 --2- 172.21.15.81:0/3241211225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271809b40 0x557271810010 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f27b4005ab0 tx=0x7f27b4004340 comp rx=0 tx=0).stop 2024-09-12T01:32:44.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27d5304740 1 -- 172.21.15.81:0/3241211225 shutdown_connections 2024-09-12T01:32:44.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27d5304740 1 --2- 172.21.15.81:0/3241211225 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x557271822ec0 0x5572718252f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27d5304740 1 --2- 172.21.15.81:0/3241211225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557271813370 0x557271810600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27d5304740 1 --2- 172.21.15.81:0/3241211225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271809b40 0x557271810010 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27d5304740 1 --2- 172.21.15.81:0/3241211225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5572718085d0 0x557271812d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27d5304740 1 -- 172.21.15.81:0/3241211225 >> 172.21.15.81:0/3241211225 conn(0x5572717d1310 msgr2=0x55727180a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:44.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27abfff640 0 client.16491 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:32:44.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27d5304740 1 -- 172.21.15.81:0/3241211225 shutdown_connections 2024-09-12T01:32:44.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.037+0000 7f27d5304740 1 -- 172.21.15.81:0/3241211225 wait complete. 2024-09-12T01:32:44.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.038+0000 7f27d5304740 20 client.16491 trim_cache size 0 max 16384 2024-09-12T01:32:44.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.050+0000 7f27d5304740 1 Processor -- start 2024-09-12T01:32:44.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.050+0000 7f27d5304740 1 -- start start 2024-09-12T01:32:44.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.050+0000 7f27d5304740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5572718085d0 0x557271804e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.050+0000 7f27d5304740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557271809b40 0x55727181f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.050+0000 7f27d5304740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x55727180b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.050+0000 7f27d5304740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc1afa10 con 0x557271813370 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.050+0000 7f27d5304740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc1b1550 con 0x5572718085d0 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.050+0000 7f27d5304740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc1b00e0 con 0x557271809b40 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.050+0000 7f27d14c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x55727180b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.051+0000 7f27d14c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x55727180b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54716/0 (socket says 172.21.15.81:54716) 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.051+0000 7f27d14c8640 1 -- 172.21.15.81:0/3509425303 learned_addr learned my addr 172.21.15.81:0/3509425303 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.051+0000 7f27d0cc7640 1 --2- 172.21.15.81:0/3509425303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5572718085d0 0x557271804e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.051+0000 7f27cbfff640 1 --2- 172.21.15.81:0/3509425303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557271809b40 0x55727181f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.051+0000 7f27d14c8640 1 -- 172.21.15.81:0/3509425303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557271809b40 msgr2=0x55727181f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.051+0000 7f27d14c8640 1 --2- 172.21.15.81:0/3509425303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557271809b40 0x55727181f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.051+0000 7f27d14c8640 1 -- 172.21.15.81:0/3509425303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5572718085d0 msgr2=0x557271804e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.051+0000 7f27d14c8640 1 --2- 172.21.15.81:0/3509425303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5572718085d0 0x557271804e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.051+0000 7f27d14c8640 1 -- 172.21.15.81:0/3509425303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55727180e560 con 0x557271813370 2024-09-12T01:32:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.051+0000 7f27d14c8640 1 --2- 172.21.15.81:0/3509425303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x55727180b120 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f27c40117a0 tx=0x7f27c4005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e949f4264777eee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.051+0000 7f27c27fc640 1 -- 172.21.15.81:0/3509425303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4011ea0 con 0x557271813370 2024-09-12T01:32:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.051+0000 7f27c27fc640 1 -- 172.21.15.81:0/3509425303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c402d070 con 0x557271813370 2024-09-12T01:32:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.051+0000 7f27c27fc640 1 -- 172.21.15.81:0/3509425303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4004950 con 0x557271813370 2024-09-12T01:32:44.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.052+0000 7f27d5304740 1 -- 172.21.15.81:0/3509425303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 msgr2=0x55727180b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.052+0000 7f27d5304740 1 --2- 172.21.15.81:0/3509425303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x55727180b120 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f27c40117a0 tx=0x7f27c4005d40 comp rx=0 tx=0).stop 2024-09-12T01:32:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.052+0000 7f27d5304740 1 -- 172.21.15.81:0/3509425303 shutdown_connections 2024-09-12T01:32:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.052+0000 7f27d5304740 1 --2- 172.21.15.81:0/3509425303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x55727180b120 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.052+0000 7f27d5304740 1 --2- 172.21.15.81:0/3509425303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557271809b40 0x55727181f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.052+0000 7f27d5304740 1 --2- 172.21.15.81:0/3509425303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5572718085d0 0x557271804e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.052+0000 7f27d5304740 1 -- 172.21.15.81:0/3509425303 >> 172.21.15.81:0/3509425303 conn(0x5572717d1310 msgr2=0x557271804700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.052+0000 7f27d5304740 1 -- 172.21.15.81:0/3509425303 shutdown_connections 2024-09-12T01:32:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.052+0000 7f27d5304740 1 -- 172.21.15.81:0/3509425303 wait complete. 2024-09-12T01:32:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.052+0000 7f27d5304740 1 -- start start 2024-09-12T01:32:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.052+0000 7f27d5304740 1 Processor -- start 2024-09-12T01:32:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d5304740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572718085d0 0x55727181b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d5304740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557271809b40 0x55727181bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d5304740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x55727180c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d5304740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc1b0e80 con 0x557271813370 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d5304740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc1b07b0 con 0x557271809b40 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d5304740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc1ad9f0 con 0x5572718085d0 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d5304740 10 client.0 _ll_register_callbacks cb 0x7f27b4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d14c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x55727180c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27cbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557271809b40 0x55727181bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d14c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x55727180c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54732/0 (socket says 172.21.15.81:54732) 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d14c8640 1 -- 172.21.15.81:0/2978713320 learned_addr learned my addr 172.21.15.81:0/2978713320 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d0cc7640 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572718085d0 0x55727181b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d14c8640 1 -- 172.21.15.81:0/2978713320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572718085d0 msgr2=0x55727181b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d14c8640 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572718085d0 0x55727181b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d14c8640 1 -- 172.21.15.81:0/2978713320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557271809b40 msgr2=0x55727181bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:44.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d14c8640 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557271809b40 0x55727181bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d14c8640 1 -- 172.21.15.81:0/2978713320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55727180d070 con 0x557271813370 2024-09-12T01:32:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27cbfff640 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557271809b40 0x55727181bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:32:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d0cc7640 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572718085d0 0x55727181b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d14c8640 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x55727180c870 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f27c4013fd0 tx=0x7f27c400ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1b0b8422b9f47c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27abfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27abfff640 1 -- 172.21.15.81:0/2978713320 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4011ea0 con 0x557271813370 2024-09-12T01:32:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27abfff640 1 -- 172.21.15.81:0/2978713320 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f27c4005460 con 0x557271813370 2024-09-12T01:32:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.053+0000 7f27d5304740 1 -- 172.21.15.81:0/2978713320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27c402d070 con 0x557271813370 2024-09-12T01:32:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.054+0000 7f27abfff640 1 -- 172.21.15.81:0/2978713320 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f27c4004660 con 0x557271813370 2024-09-12T01:32:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.054+0000 7f27d5304740 10 client.16497 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.054+0000 7f27d5304740 1 -- 172.21.15.81:0/2978713320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55727188d610 con 0x557271813370 2024-09-12T01:32:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.054+0000 7f27abfff640 1 -- 172.21.15.81:0/2978713320 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c402d070 con 0x557271813370 2024-09-12T01:32:44.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.054+0000 7f27abfff640 1 -- 172.21.15.81:0/2978713320 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f27c401f720 con 0x557271813370 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.054+0000 7f27d5304740 10 client.16497 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.054+0000 7f27d5304740 10 client.16497 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.054+0000 7f27d5304740 20 client.16497 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.054+0000 7f27d5304740 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55727188dae0 0x55727188fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.054+0000 7f27d5304740 4 client.16497 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.054+0000 7f27d5304740 1 -- 172.21.15.81:0/2978713320 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557271775d70 con 0x55727188dae0 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.054+0000 7f27d0cc7640 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55727188dae0 0x55727188fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27d0cc7640 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55727188dae0 0x55727188fed0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=72fadbc51afb1421 server_cookie=896c808abf26600a in_seq=0 out_seq=0 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27abfff640 10 client.16497 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27abfff640 1 -- 172.21.15.81:0/2978713320 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557271775d70 con 0x55727188dae0 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27abfff640 10 client.16497 handle_command_reply: tid=0 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27d5304740 1 client.16497 shutdown 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27d5304740 1 -- 172.21.15.81:0/2978713320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 msgr2=0x55727180c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27d5304740 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x55727180c870 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f27c4013fd0 tx=0x7f27c400ab10 comp rx=0 tx=0).stop 2024-09-12T01:32:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27d5304740 1 -- 172.21.15.81:0/2978713320 shutdown_connections 2024-09-12T01:32:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27d5304740 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55727188dae0 0x55727188fed0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27d5304740 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557271813370 0x55727180c870 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27d5304740 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557271809b40 0x55727181bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27d5304740 1 --2- 172.21.15.81:0/2978713320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5572718085d0 0x55727181b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27d5304740 1 -- 172.21.15.81:0/2978713320 >> 172.21.15.81:0/2978713320 conn(0x5572717d1310 msgr2=0x557271811870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.055+0000 7f27abfff640 0 client.16497 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:32:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d5304740 1 -- 172.21.15.81:0/2978713320 shutdown_connections 2024-09-12T01:32:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d5304740 1 -- 172.21.15.81:0/2978713320 wait complete. 2024-09-12T01:32:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d5304740 20 client.16497 trim_cache size 0 max 16384 2024-09-12T01:32:44.060 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:32:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d2f2b640 1 -- 172.21.15.81:0/4035153615 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f27b80a2d70 msgr2=0x7f27b80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d2f2b640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f27b80a2d70 0x7f27b80a5230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f27c4013460 tx=0x7f27c4013860 comp rx=0 tx=0).stop 2024-09-12T01:32:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d2f2b640 1 -- 172.21.15.81:0/4035153615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27cc100e20 msgr2=0x7f27cc197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d2f2b640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27cc100e20 0x7f27cc197160 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00ba50 tx=0x7f27bc00bf10 comp rx=0 tx=0).stop 2024-09-12T01:32:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d2f2b640 1 -- 172.21.15.81:0/4035153615 shutdown_connections 2024-09-12T01:32:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d2f2b640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f27b80a2d70 0x7f27b80a5230 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d2f2b640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27cc102ef0 0x7f27cc197be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d2f2b640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc102570 0x7f27cc1976a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d2f2b640 1 --2- 172.21.15.81:0/4035153615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27cc100e20 0x7f27cc197160 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d2f2b640 1 -- 172.21.15.81:0/4035153615 >> 172.21.15.81:0/4035153615 conn(0x7f27cc0fc7d0 msgr2=0x7f27cc1068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d2f2b640 1 -- 172.21.15.81:0/4035153615 shutdown_connections 2024-09-12T01:32:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:44.056+0000 7f27d2f2b640 1 -- 172.21.15.81:0/4035153615 wait complete. 2024-09-12T01:32:44.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:32:45.139 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:32:45.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:45 smithi081 ceph-mon[30920]: pgmap v143: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:45.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:45 smithi100 ceph-mon[35275]: pgmap v143: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:45.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:45 smithi189 ceph-mon[35357]: pgmap v143: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:45.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.634+0000 7f13d242f640 1 -- 172.21.15.81:0/3613576660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc102790 msgr2=0x7f13cc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:45.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.634+0000 7f13d242f640 1 --2- 172.21.15.81:0/3613576660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc102790 0x7f13cc1067e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009900 tx=0x7f13b402a410 comp rx=0 tx=0).stop 2024-09-12T01:32:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.634+0000 7f13d242f640 1 -- 172.21.15.81:0/3613576660 shutdown_connections 2024-09-12T01:32:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.634+0000 7f13d242f640 1 --2- 172.21.15.81:0/3613576660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13cc106f10 0x7f13cc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.634+0000 7f13d242f640 1 --2- 172.21.15.81:0/3613576660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc102790 0x7f13cc1067e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.634+0000 7f13d242f640 1 --2- 172.21.15.81:0/3613576660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13cc101de0 0x7f13cc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.634+0000 7f13d242f640 1 -- 172.21.15.81:0/3613576660 >> 172.21.15.81:0/3613576660 conn(0x7f13cc0fd8c0 msgr2=0x7f13cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.634+0000 7f13d242f640 1 -- 172.21.15.81:0/3613576660 shutdown_connections 2024-09-12T01:32:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.634+0000 7f13d242f640 1 -- 172.21.15.81:0/3613576660 wait complete. 2024-09-12T01:32:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13d242f640 1 Processor -- start 2024-09-12T01:32:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13d242f640 1 -- start start 2024-09-12T01:32:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13d242f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc101de0 0x7f13cc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13d242f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13cc102790 0x7f13cc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13d242f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13cc106f10 0x7f13cc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13d242f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc111f90 con 0x7f13cc101de0 2024-09-12T01:32:45.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13d242f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc111e10 con 0x7f13cc106f10 2024-09-12T01:32:45.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13d242f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc112110 con 0x7f13cc102790 2024-09-12T01:32:45.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc101de0 0x7f13cc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc101de0 0x7f13cc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54736/0 (socket says 172.21.15.81:54736) 2024-09-12T01:32:45.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13cbfff640 1 -- 172.21.15.81:0/357587786 learned_addr learned my addr 172.21.15.81:0/357587786 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:45.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13d09cc640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13cc106f10 0x7f13cc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13c3fff640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13cc102790 0x7f13cc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13cbfff640 1 -- 172.21.15.81:0/357587786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13cc102790 msgr2=0x7f13cc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:45.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13cbfff640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13cc102790 0x7f13cc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13cbfff640 1 -- 172.21.15.81:0/357587786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13cc106f10 msgr2=0x7f13cc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:45.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13cbfff640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13cc106f10 0x7f13cc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13cbfff640 1 -- 172.21.15.81:0/357587786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc1a6930 con 0x7f13cc101de0 2024-09-12T01:32:45.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13c3fff640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13cc102790 0x7f13cc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:45.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.635+0000 7f13cbfff640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc101de0 0x7f13cc0744f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00e9f0 tx=0x7f13bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:45.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.636+0000 7f13c9ffb640 1 -- 172.21.15.81:0/357587786 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00cd80 con 0x7f13cc101de0 2024-09-12T01:32:45.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.636+0000 7f13c9ffb640 1 -- 172.21.15.81:0/357587786 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13bc010910 con 0x7f13cc101de0 2024-09-12T01:32:45.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.636+0000 7f13d242f640 1 -- 172.21.15.81:0/357587786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13cc1a6c20 con 0x7f13cc101de0 2024-09-12T01:32:45.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.636+0000 7f13c9ffb640 1 -- 172.21.15.81:0/357587786 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc018990 con 0x7f13cc101de0 2024-09-12T01:32:45.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.636+0000 7f13d242f640 1 -- 172.21.15.81:0/357587786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13cc1a71b0 con 0x7f13cc101de0 2024-09-12T01:32:45.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.638+0000 7f13d4808740 1 Processor -- start 2024-09-12T01:32:45.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.638+0000 7f13d4808740 1 -- start start 2024-09-12T01:32:45.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.638+0000 7f13c9ffb640 1 -- 172.21.15.81:0/357587786 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f13bc010ac0 con 0x7f13cc101de0 2024-09-12T01:32:45.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13d4808740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d79090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13d4808740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d795d0 0x55ab66d79a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13d4808740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66d86760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13d4808740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ab66cdf2f0 con 0x55ab66d84370 2024-09-12T01:32:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13d4808740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ab66c86cf0 con 0x55ab66d795d0 2024-09-12T01:32:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13d4808740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ab66cdb2b0 con 0x55ab66d7ab40 2024-09-12T01:32:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13c3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66d86760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13c3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66d86760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54748/0 (socket says 172.21.15.81:54748) 2024-09-12T01:32:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13c3fff640 1 -- 172.21.15.81:0/3201505772 learned_addr learned my addr 172.21.15.81:0/3201505772 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13cbfff640 1 --2- 172.21.15.81:0/3201505772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d795d0 0x55ab66d79a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13d09cc640 1 --2- 172.21.15.81:0/3201505772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d79090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13c3fff640 1 -- 172.21.15.81:0/3201505772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 msgr2=0x55ab66d79090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:45.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13c3fff640 1 --2- 172.21.15.81:0/3201505772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d79090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13c3fff640 1 -- 172.21.15.81:0/3201505772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d795d0 msgr2=0x55ab66d79a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:45.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13c3fff640 1 --2- 172.21.15.81:0/3201505772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d795d0 0x55ab66d79a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13c3fff640 1 -- 172.21.15.81:0/3201505772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab66c6b3a0 con 0x55ab66d84370 2024-09-12T01:32:45.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13cbfff640 1 --2- 172.21.15.81:0/3201505772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d795d0 0x55ab66d79a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:32:45.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.639+0000 7f13c9ffb640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f13b80a2d70 0x7f13b80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.640+0000 7f13d09cc640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f13b80a2d70 0x7f13b80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.640+0000 7f13c3fff640 1 --2- 172.21.15.81:0/3201505772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66d86760 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f13b4031550 tx=0x7f13b4032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247e1d7415878843 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:45.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.640+0000 7f13c9ffb640 1 -- 172.21.15.81:0/357587786 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f13bc0cf7f0 con 0x7f13cc101de0 2024-09-12T01:32:45.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.640+0000 7f13c27fc640 1 -- 172.21.15.81:0/3201505772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b403f070 con 0x55ab66d84370 2024-09-12T01:32:45.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.640+0000 7f13c27fc640 1 -- 172.21.15.81:0/3201505772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b4032e20 con 0x55ab66d84370 2024-09-12T01:32:45.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.640+0000 7f13c27fc640 1 -- 172.21.15.81:0/3201505772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4035070 con 0x55ab66d84370 2024-09-12T01:32:45.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.641+0000 7f13d4808740 1 -- 172.21.15.81:0/3201505772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 msgr2=0x55ab66d86760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.641+0000 7f13d09cc640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f13b80a2d70 0x7f13b80a5230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f13c400b4d0 tx=0x7f13c400e040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.641+0000 7f13d4808740 1 --2- 172.21.15.81:0/3201505772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66d86760 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f13b4031550 tx=0x7f13b4032c30 comp rx=0 tx=0).stop 2024-09-12T01:32:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.641+0000 7f13d4808740 1 -- 172.21.15.81:0/3201505772 shutdown_connections 2024-09-12T01:32:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.641+0000 7f13d4808740 1 --2- 172.21.15.81:0/3201505772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66d86760 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.641+0000 7f13d4808740 1 --2- 172.21.15.81:0/3201505772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d795d0 0x55ab66d79a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.641+0000 7f13d4808740 1 --2- 172.21.15.81:0/3201505772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d79090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.641+0000 7f13d4808740 1 -- 172.21.15.81:0/3201505772 >> 172.21.15.81:0/3201505772 conn(0x55ab66d42310 msgr2=0x55ab66d75c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.641+0000 7f13d4808740 1 -- 172.21.15.81:0/3201505772 shutdown_connections 2024-09-12T01:32:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.641+0000 7f13d4808740 1 -- 172.21.15.81:0/3201505772 wait complete. 2024-09-12T01:32:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.641+0000 7f13d4808740 1 -- start start 2024-09-12T01:32:45.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.641+0000 7f13d4808740 1 Processor -- start 2024-09-12T01:32:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.641+0000 7f13d4808740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d795d0 0x55ab66d83cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13d4808740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d80fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13d4808740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d84370 0x55ab66d81520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13d4808740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ab66d87010 con 0x55ab66d795d0 2024-09-12T01:32:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13d4808740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ab66c9a060 con 0x55ab66d84370 2024-09-12T01:32:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13d4808740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ab66d87190 con 0x55ab66d7ab40 2024-09-12T01:32:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13d4808740 10 client.0 _ll_register_callbacks cb 0x55ab669ed8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d795d0 0x55ab66d83cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d795d0 0x55ab66d83cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54760/0 (socket says 172.21.15.81:54760) 2024-09-12T01:32:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13cbfff640 1 -- 172.21.15.81:0/1681144853 learned_addr learned my addr 172.21.15.81:0/1681144853 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13c3fff640 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d80fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13d09cc640 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d84370 0x55ab66d81520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13cbfff640 1 -- 172.21.15.81:0/1681144853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 msgr2=0x55ab66d80fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:45.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13cbfff640 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d80fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13cbfff640 1 -- 172.21.15.81:0/1681144853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d84370 msgr2=0x55ab66d81520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13cbfff640 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d84370 0x55ab66d81520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13cbfff640 1 -- 172.21.15.81:0/1681144853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab66a503c0 con 0x55ab66d795d0 2024-09-12T01:32:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13c3fff640 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d80fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13d09cc640 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d84370 0x55ab66d81520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13cbfff640 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d795d0 0x55ab66d83cf0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00c6a0 tx=0x7f13bc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a2f29a313f413b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13ab7fe640 1 -- 172.21.15.81:0/1681144853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc09b6a0 con 0x55ab66d795d0 2024-09-12T01:32:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13ab7fe640 1 -- 172.21.15.81:0/1681144853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f13bc018d30 con 0x55ab66d795d0 2024-09-12T01:32:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13d4808740 1 -- 172.21.15.81:0/1681144853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13b4032e20 con 0x55ab66d795d0 2024-09-12T01:32:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13ab7fe640 1 -- 172.21.15.81:0/1681144853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f13bc09c440 con 0x55ab66d795d0 2024-09-12T01:32:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13d4808740 10 client.16509 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:45.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.642+0000 7f13d4808740 1 -- 172.21.15.81:0/1681144853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ab66d92a90 con 0x55ab66d795d0 2024-09-12T01:32:45.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.643+0000 7f13ab7fe640 1 -- 172.21.15.81:0/1681144853 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b4032e20 con 0x55ab66d795d0 2024-09-12T01:32:45.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.643+0000 7f13ab7fe640 1 -- 172.21.15.81:0/1681144853 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f13bc097a90 con 0x55ab66d795d0 2024-09-12T01:32:45.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.643+0000 7f13d4808740 10 client.16509 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:45.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.643+0000 7f13d4808740 10 client.16509 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:32:45.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.643+0000 7f13d4808740 20 client.16509 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:45.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.643+0000 7f13d4808740 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55ab66d93ea0 0x55ab66d962f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.643+0000 7f13d4808740 4 client.16509 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:32:45.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.643+0000 7f13d4808740 1 -- 172.21.15.81:0/1681144853 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab66cec860 con 0x55ab66d93ea0 2024-09-12T01:32:45.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.643+0000 7f13c3fff640 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55ab66d93ea0 0x55ab66d962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13c3fff640 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55ab66d93ea0 0x55ab66d962f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b4e787d4c5720953 server_cookie=43d19babdd410e3c in_seq=0 out_seq=0 2024-09-12T01:32:45.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13ab7fe640 10 client.16509 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:32:45.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13ab7fe640 1 -- 172.21.15.81:0/1681144853 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab66cec860 con 0x55ab66d93ea0 2024-09-12T01:32:45.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13ab7fe640 10 client.16509 handle_command_reply: tid=0 2024-09-12T01:32:45.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13d4808740 1 client.16509 shutdown 2024-09-12T01:32:45.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13d4808740 1 -- 172.21.15.81:0/1681144853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d795d0 msgr2=0x55ab66d83cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:45.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13d4808740 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d795d0 0x55ab66d83cf0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00c6a0 tx=0x7f13bc009310 comp rx=0 tx=0).stop 2024-09-12T01:32:45.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13d4808740 1 -- 172.21.15.81:0/1681144853 shutdown_connections 2024-09-12T01:32:45.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13d4808740 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d84370 0x55ab66d81520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13d4808740 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d80fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13d4808740 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55ab66d93ea0 0x55ab66d962f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13d4808740 1 --2- 172.21.15.81:0/1681144853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d795d0 0x55ab66d83cf0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13d4808740 1 -- 172.21.15.81:0/1681144853 >> 172.21.15.81:0/1681144853 conn(0x55ab66d42310 msgr2=0x55ab66d7b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:45.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.644+0000 7f13ab7fe640 0 client.16509 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:32:45.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.645+0000 7f13d4808740 1 -- 172.21.15.81:0/1681144853 shutdown_connections 2024-09-12T01:32:45.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.645+0000 7f13d4808740 1 -- 172.21.15.81:0/1681144853 wait complete. 2024-09-12T01:32:45.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.645+0000 7f13d4808740 20 client.16509 trim_cache size 0 max 16384 2024-09-12T01:32:45.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.657+0000 7f13d4808740 1 Processor -- start 2024-09-12T01:32:45.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.657+0000 7f13d4808740 1 -- start start 2024-09-12T01:32:45.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.657+0000 7f13d4808740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d7f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.657+0000 7f13d4808740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66d82f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13d4808740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d7c120 0x55ab66d7c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13d4808740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc1af9f0 con 0x55ab66d84370 2024-09-12T01:32:45.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13d4808740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc1b1530 con 0x55ab66d7c120 2024-09-12T01:32:45.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13d4808740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc1b00c0 con 0x55ab66d7ab40 2024-09-12T01:32:45.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13c3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66d82f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13c3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66d82f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54772/0 (socket says 172.21.15.81:54772) 2024-09-12T01:32:45.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13c3fff640 1 -- 172.21.15.81:0/3857688373 learned_addr learned my addr 172.21.15.81:0/3857688373 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:45.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13d09cc640 1 --2- 172.21.15.81:0/3857688373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d7c120 0x55ab66d7c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13cbfff640 1 --2- 172.21.15.81:0/3857688373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d7f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13c3fff640 1 -- 172.21.15.81:0/3857688373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 msgr2=0x55ab66d7f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:45.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13c3fff640 1 --2- 172.21.15.81:0/3857688373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d7f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13c3fff640 1 -- 172.21.15.81:0/3857688373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d7c120 msgr2=0x55ab66d7c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:45.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13c3fff640 1 --2- 172.21.15.81:0/3857688373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d7c120 0x55ab66d7c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13c3fff640 1 -- 172.21.15.81:0/3857688373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab66d7ff50 con 0x55ab66d84370 2024-09-12T01:32:45.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13d09cc640 1 --2- 172.21.15.81:0/3857688373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d7c120 0x55ab66d7c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:45.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13cbfff640 1 --2- 172.21.15.81:0/3857688373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d7f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:45.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13c3fff640 1 --2- 172.21.15.81:0/3857688373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66d82f10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f13b4031550 tx=0x7f13b402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476badeabf209524 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:45.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13c1ffb640 1 -- 172.21.15.81:0/3857688373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b403f070 con 0x55ab66d84370 2024-09-12T01:32:45.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13c1ffb640 1 -- 172.21.15.81:0/3857688373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b4051070 con 0x55ab66d84370 2024-09-12T01:32:45.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.658+0000 7f13c1ffb640 1 -- 172.21.15.81:0/3857688373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4035040 con 0x55ab66d84370 2024-09-12T01:32:45.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.659+0000 7f13d4808740 1 -- 172.21.15.81:0/3857688373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 msgr2=0x55ab66d82f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:45.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.659+0000 7f13d4808740 1 --2- 172.21.15.81:0/3857688373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66d82f10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f13b4031550 tx=0x7f13b402a410 comp rx=0 tx=0).stop 2024-09-12T01:32:45.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.659+0000 7f13d4808740 1 -- 172.21.15.81:0/3857688373 shutdown_connections 2024-09-12T01:32:45.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.659+0000 7f13d4808740 1 --2- 172.21.15.81:0/3857688373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d7c120 0x55ab66d7c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.659+0000 7f13d4808740 1 --2- 172.21.15.81:0/3857688373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66d82f10 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.659+0000 7f13d4808740 1 --2- 172.21.15.81:0/3857688373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d7f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.659+0000 7f13d4808740 1 -- 172.21.15.81:0/3857688373 >> 172.21.15.81:0/3857688373 conn(0x55ab66d42310 msgr2=0x55ab66d82800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:45.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.659+0000 7f13d4808740 1 -- 172.21.15.81:0/3857688373 shutdown_connections 2024-09-12T01:32:45.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.659+0000 7f13d4808740 1 -- 172.21.15.81:0/3857688373 wait complete. 2024-09-12T01:32:45.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.659+0000 7f13d4808740 1 -- start start 2024-09-12T01:32:45.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d4808740 1 Processor -- start 2024-09-12T01:32:45.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d4808740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d88580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d4808740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d7c120 0x55ab66d88ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d4808740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66dfdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d4808740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc1b0e60 con 0x55ab66d84370 2024-09-12T01:32:45.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d4808740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc1b0790 con 0x55ab66d7c120 2024-09-12T01:32:45.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d4808740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc1ad9d0 con 0x55ab66d7ab40 2024-09-12T01:32:45.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d4808740 10 client.0 _ll_register_callbacks cb 0x7f13bc00cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:45.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d09cc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66dfdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d09cc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66dfdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54780/0 (socket says 172.21.15.81:54780) 2024-09-12T01:32:45.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d09cc640 1 -- 172.21.15.81:0/1448732598 learned_addr learned my addr 172.21.15.81:0/1448732598 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13c3fff640 1 --2- 172.21.15.81:0/1448732598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d7c120 0x55ab66d88ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13cbfff640 1 --2- 172.21.15.81:0/1448732598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d09cc640 1 -- 172.21.15.81:0/1448732598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 msgr2=0x55ab66d88580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d09cc640 1 --2- 172.21.15.81:0/1448732598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d88580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d09cc640 1 -- 172.21.15.81:0/1448732598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d7c120 msgr2=0x55ab66d88ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d09cc640 1 --2- 172.21.15.81:0/1448732598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d7c120 0x55ab66d88ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d09cc640 1 -- 172.21.15.81:0/1448732598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab66dfe060 con 0x55ab66d84370 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13d09cc640 1 --2- 172.21.15.81:0/1448732598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66dfdb20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f13c4018de0 tx=0x7f13c4004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1271d0d192ebf40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.660+0000 7f13ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13ab7fe640 1 -- 172.21.15.81:0/1448732598 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4024670 con 0x55ab66d84370 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13ab7fe640 1 -- 172.21.15.81:0/1448732598 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f13c4024810 con 0x55ab66d84370 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13d4808740 1 -- 172.21.15.81:0/1448732598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13b4051070 con 0x55ab66d84370 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13ab7fe640 1 -- 172.21.15.81:0/1448732598 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f13c4024a50 con 0x55ab66d84370 2024-09-12T01:32:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13d4808740 10 client.16515 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13d4808740 1 -- 172.21.15.81:0/1448732598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ab66dff240 con 0x55ab66d84370 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13ab7fe640 1 -- 172.21.15.81:0/1448732598 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13b4051070 con 0x55ab66d84370 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13ab7fe640 1 -- 172.21.15.81:0/1448732598 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f13c402d3b0 con 0x55ab66d84370 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13d4808740 10 client.16515 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13d4808740 10 client.16515 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13d4808740 20 client.16515 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13d4808740 1 --2- 172.21.15.81:0/1448732598 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55ab66dffa40 0x55ab66e01e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13d4808740 4 client.16515 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13d4808740 1 -- 172.21.15.81:0/1448732598 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ab66ce6d70 con 0x55ab66dffa40 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.661+0000 7f13cbfff640 1 --2- 172.21.15.81:0/1448732598 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55ab66dffa40 0x55ab66e01e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13ab7fe640 10 client.16515 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13cbfff640 1 --2- 172.21.15.81:0/1448732598 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55ab66dffa40 0x55ab66e01e60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e230856e365b12f server_cookie=5d8a8e1270c1ef65 in_seq=0 out_seq=0 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13ab7fe640 1 -- 172.21.15.81:0/1448732598 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ab66ce6d70 con 0x55ab66dffa40 2024-09-12T01:32:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13ab7fe640 10 client.16515 handle_command_reply: tid=0 2024-09-12T01:32:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13d4808740 1 client.16515 shutdown 2024-09-12T01:32:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13d4808740 1 -- 172.21.15.81:0/1448732598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 msgr2=0x55ab66dfdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13d4808740 1 --2- 172.21.15.81:0/1448732598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66dfdb20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f13c4018de0 tx=0x7f13c4004b50 comp rx=0 tx=0).stop 2024-09-12T01:32:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13d4808740 1 -- 172.21.15.81:0/1448732598 shutdown_connections 2024-09-12T01:32:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13d4808740 1 --2- 172.21.15.81:0/1448732598 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55ab66dffa40 0x55ab66e01e60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13d4808740 1 --2- 172.21.15.81:0/1448732598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab66d84370 0x55ab66dfdb20 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13d4808740 1 --2- 172.21.15.81:0/1448732598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab66d7c120 0x55ab66d88ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13d4808740 1 --2- 172.21.15.81:0/1448732598 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ab66d7ab40 0x55ab66d88580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13d4808740 1 -- 172.21.15.81:0/1448732598 >> 172.21.15.81:0/1448732598 conn(0x55ab66d42310 msgr2=0x55ab66d7f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13ab7fe640 0 client.16515 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:32:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13d4808740 1 -- 172.21.15.81:0/1448732598 shutdown_connections 2024-09-12T01:32:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.662+0000 7f13d4808740 1 -- 172.21.15.81:0/1448732598 wait complete. 2024-09-12T01:32:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.663+0000 7f13d4808740 20 client.16515 trim_cache size 0 max 16384 2024-09-12T01:32:45.669 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:32:45.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.663+0000 7f13d242f640 1 -- 172.21.15.81:0/357587786 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f13b80a2d70 msgr2=0x7f13b80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.663+0000 7f13d242f640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f13b80a2d70 0x7f13b80a5230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f13c400b4d0 tx=0x7f13c400e040 comp rx=0 tx=0).stop 2024-09-12T01:32:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.663+0000 7f13d242f640 1 -- 172.21.15.81:0/357587786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc101de0 msgr2=0x7f13cc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.663+0000 7f13d242f640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc101de0 0x7f13cc0744f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00e9f0 tx=0x7f13bc00eeb0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.663+0000 7f13d242f640 1 -- 172.21.15.81:0/357587786 shutdown_connections 2024-09-12T01:32:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.663+0000 7f13d242f640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f13b80a2d70 0x7f13b80a5230 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.663+0000 7f13d242f640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13cc106f10 0x7f13cc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.663+0000 7f13d242f640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13cc102790 0x7f13cc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.663+0000 7f13d242f640 1 --2- 172.21.15.81:0/357587786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc101de0 0x7f13cc0744f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.663+0000 7f13d242f640 1 -- 172.21.15.81:0/357587786 >> 172.21.15.81:0/357587786 conn(0x7f13cc0fd8c0 msgr2=0x7f13cc0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.663+0000 7f13d242f640 1 -- 172.21.15.81:0/357587786 shutdown_connections 2024-09-12T01:32:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:45.663+0000 7f13d242f640 1 -- 172.21.15.81:0/357587786 wait complete. 2024-09-12T01:32:46.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:32:46.735 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:32:47.107 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:47 smithi081 ceph-mon[30920]: pgmap v144: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:32:47.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.185+0000 7fca56271640 1 -- 172.21.15.81:0/474752142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca50106f10 msgr2=0x7fca5010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:47.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.185+0000 7fca56271640 1 --2- 172.21.15.81:0/474752142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca50106f10 0x7fca5010ea90 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fca48009ca0 tx=0x7fca4802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.185+0000 7fca56271640 1 -- 172.21.15.81:0/474752142 shutdown_connections 2024-09-12T01:32:47.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.185+0000 7fca56271640 1 --2- 172.21.15.81:0/474752142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca50106f10 0x7fca5010ea90 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.185+0000 7fca56271640 1 --2- 172.21.15.81:0/474752142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50102790 0x7fca501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.185+0000 7fca56271640 1 --2- 172.21.15.81:0/474752142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca50101de0 0x7fca501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.185+0000 7fca56271640 1 -- 172.21.15.81:0/474752142 >> 172.21.15.81:0/474752142 conn(0x7fca500fd8c0 msgr2=0x7fca500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.185+0000 7fca56271640 1 -- 172.21.15.81:0/474752142 shutdown_connections 2024-09-12T01:32:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.186+0000 7fca56271640 1 -- 172.21.15.81:0/474752142 wait complete. 2024-09-12T01:32:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.186+0000 7fca56271640 1 Processor -- start 2024-09-12T01:32:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.186+0000 7fca56271640 1 -- start start 2024-09-12T01:32:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.186+0000 7fca56271640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca50101de0 0x7fca50198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.186+0000 7fca56271640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50102790 0x7fca50198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.186+0000 7fca56271640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca50106f10 0x7fca5019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.186+0000 7fca56271640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca50111f70 con 0x7fca50106f10 2024-09-12T01:32:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.186+0000 7fca56271640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca50111df0 con 0x7fca50102790 2024-09-12T01:32:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.186+0000 7fca56271640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fca501120f0 con 0x7fca50101de0 2024-09-12T01:32:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca5480e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca50106f10 0x7fca5019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca5480e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca50106f10 0x7fca5019cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54796/0 (socket says 172.21.15.81:54796) 2024-09-12T01:32:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca5480e640 1 -- 172.21.15.81:0/3618639310 learned_addr learned my addr 172.21.15.81:0/3618639310 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:47.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca4ffff640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca50101de0 0x7fca50198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca4f7fe640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50102790 0x7fca50198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca5480e640 1 -- 172.21.15.81:0/3618639310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca50101de0 msgr2=0x7fca50198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:47.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca5480e640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca50101de0 0x7fca50198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca5480e640 1 -- 172.21.15.81:0/3618639310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50102790 msgr2=0x7fca50198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:47.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca5480e640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50102790 0x7fca50198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca5480e640 1 -- 172.21.15.81:0/3618639310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5019d300 con 0x7fca50106f10 2024-09-12T01:32:47.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca4f7fe640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50102790 0x7fca50198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:47.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca5480e640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca50106f10 0x7fca5019cc20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fca48031a60 tx=0x7fca48031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:47.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca4d7fa640 1 -- 172.21.15.81:0/3618639310 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48003c30 con 0x7fca50106f10 2024-09-12T01:32:47.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca56271640 1 -- 172.21.15.81:0/3618639310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5019d590 con 0x7fca50106f10 2024-09-12T01:32:47.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca4d7fa640 1 -- 172.21.15.81:0/3618639310 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca48003dd0 con 0x7fca50106f10 2024-09-12T01:32:47.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca4d7fa640 1 -- 172.21.15.81:0/3618639310 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca480047e0 con 0x7fca50106f10 2024-09-12T01:32:47.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.187+0000 7fca56271640 1 -- 172.21.15.81:0/3618639310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca501a4ed0 con 0x7fca50106f10 2024-09-12T01:32:47.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.189+0000 7fca4d7fa640 1 -- 172.21.15.81:0/3618639310 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fca4802f790 con 0x7fca50106f10 2024-09-12T01:32:47.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca5864a740 1 Processor -- start 2024-09-12T01:32:47.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca5864a740 1 -- start start 2024-09-12T01:32:47.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca4d7fa640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fca380a2d70 0x7fca380a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca5864a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e03090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca5864a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 0x5587e5e03a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca5864a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e0e370 0x5587e5e10760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca5864a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5587e5d692f0 con 0x5587e5e035d0 2024-09-12T01:32:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca5864a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5587e5d10cf0 con 0x5587e5e04b40 2024-09-12T01:32:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca5864a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5587e5d652b0 con 0x5587e5e0e370 2024-09-12T01:32:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca4f7fe640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fca380a2d70 0x7fca380a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca4f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 0x5587e5e03a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca4d7fa640 1 -- 172.21.15.81:0/3618639310 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fca480f0930 con 0x7fca50106f10 2024-09-12T01:32:47.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca4f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 0x5587e5e03a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54804/0 (socket says 172.21.15.81:54804) 2024-09-12T01:32:47.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca4f7fe640 1 -- 172.21.15.81:0/1443633602 learned_addr learned my addr 172.21.15.81:0/1443633602 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:47.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca4ffff640 1 --2- 172.21.15.81:0/1443633602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e03090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.190+0000 7fca5480e640 1 --2- 172.21.15.81:0/1443633602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e0e370 0x5587e5e10760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.191+0000 7fca4f7fe640 1 -- 172.21.15.81:0/1443633602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e0e370 msgr2=0x5587e5e10760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:47.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.191+0000 7fca4f7fe640 1 --2- 172.21.15.81:0/1443633602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e0e370 0x5587e5e10760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.191+0000 7fca4f7fe640 1 -- 172.21.15.81:0/1443633602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 msgr2=0x5587e5e03090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.191+0000 7fca4f7fe640 1 --2- 172.21.15.81:0/1443633602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e03090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.191+0000 7fca4f7fe640 1 -- 172.21.15.81:0/1443633602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587e5cf53a0 con 0x5587e5e035d0 2024-09-12T01:32:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.191+0000 7fca4f7fe640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fca380a2d70 0x7fca380a5230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fca440139b0 tx=0x7fca4400bb80 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.191+0000 7fca4f7fe640 1 --2- 172.21.15.81:0/1443633602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 0x5587e5e03a10 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fca440107a0 tx=0x7fca4401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edd3a0900a6b918 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.191+0000 7fca367fc640 1 -- 172.21.15.81:0/1443633602 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44021070 con 0x5587e5e035d0 2024-09-12T01:32:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.191+0000 7fca367fc640 1 -- 172.21.15.81:0/1443633602 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca44005500 con 0x5587e5e035d0 2024-09-12T01:32:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.191+0000 7fca367fc640 1 -- 172.21.15.81:0/1443633602 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca440049c0 con 0x5587e5e035d0 2024-09-12T01:32:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.192+0000 7fca5864a740 1 -- 172.21.15.81:0/1443633602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 msgr2=0x5587e5e03a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.192+0000 7fca5864a740 1 --2- 172.21.15.81:0/1443633602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 0x5587e5e03a10 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fca440107a0 tx=0x7fca4401a000 comp rx=0 tx=0).stop 2024-09-12T01:32:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.192+0000 7fca5864a740 1 -- 172.21.15.81:0/1443633602 shutdown_connections 2024-09-12T01:32:47.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.192+0000 7fca5864a740 1 --2- 172.21.15.81:0/1443633602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e0e370 0x5587e5e10760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.192+0000 7fca5864a740 1 --2- 172.21.15.81:0/1443633602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 0x5587e5e03a10 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.192+0000 7fca5864a740 1 --2- 172.21.15.81:0/1443633602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e03090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.192+0000 7fca5864a740 1 -- 172.21.15.81:0/1443633602 >> 172.21.15.81:0/1443633602 conn(0x5587e5dcc310 msgr2=0x5587e5dffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:47.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.192+0000 7fca5864a740 1 -- 172.21.15.81:0/1443633602 shutdown_connections 2024-09-12T01:32:47.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.192+0000 7fca5864a740 1 -- 172.21.15.81:0/1443633602 wait complete. 2024-09-12T01:32:47.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.192+0000 7fca5864a740 1 -- start start 2024-09-12T01:32:47.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.192+0000 7fca5864a740 1 Processor -- start 2024-09-12T01:32:47.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5864a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e035d0 0x5587e5e0ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5864a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e0b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5864a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 0x5587e5e0b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5864a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5587e5e11010 con 0x5587e5e0e370 2024-09-12T01:32:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5864a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5587e5d24060 con 0x5587e5e04b40 2024-09-12T01:32:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5864a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5587e5e11190 con 0x5587e5e035d0 2024-09-12T01:32:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5864a740 10 client.0 _ll_register_callbacks cb 0x5587e5a778c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5480e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 0x5587e5e0b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5480e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 0x5587e5e0b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54810/0 (socket says 172.21.15.81:54810) 2024-09-12T01:32:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5480e640 1 -- 172.21.15.81:0/365799072 learned_addr learned my addr 172.21.15.81:0/365799072 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca4ffff640 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e035d0 0x5587e5e0ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca4f7fe640 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e0b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5480e640 1 -- 172.21.15.81:0/365799072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e035d0 msgr2=0x5587e5e0ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5480e640 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e035d0 0x5587e5e0ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5480e640 1 -- 172.21.15.81:0/365799072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 msgr2=0x5587e5e0b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5480e640 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e0b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5480e640 1 -- 172.21.15.81:0/365799072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587e5ada3c0 con 0x5587e5e0e370 2024-09-12T01:32:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca4f7fe640 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e0b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca5480e640 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 0x5587e5e0b7f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fca48031f80 tx=0x7fca480bccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd21a88ae503534 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca2f7fe640 1 -- 172.21.15.81:0/365799072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca480bd0b0 con 0x5587e5e0e370 2024-09-12T01:32:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.193+0000 7fca2f7fe640 1 -- 172.21.15.81:0/365799072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fca480ee330 con 0x5587e5e0e370 2024-09-12T01:32:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.194+0000 7fca5864a740 1 -- 172.21.15.81:0/365799072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca44005500 con 0x5587e5e0e370 2024-09-12T01:32:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.194+0000 7fca2f7fe640 1 -- 172.21.15.81:0/365799072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca480c1460 con 0x5587e5e0e370 2024-09-12T01:32:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.194+0000 7fca5864a740 10 client.16527 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.194+0000 7fca5864a740 1 -- 172.21.15.81:0/365799072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5587e5e11010 con 0x5587e5e0e370 2024-09-12T01:32:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.194+0000 7fca2f7fe640 1 -- 172.21.15.81:0/365799072 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca44005500 con 0x5587e5e0e370 2024-09-12T01:32:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.194+0000 7fca2f7fe640 1 -- 172.21.15.81:0/365799072 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca4802fa80 con 0x5587e5e0e370 2024-09-12T01:32:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.194+0000 7fca5864a740 10 client.16527 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.194+0000 7fca5864a740 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.194+0000 7fca5864a740 20 client.16527 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.194+0000 7fca5864a740 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5587e5e1dfa0 0x5587e5e203e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.194+0000 7fca5864a740 4 client.16527 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:32:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.194+0000 7fca5864a740 1 -- 172.21.15.81:0/365799072 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587e5d76860 con 0x5587e5e1dfa0 2024-09-12T01:32:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.194+0000 7fca4ffff640 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5587e5e1dfa0 0x5587e5e203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.195+0000 7fca4ffff640 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5587e5e1dfa0 0x5587e5e203e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f59ef909596d4ba server_cookie=6dffb661a64055c2 in_seq=0 out_seq=0 2024-09-12T01:32:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.195+0000 7fca2f7fe640 10 client.16527 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca2f7fe640 1 -- 172.21.15.81:0/365799072 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587e5d76860 con 0x5587e5e1dfa0 2024-09-12T01:32:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca2f7fe640 10 client.16527 handle_command_reply: tid=0 2024-09-12T01:32:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca5864a740 1 client.16527 shutdown 2024-09-12T01:32:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca5864a740 1 -- 172.21.15.81:0/365799072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 msgr2=0x5587e5e0b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca5864a740 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 0x5587e5e0b7f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fca48031f80 tx=0x7fca480bccb0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca5864a740 1 -- 172.21.15.81:0/365799072 shutdown_connections 2024-09-12T01:32:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca5864a740 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5587e5e1dfa0 0x5587e5e203e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca5864a740 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 0x5587e5e0b7f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca5864a740 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e0b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca2f7fe640 0 client.16527 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca5864a740 1 --2- 172.21.15.81:0/365799072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e035d0 0x5587e5e0ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca5864a740 1 -- 172.21.15.81:0/365799072 >> 172.21.15.81:0/365799072 conn(0x5587e5dcc310 msgr2=0x5587e5e05960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca5864a740 1 -- 172.21.15.81:0/365799072 shutdown_connections 2024-09-12T01:32:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca5864a740 1 -- 172.21.15.81:0/365799072 wait complete. 2024-09-12T01:32:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.196+0000 7fca5864a740 20 client.16527 trim_cache size 0 max 16384 2024-09-12T01:32:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5864a740 1 Processor -- start 2024-09-12T01:32:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5864a740 1 -- start start 2024-09-12T01:32:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5864a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e035d0 0x5587e5e0a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5864a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e0cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5864a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 0x5587e5e06120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5864a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca501ad600 con 0x5587e5e0e370 2024-09-12T01:32:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5864a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca501af140 con 0x5587e5e04b40 2024-09-12T01:32:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5864a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fca501adcd0 con 0x5587e5e035d0 2024-09-12T01:32:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5480e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 0x5587e5e06120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5480e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 0x5587e5e06120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54820/0 (socket says 172.21.15.81:54820) 2024-09-12T01:32:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5480e640 1 -- 172.21.15.81:0/4035503067 learned_addr learned my addr 172.21.15.81:0/4035503067 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca4f7fe640 1 --2- 172.21.15.81:0/4035503067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e0cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5480e640 1 -- 172.21.15.81:0/4035503067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e035d0 msgr2=0x5587e5e0a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca4ffff640 1 --2- 172.21.15.81:0/4035503067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e035d0 0x5587e5e0a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5480e640 1 --2- 172.21.15.81:0/4035503067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e035d0 0x5587e5e0a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5480e640 1 -- 172.21.15.81:0/4035503067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 msgr2=0x5587e5e0cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5480e640 1 --2- 172.21.15.81:0/4035503067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e0cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5480e640 1 -- 172.21.15.81:0/4035503067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587e5e20a60 con 0x5587e5e0e370 2024-09-12T01:32:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca4ffff640 1 --2- 172.21.15.81:0/4035503067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e035d0 0x5587e5e0a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca4f7fe640 1 --2- 172.21.15.81:0/4035503067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e0cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.209+0000 7fca5480e640 1 --2- 172.21.15.81:0/4035503067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 0x5587e5e06120 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fca480ee6b0 tx=0x7fca480bcd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998f20f4a13f4ee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.210+0000 7fca35ffb640 1 -- 172.21.15.81:0/4035503067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca480bd0b0 con 0x5587e5e0e370 2024-09-12T01:32:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.210+0000 7fca35ffb640 1 -- 172.21.15.81:0/4035503067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca48036040 con 0x5587e5e0e370 2024-09-12T01:32:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.210+0000 7fca35ffb640 1 -- 172.21.15.81:0/4035503067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca480b9720 con 0x5587e5e0e370 2024-09-12T01:32:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.210+0000 7fca5864a740 1 -- 172.21.15.81:0/4035503067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 msgr2=0x5587e5e06120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.210+0000 7fca5864a740 1 --2- 172.21.15.81:0/4035503067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 0x5587e5e06120 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fca480ee6b0 tx=0x7fca480bcd20 comp rx=0 tx=0).stop 2024-09-12T01:32:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.210+0000 7fca5864a740 1 -- 172.21.15.81:0/4035503067 shutdown_connections 2024-09-12T01:32:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.210+0000 7fca5864a740 1 --2- 172.21.15.81:0/4035503067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e0e370 0x5587e5e06120 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.210+0000 7fca5864a740 1 --2- 172.21.15.81:0/4035503067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e04b40 0x5587e5e0cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.210+0000 7fca5864a740 1 --2- 172.21.15.81:0/4035503067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e035d0 0x5587e5e0a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.210+0000 7fca5864a740 1 -- 172.21.15.81:0/4035503067 >> 172.21.15.81:0/4035503067 conn(0x5587e5dcc310 msgr2=0x5587e5e0c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.210+0000 7fca5864a740 1 -- 172.21.15.81:0/4035503067 shutdown_connections 2024-09-12T01:32:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.210+0000 7fca5864a740 1 -- 172.21.15.81:0/4035503067 wait complete. 2024-09-12T01:32:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.210+0000 7fca5864a740 1 -- start start 2024-09-12T01:32:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca5864a740 1 Processor -- start 2024-09-12T01:32:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca5864a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 0x5587e5e080e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca5864a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e04b40 0x5587e5e08620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca5864a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e0e370 0x5587e5e08b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca5864a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca501aea70 con 0x5587e5e035d0 2024-09-12T01:32:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca5864a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca501ae3a0 con 0x5587e5e0e370 2024-09-12T01:32:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca5864a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fca501ab5e0 con 0x5587e5e04b40 2024-09-12T01:32:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca5864a740 10 client.0 _ll_register_callbacks cb 0x7fca48005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 0x5587e5e080e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 0x5587e5e080e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54822/0 (socket says 172.21.15.81:54822) 2024-09-12T01:32:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca4ffff640 1 -- 172.21.15.81:0/106623071 learned_addr learned my addr 172.21.15.81:0/106623071 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca5480e640 1 --2- 172.21.15.81:0/106623071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e0e370 0x5587e5e08b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca4ffff640 1 -- 172.21.15.81:0/106623071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e04b40 msgr2=0x5587e5e08620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca4ffff640 1 --2- 172.21.15.81:0/106623071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e04b40 0x5587e5e08620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca4ffff640 1 -- 172.21.15.81:0/106623071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e0e370 msgr2=0x5587e5e08b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca4ffff640 1 --2- 172.21.15.81:0/106623071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e0e370 0x5587e5e08b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.211+0000 7fca4ffff640 1 -- 172.21.15.81:0/106623071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587e5e00dd0 con 0x5587e5e035d0 2024-09-12T01:32:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca4ffff640 1 --2- 172.21.15.81:0/106623071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 0x5587e5e080e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fca40000c00 tx=0x7fca40010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228b6ae053fe2b7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca2f7fe640 1 -- 172.21.15.81:0/106623071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4002b060 con 0x5587e5e035d0 2024-09-12T01:32:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca2f7fe640 1 -- 172.21.15.81:0/106623071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fca4001e8d0 con 0x5587e5e035d0 2024-09-12T01:32:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca5864a740 1 -- 172.21.15.81:0/106623071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca48036040 con 0x5587e5e035d0 2024-09-12T01:32:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca2f7fe640 1 -- 172.21.15.81:0/106623071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca4001ead0 con 0x5587e5e035d0 2024-09-12T01:32:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca5864a740 10 client.16533 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca5864a740 1 -- 172.21.15.81:0/106623071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5587e5e88e20 con 0x5587e5e035d0 2024-09-12T01:32:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca2f7fe640 1 -- 172.21.15.81:0/106623071 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca48036040 con 0x5587e5e035d0 2024-09-12T01:32:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca2f7fe640 1 -- 172.21.15.81:0/106623071 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca4001d390 con 0x5587e5e035d0 2024-09-12T01:32:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca5864a740 10 client.16533 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca5864a740 10 client.16533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca5864a740 20 client.16533 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca5864a740 1 --2- 172.21.15.81:0/106623071 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5587e5e89570 0x5587e5e8b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca5864a740 4 client.16533 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:32:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.212+0000 7fca5864a740 1 -- 172.21.15.81:0/106623071 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5587e5d70d70 con 0x5587e5e89570 2024-09-12T01:32:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.213+0000 7fca4f7fe640 1 --2- 172.21.15.81:0/106623071 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5587e5e89570 0x5587e5e8b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.213+0000 7fca4f7fe640 1 --2- 172.21.15.81:0/106623071 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5587e5e89570 0x5587e5e8b990 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95f9ad9f1e06f257 server_cookie=e66bb02bb67373 in_seq=0 out_seq=0 2024-09-12T01:32:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.213+0000 7fca2f7fe640 10 client.16533 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.213+0000 7fca2f7fe640 1 -- 172.21.15.81:0/106623071 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5587e5d70d70 con 0x5587e5e89570 2024-09-12T01:32:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.213+0000 7fca2f7fe640 10 client.16533 handle_command_reply: tid=0 2024-09-12T01:32:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.213+0000 7fca5864a740 1 client.16533 shutdown 2024-09-12T01:32:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca5864a740 1 -- 172.21.15.81:0/106623071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 msgr2=0x5587e5e080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca5864a740 1 --2- 172.21.15.81:0/106623071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 0x5587e5e080e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fca40000c00 tx=0x7fca40010af0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca5864a740 1 -- 172.21.15.81:0/106623071 shutdown_connections 2024-09-12T01:32:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca5864a740 1 --2- 172.21.15.81:0/106623071 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5587e5e89570 0x5587e5e8b990 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca5864a740 1 --2- 172.21.15.81:0/106623071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5587e5e0e370 0x5587e5e08b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca5864a740 1 --2- 172.21.15.81:0/106623071 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5587e5e04b40 0x5587e5e08620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca5864a740 1 --2- 172.21.15.81:0/106623071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5587e5e035d0 0x5587e5e080e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca5864a740 1 -- 172.21.15.81:0/106623071 >> 172.21.15.81:0/106623071 conn(0x5587e5dcc310 msgr2=0x5587e5e0d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca2f7fe640 0 client.16533 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca5864a740 1 -- 172.21.15.81:0/106623071 shutdown_connections 2024-09-12T01:32:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca5864a740 1 -- 172.21.15.81:0/106623071 wait complete. 2024-09-12T01:32:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca5864a740 20 client.16533 trim_cache size 0 max 16384 2024-09-12T01:32:47.236 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:32:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca56271640 1 -- 172.21.15.81:0/3618639310 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fca380a2d70 msgr2=0x7fca380a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca56271640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fca380a2d70 0x7fca380a5230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fca440139b0 tx=0x7fca4400bb80 comp rx=0 tx=0).stop 2024-09-12T01:32:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca56271640 1 -- 172.21.15.81:0/3618639310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca50106f10 msgr2=0x7fca5019cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca56271640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca50106f10 0x7fca5019cc20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fca48031a60 tx=0x7fca48031a90 comp rx=0 tx=0).stop 2024-09-12T01:32:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca56271640 1 -- 172.21.15.81:0/3618639310 shutdown_connections 2024-09-12T01:32:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca56271640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fca380a2d70 0x7fca380a5230 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca56271640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca50106f10 0x7fca5019cc20 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca56271640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca50102790 0x7fca50198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca56271640 1 --2- 172.21.15.81:0/3618639310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca50101de0 0x7fca50198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.214+0000 7fca56271640 1 -- 172.21.15.81:0/3618639310 >> 172.21.15.81:0/3618639310 conn(0x7fca500fd8c0 msgr2=0x7fca500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.215+0000 7fca56271640 1 -- 172.21.15.81:0/3618639310 shutdown_connections 2024-09-12T01:32:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:47.215+0000 7fca56271640 1 -- 172.21.15.81:0/3618639310 wait complete. 2024-09-12T01:32:47.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:47 smithi100 ceph-mon[35275]: pgmap v144: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:32:47.531 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:47 smithi189 ceph-mon[35357]: pgmap v144: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:32:48.938 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:32:48.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:32:49.191 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:32:49.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:49 smithi081 ceph-mon[30920]: pgmap v145: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:49.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:49 smithi100 ceph-mon[35275]: pgmap v145: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:49.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:49 smithi189 ceph-mon[35357]: pgmap v145: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:32:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.708+0000 7f3fc408e640 1 -- 172.21.15.81:0/66442100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fbc100ca0 msgr2=0x7f3fbc106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.708+0000 7f3fc408e640 1 --2- 172.21.15.81:0/66442100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fbc100ca0 0x7f3fbc106840 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009930 tx=0x7f3fac02a420 comp rx=0 tx=0).stop 2024-09-12T01:32:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.708+0000 7f3fc408e640 1 -- 172.21.15.81:0/66442100 shutdown_connections 2024-09-12T01:32:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.708+0000 7f3fc408e640 1 --2- 172.21.15.81:0/66442100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fbc106f50 0x7f3fbc10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.708+0000 7f3fc408e640 1 --2- 172.21.15.81:0/66442100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fbc100ca0 0x7f3fbc106840 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.708+0000 7f3fc408e640 1 --2- 172.21.15.81:0/66442100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fbc1002f0 0x7f3fbc1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.708+0000 7f3fc408e640 1 -- 172.21.15.81:0/66442100 >> 172.21.15.81:0/66442100 conn(0x7f3fbc077210 msgr2=0x7f3fbc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.708+0000 7f3fc408e640 1 -- 172.21.15.81:0/66442100 shutdown_connections 2024-09-12T01:32:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.708+0000 7f3fc408e640 1 -- 172.21.15.81:0/66442100 wait complete. 2024-09-12T01:32:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.709+0000 7f3fc408e640 1 Processor -- start 2024-09-12T01:32:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.709+0000 7f3fc408e640 1 -- start start 2024-09-12T01:32:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.709+0000 7f3fc408e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fbc1002f0 0x7f3fbc198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.709+0000 7f3fc408e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fbc100ca0 0x7f3fbc198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.709+0000 7f3fc408e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fbc106f50 0x7f3fbc19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.709+0000 7f3fc408e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc111fa0 con 0x7f3fbc100ca0 2024-09-12T01:32:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.709+0000 7f3fc408e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc111e20 con 0x7f3fbc106f50 2024-09-12T01:32:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.709+0000 7f3fc408e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc112120 con 0x7f3fbc1002f0 2024-09-12T01:32:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.709+0000 7f3fc1629640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fbc100ca0 0x7f3fbc198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.709+0000 7f3fc1629640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fbc100ca0 0x7f3fbc198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54852/0 (socket says 172.21.15.81:54852) 2024-09-12T01:32:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.709+0000 7f3fc1629640 1 -- 172.21.15.81:0/1288034942 learned_addr learned my addr 172.21.15.81:0/1288034942 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.709+0000 7f3fc262b640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fbc106f50 0x7f3fbc19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.710+0000 7f3fc1e2a640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fbc1002f0 0x7f3fbc198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.710+0000 7f3fc1629640 1 -- 172.21.15.81:0/1288034942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fbc1002f0 msgr2=0x7f3fbc198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.710+0000 7f3fc1629640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fbc1002f0 0x7f3fbc198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.710+0000 7f3fc1629640 1 -- 172.21.15.81:0/1288034942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fbc106f50 msgr2=0x7f3fbc19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.710+0000 7f3fc1629640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fbc106f50 0x7f3fbc19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.710+0000 7f3fc1629640 1 -- 172.21.15.81:0/1288034942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc19d3d0 con 0x7f3fbc100ca0 2024-09-12T01:32:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.710+0000 7f3fc1e2a640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fbc1002f0 0x7f3fbc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.710+0000 7f3fc1629640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fbc100ca0 0x7f3fbc198960 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3fac005940 tx=0x7f3fac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.710+0000 7f3fb2ffd640 1 -- 172.21.15.81:0/1288034942 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac03f030 con 0x7f3fbc100ca0 2024-09-12T01:32:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.710+0000 7f3fb2ffd640 1 -- 172.21.15.81:0/1288034942 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fac003ce0 con 0x7f3fbc100ca0 2024-09-12T01:32:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.710+0000 7f3fb2ffd640 1 -- 172.21.15.81:0/1288034942 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac035070 con 0x7f3fbc100ca0 2024-09-12T01:32:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.710+0000 7f3fc408e640 1 -- 172.21.15.81:0/1288034942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fbc19d660 con 0x7f3fbc100ca0 2024-09-12T01:32:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.710+0000 7f3fc408e640 1 -- 172.21.15.81:0/1288034942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fbc1a4fa0 con 0x7f3fbc100ca0 2024-09-12T01:32:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.712+0000 7f3fb2ffd640 1 -- 172.21.15.81:0/1288034942 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f3fac042030 con 0x7f3fbc100ca0 2024-09-12T01:32:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.712+0000 7f3fc6467740 1 Processor -- start 2024-09-12T01:32:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fc6467740 1 -- start start 2024-09-12T01:32:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fc6467740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 0x555e22e1ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fc6467740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 0x555e22e2a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fc6467740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 0x555e22e2d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fc6467740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555e22d85280 con 0x555e22e20480 2024-09-12T01:32:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fc6467740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555e22d2cb10 con 0x555e22e2ad40 2024-09-12T01:32:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fc6467740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555e22d81240 con 0x555e22e1fb60 2024-09-12T01:32:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fc1e2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 0x555e22e2a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fc1e2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 0x555e22e2a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54868/0 (socket says 172.21.15.81:54868) 2024-09-12T01:32:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fc1e2a640 1 -- 172.21.15.81:0/546899350 learned_addr learned my addr 172.21.15.81:0/546899350 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fb2ffd640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3fa80a2d70 0x7f3fa80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fc262b640 1 --2- 172.21.15.81:0/546899350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 0x555e22e1ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fc262b640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3fa80a2d70 0x7f3fa80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.713+0000 7f3fc1e2a640 1 -- 172.21.15.81:0/546899350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 msgr2=0x555e22e1ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.714+0000 7f3fc1e2a640 1 --2- 172.21.15.81:0/546899350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 0x555e22e1ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.714+0000 7f3fc1e2a640 1 -- 172.21.15.81:0/546899350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 msgr2=0x555e22e2d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.714+0000 7f3fc1e2a640 1 --2- 172.21.15.81:0/546899350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 0x555e22e2d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.714+0000 7f3fc1e2a640 1 -- 172.21.15.81:0/546899350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e22d391f0 con 0x555e22e20480 2024-09-12T01:32:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.714+0000 7f3fb2ffd640 1 -- 172.21.15.81:0/1288034942 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f3fac0ef640 con 0x7f3fbc100ca0 2024-09-12T01:32:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.714+0000 7f3fc1e2a640 1 --2- 172.21.15.81:0/546899350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 0x555e22e2a800 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800bc20 tx=0x7f3fb800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7929cc18e9878ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.714+0000 7f3fa7fff640 1 -- 172.21.15.81:0/546899350 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8017620 con 0x555e22e20480 2024-09-12T01:32:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.714+0000 7f3fc262b640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3fa80a2d70 0x7f3fa80a5230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4005c40 tx=0x7f3fb4005bd0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.714+0000 7f3fa7fff640 1 -- 172.21.15.81:0/546899350 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fb8017ca0 con 0x555e22e20480 2024-09-12T01:32:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.714+0000 7f3fa7fff640 1 -- 172.21.15.81:0/546899350 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800fd60 con 0x555e22e20480 2024-09-12T01:32:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.715+0000 7f3fc6467740 1 -- 172.21.15.81:0/546899350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 msgr2=0x555e22e2a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:49.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.715+0000 7f3fc6467740 1 --2- 172.21.15.81:0/546899350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 0x555e22e2a800 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800bc20 tx=0x7f3fb800d710 comp rx=0 tx=0).stop 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.715+0000 7f3fc6467740 1 -- 172.21.15.81:0/546899350 shutdown_connections 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.715+0000 7f3fc6467740 1 --2- 172.21.15.81:0/546899350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 0x555e22e2d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.715+0000 7f3fc6467740 1 --2- 172.21.15.81:0/546899350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 0x555e22e2a800 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.715+0000 7f3fc6467740 1 --2- 172.21.15.81:0/546899350 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 0x555e22e1ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.715+0000 7f3fc6467740 1 -- 172.21.15.81:0/546899350 >> 172.21.15.81:0/546899350 conn(0x555e22e1c0f0 msgr2=0x555e22e1c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.715+0000 7f3fc6467740 1 -- 172.21.15.81:0/546899350 shutdown_connections 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.715+0000 7f3fc6467740 1 -- 172.21.15.81:0/546899350 wait complete. 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.715+0000 7f3fc6467740 1 -- start start 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.715+0000 7f3fc6467740 1 Processor -- start 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc6467740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 0x555e22e27c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc6467740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 0x555e22e28160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc6467740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 0x555e22e286a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc6467740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555e22e2d910 con 0x555e22e20480 2024-09-12T01:32:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc6467740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555e22d3ff10 con 0x555e22e2ad40 2024-09-12T01:32:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc6467740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555e22e2da90 con 0x555e22e1fb60 2024-09-12T01:32:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc6467740 10 client.0 _ll_register_callbacks cb 0x555e22d08a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc1629640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 0x555e22e28160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc1629640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 0x555e22e28160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54882/0 (socket says 172.21.15.81:54882) 2024-09-12T01:32:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc1629640 1 -- 172.21.15.81:0/19222186 learned_addr learned my addr 172.21.15.81:0/19222186 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc262b640 1 --2- 172.21.15.81:0/19222186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 0x555e22e286a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc1e2a640 1 --2- 172.21.15.81:0/19222186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 0x555e22e27c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc1629640 1 -- 172.21.15.81:0/19222186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 msgr2=0x555e22e27c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc1629640 1 --2- 172.21.15.81:0/19222186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 0x555e22e27c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc1629640 1 -- 172.21.15.81:0/19222186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 msgr2=0x555e22e286a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc1629640 1 --2- 172.21.15.81:0/19222186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 0x555e22e286a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc1629640 1 -- 172.21.15.81:0/19222186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e22af66a0 con 0x555e22e20480 2024-09-12T01:32:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc1629640 1 --2- 172.21.15.81:0/19222186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 0x555e22e28160 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0ed3c0 tx=0x7f3fac0b7e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be472093e63df726 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fa57fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fa57fa640 1 -- 172.21.15.81:0/19222186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac049040 con 0x555e22e20480 2024-09-12T01:32:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fa57fa640 1 -- 172.21.15.81:0/19222186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f3fac0ed040 con 0x555e22e20480 2024-09-12T01:32:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.716+0000 7f3fc6467740 1 -- 172.21.15.81:0/19222186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fb8017ca0 con 0x555e22e20480 2024-09-12T01:32:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.717+0000 7f3fa57fa640 1 -- 172.21.15.81:0/19222186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3fac0bb4f0 con 0x555e22e20480 2024-09-12T01:32:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.717+0000 7f3fc6467740 10 client.16545 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.717+0000 7f3fc6467740 1 -- 172.21.15.81:0/19222186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555e22e39540 con 0x555e22e20480 2024-09-12T01:32:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.717+0000 7f3fa57fa640 1 -- 172.21.15.81:0/19222186 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fb8017ca0 con 0x555e22e20480 2024-09-12T01:32:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.717+0000 7f3fa57fa640 1 -- 172.21.15.81:0/19222186 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3fac04c060 con 0x555e22e20480 2024-09-12T01:32:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.717+0000 7f3fc6467740 10 client.16545 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.717+0000 7f3fc6467740 10 client.16545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.717+0000 7f3fc6467740 20 client.16545 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.717+0000 7f3fc6467740 1 --2- 172.21.15.81:0/19222186 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555e22e3a9a0 0x555e22e3cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.717+0000 7f3fc6467740 4 client.16545 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:32:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.717+0000 7f3fc6467740 1 -- 172.21.15.81:0/19222186 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e22d927f0 con 0x555e22e3a9a0 2024-09-12T01:32:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.717+0000 7f3fc1e2a640 1 --2- 172.21.15.81:0/19222186 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555e22e3a9a0 0x555e22e3cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.718+0000 7f3fa57fa640 10 client.16545 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.718+0000 7f3fc1e2a640 1 --2- 172.21.15.81:0/19222186 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555e22e3a9a0 0x555e22e3cdb0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcc633bd3dc8603a server_cookie=bf857a002a06574a in_seq=0 out_seq=0 2024-09-12T01:32:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.718+0000 7f3fa57fa640 1 -- 172.21.15.81:0/19222186 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e22d927f0 con 0x555e22e3a9a0 2024-09-12T01:32:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.718+0000 7f3fa57fa640 10 client.16545 handle_command_reply: tid=0 2024-09-12T01:32:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.718+0000 7f3fc6467740 1 client.16545 shutdown 2024-09-12T01:32:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.719+0000 7f3fc6467740 1 -- 172.21.15.81:0/19222186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 msgr2=0x555e22e28160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.719+0000 7f3fc6467740 1 --2- 172.21.15.81:0/19222186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 0x555e22e28160 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0ed3c0 tx=0x7f3fac0b7e30 comp rx=0 tx=0).stop 2024-09-12T01:32:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.719+0000 7f3fc6467740 1 -- 172.21.15.81:0/19222186 shutdown_connections 2024-09-12T01:32:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.719+0000 7f3fc6467740 1 --2- 172.21.15.81:0/19222186 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555e22e3a9a0 0x555e22e3cdb0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.719+0000 7f3fc6467740 1 --2- 172.21.15.81:0/19222186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 0x555e22e286a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.719+0000 7f3fa57fa640 0 client.16545 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.719+0000 7f3fc6467740 1 --2- 172.21.15.81:0/19222186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e20480 0x555e22e28160 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.719+0000 7f3fc6467740 1 --2- 172.21.15.81:0/19222186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 0x555e22e27c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.719+0000 7f3fc6467740 1 -- 172.21.15.81:0/19222186 >> 172.21.15.81:0/19222186 conn(0x555e22e1c0f0 msgr2=0x555e22e21dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.719+0000 7f3fc6467740 1 -- 172.21.15.81:0/19222186 shutdown_connections 2024-09-12T01:32:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.719+0000 7f3fc6467740 1 -- 172.21.15.81:0/19222186 wait complete. 2024-09-12T01:32:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.719+0000 7f3fc6467740 20 client.16545 trim_cache size 0 max 16384 2024-09-12T01:32:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.736+0000 7f3fc6467740 1 Processor -- start 2024-09-12T01:32:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.736+0000 7f3fc6467740 1 -- start start 2024-09-12T01:32:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.736+0000 7f3fc6467740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 0x555e22e26ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.736+0000 7f3fc6467740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e20480 0x555e22e42680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.736+0000 7f3fc6467740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e2ad40 0x555e22e42bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.736+0000 7f3fc6467740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc1ab620 con 0x555e22e2ad40 2024-09-12T01:32:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.736+0000 7f3fc6467740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc1ad160 con 0x555e22e20480 2024-09-12T01:32:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.736+0000 7f3fc6467740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc1abcf0 con 0x555e22e1fb60 2024-09-12T01:32:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.737+0000 7f3fc262b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e2ad40 0x555e22e42bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.737+0000 7f3fc262b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e2ad40 0x555e22e42bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54894/0 (socket says 172.21.15.81:54894) 2024-09-12T01:32:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.737+0000 7f3fc262b640 1 -- 172.21.15.81:0/1051772287 learned_addr learned my addr 172.21.15.81:0/1051772287 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.737+0000 7f3fc1629640 1 --2- 172.21.15.81:0/1051772287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e20480 0x555e22e42680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.737+0000 7f3fc1e2a640 1 --2- 172.21.15.81:0/1051772287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 0x555e22e26ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.737+0000 7f3fc262b640 1 -- 172.21.15.81:0/1051772287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 msgr2=0x555e22e26ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.737+0000 7f3fc262b640 1 --2- 172.21.15.81:0/1051772287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 0x555e22e26ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.737+0000 7f3fc262b640 1 -- 172.21.15.81:0/1051772287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e20480 msgr2=0x555e22e42680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.737+0000 7f3fc262b640 1 --2- 172.21.15.81:0/1051772287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e20480 0x555e22e42680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.737+0000 7f3fc262b640 1 -- 172.21.15.81:0/1051772287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e22e1bb90 con 0x555e22e2ad40 2024-09-12T01:32:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.737+0000 7f3fc1629640 1 --2- 172.21.15.81:0/1051772287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e20480 0x555e22e42680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:32:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.737+0000 7f3fc262b640 1 --2- 172.21.15.81:0/1051772287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e2ad40 0x555e22e42bc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4010940 tx=0x7f3fb4014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1a3d836b128141 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.737+0000 7f3fa77fe640 1 -- 172.21.15.81:0/1051772287 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb401fb10 con 0x555e22e2ad40 2024-09-12T01:32:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.738+0000 7f3fa77fe640 1 -- 172.21.15.81:0/1051772287 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fb4016070 con 0x555e22e2ad40 2024-09-12T01:32:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.738+0000 7f3fa77fe640 1 -- 172.21.15.81:0/1051772287 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb40283f0 con 0x555e22e2ad40 2024-09-12T01:32:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.738+0000 7f3fc6467740 1 -- 172.21.15.81:0/1051772287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e2ad40 msgr2=0x555e22e42bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.738+0000 7f3fc6467740 1 --2- 172.21.15.81:0/1051772287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e2ad40 0x555e22e42bc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4010940 tx=0x7f3fb4014070 comp rx=0 tx=0).stop 2024-09-12T01:32:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.738+0000 7f3fc6467740 1 -- 172.21.15.81:0/1051772287 shutdown_connections 2024-09-12T01:32:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.738+0000 7f3fc6467740 1 --2- 172.21.15.81:0/1051772287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e2ad40 0x555e22e42bc0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.738+0000 7f3fc6467740 1 --2- 172.21.15.81:0/1051772287 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e20480 0x555e22e42680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.738+0000 7f3fc6467740 1 --2- 172.21.15.81:0/1051772287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e1fb60 0x555e22e26ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.738+0000 7f3fc6467740 1 -- 172.21.15.81:0/1051772287 >> 172.21.15.81:0/1051772287 conn(0x555e22e1c0f0 msgr2=0x555e22e263c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.738+0000 7f3fc6467740 1 -- 172.21.15.81:0/1051772287 shutdown_connections 2024-09-12T01:32:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.738+0000 7f3fc6467740 1 -- 172.21.15.81:0/1051772287 wait complete. 2024-09-12T01:32:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc6467740 1 -- start start 2024-09-12T01:32:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc6467740 1 Processor -- start 2024-09-12T01:32:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc6467740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e1fb60 0x555e22e2f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc6467740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e20480 0x555e22e2f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc6467740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 0x555e22e9e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc6467740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc1aca90 con 0x555e22e1fb60 2024-09-12T01:32:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc6467740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc1ac3c0 con 0x555e22e2ad40 2024-09-12T01:32:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc6467740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc1a9600 con 0x555e22e20480 2024-09-12T01:32:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc6467740 10 client.0 _ll_register_callbacks cb 0x7f3fac031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc1e2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e1fb60 0x555e22e2f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc1e2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e1fb60 0x555e22e2f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54910/0 (socket says 172.21.15.81:54910) 2024-09-12T01:32:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc1e2a640 1 -- 172.21.15.81:0/2182735338 learned_addr learned my addr 172.21.15.81:0/2182735338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc1629640 1 --2- 172.21.15.81:0/2182735338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e20480 0x555e22e2f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.739+0000 7f3fc262b640 1 --2- 172.21.15.81:0/2182735338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 0x555e22e9e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fc1e2a640 1 -- 172.21.15.81:0/2182735338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e20480 msgr2=0x555e22e2f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fc1e2a640 1 --2- 172.21.15.81:0/2182735338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e20480 0x555e22e2f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fc1e2a640 1 -- 172.21.15.81:0/2182735338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 msgr2=0x555e22e9e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fc1e2a640 1 --2- 172.21.15.81:0/2182735338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 0x555e22e9e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fc1e2a640 1 -- 172.21.15.81:0/2182735338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e22e9ecd0 con 0x555e22e1fb60 2024-09-12T01:32:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fc1e2a640 1 --2- 172.21.15.81:0/2182735338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e1fb60 0x555e22e2f2f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800dc10 tx=0x7f3fb800f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864c108b3e763e7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fa57fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fa57fa640 1 -- 172.21.15.81:0/2182735338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8032060 con 0x555e22e1fb60 2024-09-12T01:32:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fa57fa640 1 -- 172.21.15.81:0/2182735338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f3fb800f890 con 0x555e22e1fb60 2024-09-12T01:32:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fc6467740 1 -- 172.21.15.81:0/2182735338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fb4016070 con 0x555e22e1fb60 2024-09-12T01:32:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fa57fa640 1 -- 172.21.15.81:0/2182735338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3fb800fa90 con 0x555e22e1fb60 2024-09-12T01:32:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fc6467740 10 client.16551 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fc6467740 1 -- 172.21.15.81:0/2182735338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555e22ea6080 con 0x555e22e1fb60 2024-09-12T01:32:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.740+0000 7f3fa57fa640 1 -- 172.21.15.81:0/2182735338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fb4016070 con 0x555e22e1fb60 2024-09-12T01:32:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.741+0000 7f3fa57fa640 1 -- 172.21.15.81:0/2182735338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3fb802c070 con 0x555e22e1fb60 2024-09-12T01:32:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.741+0000 7f3fc6467740 10 client.16551 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.741+0000 7f3fc6467740 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.741+0000 7f3fc6467740 20 client.16551 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.741+0000 7f3fc6467740 1 --2- 172.21.15.81:0/2182735338 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555e22ea64d0 0x555e22ea88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.741+0000 7f3fc6467740 4 client.16551 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:32:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.741+0000 7f3fc6467740 1 -- 172.21.15.81:0/2182735338 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555e22d8cd00 con 0x555e22ea64d0 2024-09-12T01:32:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.741+0000 7f3fc1629640 1 --2- 172.21.15.81:0/2182735338 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555e22ea64d0 0x555e22ea88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.741+0000 7f3fa57fa640 10 client.16551 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.741+0000 7f3fc1629640 1 --2- 172.21.15.81:0/2182735338 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555e22ea64d0 0x555e22ea88c0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93211f887ab8596b server_cookie=c00de2c31f10aadb in_seq=0 out_seq=0 2024-09-12T01:32:49.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.742+0000 7f3fa57fa640 1 -- 172.21.15.81:0/2182735338 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555e22d8cd00 con 0x555e22ea64d0 2024-09-12T01:32:49.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.742+0000 7f3fa57fa640 10 client.16551 handle_command_reply: tid=0 2024-09-12T01:32:49.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.742+0000 7f3fc6467740 1 client.16551 shutdown 2024-09-12T01:32:49.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.743+0000 7f3fc6467740 1 -- 172.21.15.81:0/2182735338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e1fb60 msgr2=0x555e22e2f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:49.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.743+0000 7f3fc6467740 1 --2- 172.21.15.81:0/2182735338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e1fb60 0x555e22e2f2f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800dc10 tx=0x7f3fb800f420 comp rx=0 tx=0).stop 2024-09-12T01:32:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.743+0000 7f3fc6467740 1 -- 172.21.15.81:0/2182735338 shutdown_connections 2024-09-12T01:32:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.743+0000 7f3fc6467740 1 --2- 172.21.15.81:0/2182735338 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555e22ea64d0 0x555e22ea88c0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.743+0000 7f3fc6467740 1 --2- 172.21.15.81:0/2182735338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555e22e2ad40 0x555e22e9e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.743+0000 7f3fc6467740 1 --2- 172.21.15.81:0/2182735338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e22e20480 0x555e22e2f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.743+0000 7f3fa57fa640 0 client.16551 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.743+0000 7f3fc6467740 1 --2- 172.21.15.81:0/2182735338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e22e1fb60 0x555e22e2f2f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.743+0000 7f3fc6467740 1 -- 172.21.15.81:0/2182735338 >> 172.21.15.81:0/2182735338 conn(0x555e22e1c0f0 msgr2=0x555e22e28400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.743+0000 7f3fc6467740 1 -- 172.21.15.81:0/2182735338 shutdown_connections 2024-09-12T01:32:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.743+0000 7f3fc6467740 1 -- 172.21.15.81:0/2182735338 wait complete. 2024-09-12T01:32:49.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.743+0000 7f3fc6467740 20 client.16551 trim_cache size 0 max 16384 2024-09-12T01:32:49.748 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:32:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:32:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "a31b379d-fcf7-40e1-8fd4-29463c29800e", 2024-09-12T01:32:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:32:49.748 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:32:49.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.744+0000 7f3fc408e640 1 -- 172.21.15.81:0/1288034942 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3fa80a2d70 msgr2=0x7f3fa80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:49.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.744+0000 7f3fc408e640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3fa80a2d70 0x7f3fa80a5230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4005c40 tx=0x7f3fb4005bd0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.744+0000 7f3fc408e640 1 -- 172.21.15.81:0/1288034942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fbc100ca0 msgr2=0x7f3fbc198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:49.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.744+0000 7f3fc408e640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fbc100ca0 0x7f3fbc198960 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3fac005940 tx=0x7f3fac0042f0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.744+0000 7f3fc408e640 1 -- 172.21.15.81:0/1288034942 shutdown_connections 2024-09-12T01:32:49.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.744+0000 7f3fc408e640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3fa80a2d70 0x7f3fa80a5230 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.744+0000 7f3fc408e640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fbc106f50 0x7f3fbc19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.744+0000 7f3fc408e640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fbc100ca0 0x7f3fbc198960 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.744+0000 7f3fc408e640 1 --2- 172.21.15.81:0/1288034942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fbc1002f0 0x7f3fbc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:49.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.744+0000 7f3fc408e640 1 -- 172.21.15.81:0/1288034942 >> 172.21.15.81:0/1288034942 conn(0x7f3fbc077210 msgr2=0x7f3fbc105760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:49.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.744+0000 7f3fc408e640 1 -- 172.21.15.81:0/1288034942 shutdown_connections 2024-09-12T01:32:49.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:49.744+0000 7f3fc408e640 1 -- 172.21.15.81:0/1288034942 wait complete. 2024-09-12T01:32:50.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:32:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:32:51.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.238+0000 7f2d1d538640 1 -- 172.21.15.81:0/823691305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d18102df0 msgr2=0x7f2d181031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:51.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.238+0000 7f2d1d538640 1 --2- 172.21.15.81:0/823691305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d18102df0 0x7f2d181031d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009900 tx=0x7f2d0802a410 comp rx=0 tx=0).stop 2024-09-12T01:32:51.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.238+0000 7f2d1d538640 1 -- 172.21.15.81:0/823691305 shutdown_connections 2024-09-12T01:32:51.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.238+0000 7f2d1d538640 1 --2- 172.21.15.81:0/823691305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1810c2f0 0x7f2d1810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.238+0000 7f2d1d538640 1 --2- 172.21.15.81:0/823691305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d181037a0 0x7f2d1810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.238+0000 7f2d1d538640 1 --2- 172.21.15.81:0/823691305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d18102df0 0x7f2d181031d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.238+0000 7f2d1d538640 1 -- 172.21.15.81:0/823691305 >> 172.21.15.81:0/823691305 conn(0x7f2d180fc7d0 msgr2=0x7f2d180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:51.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.238+0000 7f2d1d538640 1 -- 172.21.15.81:0/823691305 shutdown_connections 2024-09-12T01:32:51.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.238+0000 7f2d1d538640 1 -- 172.21.15.81:0/823691305 wait complete. 2024-09-12T01:32:51.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.238+0000 7f2d1d538640 1 Processor -- start 2024-09-12T01:32:51.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d1d538640 1 -- start start 2024-09-12T01:32:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d1d538640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d18102df0 0x7f2d18198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d1d538640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d181037a0 0x7f2d18198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d1d538640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1810c2f0 0x7f2d1819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d1d538640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2d18112110 con 0x7f2d181037a0 2024-09-12T01:32:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d1d538640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d18111f90 con 0x7f2d1810c2f0 2024-09-12T01:32:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d1d538640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2d18112290 con 0x7f2d18102df0 2024-09-12T01:32:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d0e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d181037a0 0x7f2d18198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d0e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d181037a0 0x7f2d18198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54922/0 (socket says 172.21.15.81:54922) 2024-09-12T01:32:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d0e7fc640 1 -- 172.21.15.81:0/1259570393 learned_addr learned my addr 172.21.15.81:0/1259570393 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d177fe640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1810c2f0 0x7f2d1819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d16ffd640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d18102df0 0x7f2d18198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d0e7fc640 1 -- 172.21.15.81:0/1259570393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d18102df0 msgr2=0x7f2d18198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:51.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d0e7fc640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d18102df0 0x7f2d18198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d0e7fc640 1 -- 172.21.15.81:0/1259570393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1810c2f0 msgr2=0x7f2d1819cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d0e7fc640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1810c2f0 0x7f2d1819cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d0e7fc640 1 -- 172.21.15.81:0/1259570393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1819d640 con 0x7f2d181037a0 2024-09-12T01:32:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d16ffd640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d18102df0 0x7f2d18198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.239+0000 7f2d0e7fc640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d181037a0 0x7f2d18198bd0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000d750 tx=0x7f2d0000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.240+0000 7f2d14ff9640 1 -- 172.21.15.81:0/1259570393 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00017070 con 0x7f2d181037a0 2024-09-12T01:32:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.240+0000 7f2d14ff9640 1 -- 172.21.15.81:0/1259570393 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d00005500 con 0x7f2d181037a0 2024-09-12T01:32:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.240+0000 7f2d1d538640 1 -- 172.21.15.81:0/1259570393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1819d930 con 0x7f2d181037a0 2024-09-12T01:32:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.240+0000 7f2d14ff9640 1 -- 172.21.15.81:0/1259570393 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00004e00 con 0x7f2d181037a0 2024-09-12T01:32:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.240+0000 7f2d1d538640 1 -- 172.21.15.81:0/1259570393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d181a5210 con 0x7f2d181037a0 2024-09-12T01:32:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.242+0000 7f2d14ff9640 1 -- 172.21.15.81:0/1259570393 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f2d00004fa0 con 0x7f2d181037a0 2024-09-12T01:32:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.242+0000 7f2d1f911740 1 Processor -- start 2024-09-12T01:32:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.242+0000 7f2d1f911740 1 -- start start 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d1f911740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 0x55db4d996880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d1f911740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d996dc0 0x55db4d9a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d1f911740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d9a1680 0x55db4d9a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d1f911740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55db4d8fc2e0 con 0x55db4d9964a0 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d1f911740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55db4d8a3ce0 con 0x55db4d996dc0 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d1f911740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55db4d8f82a0 con 0x55db4d9a1680 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d14ff9640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2d040a2cf0 0x7f2d040a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 0x55db4d996880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 0x55db4d996880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54938/0 (socket says 172.21.15.81:54938) 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d177fe640 1 -- 172.21.15.81:0/2756221385 learned_addr learned my addr 172.21.15.81:0/2756221385 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d16ffd640 1 --2- 172.21.15.81:0/2756221385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d996dc0 0x55db4d9a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d177fe640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2d040a2cf0 0x7f2d040a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d14ff9640 1 -- 172.21.15.81:0/1259570393 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2d000cede0 con 0x7f2d181037a0 2024-09-12T01:32:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d0e7fc640 1 --2- 172.21.15.81:0/2756221385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d9a1680 0x55db4d9a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d177fe640 1 -- 172.21.15.81:0/2756221385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d9a1680 msgr2=0x55db4d9a3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d177fe640 1 --2- 172.21.15.81:0/2756221385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d9a1680 0x55db4d9a3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d177fe640 1 -- 172.21.15.81:0/2756221385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d996dc0 msgr2=0x55db4d9a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d177fe640 1 --2- 172.21.15.81:0/2756221385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d996dc0 0x55db4d9a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d177fe640 1 -- 172.21.15.81:0/2756221385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db4d888440 con 0x55db4d9964a0 2024-09-12T01:32:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d0e7fc640 1 --2- 172.21.15.81:0/2756221385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d9a1680 0x55db4d9a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.243+0000 7f2d177fe640 1 --2- 172.21.15.81:0/2756221385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 0x55db4d996880 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2d10014a60 tx=0x7f2d10014f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64224817fccecde5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.244+0000 7f2d0d7fa640 1 -- 172.21.15.81:0/2756221385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1001ec50 con 0x55db4d9964a0 2024-09-12T01:32:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.244+0000 7f2d0d7fa640 1 -- 172.21.15.81:0/2756221385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d10023070 con 0x55db4d9964a0 2024-09-12T01:32:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.244+0000 7f2d0d7fa640 1 -- 172.21.15.81:0/2756221385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10005650 con 0x55db4d9964a0 2024-09-12T01:32:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.244+0000 7f2d1f911740 1 -- 172.21.15.81:0/2756221385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 msgr2=0x55db4d996880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.244+0000 7f2d1f911740 1 --2- 172.21.15.81:0/2756221385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 0x55db4d996880 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2d10014a60 tx=0x7f2d10014f20 comp rx=0 tx=0).stop 2024-09-12T01:32:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.244+0000 7f2d177fe640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2d040a2cf0 0x7f2d040a51b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2d10022000 tx=0x7f2d1001e000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.244+0000 7f2d1f911740 1 -- 172.21.15.81:0/2756221385 shutdown_connections 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.244+0000 7f2d1f911740 1 --2- 172.21.15.81:0/2756221385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d9a1680 0x55db4d9a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.244+0000 7f2d1f911740 1 --2- 172.21.15.81:0/2756221385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d996dc0 0x55db4d9a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.244+0000 7f2d1f911740 1 --2- 172.21.15.81:0/2756221385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 0x55db4d996880 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.244+0000 7f2d1f911740 1 -- 172.21.15.81:0/2756221385 >> 172.21.15.81:0/2756221385 conn(0x55db4d992a30 msgr2=0x55db4d992e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d1f911740 1 -- 172.21.15.81:0/2756221385 shutdown_connections 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d1f911740 1 -- 172.21.15.81:0/2756221385 wait complete. 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d1f911740 1 -- start start 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d1f911740 1 Processor -- start 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d1f911740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 0x55db4d9a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d1f911740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d996dc0 0x55db4d99e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d1f911740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d9a1680 0x55db4d99e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d1f911740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55db4d9a4250 con 0x55db4d9964a0 2024-09-12T01:32:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d1f911740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55db4d8b7050 con 0x55db4d9a1680 2024-09-12T01:32:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d1f911740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55db4d9a43d0 con 0x55db4d996dc0 2024-09-12T01:32:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d1f911740 10 client.0 _ll_register_callbacks cb 0x55db4d8f7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d16ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 0x55db4d9a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d16ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 0x55db4d9a0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54946/0 (socket says 172.21.15.81:54946) 2024-09-12T01:32:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d16ffd640 1 -- 172.21.15.81:0/734669570 learned_addr learned my addr 172.21.15.81:0/734669570 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.245+0000 7f2d0e7fc640 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d996dc0 0x55db4d99e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d16ffd640 1 -- 172.21.15.81:0/734669570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d996dc0 msgr2=0x55db4d99e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d16ffd640 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d996dc0 0x55db4d99e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d177fe640 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d9a1680 0x55db4d99e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d16ffd640 1 -- 172.21.15.81:0/734669570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d9a1680 msgr2=0x55db4d99e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d16ffd640 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d9a1680 0x55db4d99e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d16ffd640 1 -- 172.21.15.81:0/734669570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db4d66d3c0 con 0x55db4d9964a0 2024-09-12T01:32:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d177fe640 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d9a1680 0x55db4d99e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d16ffd640 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 0x55db4d9a0f90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009230 tx=0x7f2d08032f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ce7a502c48af4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2cfe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2cfe7fc640 1 -- 172.21.15.81:0/734669570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d08040070 con 0x55db4d9964a0 2024-09-12T01:32:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2cfe7fc640 1 -- 172.21.15.81:0/734669570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2d08004240 con 0x55db4d9964a0 2024-09-12T01:32:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d1f911740 1 -- 172.21.15.81:0/734669570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d10023070 con 0x55db4d9964a0 2024-09-12T01:32:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2cfe7fc640 1 -- 172.21.15.81:0/734669570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2d08035040 con 0x55db4d9964a0 2024-09-12T01:32:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d1f911740 10 client.16563 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d1f911740 1 -- 172.21.15.81:0/734669570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55db4d9afb90 con 0x55db4d9964a0 2024-09-12T01:32:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2cfe7fc640 1 -- 172.21.15.81:0/734669570 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d10023070 con 0x55db4d9964a0 2024-09-12T01:32:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2cfe7fc640 1 -- 172.21.15.81:0/734669570 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2d080049c0 con 0x55db4d9964a0 2024-09-12T01:32:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d1f911740 10 client.16563 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d1f911740 10 client.16563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d1f911740 20 client.16563 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d1f911740 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55db4d9b1050 0x55db4d9b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.246+0000 7f2d1f911740 4 client.16563 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:32:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.247+0000 7f2d1f911740 1 -- 172.21.15.81:0/734669570 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db4d909850 con 0x55db4d9b1050 2024-09-12T01:32:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.247+0000 7f2d0e7fc640 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55db4d9b1050 0x55db4d9b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.247+0000 7f2cfe7fc640 10 client.16563 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.247+0000 7f2d0e7fc640 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55db4d9b1050 0x55db4d9b3460 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f17f1ad9597ed939 server_cookie=8e399ccd17e697b0 in_seq=0 out_seq=0 2024-09-12T01:32:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2cfe7fc640 1 -- 172.21.15.81:0/734669570 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db4d909850 con 0x55db4d9b1050 2024-09-12T01:32:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2cfe7fc640 10 client.16563 handle_command_reply: tid=0 2024-09-12T01:32:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2d1f911740 1 client.16563 shutdown 2024-09-12T01:32:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2d1f911740 1 -- 172.21.15.81:0/734669570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 msgr2=0x55db4d9a0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2d1f911740 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 0x55db4d9a0f90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009230 tx=0x7f2d08032f80 comp rx=0 tx=0).stop 2024-09-12T01:32:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2d1f911740 1 -- 172.21.15.81:0/734669570 shutdown_connections 2024-09-12T01:32:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2d1f911740 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55db4d9b1050 0x55db4d9b3460 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2d1f911740 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d9a1680 0x55db4d99e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2cfe7fc640 0 client.16563 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2d1f911740 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d996dc0 0x55db4d99e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2d1f911740 1 --2- 172.21.15.81:0/734669570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9964a0 0x55db4d9a0f90 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2d1f911740 1 -- 172.21.15.81:0/734669570 >> 172.21.15.81:0/734669570 conn(0x55db4d992a30 msgr2=0x55db4d998760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2d1f911740 1 -- 172.21.15.81:0/734669570 shutdown_connections 2024-09-12T01:32:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2d1f911740 1 -- 172.21.15.81:0/734669570 wait complete. 2024-09-12T01:32:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.248+0000 7f2d1f911740 20 client.16563 trim_cache size 0 max 16384 2024-09-12T01:32:51.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.265+0000 7f2d1f911740 1 Processor -- start 2024-09-12T01:32:51.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.265+0000 7f2d1f911740 1 -- start start 2024-09-12T01:32:51.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d1f911740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d9964a0 0x55db4d991980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d1f911740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d996dc0 0x55db4d991ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d1f911740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9a1680 0x55db4d9b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d1f911740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181ad820 con 0x55db4d9a1680 2024-09-12T01:32:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d1f911740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181af360 con 0x55db4d996dc0 2024-09-12T01:32:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d1f911740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181adef0 con 0x55db4d9964a0 2024-09-12T01:32:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9a1680 0x55db4d9b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9a1680 0x55db4d9b8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54954/0 (socket says 172.21.15.81:54954) 2024-09-12T01:32:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d177fe640 1 -- 172.21.15.81:0/839947856 learned_addr learned my addr 172.21.15.81:0/839947856 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d0e7fc640 1 --2- 172.21.15.81:0/839947856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d996dc0 0x55db4d991ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d16ffd640 1 --2- 172.21.15.81:0/839947856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d9964a0 0x55db4d991980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d177fe640 1 -- 172.21.15.81:0/839947856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d9964a0 msgr2=0x55db4d991980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d177fe640 1 --2- 172.21.15.81:0/839947856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d9964a0 0x55db4d991980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d177fe640 1 -- 172.21.15.81:0/839947856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d996dc0 msgr2=0x55db4d991ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d177fe640 1 --2- 172.21.15.81:0/839947856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d996dc0 0x55db4d991ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d177fe640 1 -- 172.21.15.81:0/839947856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db4d99c790 con 0x55db4d9a1680 2024-09-12T01:32:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d16ffd640 1 --2- 172.21.15.81:0/839947856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d9964a0 0x55db4d991980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d177fe640 1 --2- 172.21.15.81:0/839947856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9a1680 0x55db4d9b8d30 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2d10014930 tx=0x7f2d10005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bac2353760f2c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d0cff9640 1 -- 172.21.15.81:0/839947856 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1001ec50 con 0x55db4d9a1680 2024-09-12T01:32:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d0cff9640 1 -- 172.21.15.81:0/839947856 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d10023040 con 0x55db4d9a1680 2024-09-12T01:32:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.266+0000 7f2d0cff9640 1 -- 172.21.15.81:0/839947856 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d100052b0 con 0x55db4d9a1680 2024-09-12T01:32:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.267+0000 7f2d1f911740 1 -- 172.21.15.81:0/839947856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9a1680 msgr2=0x55db4d9b8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.267+0000 7f2d1f911740 1 --2- 172.21.15.81:0/839947856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9a1680 0x55db4d9b8d30 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2d10014930 tx=0x7f2d10005fd0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.267+0000 7f2d1f911740 1 -- 172.21.15.81:0/839947856 shutdown_connections 2024-09-12T01:32:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.267+0000 7f2d1f911740 1 --2- 172.21.15.81:0/839947856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9a1680 0x55db4d9b8d30 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.267+0000 7f2d1f911740 1 --2- 172.21.15.81:0/839947856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d996dc0 0x55db4d991ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.267+0000 7f2d1f911740 1 --2- 172.21.15.81:0/839947856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d9964a0 0x55db4d991980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.267+0000 7f2d1f911740 1 -- 172.21.15.81:0/839947856 >> 172.21.15.81:0/839947856 conn(0x55db4d992a30 msgr2=0x55db4d991270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.267+0000 7f2d1f911740 1 -- 172.21.15.81:0/839947856 shutdown_connections 2024-09-12T01:32:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.267+0000 7f2d1f911740 1 -- 172.21.15.81:0/839947856 wait complete. 2024-09-12T01:32:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d1f911740 1 -- start start 2024-09-12T01:32:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d1f911740 1 Processor -- start 2024-09-12T01:32:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d1f911740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d9964a0 0x55db4d9a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d1f911740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d996dc0 0x55db4d9a7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d1f911740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9a1680 0x55db4d9a75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d1f911740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181aec90 con 0x55db4d9a1680 2024-09-12T01:32:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d1f911740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181ae5c0 con 0x55db4d9964a0 2024-09-12T01:32:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d1f911740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181ab820 con 0x55db4d996dc0 2024-09-12T01:32:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d1f911740 10 client.0 _ll_register_callbacks cb 0x7f2d08009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:32:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d16ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d9964a0 0x55db4d9a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9a1680 0x55db4d9a75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d16ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d9964a0 0x55db4d9a9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:48290/0 (socket says 172.21.15.81:48290) 2024-09-12T01:32:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d16ffd640 1 -- 172.21.15.81:0/103613576 learned_addr learned my addr 172.21.15.81:0/103613576 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:32:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d0e7fc640 1 --2- 172.21.15.81:0/103613576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d996dc0 0x55db4d9a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d177fe640 1 -- 172.21.15.81:0/103613576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d996dc0 msgr2=0x55db4d9a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d177fe640 1 --2- 172.21.15.81:0/103613576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d996dc0 0x55db4d9a7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d177fe640 1 -- 172.21.15.81:0/103613576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d9964a0 msgr2=0x55db4d9a9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:32:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d177fe640 1 --2- 172.21.15.81:0/103613576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d9964a0 0x55db4d9a9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d177fe640 1 -- 172.21.15.81:0/103613576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db4d9a7d90 con 0x55db4d9a1680 2024-09-12T01:32:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d0e7fc640 1 --2- 172.21.15.81:0/103613576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d996dc0 0x55db4d9a7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:32:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2d177fe640 1 --2- 172.21.15.81:0/103613576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9a1680 0x55db4d9a75b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2d10000f80 tx=0x7f2d100146a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2968e0f6a3a677b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:32:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.268+0000 7f2cfe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:32:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2cfe7fc640 1 -- 172.21.15.81:0/103613576 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10005a60 con 0x55db4d9a1680 2024-09-12T01:32:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2cfe7fc640 1 -- 172.21.15.81:0/103613576 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2d1001ec50 con 0x55db4d9a1680 2024-09-12T01:32:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2d1f911740 1 -- 172.21.15.81:0/103613576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d10023040 con 0x55db4d9a1680 2024-09-12T01:32:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2cfe7fc640 1 -- 172.21.15.81:0/103613576 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2d10012c10 con 0x55db4d9a1680 2024-09-12T01:32:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2d1f911740 10 client.16569 fetch_fsmap learned FSMap version 28 2024-09-12T01:32:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2d1f911740 1 -- 172.21.15.81:0/103613576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55db4da1bc40 con 0x55db4d9a1680 2024-09-12T01:32:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2cfe7fc640 1 -- 172.21.15.81:0/103613576 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d10023040 con 0x55db4d9a1680 2024-09-12T01:32:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2cfe7fc640 1 -- 172.21.15.81:0/103613576 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2d1000f040 con 0x55db4d9a1680 2024-09-12T01:32:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2d1f911740 10 client.16569 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:32:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2d1f911740 10 client.16569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:32:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2d1f911740 20 client.16569 populate_metadata read hostname 'smithi081' 2024-09-12T01:32:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2d1f911740 1 --2- 172.21.15.81:0/103613576 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55db4da1c160 0x55db4da1e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:32:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2d1f911740 4 client.16569 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:32:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.269+0000 7f2d1f911740 1 -- 172.21.15.81:0/103613576 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55db4d99eb10 con 0x55db4da1c160 2024-09-12T01:32:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2d16ffd640 1 --2- 172.21.15.81:0/103613576 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55db4da1c160 0x55db4da1e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:32:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2d16ffd640 1 --2- 172.21.15.81:0/103613576 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55db4da1c160 0x55db4da1e550 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7604cf0113531a97 server_cookie=b8b4cec0ea135171 in_seq=0 out_seq=0 2024-09-12T01:32:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2cfe7fc640 10 client.16569 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2cfe7fc640 1 -- 172.21.15.81:0/103613576 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55db4d99eb10 con 0x55db4da1c160 2024-09-12T01:32:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2cfe7fc640 10 client.16569 handle_command_reply: tid=0 2024-09-12T01:32:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2d1f911740 1 client.16569 shutdown 2024-09-12T01:32:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2d1f911740 1 -- 172.21.15.81:0/103613576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9a1680 msgr2=0x55db4d9a75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2d1f911740 1 --2- 172.21.15.81:0/103613576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9a1680 0x55db4d9a75b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2d10000f80 tx=0x7f2d100146a0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2d1f911740 1 -- 172.21.15.81:0/103613576 shutdown_connections 2024-09-12T01:32:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2d1f911740 1 --2- 172.21.15.81:0/103613576 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55db4da1c160 0x55db4da1e550 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2d1f911740 1 --2- 172.21.15.81:0/103613576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4d9a1680 0x55db4d9a75b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2d1f911740 1 --2- 172.21.15.81:0/103613576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55db4d996dc0 0x55db4d9a7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2d1f911740 1 --2- 172.21.15.81:0/103613576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55db4d9964a0 0x55db4d9a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2cfe7fc640 0 client.16569 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:32:51.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2d1f911740 1 -- 172.21.15.81:0/103613576 >> 172.21.15.81:0/103613576 conn(0x55db4d992a30 msgr2=0x55db4d991a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:51.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2d1f911740 1 -- 172.21.15.81:0/103613576 shutdown_connections 2024-09-12T01:32:51.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.270+0000 7f2d1f911740 1 -- 172.21.15.81:0/103613576 wait complete. 2024-09-12T01:32:51.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.271+0000 7f2d1f911740 20 client.16569 trim_cache size 0 max 16384 2024-09-12T01:32:51.277 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:32:51.277 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:32:51.277 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-12T01:32:51.277 INFO:teuthology.orchestra.run.smithi081.stdout: "a31b379d-fcf7-40e1-8fd4-29463c29800e": { 2024-09-12T01:32:51.277 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-09-12T01:32:51.278 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "a31b379d-fcf7-40e1-8fd4-29463c29800e", 2024-09-12T01:32:51.278 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-12T01:32:51.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:32:51.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:32:51.278 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:32:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.271+0000 7f2d1d538640 1 -- 172.21.15.81:0/1259570393 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2d040a2cf0 msgr2=0x7f2d040a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.271+0000 7f2d1d538640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2d040a2cf0 0x7f2d040a51b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2d10022000 tx=0x7f2d1001e000 comp rx=0 tx=0).stop 2024-09-12T01:32:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.271+0000 7f2d1d538640 1 -- 172.21.15.81:0/1259570393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d181037a0 msgr2=0x7f2d18198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:32:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.271+0000 7f2d1d538640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d181037a0 0x7f2d18198bd0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000d750 tx=0x7f2d0000dc10 comp rx=0 tx=0).stop 2024-09-12T01:32:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.271+0000 7f2d1d538640 1 -- 172.21.15.81:0/1259570393 shutdown_connections 2024-09-12T01:32:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.271+0000 7f2d1d538640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2d040a2cf0 0x7f2d040a51b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.271+0000 7f2d1d538640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d1810c2f0 0x7f2d1819cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.271+0000 7f2d1d538640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d181037a0 0x7f2d18198bd0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.271+0000 7f2d1d538640 1 --2- 172.21.15.81:0/1259570393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d18102df0 0x7f2d18198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:32:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.271+0000 7f2d1d538640 1 -- 172.21.15.81:0/1259570393 >> 172.21.15.81:0/1259570393 conn(0x7f2d180fc7d0 msgr2=0x7f2d180fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:32:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.271+0000 7f2d1d538640 1 -- 172.21.15.81:0/1259570393 shutdown_connections 2024-09-12T01:32:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:32:51.271+0000 7f2d1d538640 1 -- 172.21.15.81:0/1259570393 wait complete. 2024-09-12T01:32:51.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:51 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:32:51.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:51 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:32:51.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:51 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:32:51.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:51 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:32:51.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:51 smithi081 ceph-mon[30920]: pgmap v146: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:32:51.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:51 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:32:51.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:51 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:32:51.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:51 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:32:51.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:51 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:32:51.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:51 smithi100 ceph-mon[35275]: pgmap v146: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:32:51.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:51 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:32:51.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:51 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:32:51.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:51 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:32:51.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:51 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:32:51.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:51 smithi189 ceph-mon[35357]: pgmap v146: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:32:52.063 INFO:tasks.cephfs.filesystem:scrub status for tag:a31b379d-fcf7-40e1-8fd4-29463c29800e - {'path': '/', 'tag': 'a31b379d-fcf7-40e1-8fd4-29463c29800e', 'options': 'recursive,force'} 2024-09-12T01:32:53.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:53 smithi081 ceph-mon[30920]: pgmap v147: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:32:53.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:53 smithi100 ceph-mon[35275]: pgmap v147: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:32:53.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:53 smithi189 ceph-mon[35357]: pgmap v147: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:32:55.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:55 smithi081 ceph-mon[30920]: pgmap v148: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:32:55.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:55 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:32:55.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:55 smithi100 ceph-mon[35275]: pgmap v148: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:32:55.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:55 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:32:55.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:55 smithi189 ceph-mon[35357]: pgmap v148: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:32:55.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:55 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:32:57.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:57 smithi081 ceph-mon[30920]: pgmap v149: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:32:57.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:57 smithi100 ceph-mon[35275]: pgmap v149: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:32:57.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:57 smithi189 ceph-mon[35357]: pgmap v149: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:32:59.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:32:59 smithi081 ceph-mon[30920]: pgmap v150: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:32:59.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:32:59 smithi100 ceph-mon[35275]: pgmap v150: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:32:59.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:32:59 smithi189 ceph-mon[35357]: pgmap v150: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:01.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:01 smithi081 ceph-mon[30920]: pgmap v151: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:01.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:01 smithi100 ceph-mon[35275]: pgmap v151: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:01.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:01 smithi189 ceph-mon[35357]: pgmap v151: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:03.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:03 smithi081 ceph-mon[30920]: pgmap v152: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:03.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:03 smithi100 ceph-mon[35275]: pgmap v152: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:03.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:03 smithi189 ceph-mon[35357]: pgmap v152: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:05.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:05 smithi081 ceph-mon[30920]: pgmap v153: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:05.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:05 smithi100 ceph-mon[35275]: pgmap v153: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:05.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:05 smithi189 ceph-mon[35357]: pgmap v153: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:07.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:07 smithi081 ceph-mon[30920]: pgmap v154: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:33:07.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:07 smithi100 ceph-mon[35275]: pgmap v154: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:33:07.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:07 smithi189 ceph-mon[35357]: pgmap v154: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:33:09.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:09 smithi081 ceph-mon[30920]: pgmap v155: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:33:09.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:09 smithi100 ceph-mon[35275]: pgmap v155: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:33:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:09 smithi189 ceph-mon[35357]: pgmap v155: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:33:11.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:11 smithi081 ceph-mon[30920]: pgmap v156: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:33:11.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:11 smithi100 ceph-mon[35275]: pgmap v156: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:33:11.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:11 smithi189 ceph-mon[35357]: pgmap v156: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:33:13.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:13 smithi081 ceph-mon[30920]: pgmap v157: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:33:13.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:13 smithi100 ceph-mon[35275]: pgmap v157: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:33:13.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:13 smithi189 ceph-mon[35357]: pgmap v157: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:33:15.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:15 smithi081 ceph-mon[30920]: pgmap v158: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:33:15.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:15 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:33:15.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:15 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:33:15.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:15 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:33:15.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:15 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:33:15.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:15 smithi100 ceph-mon[35275]: pgmap v158: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:33:15.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:15 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:33:15.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:15 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:33:15.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:15 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:33:15.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:15 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:33:15.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:15 smithi189 ceph-mon[35357]: pgmap v158: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:33:15.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:15 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:33:15.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:15 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:33:15.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:15 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:33:15.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:15 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:33:17.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:17 smithi081 ceph-mon[30920]: pgmap v159: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:33:17.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:17 smithi100 ceph-mon[35275]: pgmap v159: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:33:17.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:17 smithi189 ceph-mon[35357]: pgmap v159: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:33:19.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:19 smithi081 ceph-mon[30920]: pgmap v160: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T01:33:19.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:19 smithi100 ceph-mon[35275]: pgmap v160: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T01:33:19.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:19 smithi189 ceph-mon[35357]: pgmap v160: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T01:33:21.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:21 smithi081 ceph-mon[30920]: pgmap v161: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T01:33:21.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:21 smithi100 ceph-mon[35275]: pgmap v161: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T01:33:21.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:21 smithi189 ceph-mon[35357]: pgmap v161: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T01:33:22.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:33:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:22.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.807+0000 7f2345202640 1 -- 172.21.15.81:0/3322430889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340100a80 msgr2=0x7f2340100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:22.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.807+0000 7f2345202640 1 --2- 172.21.15.81:0/3322430889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340100a80 0x7f2340100ee0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2334009930 tx=0x7f233402a420 comp rx=0 tx=0).stop 2024-09-12T01:33:22.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.807+0000 7f2345202640 1 -- 172.21.15.81:0/3322430889 shutdown_connections 2024-09-12T01:33:22.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.807+0000 7f2345202640 1 --2- 172.21.15.81:0/3322430889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340101420 0x7f234010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.807+0000 7f2345202640 1 --2- 172.21.15.81:0/3322430889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340100a80 0x7f2340100ee0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.807+0000 7f2345202640 1 --2- 172.21.15.81:0/3322430889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2340106a80 0x7f2340106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.807+0000 7f2345202640 1 -- 172.21.15.81:0/3322430889 >> 172.21.15.81:0/3322430889 conn(0x7f23400fc7a0 msgr2=0x7f23400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.807+0000 7f2345202640 1 -- 172.21.15.81:0/3322430889 shutdown_connections 2024-09-12T01:33:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.807+0000 7f2345202640 1 -- 172.21.15.81:0/3322430889 wait complete. 2024-09-12T01:33:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.808+0000 7f2345202640 1 Processor -- start 2024-09-12T01:33:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.808+0000 7f2345202640 1 -- start start 2024-09-12T01:33:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f2345202640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2340100a80 0x7f2340198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f2345202640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340101420 0x7f2340198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f2345202640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340106a80 0x7f234019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f2345202640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2340111fa0 con 0x7f2340101420 2024-09-12T01:33:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f2345202640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2340111e20 con 0x7f2340106a80 2024-09-12T01:33:22.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f2345202640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2340112120 con 0x7f2340100a80 2024-09-12T01:33:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f233e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340101420 0x7f2340198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f233e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340101420 0x7f2340198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50774/0 (socket says 172.21.15.81:50774) 2024-09-12T01:33:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f233e59c640 1 -- 172.21.15.81:0/1808965138 learned_addr learned my addr 172.21.15.81:0/1808965138 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f233f59e640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340106a80 0x7f234019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f233ed9d640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2340100a80 0x7f2340198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f233e59c640 1 -- 172.21.15.81:0/1808965138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2340100a80 msgr2=0x7f2340198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f233e59c640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2340100a80 0x7f2340198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f233e59c640 1 -- 172.21.15.81:0/1808965138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340106a80 msgr2=0x7f234019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f233e59c640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340106a80 0x7f234019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f233e59c640 1 -- 172.21.15.81:0/1808965138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234019d3e0 con 0x7f2340101420 2024-09-12T01:33:22.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.809+0000 7f233e59c640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340101420 0x7f2340198970 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2334009230 tx=0x7f2334004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.810+0000 7f2327fff640 1 -- 172.21.15.81:0/1808965138 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233403f030 con 0x7f2340101420 2024-09-12T01:33:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.810+0000 7f2345202640 1 -- 172.21.15.81:0/1808965138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234019d670 con 0x7f2340101420 2024-09-12T01:33:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.810+0000 7f2327fff640 1 -- 172.21.15.81:0/1808965138 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2334003ad0 con 0x7f2340101420 2024-09-12T01:33:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.810+0000 7f2327fff640 1 -- 172.21.15.81:0/1808965138 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334035070 con 0x7f2340101420 2024-09-12T01:33:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.810+0000 7f2345202640 1 -- 172.21.15.81:0/1808965138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23401a4fb0 con 0x7f2340101420 2024-09-12T01:33:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.812+0000 7f2327fff640 1 -- 172.21.15.81:0/1808965138 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f2334042030 con 0x7f2340101420 2024-09-12T01:33:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.812+0000 7f23475db740 1 Processor -- start 2024-09-12T01:33:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.812+0000 7f23475db740 1 -- start start 2024-09-12T01:33:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.812+0000 7f23475db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdd7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.812+0000 7f2327fff640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f23280a2cf0 0x7f23280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.812+0000 7f23475db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfde2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.812+0000 7f23475db740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfde2680 0x55ebdfde4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.812+0000 7f23475db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebdfd3d2e0 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.812+0000 7f23475db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ebdfce4ce0 con 0x55ebdfdd74a0 2024-09-12T01:33:22.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.812+0000 7f23475db740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ebdfd392a0 con 0x55ebdfde2680 2024-09-12T01:33:22.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f233ed9d640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f23280a2cf0 0x7f23280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f233e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfde2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f233e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfde2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50788/0 (socket says 172.21.15.81:50788) 2024-09-12T01:33:22.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f233e59c640 1 -- 172.21.15.81:0/3402557333 learned_addr learned my addr 172.21.15.81:0/3402557333 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:22.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f233f59e640 1 --2- 172.21.15.81:0/3402557333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdd7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f2327fff640 1 -- 172.21.15.81:0/1808965138 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f23340ef910 con 0x7f2340101420 2024-09-12T01:33:22.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f233f59e640 1 --2- 172.21.15.81:0/3402557333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfde2680 0x55ebdfde4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f233e59c640 1 -- 172.21.15.81:0/3402557333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfde2680 msgr2=0x55ebdfde4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:22.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f233e59c640 1 --2- 172.21.15.81:0/3402557333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfde2680 0x55ebdfde4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f233e59c640 1 -- 172.21.15.81:0/3402557333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfdd74a0 msgr2=0x55ebdfdd7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:22.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f233e59c640 1 --2- 172.21.15.81:0/3402557333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdd7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f233e59c640 1 -- 172.21.15.81:0/3402557333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebdfcc9440 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f233ed9d640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f23280a2cf0 0x7f23280a51b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2330005fd0 tx=0x7f233000b510 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:22.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f233e59c640 1 --2- 172.21.15.81:0/3402557333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfde2140 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f23340da9f0 tx=0x7f23340045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae69a541fa1d4b2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:22.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f23257fa640 1 -- 172.21.15.81:0/3402557333 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23340d5060 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f23257fa640 1 -- 172.21.15.81:0/3402557333 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23340bc560 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.813+0000 7f23257fa640 1 -- 172.21.15.81:0/3402557333 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334048170 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.814+0000 7f23475db740 1 -- 172.21.15.81:0/3402557333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 msgr2=0x55ebdfde2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:22.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.814+0000 7f23475db740 1 --2- 172.21.15.81:0/3402557333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfde2140 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f23340da9f0 tx=0x7f23340045f0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.814+0000 7f23475db740 1 -- 172.21.15.81:0/3402557333 shutdown_connections 2024-09-12T01:33:22.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.814+0000 7f23475db740 1 --2- 172.21.15.81:0/3402557333 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfde2680 0x55ebdfde4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.814+0000 7f23475db740 1 --2- 172.21.15.81:0/3402557333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfde2140 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.814+0000 7f23475db740 1 --2- 172.21.15.81:0/3402557333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdd7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.814+0000 7f23475db740 1 -- 172.21.15.81:0/3402557333 >> 172.21.15.81:0/3402557333 conn(0x55ebdfdd3a30 msgr2=0x55ebdfdd3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:22.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.814+0000 7f23475db740 1 -- 172.21.15.81:0/3402557333 shutdown_connections 2024-09-12T01:33:22.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.814+0000 7f23475db740 1 -- 172.21.15.81:0/3402557333 wait complete. 2024-09-12T01:33:22.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.814+0000 7f23475db740 1 -- start start 2024-09-12T01:33:22.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f23475db740 1 Processor -- start 2024-09-12T01:33:22.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f23475db740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd74a0 0x55ebdfde1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f23475db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfddf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f23475db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfde2680 0x55ebdfddf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f23475db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebdfde5010 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f23475db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ebdfcf8050 con 0x55ebdfde2680 2024-09-12T01:33:22.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f23475db740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ebdfde5190 con 0x55ebdfdd74a0 2024-09-12T01:33:22.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f23475db740 10 client.0 _ll_register_callbacks cb 0x55ebdfd38160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:22.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f233e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfddf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.848 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:33:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:33:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:33:22.848 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:33:22.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f233e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfddf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50796/0 (socket says 172.21.15.81:50796) 2024-09-12T01:33:22.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f233e59c640 1 -- 172.21.15.81:0/1715523357 learned_addr learned my addr 172.21.15.81:0/1715523357 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:22.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f233ed9d640 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd74a0 0x55ebdfde1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f233f59e640 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfde2680 0x55ebdfddf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f233e59c640 1 -- 172.21.15.81:0/1715523357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd74a0 msgr2=0x55ebdfde1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:22.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f233e59c640 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd74a0 0x55ebdfde1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f233e59c640 1 -- 172.21.15.81:0/1715523357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfde2680 msgr2=0x55ebdfddf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:22.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f233e59c640 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfde2680 0x55ebdfddf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f233e59c640 1 -- 172.21.15.81:0/1715523357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebdfaae3c0 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f233ed9d640 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd74a0 0x55ebdfde1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:22.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f233e59c640 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfddf250 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f23340bbdf0 tx=0x7f2334005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71b2de0b658e396 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:22.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.815+0000 7f2322ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:22.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f2322ff5640 1 -- 172.21.15.81:0/1715523357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23340bbe60 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f2322ff5640 1 -- 172.21.15.81:0/1715523357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f23340ed310 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f23475db740 1 -- 172.21.15.81:0/1715523357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23340bc560 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f2322ff5640 1 -- 172.21.15.81:0/1715523357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f23340c0210 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f23475db740 10 client.16581 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f23475db740 1 -- 172.21.15.81:0/1715523357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ebdfde5010 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f2322ff5640 1 -- 172.21.15.81:0/1715523357 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23340bc560 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f2322ff5640 1 -- 172.21.15.81:0/1715523357 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f23340bc150 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f23475db740 10 client.16581 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f23475db740 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f23475db740 20 client.16581 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f23475db740 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ebdfdf1be0 0x55ebdfdf3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f23475db740 4 client.16581 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:22.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f23475db740 1 -- 172.21.15.81:0/1715523357 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebdfd4a850 con 0x55ebdfdf1be0 2024-09-12T01:33:22.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.816+0000 7f233ed9d640 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ebdfdf1be0 0x55ebdfdf3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.817+0000 7f233ed9d640 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ebdfdf1be0 0x55ebdfdf3fd0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44898095ac8cf89d server_cookie=869347f944698e8f in_seq=0 out_seq=0 2024-09-12T01:33:22.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.817+0000 7f2322ff5640 10 client.16581 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:22.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.817+0000 7f2322ff5640 1 -- 172.21.15.81:0/1715523357 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ebdfd4a850 con 0x55ebdfdf1be0 2024-09-12T01:33:22.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.817+0000 7f2322ff5640 10 client.16581 handle_command_reply: tid=0 2024-09-12T01:33:22.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.817+0000 7f23475db740 1 client.16581 shutdown 2024-09-12T01:33:22.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.818+0000 7f23475db740 1 -- 172.21.15.81:0/1715523357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 msgr2=0x55ebdfddf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:22.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.818+0000 7f23475db740 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfddf250 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f23340bbdf0 tx=0x7f2334005e50 comp rx=0 tx=0).stop 2024-09-12T01:33:22.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.818+0000 7f23475db740 1 -- 172.21.15.81:0/1715523357 shutdown_connections 2024-09-12T01:33:22.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.818+0000 7f23475db740 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ebdfdf1be0 0x55ebdfdf3fd0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.818+0000 7f23475db740 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfde2680 0x55ebdfddf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.818+0000 7f2322ff5640 0 client.16581 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:22.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.818+0000 7f23475db740 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfddf250 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.818+0000 7f23475db740 1 --2- 172.21.15.81:0/1715523357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd74a0 0x55ebdfde1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.818+0000 7f23475db740 1 -- 172.21.15.81:0/1715523357 >> 172.21.15.81:0/1715523357 conn(0x55ebdfdd3a30 msgr2=0x55ebdfdd2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.818+0000 7f23475db740 1 -- 172.21.15.81:0/1715523357 shutdown_connections 2024-09-12T01:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.818+0000 7f23475db740 1 -- 172.21.15.81:0/1715523357 wait complete. 2024-09-12T01:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.818+0000 7f23475db740 20 client.16581 trim_cache size 0 max 16384 2024-09-12T01:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f23475db740 1 Processor -- start 2024-09-12T01:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f23475db740 1 -- start start 2024-09-12T01:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f23475db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdee1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f23475db740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfdf9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f23475db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfde2680 0x55ebdfdf9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f23475db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23401ad750 con 0x55ebdfde2680 2024-09-12T01:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f23475db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23401af290 con 0x55ebdfdd74a0 2024-09-12T01:33:22.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f23475db740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f23401ade20 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f233f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfde2680 0x55ebdfdf9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f233f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfde2680 0x55ebdfdf9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50800/0 (socket says 172.21.15.81:50800) 2024-09-12T01:33:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f233f59e640 1 -- 172.21.15.81:0/1360284817 learned_addr learned my addr 172.21.15.81:0/1360284817 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f233ed9d640 1 --2- 172.21.15.81:0/1360284817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdee1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f233e59c640 1 --2- 172.21.15.81:0/1360284817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfdf9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f233f59e640 1 -- 172.21.15.81:0/1360284817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd7dc0 msgr2=0x55ebdfdf9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f233f59e640 1 --2- 172.21.15.81:0/1360284817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfdf9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f233f59e640 1 -- 172.21.15.81:0/1360284817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfdd74a0 msgr2=0x55ebdfdee1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f233f59e640 1 --2- 172.21.15.81:0/1360284817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdee1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f233f59e640 1 -- 172.21.15.81:0/1360284817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebdfdd8330 con 0x55ebdfde2680 2024-09-12T01:33:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.835+0000 7f233f59e640 1 --2- 172.21.15.81:0/1360284817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfde2680 0x55ebdfdf9d90 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f23380126c0 tx=0x7f2338007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0d4f4c6970d8f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.836+0000 7f2324ff9640 1 -- 172.21.15.81:0/1360284817 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338019070 con 0x55ebdfde2680 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.836+0000 7f2324ff9640 1 -- 172.21.15.81:0/1360284817 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2338011cd0 con 0x55ebdfde2680 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.836+0000 7f2324ff9640 1 -- 172.21.15.81:0/1360284817 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233800f7c0 con 0x55ebdfde2680 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.836+0000 7f23475db740 1 -- 172.21.15.81:0/1360284817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfde2680 msgr2=0x55ebdfdf9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.836+0000 7f23475db740 1 --2- 172.21.15.81:0/1360284817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfde2680 0x55ebdfdf9d90 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f23380126c0 tx=0x7f2338007aa0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.836+0000 7f23475db740 1 -- 172.21.15.81:0/1360284817 shutdown_connections 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.836+0000 7f23475db740 1 --2- 172.21.15.81:0/1360284817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfde2680 0x55ebdfdf9d90 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.836+0000 7f23475db740 1 --2- 172.21.15.81:0/1360284817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfdf9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.836+0000 7f23475db740 1 --2- 172.21.15.81:0/1360284817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdee1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.836+0000 7f23475db740 1 -- 172.21.15.81:0/1360284817 >> 172.21.15.81:0/1360284817 conn(0x55ebdfdd3a30 msgr2=0x55ebdfdde210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.836+0000 7f23475db740 1 -- 172.21.15.81:0/1360284817 shutdown_connections 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.836+0000 7f23475db740 1 -- 172.21.15.81:0/1360284817 wait complete. 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.836+0000 7f23475db740 1 -- start start 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f23475db740 1 Processor -- start 2024-09-12T01:33:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f23475db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdea920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f23475db740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfde7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f23475db740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfde2680 0x55ebdfde81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f23475db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23401aebc0 con 0x55ebdfdd74a0 2024-09-12T01:33:22.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f23475db740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23401ae4f0 con 0x55ebdfde2680 2024-09-12T01:33:22.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f23475db740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f23401ab730 con 0x55ebdfdd7dc0 2024-09-12T01:33:22.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f23475db740 10 client.0 _ll_register_callbacks cb 0x7f23380079b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:22.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f233ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdea920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f233ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdea920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50810/0 (socket says 172.21.15.81:50810) 2024-09-12T01:33:22.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f233ed9d640 1 -- 172.21.15.81:0/3410347576 learned_addr learned my addr 172.21.15.81:0/3410347576 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:22.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f233e59c640 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfde7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f233ed9d640 1 -- 172.21.15.81:0/3410347576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd7dc0 msgr2=0x55ebdfde7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:22.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f233f59e640 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfde2680 0x55ebdfde81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f233ed9d640 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfde7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f233ed9d640 1 -- 172.21.15.81:0/3410347576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfde2680 msgr2=0x55ebdfde81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:22.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f233ed9d640 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfde2680 0x55ebdfde81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f233ed9d640 1 -- 172.21.15.81:0/3410347576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebdfde8850 con 0x55ebdfdd74a0 2024-09-12T01:33:22.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f233e59c640 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfde7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:22.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f233ed9d640 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdea920 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f233000fc10 tx=0x7f2330004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477c39123b1e0520 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:22.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f2322ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:22.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.837+0000 7f2322ff5640 1 -- 172.21.15.81:0/3410347576 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233001f840 con 0x55ebdfdd74a0 2024-09-12T01:33:22.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f2322ff5640 1 -- 172.21.15.81:0/3410347576 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f233001f9e0 con 0x55ebdfdd74a0 2024-09-12T01:33:22.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f23475db740 1 -- 172.21.15.81:0/3410347576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2338011cd0 con 0x55ebdfdd74a0 2024-09-12T01:33:22.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f2322ff5640 1 -- 172.21.15.81:0/3410347576 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f233001fbe0 con 0x55ebdfdd74a0 2024-09-12T01:33:22.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f23475db740 10 client.16587 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:22.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f23475db740 1 -- 172.21.15.81:0/3410347576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ebdfe5c710 con 0x55ebdfdd74a0 2024-09-12T01:33:22.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f2322ff5640 1 -- 172.21.15.81:0/3410347576 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2338011cd0 con 0x55ebdfdd74a0 2024-09-12T01:33:22.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f2322ff5640 1 -- 172.21.15.81:0/3410347576 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f233002e410 con 0x55ebdfdd74a0 2024-09-12T01:33:22.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f23475db740 10 client.16587 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:22.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f23475db740 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:22.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f23475db740 20 client.16587 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:22.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f23475db740 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ebdfdf1be0 0x55ebdfe5ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:22.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f23475db740 4 client.16587 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:33:22.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f23475db740 1 -- 172.21.15.81:0/3410347576 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ebdfd44d60 con 0x55ebdfdf1be0 2024-09-12T01:33:22.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.838+0000 7f233e59c640 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ebdfdf1be0 0x55ebdfe5ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:22.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f2322ff5640 10 client.16587 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:22.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f233e59c640 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ebdfdf1be0 0x55ebdfe5ee50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66ea7350b8c93894 server_cookie=5264bd4eddff80f3 in_seq=0 out_seq=0 2024-09-12T01:33:22.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f2322ff5640 1 -- 172.21.15.81:0/3410347576 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ebdfd44d60 con 0x55ebdfdf1be0 2024-09-12T01:33:22.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f2322ff5640 10 client.16587 handle_command_reply: tid=0 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f23475db740 1 client.16587 shutdown 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f23475db740 1 -- 172.21.15.81:0/3410347576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd74a0 msgr2=0x55ebdfdea920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f23475db740 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdea920 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f233000fc10 tx=0x7f2330004730 comp rx=0 tx=0).stop 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f23475db740 1 -- 172.21.15.81:0/3410347576 shutdown_connections 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f23475db740 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ebdfdf1be0 0x55ebdfe5ee50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f23475db740 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ebdfde2680 0x55ebdfde81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f23475db740 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ebdfdd7dc0 0x55ebdfde7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f23475db740 1 --2- 172.21.15.81:0/3410347576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebdfdd74a0 0x55ebdfdea920 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f23475db740 1 -- 172.21.15.81:0/3410347576 >> 172.21.15.81:0/3410347576 conn(0x55ebdfdd3a30 msgr2=0x55ebdfddd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f2322ff5640 0 client.16587 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f23475db740 1 -- 172.21.15.81:0/3410347576 shutdown_connections 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.839+0000 7f23475db740 1 -- 172.21.15.81:0/3410347576 wait complete. 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.840+0000 7f23475db740 20 client.16587 trim_cache size 0 max 16384 2024-09-12T01:33:22.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.840+0000 7f2345202640 1 -- 172.21.15.81:0/1808965138 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f23280a2cf0 msgr2=0x7f23280a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:22.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.840+0000 7f2345202640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f23280a2cf0 0x7f23280a51b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2330005fd0 tx=0x7f233000b510 comp rx=0 tx=0).stop 2024-09-12T01:33:22.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.840+0000 7f2345202640 1 -- 172.21.15.81:0/1808965138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340101420 msgr2=0x7f2340198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:22.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.840+0000 7f2345202640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340101420 0x7f2340198970 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2334009230 tx=0x7f2334004270 comp rx=0 tx=0).stop 2024-09-12T01:33:22.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.840+0000 7f2345202640 1 -- 172.21.15.81:0/1808965138 shutdown_connections 2024-09-12T01:33:22.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.840+0000 7f2345202640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f23280a2cf0 0x7f23280a51b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.840+0000 7f2345202640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2340106a80 0x7f234019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.840+0000 7f2345202640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340101420 0x7f2340198970 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.840+0000 7f2345202640 1 --2- 172.21.15.81:0/1808965138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2340100a80 0x7f2340198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:22.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.840+0000 7f2345202640 1 -- 172.21.15.81:0/1808965138 >> 172.21.15.81:0/1808965138 conn(0x7f23400fc7a0 msgr2=0x7f23400fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:22.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.840+0000 7f2345202640 1 -- 172.21.15.81:0/1808965138 shutdown_connections 2024-09-12T01:33:22.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:22.840+0000 7f2345202640 1 -- 172.21.15.81:0/1808965138 wait complete. 2024-09-12T01:33:23.465 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:23 smithi081 ceph-mon[30920]: pgmap v162: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:23.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:23 smithi100 ceph-mon[35275]: pgmap v162: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:23.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:23 smithi189 ceph-mon[35357]: pgmap v162: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:23.571 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:33:23.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:33:23.819 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:24.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.253+0000 7f5670d83640 1 -- 172.21.15.81:0/2221956048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c102570 msgr2=0x7f566c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:24.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.253+0000 7f5670d83640 1 --2- 172.21.15.81:0/2221956048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c102570 0x7f566c1029b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5654009900 tx=0x7f565402a480 comp rx=0 tx=0).stop 2024-09-12T01:33:24.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.253+0000 7f5670d83640 1 -- 172.21.15.81:0/2221956048 shutdown_connections 2024-09-12T01:33:24.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.253+0000 7f5670d83640 1 --2- 172.21.15.81:0/2221956048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f566c102ef0 0x7f566c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:24.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.253+0000 7f5670d83640 1 --2- 172.21.15.81:0/2221956048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c102570 0x7f566c1029b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:24.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.253+0000 7f5670d83640 1 --2- 172.21.15.81:0/2221956048 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f566c100e20 0x7f566c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:24.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.253+0000 7f5670d83640 1 -- 172.21.15.81:0/2221956048 >> 172.21.15.81:0/2221956048 conn(0x7f566c0fc7d0 msgr2=0x7f566c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:24.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.254+0000 7f5670d83640 1 -- 172.21.15.81:0/2221956048 shutdown_connections 2024-09-12T01:33:24.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.254+0000 7f5670d83640 1 -- 172.21.15.81:0/2221956048 wait complete. 2024-09-12T01:33:24.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.254+0000 7f5670d83640 1 Processor -- start 2024-09-12T01:33:24.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.254+0000 7f5670d83640 1 -- start start 2024-09-12T01:33:24.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f5670d83640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f566c100e20 0x7f566c197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:24.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f5670d83640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f566c102570 0x7f566c197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:24.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f5670d83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c102ef0 0x7f566c19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:24.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f5670d83640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f566c111020 con 0x7f566c102ef0 2024-09-12T01:33:24.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f5670d83640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f566c110ea0 con 0x7f566c102570 2024-09-12T01:33:24.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f5670d83640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f566c1111a0 con 0x7f566c100e20 2024-09-12T01:33:24.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f5669d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f566c102570 0x7f566c197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f566ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c102ef0 0x7f566c19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f5669d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f566c102570 0x7f566c197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:51470/0 (socket says 172.21.15.81:51470) 2024-09-12T01:33:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f5669d9b640 1 -- 172.21.15.81:0/516650586 learned_addr learned my addr 172.21.15.81:0/516650586 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f566a59c640 1 --2- 172.21.15.81:0/516650586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f566c100e20 0x7f566c197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f566ad9d640 1 -- 172.21.15.81:0/516650586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f566c100e20 msgr2=0x7f566c197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f566ad9d640 1 --2- 172.21.15.81:0/516650586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f566c100e20 0x7f566c197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f566ad9d640 1 -- 172.21.15.81:0/516650586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f566c102570 msgr2=0x7f566c197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f566ad9d640 1 --2- 172.21.15.81:0/516650586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f566c102570 0x7f566c197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f566ad9d640 1 -- 172.21.15.81:0/516650586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566c19c4f0 con 0x7f566c102ef0 2024-09-12T01:33:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.255+0000 7f566ad9d640 1 --2- 172.21.15.81:0/516650586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c102ef0 0x7f566c19be10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f566400be20 tx=0x7f566400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.256+0000 7f56637fe640 1 -- 172.21.15.81:0/516650586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5664019070 con 0x7f566c102ef0 2024-09-12T01:33:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.256+0000 7f56637fe640 1 -- 172.21.15.81:0/516650586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5664014920 con 0x7f566c102ef0 2024-09-12T01:33:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.256+0000 7f5670d83640 1 -- 172.21.15.81:0/516650586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566c19c7e0 con 0x7f566c102ef0 2024-09-12T01:33:24.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.256+0000 7f56637fe640 1 -- 172.21.15.81:0/516650586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5664012920 con 0x7f566c102ef0 2024-09-12T01:33:24.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.256+0000 7f5670d83640 1 -- 172.21.15.81:0/516650586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f566c1a40c0 con 0x7f566c102ef0 2024-09-12T01:33:24.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.257+0000 7f5670d83640 1 -- 172.21.15.81:0/516650586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f566c101280 con 0x7f566c102ef0 2024-09-12T01:33:24.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.258+0000 7f56637fe640 1 -- 172.21.15.81:0/516650586 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f566401c070 con 0x7f566c102ef0 2024-09-12T01:33:24.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.258+0000 7f56637fe640 1 --2- 172.21.15.81:0/516650586 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f56580a2cf0 0x7f56580a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:24.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.259+0000 7f566a59c640 1 --2- 172.21.15.81:0/516650586 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f56580a2cf0 0x7f56580a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:24.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.259+0000 7f56637fe640 1 -- 172.21.15.81:0/516650586 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f56640ceb70 con 0x7f566c102ef0 2024-09-12T01:33:24.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.259+0000 7f566a59c640 1 --2- 172.21.15.81:0/516650586 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f56580a2cf0 0x7f56580a51b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f565c009890 tx=0x7f565c008040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:24.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.263+0000 7f56637fe640 1 -- 172.21.15.81:0/516650586 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f566409b280 con 0x7f566c102ef0 2024-09-12T01:33:24.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.463+0000 7f5670d83640 1 -- 172.21.15.81:0/516650586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f566c109090 con 0x7f566c102ef0 2024-09-12T01:33:24.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.464+0000 7f56637fe640 1 -- 172.21.15.81:0/516650586 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f566409f580 con 0x7f566c102ef0 2024-09-12T01:33:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:33:24.464 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:33:24.464 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:33:24.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.466+0000 7f5670d83640 1 -- 172.21.15.81:0/516650586 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f56580a2cf0 msgr2=0x7f56580a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:24.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.466+0000 7f5670d83640 1 --2- 172.21.15.81:0/516650586 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f56580a2cf0 0x7f56580a51b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f565c009890 tx=0x7f565c008040 comp rx=0 tx=0).stop 2024-09-12T01:33:24.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.466+0000 7f5670d83640 1 -- 172.21.15.81:0/516650586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c102ef0 msgr2=0x7f566c19be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:24.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.466+0000 7f5670d83640 1 --2- 172.21.15.81:0/516650586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c102ef0 0x7f566c19be10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f566400be20 tx=0x7f566400bf10 comp rx=0 tx=0).stop 2024-09-12T01:33:24.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.466+0000 7f5670d83640 1 -- 172.21.15.81:0/516650586 shutdown_connections 2024-09-12T01:33:24.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.466+0000 7f5670d83640 1 --2- 172.21.15.81:0/516650586 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f56580a2cf0 0x7f56580a51b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:24.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.466+0000 7f5670d83640 1 --2- 172.21.15.81:0/516650586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c102ef0 0x7f566c19be10 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:24.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.466+0000 7f5670d83640 1 --2- 172.21.15.81:0/516650586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f566c102570 0x7f566c197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:24.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.466+0000 7f5670d83640 1 --2- 172.21.15.81:0/516650586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f566c100e20 0x7f566c197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:24.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.466+0000 7f5670d83640 1 -- 172.21.15.81:0/516650586 >> 172.21.15.81:0/516650586 conn(0x7f566c0fc7d0 msgr2=0x7f566c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:24.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.466+0000 7f5670d83640 1 -- 172.21.15.81:0/516650586 shutdown_connections 2024-09-12T01:33:24.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:24.466+0000 7f5670d83640 1 -- 172.21.15.81:0/516650586 wait complete. 2024-09-12T01:33:25.320 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:33:25.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:25 smithi081 ceph-mon[30920]: pgmap v163: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:25.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:25 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/516650586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:33:25.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:25 smithi100 ceph-mon[35275]: pgmap v163: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:25.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:25 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/516650586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:33:25.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:25 smithi189 ceph-mon[35357]: pgmap v163: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:25.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:25 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/516650586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:33:25.566 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.987+0000 7f9f23ca0640 1 -- 172.21.15.81:0/3948306694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c100b30 msgr2=0x7f9f1c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.987+0000 7f9f23ca0640 1 --2- 172.21.15.81:0/3948306694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c100b30 0x7f9f1c100f10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009900 tx=0x7f9f1802a470 comp rx=0 tx=0).stop 2024-09-12T01:33:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.987+0000 7f9f23ca0640 1 -- 172.21.15.81:0/3948306694 shutdown_connections 2024-09-12T01:33:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.987+0000 7f9f23ca0640 1 --2- 172.21.15.81:0/3948306694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f1c105f40 0x7f9f1c1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.987+0000 7f9f23ca0640 1 --2- 172.21.15.81:0/3948306694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f1c101450 0x7f9f1c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.987+0000 7f9f23ca0640 1 --2- 172.21.15.81:0/3948306694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c100b30 0x7f9f1c100f10 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.987+0000 7f9f23ca0640 1 -- 172.21.15.81:0/3948306694 >> 172.21.15.81:0/3948306694 conn(0x7f9f1c0fc7a0 msgr2=0x7f9f1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.987+0000 7f9f23ca0640 1 -- 172.21.15.81:0/3948306694 shutdown_connections 2024-09-12T01:33:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.988+0000 7f9f23ca0640 1 -- 172.21.15.81:0/3948306694 wait complete. 2024-09-12T01:33:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.988+0000 7f9f23ca0640 1 Processor -- start 2024-09-12T01:33:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.988+0000 7f9f23ca0640 1 -- start start 2024-09-12T01:33:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.988+0000 7f9f23ca0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f1c100b30 0x7f9f1c1a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.988+0000 7f9f23ca0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f1c101450 0x7f9f1c1a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.988+0000 7f9f23ca0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c105f40 0x7f9f1c19ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.988+0000 7f9f23ca0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c118640 con 0x7f9f1c105f40 2024-09-12T01:33:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.988+0000 7f9f23ca0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1184c0 con 0x7f9f1c101450 2024-09-12T01:33:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.988+0000 7f9f23ca0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1187c0 con 0x7f9f1c100b30 2024-09-12T01:33:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f2223d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c105f40 0x7f9f1c19ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f2223d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c105f40 0x7f9f1c19ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50832/0 (socket says 172.21.15.81:50832) 2024-09-12T01:33:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f2223d640 1 -- 172.21.15.81:0/2862634192 learned_addr learned my addr 172.21.15.81:0/2862634192 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f1c100b30 0x7f9f1c1a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f2123b640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f1c101450 0x7f9f1c1a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f2223d640 1 -- 172.21.15.81:0/2862634192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f1c100b30 msgr2=0x7f9f1c1a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f2223d640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f1c100b30 0x7f9f1c1a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f2223d640 1 -- 172.21.15.81:0/2862634192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f1c101450 msgr2=0x7f9f1c1a4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f2223d640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f1c101450 0x7f9f1c1a4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f2223d640 1 -- 172.21.15.81:0/2862634192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1c19f130 con 0x7f9f1c105f40 2024-09-12T01:33:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f1c100b30 0x7f9f1c1a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f2223d640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c105f40 0x7f9f1c19ea00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400b970 tx=0x7f9f1400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f12ffd640 1 -- 172.21.15.81:0/2862634192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14019070 con 0x7f9f1c105f40 2024-09-12T01:33:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f23ca0640 1 -- 172.21.15.81:0/2862634192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f1c19f420 con 0x7f9f1c105f40 2024-09-12T01:33:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f12ffd640 1 -- 172.21.15.81:0/2862634192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f1400cb40 con 0x7f9f1c105f40 2024-09-12T01:33:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f12ffd640 1 -- 172.21.15.81:0/2862634192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14007650 con 0x7f9f1c105f40 2024-09-12T01:33:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.989+0000 7f9f23ca0640 1 -- 172.21.15.81:0/2862634192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f1c1ab710 con 0x7f9f1c105f40 2024-09-12T01:33:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f12ffd640 1 -- 172.21.15.81:0/2862634192 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9f1401c070 con 0x7f9f1c105f40 2024-09-12T01:33:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f26079740 1 Processor -- start 2024-09-12T01:33:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f26079740 1 -- start start 2024-09-12T01:33:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f26079740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e258b40 0x56099e257090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f26079740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e2575d0 0x56099e257a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f26079740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 0x56099e264760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f26079740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56099e1bd2f0 con 0x56099e262370 2024-09-12T01:33:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f26079740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56099e164cf0 con 0x56099e258b40 2024-09-12T01:33:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f26079740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56099e1b92b0 con 0x56099e2575d0 2024-09-12T01:33:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f2123b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 0x56099e264760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f2123b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 0x56099e264760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50840/0 (socket says 172.21.15.81:50840) 2024-09-12T01:33:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f2123b640 1 -- 172.21.15.81:0/3616698095 learned_addr learned my addr 172.21.15.81:0/3616698095 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/3616698095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e2575d0 0x56099e257a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f2123b640 1 --2- 172.21.15.81:0/3616698095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e258b40 0x56099e257090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.992+0000 7f9f12ffd640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9f080a2cf0 0x7f9f080a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.993+0000 7f9f2223d640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9f080a2cf0 0x7f9f080a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.993+0000 7f9f2123b640 1 -- 172.21.15.81:0/3616698095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e2575d0 msgr2=0x56099e257a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.993+0000 7f9f2123b640 1 --2- 172.21.15.81:0/3616698095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e2575d0 0x56099e257a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.993+0000 7f9f2123b640 1 -- 172.21.15.81:0/3616698095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e258b40 msgr2=0x56099e257090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.993+0000 7f9f2123b640 1 --2- 172.21.15.81:0/3616698095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e258b40 0x56099e257090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.993+0000 7f9f12ffd640 1 -- 172.21.15.81:0/2862634192 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f9f140cea10 con 0x7f9f1c105f40 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.993+0000 7f9f2123b640 1 -- 172.21.15.81:0/3616698095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099e1493a0 con 0x56099e262370 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.993+0000 7f9f2123b640 1 --2- 172.21.15.81:0/3616698095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 0x56099e264760 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0164e0 tx=0x7f9f0c00a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460238e9dfc53e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.993+0000 7f9f07fff640 1 -- 172.21.15.81:0/3616698095 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c016e60 con 0x56099e262370 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.993+0000 7f9f2223d640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9f080a2cf0 0x7f9f080a51b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9f1409ad10 tx=0x7f9f14004a40 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.993+0000 7f9f07fff640 1 -- 172.21.15.81:0/3616698095 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f0c018910 con 0x56099e262370 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.993+0000 7f9f07fff640 1 -- 172.21.15.81:0/3616698095 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0178e0 con 0x56099e262370 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.994+0000 7f9f26079740 1 -- 172.21.15.81:0/3616698095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 msgr2=0x56099e264760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.994+0000 7f9f26079740 1 --2- 172.21.15.81:0/3616698095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 0x56099e264760 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0164e0 tx=0x7f9f0c00a330 comp rx=0 tx=0).stop 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.994+0000 7f9f26079740 1 -- 172.21.15.81:0/3616698095 shutdown_connections 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.994+0000 7f9f26079740 1 --2- 172.21.15.81:0/3616698095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 0x56099e264760 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.994+0000 7f9f26079740 1 --2- 172.21.15.81:0/3616698095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e2575d0 0x56099e257a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.994+0000 7f9f26079740 1 --2- 172.21.15.81:0/3616698095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e258b40 0x56099e257090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.994+0000 7f9f26079740 1 -- 172.21.15.81:0/3616698095 >> 172.21.15.81:0/3616698095 conn(0x56099e220310 msgr2=0x56099e253c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.994+0000 7f9f26079740 1 -- 172.21.15.81:0/3616698095 shutdown_connections 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.994+0000 7f9f26079740 1 -- 172.21.15.81:0/3616698095 wait complete. 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.994+0000 7f9f26079740 1 -- start start 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.994+0000 7f9f26079740 1 Processor -- start 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f26079740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e2575d0 0x56099e261d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f26079740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e258b40 0x56099e25eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f26079740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e262370 0x56099e25f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f26079740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56099e265010 con 0x56099e2575d0 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f26079740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56099e178060 con 0x56099e258b40 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f26079740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56099e265190 con 0x56099e262370 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f26079740 10 client.0 _ll_register_callbacks cb 0x56099decb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f2123b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e2575d0 0x56099e261d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f2123b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e2575d0 0x56099e261d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50844/0 (socket says 172.21.15.81:50844) 2024-09-12T01:33:26.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f2123b640 1 -- 172.21.15.81:0/3814281818 learned_addr learned my addr 172.21.15.81:0/3814281818 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/3814281818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e258b40 0x56099e25eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f2123b640 1 -- 172.21.15.81:0/3814281818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e262370 msgr2=0x56099e25f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f2123b640 1 --2- 172.21.15.81:0/3814281818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e262370 0x56099e25f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f2123b640 1 -- 172.21.15.81:0/3814281818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e258b40 msgr2=0x56099e25eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f2123b640 1 --2- 172.21.15.81:0/3814281818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e258b40 0x56099e25eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f2123b640 1 -- 172.21.15.81:0/3814281818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099df2e3c0 con 0x56099e2575d0 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/3814281818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e258b40 0x56099e25eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f2123b640 1 --2- 172.21.15.81:0/3814281818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e2575d0 0x56099e261d40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c006e10 tx=0x7f9f0c017450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16504d218ae3191 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.995+0000 7f9f057fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f057fa640 1 -- 172.21.15.81:0/3814281818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c026020 con 0x56099e2575d0 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f26079740 1 -- 172.21.15.81:0/3814281818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f0c018910 con 0x56099e2575d0 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f057fa640 1 -- 172.21.15.81:0/3814281818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f9f0c018cc0 con 0x56099e2575d0 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f057fa640 1 -- 172.21.15.81:0/3814281818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f0c0059c0 con 0x56099e2575d0 2024-09-12T01:33:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f26079740 10 client.16605 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f26079740 1 -- 172.21.15.81:0/3814281818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56099e270a80 con 0x56099e2575d0 2024-09-12T01:33:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f057fa640 1 -- 172.21.15.81:0/3814281818 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f0c018910 con 0x56099e2575d0 2024-09-12T01:33:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f057fa640 1 -- 172.21.15.81:0/3814281818 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9f0c021070 con 0x56099e2575d0 2024-09-12T01:33:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f26079740 10 client.16605 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f26079740 10 client.16605 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:33:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f26079740 20 client.16605 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f26079740 1 --2- 172.21.15.81:0/3814281818 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56099e271dd0 0x56099e2741c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f26079740 4 client.16605 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f26079740 1 -- 172.21.15.81:0/3814281818 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56099e1ca860 con 0x56099e271dd0 2024-09-12T01:33:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.996+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/3814281818 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56099e271dd0 0x56099e2741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.997+0000 7f9f057fa640 10 client.16605 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:33:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.997+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/3814281818 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56099e271dd0 0x56099e2741c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=479937f819f2799 server_cookie=b25502dc8d0c6d5a in_seq=0 out_seq=0 2024-09-12T01:33:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f057fa640 1 -- 172.21.15.81:0/3814281818 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56099e1ca860 con 0x56099e271dd0 2024-09-12T01:33:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f057fa640 10 client.16605 handle_command_reply: tid=0 2024-09-12T01:33:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f26079740 1 client.16605 shutdown 2024-09-12T01:33:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f26079740 1 -- 172.21.15.81:0/3814281818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e2575d0 msgr2=0x56099e261d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f26079740 1 --2- 172.21.15.81:0/3814281818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e2575d0 0x56099e261d40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c006e10 tx=0x7f9f0c017450 comp rx=0 tx=0).stop 2024-09-12T01:33:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f26079740 1 -- 172.21.15.81:0/3814281818 shutdown_connections 2024-09-12T01:33:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f26079740 1 --2- 172.21.15.81:0/3814281818 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56099e271dd0 0x56099e2741c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f26079740 1 --2- 172.21.15.81:0/3814281818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e262370 0x56099e25f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f26079740 1 --2- 172.21.15.81:0/3814281818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e258b40 0x56099e25eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f26079740 1 --2- 172.21.15.81:0/3814281818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e2575d0 0x56099e261d40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f057fa640 0 client.16605 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:33:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f26079740 1 -- 172.21.15.81:0/3814281818 >> 172.21.15.81:0/3814281818 conn(0x56099e220310 msgr2=0x56099e259960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f26079740 1 -- 172.21.15.81:0/3814281818 shutdown_connections 2024-09-12T01:33:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f26079740 1 -- 172.21.15.81:0/3814281818 wait complete. 2024-09-12T01:33:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:25.998+0000 7f9f26079740 20 client.16605 trim_cache size 0 max 16384 2024-09-12T01:33:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f26079740 1 Processor -- start 2024-09-12T01:33:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f26079740 1 -- start start 2024-09-12T01:33:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f26079740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e2575d0 0x56099e25e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f26079740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e258b40 0x56099e259820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f26079740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e262370 0x56099e259d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f26079740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1b3fd0 con 0x56099e258b40 2024-09-12T01:33:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f26079740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1b5b10 con 0x56099e262370 2024-09-12T01:33:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f26079740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1b46a0 con 0x56099e2575d0 2024-09-12T01:33:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f21a3c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e258b40 0x56099e259820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f21a3c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e258b40 0x56099e259820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50854/0 (socket says 172.21.15.81:50854) 2024-09-12T01:33:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f21a3c640 1 -- 172.21.15.81:0/2169228647 learned_addr learned my addr 172.21.15.81:0/2169228647 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f21a3c640 1 -- 172.21.15.81:0/2169228647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e2575d0 msgr2=0x56099e25e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/2169228647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e2575d0 0x56099e25e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f21a3c640 1 -- 172.21.15.81:0/2169228647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e262370 msgr2=0x56099e259d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/2169228647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e262370 0x56099e259d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f21a3c640 1 -- 172.21.15.81:0/2169228647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099e2620b0 con 0x56099e258b40 2024-09-12T01:33:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.011+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/2169228647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e258b40 0x56099e259820 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9f1802a990 tx=0x7f9f18031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9111953df26aec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.012+0000 7f9f077fe640 1 -- 172.21.15.81:0/2169228647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18049070 con 0x56099e258b40 2024-09-12T01:33:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.012+0000 7f9f077fe640 1 -- 172.21.15.81:0/2169228647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f18005500 con 0x56099e258b40 2024-09-12T01:33:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.012+0000 7f9f077fe640 1 -- 172.21.15.81:0/2169228647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18035040 con 0x56099e258b40 2024-09-12T01:33:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.012+0000 7f9f26079740 1 -- 172.21.15.81:0/2169228647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e258b40 msgr2=0x56099e259820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.012+0000 7f9f26079740 1 --2- 172.21.15.81:0/2169228647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e258b40 0x56099e259820 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9f1802a990 tx=0x7f9f18031400 comp rx=0 tx=0).stop 2024-09-12T01:33:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.012+0000 7f9f26079740 1 -- 172.21.15.81:0/2169228647 shutdown_connections 2024-09-12T01:33:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.012+0000 7f9f26079740 1 --2- 172.21.15.81:0/2169228647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e262370 0x56099e259d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.012+0000 7f9f26079740 1 --2- 172.21.15.81:0/2169228647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e258b40 0x56099e259820 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.012+0000 7f9f26079740 1 --2- 172.21.15.81:0/2169228647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e2575d0 0x56099e25e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.012+0000 7f9f26079740 1 -- 172.21.15.81:0/2169228647 >> 172.21.15.81:0/2169228647 conn(0x56099e220310 msgr2=0x56099e259110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.012+0000 7f9f26079740 1 -- 172.21.15.81:0/2169228647 shutdown_connections 2024-09-12T01:33:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.012+0000 7f9f26079740 1 -- 172.21.15.81:0/2169228647 wait complete. 2024-09-12T01:33:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.012+0000 7f9f26079740 1 -- start start 2024-09-12T01:33:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f26079740 1 Processor -- start 2024-09-12T01:33:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f26079740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e2575d0 0x56099e277960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f26079740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e258b40 0x56099e274d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f26079740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 0x56099e275240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f26079740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1b5440 con 0x56099e262370 2024-09-12T01:33:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f26079740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1b4d70 con 0x56099e2575d0 2024-09-12T01:33:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f26079740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1b1fb0 con 0x56099e258b40 2024-09-12T01:33:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f26079740 10 client.0 _ll_register_callbacks cb 0x7f9f0c00ac30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f2123b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 0x56099e275240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f2123b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 0x56099e275240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50860/0 (socket says 172.21.15.81:50860) 2024-09-12T01:33:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f2123b640 1 -- 172.21.15.81:0/900810235 learned_addr learned my addr 172.21.15.81:0/900810235 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/900810235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e258b40 0x56099e274d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f2123b640 1 -- 172.21.15.81:0/900810235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e258b40 msgr2=0x56099e274d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f2123b640 1 --2- 172.21.15.81:0/900810235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e258b40 0x56099e274d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f2123b640 1 -- 172.21.15.81:0/900810235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e2575d0 msgr2=0x56099e277960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f2123b640 1 --2- 172.21.15.81:0/900810235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e2575d0 0x56099e277960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f2123b640 1 -- 172.21.15.81:0/900810235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099e275a90 con 0x56099e262370 2024-09-12T01:33:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.013+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/900810235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e258b40 0x56099e274d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f2123b640 1 --2- 172.21.15.81:0/900810235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 0x56099e275240 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c004690 tx=0x7f9f0c00a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86d524ca0b9a991 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f057fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f057fa640 1 -- 172.21.15.81:0/900810235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c03a060 con 0x56099e262370 2024-09-12T01:33:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f057fa640 1 -- 172.21.15.81:0/900810235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f9f0c022430 con 0x56099e262370 2024-09-12T01:33:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f26079740 1 -- 172.21.15.81:0/900810235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f18005500 con 0x56099e262370 2024-09-12T01:33:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f057fa640 1 -- 172.21.15.81:0/900810235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f0c026050 con 0x56099e262370 2024-09-12T01:33:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f26079740 10 client.16611 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f26079740 1 -- 172.21.15.81:0/900810235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56099e2dc740 con 0x56099e262370 2024-09-12T01:33:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f057fa640 1 -- 172.21.15.81:0/900810235 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f18005500 con 0x56099e262370 2024-09-12T01:33:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f057fa640 1 -- 172.21.15.81:0/900810235 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9f0c034070 con 0x56099e262370 2024-09-12T01:33:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f26079740 10 client.16611 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f26079740 10 client.16611 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:33:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f26079740 20 client.16611 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f26079740 1 --2- 172.21.15.81:0/900810235 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56099e2dce00 0x56099e2df220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f26079740 4 client.16611 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:33:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.014+0000 7f9f26079740 1 -- 172.21.15.81:0/900810235 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56099e1c4d70 con 0x56099e2dce00 2024-09-12T01:33:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/900810235 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56099e2dce00 0x56099e2df220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f21a3c640 1 --2- 172.21.15.81:0/900810235 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56099e2dce00 0x56099e2df220 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c3704a08745b18eb server_cookie=cd396eca364ec763 in_seq=0 out_seq=0 2024-09-12T01:33:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f057fa640 10 client.16611 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:33:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f057fa640 1 -- 172.21.15.81:0/900810235 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56099e1c4d70 con 0x56099e2dce00 2024-09-12T01:33:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f057fa640 10 client.16611 handle_command_reply: tid=0 2024-09-12T01:33:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f26079740 1 client.16611 shutdown 2024-09-12T01:33:26.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f26079740 1 -- 172.21.15.81:0/900810235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 msgr2=0x56099e275240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f26079740 1 --2- 172.21.15.81:0/900810235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 0x56099e275240 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c004690 tx=0x7f9f0c00a7a0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f26079740 1 -- 172.21.15.81:0/900810235 shutdown_connections 2024-09-12T01:33:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f26079740 1 --2- 172.21.15.81:0/900810235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56099e262370 0x56099e275240 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f26079740 1 --2- 172.21.15.81:0/900810235 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56099e2dce00 0x56099e2df220 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f26079740 1 --2- 172.21.15.81:0/900810235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56099e258b40 0x56099e274d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f26079740 1 --2- 172.21.15.81:0/900810235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56099e2575d0 0x56099e277960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f26079740 1 -- 172.21.15.81:0/900810235 >> 172.21.15.81:0/900810235 conn(0x56099e220310 msgr2=0x56099e259820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.015+0000 7f9f057fa640 0 client.16611 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:33:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.016+0000 7f9f26079740 1 -- 172.21.15.81:0/900810235 shutdown_connections 2024-09-12T01:33:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.016+0000 7f9f26079740 1 -- 172.21.15.81:0/900810235 wait complete. 2024-09-12T01:33:26.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.016+0000 7f9f26079740 20 client.16611 trim_cache size 0 max 16384 2024-09-12T01:33:26.033 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:33:26.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.016+0000 7f9f23ca0640 1 -- 172.21.15.81:0/2862634192 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9f080a2cf0 msgr2=0x7f9f080a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:26.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.016+0000 7f9f23ca0640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9f080a2cf0 0x7f9f080a51b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9f1409ad10 tx=0x7f9f14004a40 comp rx=0 tx=0).stop 2024-09-12T01:33:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.016+0000 7f9f23ca0640 1 -- 172.21.15.81:0/2862634192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c105f40 msgr2=0x7f9f1c19ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.016+0000 7f9f23ca0640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c105f40 0x7f9f1c19ea00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400b970 tx=0x7f9f1400be30 comp rx=0 tx=0).stop 2024-09-12T01:33:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.017+0000 7f9f23ca0640 1 -- 172.21.15.81:0/2862634192 shutdown_connections 2024-09-12T01:33:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.017+0000 7f9f23ca0640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9f080a2cf0 0x7f9f080a51b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.017+0000 7f9f23ca0640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c105f40 0x7f9f1c19ea00 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.017+0000 7f9f23ca0640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f1c101450 0x7f9f1c1a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.017+0000 7f9f23ca0640 1 --2- 172.21.15.81:0/2862634192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f1c100b30 0x7f9f1c1a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.017+0000 7f9f23ca0640 1 -- 172.21.15.81:0/2862634192 >> 172.21.15.81:0/2862634192 conn(0x7f9f1c0fc7a0 msgr2=0x7f9f1c10f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.017+0000 7f9f23ca0640 1 -- 172.21.15.81:0/2862634192 shutdown_connections 2024-09-12T01:33:26.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:26.017+0000 7f9f23ca0640 1 -- 172.21.15.81:0/2862634192 wait complete. 2024-09-12T01:33:26.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:33:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:27.482 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:27 smithi081 ceph-mon[30920]: pgmap v164: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:33:27.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:27 smithi100 ceph-mon[35275]: pgmap v164: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:33:27.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:27 smithi189 ceph-mon[35357]: pgmap v164: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:33:27.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.564+0000 7f17c2503640 1 -- 172.21.15.81:0/162171709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17bc106f10 msgr2=0x7f17bc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:27.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.564+0000 7f17c2503640 1 --2- 172.21.15.81:0/162171709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17bc106f10 0x7f17bc10ea90 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009ca0 tx=0x7f17b402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.564+0000 7f17c2503640 1 -- 172.21.15.81:0/162171709 shutdown_connections 2024-09-12T01:33:27.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.564+0000 7f17c2503640 1 --2- 172.21.15.81:0/162171709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17bc106f10 0x7f17bc10ea90 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.564+0000 7f17c2503640 1 --2- 172.21.15.81:0/162171709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17bc102790 0x7f17bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.564+0000 7f17c2503640 1 --2- 172.21.15.81:0/162171709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17bc101de0 0x7f17bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.564+0000 7f17c2503640 1 -- 172.21.15.81:0/162171709 >> 172.21.15.81:0/162171709 conn(0x7f17bc0fd8c0 msgr2=0x7f17bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:27.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.564+0000 7f17c2503640 1 -- 172.21.15.81:0/162171709 shutdown_connections 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.564+0000 7f17c2503640 1 -- 172.21.15.81:0/162171709 wait complete. 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.565+0000 7f17c2503640 1 Processor -- start 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.565+0000 7f17c2503640 1 -- start start 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.565+0000 7f17c2503640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17bc101de0 0x7f17bc198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.565+0000 7f17c2503640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17bc102790 0x7f17bc198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.565+0000 7f17c2503640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17bc106f10 0x7f17bc19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.565+0000 7f17c2503640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc111f70 con 0x7f17bc102790 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.565+0000 7f17c2503640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc111df0 con 0x7f17bc106f10 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.565+0000 7f17c2503640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1120f0 con 0x7f17bc101de0 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.565+0000 7f17b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17bc102790 0x7f17bc198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.565+0000 7f17b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17bc102790 0x7f17bc198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50874/0 (socket says 172.21.15.81:50874) 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.565+0000 7f17b3fff640 1 -- 172.21.15.81:0/3499144808 learned_addr learned my addr 172.21.15.81:0/3499144808 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17bbfff640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17bc101de0 0x7f17bc198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17c0aa0640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17bc106f10 0x7f17bc19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17b3fff640 1 -- 172.21.15.81:0/3499144808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17bc101de0 msgr2=0x7f17bc198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17b3fff640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17bc101de0 0x7f17bc198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17b3fff640 1 -- 172.21.15.81:0/3499144808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17bc106f10 msgr2=0x7f17bc19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17b3fff640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17bc106f10 0x7f17bc19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17b3fff640 1 -- 172.21.15.81:0/3499144808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc19d2e0 con 0x7f17bc102790 2024-09-12T01:33:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17c0aa0640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17bc106f10 0x7f17bc19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17b3fff640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17bc102790 0x7f17bc198870 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f17a400d950 tx=0x7f17a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17b9ffb640 1 -- 172.21.15.81:0/3499144808 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4017070 con 0x7f17bc102790 2024-09-12T01:33:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17c2503640 1 -- 172.21.15.81:0/3499144808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17bc19d5d0 con 0x7f17bc102790 2024-09-12T01:33:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17b9ffb640 1 -- 172.21.15.81:0/3499144808 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17a4009c30 con 0x7f17bc102790 2024-09-12T01:33:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17b9ffb640 1 -- 172.21.15.81:0/3499144808 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a400f6b0 con 0x7f17bc102790 2024-09-12T01:33:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.566+0000 7f17c2503640 1 -- 172.21.15.81:0/3499144808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17bc1a4eb0 con 0x7f17bc102790 2024-09-12T01:33:27.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.569+0000 7f17c48dc740 1 Processor -- start 2024-09-12T01:33:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.569+0000 7f17b9ffb640 1 -- 172.21.15.81:0/3499144808 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f17a40109d0 con 0x7f17bc102790 2024-09-12T01:33:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.569+0000 7f17c48dc740 1 -- start start 2024-09-12T01:33:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.569+0000 7f17c48dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 0x564913752090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.569+0000 7f17c48dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649137525d0 0x564913752a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.569+0000 7f17c48dc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56491375d370 0x56491375f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.569+0000 7f17c48dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5649136b82f0 con 0x564913753b40 2024-09-12T01:33:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.569+0000 7f17c48dc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56491365fcf0 con 0x56491375d370 2024-09-12T01:33:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.569+0000 7f17c48dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5649136b42b0 con 0x5649137525d0 2024-09-12T01:33:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.569+0000 7f17c0aa0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 0x564913752090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.569+0000 7f17c0aa0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 0x564913752090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50878/0 (socket says 172.21.15.81:50878) 2024-09-12T01:33:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.569+0000 7f17c0aa0640 1 -- 172.21.15.81:0/2356508176 learned_addr learned my addr 172.21.15.81:0/2356508176 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17bbfff640 1 --2- 172.21.15.81:0/2356508176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649137525d0 0x564913752a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17b3fff640 1 --2- 172.21.15.81:0/2356508176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56491375d370 0x56491375f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17c0aa0640 1 -- 172.21.15.81:0/2356508176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649137525d0 msgr2=0x564913752a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17c0aa0640 1 --2- 172.21.15.81:0/2356508176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649137525d0 0x564913752a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17c0aa0640 1 -- 172.21.15.81:0/2356508176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56491375d370 msgr2=0x56491375f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17c0aa0640 1 --2- 172.21.15.81:0/2356508176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56491375d370 0x56491375f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17c0aa0640 1 -- 172.21.15.81:0/2356508176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649136443a0 con 0x564913753b40 2024-09-12T01:33:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17b9ffb640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f17a80a2cf0 0x7f17a80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17c0aa0640 1 --2- 172.21.15.81:0/2356508176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 0x564913752090 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009940 tx=0x7f17b4009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1042eb0cf5b258 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17bbfff640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f17a80a2cf0 0x7f17a80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17b9ffb640 1 -- 172.21.15.81:0/3499144808 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f17a40cf0d0 con 0x7f17bc102790 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17b27fc640 1 -- 172.21.15.81:0/2356508176 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4003970 con 0x564913753b40 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17b27fc640 1 -- 172.21.15.81:0/2356508176 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17b4036050 con 0x564913753b40 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.570+0000 7f17b27fc640 1 -- 172.21.15.81:0/2356508176 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b40044d0 con 0x564913753b40 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.571+0000 7f17c48dc740 1 -- 172.21.15.81:0/2356508176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 msgr2=0x564913752090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.571+0000 7f17c48dc740 1 --2- 172.21.15.81:0/2356508176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 0x564913752090 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009940 tx=0x7f17b4009970 comp rx=0 tx=0).stop 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.571+0000 7f17bbfff640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f17a80a2cf0 0x7f17a80a51b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x56491374fac0 tx=0x7f17ac00c4b0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.571+0000 7f17c48dc740 1 -- 172.21.15.81:0/2356508176 shutdown_connections 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.571+0000 7f17c48dc740 1 --2- 172.21.15.81:0/2356508176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56491375d370 0x56491375f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.571+0000 7f17c48dc740 1 --2- 172.21.15.81:0/2356508176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649137525d0 0x564913752a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.571+0000 7f17c48dc740 1 --2- 172.21.15.81:0/2356508176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 0x564913752090 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.571+0000 7f17c48dc740 1 -- 172.21.15.81:0/2356508176 >> 172.21.15.81:0/2356508176 conn(0x56491371b310 msgr2=0x56491374ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.571+0000 7f17c48dc740 1 -- 172.21.15.81:0/2356508176 shutdown_connections 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.571+0000 7f17c48dc740 1 -- 172.21.15.81:0/2356508176 wait complete. 2024-09-12T01:33:27.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.571+0000 7f17c48dc740 1 -- start start 2024-09-12T01:33:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17c48dc740 1 Processor -- start 2024-09-12T01:33:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17c48dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649137525d0 0x56491375cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17c48dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 0x56491375a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17c48dc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56491375d370 0x56491375a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17c48dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56491375fe90 con 0x564913753b40 2024-09-12T01:33:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17c48dc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564913673060 con 0x56491375d370 2024-09-12T01:33:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17c48dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564913760010 con 0x5649137525d0 2024-09-12T01:33:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17c48dc740 10 client.0 _ll_register_callbacks cb 0x5649133c68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 0x56491375a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 0x56491375a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50882/0 (socket says 172.21.15.81:50882) 2024-09-12T01:33:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17b3fff640 1 -- 172.21.15.81:0/103247007 learned_addr learned my addr 172.21.15.81:0/103247007 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:27.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17c0aa0640 1 --2- 172.21.15.81:0/103247007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56491375d370 0x56491375a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17bbfff640 1 --2- 172.21.15.81:0/103247007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649137525d0 0x56491375cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17b3fff640 1 -- 172.21.15.81:0/103247007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649137525d0 msgr2=0x56491375cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17b3fff640 1 --2- 172.21.15.81:0/103247007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649137525d0 0x56491375cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17b3fff640 1 -- 172.21.15.81:0/103247007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56491375d370 msgr2=0x56491375a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17b3fff640 1 --2- 172.21.15.81:0/103247007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56491375d370 0x56491375a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.572+0000 7f17b3fff640 1 -- 172.21.15.81:0/103247007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649134293c0 con 0x564913753b40 2024-09-12T01:33:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f17b3fff640 1 --2- 172.21.15.81:0/103247007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 0x56491375a020 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f17a4000c00 tx=0x7f17a40979b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db08a7b1be54009e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f179b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f179b7fe640 1 -- 172.21.15.81:0/103247007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4020070 con 0x564913753b40 2024-09-12T01:33:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f179b7fe640 1 -- 172.21.15.81:0/103247007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f17a40d1110 con 0x564913753b40 2024-09-12T01:33:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f17c48dc740 1 -- 172.21.15.81:0/103247007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17b4036050 con 0x564913753b40 2024-09-12T01:33:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f179b7fe640 1 -- 172.21.15.81:0/103247007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f17a4009de0 con 0x564913753b40 2024-09-12T01:33:27.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f17c48dc740 10 client.16623 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f17c48dc740 1 -- 172.21.15.81:0/103247007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56491376b980 con 0x564913753b40 2024-09-12T01:33:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f179b7fe640 1 -- 172.21.15.81:0/103247007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17b4036050 con 0x564913753b40 2024-09-12T01:33:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f179b7fe640 1 -- 172.21.15.81:0/103247007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f17a4084b60 con 0x564913753b40 2024-09-12T01:33:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f17c48dc740 10 client.16623 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f17c48dc740 10 client.16623 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:33:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f17c48dc740 20 client.16623 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f17c48dc740 1 --2- 172.21.15.81:0/103247007 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x56491376ccd0 0x56491376f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f17c48dc740 4 client.16623 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.573+0000 7f17c48dc740 1 -- 172.21.15.81:0/103247007 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649136c5860 con 0x56491376ccd0 2024-09-12T01:33:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.574+0000 7f17bbfff640 1 --2- 172.21.15.81:0/103247007 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x56491376ccd0 0x56491376f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.574+0000 7f17bbfff640 1 --2- 172.21.15.81:0/103247007 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x56491376ccd0 0x56491376f0c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b18719e3f34feb32 server_cookie=1e5d2b6cf427b54e in_seq=0 out_seq=0 2024-09-12T01:33:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.574+0000 7f179b7fe640 10 client.16623 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:33:27.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f179b7fe640 1 -- 172.21.15.81:0/103247007 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649136c5860 con 0x56491376ccd0 2024-09-12T01:33:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f179b7fe640 10 client.16623 handle_command_reply: tid=0 2024-09-12T01:33:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f17c48dc740 1 client.16623 shutdown 2024-09-12T01:33:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f17c48dc740 1 -- 172.21.15.81:0/103247007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 msgr2=0x56491375a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f17c48dc740 1 --2- 172.21.15.81:0/103247007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 0x56491375a020 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f17a4000c00 tx=0x7f17a40979b0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f17c48dc740 1 -- 172.21.15.81:0/103247007 shutdown_connections 2024-09-12T01:33:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f17c48dc740 1 --2- 172.21.15.81:0/103247007 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x56491376ccd0 0x56491376f0c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f17c48dc740 1 --2- 172.21.15.81:0/103247007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56491375d370 0x56491375a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f17c48dc740 1 --2- 172.21.15.81:0/103247007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564913753b40 0x56491375a020 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f17c48dc740 1 --2- 172.21.15.81:0/103247007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5649137525d0 0x56491375cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f17c48dc740 1 -- 172.21.15.81:0/103247007 >> 172.21.15.81:0/103247007 conn(0x56491371b310 msgr2=0x564913754960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f179b7fe640 0 client.16623 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:33:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f17c48dc740 1 -- 172.21.15.81:0/103247007 shutdown_connections 2024-09-12T01:33:27.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f17c48dc740 1 -- 172.21.15.81:0/103247007 wait complete. 2024-09-12T01:33:27.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.575+0000 7f17c48dc740 20 client.16623 trim_cache size 0 max 16384 2024-09-12T01:33:27.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17c48dc740 1 Processor -- start 2024-09-12T01:33:27.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17c48dc740 1 -- start start 2024-09-12T01:33:27.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17c48dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 0x564913769130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17c48dc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564913753b40 0x564913755120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17c48dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56491375d370 0x564913755660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17c48dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1ad730 con 0x5649137525d0 2024-09-12T01:33:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17c48dc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1af270 con 0x564913753b40 2024-09-12T01:33:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17c48dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1ade00 con 0x56491375d370 2024-09-12T01:33:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 0x564913769130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 0x564913769130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50892/0 (socket says 172.21.15.81:50892) 2024-09-12T01:33:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17bbfff640 1 -- 172.21.15.81:0/1027994429 learned_addr learned my addr 172.21.15.81:0/1027994429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17b3fff640 1 --2- 172.21.15.81:0/1027994429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564913753b40 0x564913755120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17bbfff640 1 -- 172.21.15.81:0/1027994429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56491375d370 msgr2=0x564913755660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17bbfff640 1 --2- 172.21.15.81:0/1027994429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56491375d370 0x564913755660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17bbfff640 1 -- 172.21.15.81:0/1027994429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564913753b40 msgr2=0x564913755120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17bbfff640 1 --2- 172.21.15.81:0/1027994429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564913753b40 0x564913755120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17bbfff640 1 -- 172.21.15.81:0/1027994429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56491374fdd0 con 0x5649137525d0 2024-09-12T01:33:27.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.588+0000 7f17b3fff640 1 --2- 172.21.15.81:0/1027994429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564913753b40 0x564913755120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.589+0000 7f17bbfff640 1 --2- 172.21.15.81:0/1027994429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 0x564913769130 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x56491376f930 tx=0x7f17ac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18997fee28d66154 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.589+0000 7f17b1ffb640 1 -- 172.21.15.81:0/1027994429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac01ac50 con 0x5649137525d0 2024-09-12T01:33:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.589+0000 7f17b1ffb640 1 -- 172.21.15.81:0/1027994429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17ac01adf0 con 0x5649137525d0 2024-09-12T01:33:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.589+0000 7f17b1ffb640 1 -- 172.21.15.81:0/1027994429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0116a0 con 0x5649137525d0 2024-09-12T01:33:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.589+0000 7f17c48dc740 1 -- 172.21.15.81:0/1027994429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 msgr2=0x564913769130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.589+0000 7f17c48dc740 1 --2- 172.21.15.81:0/1027994429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 0x564913769130 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x56491376f930 tx=0x7f17ac014000 comp rx=0 tx=0).stop 2024-09-12T01:33:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.589+0000 7f17c48dc740 1 -- 172.21.15.81:0/1027994429 shutdown_connections 2024-09-12T01:33:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.589+0000 7f17c48dc740 1 --2- 172.21.15.81:0/1027994429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56491375d370 0x564913755660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.589+0000 7f17c48dc740 1 --2- 172.21.15.81:0/1027994429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564913753b40 0x564913755120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.589+0000 7f17c48dc740 1 --2- 172.21.15.81:0/1027994429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 0x564913769130 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.589+0000 7f17c48dc740 1 -- 172.21.15.81:0/1027994429 >> 172.21.15.81:0/1027994429 conn(0x56491371b310 msgr2=0x564913759110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.589+0000 7f17c48dc740 1 -- 172.21.15.81:0/1027994429 shutdown_connections 2024-09-12T01:33:27.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.590+0000 7f17c48dc740 1 -- 172.21.15.81:0/1027994429 wait complete. 2024-09-12T01:33:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.590+0000 7f17c48dc740 1 -- start start 2024-09-12T01:33:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.590+0000 7f17c48dc740 1 Processor -- start 2024-09-12T01:33:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.590+0000 7f17c48dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 0x564913765bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.590+0000 7f17c48dc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564913753b40 0x564913760ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.590+0000 7f17c48dc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56491375d370 0x564913761680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.590+0000 7f17c48dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1aeba0 con 0x5649137525d0 2024-09-12T01:33:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.590+0000 7f17c48dc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1ae4d0 con 0x564913753b40 2024-09-12T01:33:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.590+0000 7f17c48dc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc1ab710 con 0x56491375d370 2024-09-12T01:33:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.590+0000 7f17c48dc740 10 client.0 _ll_register_callbacks cb 0x7f17a400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 0x564913765bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 0x564913765bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50902/0 (socket says 172.21.15.81:50902) 2024-09-12T01:33:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17bbfff640 1 -- 172.21.15.81:0/441549010 learned_addr learned my addr 172.21.15.81:0/441549010 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17c0aa0640 1 --2- 172.21.15.81:0/441549010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56491375d370 0x564913761680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17b3fff640 1 --2- 172.21.15.81:0/441549010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564913753b40 0x564913760ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17bbfff640 1 -- 172.21.15.81:0/441549010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56491375d370 msgr2=0x564913761680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17bbfff640 1 --2- 172.21.15.81:0/441549010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56491375d370 0x564913761680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17bbfff640 1 -- 172.21.15.81:0/441549010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564913753b40 msgr2=0x564913760ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17bbfff640 1 --2- 172.21.15.81:0/441549010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564913753b40 0x564913760ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17bbfff640 1 -- 172.21.15.81:0/441549010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649137d6960 con 0x5649137525d0 2024-09-12T01:33:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17bbfff640 1 --2- 172.21.15.81:0/441549010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 0x564913765bc0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f17ac01ad30 tx=0x7f17ac004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194a7ca06d4e837d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f179b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f179b7fe640 1 -- 172.21.15.81:0/441549010 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0053b0 con 0x5649137525d0 2024-09-12T01:33:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f179b7fe640 1 -- 172.21.15.81:0/441549010 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f17ac005550 con 0x5649137525d0 2024-09-12T01:33:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17c48dc740 1 -- 172.21.15.81:0/441549010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17ac01adf0 con 0x5649137525d0 2024-09-12T01:33:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f179b7fe640 1 -- 172.21.15.81:0/441549010 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f17ac031480 con 0x5649137525d0 2024-09-12T01:33:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17c48dc740 10 client.16629 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.591+0000 7f17c48dc740 1 -- 172.21.15.81:0/441549010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5649137d7ab0 con 0x5649137525d0 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.592+0000 7f179b7fe640 1 -- 172.21.15.81:0/441549010 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17ac01adf0 con 0x5649137525d0 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.592+0000 7f179b7fe640 1 -- 172.21.15.81:0/441549010 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f17ac018040 con 0x5649137525d0 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.592+0000 7f17c48dc740 10 client.16629 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.592+0000 7f17c48dc740 10 client.16629 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.592+0000 7f17c48dc740 20 client.16629 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.592+0000 7f17c48dc740 1 --2- 172.21.15.81:0/441549010 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5649137d8160 0x5649137da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.592+0000 7f17c48dc740 4 client.16629 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.592+0000 7f17c48dc740 1 -- 172.21.15.81:0/441549010 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5649136bfd70 con 0x5649137d8160 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.592+0000 7f17b3fff640 1 --2- 172.21.15.81:0/441549010 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5649137d8160 0x5649137da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f179b7fe640 10 client.16629 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f17b3fff640 1 --2- 172.21.15.81:0/441549010 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5649137d8160 0x5649137da580 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5fd47c6e6f19ec56 server_cookie=885f549433d88635 in_seq=0 out_seq=0 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f179b7fe640 1 -- 172.21.15.81:0/441549010 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5649136bfd70 con 0x5649137d8160 2024-09-12T01:33:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f179b7fe640 10 client.16629 handle_command_reply: tid=0 2024-09-12T01:33:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f17c48dc740 1 client.16629 shutdown 2024-09-12T01:33:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f17c48dc740 1 -- 172.21.15.81:0/441549010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 msgr2=0x564913765bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f17c48dc740 1 --2- 172.21.15.81:0/441549010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 0x564913765bc0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f17ac01ad30 tx=0x7f17ac004de0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f17c48dc740 1 -- 172.21.15.81:0/441549010 shutdown_connections 2024-09-12T01:33:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f17c48dc740 1 --2- 172.21.15.81:0/441549010 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5649137d8160 0x5649137da580 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f17c48dc740 1 --2- 172.21.15.81:0/441549010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56491375d370 0x564913761680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f17c48dc740 1 --2- 172.21.15.81:0/441549010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564913753b40 0x564913760ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f17c48dc740 1 --2- 172.21.15.81:0/441549010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649137525d0 0x564913765bc0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f17c48dc740 1 -- 172.21.15.81:0/441549010 >> 172.21.15.81:0/441549010 conn(0x56491371b310 msgr2=0x56491375b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f179b7fe640 0 client.16629 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:33:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f17c48dc740 1 -- 172.21.15.81:0/441549010 shutdown_connections 2024-09-12T01:33:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f17c48dc740 1 -- 172.21.15.81:0/441549010 wait complete. 2024-09-12T01:33:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.593+0000 7f17c48dc740 20 client.16629 trim_cache size 0 max 16384 2024-09-12T01:33:27.603 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:33:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.594+0000 7f17c2503640 1 -- 172.21.15.81:0/3499144808 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f17a80a2cf0 msgr2=0x7f17a80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.594+0000 7f17c2503640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f17a80a2cf0 0x7f17a80a51b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x56491374fac0 tx=0x7f17ac00c4b0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.594+0000 7f17c2503640 1 -- 172.21.15.81:0/3499144808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17bc102790 msgr2=0x7f17bc198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.594+0000 7f17c2503640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17bc102790 0x7f17bc198870 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f17a400d950 tx=0x7f17a400de10 comp rx=0 tx=0).stop 2024-09-12T01:33:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.594+0000 7f17c2503640 1 -- 172.21.15.81:0/3499144808 shutdown_connections 2024-09-12T01:33:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.594+0000 7f17c2503640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f17a80a2cf0 0x7f17a80a51b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.594+0000 7f17c2503640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17bc106f10 0x7f17bc19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.594+0000 7f17c2503640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17bc102790 0x7f17bc198870 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.594+0000 7f17c2503640 1 --2- 172.21.15.81:0/3499144808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17bc101de0 0x7f17bc198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.594+0000 7f17c2503640 1 -- 172.21.15.81:0/3499144808 >> 172.21.15.81:0/3499144808 conn(0x7f17bc0fd8c0 msgr2=0x7f17bc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.594+0000 7f17c2503640 1 -- 172.21.15.81:0/3499144808 shutdown_connections 2024-09-12T01:33:27.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:27.594+0000 7f17c2503640 1 -- 172.21.15.81:0/3499144808 wait complete. 2024-09-12T01:33:28.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:33:28.594 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.056+0000 7f8f3fcfa640 1 -- 172.21.15.81:0/970687173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f38100a80 msgr2=0x7f8f38100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.056+0000 7f8f3fcfa640 1 --2- 172.21.15.81:0/970687173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f38100a80 0x7f8f38100ee0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009930 tx=0x7f8f2802a420 comp rx=0 tx=0).stop 2024-09-12T01:33:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.056+0000 7f8f3fcfa640 1 -- 172.21.15.81:0/970687173 shutdown_connections 2024-09-12T01:33:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.056+0000 7f8f3fcfa640 1 --2- 172.21.15.81:0/970687173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f38101420 0x7f8f3810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.056+0000 7f8f3fcfa640 1 --2- 172.21.15.81:0/970687173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f38100a80 0x7f8f38100ee0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.056+0000 7f8f3fcfa640 1 --2- 172.21.15.81:0/970687173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f38106a80 0x7f8f38106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.056+0000 7f8f3fcfa640 1 -- 172.21.15.81:0/970687173 >> 172.21.15.81:0/970687173 conn(0x7f8f380fc7a0 msgr2=0x7f8f380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.056+0000 7f8f3fcfa640 1 -- 172.21.15.81:0/970687173 shutdown_connections 2024-09-12T01:33:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.056+0000 7f8f3fcfa640 1 -- 172.21.15.81:0/970687173 wait complete. 2024-09-12T01:33:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3fcfa640 1 Processor -- start 2024-09-12T01:33:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3fcfa640 1 -- start start 2024-09-12T01:33:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3fcfa640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f38100a80 0x7f8f381985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3fcfa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f38101420 0x7f8f38198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3fcfa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f38106a80 0x7f8f3819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3fcfa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38110f20 con 0x7f8f38106a80 2024-09-12T01:33:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3fcfa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38110da0 con 0x7f8f38101420 2024-09-12T01:33:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3fcfa640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8f381110a0 con 0x7f8f38100a80 2024-09-12T01:33:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3e297640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f38106a80 0x7f8f3819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3d295640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f38101420 0x7f8f38198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3e297640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f38106a80 0x7f8f3819ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50922/0 (socket says 172.21.15.81:50922) 2024-09-12T01:33:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3d295640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f38101420 0x7f8f38198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:51602/0 (socket says 172.21.15.81:51602) 2024-09-12T01:33:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3e297640 1 -- 172.21.15.81:0/3629674218 learned_addr learned my addr 172.21.15.81:0/3629674218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3da96640 1 --2- 172.21.15.81:0/3629674218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f38100a80 0x7f8f381985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3e297640 1 -- 172.21.15.81:0/3629674218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f38100a80 msgr2=0x7f8f381985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3e297640 1 --2- 172.21.15.81:0/3629674218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f38100a80 0x7f8f381985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3e297640 1 -- 172.21.15.81:0/3629674218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f38101420 msgr2=0x7f8f38198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3e297640 1 --2- 172.21.15.81:0/3629674218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f38101420 0x7f8f38198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.057+0000 7f8f3e297640 1 -- 172.21.15.81:0/3629674218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3819d570 con 0x7f8f38106a80 2024-09-12T01:33:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.058+0000 7f8f3e297640 1 --2- 172.21.15.81:0/3629674218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f38106a80 0x7f8f3819ce90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000b970 tx=0x7f8f3000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.058+0000 7f8f2effd640 1 -- 172.21.15.81:0/3629674218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30019070 con 0x7f8f38106a80 2024-09-12T01:33:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.058+0000 7f8f2effd640 1 -- 172.21.15.81:0/3629674218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f30014440 con 0x7f8f38106a80 2024-09-12T01:33:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.058+0000 7f8f3fcfa640 1 -- 172.21.15.81:0/3629674218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3819d860 con 0x7f8f38106a80 2024-09-12T01:33:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.058+0000 7f8f2effd640 1 -- 172.21.15.81:0/3629674218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f300075d0 con 0x7f8f38106a80 2024-09-12T01:33:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.058+0000 7f8f3fcfa640 1 -- 172.21.15.81:0/3629674218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f381a5140 con 0x7f8f38106a80 2024-09-12T01:33:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.061+0000 7f8f420d3740 1 Processor -- start 2024-09-12T01:33:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.061+0000 7f8f2effd640 1 -- 172.21.15.81:0/3629674218 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f8f3001c070 con 0x7f8f38106a80 2024-09-12T01:33:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.061+0000 7f8f420d3740 1 -- start start 2024-09-12T01:33:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.061+0000 7f8f420d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b6762b40 0x5568b6761090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.061+0000 7f8f420d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b67615d0 0x5568b6761a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.061+0000 7f8f420d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 0x5568b676e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.061+0000 7f8f420d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5568b66c72f0 con 0x5568b676c370 2024-09-12T01:33:29.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.061+0000 7f8f420d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5568b666ecf0 con 0x5568b6762b40 2024-09-12T01:33:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.061+0000 7f8f420d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5568b66c32b0 con 0x5568b67615d0 2024-09-12T01:33:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.061+0000 7f8f3d295640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 0x5568b676e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.061+0000 7f8f3d295640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 0x5568b676e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50926/0 (socket says 172.21.15.81:50926) 2024-09-12T01:33:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.061+0000 7f8f3d295640 1 -- 172.21.15.81:0/1385595246 learned_addr learned my addr 172.21.15.81:0/1385595246 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f3da96640 1 --2- 172.21.15.81:0/1385595246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b67615d0 0x5568b6761a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f3d295640 1 --2- 172.21.15.81:0/1385595246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b6762b40 0x5568b6761090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f2effd640 1 --2- 172.21.15.81:0/3629674218 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8f240a2cf0 0x7f8f240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f3d295640 1 -- 172.21.15.81:0/1385595246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b67615d0 msgr2=0x5568b6761a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f3d295640 1 --2- 172.21.15.81:0/1385595246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b67615d0 0x5568b6761a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f3d295640 1 -- 172.21.15.81:0/1385595246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b6762b40 msgr2=0x5568b6761090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:29.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f3d295640 1 --2- 172.21.15.81:0/1385595246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b6762b40 0x5568b6761090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f3d295640 1 -- 172.21.15.81:0/1385595246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b66533a0 con 0x5568b676c370 2024-09-12T01:33:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f3e297640 1 --2- 172.21.15.81:0/3629674218 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8f240a2cf0 0x7f8f240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f3d295640 1 --2- 172.21.15.81:0/1385595246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 0x5568b676e760 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8f28005ec0 tx=0x7f8f28005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951aad0ec04717d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f2effd640 1 -- 172.21.15.81:0/3629674218 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f8f300ce8b0 con 0x7f8f38106a80 2024-09-12T01:33:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f23fff640 1 -- 172.21.15.81:0/1385595246 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f28035070 con 0x5568b676c370 2024-09-12T01:33:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f23fff640 1 -- 172.21.15.81:0/1385595246 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f28031800 con 0x5568b676c370 2024-09-12T01:33:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.062+0000 7f8f23fff640 1 -- 172.21.15.81:0/1385595246 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f280047a0 con 0x5568b676c370 2024-09-12T01:33:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.063+0000 7f8f420d3740 1 -- 172.21.15.81:0/1385595246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 msgr2=0x5568b676e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.063+0000 7f8f3e297640 1 --2- 172.21.15.81:0/3629674218 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8f240a2cf0 0x7f8f240a51b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f300cc630 tx=0x7f8f3000e040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.063+0000 7f8f420d3740 1 --2- 172.21.15.81:0/1385595246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 0x5568b676e760 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8f28005ec0 tx=0x7f8f28005fd0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.063+0000 7f8f420d3740 1 -- 172.21.15.81:0/1385595246 shutdown_connections 2024-09-12T01:33:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.063+0000 7f8f420d3740 1 --2- 172.21.15.81:0/1385595246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 0x5568b676e760 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.063+0000 7f8f420d3740 1 --2- 172.21.15.81:0/1385595246 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b67615d0 0x5568b6761a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.063+0000 7f8f420d3740 1 --2- 172.21.15.81:0/1385595246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b6762b40 0x5568b6761090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.063+0000 7f8f420d3740 1 -- 172.21.15.81:0/1385595246 >> 172.21.15.81:0/1385595246 conn(0x5568b672a310 msgr2=0x5568b675dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.063+0000 7f8f420d3740 1 -- 172.21.15.81:0/1385595246 shutdown_connections 2024-09-12T01:33:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.063+0000 7f8f420d3740 1 -- 172.21.15.81:0/1385595246 wait complete. 2024-09-12T01:33:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.063+0000 7f8f420d3740 1 -- start start 2024-09-12T01:33:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f420d3740 1 Processor -- start 2024-09-12T01:33:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f420d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b67615d0 0x5568b676bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f420d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b6762b40 0x5568b6769020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f420d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 0x5568b6769610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f420d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5568b676f010 con 0x5568b676c370 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f420d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5568b6682060 con 0x5568b6762b40 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f420d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5568b676f190 con 0x5568b67615d0 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f420d3740 10 client.0 _ll_register_callbacks cb 0x5568b63d58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f3d295640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 0x5568b6769610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f3d295640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 0x5568b6769610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50928/0 (socket says 172.21.15.81:50928) 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f3d295640 1 -- 172.21.15.81:0/3714466191 learned_addr learned my addr 172.21.15.81:0/3714466191 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f3d295640 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b67615d0 0x5568b676bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f3da96640 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b6762b40 0x5568b6769020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f3d295640 1 -- 172.21.15.81:0/3714466191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b67615d0 msgr2=0x5568b676bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f3d295640 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b67615d0 0x5568b676bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f3d295640 1 -- 172.21.15.81:0/3714466191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b6762b40 msgr2=0x5568b6769020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f3d295640 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b6762b40 0x5568b6769020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f3d295640 1 -- 172.21.15.81:0/3714466191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568b64383c0 con 0x5568b676c370 2024-09-12T01:33:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.064+0000 7f8f3da96640 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b6762b40 0x5568b6769020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f3d295640 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 0x5568b6769610 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8f2802a940 tx=0x7f8f280054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94dc965be8de2b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f217fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f217fa640 1 -- 172.21.15.81:0/3714466191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f28035070 con 0x5568b676c370 2024-09-12T01:33:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f420d3740 1 -- 172.21.15.81:0/3714466191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f28031800 con 0x5568b676c370 2024-09-12T01:33:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f217fa640 1 -- 172.21.15.81:0/3714466191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f8f28004260 con 0x5568b676c370 2024-09-12T01:33:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f217fa640 1 -- 172.21.15.81:0/3714466191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f28004460 con 0x5568b676c370 2024-09-12T01:33:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f420d3740 10 client.16641 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f420d3740 1 -- 172.21.15.81:0/3714466191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5568b677aab0 con 0x5568b676c370 2024-09-12T01:33:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f217fa640 1 -- 172.21.15.81:0/3714466191 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f28031800 con 0x5568b676c370 2024-09-12T01:33:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f217fa640 1 -- 172.21.15.81:0/3714466191 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f2803d720 con 0x5568b676c370 2024-09-12T01:33:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f420d3740 10 client.16641 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f420d3740 10 client.16641 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:33:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f420d3740 20 client.16641 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f420d3740 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5568b677be00 0x5568b677e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f420d3740 4 client.16641 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.065+0000 7f8f420d3740 1 -- 172.21.15.81:0/3714466191 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568b66d4860 con 0x5568b677be00 2024-09-12T01:33:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.066+0000 7f8f3da96640 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5568b677be00 0x5568b677e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.066+0000 7f8f3da96640 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5568b677be00 0x5568b677e1f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=762d4fff590a9fd2 server_cookie=b0b0f3769fbec62f in_seq=0 out_seq=0 2024-09-12T01:33:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.066+0000 7f8f217fa640 10 client.16641 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:33:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f217fa640 1 -- 172.21.15.81:0/3714466191 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568b66d4860 con 0x5568b677be00 2024-09-12T01:33:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f217fa640 10 client.16641 handle_command_reply: tid=0 2024-09-12T01:33:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f420d3740 1 client.16641 shutdown 2024-09-12T01:33:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f420d3740 1 -- 172.21.15.81:0/3714466191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 msgr2=0x5568b6769610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f420d3740 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 0x5568b6769610 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8f2802a940 tx=0x7f8f280054e0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f420d3740 1 -- 172.21.15.81:0/3714466191 shutdown_connections 2024-09-12T01:33:29.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f420d3740 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5568b677be00 0x5568b677e1f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f420d3740 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b676c370 0x5568b6769610 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f420d3740 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b6762b40 0x5568b6769020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f420d3740 1 --2- 172.21.15.81:0/3714466191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b67615d0 0x5568b676bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f217fa640 0 client.16641 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:33:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f420d3740 1 -- 172.21.15.81:0/3714466191 >> 172.21.15.81:0/3714466191 conn(0x5568b672a310 msgr2=0x5568b6763960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f420d3740 1 -- 172.21.15.81:0/3714466191 shutdown_connections 2024-09-12T01:33:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f420d3740 1 -- 172.21.15.81:0/3714466191 wait complete. 2024-09-12T01:33:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.067+0000 7f8f420d3740 20 client.16641 trim_cache size 0 max 16384 2024-09-12T01:33:29.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f420d3740 1 Processor -- start 2024-09-12T01:33:29.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f420d3740 1 -- start start 2024-09-12T01:33:29.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f420d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b67615d0 0x5568b676af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f420d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b6762b40 0x5568b6764120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f420d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b676c370 0x5568b6764660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f420d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f381ad830 con 0x5568b67615d0 2024-09-12T01:33:29.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f420d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8f381af370 con 0x5568b676c370 2024-09-12T01:33:29.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f420d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8f381adf00 con 0x5568b6762b40 2024-09-12T01:33:29.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f3d295640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b67615d0 0x5568b676af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f3d295640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b67615d0 0x5568b676af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50944/0 (socket says 172.21.15.81:50944) 2024-09-12T01:33:29.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f3d295640 1 -- 172.21.15.81:0/3123812019 learned_addr learned my addr 172.21.15.81:0/3123812019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:29.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f3da96640 1 --2- 172.21.15.81:0/3123812019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b6762b40 0x5568b6764120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f3d295640 1 -- 172.21.15.81:0/3123812019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b6762b40 msgr2=0x5568b6764120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:29.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.080+0000 7f8f3d295640 1 --2- 172.21.15.81:0/3123812019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b6762b40 0x5568b6764120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f3d295640 1 -- 172.21.15.81:0/3123812019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b676c370 msgr2=0x5568b6764660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:29.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f3d295640 1 --2- 172.21.15.81:0/3123812019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b676c370 0x5568b6764660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f3d295640 1 -- 172.21.15.81:0/3123812019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b676c0e0 con 0x5568b67615d0 2024-09-12T01:33:29.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f3d295640 1 --2- 172.21.15.81:0/3123812019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b67615d0 0x5568b676af90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8f2803db90 tx=0x7f8f28000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d44680b770d0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f237fe640 1 -- 172.21.15.81:0/3123812019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f28035040 con 0x5568b67615d0 2024-09-12T01:33:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f237fe640 1 -- 172.21.15.81:0/3123812019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f28005640 con 0x5568b67615d0 2024-09-12T01:33:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f237fe640 1 -- 172.21.15.81:0/3123812019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f28003850 con 0x5568b67615d0 2024-09-12T01:33:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f420d3740 1 -- 172.21.15.81:0/3123812019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b67615d0 msgr2=0x5568b676af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f420d3740 1 --2- 172.21.15.81:0/3123812019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b67615d0 0x5568b676af90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8f2803db90 tx=0x7f8f28000bc0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f420d3740 1 -- 172.21.15.81:0/3123812019 shutdown_connections 2024-09-12T01:33:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f420d3740 1 --2- 172.21.15.81:0/3123812019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b676c370 0x5568b6764660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f420d3740 1 --2- 172.21.15.81:0/3123812019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b6762b40 0x5568b6764120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f420d3740 1 --2- 172.21.15.81:0/3123812019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b67615d0 0x5568b676af90 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.081+0000 7f8f420d3740 1 -- 172.21.15.81:0/3123812019 >> 172.21.15.81:0/3123812019 conn(0x5568b672a310 msgr2=0x5568b676a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.082+0000 7f8f420d3740 1 -- 172.21.15.81:0/3123812019 shutdown_connections 2024-09-12T01:33:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.082+0000 7f8f420d3740 1 -- 172.21.15.81:0/3123812019 wait complete. 2024-09-12T01:33:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.082+0000 7f8f420d3740 1 -- start start 2024-09-12T01:33:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.082+0000 7f8f420d3740 1 Processor -- start 2024-09-12T01:33:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.082+0000 7f8f420d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b67615d0 0x5568b6774b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.082+0000 7f8f420d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b6762b40 0x5568b6765d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.082+0000 7f8f420d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b676c370 0x5568b6766250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.082+0000 7f8f420d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f381aeca0 con 0x5568b6762b40 2024-09-12T01:33:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.082+0000 7f8f420d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8f381ae5d0 con 0x5568b67615d0 2024-09-12T01:33:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.082+0000 7f8f420d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8f381ab810 con 0x5568b676c370 2024-09-12T01:33:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.082+0000 7f8f420d3740 10 client.0 _ll_register_callbacks cb 0x7f8f340093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f3da96640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b6762b40 0x5568b6765d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f3da96640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b6762b40 0x5568b6765d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50956/0 (socket says 172.21.15.81:50956) 2024-09-12T01:33:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f3da96640 1 -- 172.21.15.81:0/1630224470 learned_addr learned my addr 172.21.15.81:0/1630224470 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f3d295640 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b676c370 0x5568b6766250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f3d295640 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b67615d0 0x5568b6774b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f3da96640 1 -- 172.21.15.81:0/1630224470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b676c370 msgr2=0x5568b6766250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f3da96640 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b676c370 0x5568b6766250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f3da96640 1 -- 172.21.15.81:0/1630224470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b67615d0 msgr2=0x5568b6774b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f3da96640 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b67615d0 0x5568b6774b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f3da96640 1 -- 172.21.15.81:0/1630224470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568b6766a50 con 0x5568b6762b40 2024-09-12T01:33:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f3d295640 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b676c370 0x5568b6766250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f3da96640 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b6762b40 0x5568b6765d10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x5568b67688b0 tx=0x7f8f340092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9ea6fc895330fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f217fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f217fa640 1 -- 172.21.15.81:0/1630224470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f340155d0 con 0x5568b6762b40 2024-09-12T01:33:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f217fa640 1 -- 172.21.15.81:0/1630224470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f8f34015770 con 0x5568b6762b40 2024-09-12T01:33:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f420d3740 1 -- 172.21.15.81:0/1630224470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f28005640 con 0x5568b6762b40 2024-09-12T01:33:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f217fa640 1 -- 172.21.15.81:0/1630224470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f34015970 con 0x5568b6762b40 2024-09-12T01:33:29.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f420d3740 10 client.16647 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:29.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.083+0000 7f8f420d3740 1 -- 172.21.15.81:0/1630224470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5568b67e6760 con 0x5568b6762b40 2024-09-12T01:33:29.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.084+0000 7f8f217fa640 1 -- 172.21.15.81:0/1630224470 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f28005640 con 0x5568b6762b40 2024-09-12T01:33:29.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.084+0000 7f8f217fa640 1 -- 172.21.15.81:0/1630224470 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f3402e380 con 0x5568b6762b40 2024-09-12T01:33:29.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.084+0000 7f8f420d3740 10 client.16647 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:29.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.084+0000 7f8f420d3740 10 client.16647 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:33:29.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.084+0000 7f8f420d3740 20 client.16647 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:29.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.084+0000 7f8f420d3740 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5568b67e6ec0 0x5568b67e92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:29.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.084+0000 7f8f420d3740 4 client.16647 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:33:29.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.084+0000 7f8f420d3740 1 -- 172.21.15.81:0/1630224470 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5568b66ced70 con 0x5568b67e6ec0 2024-09-12T01:33:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.084+0000 7f8f3d295640 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5568b67e6ec0 0x5568b67e92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.084+0000 7f8f3d295640 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5568b67e6ec0 0x5568b67e92e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2a7c809e7dcef832 server_cookie=3a7d581b0c520819 in_seq=0 out_seq=0 2024-09-12T01:33:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.084+0000 7f8f217fa640 10 client.16647 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:33:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f217fa640 1 -- 172.21.15.81:0/1630224470 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5568b66ced70 con 0x5568b67e6ec0 2024-09-12T01:33:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f217fa640 10 client.16647 handle_command_reply: tid=0 2024-09-12T01:33:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f420d3740 1 client.16647 shutdown 2024-09-12T01:33:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f420d3740 1 -- 172.21.15.81:0/1630224470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b6762b40 msgr2=0x5568b6765d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f420d3740 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b6762b40 0x5568b6765d10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x5568b67688b0 tx=0x7f8f340092f0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f420d3740 1 -- 172.21.15.81:0/1630224470 shutdown_connections 2024-09-12T01:33:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f420d3740 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5568b67e6ec0 0x5568b67e92e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f420d3740 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5568b676c370 0x5568b6766250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f420d3740 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5568b6762b40 0x5568b6765d10 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f217fa640 0 client.16647 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:33:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f420d3740 1 --2- 172.21.15.81:0/1630224470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568b67615d0 0x5568b6774b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f420d3740 1 -- 172.21.15.81:0/1630224470 >> 172.21.15.81:0/1630224470 conn(0x5568b672a310 msgr2=0x5568b676b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f420d3740 1 -- 172.21.15.81:0/1630224470 shutdown_connections 2024-09-12T01:33:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f420d3740 1 -- 172.21.15.81:0/1630224470 wait complete. 2024-09-12T01:33:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f420d3740 20 client.16647 trim_cache size 0 max 16384 2024-09-12T01:33:29.093 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:33:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f3fcfa640 1 -- 172.21.15.81:0/3629674218 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8f240a2cf0 msgr2=0x7f8f240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f3fcfa640 1 --2- 172.21.15.81:0/3629674218 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8f240a2cf0 0x7f8f240a51b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f300cc630 tx=0x7f8f3000e040 comp rx=0 tx=0).stop 2024-09-12T01:33:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f3fcfa640 1 -- 172.21.15.81:0/3629674218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f38106a80 msgr2=0x7f8f3819ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.085+0000 7f8f3fcfa640 1 --2- 172.21.15.81:0/3629674218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f38106a80 0x7f8f3819ce90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000b970 tx=0x7f8f3000bd70 comp rx=0 tx=0).stop 2024-09-12T01:33:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.086+0000 7f8f3fcfa640 1 -- 172.21.15.81:0/3629674218 shutdown_connections 2024-09-12T01:33:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.086+0000 7f8f3fcfa640 1 --2- 172.21.15.81:0/3629674218 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8f240a2cf0 0x7f8f240a51b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.086+0000 7f8f3fcfa640 1 --2- 172.21.15.81:0/3629674218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f38106a80 0x7f8f3819ce90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.086+0000 7f8f3fcfa640 1 --2- 172.21.15.81:0/3629674218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f38101420 0x7f8f38198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.086+0000 7f8f3fcfa640 1 --2- 172.21.15.81:0/3629674218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8f38100a80 0x7f8f381985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.086+0000 7f8f3fcfa640 1 -- 172.21.15.81:0/3629674218 >> 172.21.15.81:0/3629674218 conn(0x7f8f380fc7a0 msgr2=0x7f8f38104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.086+0000 7f8f3fcfa640 1 -- 172.21.15.81:0/3629674218 shutdown_connections 2024-09-12T01:33:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:29.086+0000 7f8f3fcfa640 1 -- 172.21.15.81:0/3629674218 wait complete. 2024-09-12T01:33:29.239 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:29 smithi081 ceph-mon[30920]: pgmap v165: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:29.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:29 smithi100 ceph-mon[35275]: pgmap v165: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:29.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:29 smithi189 ceph-mon[35357]: pgmap v165: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:29.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:33:30.042 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.498+0000 7f5749441640 1 -- 172.21.15.81:0/3134905465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57441082a0 msgr2=0x7f574410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.498+0000 7f5749441640 1 --2- 172.21.15.81:0/3134905465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57441082a0 0x7f574410ec40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f573c009cd0 tx=0x7f573c02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.498+0000 7f5749441640 1 -- 172.21.15.81:0/3134905465 shutdown_connections 2024-09-12T01:33:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.498+0000 7f5749441640 1 --2- 172.21.15.81:0/3134905465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57441082a0 0x7f574410ec40 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.498+0000 7f5749441640 1 --2- 172.21.15.81:0/3134905465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57441036e0 0x7f5744107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.498+0000 7f5749441640 1 --2- 172.21.15.81:0/3134905465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5744102d30 0x7f5744103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.498+0000 7f5749441640 1 -- 172.21.15.81:0/3134905465 >> 172.21.15.81:0/3134905465 conn(0x7f57440fc7d0 msgr2=0x7f57440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.498+0000 7f5749441640 1 -- 172.21.15.81:0/3134905465 shutdown_connections 2024-09-12T01:33:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.498+0000 7f5749441640 1 -- 172.21.15.81:0/3134905465 wait complete. 2024-09-12T01:33:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.498+0000 7f5749441640 1 Processor -- start 2024-09-12T01:33:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.498+0000 7f5749441640 1 -- start start 2024-09-12T01:33:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.499+0000 7f5749441640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744102d30 0x7f5744198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.499+0000 7f5749441640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57441036e0 0x7f5744198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.499+0000 7f5749441640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57441082a0 0x7f574419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.499+0000 7f5749441640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f57441120a0 con 0x7f5744102d30 2024-09-12T01:33:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.499+0000 7f5749441640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5744111f20 con 0x7f57441082a0 2024-09-12T01:33:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.499+0000 7f5749441640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5744112220 con 0x7f57441036e0 2024-09-12T01:33:30.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.499+0000 7f57427fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57441036e0 0x7f5744198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.499+0000 7f57437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57441082a0 0x7f574419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.499+0000 7f57427fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57441036e0 0x7f5744198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.81:60358/0 (socket says 172.21.15.81:60358) 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.499+0000 7f57427fc640 1 -- 172.21.15.81:0/3003607061 learned_addr learned my addr 172.21.15.81:0/3003607061 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.499+0000 7f5742ffd640 1 --2- 172.21.15.81:0/3003607061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744102d30 0x7f5744198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.500+0000 7f57427fc640 1 -- 172.21.15.81:0/3003607061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57441082a0 msgr2=0x7f574419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.500+0000 7f57427fc640 1 --2- 172.21.15.81:0/3003607061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57441082a0 0x7f574419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.500+0000 7f57427fc640 1 -- 172.21.15.81:0/3003607061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744102d30 msgr2=0x7f5744198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.500+0000 7f57427fc640 1 --2- 172.21.15.81:0/3003607061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744102d30 0x7f5744198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.500+0000 7f57427fc640 1 -- 172.21.15.81:0/3003607061 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574419d4e0 con 0x7f57441036e0 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.500+0000 7f57427fc640 1 --2- 172.21.15.81:0/3003607061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57441036e0 0x7f5744198a70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f573800d740 tx=0x7f573800dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.500+0000 7f572bfff640 1 -- 172.21.15.81:0/3003607061 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738017070 con 0x7f57441036e0 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.500+0000 7f572bfff640 1 -- 172.21.15.81:0/3003607061 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f573800de50 con 0x7f57441036e0 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.500+0000 7f572bfff640 1 -- 172.21.15.81:0/3003607061 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573800f6b0 con 0x7f57441036e0 2024-09-12T01:33:30.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.500+0000 7f5749441640 1 -- 172.21.15.81:0/3003607061 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574419d7d0 con 0x7f57441036e0 2024-09-12T01:33:30.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.500+0000 7f5749441640 1 -- 172.21.15.81:0/3003607061 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57441a50b0 con 0x7f57441036e0 2024-09-12T01:33:30.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f572bfff640 1 -- 172.21.15.81:0/3003607061 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f573801a070 con 0x7f57441036e0 2024-09-12T01:33:30.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f574b81a740 1 Processor -- start 2024-09-12T01:33:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f574b81a740 1 -- start start 2024-09-12T01:33:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f574b81a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4adb40 0x559d2b4ac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f574b81a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4aca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f574b81a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 0x559d2b4bdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f574b81a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559d2b4122f0 con 0x559d2b4ac5d0 2024-09-12T01:33:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f574b81a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559d2b3b9cf0 con 0x559d2b4adb40 2024-09-12T01:33:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f574b81a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559d2b40e2b0 con 0x559d2b4bb780 2024-09-12T01:33:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f5742ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f5742ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50992/0 (socket says 172.21.15.81:50992) 2024-09-12T01:33:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f5742ffd640 1 -- 172.21.15.81:0/253877401 learned_addr learned my addr 172.21.15.81:0/253877401 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f57437fe640 1 --2- 172.21.15.81:0/253877401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4adb40 0x559d2b4ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f57427fc640 1 --2- 172.21.15.81:0/253877401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 0x559d2b4bdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f5742ffd640 1 -- 172.21.15.81:0/253877401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 msgr2=0x559d2b4bdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:30.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f5742ffd640 1 --2- 172.21.15.81:0/253877401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 0x559d2b4bdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f5742ffd640 1 -- 172.21.15.81:0/253877401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4adb40 msgr2=0x559d2b4ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:30.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f5742ffd640 1 --2- 172.21.15.81:0/253877401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4adb40 0x559d2b4ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.503+0000 7f5742ffd640 1 -- 172.21.15.81:0/253877401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2b39e3a0 con 0x559d2b4ac5d0 2024-09-12T01:33:30.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.504+0000 7f57427fc640 1 --2- 172.21.15.81:0/253877401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 0x559d2b4bdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:30.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.504+0000 7f57437fe640 1 --2- 172.21.15.81:0/253877401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4adb40 0x559d2b4ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:30.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.504+0000 7f572bfff640 1 --2- 172.21.15.81:0/3003607061 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f572c0a2cf0 0x7f572c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.504+0000 7f5742ffd640 1 --2- 172.21.15.81:0/253877401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4aca10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f573400bd10 tx=0x7f57340107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe40226c504f36a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:30.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.504+0000 7f57437fe640 1 --2- 172.21.15.81:0/3003607061 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f572c0a2cf0 0x7f572c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.504+0000 7f572bfff640 1 -- 172.21.15.81:0/3003607061 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f57380ced20 con 0x7f57441036e0 2024-09-12T01:33:30.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.504+0000 7f57297fa640 1 -- 172.21.15.81:0/253877401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734004030 con 0x559d2b4ac5d0 2024-09-12T01:33:30.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.504+0000 7f57297fa640 1 -- 172.21.15.81:0/253877401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57340041d0 con 0x559d2b4ac5d0 2024-09-12T01:33:30.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.504+0000 7f57297fa640 1 -- 172.21.15.81:0/253877401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734011820 con 0x559d2b4ac5d0 2024-09-12T01:33:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 -- 172.21.15.81:0/253877401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 msgr2=0x559d2b4aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 --2- 172.21.15.81:0/253877401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4aca10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f573400bd10 tx=0x7f57340107a0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f57437fe640 1 --2- 172.21.15.81:0/3003607061 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f572c0a2cf0 0x7f572c0a51b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f573c004ab0 tx=0x7f573c004a40 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 -- 172.21.15.81:0/253877401 shutdown_connections 2024-09-12T01:33:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 --2- 172.21.15.81:0/253877401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 0x559d2b4bdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 --2- 172.21.15.81:0/253877401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4aca10 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 --2- 172.21.15.81:0/253877401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4adb40 0x559d2b4ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 -- 172.21.15.81:0/253877401 >> 172.21.15.81:0/253877401 conn(0x559d2b475310 msgr2=0x559d2b4a8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 -- 172.21.15.81:0/253877401 shutdown_connections 2024-09-12T01:33:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 -- 172.21.15.81:0/253877401 wait complete. 2024-09-12T01:33:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 -- start start 2024-09-12T01:33:30.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 Processor -- start 2024-09-12T01:33:30.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4bb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4adb40 0x559d2b4b8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4bb780 0x559d2b4b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559d2b4be480 con 0x559d2b4ac5d0 2024-09-12T01:33:30.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.505+0000 7f574b81a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559d2b3cd060 con 0x559d2b4bb780 2024-09-12T01:33:30.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f574b81a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559d2b4be600 con 0x559d2b4adb40 2024-09-12T01:33:30.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f574b81a740 10 client.0 _ll_register_callbacks cb 0x559d2b1208c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:30.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f5742ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4bb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f5742ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4bb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50996/0 (socket says 172.21.15.81:50996) 2024-09-12T01:33:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f5742ffd640 1 -- 172.21.15.81:0/3918275964 learned_addr learned my addr 172.21.15.81:0/3918275964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f57427fc640 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4adb40 0x559d2b4b8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f57437fe640 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4bb780 0x559d2b4b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f5742ffd640 1 -- 172.21.15.81:0/3918275964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4adb40 msgr2=0x559d2b4b8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f5742ffd640 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4adb40 0x559d2b4b8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f5742ffd640 1 -- 172.21.15.81:0/3918275964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4bb780 msgr2=0x559d2b4b88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f5742ffd640 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4bb780 0x559d2b4b88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f5742ffd640 1 -- 172.21.15.81:0/3918275964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d2b1833c0 con 0x559d2b4ac5d0 2024-09-12T01:33:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f57437fe640 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4bb780 0x559d2b4b88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f5742ffd640 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4bb0d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5734010ca0 tx=0x7f573400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667a774bca73cfaf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f5726ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:30.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f5726ff5640 1 -- 172.21.15.81:0/3918275964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734029060 con 0x559d2b4ac5d0 2024-09-12T01:33:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f5726ff5640 1 -- 172.21.15.81:0/3918275964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f5734004440 con 0x559d2b4ac5d0 2024-09-12T01:33:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f574b81a740 1 -- 172.21.15.81:0/3918275964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57340041d0 con 0x559d2b4ac5d0 2024-09-12T01:33:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f5726ff5640 1 -- 172.21.15.81:0/3918275964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5734003800 con 0x559d2b4ac5d0 2024-09-12T01:33:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.506+0000 7f574b81a740 10 client.16659 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.507+0000 7f574b81a740 1 -- 172.21.15.81:0/3918275964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d2b4c9e00 con 0x559d2b4ac5d0 2024-09-12T01:33:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.507+0000 7f5726ff5640 1 -- 172.21.15.81:0/3918275964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57340041d0 con 0x559d2b4ac5d0 2024-09-12T01:33:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.507+0000 7f5726ff5640 1 -- 172.21.15.81:0/3918275964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5734004a30 con 0x559d2b4ac5d0 2024-09-12T01:33:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.507+0000 7f574b81a740 10 client.16659 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.507+0000 7f574b81a740 10 client.16659 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:33:30.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.507+0000 7f574b81a740 20 client.16659 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:30.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.507+0000 7f574b81a740 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x559d2b4cb260 0x559d2b4cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.507+0000 7f574b81a740 4 client.16659 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:30.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.507+0000 7f574b81a740 1 -- 172.21.15.81:0/3918275964 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d2b41f860 con 0x559d2b4cb260 2024-09-12T01:33:30.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.507+0000 7f57427fc640 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x559d2b4cb260 0x559d2b4cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.508+0000 7f5726ff5640 10 client.16659 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:33:30.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.508+0000 7f57427fc640 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x559d2b4cb260 0x559d2b4cd650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d32ed2fb0182d6aa server_cookie=693dda55129c4fc4 in_seq=0 out_seq=0 2024-09-12T01:33:30.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.508+0000 7f5726ff5640 1 -- 172.21.15.81:0/3918275964 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d2b41f860 con 0x559d2b4cb260 2024-09-12T01:33:30.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.508+0000 7f5726ff5640 10 client.16659 handle_command_reply: tid=0 2024-09-12T01:33:30.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.508+0000 7f574b81a740 1 client.16659 shutdown 2024-09-12T01:33:30.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.509+0000 7f574b81a740 1 -- 172.21.15.81:0/3918275964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 msgr2=0x559d2b4bb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:30.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.509+0000 7f574b81a740 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4bb0d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5734010ca0 tx=0x7f573400b8e0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.509+0000 7f574b81a740 1 -- 172.21.15.81:0/3918275964 shutdown_connections 2024-09-12T01:33:30.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.509+0000 7f574b81a740 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4bb780 0x559d2b4b88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.509+0000 7f574b81a740 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4adb40 0x559d2b4b8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.509+0000 7f574b81a740 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x559d2b4cb260 0x559d2b4cd650 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.509+0000 7f574b81a740 1 --2- 172.21.15.81:0/3918275964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4bb0d0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.509+0000 7f574b81a740 1 -- 172.21.15.81:0/3918275964 >> 172.21.15.81:0/3918275964 conn(0x559d2b475310 msgr2=0x559d2b4ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:30.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.509+0000 7f5726ff5640 0 client.16659 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:33:30.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.509+0000 7f574b81a740 1 -- 172.21.15.81:0/3918275964 shutdown_connections 2024-09-12T01:33:30.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.509+0000 7f574b81a740 1 -- 172.21.15.81:0/3918275964 wait complete. 2024-09-12T01:33:30.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.509+0000 7f574b81a740 20 client.16659 trim_cache size 0 max 16384 2024-09-12T01:33:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.521+0000 7f574b81a740 1 Processor -- start 2024-09-12T01:33:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.521+0000 7f574b81a740 1 -- start start 2024-09-12T01:33:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f574b81a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4ac5d0 0x559d2b4c7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f574b81a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4adb40 0x559d2b4b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f574b81a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 0x559d2b4d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f574b81a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f57441ab640 con 0x559d2b4adb40 2024-09-12T01:33:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f574b81a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f57441ad180 con 0x559d2b4ac5d0 2024-09-12T01:33:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f574b81a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f57441abd10 con 0x559d2b4bb780 2024-09-12T01:33:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f57427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4adb40 0x559d2b4b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f57427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4adb40 0x559d2b4b7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51010/0 (socket says 172.21.15.81:51010) 2024-09-12T01:33:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f57427fc640 1 -- 172.21.15.81:0/4210052472 learned_addr learned my addr 172.21.15.81:0/4210052472 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f5742ffd640 1 --2- 172.21.15.81:0/4210052472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4ac5d0 0x559d2b4c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f57427fc640 1 -- 172.21.15.81:0/4210052472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 msgr2=0x559d2b4d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f57427fc640 1 --2- 172.21.15.81:0/4210052472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 0x559d2b4d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f57427fc640 1 -- 172.21.15.81:0/4210052472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4ac5d0 msgr2=0x559d2b4c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f57427fc640 1 --2- 172.21.15.81:0/4210052472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4ac5d0 0x559d2b4c7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f57427fc640 1 -- 172.21.15.81:0/4210052472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2b4ac3e0 con 0x559d2b4adb40 2024-09-12T01:33:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f57427fc640 1 --2- 172.21.15.81:0/4210052472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4adb40 0x559d2b4b7230 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f57380cc500 tx=0x7f57380bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c80654e30f5358d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f5728ff9640 1 -- 172.21.15.81:0/4210052472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738021040 con 0x559d2b4adb40 2024-09-12T01:33:30.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f5728ff9640 1 -- 172.21.15.81:0/4210052472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f573809f620 con 0x559d2b4adb40 2024-09-12T01:33:30.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.522+0000 7f5728ff9640 1 -- 172.21.15.81:0/4210052472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57380cc8b0 con 0x559d2b4adb40 2024-09-12T01:33:30.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.523+0000 7f574b81a740 1 -- 172.21.15.81:0/4210052472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4adb40 msgr2=0x559d2b4b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:30.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.523+0000 7f574b81a740 1 --2- 172.21.15.81:0/4210052472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4adb40 0x559d2b4b7230 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f57380cc500 tx=0x7f57380bb040 comp rx=0 tx=0).stop 2024-09-12T01:33:30.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.523+0000 7f574b81a740 1 -- 172.21.15.81:0/4210052472 shutdown_connections 2024-09-12T01:33:30.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.523+0000 7f574b81a740 1 --2- 172.21.15.81:0/4210052472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 0x559d2b4d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.523+0000 7f574b81a740 1 --2- 172.21.15.81:0/4210052472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4adb40 0x559d2b4b7230 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.523+0000 7f574b81a740 1 --2- 172.21.15.81:0/4210052472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4ac5d0 0x559d2b4c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.523+0000 7f574b81a740 1 -- 172.21.15.81:0/4210052472 >> 172.21.15.81:0/4210052472 conn(0x559d2b475310 msgr2=0x559d2b4b6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:30.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.523+0000 7f574b81a740 1 -- 172.21.15.81:0/4210052472 shutdown_connections 2024-09-12T01:33:30.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.523+0000 7f574b81a740 1 -- 172.21.15.81:0/4210052472 wait complete. 2024-09-12T01:33:30.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.523+0000 7f574b81a740 1 -- start start 2024-09-12T01:33:30.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.523+0000 7f574b81a740 1 Processor -- start 2024-09-12T01:33:30.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f574b81a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f574b81a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4adb40 0x559d2b4c4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f574b81a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 0x559d2b4bf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f574b81a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f57441acab0 con 0x559d2b4ac5d0 2024-09-12T01:33:30.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f574b81a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f57441ac3e0 con 0x559d2b4adb40 2024-09-12T01:33:30.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f574b81a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f57441a9620 con 0x559d2b4bb780 2024-09-12T01:33:30.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f574b81a740 10 client.0 _ll_register_callbacks cb 0x7f573400bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:30.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f5742ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f57427fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4adb40 0x559d2b4c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f5742ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51024/0 (socket says 172.21.15.81:51024) 2024-09-12T01:33:30.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f5742ffd640 1 -- 172.21.15.81:0/2640280194 learned_addr learned my addr 172.21.15.81:0/2640280194 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:30.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f57437fe640 1 --2- 172.21.15.81:0/2640280194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 0x559d2b4bf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f5742ffd640 1 -- 172.21.15.81:0/2640280194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 msgr2=0x559d2b4bf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:30.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f5742ffd640 1 --2- 172.21.15.81:0/2640280194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 0x559d2b4bf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f5742ffd640 1 -- 172.21.15.81:0/2640280194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4adb40 msgr2=0x559d2b4c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:30.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f5742ffd640 1 --2- 172.21.15.81:0/2640280194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4adb40 0x559d2b4c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f5742ffd640 1 -- 172.21.15.81:0/2640280194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d2b4bf850 con 0x559d2b4ac5d0 2024-09-12T01:33:30.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f5742ffd640 1 --2- 172.21.15.81:0/2640280194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4c3bd0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f573400bc30 tx=0x7f5734005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8389e7eb178c9d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:30.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f5726ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f5726ff5640 1 -- 172.21.15.81:0/2640280194 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734029050 con 0x559d2b4ac5d0 2024-09-12T01:33:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f5726ff5640 1 -- 172.21.15.81:0/2640280194 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f5734005650 con 0x559d2b4ac5d0 2024-09-12T01:33:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.524+0000 7f574b81a740 1 -- 172.21.15.81:0/2640280194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f573809f620 con 0x559d2b4ac5d0 2024-09-12T01:33:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.525+0000 7f5726ff5640 1 -- 172.21.15.81:0/2640280194 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f573403e050 con 0x559d2b4ac5d0 2024-09-12T01:33:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.525+0000 7f574b81a740 10 client.16665 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.525+0000 7f574b81a740 1 -- 172.21.15.81:0/2640280194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d2b535820 con 0x559d2b4ac5d0 2024-09-12T01:33:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.525+0000 7f5726ff5640 1 -- 172.21.15.81:0/2640280194 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f573809f620 con 0x559d2b4ac5d0 2024-09-12T01:33:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.525+0000 7f5726ff5640 1 -- 172.21.15.81:0/2640280194 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5734036020 con 0x559d2b4ac5d0 2024-09-12T01:33:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.525+0000 7f574b81a740 10 client.16665 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.525+0000 7f574b81a740 10 client.16665 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:33:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.525+0000 7f574b81a740 20 client.16665 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:30.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.525+0000 7f574b81a740 1 --2- 172.21.15.81:0/2640280194 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x559d2b535ed0 0x559d2b5382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.525+0000 7f574b81a740 4 client.16665 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:33:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.525+0000 7f574b81a740 1 -- 172.21.15.81:0/2640280194 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d2b419d70 con 0x559d2b535ed0 2024-09-12T01:33:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.525+0000 7f57427fc640 1 --2- 172.21.15.81:0/2640280194 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x559d2b535ed0 0x559d2b5382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f57427fc640 1 --2- 172.21.15.81:0/2640280194 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x559d2b535ed0 0x559d2b5382f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=892456dcbcf64974 server_cookie=b832c673ba3d83aa in_seq=0 out_seq=0 2024-09-12T01:33:30.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f5726ff5640 10 client.16665 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:33:30.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f5726ff5640 1 -- 172.21.15.81:0/2640280194 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559d2b419d70 con 0x559d2b535ed0 2024-09-12T01:33:30.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f5726ff5640 10 client.16665 handle_command_reply: tid=0 2024-09-12T01:33:30.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f574b81a740 1 client.16665 shutdown 2024-09-12T01:33:30.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f574b81a740 1 -- 172.21.15.81:0/2640280194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 msgr2=0x559d2b4c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:30.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f574b81a740 1 --2- 172.21.15.81:0/2640280194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4c3bd0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f573400bc30 tx=0x7f5734005250 comp rx=0 tx=0).stop 2024-09-12T01:33:30.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f574b81a740 1 -- 172.21.15.81:0/2640280194 shutdown_connections 2024-09-12T01:33:30.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f574b81a740 1 --2- 172.21.15.81:0/2640280194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d2b4bb780 0x559d2b4bf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f574b81a740 1 --2- 172.21.15.81:0/2640280194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559d2b4adb40 0x559d2b4c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f574b81a740 1 --2- 172.21.15.81:0/2640280194 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x559d2b535ed0 0x559d2b5382f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f574b81a740 1 --2- 172.21.15.81:0/2640280194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559d2b4ac5d0 0x559d2b4c3bd0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f5726ff5640 0 client.16665 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:33:30.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f574b81a740 1 -- 172.21.15.81:0/2640280194 >> 172.21.15.81:0/2640280194 conn(0x559d2b475310 msgr2=0x559d2b4a7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:30.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f574b81a740 1 -- 172.21.15.81:0/2640280194 shutdown_connections 2024-09-12T01:33:30.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.526+0000 7f574b81a740 1 -- 172.21.15.81:0/2640280194 wait complete. 2024-09-12T01:33:30.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.527+0000 7f574b81a740 20 client.16665 trim_cache size 0 max 16384 2024-09-12T01:33:30.534 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:33:30.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.527+0000 7f5749441640 1 -- 172.21.15.81:0/3003607061 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f572c0a2cf0 msgr2=0x7f572c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:30.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.527+0000 7f5749441640 1 --2- 172.21.15.81:0/3003607061 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f572c0a2cf0 0x7f572c0a51b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f573c004ab0 tx=0x7f573c004a40 comp rx=0 tx=0).stop 2024-09-12T01:33:30.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.527+0000 7f5749441640 1 -- 172.21.15.81:0/3003607061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57441036e0 msgr2=0x7f5744198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:30.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.527+0000 7f5749441640 1 --2- 172.21.15.81:0/3003607061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57441036e0 0x7f5744198a70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f573800d740 tx=0x7f573800dc00 comp rx=0 tx=0).stop 2024-09-12T01:33:30.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.527+0000 7f5749441640 1 -- 172.21.15.81:0/3003607061 shutdown_connections 2024-09-12T01:33:30.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.527+0000 7f5749441640 1 --2- 172.21.15.81:0/3003607061 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f572c0a2cf0 0x7f572c0a51b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.527+0000 7f5749441640 1 --2- 172.21.15.81:0/3003607061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57441082a0 0x7f574419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.527+0000 7f5749441640 1 --2- 172.21.15.81:0/3003607061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57441036e0 0x7f5744198a70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.527+0000 7f5749441640 1 --2- 172.21.15.81:0/3003607061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744102d30 0x7f5744198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:30.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.527+0000 7f5749441640 1 -- 172.21.15.81:0/3003607061 >> 172.21.15.81:0/3003607061 conn(0x7f57440fc7d0 msgr2=0x7f5744106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:30.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.527+0000 7f5749441640 1 -- 172.21.15.81:0/3003607061 shutdown_connections 2024-09-12T01:33:30.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:30.527+0000 7f5749441640 1 -- 172.21.15.81:0/3003607061 wait complete. 2024-09-12T01:33:31.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:33:31.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:31 smithi081 ceph-mon[30920]: pgmap v166: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:33:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:31.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:31 smithi100 ceph-mon[35275]: pgmap v166: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:33:31.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:31 smithi189 ceph-mon[35357]: pgmap v166: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:33:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.946+0000 7fe038b0d640 1 -- 172.21.15.81:0/2979002708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe03410c170 msgr2=0x7fe03410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.946+0000 7fe038b0d640 1 --2- 172.21.15.81:0/2979002708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe03410c170 0x7fe03410e610 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009ca0 tx=0x7fe02c02a950 comp rx=0 tx=0).stop 2024-09-12T01:33:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.946+0000 7fe038b0d640 1 -- 172.21.15.81:0/2979002708 shutdown_connections 2024-09-12T01:33:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.946+0000 7fe038b0d640 1 --2- 172.21.15.81:0/2979002708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe03410c170 0x7fe03410e610 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.946+0000 7fe038b0d640 1 --2- 172.21.15.81:0/2979002708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe034103660 0x7fe03410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.946+0000 7fe038b0d640 1 --2- 172.21.15.81:0/2979002708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe034102d40 0x7fe034103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.946+0000 7fe038b0d640 1 -- 172.21.15.81:0/2979002708 >> 172.21.15.81:0/2979002708 conn(0x7fe0340fc7a0 msgr2=0x7fe0340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.946+0000 7fe038b0d640 1 -- 172.21.15.81:0/2979002708 shutdown_connections 2024-09-12T01:33:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.946+0000 7fe038b0d640 1 -- 172.21.15.81:0/2979002708 wait complete. 2024-09-12T01:33:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.947+0000 7fe038b0d640 1 Processor -- start 2024-09-12T01:33:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.947+0000 7fe038b0d640 1 -- start start 2024-09-12T01:33:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.947+0000 7fe038b0d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe034102d40 0x7fe034198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.947+0000 7fe038b0d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe034103660 0x7fe034198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.947+0000 7fe038b0d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe03410c170 0x7fe03419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.947+0000 7fe038b0d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe034112030 con 0x7fe034102d40 2024-09-12T01:33:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.947+0000 7fe038b0d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe034111eb0 con 0x7fe034103660 2024-09-12T01:33:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.947+0000 7fe038b0d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe0341121b0 con 0x7fe03410c170 2024-09-12T01:33:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe03259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe034102d40 0x7fe034198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe03259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe034102d40 0x7fe034198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51044/0 (socket says 172.21.15.81:51044) 2024-09-12T01:33:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe03259c640 1 -- 172.21.15.81:0/3670004958 learned_addr learned my addr 172.21.15.81:0/3670004958 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe031d9b640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe034103660 0x7fe034198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe032d9d640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe03410c170 0x7fe03419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe03259c640 1 -- 172.21.15.81:0/3670004958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe03410c170 msgr2=0x7fe03419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe03259c640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe03410c170 0x7fe03419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe03259c640 1 -- 172.21.15.81:0/3670004958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe034103660 msgr2=0x7fe034198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe03259c640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe034103660 0x7fe034198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe03259c640 1 -- 172.21.15.81:0/3670004958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03419d4e0 con 0x7fe034102d40 2024-09-12T01:33:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe031d9b640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe034103660 0x7fe034198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe03259c640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe034102d40 0x7fe034198530 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe02400b4a0 tx=0x7fe02400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe0237fe640 1 -- 172.21.15.81:0/3670004958 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024014070 con 0x7fe034102d40 2024-09-12T01:33:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe038b0d640 1 -- 172.21.15.81:0/3670004958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03419d7d0 con 0x7fe034102d40 2024-09-12T01:33:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe0237fe640 1 -- 172.21.15.81:0/3670004958 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe024010af0 con 0x7fe034102d40 2024-09-12T01:33:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe0237fe640 1 -- 172.21.15.81:0/3670004958 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024017d10 con 0x7fe034102d40 2024-09-12T01:33:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.948+0000 7fe038b0d640 1 -- 172.21.15.81:0/3670004958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0341a50b0 con 0x7fe034102d40 2024-09-12T01:33:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.950+0000 7fe0237fe640 1 -- 172.21.15.81:0/3670004958 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fe024017070 con 0x7fe034102d40 2024-09-12T01:33:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.951+0000 7fe03aee6740 1 Processor -- start 2024-09-12T01:33:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.951+0000 7fe03aee6740 1 -- start start 2024-09-12T01:33:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.951+0000 7fe03aee6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00ef7b40 0x555d00ef6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.951+0000 7fe03aee6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef65d0 0x555d00ef6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.951+0000 7fe03aee6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 0x555d00f03760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.951+0000 7fe03aee6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555d00e5c2f0 con 0x555d00f01370 2024-09-12T01:33:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.951+0000 7fe03aee6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555d00e03cf0 con 0x555d00ef65d0 2024-09-12T01:33:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.951+0000 7fe03aee6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555d00e582b0 con 0x555d00ef7b40 2024-09-12T01:33:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.951+0000 7fe0237fe640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe01c0a2cf0 0x7fe01c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.951+0000 7fe03259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef65d0 0x555d00ef6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.951+0000 7fe031d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 0x555d00f03760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.951+0000 7fe031d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 0x555d00f03760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51050/0 (socket says 172.21.15.81:51050) 2024-09-12T01:33:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.951+0000 7fe031d9b640 1 -- 172.21.15.81:0/2678334205 learned_addr learned my addr 172.21.15.81:0/2678334205 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.952+0000 7fe032d9d640 1 --2- 172.21.15.81:0/2678334205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00ef7b40 0x555d00ef6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.952+0000 7fe0237fe640 1 -- 172.21.15.81:0/3670004958 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe0240ce790 con 0x7fe034102d40 2024-09-12T01:33:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.952+0000 7fe032d9d640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe01c0a2cf0 0x7fe01c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.952+0000 7fe031d9b640 1 -- 172.21.15.81:0/2678334205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00ef7b40 msgr2=0x555d00ef6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.952+0000 7fe031d9b640 1 --2- 172.21.15.81:0/2678334205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00ef7b40 0x555d00ef6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.952+0000 7fe031d9b640 1 -- 172.21.15.81:0/2678334205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef65d0 msgr2=0x555d00ef6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.952+0000 7fe031d9b640 1 --2- 172.21.15.81:0/2678334205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef65d0 0x555d00ef6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.952+0000 7fe031d9b640 1 -- 172.21.15.81:0/2678334205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d00de83a0 con 0x555d00f01370 2024-09-12T01:33:31.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.952+0000 7fe031d9b640 1 --2- 172.21.15.81:0/2678334205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 0x555d00f03760 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe0280077c0 tx=0x7fe028007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252c4404659a5e95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.952+0000 7fe032d9d640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe01c0a2cf0 0x7fe01c0a51b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009a60 tx=0x7fe02c02a950 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.952+0000 7fe020ff9640 1 -- 172.21.15.81:0/2678334205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02800d950 con 0x555d00f01370 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.952+0000 7fe020ff9640 1 -- 172.21.15.81:0/2678334205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe028018070 con 0x555d00f01370 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.952+0000 7fe020ff9640 1 -- 172.21.15.81:0/2678334205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0280123e0 con 0x555d00f01370 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.953+0000 7fe03aee6740 1 -- 172.21.15.81:0/2678334205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 msgr2=0x555d00f03760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.953+0000 7fe03aee6740 1 --2- 172.21.15.81:0/2678334205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 0x555d00f03760 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe0280077c0 tx=0x7fe028007c80 comp rx=0 tx=0).stop 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.953+0000 7fe03aee6740 1 -- 172.21.15.81:0/2678334205 shutdown_connections 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.953+0000 7fe03aee6740 1 --2- 172.21.15.81:0/2678334205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 0x555d00f03760 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.953+0000 7fe03aee6740 1 --2- 172.21.15.81:0/2678334205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef65d0 0x555d00ef6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.953+0000 7fe03aee6740 1 --2- 172.21.15.81:0/2678334205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00ef7b40 0x555d00ef6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.953+0000 7fe03aee6740 1 -- 172.21.15.81:0/2678334205 >> 172.21.15.81:0/2678334205 conn(0x555d00ebf310 msgr2=0x555d00ef2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.953+0000 7fe03aee6740 1 -- 172.21.15.81:0/2678334205 shutdown_connections 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.953+0000 7fe03aee6740 1 -- 172.21.15.81:0/2678334205 wait complete. 2024-09-12T01:33:31.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.953+0000 7fe03aee6740 1 -- start start 2024-09-12T01:33:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03aee6740 1 Processor -- start 2024-09-12T01:33:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03aee6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 0x555d00f00ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03aee6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef7b40 0x555d00efdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03aee6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00f01370 0x555d00efe4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03aee6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555d00f04070 con 0x555d00ef65d0 2024-09-12T01:33:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03aee6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555d00e17060 con 0x555d00ef7b40 2024-09-12T01:33:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03aee6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555d00f041f0 con 0x555d00f01370 2024-09-12T01:33:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03aee6740 10 client.0 _ll_register_callbacks cb 0x555d00b6a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 0x555d00f00ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 0x555d00f00ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51062/0 (socket says 172.21.15.81:51062) 2024-09-12T01:33:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03259c640 1 -- 172.21.15.81:0/3443156384 learned_addr learned my addr 172.21.15.81:0/3443156384 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe032d9d640 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00f01370 0x555d00efe4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe031d9b640 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef7b40 0x555d00efdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03259c640 1 -- 172.21.15.81:0/3443156384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00f01370 msgr2=0x555d00efe4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:31.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03259c640 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00f01370 0x555d00efe4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03259c640 1 -- 172.21.15.81:0/3443156384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef7b40 msgr2=0x555d00efdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:31.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03259c640 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef7b40 0x555d00efdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03259c640 1 -- 172.21.15.81:0/3443156384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d00bcd3c0 con 0x555d00ef65d0 2024-09-12T01:33:31.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe031d9b640 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef7b40 0x555d00efdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:31.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe03259c640 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 0x555d00f00ce0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe02400be60 tx=0x7fe024069d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e7a56b749e2772 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:31.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.954+0000 7fe019ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:31.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe019ffb640 1 -- 172.21.15.81:0/3443156384 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02401e040 con 0x555d00ef65d0 2024-09-12T01:33:31.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe03aee6740 1 -- 172.21.15.81:0/3443156384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe028018070 con 0x555d00ef65d0 2024-09-12T01:33:31.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe019ffb640 1 -- 172.21.15.81:0/3443156384 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe0240cc190 con 0x555d00ef65d0 2024-09-12T01:33:31.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe019ffb640 1 -- 172.21.15.81:0/3443156384 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe02409b4f0 con 0x555d00ef65d0 2024-09-12T01:33:31.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe03aee6740 10 client.16677 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:31.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe03aee6740 1 -- 172.21.15.81:0/3443156384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555d00f0fad0 con 0x555d00ef65d0 2024-09-12T01:33:31.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe019ffb640 1 -- 172.21.15.81:0/3443156384 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe028018070 con 0x555d00ef65d0 2024-09-12T01:33:31.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe019ffb640 1 -- 172.21.15.81:0/3443156384 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe024097460 con 0x555d00ef65d0 2024-09-12T01:33:31.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe03aee6740 10 client.16677 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:31.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe03aee6740 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:31.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe03aee6740 20 client.16677 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:31.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe03aee6740 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555d00f113a0 0x555d00f13860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe03aee6740 4 client.16677 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:31.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.955+0000 7fe03aee6740 1 -- 172.21.15.81:0/3443156384 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d00e69860 con 0x555d00f113a0 2024-09-12T01:33:31.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.956+0000 7fe031d9b640 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555d00f113a0 0x555d00f13860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.956+0000 7fe031d9b640 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555d00f113a0 0x555d00f13860 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deecda97a4566d18 server_cookie=39bfaeee47ed5afa in_seq=0 out_seq=0 2024-09-12T01:33:31.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.956+0000 7fe019ffb640 10 client.16677 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe019ffb640 1 -- 172.21.15.81:0/3443156384 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d00e69860 con 0x555d00f113a0 2024-09-12T01:33:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe019ffb640 10 client.16677 handle_command_reply: tid=0 2024-09-12T01:33:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe03aee6740 1 client.16677 shutdown 2024-09-12T01:33:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe03aee6740 1 -- 172.21.15.81:0/3443156384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 msgr2=0x555d00f00ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe03aee6740 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 0x555d00f00ce0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe02400be60 tx=0x7fe024069d20 comp rx=0 tx=0).stop 2024-09-12T01:33:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe03aee6740 1 -- 172.21.15.81:0/3443156384 shutdown_connections 2024-09-12T01:33:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe03aee6740 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555d00f113a0 0x555d00f13860 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe03aee6740 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00f01370 0x555d00efe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe03aee6740 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef7b40 0x555d00efdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe03aee6740 1 --2- 172.21.15.81:0/3443156384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 0x555d00f00ce0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe03aee6740 1 -- 172.21.15.81:0/3443156384 >> 172.21.15.81:0/3443156384 conn(0x555d00ebf310 msgr2=0x555d00ef8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe019ffb640 0 client.16677 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:31.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe03aee6740 1 -- 172.21.15.81:0/3443156384 shutdown_connections 2024-09-12T01:33:31.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe03aee6740 1 -- 172.21.15.81:0/3443156384 wait complete. 2024-09-12T01:33:31.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.957+0000 7fe03aee6740 20 client.16677 trim_cache size 0 max 16384 2024-09-12T01:33:31.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.970+0000 7fe03aee6740 1 Processor -- start 2024-09-12T01:33:31.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.970+0000 7fe03aee6740 1 -- start start 2024-09-12T01:33:31.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.970+0000 7fe03aee6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef65d0 0x555d00efff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.970+0000 7fe03aee6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00ef7b40 0x555d00ef9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.970+0000 7fe03aee6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 0x555d00ef9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.970+0000 7fe03aee6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0341ad920 con 0x555d00f01370 2024-09-12T01:33:31.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.970+0000 7fe03aee6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0341af460 con 0x555d00ef65d0 2024-09-12T01:33:31.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.970+0000 7fe03aee6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe0341adff0 con 0x555d00ef7b40 2024-09-12T01:33:31.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.970+0000 7fe032d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 0x555d00ef9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.970+0000 7fe032d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 0x555d00ef9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51066/0 (socket says 172.21.15.81:51066) 2024-09-12T01:33:31.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.970+0000 7fe032d9d640 1 -- 172.21.15.81:0/1788728653 learned_addr learned my addr 172.21.15.81:0/1788728653 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:31.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.970+0000 7fe03259c640 1 --2- 172.21.15.81:0/1788728653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef65d0 0x555d00efff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.970+0000 7fe031d9b640 1 --2- 172.21.15.81:0/1788728653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00ef7b40 0x555d00ef9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe032d9d640 1 -- 172.21.15.81:0/1788728653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00ef7b40 msgr2=0x555d00ef9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:31.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe032d9d640 1 --2- 172.21.15.81:0/1788728653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00ef7b40 0x555d00ef9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe032d9d640 1 -- 172.21.15.81:0/1788728653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef65d0 msgr2=0x555d00efff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:31.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe032d9d640 1 --2- 172.21.15.81:0/1788728653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef65d0 0x555d00efff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe032d9d640 1 -- 172.21.15.81:0/1788728653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d00efe860 con 0x555d00f01370 2024-09-12T01:33:31.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe032d9d640 1 --2- 172.21.15.81:0/1788728653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 0x555d00ef9660 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe02c02fc90 tx=0x7fe02c042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2350c3de89f3c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:31.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe01bfff640 1 -- 172.21.15.81:0/1788728653 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c050070 con 0x555d00f01370 2024-09-12T01:33:31.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe01bfff640 1 -- 172.21.15.81:0/1788728653 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe02c004520 con 0x555d00f01370 2024-09-12T01:33:31.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe01bfff640 1 -- 172.21.15.81:0/1788728653 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c034040 con 0x555d00f01370 2024-09-12T01:33:31.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe03aee6740 1 -- 172.21.15.81:0/1788728653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 msgr2=0x555d00ef9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:31.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe03aee6740 1 --2- 172.21.15.81:0/1788728653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 0x555d00ef9660 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe02c02fc90 tx=0x7fe02c042000 comp rx=0 tx=0).stop 2024-09-12T01:33:31.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe03aee6740 1 -- 172.21.15.81:0/1788728653 shutdown_connections 2024-09-12T01:33:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe03aee6740 1 --2- 172.21.15.81:0/1788728653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00f01370 0x555d00ef9660 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe03aee6740 1 --2- 172.21.15.81:0/1788728653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00ef7b40 0x555d00ef9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe03aee6740 1 --2- 172.21.15.81:0/1788728653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef65d0 0x555d00efff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.971+0000 7fe03aee6740 1 -- 172.21.15.81:0/1788728653 >> 172.21.15.81:0/1788728653 conn(0x555d00ebf310 msgr2=0x555d00eff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03aee6740 1 -- 172.21.15.81:0/1788728653 shutdown_connections 2024-09-12T01:33:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03aee6740 1 -- 172.21.15.81:0/1788728653 wait complete. 2024-09-12T01:33:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03aee6740 1 -- start start 2024-09-12T01:33:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03aee6740 1 Processor -- start 2024-09-12T01:33:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03aee6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 0x555d00f09840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03aee6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef7b40 0x555d00f09d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03aee6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00f01370 0x555d00efab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03aee6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0341aed90 con 0x555d00ef65d0 2024-09-12T01:33:31.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03aee6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0341ae6c0 con 0x555d00ef7b40 2024-09-12T01:33:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03aee6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe0341ab900 con 0x555d00f01370 2024-09-12T01:33:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03aee6740 10 client.0 _ll_register_callbacks cb 0x7fe02400b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 0x555d00f09840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 0x555d00f09840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51074/0 (socket says 172.21.15.81:51074) 2024-09-12T01:33:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.972+0000 7fe03259c640 1 -- 172.21.15.81:0/1317480290 learned_addr learned my addr 172.21.15.81:0/1317480290 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe031d9b640 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef7b40 0x555d00f09d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe032d9d640 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00f01370 0x555d00efab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe03259c640 1 -- 172.21.15.81:0/1317480290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00f01370 msgr2=0x555d00efab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe03259c640 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00f01370 0x555d00efab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe03259c640 1 -- 172.21.15.81:0/1317480290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef7b40 msgr2=0x555d00f09d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:31.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe03259c640 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef7b40 0x555d00f09d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe03259c640 1 -- 172.21.15.81:0/1317480290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d00efb370 con 0x555d00ef65d0 2024-09-12T01:33:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe032d9d640 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00f01370 0x555d00efab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe031d9b640 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef7b40 0x555d00f09d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe03259c640 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 0x555d00f09840 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe02409aaf0 tx=0x7fe0240047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca4d1055e9d0ac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe019ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe019ffb640 1 -- 172.21.15.81:0/1317480290 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02401e040 con 0x555d00ef65d0 2024-09-12T01:33:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe019ffb640 1 -- 172.21.15.81:0/1317480290 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe02409a440 con 0x555d00ef65d0 2024-09-12T01:33:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe03aee6740 1 -- 172.21.15.81:0/1317480290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe02c004520 con 0x555d00ef65d0 2024-09-12T01:33:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe019ffb640 1 -- 172.21.15.81:0/1317480290 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe024010610 con 0x555d00ef65d0 2024-09-12T01:33:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe03aee6740 10 client.16683 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:31.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe03aee6740 1 -- 172.21.15.81:0/1317480290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555d00f7be10 con 0x555d00ef65d0 2024-09-12T01:33:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.973+0000 7fe019ffb640 1 -- 172.21.15.81:0/1317480290 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0240b8030 con 0x555d00ef65d0 2024-09-12T01:33:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe019ffb640 1 -- 172.21.15.81:0/1317480290 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe024061070 con 0x555d00ef65d0 2024-09-12T01:33:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe03aee6740 10 client.16683 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe03aee6740 10 client.16683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe03aee6740 20 client.16683 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe03aee6740 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555d00f7c530 0x555d00f7e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe03aee6740 4 client.16683 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:33:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe03aee6740 1 -- 172.21.15.81:0/1317480290 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555d00e63d70 con 0x555d00f7c530 2024-09-12T01:33:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe031d9b640 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555d00f7c530 0x555d00f7e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe019ffb640 10 client.16683 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe031d9b640 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555d00f7c530 0x555d00f7e920 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e85352adcb686f18 server_cookie=5db543e6d829d3a in_seq=0 out_seq=0 2024-09-12T01:33:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe019ffb640 1 -- 172.21.15.81:0/1317480290 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555d00e63d70 con 0x555d00f7c530 2024-09-12T01:33:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe019ffb640 10 client.16683 handle_command_reply: tid=0 2024-09-12T01:33:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe03aee6740 1 client.16683 shutdown 2024-09-12T01:33:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.974+0000 7fe03aee6740 1 -- 172.21.15.81:0/1317480290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 msgr2=0x555d00f09840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe03aee6740 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 0x555d00f09840 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe02409aaf0 tx=0x7fe0240047d0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe03aee6740 1 -- 172.21.15.81:0/1317480290 shutdown_connections 2024-09-12T01:33:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe03aee6740 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x555d00f7c530 0x555d00f7e920 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe03aee6740 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555d00f01370 0x555d00efab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe03aee6740 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d00ef7b40 0x555d00f09d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe019ffb640 0 client.16683 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe03aee6740 1 --2- 172.21.15.81:0/1317480290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555d00ef65d0 0x555d00f09840 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe03aee6740 1 -- 172.21.15.81:0/1317480290 >> 172.21.15.81:0/1317480290 conn(0x555d00ebf310 msgr2=0x555d00eff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe03aee6740 1 -- 172.21.15.81:0/1317480290 shutdown_connections 2024-09-12T01:33:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe03aee6740 1 -- 172.21.15.81:0/1317480290 wait complete. 2024-09-12T01:33:31.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe03aee6740 20 client.16683 trim_cache size 0 max 16384 2024-09-12T01:33:31.983 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:33:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe038b0d640 1 -- 172.21.15.81:0/3670004958 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe01c0a2cf0 msgr2=0x7fe01c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe038b0d640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe01c0a2cf0 0x7fe01c0a51b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009a60 tx=0x7fe02c02a950 comp rx=0 tx=0).stop 2024-09-12T01:33:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe038b0d640 1 -- 172.21.15.81:0/3670004958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe034102d40 msgr2=0x7fe034198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe038b0d640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe034102d40 0x7fe034198530 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe02400b4a0 tx=0x7fe02400b960 comp rx=0 tx=0).stop 2024-09-12T01:33:31.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe038b0d640 1 -- 172.21.15.81:0/3670004958 shutdown_connections 2024-09-12T01:33:31.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe038b0d640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe01c0a2cf0 0x7fe01c0a51b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe038b0d640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe03410c170 0x7fe03419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe038b0d640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe034103660 0x7fe034198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe038b0d640 1 --2- 172.21.15.81:0/3670004958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe034102d40 0x7fe034198530 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:31.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe038b0d640 1 -- 172.21.15.81:0/3670004958 >> 172.21.15.81:0/3670004958 conn(0x7fe0340fc7a0 msgr2=0x7fe0340fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:31.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe038b0d640 1 -- 172.21.15.81:0/3670004958 shutdown_connections 2024-09-12T01:33:31.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:31.975+0000 7fe038b0d640 1 -- 172.21.15.81:0/3670004958 wait complete. 2024-09-12T01:33:33.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:33 smithi081 ceph-mon[30920]: pgmap v167: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:33.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:33 smithi100 ceph-mon[35275]: pgmap v167: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:33.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:33 smithi189 ceph-mon[35357]: pgmap v167: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:33.746 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:33:33.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:33:34.006 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.494+0000 7fb2c8036640 1 -- 172.21.15.81:0/882322301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c0108290 msgr2=0x7fb2c010ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.494+0000 7fb2c8036640 1 --2- 172.21.15.81:0/882322301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c0108290 0x7fb2c010ec30 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009cd0 tx=0x7fb2b802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 -- 172.21.15.81:0/882322301 shutdown_connections 2024-09-12T01:33:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 --2- 172.21.15.81:0/882322301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c0108290 0x7fb2c010ec30 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 --2- 172.21.15.81:0/882322301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2c0103740 0x7fb2c0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 --2- 172.21.15.81:0/882322301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c0102d90 0x7fb2c0103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 -- 172.21.15.81:0/882322301 >> 172.21.15.81:0/882322301 conn(0x7fb2c00fc7d0 msgr2=0x7fb2c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 -- 172.21.15.81:0/882322301 shutdown_connections 2024-09-12T01:33:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 -- 172.21.15.81:0/882322301 wait complete. 2024-09-12T01:33:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 Processor -- start 2024-09-12T01:33:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 -- start start 2024-09-12T01:33:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c0102d90 0x7fb2c01009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2c0103740 0x7fb2c0100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c0108290 0x7fb2c0101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0112090 con 0x7fb2c0108290 2024-09-12T01:33:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0111f10 con 0x7fb2c0102d90 2024-09-12T01:33:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.495+0000 7fb2c8036640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0112210 con 0x7fb2c0103740 2024-09-12T01:33:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c65d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c0108290 0x7fb2c0101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c65d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c0108290 0x7fb2c0101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53938/0 (socket says 172.21.15.81:53938) 2024-09-12T01:33:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c65d3640 1 -- 172.21.15.81:0/34388300 learned_addr learned my addr 172.21.15.81:0/34388300 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c5dd2640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c0102d90 0x7fb2c01009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2c0103740 0x7fb2c0100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c65d3640 1 -- 172.21.15.81:0/34388300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2c0103740 msgr2=0x7fb2c0100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:34.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c65d3640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2c0103740 0x7fb2c0100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c65d3640 1 -- 172.21.15.81:0/34388300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c0102d90 msgr2=0x7fb2c01009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:34.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c65d3640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c0102d90 0x7fb2c01009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c65d3640 1 -- 172.21.15.81:0/34388300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c01a6a00 con 0x7fb2c0108290 2024-09-12T01:33:34.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2c0103740 0x7fb2c0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:34.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c65d3640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c0108290 0x7fb2c0101470 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8005cc0 tx=0x7fb2b8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:34.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2b6ffd640 1 -- 172.21.15.81:0/34388300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8004040 con 0x7fb2c0108290 2024-09-12T01:33:34.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2b6ffd640 1 -- 172.21.15.81:0/34388300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2b80046c0 con 0x7fb2c0108290 2024-09-12T01:33:34.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c8036640 1 -- 172.21.15.81:0/34388300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c01a6c90 con 0x7fb2c0108290 2024-09-12T01:33:34.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2b6ffd640 1 -- 172.21.15.81:0/34388300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8046480 con 0x7fb2c0108290 2024-09-12T01:33:34.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.496+0000 7fb2c8036640 1 -- 172.21.15.81:0/34388300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c01a71d0 con 0x7fb2c0108290 2024-09-12T01:33:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.498+0000 7fb2b6ffd640 1 -- 172.21.15.81:0/34388300 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb2b80305a0 con 0x7fb2c0108290 2024-09-12T01:33:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2ca40f740 1 Processor -- start 2024-09-12T01:33:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2ca40f740 1 -- start start 2024-09-12T01:33:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2ca40f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 0x561dba89ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2ca40f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89f480 0x561dba8a9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2ca40f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 0x561dba8ac130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2ca40f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561dba804280 con 0x561dba89eb60 2024-09-12T01:33:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2ca40f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561dba7abb10 con 0x561dba89f480 2024-09-12T01:33:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2ca40f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561dba800240 con 0x561dba8a9d40 2024-09-12T01:33:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2b6ffd640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb2ac0a2cf0 0x7fb2ac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2c55d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 0x561dba89ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2c55d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 0x561dba89ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53950/0 (socket says 172.21.15.81:53950) 2024-09-12T01:33:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2c55d1640 1 -- 172.21.15.81:0/3796119067 learned_addr learned my addr 172.21.15.81:0/3796119067 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2c65d3640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb2ac0a2cf0 0x7fb2ac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.499+0000 7fb2c5dd2640 1 --2- 172.21.15.81:0/3796119067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89f480 0x561dba8a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.500+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/3796119067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 0x561dba8ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.500+0000 7fb2b6ffd640 1 -- 172.21.15.81:0/34388300 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb2b802e030 con 0x7fb2c0108290 2024-09-12T01:33:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.500+0000 7fb2c55d1640 1 -- 172.21.15.81:0/3796119067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 msgr2=0x561dba8ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.500+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/3796119067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 0x561dba8ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.500+0000 7fb2c55d1640 1 -- 172.21.15.81:0/3796119067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89f480 msgr2=0x561dba8a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.500+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/3796119067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89f480 0x561dba8a9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.500+0000 7fb2c55d1640 1 -- 172.21.15.81:0/3796119067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dba7b81f0 con 0x561dba89eb60 2024-09-12T01:33:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.500+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/3796119067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 0x561dba89ef40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000bf90 tx=0x7fb2b000b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddca26438e074fa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.500+0000 7fb2c65d3640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb2ac0a2cf0 0x7fb2ac0a51b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80ee4c0 tx=0x7fb2b80dd040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.500+0000 7fb2abfff640 1 -- 172.21.15.81:0/3796119067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0012860 con 0x561dba89eb60 2024-09-12T01:33:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.500+0000 7fb2abfff640 1 -- 172.21.15.81:0/3796119067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2b0011440 con 0x561dba89eb60 2024-09-12T01:33:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.500+0000 7fb2abfff640 1 -- 172.21.15.81:0/3796119067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0010630 con 0x561dba89eb60 2024-09-12T01:33:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.501+0000 7fb2ca40f740 1 -- 172.21.15.81:0/3796119067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 msgr2=0x561dba89ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.501+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/3796119067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 0x561dba89ef40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000bf90 tx=0x7fb2b000b490 comp rx=0 tx=0).stop 2024-09-12T01:33:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.501+0000 7fb2ca40f740 1 -- 172.21.15.81:0/3796119067 shutdown_connections 2024-09-12T01:33:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.501+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/3796119067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 0x561dba8ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.501+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/3796119067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89f480 0x561dba8a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.501+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/3796119067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 0x561dba89ef40 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.501+0000 7fb2ca40f740 1 -- 172.21.15.81:0/3796119067 >> 172.21.15.81:0/3796119067 conn(0x561dba89b0f0 msgr2=0x561dba89b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.501+0000 7fb2ca40f740 1 -- 172.21.15.81:0/3796119067 shutdown_connections 2024-09-12T01:33:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.501+0000 7fb2ca40f740 1 -- 172.21.15.81:0/3796119067 wait complete. 2024-09-12T01:33:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.501+0000 7fb2ca40f740 1 -- start start 2024-09-12T01:33:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.501+0000 7fb2ca40f740 1 Processor -- start 2024-09-12T01:33:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2ca40f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 0x561dba8a6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2ca40f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89f480 0x561dba8a70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2ca40f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 0x561dba8a7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2ca40f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561dba8ac910 con 0x561dba89eb60 2024-09-12T01:33:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2ca40f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561dba7bef10 con 0x561dba89f480 2024-09-12T01:33:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2ca40f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561dba8aca90 con 0x561dba8a9d40 2024-09-12T01:33:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2c55d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 0x561dba8a6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2c55d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 0x561dba8a6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53964/0 (socket says 172.21.15.81:53964) 2024-09-12T01:33:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2c55d1640 1 -- 172.21.15.81:0/2952455321 learned_addr learned my addr 172.21.15.81:0/2952455321 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2ca40f740 10 client.0 _ll_register_callbacks cb 0x561dba787a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2c5dd2640 1 --2- 172.21.15.81:0/2952455321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89f480 0x561dba8a70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/2952455321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 0x561dba8a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2c55d1640 1 -- 172.21.15.81:0/2952455321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 msgr2=0x561dba8a7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/2952455321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 0x561dba8a7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2c55d1640 1 -- 172.21.15.81:0/2952455321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89f480 msgr2=0x561dba8a70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/2952455321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89f480 0x561dba8a70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2c55d1640 1 -- 172.21.15.81:0/2952455321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dba5756a0 con 0x561dba89eb60 2024-09-12T01:33:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/2952455321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 0x561dba8a6ba0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0005940 tx=0x7fb2b0011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cce2bf514191dbb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.502+0000 7fb2a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2a97fa640 1 -- 172.21.15.81:0/2952455321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0016030 con 0x561dba89eb60 2024-09-12T01:33:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2a97fa640 1 -- 172.21.15.81:0/2952455321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb2b0012a70 con 0x561dba89eb60 2024-09-12T01:33:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2ca40f740 1 -- 172.21.15.81:0/2952455321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2b0011440 con 0x561dba89eb60 2024-09-12T01:33:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2a97fa640 1 -- 172.21.15.81:0/2952455321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb2b0005e00 con 0x561dba89eb60 2024-09-12T01:33:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2ca40f740 10 client.16695 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2ca40f740 1 -- 172.21.15.81:0/2952455321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561dba8b84b0 con 0x561dba89eb60 2024-09-12T01:33:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2a97fa640 1 -- 172.21.15.81:0/2952455321 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2b0011440 con 0x561dba89eb60 2024-09-12T01:33:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2a97fa640 1 -- 172.21.15.81:0/2952455321 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb2b0035c00 con 0x561dba89eb60 2024-09-12T01:33:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2ca40f740 10 client.16695 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2ca40f740 10 client.16695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2ca40f740 20 client.16695 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/2952455321 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561dba8b9970 0x561dba8bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2ca40f740 4 client.16695 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:34.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.503+0000 7fb2ca40f740 1 -- 172.21.15.81:0/2952455321 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561dba8117f0 con 0x561dba8b9970 2024-09-12T01:33:34.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.504+0000 7fb2c5dd2640 1 --2- 172.21.15.81:0/2952455321 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561dba8b9970 0x561dba8bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.504+0000 7fb2a97fa640 10 client.16695 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:34.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.504+0000 7fb2c5dd2640 1 --2- 172.21.15.81:0/2952455321 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561dba8b9970 0x561dba8bbd60 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18a10e9c8908a9a7 server_cookie=70faa40dea68522e in_seq=0 out_seq=0 2024-09-12T01:33:34.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2a97fa640 1 -- 172.21.15.81:0/2952455321 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561dba8117f0 con 0x561dba8b9970 2024-09-12T01:33:34.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2a97fa640 10 client.16695 handle_command_reply: tid=0 2024-09-12T01:33:34.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2ca40f740 1 client.16695 shutdown 2024-09-12T01:33:34.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2ca40f740 1 -- 172.21.15.81:0/2952455321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 msgr2=0x561dba8a6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/2952455321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 0x561dba8a6ba0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0005940 tx=0x7fb2b0011f70 comp rx=0 tx=0).stop 2024-09-12T01:33:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2ca40f740 1 -- 172.21.15.81:0/2952455321 shutdown_connections 2024-09-12T01:33:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/2952455321 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561dba8b9970 0x561dba8bbd60 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/2952455321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 0x561dba8a7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/2952455321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89f480 0x561dba8a70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2a97fa640 0 client.16695 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/2952455321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89eb60 0x561dba8a6ba0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2ca40f740 1 -- 172.21.15.81:0/2952455321 >> 172.21.15.81:0/2952455321 conn(0x561dba89b0f0 msgr2=0x561dba8a0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2ca40f740 1 -- 172.21.15.81:0/2952455321 shutdown_connections 2024-09-12T01:33:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2ca40f740 1 -- 172.21.15.81:0/2952455321 wait complete. 2024-09-12T01:33:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.505+0000 7fb2ca40f740 20 client.16695 trim_cache size 0 max 16384 2024-09-12T01:33:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.522+0000 7fb2ca40f740 1 Processor -- start 2024-09-12T01:33:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.522+0000 7fb2ca40f740 1 -- start start 2024-09-12T01:33:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.522+0000 7fb2ca40f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89eb60 0x561dba8a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.522+0000 7fb2ca40f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89f480 0x561dba8c1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.522+0000 7fb2ca40f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 0x561dba8c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.522+0000 7fb2ca40f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01af9b0 con 0x561dba89f480 2024-09-12T01:33:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.522+0000 7fb2ca40f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01b14f0 con 0x561dba89eb60 2024-09-12T01:33:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.522+0000 7fb2ca40f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01b0080 con 0x561dba8a9d40 2024-09-12T01:33:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2c5dd2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89f480 0x561dba8c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2c5dd2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89f480 0x561dba8c1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53968/0 (socket says 172.21.15.81:53968) 2024-09-12T01:33:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2c5dd2640 1 -- 172.21.15.81:0/1266775404 learned_addr learned my addr 172.21.15.81:0/1266775404 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/1266775404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89eb60 0x561dba8a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/1266775404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 0x561dba8c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2c5dd2640 1 -- 172.21.15.81:0/1266775404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 msgr2=0x561dba8c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2c5dd2640 1 --2- 172.21.15.81:0/1266775404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 0x561dba8c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2c5dd2640 1 -- 172.21.15.81:0/1266775404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89eb60 msgr2=0x561dba8a8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2c5dd2640 1 --2- 172.21.15.81:0/1266775404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89eb60 0x561dba8a8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2c5dd2640 1 -- 172.21.15.81:0/1266775404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dba89f2b0 con 0x561dba89f480 2024-09-12T01:33:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/1266775404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 0x561dba8c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2c5dd2640 1 --2- 172.21.15.81:0/1266775404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89f480 0x561dba8c1330 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc000c00 tx=0x7fb2bc00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a794ca4794a1aec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2ab7fe640 1 -- 172.21.15.81:0/1266775404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc003de0 con 0x561dba89f480 2024-09-12T01:33:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2ab7fe640 1 -- 172.21.15.81:0/1266775404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2bc026920 con 0x561dba89f480 2024-09-12T01:33:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.523+0000 7fb2ab7fe640 1 -- 172.21.15.81:0/1266775404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0119c0 con 0x561dba89f480 2024-09-12T01:33:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.524+0000 7fb2ca40f740 1 -- 172.21.15.81:0/1266775404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89f480 msgr2=0x561dba8c1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.524+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/1266775404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89f480 0x561dba8c1330 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc000c00 tx=0x7fb2bc00b390 comp rx=0 tx=0).stop 2024-09-12T01:33:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.524+0000 7fb2ca40f740 1 -- 172.21.15.81:0/1266775404 shutdown_connections 2024-09-12T01:33:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.524+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/1266775404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba8a9d40 0x561dba8c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.524+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/1266775404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba89f480 0x561dba8c1330 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.524+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/1266775404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89eb60 0x561dba8a8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.524+0000 7fb2ca40f740 1 -- 172.21.15.81:0/1266775404 >> 172.21.15.81:0/1266775404 conn(0x561dba89b0f0 msgr2=0x561dba8a82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.524+0000 7fb2ca40f740 1 -- 172.21.15.81:0/1266775404 shutdown_connections 2024-09-12T01:33:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.524+0000 7fb2ca40f740 1 -- 172.21.15.81:0/1266775404 wait complete. 2024-09-12T01:33:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.524+0000 7fb2ca40f740 1 -- start start 2024-09-12T01:33:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.524+0000 7fb2ca40f740 1 Processor -- start 2024-09-12T01:33:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2ca40f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89eb60 0x561dba8a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2ca40f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba89f480 0x561dba8a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2ca40f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba8a9d40 0x561dba8a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2ca40f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01b0e20 con 0x561dba8a9d40 2024-09-12T01:33:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2ca40f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01b0750 con 0x561dba89eb60 2024-09-12T01:33:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2ca40f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01ad9b0 con 0x561dba89f480 2024-09-12T01:33:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2ca40f740 10 client.0 _ll_register_callbacks cb 0x7fb2bc00b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2c55d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba8a9d40 0x561dba8a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2c55d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba8a9d40 0x561dba8a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53984/0 (socket says 172.21.15.81:53984) 2024-09-12T01:33:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2c55d1640 1 -- 172.21.15.81:0/3194844676 learned_addr learned my addr 172.21.15.81:0/3194844676 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/3194844676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89eb60 0x561dba8a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2c5dd2640 1 --2- 172.21.15.81:0/3194844676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba89f480 0x561dba8a41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2c55d1640 1 -- 172.21.15.81:0/3194844676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba89f480 msgr2=0x561dba8a41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/3194844676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba89f480 0x561dba8a41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2c55d1640 1 -- 172.21.15.81:0/3194844676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89eb60 msgr2=0x561dba8a3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/3194844676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89eb60 0x561dba8a3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2c55d1640 1 -- 172.21.15.81:0/3194844676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dba923380 con 0x561dba8a9d40 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2c55d1640 1 --2- 172.21.15.81:0/3194844676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba8a9d40 0x561dba8a4710 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0005c30 tx=0x7fb2b0011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6537acecbf96b1ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.525+0000 7fb2a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2a97fa640 1 -- 172.21.15.81:0/3194844676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0016070 con 0x561dba8a9d40 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2a97fa640 1 -- 172.21.15.81:0/3194844676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fb2b000bde0 con 0x561dba8a9d40 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2ca40f740 1 -- 172.21.15.81:0/3194844676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2bc026920 con 0x561dba8a9d40 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2a97fa640 1 -- 172.21.15.81:0/3194844676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb2b003b040 con 0x561dba8a9d40 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2ca40f740 10 client.16701 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2ca40f740 1 -- 172.21.15.81:0/3194844676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561dba924610 con 0x561dba8a9d40 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2a97fa640 1 -- 172.21.15.81:0/3194844676 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2bc026920 con 0x561dba8a9d40 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2a97fa640 1 -- 172.21.15.81:0/3194844676 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb2b0041030 con 0x561dba8a9d40 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2ca40f740 10 client.16701 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2ca40f740 10 client.16701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2ca40f740 20 client.16701 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/3194844676 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561dba924cd0 0x561dba9270f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2ca40f740 4 client.16701 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.526+0000 7fb2ca40f740 1 -- 172.21.15.81:0/3194844676 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561dba80bd00 con 0x561dba924cd0 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.527+0000 7fb2c5dd2640 1 --2- 172.21.15.81:0/3194844676 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561dba924cd0 0x561dba9270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.527+0000 7fb2a97fa640 10 client.16701 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.527+0000 7fb2c5dd2640 1 --2- 172.21.15.81:0/3194844676 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561dba924cd0 0x561dba9270f0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=983de5d62e839b36 server_cookie=b7d9c1eb133018b4 in_seq=0 out_seq=0 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2a97fa640 1 -- 172.21.15.81:0/3194844676 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561dba80bd00 con 0x561dba924cd0 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2a97fa640 10 client.16701 handle_command_reply: tid=0 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2ca40f740 1 client.16701 shutdown 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2ca40f740 1 -- 172.21.15.81:0/3194844676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba8a9d40 msgr2=0x561dba8a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/3194844676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba8a9d40 0x561dba8a4710 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0005c30 tx=0x7fb2b0011900 comp rx=0 tx=0).stop 2024-09-12T01:33:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2ca40f740 1 -- 172.21.15.81:0/3194844676 shutdown_connections 2024-09-12T01:33:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/3194844676 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561dba924cd0 0x561dba9270f0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/3194844676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561dba8a9d40 0x561dba8a4710 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/3194844676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561dba89f480 0x561dba8a41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2ca40f740 1 --2- 172.21.15.81:0/3194844676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561dba89eb60 0x561dba8a3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2a97fa640 0 client.16701 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2ca40f740 1 -- 172.21.15.81:0/3194844676 >> 172.21.15.81:0/3194844676 conn(0x561dba89b0f0 msgr2=0x561dba8a8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2ca40f740 1 -- 172.21.15.81:0/3194844676 shutdown_connections 2024-09-12T01:33:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2ca40f740 1 -- 172.21.15.81:0/3194844676 wait complete. 2024-09-12T01:33:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.528+0000 7fb2ca40f740 20 client.16701 trim_cache size 0 max 16384 2024-09-12T01:33:34.543 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:33:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:33:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "38aa20f1-6c61-4141-93d3-eba454d9b742", 2024-09-12T01:33:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:33:34.543 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:33:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.529+0000 7fb2c8036640 1 -- 172.21.15.81:0/34388300 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb2ac0a2cf0 msgr2=0x7fb2ac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.529+0000 7fb2c8036640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb2ac0a2cf0 0x7fb2ac0a51b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80ee4c0 tx=0x7fb2b80dd040 comp rx=0 tx=0).stop 2024-09-12T01:33:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.529+0000 7fb2c8036640 1 -- 172.21.15.81:0/34388300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c0108290 msgr2=0x7fb2c0101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.529+0000 7fb2c8036640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c0108290 0x7fb2c0101470 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8005cc0 tx=0x7fb2b8003970 comp rx=0 tx=0).stop 2024-09-12T01:33:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.529+0000 7fb2c8036640 1 -- 172.21.15.81:0/34388300 shutdown_connections 2024-09-12T01:33:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.529+0000 7fb2c8036640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb2ac0a2cf0 0x7fb2ac0a51b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.529+0000 7fb2c8036640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2c0108290 0x7fb2c0101470 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.529+0000 7fb2c8036640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2c0103740 0x7fb2c0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.529+0000 7fb2c8036640 1 --2- 172.21.15.81:0/34388300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c0102d90 0x7fb2c01009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.529+0000 7fb2c8036640 1 -- 172.21.15.81:0/34388300 >> 172.21.15.81:0/34388300 conn(0x7fb2c00fc7d0 msgr2=0x7fb2c0106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.529+0000 7fb2c8036640 1 -- 172.21.15.81:0/34388300 shutdown_connections 2024-09-12T01:33:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:34.529+0000 7fb2c8036640 1 -- 172.21.15.81:0/34388300 wait complete. 2024-09-12T01:33:35.285 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:33:35.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:35 smithi081 ceph-mon[30920]: pgmap v168: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:35.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:35 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:33:35.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:35 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:33:35.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:35 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:33:35.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:35 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:33:35.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:35 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:33:35.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:35 smithi100 ceph-mon[35275]: pgmap v168: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:35.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:35 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:33:35.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:35 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:33:35.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:35 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:33:35.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:35 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:33:35.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:35 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:33:35.531 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:35.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:35 smithi189 ceph-mon[35357]: pgmap v168: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:35.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:35 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:33:35.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:35 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:33:35.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:35 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:33:35.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:35 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:33:35.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:35 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:33:36.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.009+0000 7f3005a47640 1 -- 172.21.15.81:0/3188797141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3000106f10 msgr2=0x7f300010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:36.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.009+0000 7f3005a47640 1 --2- 172.21.15.81:0/3188797141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3000106f10 0x7f300010ea90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009ca0 tx=0x7f2ff802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.009+0000 7f3005a47640 1 -- 172.21.15.81:0/3188797141 shutdown_connections 2024-09-12T01:33:36.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.009+0000 7f3005a47640 1 --2- 172.21.15.81:0/3188797141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3000106f10 0x7f300010ea90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.009+0000 7f3005a47640 1 --2- 172.21.15.81:0/3188797141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3000102790 0x7f30001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.009+0000 7f3005a47640 1 --2- 172.21.15.81:0/3188797141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3000101de0 0x7f30001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.009+0000 7f3005a47640 1 -- 172.21.15.81:0/3188797141 >> 172.21.15.81:0/3188797141 conn(0x7f30000fd8c0 msgr2=0x7f30000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:36.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.009+0000 7f3005a47640 1 -- 172.21.15.81:0/3188797141 shutdown_connections 2024-09-12T01:33:36.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.009+0000 7f3005a47640 1 -- 172.21.15.81:0/3188797141 wait complete. 2024-09-12T01:33:36.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f3005a47640 1 Processor -- start 2024-09-12T01:33:36.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f3005a47640 1 -- start start 2024-09-12T01:33:36.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f3005a47640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3000101de0 0x7f300019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f3005a47640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3000102790 0x7f300019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f3005a47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3000106f10 0x7f300019ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f3005a47640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3000111f70 con 0x7f3000106f10 2024-09-12T01:33:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f3005a47640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3000111df0 con 0x7f3000101de0 2024-09-12T01:33:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f3005a47640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30001120f0 con 0x7f3000102790 2024-09-12T01:33:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f2fff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3000106f10 0x7f300019ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f2fff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3000106f10 0x7f300019ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53996/0 (socket says 172.21.15.81:53996) 2024-09-12T01:33:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f2fff7fe640 1 -- 172.21.15.81:0/155997365 learned_addr learned my addr 172.21.15.81:0/155997365 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f2ffeffd640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3000101de0 0x7f300019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f2ffe7fc640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3000102790 0x7f300019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f2fff7fe640 1 -- 172.21.15.81:0/155997365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3000102790 msgr2=0x7f300019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f2fff7fe640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3000102790 0x7f300019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f2fff7fe640 1 -- 172.21.15.81:0/155997365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3000101de0 msgr2=0x7f300019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f2fff7fe640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3000101de0 0x7f300019a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.010+0000 7f2fff7fe640 1 -- 172.21.15.81:0/155997365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300019f550 con 0x7f3000106f10 2024-09-12T01:33:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.011+0000 7f2fff7fe640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3000106f10 0x7f300019ee70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8031a20 tx=0x7f2ff8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.011+0000 7f3004a45640 1 -- 172.21.15.81:0/155997365 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8003b70 con 0x7f3000106f10 2024-09-12T01:33:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.011+0000 7f3004a45640 1 -- 172.21.15.81:0/155997365 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff8003d10 con 0x7f3000106f10 2024-09-12T01:33:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.011+0000 7f3005a47640 1 -- 172.21.15.81:0/155997365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300019f7e0 con 0x7f3000106f10 2024-09-12T01:33:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.011+0000 7f3004a45640 1 -- 172.21.15.81:0/155997365 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff802fc80 con 0x7f3000106f10 2024-09-12T01:33:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.011+0000 7f3005a47640 1 -- 172.21.15.81:0/155997365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30001a7120 con 0x7f3000106f10 2024-09-12T01:33:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.013+0000 7f3004a45640 1 -- 172.21.15.81:0/155997365 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f2ff80046a0 con 0x7f3000106f10 2024-09-12T01:33:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.013+0000 7f3007e20740 1 Processor -- start 2024-09-12T01:33:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.013+0000 7f3007e20740 1 -- start start 2024-09-12T01:33:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.013+0000 7f3007e20740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db64a0 0x561163db6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.013+0000 7f3007e20740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 0x561163dc1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.013+0000 7f3007e20740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163dc1680 0x561163dc3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.013+0000 7f3007e20740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561163d1c2e0 con 0x561163db6dc0 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f3007e20740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561163cc3ce0 con 0x561163db64a0 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f3007e20740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561163d182a0 con 0x561163dc1680 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2ffeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 0x561163dc1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2ffeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 0x561163dc1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53998/0 (socket says 172.21.15.81:53998) 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2ffeffd640 1 -- 172.21.15.81:0/4100751896 learned_addr learned my addr 172.21.15.81:0/4100751896 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2ffe7fc640 1 --2- 172.21.15.81:0/4100751896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163dc1680 0x561163dc3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2ffe7fc640 1 --2- 172.21.15.81:0/4100751896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db64a0 0x561163db6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2ffeffd640 1 -- 172.21.15.81:0/4100751896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163dc1680 msgr2=0x561163dc3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2ffeffd640 1 --2- 172.21.15.81:0/4100751896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163dc1680 0x561163dc3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2ffeffd640 1 -- 172.21.15.81:0/4100751896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db64a0 msgr2=0x561163db6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2ffeffd640 1 --2- 172.21.15.81:0/4100751896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db64a0 0x561163db6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2ffeffd640 1 -- 172.21.15.81:0/4100751896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561163ca8440 con 0x561163db6dc0 2024-09-12T01:33:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2ffe7fc640 1 --2- 172.21.15.81:0/4100751896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db64a0 0x561163db6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f3004a45640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2fe80a2d70 0x7f2fe80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2ffeffd640 1 --2- 172.21.15.81:0/4100751896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 0x561163dc1140 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000b760 tx=0x7f2ff000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d24a3d2ac8af61 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2ffe7fc640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2fe80a2d70 0x7f2fe80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f3004a45640 1 -- 172.21.15.81:0/155997365 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2ff80f0460 con 0x7f3000106f10 2024-09-12T01:33:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2fe5ffb640 1 -- 172.21.15.81:0/4100751896 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0003dd0 con 0x561163db6dc0 2024-09-12T01:33:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2fe5ffb640 1 -- 172.21.15.81:0/4100751896 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff0015070 con 0x561163db6dc0 2024-09-12T01:33:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.014+0000 7f2fe5ffb640 1 -- 172.21.15.81:0/4100751896 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0011440 con 0x561163db6dc0 2024-09-12T01:33:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.015+0000 7f3007e20740 1 -- 172.21.15.81:0/4100751896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 msgr2=0x561163dc1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.015+0000 7f2ffe7fc640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2fe80a2d70 0x7f2fe80a5230 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x561163db3db0 tx=0x7f2ff400a2d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.015+0000 7f3007e20740 1 --2- 172.21.15.81:0/4100751896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 0x561163dc1140 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000b760 tx=0x7f2ff000bc20 comp rx=0 tx=0).stop 2024-09-12T01:33:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.015+0000 7f3007e20740 1 -- 172.21.15.81:0/4100751896 shutdown_connections 2024-09-12T01:33:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.015+0000 7f3007e20740 1 --2- 172.21.15.81:0/4100751896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163dc1680 0x561163dc3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.015+0000 7f3007e20740 1 --2- 172.21.15.81:0/4100751896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 0x561163dc1140 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.015+0000 7f3007e20740 1 --2- 172.21.15.81:0/4100751896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db64a0 0x561163db6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.015+0000 7f3007e20740 1 -- 172.21.15.81:0/4100751896 >> 172.21.15.81:0/4100751896 conn(0x561163db2a30 msgr2=0x561163db2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.015+0000 7f3007e20740 1 -- 172.21.15.81:0/4100751896 shutdown_connections 2024-09-12T01:33:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.015+0000 7f3007e20740 1 -- 172.21.15.81:0/4100751896 wait complete. 2024-09-12T01:33:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.015+0000 7f3007e20740 1 -- start start 2024-09-12T01:33:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f3007e20740 1 Processor -- start 2024-09-12T01:33:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f3007e20740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db64a0 0x561163dc0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f3007e20740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db6dc0 0x561163dbe220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f3007e20740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163dc1680 0x561163dbe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f3007e20740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561163dc4250 con 0x561163dc1680 2024-09-12T01:33:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f3007e20740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561163cd7050 con 0x561163db64a0 2024-09-12T01:33:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f3007e20740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561163dc43d0 con 0x561163db6dc0 2024-09-12T01:33:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f3007e20740 10 client.0 _ll_register_callbacks cb 0x561163d17160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f2fff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163dc1680 0x561163dbe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f2fff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163dc1680 0x561163dbe760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54002/0 (socket says 172.21.15.81:54002) 2024-09-12T01:33:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f2fff7fe640 1 -- 172.21.15.81:0/2046823590 learned_addr learned my addr 172.21.15.81:0/2046823590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f2ffeffd640 1 --2- 172.21.15.81:0/2046823590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db64a0 0x561163dc0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f2ffe7fc640 1 --2- 172.21.15.81:0/2046823590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db6dc0 0x561163dbe220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f2fff7fe640 1 -- 172.21.15.81:0/2046823590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db6dc0 msgr2=0x561163dbe220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f2fff7fe640 1 --2- 172.21.15.81:0/2046823590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db6dc0 0x561163dbe220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f2fff7fe640 1 -- 172.21.15.81:0/2046823590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db64a0 msgr2=0x561163dc0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f2fff7fe640 1 --2- 172.21.15.81:0/2046823590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db64a0 0x561163dc0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.016+0000 7f2fff7fe640 1 -- 172.21.15.81:0/2046823590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561163a8d3c0 con 0x561163dc1680 2024-09-12T01:33:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f2fff7fe640 1 --2- 172.21.15.81:0/2046823590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163dc1680 0x561163dbe760 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80bc850 tx=0x7f2ff80bc570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4445111a93b8cdc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f2fdeffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f2fdeffd640 1 -- 172.21.15.81:0/2046823590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80bcb50 con 0x561163dc1680 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f2fdeffd640 1 -- 172.21.15.81:0/2046823590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2ff80b91c0 con 0x561163dc1680 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f3007e20740 1 -- 172.21.15.81:0/2046823590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ff0015070 con 0x561163dc1680 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f2fdeffd640 1 -- 172.21.15.81:0/2046823590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2ff80c0f00 con 0x561163dc1680 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f3007e20740 10 client.16713 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f3007e20740 1 -- 172.21.15.81:0/2046823590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561163dc4250 con 0x561163dc1680 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f2fdeffd640 1 -- 172.21.15.81:0/2046823590 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff0015070 con 0x561163dc1680 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f2fdeffd640 1 -- 172.21.15.81:0/2046823590 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2ff80db2b0 con 0x561163dc1680 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f3007e20740 10 client.16713 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f3007e20740 10 client.16713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f3007e20740 20 client.16713 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f3007e20740 1 --2- 172.21.15.81:0/2046823590 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561163dd1070 0x561163dd34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f3007e20740 4 client.16713 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.017+0000 7f3007e20740 1 -- 172.21.15.81:0/2046823590 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561163d29850 con 0x561163dd1070 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.018+0000 7f2ffeffd640 1 --2- 172.21.15.81:0/2046823590 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561163dd1070 0x561163dd34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.018+0000 7f2ffeffd640 1 --2- 172.21.15.81:0/2046823590 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561163dd1070 0x561163dd34c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5eab9aa72df56b3 server_cookie=72a61a9fa3a50e73 in_seq=0 out_seq=0 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.018+0000 7f2fdeffd640 10 client.16713 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f2fdeffd640 1 -- 172.21.15.81:0/2046823590 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561163d29850 con 0x561163dd1070 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f2fdeffd640 10 client.16713 handle_command_reply: tid=0 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f3007e20740 1 client.16713 shutdown 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f3007e20740 1 -- 172.21.15.81:0/2046823590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163dc1680 msgr2=0x561163dbe760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f3007e20740 1 --2- 172.21.15.81:0/2046823590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163dc1680 0x561163dbe760 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80bc850 tx=0x7f2ff80bc570 comp rx=0 tx=0).stop 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f3007e20740 1 -- 172.21.15.81:0/2046823590 shutdown_connections 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f3007e20740 1 --2- 172.21.15.81:0/2046823590 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561163dd1070 0x561163dd34c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f3007e20740 1 --2- 172.21.15.81:0/2046823590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163dc1680 0x561163dbe760 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f3007e20740 1 --2- 172.21.15.81:0/2046823590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db6dc0 0x561163dbe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f3007e20740 1 --2- 172.21.15.81:0/2046823590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db64a0 0x561163dc0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f2fdeffd640 0 client.16713 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f3007e20740 1 -- 172.21.15.81:0/2046823590 >> 172.21.15.81:0/2046823590 conn(0x561163db2a30 msgr2=0x561163db1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f3007e20740 1 -- 172.21.15.81:0/2046823590 shutdown_connections 2024-09-12T01:33:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f3007e20740 1 -- 172.21.15.81:0/2046823590 wait complete. 2024-09-12T01:33:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.019+0000 7f3007e20740 20 client.16713 trim_cache size 0 max 16384 2024-09-12T01:33:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f3007e20740 1 Processor -- start 2024-09-12T01:33:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f3007e20740 1 -- start start 2024-09-12T01:33:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f3007e20740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db2a30 0x561163dcd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f3007e20740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db64a0 0x561163dd8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f3007e20740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db6dc0 0x561163dd92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f3007e20740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f30001af830 con 0x561163db64a0 2024-09-12T01:33:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f3007e20740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b1370 con 0x561163db2a30 2024-09-12T01:33:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f3007e20740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30001aff00 con 0x561163db6dc0 2024-09-12T01:33:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f2ffe7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db64a0 0x561163dd8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f2ffe7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db64a0 0x561163dd8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54006/0 (socket says 172.21.15.81:54006) 2024-09-12T01:33:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f2ffe7fc640 1 -- 172.21.15.81:0/1379310215 learned_addr learned my addr 172.21.15.81:0/1379310215 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f2ffeffd640 1 --2- 172.21.15.81:0/1379310215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db2a30 0x561163dcd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f2fff7fe640 1 --2- 172.21.15.81:0/1379310215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db6dc0 0x561163dd92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f2ffe7fc640 1 -- 172.21.15.81:0/1379310215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db6dc0 msgr2=0x561163dd92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f2ffe7fc640 1 --2- 172.21.15.81:0/1379310215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db6dc0 0x561163dd92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f2ffe7fc640 1 -- 172.21.15.81:0/1379310215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db2a30 msgr2=0x561163dcd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f2ffe7fc640 1 --2- 172.21.15.81:0/1379310215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db2a30 0x561163dcd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f2ffe7fc640 1 -- 172.21.15.81:0/1379310215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561163db24d0 con 0x561163db64a0 2024-09-12T01:33:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f2fff7fe640 1 --2- 172.21.15.81:0/1379310215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db6dc0 0x561163dd92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.036+0000 7f2ffeffd640 1 --2- 172.21.15.81:0/1379310215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db2a30 0x561163dcd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.037+0000 7f2ffe7fc640 1 --2- 172.21.15.81:0/1379310215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db64a0 0x561163dd8d70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400acf0 tx=0x7f2ff4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3601294934774671 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.037+0000 7f2fe57fa640 1 -- 172.21.15.81:0/1379310215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff402d070 con 0x561163db64a0 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.037+0000 7f2fe57fa640 1 -- 172.21.15.81:0/1379310215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff40288d0 con 0x561163db64a0 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.037+0000 7f2fe57fa640 1 -- 172.21.15.81:0/1379310215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff401e930 con 0x561163db64a0 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.037+0000 7f3007e20740 1 -- 172.21.15.81:0/1379310215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db64a0 msgr2=0x561163dd8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.037+0000 7f3007e20740 1 --2- 172.21.15.81:0/1379310215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db64a0 0x561163dd8d70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400acf0 tx=0x7f2ff4014000 comp rx=0 tx=0).stop 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.037+0000 7f3007e20740 1 -- 172.21.15.81:0/1379310215 shutdown_connections 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.037+0000 7f3007e20740 1 --2- 172.21.15.81:0/1379310215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db6dc0 0x561163dd92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.037+0000 7f3007e20740 1 --2- 172.21.15.81:0/1379310215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db64a0 0x561163dd8d70 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.037+0000 7f3007e20740 1 --2- 172.21.15.81:0/1379310215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db2a30 0x561163dcd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.037+0000 7f3007e20740 1 -- 172.21.15.81:0/1379310215 >> 172.21.15.81:0/1379310215 conn(0x561163dbe8c0 msgr2=0x561163dbcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.037+0000 7f3007e20740 1 -- 172.21.15.81:0/1379310215 shutdown_connections 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.037+0000 7f3007e20740 1 -- 172.21.15.81:0/1379310215 wait complete. 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.038+0000 7f3007e20740 1 -- start start 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.038+0000 7f3007e20740 1 Processor -- start 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.038+0000 7f3007e20740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db2a30 0x561163dc54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.038+0000 7f3007e20740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db64a0 0x561163dc59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.038+0000 7f3007e20740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 0x561163dc5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.038+0000 7f3007e20740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b0ca0 con 0x561163db6dc0 2024-09-12T01:33:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.038+0000 7f3007e20740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b05d0 con 0x561163db2a30 2024-09-12T01:33:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.038+0000 7f3007e20740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f30001ad810 con 0x561163db64a0 2024-09-12T01:33:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.038+0000 7f3007e20740 10 client.0 _ll_register_callbacks cb 0x7f2ff8009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.038+0000 7f2fff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 0x561163dc5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.038+0000 7f2fff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 0x561163dc5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54022/0 (socket says 172.21.15.81:54022) 2024-09-12T01:33:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.038+0000 7f2fff7fe640 1 -- 172.21.15.81:0/3508878640 learned_addr learned my addr 172.21.15.81:0/3508878640 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f2ffeffd640 1 --2- 172.21.15.81:0/3508878640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db2a30 0x561163dc54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f2ffe7fc640 1 --2- 172.21.15.81:0/3508878640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db64a0 0x561163dc59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f2fff7fe640 1 -- 172.21.15.81:0/3508878640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db64a0 msgr2=0x561163dc59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f2fff7fe640 1 --2- 172.21.15.81:0/3508878640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db64a0 0x561163dc59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f2fff7fe640 1 -- 172.21.15.81:0/3508878640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db2a30 msgr2=0x561163dc54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f2fff7fe640 1 --2- 172.21.15.81:0/3508878640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db2a30 0x561163dc54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f2fff7fe640 1 -- 172.21.15.81:0/3508878640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561163e3aea0 con 0x561163db6dc0 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f2fff7fe640 1 --2- 172.21.15.81:0/3508878640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 0x561163dc5f20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8005e30 tx=0x7f2ff80bb060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2566edf27c49bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f2fdeffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f2fdeffd640 1 -- 172.21.15.81:0/3508878640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80bc690 con 0x561163db6dc0 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f2fdeffd640 1 -- 172.21.15.81:0/3508878640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2ff80bbfa0 con 0x561163db6dc0 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f3007e20740 1 -- 172.21.15.81:0/3508878640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ff40288d0 con 0x561163db6dc0 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f2fdeffd640 1 -- 172.21.15.81:0/3508878640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2ff80c54a0 con 0x561163db6dc0 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f3007e20740 10 client.16719 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f3007e20740 1 -- 172.21.15.81:0/3508878640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561163e3c0c0 con 0x561163db6dc0 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.039+0000 7f2fdeffd640 1 -- 172.21.15.81:0/3508878640 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff40288d0 con 0x561163db6dc0 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.040+0000 7f2fdeffd640 1 -- 172.21.15.81:0/3508878640 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2ff80b88a0 con 0x561163db6dc0 2024-09-12T01:33:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.040+0000 7f3007e20740 10 client.16719 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.040+0000 7f3007e20740 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.040+0000 7f3007e20740 20 client.16719 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.040+0000 7f3007e20740 1 --2- 172.21.15.81:0/3508878640 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561163dc1680 0x561163e3e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.040+0000 7f3007e20740 4 client.16719 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.040+0000 7f3007e20740 1 -- 172.21.15.81:0/3508878640 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561163d23d60 con 0x561163dc1680 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.040+0000 7f2ffeffd640 1 --2- 172.21.15.81:0/3508878640 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561163dc1680 0x561163e3e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.040+0000 7f2fdeffd640 10 client.16719 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.040+0000 7f2ffeffd640 1 --2- 172.21.15.81:0/3508878640 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561163dc1680 0x561163e3e600 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c74515bff4259e7 server_cookie=2920839686bcba7d in_seq=0 out_seq=0 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f2fdeffd640 1 -- 172.21.15.81:0/3508878640 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561163d23d60 con 0x561163dc1680 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f2fdeffd640 10 client.16719 handle_command_reply: tid=0 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f3007e20740 1 client.16719 shutdown 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f3007e20740 1 -- 172.21.15.81:0/3508878640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 msgr2=0x561163dc5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f3007e20740 1 --2- 172.21.15.81:0/3508878640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 0x561163dc5f20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8005e30 tx=0x7f2ff80bb060 comp rx=0 tx=0).stop 2024-09-12T01:33:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f3007e20740 1 -- 172.21.15.81:0/3508878640 shutdown_connections 2024-09-12T01:33:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f3007e20740 1 --2- 172.21.15.81:0/3508878640 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561163dc1680 0x561163e3e600 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f3007e20740 1 --2- 172.21.15.81:0/3508878640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561163db6dc0 0x561163dc5f20 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f3007e20740 1 --2- 172.21.15.81:0/3508878640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561163db64a0 0x561163dc59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f2fdeffd640 0 client.16719 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f3007e20740 1 --2- 172.21.15.81:0/3508878640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561163db2a30 0x561163dc54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f3007e20740 1 -- 172.21.15.81:0/3508878640 >> 172.21.15.81:0/3508878640 conn(0x561163dbe8c0 msgr2=0x561163dbfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f3007e20740 1 -- 172.21.15.81:0/3508878640 shutdown_connections 2024-09-12T01:33:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f3007e20740 1 -- 172.21.15.81:0/3508878640 wait complete. 2024-09-12T01:33:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.041+0000 7f3007e20740 20 client.16719 trim_cache size 0 max 16384 2024-09-12T01:33:36.047 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:33:36.048 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:33:36.048 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:33:36.048 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:33:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.042+0000 7f3005a47640 1 -- 172.21.15.81:0/155997365 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2fe80a2d70 msgr2=0x7f2fe80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.042+0000 7f3005a47640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2fe80a2d70 0x7f2fe80a5230 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x561163db3db0 tx=0x7f2ff400a2d0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.042+0000 7f3005a47640 1 -- 172.21.15.81:0/155997365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3000106f10 msgr2=0x7f300019ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.042+0000 7f3005a47640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3000106f10 0x7f300019ee70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8031a20 tx=0x7f2ff8031a50 comp rx=0 tx=0).stop 2024-09-12T01:33:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.042+0000 7f3005a47640 1 -- 172.21.15.81:0/155997365 shutdown_connections 2024-09-12T01:33:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.042+0000 7f3005a47640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2fe80a2d70 0x7f2fe80a5230 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.042+0000 7f3005a47640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3000106f10 0x7f300019ee70 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.042+0000 7f3005a47640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3000102790 0x7f300019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.042+0000 7f3005a47640 1 --2- 172.21.15.81:0/155997365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3000101de0 0x7f300019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.042+0000 7f3005a47640 1 -- 172.21.15.81:0/155997365 >> 172.21.15.81:0/155997365 conn(0x7f30000fd8c0 msgr2=0x7f30000fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.042+0000 7f3005a47640 1 -- 172.21.15.81:0/155997365 shutdown_connections 2024-09-12T01:33:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:36.042+0000 7f3005a47640 1 -- 172.21.15.81:0/155997365 wait complete. 2024-09-12T01:33:36.699 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:33:36.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:33:36.942 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:37.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:37 smithi081 ceph-mon[30920]: pgmap v169: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.372+0000 7fa658526640 1 -- 172.21.15.81:0/2144246362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa650102ef0 msgr2=0x7fa65010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.372+0000 7fa658526640 1 --2- 172.21.15.81:0/2144246362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa650102ef0 0x7fa65010da40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa648009900 tx=0x7fa64802a480 comp rx=0 tx=0).stop 2024-09-12T01:33:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.372+0000 7fa658526640 1 -- 172.21.15.81:0/2144246362 shutdown_connections 2024-09-12T01:33:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.372+0000 7fa658526640 1 --2- 172.21.15.81:0/2144246362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa650102ef0 0x7fa65010da40 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.372+0000 7fa658526640 1 --2- 172.21.15.81:0/2144246362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa650102570 0x7fa6501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.372+0000 7fa658526640 1 --2- 172.21.15.81:0/2144246362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa650100e20 0x7fa650101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.372+0000 7fa658526640 1 -- 172.21.15.81:0/2144246362 >> 172.21.15.81:0/2144246362 conn(0x7fa6500fc7d0 msgr2=0x7fa6500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.372+0000 7fa658526640 1 -- 172.21.15.81:0/2144246362 shutdown_connections 2024-09-12T01:33:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.372+0000 7fa658526640 1 -- 172.21.15.81:0/2144246362 wait complete. 2024-09-12T01:33:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.372+0000 7fa658526640 1 Processor -- start 2024-09-12T01:33:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.372+0000 7fa658526640 1 -- start start 2024-09-12T01:33:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa658526640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa650100e20 0x7fa65019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa658526640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa650102570 0x7fa65019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa658526640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa650102ef0 0x7fa65019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa658526640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa650110ff0 con 0x7fa650100e20 2024-09-12T01:33:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa658526640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa650110e70 con 0x7fa650102ef0 2024-09-12T01:33:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa658526640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa650111170 con 0x7fa650102570 2024-09-12T01:33:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa6562c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa650100e20 0x7fa65019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa6562c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa650100e20 0x7fa65019a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54034/0 (socket says 172.21.15.81:54034) 2024-09-12T01:33:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa6562c2640 1 -- 172.21.15.81:0/1501417331 learned_addr learned my addr 172.21.15.81:0/1501417331 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa656ac3640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa650102ef0 0x7fa65019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa655ac1640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa650102570 0x7fa65019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa6562c2640 1 -- 172.21.15.81:0/1501417331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa650102570 msgr2=0x7fa65019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa6562c2640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa650102570 0x7fa65019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa6562c2640 1 -- 172.21.15.81:0/1501417331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa650102ef0 msgr2=0x7fa65019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa6562c2640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa650102ef0 0x7fa65019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa6562c2640 1 -- 172.21.15.81:0/1501417331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65019f6a0 con 0x7fa650100e20 2024-09-12T01:33:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa6562c2640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa650100e20 0x7fa65019a6f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa64000cce0 tx=0x7fa64000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.373+0000 7fa64f7fe640 1 -- 172.21.15.81:0/1501417331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640004b20 con 0x7fa650100e20 2024-09-12T01:33:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.374+0000 7fa658526640 1 -- 172.21.15.81:0/1501417331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa65019f990 con 0x7fa650100e20 2024-09-12T01:33:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.374+0000 7fa64f7fe640 1 -- 172.21.15.81:0/1501417331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa640004cc0 con 0x7fa650100e20 2024-09-12T01:33:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.374+0000 7fa64f7fe640 1 -- 172.21.15.81:0/1501417331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64000f7d0 con 0x7fa650100e20 2024-09-12T01:33:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.374+0000 7fa658526640 1 -- 172.21.15.81:0/1501417331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6501a7270 con 0x7fa650100e20 2024-09-12T01:33:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.374+0000 7fa658526640 1 -- 172.21.15.81:0/1501417331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa650101200 con 0x7fa650100e20 2024-09-12T01:33:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.376+0000 7fa64f7fe640 1 -- 172.21.15.81:0/1501417331 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa64000f970 con 0x7fa650100e20 2024-09-12T01:33:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.376+0000 7fa64f7fe640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa6380a2cf0 0x7fa6380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.377+0000 7fa655ac1640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa6380a2cf0 0x7fa6380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.377+0000 7fa64f7fe640 1 -- 172.21.15.81:0/1501417331 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fa6400cf960 con 0x7fa650100e20 2024-09-12T01:33:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.377+0000 7fa655ac1640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa6380a2cf0 0x7fa6380a51b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa65010ddf0 tx=0x7fa644008040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.380+0000 7fa64f7fe640 1 -- 172.21.15.81:0/1501417331 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa640014030 con 0x7fa650100e20 2024-09-12T01:33:37.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:37 smithi100 ceph-mon[35275]: pgmap v169: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:37.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:37 smithi189 ceph-mon[35357]: pgmap v169: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:37.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.578+0000 7fa658526640 1 -- 172.21.15.81:0/1501417331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa65019ba50 con 0x7fa650100e20 2024-09-12T01:33:37.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.578+0000 7fa64f7fe640 1 -- 172.21.15.81:0/1501417331 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fa64009c5b0 con 0x7fa650100e20 2024-09-12T01:33:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:33:37.578 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:33:37.578 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:33:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.581+0000 7fa658526640 1 -- 172.21.15.81:0/1501417331 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa6380a2cf0 msgr2=0x7fa6380a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.581+0000 7fa658526640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa6380a2cf0 0x7fa6380a51b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa65010ddf0 tx=0x7fa644008040 comp rx=0 tx=0).stop 2024-09-12T01:33:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.581+0000 7fa658526640 1 -- 172.21.15.81:0/1501417331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa650100e20 msgr2=0x7fa65019a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.581+0000 7fa658526640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa650100e20 0x7fa65019a6f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa64000cce0 tx=0x7fa64000a620 comp rx=0 tx=0).stop 2024-09-12T01:33:37.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.581+0000 7fa658526640 1 -- 172.21.15.81:0/1501417331 shutdown_connections 2024-09-12T01:33:37.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.581+0000 7fa658526640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa6380a2cf0 0x7fa6380a51b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:37.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.581+0000 7fa658526640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa650102ef0 0x7fa65019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:37.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.581+0000 7fa658526640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa650102570 0x7fa65019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:37.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.581+0000 7fa658526640 1 --2- 172.21.15.81:0/1501417331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa650100e20 0x7fa65019a6f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:37.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.581+0000 7fa658526640 1 -- 172.21.15.81:0/1501417331 >> 172.21.15.81:0/1501417331 conn(0x7fa6500fc7d0 msgr2=0x7fa65006a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:37.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.581+0000 7fa658526640 1 -- 172.21.15.81:0/1501417331 shutdown_connections 2024-09-12T01:33:37.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:37.581+0000 7fa658526640 1 -- 172.21.15.81:0/1501417331 wait complete. 2024-09-12T01:33:38.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:33:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:38.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:38 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1501417331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:33:38.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:38 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1501417331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:33:38.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:38 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1501417331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:33:38.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.923+0000 7f7db6a79640 1 -- 172.21.15.81:0/539672761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db0100a80 msgr2=0x7f7db0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:38.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.923+0000 7f7db6a79640 1 --2- 172.21.15.81:0/539672761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db0100a80 0x7f7db0100ee0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009930 tx=0x7f7d9c02a420 comp rx=0 tx=0).stop 2024-09-12T01:33:38.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.923+0000 7f7db6a79640 1 -- 172.21.15.81:0/539672761 shutdown_connections 2024-09-12T01:33:38.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.923+0000 7f7db6a79640 1 --2- 172.21.15.81:0/539672761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7db0101420 0x7f7db010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.923+0000 7f7db6a79640 1 --2- 172.21.15.81:0/539672761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db0100a80 0x7f7db0100ee0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.923+0000 7f7db6a79640 1 --2- 172.21.15.81:0/539672761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7db0106a80 0x7f7db0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.923+0000 7f7db6a79640 1 -- 172.21.15.81:0/539672761 >> 172.21.15.81:0/539672761 conn(0x7f7db00fc7a0 msgr2=0x7f7db00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:38.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.923+0000 7f7db6a79640 1 -- 172.21.15.81:0/539672761 shutdown_connections 2024-09-12T01:33:38.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.923+0000 7f7db6a79640 1 -- 172.21.15.81:0/539672761 wait complete. 2024-09-12T01:33:38.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.924+0000 7f7db6a79640 1 Processor -- start 2024-09-12T01:33:38.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.924+0000 7f7db6a79640 1 -- start start 2024-09-12T01:33:38.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.924+0000 7f7db6a79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db0100a80 0x7f7db01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.924+0000 7f7db6a79640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7db0101420 0x7f7db0198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.924+0000 7f7db6a79640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7db0106a80 0x7f7db019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.924+0000 7f7db6a79640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7db0110ef0 con 0x7f7db0100a80 2024-09-12T01:33:38.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.924+0000 7f7db6a79640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7db0110d70 con 0x7f7db0101420 2024-09-12T01:33:38.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.924+0000 7f7db6a79640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7db0111070 con 0x7f7db0106a80 2024-09-12T01:33:38.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.924+0000 7f7db4815640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db0100a80 0x7f7db01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.924+0000 7f7db4815640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db0100a80 0x7f7db01984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54062/0 (socket says 172.21.15.81:54062) 2024-09-12T01:33:38.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.924+0000 7f7db4815640 1 -- 172.21.15.81:0/1406258761 learned_addr learned my addr 172.21.15.81:0/1406258761 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:38.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7db4815640 1 -- 172.21.15.81:0/1406258761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7db0106a80 msgr2=0x7f7db019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:38.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7daffff640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7db0101420 0x7f7db0198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7db5016640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7db0106a80 0x7f7db019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7db4815640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7db0106a80 0x7f7db019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7db4815640 1 -- 172.21.15.81:0/1406258761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7db0101420 msgr2=0x7f7db0198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7db4815640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7db0101420 0x7f7db0198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7db4815640 1 -- 172.21.15.81:0/1406258761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db019d480 con 0x7f7db0100a80 2024-09-12T01:33:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7daffff640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7db0101420 0x7f7db0198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7db4815640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db0100a80 0x7f7db01984d0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7da400d950 tx=0x7f7da400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7dadffb640 1 -- 172.21.15.81:0/1406258761 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4017070 con 0x7f7db0100a80 2024-09-12T01:33:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7dadffb640 1 -- 172.21.15.81:0/1406258761 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7da4009c30 con 0x7f7db0100a80 2024-09-12T01:33:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7db6a79640 1 -- 172.21.15.81:0/1406258761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db019d770 con 0x7f7db0100a80 2024-09-12T01:33:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7dadffb640 1 -- 172.21.15.81:0/1406258761 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da400f6b0 con 0x7f7db0100a80 2024-09-12T01:33:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.925+0000 7f7db6a79640 1 -- 172.21.15.81:0/1406258761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db01a5050 con 0x7f7db0100a80 2024-09-12T01:33:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.928+0000 7f7dadffb640 1 -- 172.21.15.81:0/1406258761 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7da40109d0 con 0x7f7db0100a80 2024-09-12T01:33:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.928+0000 7f7db8e52740 1 Processor -- start 2024-09-12T01:33:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7db8e52740 1 -- start start 2024-09-12T01:33:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7db8e52740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439bb40 0x55677439a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7db8e52740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439a5d0 0x55677439aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7db8e52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x5567743a7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7db8e52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5567743002f0 con 0x5567743a5370 2024-09-12T01:33:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7db8e52740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5567742a7cf0 con 0x55677439a5d0 2024-09-12T01:33:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7db8e52740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5567742fc2b0 con 0x55677439bb40 2024-09-12T01:33:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7dadffb640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7da00a2d70 0x7f7da00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7daffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x5567743a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7daffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x5567743a7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54068/0 (socket says 172.21.15.81:54068) 2024-09-12T01:33:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7daffff640 1 -- 172.21.15.81:0/2309864334 learned_addr learned my addr 172.21.15.81:0/2309864334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7db4815640 1 --2- 172.21.15.81:0/2309864334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439a5d0 0x55677439aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7db5016640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7da00a2d70 0x7f7da00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7dadffb640 1 -- 172.21.15.81:0/1406258761 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7da40cf0c0 con 0x7f7db0100a80 2024-09-12T01:33:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7db5016640 1 --2- 172.21.15.81:0/2309864334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439bb40 0x55677439a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7daffff640 1 -- 172.21.15.81:0/2309864334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439bb40 msgr2=0x55677439a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7daffff640 1 --2- 172.21.15.81:0/2309864334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439bb40 0x55677439a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7daffff640 1 -- 172.21.15.81:0/2309864334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439a5d0 msgr2=0x55677439aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7daffff640 1 --2- 172.21.15.81:0/2309864334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439a5d0 0x55677439aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.929+0000 7f7daffff640 1 -- 172.21.15.81:0/2309864334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55677428c3a0 con 0x5567743a5370 2024-09-12T01:33:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.930+0000 7f7db5016640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7da00a2d70 0x7f7da00a5230 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7da8014590 tx=0x7f7da8006090 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.930+0000 7f7daffff640 1 --2- 172.21.15.81:0/2309864334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x5567743a7760 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c005ab0 tx=0x7f7d9c0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1862678567a4027 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.930+0000 7f7d9affd640 1 -- 172.21.15.81:0/2309864334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c035030 con 0x5567743a5370 2024-09-12T01:33:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.930+0000 7f7d9affd640 1 -- 172.21.15.81:0/2309864334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d9c041070 con 0x5567743a5370 2024-09-12T01:33:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.930+0000 7f7d9affd640 1 -- 172.21.15.81:0/2309864334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c0046c0 con 0x5567743a5370 2024-09-12T01:33:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.930+0000 7f7db8e52740 1 -- 172.21.15.81:0/2309864334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 msgr2=0x5567743a7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.930+0000 7f7db8e52740 1 --2- 172.21.15.81:0/2309864334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x5567743a7760 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c005ab0 tx=0x7f7d9c0040f0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.930+0000 7f7db8e52740 1 -- 172.21.15.81:0/2309864334 shutdown_connections 2024-09-12T01:33:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.930+0000 7f7db8e52740 1 --2- 172.21.15.81:0/2309864334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x5567743a7760 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.930+0000 7f7db8e52740 1 --2- 172.21.15.81:0/2309864334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439a5d0 0x55677439aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.931+0000 7f7db8e52740 1 --2- 172.21.15.81:0/2309864334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439bb40 0x55677439a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.931+0000 7f7db8e52740 1 -- 172.21.15.81:0/2309864334 >> 172.21.15.81:0/2309864334 conn(0x556774363310 msgr2=0x556774396c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.931+0000 7f7db8e52740 1 -- 172.21.15.81:0/2309864334 shutdown_connections 2024-09-12T01:33:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.931+0000 7f7db8e52740 1 -- 172.21.15.81:0/2309864334 wait complete. 2024-09-12T01:33:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.931+0000 7f7db8e52740 1 -- start start 2024-09-12T01:33:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.931+0000 7f7db8e52740 1 Processor -- start 2024-09-12T01:33:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.931+0000 7f7db8e52740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439a5d0 0x5567743a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.931+0000 7f7db8e52740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439bb40 0x5567743a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.931+0000 7f7db8e52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x5567743a2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.931+0000 7f7db8e52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5567743a8010 con 0x5567743a5370 2024-09-12T01:33:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.931+0000 7f7db8e52740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5567742bb060 con 0x55677439bb40 2024-09-12T01:33:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.931+0000 7f7db8e52740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5567743a8190 con 0x55677439a5d0 2024-09-12T01:33:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db8e52740 10 client.0 _ll_register_callbacks cb 0x55677400e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db5016640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x5567743a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db5016640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x5567743a2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54082/0 (socket says 172.21.15.81:54082) 2024-09-12T01:33:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db5016640 1 -- 172.21.15.81:0/111819215 learned_addr learned my addr 172.21.15.81:0/111819215 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7daffff640 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439bb40 0x5567743a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db4815640 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439a5d0 0x5567743a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db5016640 1 -- 172.21.15.81:0/111819215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439a5d0 msgr2=0x5567743a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db5016640 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439a5d0 0x5567743a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db5016640 1 -- 172.21.15.81:0/111819215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439bb40 msgr2=0x5567743a1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db5016640 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439bb40 0x5567743a1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db5016640 1 -- 172.21.15.81:0/111819215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567740713c0 con 0x5567743a5370 2024-09-12T01:33:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db4815640 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439a5d0 0x5567743a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db5016640 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x5567743a2570 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f7da801bdd0 tx=0x7f7da8004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4931d595a8f885 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7d8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7d8ffff640 1 -- 172.21.15.81:0/111819215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8028060 con 0x5567743a5370 2024-09-12T01:33:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7d8ffff640 1 -- 172.21.15.81:0/111819215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7da8023630 con 0x5567743a5370 2024-09-12T01:33:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db8e52740 1 -- 172.21.15.81:0/111819215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d9c041070 con 0x5567743a5370 2024-09-12T01:33:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7d8ffff640 1 -- 172.21.15.81:0/111819215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7da8023830 con 0x5567743a5370 2024-09-12T01:33:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db8e52740 10 client.16737 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7db8e52740 1 -- 172.21.15.81:0/111819215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5567743b3b10 con 0x5567743a5370 2024-09-12T01:33:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.932+0000 7f7d8ffff640 1 -- 172.21.15.81:0/111819215 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d9c041070 con 0x5567743a5370 2024-09-12T01:33:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.933+0000 7f7d8ffff640 1 -- 172.21.15.81:0/111819215 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7da8017950 con 0x5567743a5370 2024-09-12T01:33:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.933+0000 7f7db8e52740 10 client.16737 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.933+0000 7f7db8e52740 10 client.16737 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:33:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.933+0000 7f7db8e52740 20 client.16737 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.933+0000 7f7db8e52740 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x5567743b4fd0 0x5567743b7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.933+0000 7f7db8e52740 4 client.16737 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.933+0000 7f7db8e52740 1 -- 172.21.15.81:0/111819215 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55677430d860 con 0x5567743b4fd0 2024-09-12T01:33:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.933+0000 7f7db4815640 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x5567743b4fd0 0x5567743b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.933+0000 7f7db4815640 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x5567743b4fd0 0x5567743b7420 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1c7af584272e24ab server_cookie=bd2c91cb7d80168f in_seq=0 out_seq=0 2024-09-12T01:33:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.933+0000 7f7d8ffff640 10 client.16737 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:33:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.934+0000 7f7d8ffff640 1 -- 172.21.15.81:0/111819215 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55677430d860 con 0x5567743b4fd0 2024-09-12T01:33:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.934+0000 7f7d8ffff640 10 client.16737 handle_command_reply: tid=0 2024-09-12T01:33:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.934+0000 7f7db8e52740 1 client.16737 shutdown 2024-09-12T01:33:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.934+0000 7f7db8e52740 1 -- 172.21.15.81:0/111819215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 msgr2=0x5567743a2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.934+0000 7f7db8e52740 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x5567743a2570 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f7da801bdd0 tx=0x7f7da8004b50 comp rx=0 tx=0).stop 2024-09-12T01:33:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.934+0000 7f7db8e52740 1 -- 172.21.15.81:0/111819215 shutdown_connections 2024-09-12T01:33:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.934+0000 7f7db8e52740 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x5567743a2570 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.934+0000 7f7db8e52740 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439bb40 0x5567743a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.934+0000 7f7db8e52740 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x5567743b4fd0 0x5567743b7420 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.934+0000 7f7d8ffff640 0 client.16737 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:33:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.934+0000 7f7db8e52740 1 --2- 172.21.15.81:0/111819215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439a5d0 0x5567743a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.934+0000 7f7db8e52740 1 -- 172.21.15.81:0/111819215 >> 172.21.15.81:0/111819215 conn(0x556774363310 msgr2=0x55677439c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.935+0000 7f7db8e52740 1 -- 172.21.15.81:0/111819215 shutdown_connections 2024-09-12T01:33:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.935+0000 7f7db8e52740 1 -- 172.21.15.81:0/111819215 wait complete. 2024-09-12T01:33:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.935+0000 7f7db8e52740 20 client.16737 trim_cache size 0 max 16384 2024-09-12T01:33:38.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db8e52740 1 Processor -- start 2024-09-12T01:33:38.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db8e52740 1 -- start start 2024-09-12T01:33:38.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db8e52740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439a5d0 0x5567743a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db8e52740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439bb40 0x55677439d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db8e52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x55677439d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db8e52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01ab670 con 0x5567743a5370 2024-09-12T01:33:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db8e52740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01ad1b0 con 0x55677439bb40 2024-09-12T01:33:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db8e52740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01abd40 con 0x55677439a5d0 2024-09-12T01:33:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db5016640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x55677439d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db5016640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x55677439d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54092/0 (socket says 172.21.15.81:54092) 2024-09-12T01:33:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db5016640 1 -- 172.21.15.81:0/953565989 learned_addr learned my addr 172.21.15.81:0/953565989 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7daffff640 1 --2- 172.21.15.81:0/953565989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439bb40 0x55677439d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db4815640 1 --2- 172.21.15.81:0/953565989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439a5d0 0x5567743a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db5016640 1 -- 172.21.15.81:0/953565989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439a5d0 msgr2=0x5567743a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db5016640 1 --2- 172.21.15.81:0/953565989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439a5d0 0x5567743a3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db5016640 1 -- 172.21.15.81:0/953565989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439bb40 msgr2=0x55677439d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db5016640 1 --2- 172.21.15.81:0/953565989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439bb40 0x55677439d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db5016640 1 -- 172.21.15.81:0/953565989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567743b7aa0 con 0x5567743a5370 2024-09-12T01:33:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db4815640 1 --2- 172.21.15.81:0/953565989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439a5d0 0x5567743a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7daffff640 1 --2- 172.21.15.81:0/953565989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439bb40 0x55677439d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.948+0000 7f7db5016640 1 --2- 172.21.15.81:0/953565989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x55677439d660 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7da8000f80 tx=0x7f7da801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8180b5dc4c4675f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.949+0000 7f7d9a7fc640 1 -- 172.21.15.81:0/953565989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da803b070 con 0x5567743a5370 2024-09-12T01:33:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.949+0000 7f7d9a7fc640 1 -- 172.21.15.81:0/953565989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7da800a070 con 0x5567743a5370 2024-09-12T01:33:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.949+0000 7f7d9a7fc640 1 -- 172.21.15.81:0/953565989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8017620 con 0x5567743a5370 2024-09-12T01:33:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.949+0000 7f7db8e52740 1 -- 172.21.15.81:0/953565989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 msgr2=0x55677439d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.949+0000 7f7db8e52740 1 --2- 172.21.15.81:0/953565989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x55677439d660 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7da8000f80 tx=0x7f7da801ba30 comp rx=0 tx=0).stop 2024-09-12T01:33:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.949+0000 7f7db8e52740 1 -- 172.21.15.81:0/953565989 shutdown_connections 2024-09-12T01:33:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.949+0000 7f7db8e52740 1 --2- 172.21.15.81:0/953565989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567743a5370 0x55677439d660 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.949+0000 7f7db8e52740 1 --2- 172.21.15.81:0/953565989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439bb40 0x55677439d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.949+0000 7f7db8e52740 1 --2- 172.21.15.81:0/953565989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55677439a5d0 0x5567743a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.949+0000 7f7db8e52740 1 -- 172.21.15.81:0/953565989 >> 172.21.15.81:0/953565989 conn(0x556774363310 msgr2=0x5567743a3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.949+0000 7f7db8e52740 1 -- 172.21.15.81:0/953565989 shutdown_connections 2024-09-12T01:33:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.949+0000 7f7db8e52740 1 -- 172.21.15.81:0/953565989 wait complete. 2024-09-12T01:33:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.950+0000 7f7db8e52740 1 -- start start 2024-09-12T01:33:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.950+0000 7f7db8e52740 1 Processor -- start 2024-09-12T01:33:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.950+0000 7f7db8e52740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439a5d0 0x5567743adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.950+0000 7f7db8e52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55677439bb40 0x55677439ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.950+0000 7f7db8e52740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5567743a5370 0x55677439f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.950+0000 7f7db8e52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01acae0 con 0x55677439bb40 2024-09-12T01:33:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.950+0000 7f7db8e52740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01ac410 con 0x55677439a5d0 2024-09-12T01:33:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.950+0000 7f7db8e52740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7db01a9650 con 0x5567743a5370 2024-09-12T01:33:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.950+0000 7f7db8e52740 10 client.0 _ll_register_callbacks cb 0x7f7da8008030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.950+0000 7f7daffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55677439bb40 0x55677439ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.950+0000 7f7daffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55677439bb40 0x55677439ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54106/0 (socket says 172.21.15.81:54106) 2024-09-12T01:33:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.950+0000 7f7daffff640 1 -- 172.21.15.81:0/39708438 learned_addr learned my addr 172.21.15.81:0/39708438 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.950+0000 7f7db4815640 1 --2- 172.21.15.81:0/39708438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439a5d0 0x5567743adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7db5016640 1 --2- 172.21.15.81:0/39708438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5567743a5370 0x55677439f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7daffff640 1 -- 172.21.15.81:0/39708438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5567743a5370 msgr2=0x55677439f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7daffff640 1 --2- 172.21.15.81:0/39708438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5567743a5370 0x55677439f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7daffff640 1 -- 172.21.15.81:0/39708438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439a5d0 msgr2=0x5567743adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7daffff640 1 --2- 172.21.15.81:0/39708438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439a5d0 0x5567743adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7daffff640 1 -- 172.21.15.81:0/39708438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55677441ecc0 con 0x55677439bb40 2024-09-12T01:33:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7daffff640 1 --2- 172.21.15.81:0/39708438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55677439bb40 0x55677439ee40 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0092a0 tx=0x7f7d9c03d780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f280372135499d6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7d8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7d8ffff640 1 -- 172.21.15.81:0/39708438 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c053060 con 0x55677439bb40 2024-09-12T01:33:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7d8ffff640 1 -- 172.21.15.81:0/39708438 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7d9c03dd00 con 0x55677439bb40 2024-09-12T01:33:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7db8e52740 1 -- 172.21.15.81:0/39708438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7da800a070 con 0x55677439bb40 2024-09-12T01:33:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7d8ffff640 1 -- 172.21.15.81:0/39708438 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d9c035050 con 0x55677439bb40 2024-09-12T01:33:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7db8e52740 10 client.16743 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7db8e52740 1 -- 172.21.15.81:0/39708438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55677441fdb0 con 0x55677439bb40 2024-09-12T01:33:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.951+0000 7f7d8ffff640 1 -- 172.21.15.81:0/39708438 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7da800a070 con 0x55677439bb40 2024-09-12T01:33:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.952+0000 7f7d8ffff640 1 -- 172.21.15.81:0/39708438 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7d9c004c80 con 0x55677439bb40 2024-09-12T01:33:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.952+0000 7f7db8e52740 10 client.16743 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.952+0000 7f7db8e52740 10 client.16743 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:33:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.952+0000 7f7db8e52740 20 client.16743 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.952+0000 7f7db8e52740 1 --2- 172.21.15.81:0/39708438 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x556774420140 0x556774422530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.952+0000 7f7db8e52740 4 client.16743 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:33:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.952+0000 7f7db8e52740 1 -- 172.21.15.81:0/39708438 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556774307d70 con 0x556774420140 2024-09-12T01:33:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.952+0000 7f7db4815640 1 --2- 172.21.15.81:0/39708438 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x556774420140 0x556774422530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.952+0000 7f7d8ffff640 10 client.16743 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:33:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.952+0000 7f7db4815640 1 --2- 172.21.15.81:0/39708438 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x556774420140 0x556774422530 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=73a4bbbeb9b2c114 server_cookie=a7046568072c4092 in_seq=0 out_seq=0 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7d8ffff640 1 -- 172.21.15.81:0/39708438 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556774307d70 con 0x556774420140 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7d8ffff640 10 client.16743 handle_command_reply: tid=0 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7db8e52740 1 client.16743 shutdown 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7db8e52740 1 -- 172.21.15.81:0/39708438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55677439bb40 msgr2=0x55677439ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7db8e52740 1 --2- 172.21.15.81:0/39708438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55677439bb40 0x55677439ee40 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0092a0 tx=0x7f7d9c03d780 comp rx=0 tx=0).stop 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7db8e52740 1 -- 172.21.15.81:0/39708438 shutdown_connections 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7db8e52740 1 --2- 172.21.15.81:0/39708438 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x556774420140 0x556774422530 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7db8e52740 1 --2- 172.21.15.81:0/39708438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5567743a5370 0x55677439f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7db8e52740 1 --2- 172.21.15.81:0/39708438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55677439bb40 0x55677439ee40 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7d8ffff640 0 client.16743 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7db8e52740 1 --2- 172.21.15.81:0/39708438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55677439a5d0 0x5567743adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7db8e52740 1 -- 172.21.15.81:0/39708438 >> 172.21.15.81:0/39708438 conn(0x556774363310 msgr2=0x556774395d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7db8e52740 1 -- 172.21.15.81:0/39708438 shutdown_connections 2024-09-12T01:33:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7db8e52740 1 -- 172.21.15.81:0/39708438 wait complete. 2024-09-12T01:33:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.953+0000 7f7db8e52740 20 client.16743 trim_cache size 0 max 16384 2024-09-12T01:33:38.959 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:33:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.954+0000 7f7db6a79640 1 -- 172.21.15.81:0/1406258761 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7da00a2d70 msgr2=0x7f7da00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.954+0000 7f7db6a79640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7da00a2d70 0x7f7da00a5230 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7da8014590 tx=0x7f7da8006090 comp rx=0 tx=0).stop 2024-09-12T01:33:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.954+0000 7f7db6a79640 1 -- 172.21.15.81:0/1406258761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db0100a80 msgr2=0x7f7db01984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.954+0000 7f7db6a79640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db0100a80 0x7f7db01984d0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7da400d950 tx=0x7f7da400de10 comp rx=0 tx=0).stop 2024-09-12T01:33:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.954+0000 7f7db6a79640 1 -- 172.21.15.81:0/1406258761 shutdown_connections 2024-09-12T01:33:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.954+0000 7f7db6a79640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7da00a2d70 0x7f7da00a5230 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.954+0000 7f7db6a79640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7db0106a80 0x7f7db019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.954+0000 7f7db6a79640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7db0101420 0x7f7db0198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.954+0000 7f7db6a79640 1 --2- 172.21.15.81:0/1406258761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7db0100a80 0x7f7db01984d0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.954+0000 7f7db6a79640 1 -- 172.21.15.81:0/1406258761 >> 172.21.15.81:0/1406258761 conn(0x7f7db00fc7a0 msgr2=0x7f7db0104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.954+0000 7f7db6a79640 1 -- 172.21.15.81:0/1406258761 shutdown_connections 2024-09-12T01:33:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:38.954+0000 7f7db6a79640 1 -- 172.21.15.81:0/1406258761 wait complete. 2024-09-12T01:33:39.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:39 smithi081 ceph-mon[30920]: pgmap v170: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:39.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:39 smithi100 ceph-mon[35275]: pgmap v170: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:39.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:39 smithi189 ceph-mon[35357]: pgmap v170: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:39.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:33:39.862 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:40.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.323+0000 7f44098bb640 1 -- 172.21.15.81:0/3731679151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4404101420 msgr2=0x7f440410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:40.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.323+0000 7f44098bb640 1 --2- 172.21.15.81:0/3731679151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4404101420 0x7f440410d950 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009cd0 tx=0x7f43fc02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.323+0000 7f44098bb640 1 -- 172.21.15.81:0/3731679151 shutdown_connections 2024-09-12T01:33:40.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.323+0000 7f44098bb640 1 --2- 172.21.15.81:0/3731679151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4404101420 0x7f440410d950 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.323+0000 7f44098bb640 1 --2- 172.21.15.81:0/3731679151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4404100a80 0x7f4404100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.323+0000 7f44098bb640 1 --2- 172.21.15.81:0/3731679151 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4404106a80 0x7f4404106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.323+0000 7f44098bb640 1 -- 172.21.15.81:0/3731679151 >> 172.21.15.81:0/3731679151 conn(0x7f44040fc7a0 msgr2=0x7f44040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:40.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.323+0000 7f44098bb640 1 -- 172.21.15.81:0/3731679151 shutdown_connections 2024-09-12T01:33:40.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.323+0000 7f44098bb640 1 -- 172.21.15.81:0/3731679151 wait complete. 2024-09-12T01:33:40.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.323+0000 7f44098bb640 1 Processor -- start 2024-09-12T01:33:40.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44098bb640 1 -- start start 2024-09-12T01:33:40.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44098bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4404100a80 0x7f4404102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44098bb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4404101420 0x7f4404102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44098bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4404106a80 0x7f44041030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44098bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4404110e80 con 0x7f4404106a80 2024-09-12T01:33:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44098bb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4404110d00 con 0x7f4404100a80 2024-09-12T01:33:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44098bb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4404111000 con 0x7f4404101420 2024-09-12T01:33:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4404106a80 0x7f44041030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4404106a80 0x7f44041030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54134/0 (socket says 172.21.15.81:54134) 2024-09-12T01:33:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44037fe640 1 -- 172.21.15.81:0/2046610086 learned_addr learned my addr 172.21.15.81:0/2046610086 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f4402ffd640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4404100a80 0x7f4404102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f43fbfff640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4404101420 0x7f4404102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44037fe640 1 -- 172.21.15.81:0/2046610086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4404101420 msgr2=0x7f4404102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44037fe640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4404101420 0x7f4404102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44037fe640 1 -- 172.21.15.81:0/2046610086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4404100a80 msgr2=0x7f4404102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44037fe640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4404100a80 0x7f4404102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44037fe640 1 -- 172.21.15.81:0/2046610086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44041a67d0 con 0x7f4404106a80 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f43fbfff640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4404101420 0x7f4404102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44037fe640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4404106a80 0x7f44041030d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f43fc006010 tx=0x7f43fc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.324+0000 7f44088b9640 1 -- 172.21.15.81:0/2046610086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc004450 con 0x7f4404106a80 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.325+0000 7f44088b9640 1 -- 172.21.15.81:0/2046610086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43fc003e10 con 0x7f4404106a80 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.325+0000 7f44098bb640 1 -- 172.21.15.81:0/2046610086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44041a6a60 con 0x7f4404106a80 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.325+0000 7f44088b9640 1 -- 172.21.15.81:0/2046610086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc0466e0 con 0x7f4404106a80 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.325+0000 7f44098bb640 1 -- 172.21.15.81:0/2046610086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44041a6fa0 con 0x7f4404106a80 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.327+0000 7f44088b9640 1 -- 172.21.15.81:0/2046610086 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f43fc0305a0 con 0x7f4404106a80 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.327+0000 7f440bc94740 1 Processor -- start 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.327+0000 7f440bc94740 1 -- start start 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.327+0000 7f440bc94740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d9b40 0x5634b09d8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.327+0000 7f440bc94740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d85d0 0x5634b09d8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.327+0000 7f440bc94740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 0x5634b09e5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.327+0000 7f440bc94740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5634b093e2f0 con 0x5634b09e3370 2024-09-12T01:33:40.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.327+0000 7f440bc94740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5634b08e5cf0 con 0x5634b09d85d0 2024-09-12T01:33:40.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.327+0000 7f440bc94740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5634b093a2b0 con 0x5634b09d9b40 2024-09-12T01:33:40.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.327+0000 7f43fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 0x5634b09e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.327+0000 7f44088b9640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f43f00a2cf0 0x7f43f00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.327+0000 7f43fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 0x5634b09e5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54140/0 (socket says 172.21.15.81:54140) 2024-09-12T01:33:40.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.327+0000 7f43fbfff640 1 -- 172.21.15.81:0/1573146904 learned_addr learned my addr 172.21.15.81:0/1573146904 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:40.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f43fbfff640 1 --2- 172.21.15.81:0/1573146904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d9b40 0x5634b09d8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f4402ffd640 1 --2- 172.21.15.81:0/1573146904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d85d0 0x5634b09d8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f44088b9640 1 -- 172.21.15.81:0/2046610086 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f43fc02e030 con 0x7f4404106a80 2024-09-12T01:33:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f44037fe640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f43f00a2cf0 0x7f43f00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f43fbfff640 1 -- 172.21.15.81:0/1573146904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d9b40 msgr2=0x5634b09d8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f43fbfff640 1 --2- 172.21.15.81:0/1573146904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d9b40 0x5634b09d8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f43fbfff640 1 -- 172.21.15.81:0/1573146904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d85d0 msgr2=0x5634b09d8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f43fbfff640 1 --2- 172.21.15.81:0/1573146904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d85d0 0x5634b09d8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f43fbfff640 1 -- 172.21.15.81:0/1573146904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634b08ca3a0 con 0x5634b09e3370 2024-09-12T01:33:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f43fbfff640 1 --2- 172.21.15.81:0/1573146904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 0x5634b09e5760 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f43ec012880 tx=0x7f43ec00d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27c0aaf9156b018 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f44037fe640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f43f00a2cf0 0x7f43f00a51b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f43fc005cc0 tx=0x7f43fc02a8e0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f43f9ffb640 1 -- 172.21.15.81:0/1573146904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec00aa60 con 0x5634b09e3370 2024-09-12T01:33:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f43f9ffb640 1 -- 172.21.15.81:0/1573146904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43ec005500 con 0x5634b09e3370 2024-09-12T01:33:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.328+0000 7f43f9ffb640 1 -- 172.21.15.81:0/1573146904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec004b60 con 0x5634b09e3370 2024-09-12T01:33:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.329+0000 7f440bc94740 1 -- 172.21.15.81:0/1573146904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 msgr2=0x5634b09e5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.329+0000 7f440bc94740 1 --2- 172.21.15.81:0/1573146904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 0x5634b09e5760 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f43ec012880 tx=0x7f43ec00d440 comp rx=0 tx=0).stop 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.329+0000 7f440bc94740 1 -- 172.21.15.81:0/1573146904 shutdown_connections 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.329+0000 7f440bc94740 1 --2- 172.21.15.81:0/1573146904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 0x5634b09e5760 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.329+0000 7f440bc94740 1 --2- 172.21.15.81:0/1573146904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d85d0 0x5634b09d8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.329+0000 7f440bc94740 1 --2- 172.21.15.81:0/1573146904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d9b40 0x5634b09d8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.329+0000 7f440bc94740 1 -- 172.21.15.81:0/1573146904 >> 172.21.15.81:0/1573146904 conn(0x5634b09a1310 msgr2=0x5634b09d4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.329+0000 7f440bc94740 1 -- 172.21.15.81:0/1573146904 shutdown_connections 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.329+0000 7f440bc94740 1 -- 172.21.15.81:0/1573146904 wait complete. 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.329+0000 7f440bc94740 1 -- start start 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f440bc94740 1 Processor -- start 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f440bc94740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d85d0 0x5634b09e2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f440bc94740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 0x5634b09dffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f440bc94740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09e3370 0x5634b09e05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f440bc94740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5634b09e6070 con 0x5634b09d9b40 2024-09-12T01:33:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f440bc94740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5634b08f9060 con 0x5634b09d85d0 2024-09-12T01:33:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f440bc94740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5634b09e61f0 con 0x5634b09e3370 2024-09-12T01:33:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f440bc94740 10 client.0 _ll_register_callbacks cb 0x5634b064c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f4402ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 0x5634b09dffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f4402ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 0x5634b09dffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54154/0 (socket says 172.21.15.81:54154) 2024-09-12T01:33:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f4402ffd640 1 -- 172.21.15.81:0/1913372623 learned_addr learned my addr 172.21.15.81:0/1913372623 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f43fbfff640 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d85d0 0x5634b09e2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f43fbfff640 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09e3370 0x5634b09e05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f4402ffd640 1 -- 172.21.15.81:0/1913372623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09e3370 msgr2=0x5634b09e05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f4402ffd640 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09e3370 0x5634b09e05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f4402ffd640 1 -- 172.21.15.81:0/1913372623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d85d0 msgr2=0x5634b09e2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f4402ffd640 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d85d0 0x5634b09e2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f4402ffd640 1 -- 172.21.15.81:0/1913372623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634b06af3c0 con 0x5634b09d9b40 2024-09-12T01:33:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f43fbfff640 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09e3370 0x5634b09e05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f4402ffd640 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 0x5634b09dffe0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f43f4010840 tx=0x7f43f4010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0835bdb5dfcf443 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f43e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f43e2ffd640 1 -- 172.21.15.81:0/1913372623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f400cb10 con 0x5634b09d9b40 2024-09-12T01:33:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f440bc94740 1 -- 172.21.15.81:0/1913372623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43ec005500 con 0x5634b09d9b40 2024-09-12T01:33:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.330+0000 7f43e2ffd640 1 -- 172.21.15.81:0/1913372623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f43f400ccb0 con 0x5634b09d9b40 2024-09-12T01:33:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.331+0000 7f43e2ffd640 1 -- 172.21.15.81:0/1913372623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f43f4011440 con 0x5634b09d9b40 2024-09-12T01:33:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.331+0000 7f440bc94740 10 client.16755 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.331+0000 7f440bc94740 1 -- 172.21.15.81:0/1913372623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5634b09f1b60 con 0x5634b09d9b40 2024-09-12T01:33:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.331+0000 7f43e2ffd640 1 -- 172.21.15.81:0/1913372623 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43ec005500 con 0x5634b09d9b40 2024-09-12T01:33:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.331+0000 7f43e2ffd640 1 -- 172.21.15.81:0/1913372623 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f43f401a5f0 con 0x5634b09d9b40 2024-09-12T01:33:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.331+0000 7f440bc94740 10 client.16755 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.331+0000 7f440bc94740 10 client.16755 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:33:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.331+0000 7f440bc94740 20 client.16755 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:40.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.331+0000 7f440bc94740 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5634b09f30c0 0x5634b09f5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.331+0000 7f440bc94740 4 client.16755 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:40.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.331+0000 7f440bc94740 1 -- 172.21.15.81:0/1913372623 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634b094b860 con 0x5634b09f30c0 2024-09-12T01:33:40.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.331+0000 7f43fbfff640 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5634b09f30c0 0x5634b09f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.332+0000 7f43e2ffd640 10 client.16755 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:33:40.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.332+0000 7f43fbfff640 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5634b09f30c0 0x5634b09f5500 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=20f2ac3e344a2904 server_cookie=abbb4caefc6474ee in_seq=0 out_seq=0 2024-09-12T01:33:40.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.332+0000 7f43e2ffd640 1 -- 172.21.15.81:0/1913372623 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634b094b860 con 0x5634b09f30c0 2024-09-12T01:33:40.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.332+0000 7f43e2ffd640 10 client.16755 handle_command_reply: tid=0 2024-09-12T01:33:40.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.332+0000 7f440bc94740 1 client.16755 shutdown 2024-09-12T01:33:40.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.333+0000 7f440bc94740 1 -- 172.21.15.81:0/1913372623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 msgr2=0x5634b09dffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:40.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.333+0000 7f440bc94740 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 0x5634b09dffe0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f43f4010840 tx=0x7f43f4010d00 comp rx=0 tx=0).stop 2024-09-12T01:33:40.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.333+0000 7f440bc94740 1 -- 172.21.15.81:0/1913372623 shutdown_connections 2024-09-12T01:33:40.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.333+0000 7f440bc94740 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5634b09f30c0 0x5634b09f5500 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.333+0000 7f440bc94740 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09e3370 0x5634b09e05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.333+0000 7f440bc94740 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 0x5634b09dffe0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.333+0000 7f43e2ffd640 0 client.16755 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:33:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.333+0000 7f440bc94740 1 --2- 172.21.15.81:0/1913372623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d85d0 0x5634b09e2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.333+0000 7f440bc94740 1 -- 172.21.15.81:0/1913372623 >> 172.21.15.81:0/1913372623 conn(0x5634b09a1310 msgr2=0x5634b09da960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.333+0000 7f440bc94740 1 -- 172.21.15.81:0/1913372623 shutdown_connections 2024-09-12T01:33:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.333+0000 7f440bc94740 1 -- 172.21.15.81:0/1913372623 wait complete. 2024-09-12T01:33:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.333+0000 7f440bc94740 20 client.16755 trim_cache size 0 max 16384 2024-09-12T01:33:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.345+0000 7f440bc94740 1 Processor -- start 2024-09-12T01:33:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.345+0000 7f440bc94740 1 -- start start 2024-09-12T01:33:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f440bc94740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d85d0 0x5634b09d4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f440bc94740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 0x5634b09d9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f440bc94740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09e3370 0x5634b09ef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f440bc94740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f44041af910 con 0x5634b09d9b40 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f440bc94740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f44041b1450 con 0x5634b09e3370 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f440bc94740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f44041affe0 con 0x5634b09d85d0 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f4402ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 0x5634b09d9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f4402ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 0x5634b09d9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54170/0 (socket says 172.21.15.81:54170) 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f4402ffd640 1 -- 172.21.15.81:0/1080279272 learned_addr learned my addr 172.21.15.81:0/1080279272 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f43fbfff640 1 --2- 172.21.15.81:0/1080279272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09e3370 0x5634b09ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f43fbfff640 1 --2- 172.21.15.81:0/1080279272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d85d0 0x5634b09d4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f4402ffd640 1 -- 172.21.15.81:0/1080279272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d85d0 msgr2=0x5634b09d4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f4402ffd640 1 --2- 172.21.15.81:0/1080279272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d85d0 0x5634b09d4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f4402ffd640 1 -- 172.21.15.81:0/1080279272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09e3370 msgr2=0x5634b09ef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f4402ffd640 1 --2- 172.21.15.81:0/1080279272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09e3370 0x5634b09ef340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f4402ffd640 1 -- 172.21.15.81:0/1080279272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634b09d5960 con 0x5634b09d9b40 2024-09-12T01:33:40.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f43fbfff640 1 --2- 172.21.15.81:0/1080279272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d85d0 0x5634b09d4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f4402ffd640 1 --2- 172.21.15.81:0/1080279272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 0x5634b09d9300 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f43f401aae0 tx=0x7f43f400e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944392496f66495f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f43f97fa640 1 -- 172.21.15.81:0/1080279272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4030070 con 0x5634b09d9b40 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f43f97fa640 1 -- 172.21.15.81:0/1080279272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43f40055c0 con 0x5634b09d9b40 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.346+0000 7f43f97fa640 1 -- 172.21.15.81:0/1080279272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4027040 con 0x5634b09d9b40 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.347+0000 7f440bc94740 1 -- 172.21.15.81:0/1080279272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 msgr2=0x5634b09d9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.347+0000 7f440bc94740 1 --2- 172.21.15.81:0/1080279272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 0x5634b09d9300 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f43f401aae0 tx=0x7f43f400e6e0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.347+0000 7f440bc94740 1 -- 172.21.15.81:0/1080279272 shutdown_connections 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.347+0000 7f440bc94740 1 --2- 172.21.15.81:0/1080279272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09e3370 0x5634b09ef340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.347+0000 7f440bc94740 1 --2- 172.21.15.81:0/1080279272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09d9b40 0x5634b09d9300 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.347+0000 7f440bc94740 1 --2- 172.21.15.81:0/1080279272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d85d0 0x5634b09d4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.347+0000 7f440bc94740 1 -- 172.21.15.81:0/1080279272 >> 172.21.15.81:0/1080279272 conn(0x5634b09a1310 msgr2=0x5634b09d4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.347+0000 7f440bc94740 1 -- 172.21.15.81:0/1080279272 shutdown_connections 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.347+0000 7f440bc94740 1 -- 172.21.15.81:0/1080279272 wait complete. 2024-09-12T01:33:40.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.347+0000 7f440bc94740 1 -- start start 2024-09-12T01:33:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f440bc94740 1 Processor -- start 2024-09-12T01:33:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f440bc94740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d85d0 0x5634b09eb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f440bc94740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d9b40 0x5634b09ebda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f440bc94740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 0x5634b09dcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f440bc94740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f44041b0d80 con 0x5634b09e3370 2024-09-12T01:33:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f440bc94740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f44041b06b0 con 0x5634b09d9b40 2024-09-12T01:33:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f440bc94740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f44041ad8f0 con 0x5634b09d85d0 2024-09-12T01:33:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f440bc94740 10 client.0 _ll_register_callbacks cb 0x7f43f400e3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f43fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 0x5634b09dcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f43fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 0x5634b09dcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54184/0 (socket says 172.21.15.81:54184) 2024-09-12T01:33:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f43fbfff640 1 -- 172.21.15.81:0/3392440138 learned_addr learned my addr 172.21.15.81:0/3392440138 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f4402ffd640 1 --2- 172.21.15.81:0/3392440138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d9b40 0x5634b09ebda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f43fbfff640 1 -- 172.21.15.81:0/3392440138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d85d0 msgr2=0x5634b09eb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f43fbfff640 1 --2- 172.21.15.81:0/3392440138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d85d0 0x5634b09eb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f43fbfff640 1 -- 172.21.15.81:0/3392440138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d9b40 msgr2=0x5634b09ebda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f43fbfff640 1 --2- 172.21.15.81:0/3392440138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d9b40 0x5634b09ebda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f43fbfff640 1 -- 172.21.15.81:0/3392440138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634b09dd450 con 0x5634b09e3370 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f43fbfff640 1 --2- 172.21.15.81:0/3392440138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 0x5634b09dcc20 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f43ec012880 tx=0x7f43ec00d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e1df6a46a1c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f43e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f43e2ffd640 1 -- 172.21.15.81:0/3392440138 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec036060 con 0x5634b09e3370 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f43e2ffd640 1 -- 172.21.15.81:0/3392440138 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f43ec012480 con 0x5634b09e3370 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.348+0000 7f440bc94740 1 -- 172.21.15.81:0/3392440138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43f40055c0 con 0x5634b09e3370 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.349+0000 7f43e2ffd640 1 -- 172.21.15.81:0/3392440138 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f43ec00a860 con 0x5634b09e3370 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.349+0000 7f440bc94740 10 client.16761 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.349+0000 7f440bc94740 1 -- 172.21.15.81:0/3392440138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5634b0a66270 con 0x5634b09e3370 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.349+0000 7f43e2ffd640 1 -- 172.21.15.81:0/3392440138 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43f40055c0 con 0x5634b09e3370 2024-09-12T01:33:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.349+0000 7f43e2ffd640 1 -- 172.21.15.81:0/3392440138 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f43ec030030 con 0x5634b09e3370 2024-09-12T01:33:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.349+0000 7f440bc94740 10 client.16761 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.349+0000 7f440bc94740 10 client.16761 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:33:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.349+0000 7f440bc94740 20 client.16761 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.349+0000 7f440bc94740 1 --2- 172.21.15.81:0/3392440138 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5634b0a66740 0x5634b0a68b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.349+0000 7f440bc94740 4 client.16761 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:33:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.349+0000 7f440bc94740 1 -- 172.21.15.81:0/3392440138 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5634b0945d70 con 0x5634b0a66740 2024-09-12T01:33:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.349+0000 7f4402ffd640 1 --2- 172.21.15.81:0/3392440138 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5634b0a66740 0x5634b0a68b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f43e2ffd640 10 client.16761 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:33:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f4402ffd640 1 --2- 172.21.15.81:0/3392440138 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5634b0a66740 0x5634b0a68b60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=78a52dcd663129e6 server_cookie=2eb21c8c241897aa in_seq=0 out_seq=0 2024-09-12T01:33:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f43e2ffd640 1 -- 172.21.15.81:0/3392440138 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5634b0945d70 con 0x5634b0a66740 2024-09-12T01:33:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f43e2ffd640 10 client.16761 handle_command_reply: tid=0 2024-09-12T01:33:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f440bc94740 1 client.16761 shutdown 2024-09-12T01:33:40.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f440bc94740 1 -- 172.21.15.81:0/3392440138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 msgr2=0x5634b09dcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:40.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f440bc94740 1 --2- 172.21.15.81:0/3392440138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 0x5634b09dcc20 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f43ec012880 tx=0x7f43ec00d370 comp rx=0 tx=0).stop 2024-09-12T01:33:40.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f440bc94740 1 -- 172.21.15.81:0/3392440138 shutdown_connections 2024-09-12T01:33:40.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f440bc94740 1 --2- 172.21.15.81:0/3392440138 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5634b0a66740 0x5634b0a68b60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f43e2ffd640 0 client.16761 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:33:40.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f440bc94740 1 --2- 172.21.15.81:0/3392440138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634b09e3370 0x5634b09dcc20 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f440bc94740 1 --2- 172.21.15.81:0/3392440138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5634b09d9b40 0x5634b09ebda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f440bc94740 1 --2- 172.21.15.81:0/3392440138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5634b09d85d0 0x5634b09eb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f440bc94740 1 -- 172.21.15.81:0/3392440138 >> 172.21.15.81:0/3392440138 conn(0x5634b09a1310 msgr2=0x5634b09de490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:40.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f440bc94740 1 -- 172.21.15.81:0/3392440138 shutdown_connections 2024-09-12T01:33:40.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f440bc94740 1 -- 172.21.15.81:0/3392440138 wait complete. 2024-09-12T01:33:40.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.350+0000 7f440bc94740 20 client.16761 trim_cache size 0 max 16384 2024-09-12T01:33:40.368 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:33:40.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.351+0000 7f44098bb640 1 -- 172.21.15.81:0/2046610086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f43f00a2cf0 msgr2=0x7f43f00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:40.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.351+0000 7f44098bb640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f43f00a2cf0 0x7f43f00a51b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f43fc005cc0 tx=0x7f43fc02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.351+0000 7f44098bb640 1 -- 172.21.15.81:0/2046610086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4404106a80 msgr2=0x7f44041030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.351+0000 7f44098bb640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4404106a80 0x7f44041030d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f43fc006010 tx=0x7f43fc003c20 comp rx=0 tx=0).stop 2024-09-12T01:33:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.351+0000 7f44098bb640 1 -- 172.21.15.81:0/2046610086 shutdown_connections 2024-09-12T01:33:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.351+0000 7f44098bb640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f43f00a2cf0 0x7f43f00a51b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.351+0000 7f44098bb640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4404106a80 0x7f44041030d0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.351+0000 7f44098bb640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4404101420 0x7f4404102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.351+0000 7f44098bb640 1 --2- 172.21.15.81:0/2046610086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4404100a80 0x7f4404102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.351+0000 7f44098bb640 1 -- 172.21.15.81:0/2046610086 >> 172.21.15.81:0/2046610086 conn(0x7f44040fc7a0 msgr2=0x7f44040fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.351+0000 7f44098bb640 1 -- 172.21.15.81:0/2046610086 shutdown_connections 2024-09-12T01:33:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:40.351+0000 7f44098bb640 1 -- 172.21.15.81:0/2046610086 wait complete. 2024-09-12T01:33:41.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:33:41.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:41 smithi081 ceph-mon[30920]: pgmap v171: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:41.247 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:41.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:41 smithi100 ceph-mon[35275]: pgmap v171: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:41.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:41 smithi189 ceph-mon[35357]: pgmap v171: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.740+0000 7fdb92b36640 1 -- 172.21.15.81:0/1114666708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c102790 msgr2=0x7fdb8c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.740+0000 7fdb92b36640 1 --2- 172.21.15.81:0/1114666708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c102790 0x7fdb8c1067e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009900 tx=0x7fdb7c02a410 comp rx=0 tx=0).stop 2024-09-12T01:33:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.740+0000 7fdb92b36640 1 -- 172.21.15.81:0/1114666708 shutdown_connections 2024-09-12T01:33:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.740+0000 7fdb92b36640 1 --2- 172.21.15.81:0/1114666708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb8c106f10 0x7fdb8c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.740+0000 7fdb92b36640 1 --2- 172.21.15.81:0/1114666708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c102790 0x7fdb8c1067e0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.740+0000 7fdb92b36640 1 --2- 172.21.15.81:0/1114666708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb8c101de0 0x7fdb8c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.740+0000 7fdb92b36640 1 -- 172.21.15.81:0/1114666708 >> 172.21.15.81:0/1114666708 conn(0x7fdb8c0fd8c0 msgr2=0x7fdb8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.740+0000 7fdb92b36640 1 -- 172.21.15.81:0/1114666708 shutdown_connections 2024-09-12T01:33:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.740+0000 7fdb92b36640 1 -- 172.21.15.81:0/1114666708 wait complete. 2024-09-12T01:33:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb92b36640 1 Processor -- start 2024-09-12T01:33:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb92b36640 1 -- start start 2024-09-12T01:33:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb92b36640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb8c101de0 0x7fdb8c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb92b36640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c102790 0x7fdb8c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb92b36640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb8c106f10 0x7fdb8c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb92b36640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c112010 con 0x7fdb8c102790 2024-09-12T01:33:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb92b36640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c111e90 con 0x7fdb8c106f10 2024-09-12T01:33:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb92b36640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c112190 con 0x7fdb8c101de0 2024-09-12T01:33:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c102790 0x7fdb8c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c102790 0x7fdb8c198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54194/0 (socket says 172.21.15.81:54194) 2024-09-12T01:33:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb83fff640 1 -- 172.21.15.81:0/1608851306 learned_addr learned my addr 172.21.15.81:0/1608851306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb910d3640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb8c106f10 0x7fdb8c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb908d2640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb8c101de0 0x7fdb8c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb83fff640 1 -- 172.21.15.81:0/1608851306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb8c101de0 msgr2=0x7fdb8c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb83fff640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb8c101de0 0x7fdb8c1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb83fff640 1 -- 172.21.15.81:0/1608851306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb8c106f10 msgr2=0x7fdb8c19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb83fff640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb8c106f10 0x7fdb8c19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb83fff640 1 -- 172.21.15.81:0/1608851306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8c19d560 con 0x7fdb8c102790 2024-09-12T01:33:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.741+0000 7fdb910d3640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb8c106f10 0x7fdb8c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.742+0000 7fdb83fff640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c102790 0x7fdb8c198af0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c005ab0 tx=0x7fdb7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.742+0000 7fdb81ffb640 1 -- 172.21.15.81:0/1608851306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c03f030 con 0x7fdb8c102790 2024-09-12T01:33:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.742+0000 7fdb81ffb640 1 -- 172.21.15.81:0/1608851306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb7c003ce0 con 0x7fdb8c102790 2024-09-12T01:33:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.742+0000 7fdb81ffb640 1 -- 172.21.15.81:0/1608851306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c035070 con 0x7fdb8c102790 2024-09-12T01:33:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.742+0000 7fdb92b36640 1 -- 172.21.15.81:0/1608851306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8c19d7f0 con 0x7fdb8c102790 2024-09-12T01:33:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.742+0000 7fdb92b36640 1 -- 172.21.15.81:0/1608851306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb8c1a5130 con 0x7fdb8c102790 2024-09-12T01:33:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.744+0000 7fdb81ffb640 1 -- 172.21.15.81:0/1608851306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fdb7c042030 con 0x7fdb8c102790 2024-09-12T01:33:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.744+0000 7fdb94f0f740 1 Processor -- start 2024-09-12T01:33:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.744+0000 7fdb94f0f740 1 -- start start 2024-09-12T01:33:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb94f0f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 0x5574a5faa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb94f0f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5faa5d0 0x5574a5faaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb94f0f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5fb5370 0x5574a5fb7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb94f0f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5574a5f102f0 con 0x5574a5fabb40 2024-09-12T01:33:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb94f0f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5574a5eb7cf0 con 0x5574a5fb5370 2024-09-12T01:33:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb94f0f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5574a5f0c2b0 con 0x5574a5faa5d0 2024-09-12T01:33:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb81ffb640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdb740a2d70 0x7fdb740a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb910d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 0x5574a5faa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb910d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 0x5574a5faa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54202/0 (socket says 172.21.15.81:54202) 2024-09-12T01:33:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb910d3640 1 -- 172.21.15.81:0/340940913 learned_addr learned my addr 172.21.15.81:0/340940913 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb908d2640 1 --2- 172.21.15.81:0/340940913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5faa5d0 0x5574a5faaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb81ffb640 1 -- 172.21.15.81:0/1608851306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fdb7c0efd50 con 0x7fdb8c102790 2024-09-12T01:33:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb83fff640 1 --2- 172.21.15.81:0/340940913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5fb5370 0x5574a5fb7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb910d3640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdb740a2d70 0x7fdb740a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb910d3640 1 -- 172.21.15.81:0/340940913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5faa5d0 msgr2=0x5574a5faaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb910d3640 1 --2- 172.21.15.81:0/340940913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5faa5d0 0x5574a5faaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb910d3640 1 -- 172.21.15.81:0/340940913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5fb5370 msgr2=0x5574a5fb7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb910d3640 1 --2- 172.21.15.81:0/340940913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5fb5370 0x5574a5fb7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb910d3640 1 -- 172.21.15.81:0/340940913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574a5e9c3a0 con 0x5574a5fabb40 2024-09-12T01:33:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb83fff640 1 --2- 172.21.15.81:0/340940913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5fb5370 0x5574a5fb7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.745+0000 7fdb910d3640 1 --2- 172.21.15.81:0/340940913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 0x5574a5faa090 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400cbf0 tx=0x7fdb84007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0555c9a67133a59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.746+0000 7fdb72ffd640 1 -- 172.21.15.81:0/340940913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84015070 con 0x5574a5fabb40 2024-09-12T01:33:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.746+0000 7fdb72ffd640 1 -- 172.21.15.81:0/340940913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb84016040 con 0x5574a5fabb40 2024-09-12T01:33:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.746+0000 7fdb72ffd640 1 -- 172.21.15.81:0/340940913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8401e020 con 0x5574a5fabb40 2024-09-12T01:33:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.746+0000 7fdb94f0f740 1 -- 172.21.15.81:0/340940913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 msgr2=0x5574a5faa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.746+0000 7fdb910d3640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdb740a2d70 0x7fdb740a5230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdb8401f000 tx=0x7fdb8401b000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.746+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/340940913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 0x5574a5faa090 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400cbf0 tx=0x7fdb84007680 comp rx=0 tx=0).stop 2024-09-12T01:33:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.746+0000 7fdb94f0f740 1 -- 172.21.15.81:0/340940913 shutdown_connections 2024-09-12T01:33:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.746+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/340940913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5fb5370 0x5574a5fb7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.746+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/340940913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5faa5d0 0x5574a5faaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.746+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/340940913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 0x5574a5faa090 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.746+0000 7fdb94f0f740 1 -- 172.21.15.81:0/340940913 >> 172.21.15.81:0/340940913 conn(0x5574a5f73310 msgr2=0x5574a5fa6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.746+0000 7fdb94f0f740 1 -- 172.21.15.81:0/340940913 shutdown_connections 2024-09-12T01:33:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.746+0000 7fdb94f0f740 1 -- 172.21.15.81:0/340940913 wait complete. 2024-09-12T01:33:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.747+0000 7fdb94f0f740 1 -- start start 2024-09-12T01:33:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.747+0000 7fdb94f0f740 1 Processor -- start 2024-09-12T01:33:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.747+0000 7fdb94f0f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5faa5d0 0x5574a5fb4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.747+0000 7fdb94f0f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 0x5574a5fb2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.747+0000 7fdb94f0f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5fb5370 0x5574a5fb2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.747+0000 7fdb94f0f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5574a5fb8070 con 0x5574a5fabb40 2024-09-12T01:33:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.747+0000 7fdb94f0f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5574a5ecb060 con 0x5574a5faa5d0 2024-09-12T01:33:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.747+0000 7fdb94f0f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5574a5fb81f0 con 0x5574a5fb5370 2024-09-12T01:33:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.747+0000 7fdb94f0f740 10 client.0 _ll_register_callbacks cb 0x5574a5c1e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.747+0000 7fdb83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 0x5574a5fb2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.747+0000 7fdb83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 0x5574a5fb2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54218/0 (socket says 172.21.15.81:54218) 2024-09-12T01:33:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.747+0000 7fdb83fff640 1 -- 172.21.15.81:0/261206620 learned_addr learned my addr 172.21.15.81:0/261206620 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.747+0000 7fdb910d3640 1 --2- 172.21.15.81:0/261206620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5fb5370 0x5574a5fb2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb908d2640 1 --2- 172.21.15.81:0/261206620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5faa5d0 0x5574a5fb4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb83fff640 1 -- 172.21.15.81:0/261206620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5fb5370 msgr2=0x5574a5fb2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb83fff640 1 --2- 172.21.15.81:0/261206620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5fb5370 0x5574a5fb2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb83fff640 1 -- 172.21.15.81:0/261206620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5faa5d0 msgr2=0x5574a5fb4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb83fff640 1 --2- 172.21.15.81:0/261206620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5faa5d0 0x5574a5fb4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb83fff640 1 -- 172.21.15.81:0/261206620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574a5c813c0 con 0x5574a5fabb40 2024-09-12T01:33:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb83fff640 1 --2- 172.21.15.81:0/261206620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 0x5574a5fb2040 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c006010 tx=0x7fdb7c0bc070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b7bcbbf4b32b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb6bfff640 1 -- 172.21.15.81:0/261206620 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c049030 con 0x5574a5fabb40 2024-09-12T01:33:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb6bfff640 1 -- 172.21.15.81:0/261206620 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fdb7c0b8910 con 0x5574a5fabb40 2024-09-12T01:33:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb94f0f740 1 -- 172.21.15.81:0/261206620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb84016040 con 0x5574a5fabb40 2024-09-12T01:33:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb6bfff640 1 -- 172.21.15.81:0/261206620 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdb7c0bc9a0 con 0x5574a5fabb40 2024-09-12T01:33:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb94f0f740 10 client.16773 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb94f0f740 1 -- 172.21.15.81:0/261206620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5574a5fc3b40 con 0x5574a5fabb40 2024-09-12T01:33:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb6bfff640 1 -- 172.21.15.81:0/261206620 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb84016040 con 0x5574a5fabb40 2024-09-12T01:33:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.748+0000 7fdb6bfff640 1 -- 172.21.15.81:0/261206620 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdb7c0d5120 con 0x5574a5fabb40 2024-09-12T01:33:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.749+0000 7fdb94f0f740 10 client.16773 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.749+0000 7fdb94f0f740 10 client.16773 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:33:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.749+0000 7fdb94f0f740 20 client.16773 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.749+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/261206620 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5574a5fc4fa0 0x5574a5fc7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.749+0000 7fdb94f0f740 4 client.16773 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.749+0000 7fdb94f0f740 1 -- 172.21.15.81:0/261206620 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574a5f1d860 con 0x5574a5fc4fa0 2024-09-12T01:33:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.749+0000 7fdb908d2640 1 --2- 172.21.15.81:0/261206620 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5574a5fc4fa0 0x5574a5fc7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.749+0000 7fdb908d2640 1 --2- 172.21.15.81:0/261206620 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5574a5fc4fa0 0x5574a5fc7410 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c5a410f7161ea79e server_cookie=b3a86ffba000d6ac in_seq=0 out_seq=0 2024-09-12T01:33:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.749+0000 7fdb6bfff640 10 client.16773 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:33:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb6bfff640 1 -- 172.21.15.81:0/261206620 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5574a5f1d860 con 0x5574a5fc4fa0 2024-09-12T01:33:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb6bfff640 10 client.16773 handle_command_reply: tid=0 2024-09-12T01:33:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb94f0f740 1 client.16773 shutdown 2024-09-12T01:33:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb94f0f740 1 -- 172.21.15.81:0/261206620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 msgr2=0x5574a5fb2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/261206620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 0x5574a5fb2040 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c006010 tx=0x7fdb7c0bc070 comp rx=0 tx=0).stop 2024-09-12T01:33:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb94f0f740 1 -- 172.21.15.81:0/261206620 shutdown_connections 2024-09-12T01:33:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/261206620 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5574a5fc4fa0 0x5574a5fc7410 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/261206620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5fb5370 0x5574a5fb2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/261206620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fabb40 0x5574a5fb2040 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb6bfff640 0 client.16773 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:33:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/261206620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5faa5d0 0x5574a5fb4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb94f0f740 1 -- 172.21.15.81:0/261206620 >> 172.21.15.81:0/261206620 conn(0x5574a5f73310 msgr2=0x5574a5fac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb94f0f740 1 -- 172.21.15.81:0/261206620 shutdown_connections 2024-09-12T01:33:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb94f0f740 1 -- 172.21.15.81:0/261206620 wait complete. 2024-09-12T01:33:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.750+0000 7fdb94f0f740 20 client.16773 trim_cache size 0 max 16384 2024-09-12T01:33:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.763+0000 7fdb94f0f740 1 Processor -- start 2024-09-12T01:33:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.763+0000 7fdb94f0f740 1 -- start start 2024-09-12T01:33:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.763+0000 7fdb94f0f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5faa5d0 0x5574a5fb3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.763+0000 7fdb94f0f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5fabb40 0x5574a5fad120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.763+0000 7fdb94f0f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 0x5574a5fad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.763+0000 7fdb94f0f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c1ad990 con 0x5574a5fb5370 2024-09-12T01:33:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.763+0000 7fdb94f0f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c1af4d0 con 0x5574a5fabb40 2024-09-12T01:33:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.763+0000 7fdb94f0f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c1ae060 con 0x5574a5faa5d0 2024-09-12T01:33:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.763+0000 7fdb910d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 0x5574a5fad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.763+0000 7fdb910d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 0x5574a5fad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54226/0 (socket says 172.21.15.81:54226) 2024-09-12T01:33:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.763+0000 7fdb910d3640 1 -- 172.21.15.81:0/1521540248 learned_addr learned my addr 172.21.15.81:0/1521540248 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.763+0000 7fdb83fff640 1 --2- 172.21.15.81:0/1521540248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5fabb40 0x5574a5fad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb908d2640 1 --2- 172.21.15.81:0/1521540248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5faa5d0 0x5574a5fb3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb910d3640 1 -- 172.21.15.81:0/1521540248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5faa5d0 msgr2=0x5574a5fb3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb910d3640 1 --2- 172.21.15.81:0/1521540248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5faa5d0 0x5574a5fb3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb910d3640 1 -- 172.21.15.81:0/1521540248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5fabb40 msgr2=0x5574a5fad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb910d3640 1 --2- 172.21.15.81:0/1521540248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5fabb40 0x5574a5fad120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb910d3640 1 -- 172.21.15.81:0/1521540248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574a5fc7a60 con 0x5574a5fb5370 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb83fff640 1 --2- 172.21.15.81:0/1521540248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5fabb40 0x5574a5fad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb910d3640 1 --2- 172.21.15.81:0/1521540248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 0x5574a5fad660 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fdb84012000 tx=0x7fdb8400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d418b21df25f3ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb727fc640 1 -- 172.21.15.81:0/1521540248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84031070 con 0x5574a5fb5370 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb727fc640 1 -- 172.21.15.81:0/1521540248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb8400ae40 con 0x5574a5fb5370 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb727fc640 1 -- 172.21.15.81:0/1521540248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8401e040 con 0x5574a5fb5370 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb94f0f740 1 -- 172.21.15.81:0/1521540248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 msgr2=0x5574a5fad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/1521540248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 0x5574a5fad660 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fdb84012000 tx=0x7fdb8400f000 comp rx=0 tx=0).stop 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb94f0f740 1 -- 172.21.15.81:0/1521540248 shutdown_connections 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.764+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/1521540248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 0x5574a5fad660 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/1521540248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5fabb40 0x5574a5fad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/1521540248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5faa5d0 0x5574a5fb3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 1 -- 172.21.15.81:0/1521540248 >> 172.21.15.81:0/1521540248 conn(0x5574a5f73310 msgr2=0x5574a5fb38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 1 -- 172.21.15.81:0/1521540248 shutdown_connections 2024-09-12T01:33:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 1 -- 172.21.15.81:0/1521540248 wait complete. 2024-09-12T01:33:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 1 -- start start 2024-09-12T01:33:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 1 Processor -- start 2024-09-12T01:33:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5faa5d0 0x5574a5fbd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5fabb40 0x5574a5fbd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 0x5574a5fba450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c1aee00 con 0x5574a5fb5370 2024-09-12T01:33:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c1ae730 con 0x5574a5faa5d0 2024-09-12T01:33:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c1ab970 con 0x5574a5fabb40 2024-09-12T01:33:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb94f0f740 10 client.0 _ll_register_callbacks cb 0x7fdb7c005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb910d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 0x5574a5fba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb910d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 0x5574a5fba450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54238/0 (socket says 172.21.15.81:54238) 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb910d3640 1 -- 172.21.15.81:0/3842103436 learned_addr learned my addr 172.21.15.81:0/3842103436 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.765+0000 7fdb83fff640 1 --2- 172.21.15.81:0/3842103436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5fabb40 0x5574a5fbd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb908d2640 1 --2- 172.21.15.81:0/3842103436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5faa5d0 0x5574a5fbd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb910d3640 1 -- 172.21.15.81:0/3842103436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5fabb40 msgr2=0x5574a5fbd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb910d3640 1 --2- 172.21.15.81:0/3842103436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5fabb40 0x5574a5fbd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb910d3640 1 -- 172.21.15.81:0/3842103436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5faa5d0 msgr2=0x5574a5fbd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb910d3640 1 --2- 172.21.15.81:0/3842103436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5faa5d0 0x5574a5fbd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb910d3640 1 -- 172.21.15.81:0/3842103436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574a5fbe050 con 0x5574a5fb5370 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb910d3640 1 --2- 172.21.15.81:0/3842103436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 0x5574a5fba450 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fdb84000f80 tx=0x7fdb8400c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef73d5a77dd440ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb6bfff640 1 -- 172.21.15.81:0/3842103436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8403a060 con 0x5574a5fb5370 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb6bfff640 1 -- 172.21.15.81:0/3842103436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fdb8400c160 con 0x5574a5fb5370 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb94f0f740 1 -- 172.21.15.81:0/3842103436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5574a5f17d70 con 0x5574a5fb5370 2024-09-12T01:33:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb6bfff640 1 -- 172.21.15.81:0/3842103436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdb84031040 con 0x5574a5fb5370 2024-09-12T01:33:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb94f0f740 10 client.16779 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb94f0f740 1 -- 172.21.15.81:0/3842103436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5574a6030260 con 0x5574a5fb5370 2024-09-12T01:33:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb6bfff640 1 -- 172.21.15.81:0/3842103436 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5574a5f17d70 con 0x5574a5fb5370 2024-09-12T01:33:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.766+0000 7fdb6bfff640 1 -- 172.21.15.81:0/3842103436 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdb84034070 con 0x5574a5fb5370 2024-09-12T01:33:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.767+0000 7fdb94f0f740 10 client.16779 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.767+0000 7fdb94f0f740 10 client.16779 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:33:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.767+0000 7fdb94f0f740 20 client.16779 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.767+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/3842103436 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5574a60306d0 0x5574a6032ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.767+0000 7fdb94f0f740 4 client.16779 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:33:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.767+0000 7fdb94f0f740 1 -- 172.21.15.81:0/3842103436 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5574a5e94170 con 0x5574a60306d0 2024-09-12T01:33:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.767+0000 7fdb908d2640 1 --2- 172.21.15.81:0/3842103436 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5574a60306d0 0x5574a6032ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.767+0000 7fdb6bfff640 10 client.16779 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:33:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb908d2640 1 --2- 172.21.15.81:0/3842103436 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5574a60306d0 0x5574a6032ac0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3cf65dcc31378472 server_cookie=113747cac3b7f4fe in_seq=0 out_seq=0 2024-09-12T01:33:41.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb6bfff640 1 -- 172.21.15.81:0/3842103436 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5574a5e94170 con 0x5574a60306d0 2024-09-12T01:33:41.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb6bfff640 10 client.16779 handle_command_reply: tid=0 2024-09-12T01:33:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb94f0f740 1 client.16779 shutdown 2024-09-12T01:33:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb94f0f740 1 -- 172.21.15.81:0/3842103436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 msgr2=0x5574a5fba450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/3842103436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 0x5574a5fba450 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fdb84000f80 tx=0x7fdb8400c010 comp rx=0 tx=0).stop 2024-09-12T01:33:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb94f0f740 1 -- 172.21.15.81:0/3842103436 shutdown_connections 2024-09-12T01:33:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/3842103436 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5574a60306d0 0x5574a6032ac0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/3842103436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5574a5fb5370 0x5574a5fba450 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/3842103436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574a5fabb40 0x5574a5fbd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb6bfff640 0 client.16779 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:33:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb94f0f740 1 --2- 172.21.15.81:0/3842103436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5574a5faa5d0 0x5574a5fbd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb94f0f740 1 -- 172.21.15.81:0/3842103436 >> 172.21.15.81:0/3842103436 conn(0x5574a5f73310 msgr2=0x5574a5fb40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb94f0f740 1 -- 172.21.15.81:0/3842103436 shutdown_connections 2024-09-12T01:33:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb94f0f740 1 -- 172.21.15.81:0/3842103436 wait complete. 2024-09-12T01:33:41.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.768+0000 7fdb94f0f740 20 client.16779 trim_cache size 0 max 16384 2024-09-12T01:33:41.786 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:33:41.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.769+0000 7fdb92b36640 1 -- 172.21.15.81:0/1608851306 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdb740a2d70 msgr2=0x7fdb740a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:41.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.769+0000 7fdb92b36640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdb740a2d70 0x7fdb740a5230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdb8401f000 tx=0x7fdb8401b000 comp rx=0 tx=0).stop 2024-09-12T01:33:41.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.769+0000 7fdb92b36640 1 -- 172.21.15.81:0/1608851306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c102790 msgr2=0x7fdb8c198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:41.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.769+0000 7fdb92b36640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c102790 0x7fdb8c198af0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c005ab0 tx=0x7fdb7c0042f0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.769+0000 7fdb92b36640 1 -- 172.21.15.81:0/1608851306 shutdown_connections 2024-09-12T01:33:41.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.769+0000 7fdb92b36640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fdb740a2d70 0x7fdb740a5230 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.769+0000 7fdb92b36640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb8c106f10 0x7fdb8c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.769+0000 7fdb92b36640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c102790 0x7fdb8c198af0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.769+0000 7fdb92b36640 1 --2- 172.21.15.81:0/1608851306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb8c101de0 0x7fdb8c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:41.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.769+0000 7fdb92b36640 1 -- 172.21.15.81:0/1608851306 >> 172.21.15.81:0/1608851306 conn(0x7fdb8c0fd8c0 msgr2=0x7fdb8c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:41.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.769+0000 7fdb92b36640 1 -- 172.21.15.81:0/1608851306 shutdown_connections 2024-09-12T01:33:41.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:41.769+0000 7fdb92b36640 1 -- 172.21.15.81:0/1608851306 wait complete. 2024-09-12T01:33:42.485 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:33:42.732 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:43.207 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:43 smithi081 ceph-mon[30920]: pgmap v172: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:43.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.198+0000 7fa843725640 1 -- 172.21.15.81:0/3946892069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c101450 msgr2=0x7fa83c105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.198+0000 7fa843725640 1 --2- 172.21.15.81:0/3946892069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c101450 0x7fa83c105920 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009900 tx=0x7fa82c02a470 comp rx=0 tx=0).stop 2024-09-12T01:33:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.198+0000 7fa843725640 1 -- 172.21.15.81:0/3946892069 shutdown_connections 2024-09-12T01:33:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.198+0000 7fa843725640 1 --2- 172.21.15.81:0/3946892069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa83c105f40 0x7fa83c1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.198+0000 7fa843725640 1 --2- 172.21.15.81:0/3946892069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c101450 0x7fa83c105920 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.198+0000 7fa843725640 1 --2- 172.21.15.81:0/3946892069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa83c100b30 0x7fa83c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.198+0000 7fa843725640 1 -- 172.21.15.81:0/3946892069 >> 172.21.15.81:0/3946892069 conn(0x7fa83c0fc7a0 msgr2=0x7fa83c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.198+0000 7fa843725640 1 -- 172.21.15.81:0/3946892069 shutdown_connections 2024-09-12T01:33:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.198+0000 7fa843725640 1 -- 172.21.15.81:0/3946892069 wait complete. 2024-09-12T01:33:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa843725640 1 Processor -- start 2024-09-12T01:33:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa843725640 1 -- start start 2024-09-12T01:33:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa843725640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa83c100b30 0x7fa83c1a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa843725640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa83c101450 0x7fa83c1a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa843725640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c105f40 0x7fa83c19e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa843725640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1185c0 con 0x7fa83c105f40 2024-09-12T01:33:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa843725640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c118440 con 0x7fa83c100b30 2024-09-12T01:33:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa843725640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c118740 con 0x7fa83c101450 2024-09-12T01:33:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa841cc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c105f40 0x7fa83c19e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa841cc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c105f40 0x7fa83c19e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34460/0 (socket says 172.21.15.81:34460) 2024-09-12T01:33:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa841cc2640 1 -- 172.21.15.81:0/4052928303 learned_addr learned my addr 172.21.15.81:0/4052928303 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa8414c1640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa83c100b30 0x7fa83c1a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa840cc0640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa83c101450 0x7fa83c1a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa841cc2640 1 -- 172.21.15.81:0/4052928303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa83c101450 msgr2=0x7fa83c1a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa841cc2640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa83c101450 0x7fa83c1a4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa841cc2640 1 -- 172.21.15.81:0/4052928303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa83c100b30 msgr2=0x7fa83c1a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa841cc2640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa83c100b30 0x7fa83c1a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa841cc2640 1 -- 172.21.15.81:0/4052928303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c19f0a0 con 0x7fa83c105f40 2024-09-12T01:33:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.199+0000 7fa840cc0640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa83c101450 0x7fa83c1a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.200+0000 7fa841cc2640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c105f40 0x7fa83c19e970 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa83400eaa0 tx=0x7fa83400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.200+0000 7fa8327fc640 1 -- 172.21.15.81:0/4052928303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834004d20 con 0x7fa83c105f40 2024-09-12T01:33:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.200+0000 7fa843725640 1 -- 172.21.15.81:0/4052928303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83c19f390 con 0x7fa83c105f40 2024-09-12T01:33:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.200+0000 7fa8327fc640 1 -- 172.21.15.81:0/4052928303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa834005020 con 0x7fa83c105f40 2024-09-12T01:33:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.200+0000 7fa8327fc640 1 -- 172.21.15.81:0/4052928303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8340116d0 con 0x7fa83c105f40 2024-09-12T01:33:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.200+0000 7fa843725640 1 -- 172.21.15.81:0/4052928303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83c1ab680 con 0x7fa83c105f40 2024-09-12T01:33:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.202+0000 7fa8327fc640 1 -- 172.21.15.81:0/4052928303 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa8340051d0 con 0x7fa83c105f40 2024-09-12T01:33:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa845afe740 1 Processor -- start 2024-09-12T01:33:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa845afe740 1 -- start start 2024-09-12T01:33:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa845afe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2bb40 0x56419dc2a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa8327fc640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8280a2cf0 0x7fa8280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa845afe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2a5d0 0x56419dc2aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa845afe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc37760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa845afe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56419db902f0 con 0x56419dc35370 2024-09-12T01:33:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa845afe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56419db37cf0 con 0x56419dc2a5d0 2024-09-12T01:33:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa845afe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56419db8c2b0 con 0x56419dc2bb40 2024-09-12T01:33:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa841cc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc37760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa8414c1640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8280a2cf0 0x7fa8280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa841cc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc37760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34470/0 (socket says 172.21.15.81:34470) 2024-09-12T01:33:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa841cc2640 1 -- 172.21.15.81:0/3582084589 learned_addr learned my addr 172.21.15.81:0/3582084589 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa840cc0640 1 --2- 172.21.15.81:0/3582084589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2bb40 0x56419dc2a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa8327fc640 1 -- 172.21.15.81:0/4052928303 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fa8340cf6b0 con 0x7fa83c105f40 2024-09-12T01:33:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa840cc0640 1 --2- 172.21.15.81:0/3582084589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2a5d0 0x56419dc2aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa841cc2640 1 -- 172.21.15.81:0/3582084589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2bb40 msgr2=0x56419dc2a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa841cc2640 1 --2- 172.21.15.81:0/3582084589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2bb40 0x56419dc2a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa841cc2640 1 -- 172.21.15.81:0/3582084589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2a5d0 msgr2=0x56419dc2aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa841cc2640 1 --2- 172.21.15.81:0/3582084589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2a5d0 0x56419dc2aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa841cc2640 1 -- 172.21.15.81:0/3582084589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419db1c3a0 con 0x56419dc35370 2024-09-12T01:33:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.203+0000 7fa840cc0640 1 --2- 172.21.15.81:0/3582084589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2a5d0 0x56419dc2aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.204+0000 7fa841cc2640 1 --2- 172.21.15.81:0/3582084589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc37760 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa8340a4340 tx=0x7fa8340058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfe84ad0977937c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.204+0000 7fa8414c1640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8280a2cf0 0x7fa8280a51b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa83c19fab0 tx=0x7fa838009110 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.204+0000 7fa8277fe640 1 -- 172.21.15.81:0/3582084589 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83401f030 con 0x56419dc35370 2024-09-12T01:33:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.204+0000 7fa8277fe640 1 -- 172.21.15.81:0/3582084589 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa83409c300 con 0x56419dc35370 2024-09-12T01:33:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.204+0000 7fa8277fe640 1 -- 172.21.15.81:0/3582084589 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834098270 con 0x56419dc35370 2024-09-12T01:33:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.204+0000 7fa845afe740 1 -- 172.21.15.81:0/3582084589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 msgr2=0x56419dc37760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.204+0000 7fa845afe740 1 --2- 172.21.15.81:0/3582084589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc37760 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa8340a4340 tx=0x7fa8340058a0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.204+0000 7fa845afe740 1 -- 172.21.15.81:0/3582084589 shutdown_connections 2024-09-12T01:33:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.204+0000 7fa845afe740 1 --2- 172.21.15.81:0/3582084589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc37760 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.204+0000 7fa845afe740 1 --2- 172.21.15.81:0/3582084589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2a5d0 0x56419dc2aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.204+0000 7fa845afe740 1 --2- 172.21.15.81:0/3582084589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2bb40 0x56419dc2a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.204+0000 7fa845afe740 1 -- 172.21.15.81:0/3582084589 >> 172.21.15.81:0/3582084589 conn(0x56419dbf3310 msgr2=0x56419dc26c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.205+0000 7fa845afe740 1 -- 172.21.15.81:0/3582084589 shutdown_connections 2024-09-12T01:33:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.205+0000 7fa845afe740 1 -- 172.21.15.81:0/3582084589 wait complete. 2024-09-12T01:33:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.205+0000 7fa845afe740 1 -- start start 2024-09-12T01:33:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.205+0000 7fa845afe740 1 Processor -- start 2024-09-12T01:33:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.205+0000 7fa845afe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2a5d0 0x56419dc34db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa845afe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2bb40 0x56419dc32060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa845afe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc327f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa845afe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56419dc38070 con 0x56419dc35370 2024-09-12T01:33:43.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa845afe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56419db4b060 con 0x56419dc2bb40 2024-09-12T01:33:43.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa845afe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56419dc381f0 con 0x56419dc2a5d0 2024-09-12T01:33:43.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa845afe740 10 client.0 _ll_register_callbacks cb 0x56419d89e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:43.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa841cc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc327f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa841cc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc327f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34484/0 (socket says 172.21.15.81:34484) 2024-09-12T01:33:43.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa841cc2640 1 -- 172.21.15.81:0/1994722293 learned_addr learned my addr 172.21.15.81:0/1994722293 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:43.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa8414c1640 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2a5d0 0x56419dc34db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa840cc0640 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2bb40 0x56419dc32060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa841cc2640 1 -- 172.21.15.81:0/1994722293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2a5d0 msgr2=0x56419dc34db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:43.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa841cc2640 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2a5d0 0x56419dc34db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa841cc2640 1 -- 172.21.15.81:0/1994722293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2bb40 msgr2=0x56419dc32060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:43.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa841cc2640 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2bb40 0x56419dc32060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa841cc2640 1 -- 172.21.15.81:0/1994722293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419d9013c0 con 0x56419dc35370 2024-09-12T01:33:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa840cc0640 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2bb40 0x56419dc32060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa841cc2640 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc327f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa83409b900 tx=0x7fa8340984a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f9f780ebe8ea96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa824ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa824ff9640 1 -- 172.21.15.81:0/1994722293 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83401f070 con 0x56419dc35370 2024-09-12T01:33:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa824ff9640 1 -- 172.21.15.81:0/1994722293 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fa834076280 con 0x56419dc35370 2024-09-12T01:33:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa845afe740 1 -- 172.21.15.81:0/1994722293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa83409c300 con 0x56419dc35370 2024-09-12T01:33:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa824ff9640 1 -- 172.21.15.81:0/1994722293 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa83409bc00 con 0x56419dc35370 2024-09-12T01:33:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa845afe740 10 client.16791 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.206+0000 7fa845afe740 1 -- 172.21.15.81:0/1994722293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56419dc43b60 con 0x56419dc35370 2024-09-12T01:33:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.207+0000 7fa824ff9640 1 -- 172.21.15.81:0/1994722293 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa83409c300 con 0x56419dc35370 2024-09-12T01:33:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.207+0000 7fa824ff9640 1 -- 172.21.15.81:0/1994722293 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa83408e050 con 0x56419dc35370 2024-09-12T01:33:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.207+0000 7fa845afe740 10 client.16791 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.207+0000 7fa845afe740 10 client.16791 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:33:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.207+0000 7fa845afe740 20 client.16791 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.207+0000 7fa845afe740 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x56419dc44eb0 0x56419dc472a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.207+0000 7fa845afe740 4 client.16791 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.207+0000 7fa845afe740 1 -- 172.21.15.81:0/1994722293 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56419db9d860 con 0x56419dc44eb0 2024-09-12T01:33:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.208+0000 7fa8414c1640 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x56419dc44eb0 0x56419dc472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.208+0000 7fa824ff9640 10 client.16791 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:33:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.208+0000 7fa8414c1640 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x56419dc44eb0 0x56419dc472a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f6a8a05916cfb3df server_cookie=eb5941e034866e4b in_seq=0 out_seq=0 2024-09-12T01:33:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa824ff9640 1 -- 172.21.15.81:0/1994722293 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56419db9d860 con 0x56419dc44eb0 2024-09-12T01:33:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa824ff9640 10 client.16791 handle_command_reply: tid=0 2024-09-12T01:33:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa845afe740 1 client.16791 shutdown 2024-09-12T01:33:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa845afe740 1 -- 172.21.15.81:0/1994722293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 msgr2=0x56419dc327f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa845afe740 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc327f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa83409b900 tx=0x7fa8340984a0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa845afe740 1 -- 172.21.15.81:0/1994722293 shutdown_connections 2024-09-12T01:33:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa845afe740 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x56419dc44eb0 0x56419dc472a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa845afe740 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc327f0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa845afe740 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2bb40 0x56419dc32060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa824ff9640 0 client.16791 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:33:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa845afe740 1 --2- 172.21.15.81:0/1994722293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2a5d0 0x56419dc34db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa845afe740 1 -- 172.21.15.81:0/1994722293 >> 172.21.15.81:0/1994722293 conn(0x56419dbf3310 msgr2=0x56419dc2c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa845afe740 1 -- 172.21.15.81:0/1994722293 shutdown_connections 2024-09-12T01:33:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa845afe740 1 -- 172.21.15.81:0/1994722293 wait complete. 2024-09-12T01:33:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.209+0000 7fa845afe740 20 client.16791 trim_cache size 0 max 16384 2024-09-12T01:33:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.222+0000 7fa845afe740 1 Processor -- start 2024-09-12T01:33:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.222+0000 7fa845afe740 1 -- start start 2024-09-12T01:33:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.222+0000 7fa845afe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2a5d0 0x56419dc2d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.222+0000 7fa845afe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2bb40 0x56419dc2d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.222+0000 7fa845afe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc4a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.222+0000 7fa845afe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1b3eb0 con 0x56419dc35370 2024-09-12T01:33:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.222+0000 7fa845afe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1b59f0 con 0x56419dc2bb40 2024-09-12T01:33:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.222+0000 7fa845afe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1b4580 con 0x56419dc2a5d0 2024-09-12T01:33:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.222+0000 7fa841cc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc4a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.222+0000 7fa841cc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc4a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34488/0 (socket says 172.21.15.81:34488) 2024-09-12T01:33:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.222+0000 7fa841cc2640 1 -- 172.21.15.81:0/3345351413 learned_addr learned my addr 172.21.15.81:0/3345351413 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa8414c1640 1 --2- 172.21.15.81:0/3345351413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2a5d0 0x56419dc2d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa841cc2640 1 -- 172.21.15.81:0/3345351413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2a5d0 msgr2=0x56419dc2d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa841cc2640 1 --2- 172.21.15.81:0/3345351413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2a5d0 0x56419dc2d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa841cc2640 1 -- 172.21.15.81:0/3345351413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2bb40 msgr2=0x56419dc2d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa841cc2640 1 --2- 172.21.15.81:0/3345351413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2bb40 0x56419dc2d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa841cc2640 1 -- 172.21.15.81:0/3345351413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419dc27960 con 0x56419dc35370 2024-09-12T01:33:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa8414c1640 1 --2- 172.21.15.81:0/3345351413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2a5d0 0x56419dc2d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa841cc2640 1 --2- 172.21.15.81:0/3345351413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc4a2c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa834098060 tx=0x7fa834097780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9310d7dc2187da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa826ffd640 1 -- 172.21.15.81:0/3345351413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83401f070 con 0x56419dc35370 2024-09-12T01:33:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa826ffd640 1 -- 172.21.15.81:0/3345351413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8340b7020 con 0x56419dc35370 2024-09-12T01:33:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa826ffd640 1 -- 172.21.15.81:0/3345351413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834097950 con 0x56419dc35370 2024-09-12T01:33:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa845afe740 1 -- 172.21.15.81:0/3345351413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 msgr2=0x56419dc4a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa845afe740 1 --2- 172.21.15.81:0/3345351413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc4a2c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa834098060 tx=0x7fa834097780 comp rx=0 tx=0).stop 2024-09-12T01:33:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa845afe740 1 -- 172.21.15.81:0/3345351413 shutdown_connections 2024-09-12T01:33:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa845afe740 1 --2- 172.21.15.81:0/3345351413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc4a2c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa845afe740 1 --2- 172.21.15.81:0/3345351413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2bb40 0x56419dc2d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa845afe740 1 --2- 172.21.15.81:0/3345351413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2a5d0 0x56419dc2d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.223+0000 7fa845afe740 1 -- 172.21.15.81:0/3345351413 >> 172.21.15.81:0/3345351413 conn(0x56419dbf3310 msgr2=0x56419dc31150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa845afe740 1 -- 172.21.15.81:0/3345351413 shutdown_connections 2024-09-12T01:33:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa845afe740 1 -- 172.21.15.81:0/3345351413 wait complete. 2024-09-12T01:33:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa845afe740 1 -- start start 2024-09-12T01:33:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa845afe740 1 Processor -- start 2024-09-12T01:33:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa845afe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2a5d0 0x56419dc4aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa845afe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2bb40 0x56419dc47ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa845afe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc48680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa845afe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1b5320 con 0x56419dc35370 2024-09-12T01:33:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa845afe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1b4c50 con 0x56419dc2a5d0 2024-09-12T01:33:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa845afe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c1b1e90 con 0x56419dc2bb40 2024-09-12T01:33:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa845afe740 10 client.0 _ll_register_callbacks cb 0x7fa83c06b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa841cc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc48680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa841cc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc48680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34496/0 (socket says 172.21.15.81:34496) 2024-09-12T01:33:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa841cc2640 1 -- 172.21.15.81:0/4169113677 learned_addr learned my addr 172.21.15.81:0/4169113677 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.224+0000 7fa8414c1640 1 --2- 172.21.15.81:0/4169113677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2a5d0 0x56419dc4aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa840cc0640 1 --2- 172.21.15.81:0/4169113677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2bb40 0x56419dc47ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa841cc2640 1 -- 172.21.15.81:0/4169113677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2bb40 msgr2=0x56419dc47ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa841cc2640 1 --2- 172.21.15.81:0/4169113677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2bb40 0x56419dc47ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa841cc2640 1 -- 172.21.15.81:0/4169113677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2a5d0 msgr2=0x56419dc4aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa841cc2640 1 --2- 172.21.15.81:0/4169113677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2a5d0 0x56419dc4aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa841cc2640 1 -- 172.21.15.81:0/4169113677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419dcae7f0 con 0x56419dc35370 2024-09-12T01:33:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa841cc2640 1 --2- 172.21.15.81:0/4169113677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc48680 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa834099eb0 tx=0x7fa83409b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f0300fca09e40f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa824ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa824ff9640 1 -- 172.21.15.81:0/4169113677 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83401f030 con 0x56419dc35370 2024-09-12T01:33:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa824ff9640 1 -- 172.21.15.81:0/4169113677 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fa83400cd00 con 0x56419dc35370 2024-09-12T01:33:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa845afe740 1 -- 172.21.15.81:0/4169113677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8340b7020 con 0x56419dc35370 2024-09-12T01:33:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa824ff9640 1 -- 172.21.15.81:0/4169113677 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa83409ffb0 con 0x56419dc35370 2024-09-12T01:33:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa845afe740 10 client.16797 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa845afe740 1 -- 172.21.15.81:0/4169113677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56419dcae7f0 con 0x56419dc35370 2024-09-12T01:33:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa824ff9640 1 -- 172.21.15.81:0/4169113677 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8340b7020 con 0x56419dc35370 2024-09-12T01:33:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.225+0000 7fa824ff9640 1 -- 172.21.15.81:0/4169113677 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa83400f040 con 0x56419dc35370 2024-09-12T01:33:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.226+0000 7fa845afe740 10 client.16797 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.226+0000 7fa845afe740 10 client.16797 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:33:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.226+0000 7fa845afe740 20 client.16797 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.226+0000 7fa845afe740 1 --2- 172.21.15.81:0/4169113677 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x56419dcafba0 0x56419dcb1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.226+0000 7fa845afe740 4 client.16797 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:33:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.226+0000 7fa845afe740 1 -- 172.21.15.81:0/4169113677 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56419db97d70 con 0x56419dcafba0 2024-09-12T01:33:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.226+0000 7fa8414c1640 1 --2- 172.21.15.81:0/4169113677 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x56419dcafba0 0x56419dcb1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.226+0000 7fa8414c1640 1 --2- 172.21.15.81:0/4169113677 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x56419dcafba0 0x56419dcb1f90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9a86db642d42429a server_cookie=53d2365f4c97f2af in_seq=0 out_seq=0 2024-09-12T01:33:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.226+0000 7fa824ff9640 10 client.16797 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:33:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.226+0000 7fa824ff9640 1 -- 172.21.15.81:0/4169113677 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56419db97d70 con 0x56419dcafba0 2024-09-12T01:33:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.226+0000 7fa824ff9640 10 client.16797 handle_command_reply: tid=0 2024-09-12T01:33:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.226+0000 7fa845afe740 1 client.16797 shutdown 2024-09-12T01:33:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa845afe740 1 -- 172.21.15.81:0/4169113677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 msgr2=0x56419dc48680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa845afe740 1 --2- 172.21.15.81:0/4169113677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc48680 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa834099eb0 tx=0x7fa83409b4a0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa845afe740 1 -- 172.21.15.81:0/4169113677 shutdown_connections 2024-09-12T01:33:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa845afe740 1 --2- 172.21.15.81:0/4169113677 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x56419dcafba0 0x56419dcb1f90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa845afe740 1 --2- 172.21.15.81:0/4169113677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56419dc35370 0x56419dc48680 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa845afe740 1 --2- 172.21.15.81:0/4169113677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56419dc2bb40 0x56419dc47ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa824ff9640 0 client.16797 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:33:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa845afe740 1 --2- 172.21.15.81:0/4169113677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56419dc2a5d0 0x56419dc4aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa845afe740 1 -- 172.21.15.81:0/4169113677 >> 172.21.15.81:0/4169113677 conn(0x56419dbf3310 msgr2=0x56419dc40480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa845afe740 1 -- 172.21.15.81:0/4169113677 shutdown_connections 2024-09-12T01:33:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa845afe740 1 -- 172.21.15.81:0/4169113677 wait complete. 2024-09-12T01:33:43.251 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:33:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa845afe740 20 client.16797 trim_cache size 0 max 16384 2024-09-12T01:33:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa843725640 1 -- 172.21.15.81:0/4052928303 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8280a2cf0 msgr2=0x7fa8280a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa843725640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8280a2cf0 0x7fa8280a51b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa83c19fab0 tx=0x7fa838009110 comp rx=0 tx=0).stop 2024-09-12T01:33:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa843725640 1 -- 172.21.15.81:0/4052928303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c105f40 msgr2=0x7fa83c19e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa843725640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c105f40 0x7fa83c19e970 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa83400eaa0 tx=0x7fa83400eea0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa843725640 1 -- 172.21.15.81:0/4052928303 shutdown_connections 2024-09-12T01:33:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa843725640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8280a2cf0 0x7fa8280a51b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa843725640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c105f40 0x7fa83c19e970 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa843725640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa83c101450 0x7fa83c1a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa843725640 1 --2- 172.21.15.81:0/4052928303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa83c100b30 0x7fa83c1a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa843725640 1 -- 172.21.15.81:0/4052928303 >> 172.21.15.81:0/4052928303 conn(0x7fa83c0fc7a0 msgr2=0x7fa83c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa843725640 1 -- 172.21.15.81:0/4052928303 shutdown_connections 2024-09-12T01:33:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:43.227+0000 7fa843725640 1 -- 172.21.15.81:0/4052928303 wait complete. 2024-09-12T01:33:43.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:43 smithi100 ceph-mon[35275]: pgmap v172: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:43.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:43 smithi189 ceph-mon[35357]: pgmap v172: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:44.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:33:44.271 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.722+0000 7f73332c8640 1 -- 172.21.15.81:0/1563007983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f732c1082a0 msgr2=0x7f732c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:44.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.722+0000 7f73332c8640 1 --2- 172.21.15.81:0/1563007983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f732c1082a0 0x7f732c10ec40 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7324009930 tx=0x7f732402a420 comp rx=0 tx=0).stop 2024-09-12T01:33:44.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.722+0000 7f73332c8640 1 -- 172.21.15.81:0/1563007983 shutdown_connections 2024-09-12T01:33:44.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.722+0000 7f73332c8640 1 --2- 172.21.15.81:0/1563007983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f732c1082a0 0x7f732c10ec40 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.722+0000 7f73332c8640 1 --2- 172.21.15.81:0/1563007983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c1036e0 0x7f732c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.722+0000 7f73332c8640 1 --2- 172.21.15.81:0/1563007983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f732c102d30 0x7f732c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.722+0000 7f73332c8640 1 -- 172.21.15.81:0/1563007983 >> 172.21.15.81:0/1563007983 conn(0x7f732c0fc7d0 msgr2=0x7f732c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:44.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.722+0000 7f73332c8640 1 -- 172.21.15.81:0/1563007983 shutdown_connections 2024-09-12T01:33:44.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.722+0000 7f73332c8640 1 -- 172.21.15.81:0/1563007983 wait complete. 2024-09-12T01:33:44.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.722+0000 7f73332c8640 1 Processor -- start 2024-09-12T01:33:44.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.722+0000 7f73332c8640 1 -- start start 2024-09-12T01:33:44.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f73332c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f732c102d30 0x7f732c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f73332c8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f732c1036e0 0x7f732c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f73332c8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c1082a0 0x7f732c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f73332c8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f732c112100 con 0x7f732c102d30 2024-09-12T01:33:44.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f73332c8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f732c111f80 con 0x7f732c1082a0 2024-09-12T01:33:44.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f73332c8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f732c112280 con 0x7f732c1036e0 2024-09-12T01:33:44.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f7331064640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f732c102d30 0x7f732c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f7331064640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f732c102d30 0x7f732c198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34508/0 (socket says 172.21.15.81:34508) 2024-09-12T01:33:44.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f7331064640 1 -- 172.21.15.81:0/545555745 learned_addr learned my addr 172.21.15.81:0/545555745 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:44.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f7331865640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c1082a0 0x7f732c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f7330863640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f732c1036e0 0x7f732c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f7331064640 1 -- 172.21.15.81:0/545555745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f732c1036e0 msgr2=0x7f732c198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:44.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f7331064640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f732c1036e0 0x7f732c198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f7331064640 1 -- 172.21.15.81:0/545555745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c1082a0 msgr2=0x7f732c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f7331064640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c1082a0 0x7f732c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f7331064640 1 -- 172.21.15.81:0/545555745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c19d500 con 0x7f732c102d30 2024-09-12T01:33:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f7331064640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f732c102d30 0x7f732c198550 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f731c00ba50 tx=0x7f731c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f732a7fc640 1 -- 172.21.15.81:0/545555745 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c019070 con 0x7f732c102d30 2024-09-12T01:33:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f732a7fc640 1 -- 172.21.15.81:0/545555745 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f731c00cbe0 con 0x7f732c102d30 2024-09-12T01:33:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f73332c8640 1 -- 172.21.15.81:0/545555745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732c19d7f0 con 0x7f732c102d30 2024-09-12T01:33:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f732a7fc640 1 -- 172.21.15.81:0/545555745 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c0076e0 con 0x7f732c102d30 2024-09-12T01:33:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.723+0000 7f73332c8640 1 -- 172.21.15.81:0/545555745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f732c1a50d0 con 0x7f732c102d30 2024-09-12T01:33:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.726+0000 7f732a7fc640 1 -- 172.21.15.81:0/545555745 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f731c01c070 con 0x7f732c102d30 2024-09-12T01:33:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.726+0000 7f73356a1740 1 Processor -- start 2024-09-12T01:33:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.726+0000 7f73356a1740 1 -- start start 2024-09-12T01:33:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.726+0000 7f73356a1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 0x55c31ee7f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.726+0000 7f73356a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee7fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.726+0000 7f73356a1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee8c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.726+0000 7f73356a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c31ede52f0 con 0x55c31ee7f5d0 2024-09-12T01:33:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.726+0000 7f73356a1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c31ed8ccf0 con 0x55c31ee8a370 2024-09-12T01:33:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.726+0000 7f73356a1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c31ede12b0 con 0x55c31ee80b40 2024-09-12T01:33:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f732a7fc640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f73140a2cf0 0x7f73140a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7331064640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee7fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7331064640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee7fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34514/0 (socket says 172.21.15.81:34514) 2024-09-12T01:33:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7331064640 1 -- 172.21.15.81:0/3163772080 learned_addr learned my addr 172.21.15.81:0/3163772080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7331865640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f73140a2cf0 0x7f73140a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7330863640 1 --2- 172.21.15.81:0/3163772080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee8c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7331865640 1 --2- 172.21.15.81:0/3163772080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 0x55c31ee7f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f732a7fc640 1 -- 172.21.15.81:0/545555745 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f731c0ce9e0 con 0x7f732c102d30 2024-09-12T01:33:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7331064640 1 -- 172.21.15.81:0/3163772080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 msgr2=0x55c31ee7f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:44.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7331064640 1 --2- 172.21.15.81:0/3163772080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 0x55c31ee7f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7331064640 1 -- 172.21.15.81:0/3163772080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 msgr2=0x55c31ee8c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:44.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7331064640 1 --2- 172.21.15.81:0/3163772080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee8c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7331064640 1 -- 172.21.15.81:0/3163772080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31ed713a0 con 0x55c31ee7f5d0 2024-09-12T01:33:44.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7331865640 1 --2- 172.21.15.81:0/3163772080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 0x55c31ee7f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:44.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7331064640 1 --2- 172.21.15.81:0/3163772080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee7fa10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f731c00ba20 tx=0x7f731c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba88287f9831a66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:44.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f7331865640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f73140a2cf0 0x7f73140a51b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7324005940 tx=0x7f73240058b0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:44.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f73137fe640 1 -- 172.21.15.81:0/3163772080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c0bb110 con 0x55c31ee7f5d0 2024-09-12T01:33:44.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f73137fe640 1 -- 172.21.15.81:0/3163772080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f731c09b740 con 0x55c31ee7f5d0 2024-09-12T01:33:44.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.727+0000 7f73137fe640 1 -- 172.21.15.81:0/3163772080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c0976b0 con 0x55c31ee7f5d0 2024-09-12T01:33:44.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.728+0000 7f73356a1740 1 -- 172.21.15.81:0/3163772080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 msgr2=0x55c31ee7fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:44.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.728+0000 7f73356a1740 1 --2- 172.21.15.81:0/3163772080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee7fa10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f731c00ba20 tx=0x7f731c004b50 comp rx=0 tx=0).stop 2024-09-12T01:33:44.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.728+0000 7f73356a1740 1 -- 172.21.15.81:0/3163772080 shutdown_connections 2024-09-12T01:33:44.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.728+0000 7f73356a1740 1 --2- 172.21.15.81:0/3163772080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee8c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.728+0000 7f73356a1740 1 --2- 172.21.15.81:0/3163772080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee7fa10 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.728+0000 7f73356a1740 1 --2- 172.21.15.81:0/3163772080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 0x55c31ee7f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.728+0000 7f73356a1740 1 -- 172.21.15.81:0/3163772080 >> 172.21.15.81:0/3163772080 conn(0x55c31ee48310 msgr2=0x55c31ee7bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:44.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.728+0000 7f73356a1740 1 -- 172.21.15.81:0/3163772080 shutdown_connections 2024-09-12T01:33:44.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.728+0000 7f73356a1740 1 -- 172.21.15.81:0/3163772080 wait complete. 2024-09-12T01:33:44.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.728+0000 7f73356a1740 1 -- start start 2024-09-12T01:33:44.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f73356a1740 1 Processor -- start 2024-09-12T01:33:44.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f73356a1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee7f5d0 0x55c31ee89de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f73356a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee80b40 0x55c31ee87090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f73356a1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee877d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f73356a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c31ee8d010 con 0x55c31ee80b40 2024-09-12T01:33:44.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f73356a1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c31eda0060 con 0x55c31ee8a370 2024-09-12T01:33:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f73356a1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c31ee8d190 con 0x55c31ee7f5d0 2024-09-12T01:33:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f73356a1740 10 client.0 _ll_register_callbacks cb 0x55c31eaf38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f7330863640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee80b40 0x55c31ee87090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f7330863640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee80b40 0x55c31ee87090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34516/0 (socket says 172.21.15.81:34516) 2024-09-12T01:33:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f7330863640 1 -- 172.21.15.81:0/1225811983 learned_addr learned my addr 172.21.15.81:0/1225811983 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f7331865640 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee877d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f7331064640 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee7f5d0 0x55c31ee89de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f7330863640 1 -- 172.21.15.81:0/1225811983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee7f5d0 msgr2=0x55c31ee89de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f7330863640 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee7f5d0 0x55c31ee89de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f7330863640 1 -- 172.21.15.81:0/1225811983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 msgr2=0x55c31ee877d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f7330863640 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee877d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f7330863640 1 -- 172.21.15.81:0/1225811983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c31eb563c0 con 0x55c31ee80b40 2024-09-12T01:33:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f7331064640 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee7f5d0 0x55c31ee89de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.729+0000 7f7331865640 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee877d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f7330863640 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee80b40 0x55c31ee87090 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f732000cd60 tx=0x7f73200039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0ef1b70c042b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f7310ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f7310ff9640 1 -- 172.21.15.81:0/1225811983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320011910 con 0x55c31ee80b40 2024-09-12T01:33:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f7310ff9640 1 -- 172.21.15.81:0/1225811983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7320011ab0 con 0x55c31ee80b40 2024-09-12T01:33:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f73356a1740 1 -- 172.21.15.81:0/1225811983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f731c09b740 con 0x55c31ee80b40 2024-09-12T01:33:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f7310ff9640 1 -- 172.21.15.81:0/1225811983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7320011cb0 con 0x55c31ee80b40 2024-09-12T01:33:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f73356a1740 10 client.16809 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f73356a1740 1 -- 172.21.15.81:0/1225811983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c31ee98ba0 con 0x55c31ee80b40 2024-09-12T01:33:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f7310ff9640 1 -- 172.21.15.81:0/1225811983 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f731c09b740 con 0x55c31ee80b40 2024-09-12T01:33:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f7310ff9640 1 -- 172.21.15.81:0/1225811983 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7320018070 con 0x55c31ee80b40 2024-09-12T01:33:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f73356a1740 10 client.16809 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f73356a1740 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f73356a1740 20 client.16809 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f73356a1740 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c31ee9a100 0x55c31ee9c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f73356a1740 4 client.16809 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.730+0000 7f73356a1740 1 -- 172.21.15.81:0/1225811983 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c31edf2860 con 0x55c31ee9a100 2024-09-12T01:33:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.731+0000 7f7331064640 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c31ee9a100 0x55c31ee9c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.731+0000 7f7310ff9640 10 client.16809 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.731+0000 7f7331064640 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c31ee9a100 0x55c31ee9c540 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7fd092e8adb330a server_cookie=75593c1f95914038 in_seq=0 out_seq=0 2024-09-12T01:33:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f7310ff9640 1 -- 172.21.15.81:0/1225811983 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c31edf2860 con 0x55c31ee9a100 2024-09-12T01:33:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f7310ff9640 10 client.16809 handle_command_reply: tid=0 2024-09-12T01:33:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f73356a1740 1 client.16809 shutdown 2024-09-12T01:33:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f73356a1740 1 -- 172.21.15.81:0/1225811983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee80b40 msgr2=0x55c31ee87090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f73356a1740 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee80b40 0x55c31ee87090 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f732000cd60 tx=0x7f73200039c0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f73356a1740 1 -- 172.21.15.81:0/1225811983 shutdown_connections 2024-09-12T01:33:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f73356a1740 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c31ee9a100 0x55c31ee9c540 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f73356a1740 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee877d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f73356a1740 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee80b40 0x55c31ee87090 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f73356a1740 1 --2- 172.21.15.81:0/1225811983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee7f5d0 0x55c31ee89de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f7310ff9640 0 client.16809 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f73356a1740 1 -- 172.21.15.81:0/1225811983 >> 172.21.15.81:0/1225811983 conn(0x55c31ee48310 msgr2=0x55c31ee81990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f73356a1740 1 -- 172.21.15.81:0/1225811983 shutdown_connections 2024-09-12T01:33:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f73356a1740 1 -- 172.21.15.81:0/1225811983 wait complete. 2024-09-12T01:33:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.732+0000 7f73356a1740 20 client.16809 trim_cache size 0 max 16384 2024-09-12T01:33:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f73356a1740 1 Processor -- start 2024-09-12T01:33:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f73356a1740 1 -- start start 2024-09-12T01:33:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f73356a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee962b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f73356a1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 0x55c31ee89000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f73356a1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31eea1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f73356a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f732c1ad800 con 0x55c31ee7f5d0 2024-09-12T01:33:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f73356a1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f732c1af340 con 0x55c31ee8a370 2024-09-12T01:33:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f73356a1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f732c1aded0 con 0x55c31ee80b40 2024-09-12T01:33:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f7331064640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f7331064640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee962b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34524/0 (socket says 172.21.15.81:34524) 2024-09-12T01:33:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f7331064640 1 -- 172.21.15.81:0/1785881041 learned_addr learned my addr 172.21.15.81:0/1785881041 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f7331064640 1 -- 172.21.15.81:0/1785881041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 msgr2=0x55c31ee89000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f7331064640 1 --2- 172.21.15.81:0/1785881041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 0x55c31ee89000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f7331064640 1 -- 172.21.15.81:0/1785881041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 msgr2=0x55c31eea1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f7331064640 1 --2- 172.21.15.81:0/1785881041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31eea1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f7331064640 1 -- 172.21.15.81:0/1785881041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31ee7c960 con 0x55c31ee7f5d0 2024-09-12T01:33:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.745+0000 7f7331064640 1 --2- 172.21.15.81:0/1785881041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee962b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f731c097a10 tx=0x7f731c0a9050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23631495ee2d1b4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.746+0000 7f7312ffd640 1 -- 172.21.15.81:0/1785881041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c079e60 con 0x55c31ee7f5d0 2024-09-12T01:33:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.746+0000 7f7312ffd640 1 -- 172.21.15.81:0/1785881041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f731c0a3cb0 con 0x55c31ee7f5d0 2024-09-12T01:33:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.746+0000 7f7312ffd640 1 -- 172.21.15.81:0/1785881041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c09f110 con 0x55c31ee7f5d0 2024-09-12T01:33:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.746+0000 7f73356a1740 1 -- 172.21.15.81:0/1785881041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 msgr2=0x55c31ee962b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.746+0000 7f73356a1740 1 --2- 172.21.15.81:0/1785881041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee962b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f731c097a10 tx=0x7f731c0a9050 comp rx=0 tx=0).stop 2024-09-12T01:33:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.746+0000 7f73356a1740 1 -- 172.21.15.81:0/1785881041 shutdown_connections 2024-09-12T01:33:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.746+0000 7f73356a1740 1 --2- 172.21.15.81:0/1785881041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31eea1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.746+0000 7f73356a1740 1 --2- 172.21.15.81:0/1785881041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 0x55c31ee89000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.746+0000 7f73356a1740 1 --2- 172.21.15.81:0/1785881041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee962b0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.746+0000 7f73356a1740 1 -- 172.21.15.81:0/1785881041 >> 172.21.15.81:0/1785881041 conn(0x55c31ee48310 msgr2=0x55c31ee888f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.746+0000 7f73356a1740 1 -- 172.21.15.81:0/1785881041 shutdown_connections 2024-09-12T01:33:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.746+0000 7f73356a1740 1 -- 172.21.15.81:0/1785881041 wait complete. 2024-09-12T01:33:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f73356a1740 1 -- start start 2024-09-12T01:33:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f73356a1740 1 Processor -- start 2024-09-12T01:33:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f73356a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee8e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f73356a1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 0x55c31ee8e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f73356a1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee8ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f73356a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f732c1aec70 con 0x55c31ee7f5d0 2024-09-12T01:33:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f73356a1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f732c1ae5a0 con 0x55c31ee8a370 2024-09-12T01:33:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f73356a1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f732c1ab7e0 con 0x55c31ee80b40 2024-09-12T01:33:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f73356a1740 10 client.0 _ll_register_callbacks cb 0x7f7320004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f7331064640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee8e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f7331064640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee8e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34526/0 (socket says 172.21.15.81:34526) 2024-09-12T01:33:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f7331064640 1 -- 172.21.15.81:0/2308862331 learned_addr learned my addr 172.21.15.81:0/2308862331 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f7331865640 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee8ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f7330863640 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 0x55c31ee8e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f7331064640 1 -- 172.21.15.81:0/2308862331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 msgr2=0x55c31ee8e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f7331064640 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 0x55c31ee8e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f7331064640 1 -- 172.21.15.81:0/2308862331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 msgr2=0x55c31ee8ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f7331064640 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee8ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f7331064640 1 -- 172.21.15.81:0/2308862331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c31ef03de0 con 0x55c31ee7f5d0 2024-09-12T01:33:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f7331865640 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee8ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.747+0000 7f7330863640 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 0x55c31ee8e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f7331064640 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee8e170 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f731c0cc2d0 tx=0x7f731c099440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e36d0340863cfcb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f7310ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f7310ff9640 1 -- 172.21.15.81:0/2308862331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c09b040 con 0x55c31ee7f5d0 2024-09-12T01:33:44.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f7310ff9640 1 -- 172.21.15.81:0/2308862331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f731c0cc3e0 con 0x55c31ee7f5d0 2024-09-12T01:33:44.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f73356a1740 1 -- 172.21.15.81:0/2308862331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c31edecd70 con 0x55c31ee7f5d0 2024-09-12T01:33:44.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f7310ff9640 1 -- 172.21.15.81:0/2308862331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f731c09b740 con 0x55c31ee7f5d0 2024-09-12T01:33:44.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f73356a1740 10 client.16815 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:44.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f73356a1740 1 -- 172.21.15.81:0/2308862331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c31ef05060 con 0x55c31ee7f5d0 2024-09-12T01:33:44.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f7310ff9640 1 -- 172.21.15.81:0/2308862331 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c31edecd70 con 0x55c31ee7f5d0 2024-09-12T01:33:44.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f7310ff9640 1 -- 172.21.15.81:0/2308862331 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f731c095bb0 con 0x55c31ee7f5d0 2024-09-12T01:33:44.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f73356a1740 10 client.16815 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:44.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f73356a1740 10 client.16815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f73356a1740 20 client.16815 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f73356a1740 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c31ef052d0 0x55c31ef076c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f73356a1740 4 client.16815 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:33:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.748+0000 7f73356a1740 1 -- 172.21.15.81:0/2308862331 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c31ed69170 con 0x55c31ef052d0 2024-09-12T01:33:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f7330863640 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c31ef052d0 0x55c31ef076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f7310ff9640 10 client.16815 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f7330863640 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c31ef052d0 0x55c31ef076c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdfec689eb4165ae server_cookie=820421f2b2933881 in_seq=0 out_seq=0 2024-09-12T01:33:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f7310ff9640 1 -- 172.21.15.81:0/2308862331 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c31ed69170 con 0x55c31ef052d0 2024-09-12T01:33:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f7310ff9640 10 client.16815 handle_command_reply: tid=0 2024-09-12T01:33:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f73356a1740 1 client.16815 shutdown 2024-09-12T01:33:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f73356a1740 1 -- 172.21.15.81:0/2308862331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 msgr2=0x55c31ee8e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f73356a1740 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee8e170 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f731c0cc2d0 tx=0x7f731c099440 comp rx=0 tx=0).stop 2024-09-12T01:33:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f73356a1740 1 -- 172.21.15.81:0/2308862331 shutdown_connections 2024-09-12T01:33:44.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f73356a1740 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c31ef052d0 0x55c31ef076c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f73356a1740 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c31ee8a370 0x55c31ee8ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f73356a1740 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c31ee80b40 0x55c31ee8e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f73356a1740 1 --2- 172.21.15.81:0/2308862331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c31ee7f5d0 0x55c31ee8e170 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.749+0000 7f73356a1740 1 -- 172.21.15.81:0/2308862331 >> 172.21.15.81:0/2308862331 conn(0x55c31ee48310 msgr2=0x55c31ee89110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:44.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f7310ff9640 0 client.16815 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:44.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f73356a1740 1 -- 172.21.15.81:0/2308862331 shutdown_connections 2024-09-12T01:33:44.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f73356a1740 1 -- 172.21.15.81:0/2308862331 wait complete. 2024-09-12T01:33:44.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f73356a1740 20 client.16815 trim_cache size 0 max 16384 2024-09-12T01:33:44.770 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:33:44.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f73332c8640 1 -- 172.21.15.81:0/545555745 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f73140a2cf0 msgr2=0x7f73140a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:44.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f73332c8640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f73140a2cf0 0x7f73140a51b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7324005940 tx=0x7f73240058b0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f73332c8640 1 -- 172.21.15.81:0/545555745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f732c102d30 msgr2=0x7f732c198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:44.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f73332c8640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f732c102d30 0x7f732c198550 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f731c00ba50 tx=0x7f731c00bf10 comp rx=0 tx=0).stop 2024-09-12T01:33:44.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f73332c8640 1 -- 172.21.15.81:0/545555745 shutdown_connections 2024-09-12T01:33:44.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f73332c8640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f73140a2cf0 0x7f73140a51b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f73332c8640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732c1082a0 0x7f732c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f73332c8640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f732c1036e0 0x7f732c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f73332c8640 1 --2- 172.21.15.81:0/545555745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f732c102d30 0x7f732c198550 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:44.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.750+0000 7f73332c8640 1 -- 172.21.15.81:0/545555745 >> 172.21.15.81:0/545555745 conn(0x7f732c0fc7d0 msgr2=0x7f732c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:44.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.751+0000 7f73332c8640 1 -- 172.21.15.81:0/545555745 shutdown_connections 2024-09-12T01:33:44.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:44.751+0000 7f73332c8640 1 -- 172.21.15.81:0/545555745 wait complete. 2024-09-12T01:33:45.454 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:45 smithi081 ceph-mon[30920]: pgmap v173: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:45.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:45 smithi100 ceph-mon[35275]: pgmap v173: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:45.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:45 smithi189 ceph-mon[35357]: pgmap v173: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:46.483 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:33:46.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:33:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.217+0000 7f60d9c47640 1 -- 172.21.15.81:0/1437349188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60d4101de0 msgr2=0x7f60d41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.217+0000 7f60d9c47640 1 --2- 172.21.15.81:0/1437349188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60d4101de0 0x7f60d41021c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009900 tx=0x7f60c402a410 comp rx=0 tx=0).stop 2024-09-12T01:33:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.217+0000 7f60d9c47640 1 -- 172.21.15.81:0/1437349188 shutdown_connections 2024-09-12T01:33:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.217+0000 7f60d9c47640 1 --2- 172.21.15.81:0/1437349188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60d4106f10 0x7f60d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.217+0000 7f60d9c47640 1 --2- 172.21.15.81:0/1437349188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60d4102790 0x7f60d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.217+0000 7f60d9c47640 1 --2- 172.21.15.81:0/1437349188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60d4101de0 0x7f60d41021c0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.217+0000 7f60d9c47640 1 -- 172.21.15.81:0/1437349188 >> 172.21.15.81:0/1437349188 conn(0x7f60d40fd8c0 msgr2=0x7f60d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.217+0000 7f60d9c47640 1 -- 172.21.15.81:0/1437349188 shutdown_connections 2024-09-12T01:33:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.217+0000 7f60d9c47640 1 -- 172.21.15.81:0/1437349188 wait complete. 2024-09-12T01:33:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.218+0000 7f60d9c47640 1 Processor -- start 2024-09-12T01:33:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.218+0000 7f60d9c47640 1 -- start start 2024-09-12T01:33:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.218+0000 7f60d9c47640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60d4101de0 0x7f60d40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.218+0000 7f60d9c47640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60d4102790 0x7f60d4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.218+0000 7f60d9c47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60d4106f10 0x7f60d4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.218+0000 7f60d9c47640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60d4111f70 con 0x7f60d4106f10 2024-09-12T01:33:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.218+0000 7f60d9c47640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f60d4111df0 con 0x7f60d4102790 2024-09-12T01:33:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.218+0000 7f60d9c47640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f60d41120f0 con 0x7f60d4101de0 2024-09-12T01:33:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60d4106f10 0x7f60d4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60d4106f10 0x7f60d4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34538/0 (socket says 172.21.15.81:34538) 2024-09-12T01:33:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d3fff640 1 -- 172.21.15.81:0/1084611285 learned_addr learned my addr 172.21.15.81:0/1084611285 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:47.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60d4102790 0x7f60d4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d37fe640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60d4101de0 0x7f60d40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d3fff640 1 -- 172.21.15.81:0/1084611285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60d4101de0 msgr2=0x7f60d40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d3fff640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60d4101de0 0x7f60d40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d3fff640 1 -- 172.21.15.81:0/1084611285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60d4102790 msgr2=0x7f60d4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d3fff640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60d4102790 0x7f60d4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d3fff640 1 -- 172.21.15.81:0/1084611285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d41a6890 con 0x7f60d4106f10 2024-09-12T01:33:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d3fff640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60d4106f10 0x7f60d4074f70 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00cce0 tx=0x7f60cc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d0ff9640 1 -- 172.21.15.81:0/1084611285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc00f450 con 0x7f60d4106f10 2024-09-12T01:33:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d9c47640 1 -- 172.21.15.81:0/1084611285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d41a6b80 con 0x7f60d4106f10 2024-09-12T01:33:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d0ff9640 1 -- 172.21.15.81:0/1084611285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60cc00fad0 con 0x7f60d4106f10 2024-09-12T01:33:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d0ff9640 1 -- 172.21.15.81:0/1084611285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc018c10 con 0x7f60d4106f10 2024-09-12T01:33:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.219+0000 7f60d9c47640 1 -- 172.21.15.81:0/1084611285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d41a70c0 con 0x7f60d4106f10 2024-09-12T01:33:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.221+0000 7f60d0ff9640 1 -- 172.21.15.81:0/1084611285 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f60cc00f5f0 con 0x7f60d4106f10 2024-09-12T01:33:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60dc020740 1 Processor -- start 2024-09-12T01:33:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60dc020740 1 -- start start 2024-09-12T01:33:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60dc020740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 0x55b73375bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60dc020740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 0x55b733766800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60dc020740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b733766d40 0x55b733769130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60dc020740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7336c1280 con 0x55b73375c480 2024-09-12T01:33:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60dc020740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b733668b10 con 0x55b73375bb60 2024-09-12T01:33:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60dc020740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7336bd240 con 0x55b733766d40 2024-09-12T01:33:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 0x55b733766800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 0x55b733766800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34554/0 (socket says 172.21.15.81:34554) 2024-09-12T01:33:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d37fe640 1 -- 172.21.15.81:0/1203668434 learned_addr learned my addr 172.21.15.81:0/1203668434 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d0ff9640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f60bc0a2cf0 0x7f60bc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/1203668434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 0x55b73375bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/1203668434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b733766d40 0x55b733769130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d37fe640 1 -- 172.21.15.81:0/1203668434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b733766d40 msgr2=0x55b733769130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d37fe640 1 --2- 172.21.15.81:0/1203668434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b733766d40 0x55b733769130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d37fe640 1 -- 172.21.15.81:0/1203668434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 msgr2=0x55b73375bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d37fe640 1 --2- 172.21.15.81:0/1203668434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 0x55b73375bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d37fe640 1 -- 172.21.15.81:0/1203668434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7336751f0 con 0x55b73375c480 2024-09-12T01:33:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/1203668434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b733766d40 0x55b733769130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d3fff640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f60bc0a2cf0 0x7f60bc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.222+0000 7f60d0ff9640 1 -- 172.21.15.81:0/1084611285 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f60cc0cf9f0 con 0x7f60d4106f10 2024-09-12T01:33:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.223+0000 7f60d37fe640 1 --2- 172.21.15.81:0/1203668434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 0x55b733766800 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009900 tx=0x7f60c4031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b9311799a99749 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.223+0000 7f60b9ffb640 1 -- 172.21.15.81:0/1203668434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c4040070 con 0x55b73375c480 2024-09-12T01:33:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.223+0000 7f60b9ffb640 1 -- 172.21.15.81:0/1203668434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60c4005020 con 0x55b73375c480 2024-09-12T01:33:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.223+0000 7f60b9ffb640 1 -- 172.21.15.81:0/1203668434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c4035040 con 0x55b73375c480 2024-09-12T01:33:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.223+0000 7f60dc020740 1 -- 172.21.15.81:0/1203668434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 msgr2=0x55b733766800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.223+0000 7f60d3fff640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f60bc0a2cf0 0x7f60bc0a51b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0cd220 tx=0x7f60cc066b70 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.224+0000 7f60dc020740 1 --2- 172.21.15.81:0/1203668434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 0x55b733766800 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009900 tx=0x7f60c4031630 comp rx=0 tx=0).stop 2024-09-12T01:33:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.224+0000 7f60dc020740 1 -- 172.21.15.81:0/1203668434 shutdown_connections 2024-09-12T01:33:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.224+0000 7f60dc020740 1 --2- 172.21.15.81:0/1203668434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b733766d40 0x55b733769130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.224+0000 7f60dc020740 1 --2- 172.21.15.81:0/1203668434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 0x55b733766800 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.224+0000 7f60dc020740 1 --2- 172.21.15.81:0/1203668434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 0x55b73375bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.224+0000 7f60dc020740 1 -- 172.21.15.81:0/1203668434 >> 172.21.15.81:0/1203668434 conn(0x55b7337580f0 msgr2=0x55b7337584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.224+0000 7f60dc020740 1 -- 172.21.15.81:0/1203668434 shutdown_connections 2024-09-12T01:33:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.224+0000 7f60dc020740 1 -- 172.21.15.81:0/1203668434 wait complete. 2024-09-12T01:33:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.224+0000 7f60dc020740 1 -- start start 2024-09-12T01:33:47.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.224+0000 7f60dc020740 1 Processor -- start 2024-09-12T01:33:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60dc020740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 0x55b733763b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60dc020740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 0x55b7337640a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60dc020740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b733766d40 0x55b7337645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60dc020740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b733769910 con 0x55b73375c480 2024-09-12T01:33:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60dc020740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b73367bf10 con 0x55b73375bb60 2024-09-12T01:33:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60dc020740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b733769a90 con 0x55b733766d40 2024-09-12T01:33:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60dc020740 10 client.0 _ll_register_callbacks cb 0x55b733644a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60d37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 0x55b7337640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60d37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 0x55b7337640a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34564/0 (socket says 172.21.15.81:34564) 2024-09-12T01:33:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60d37fe640 1 -- 172.21.15.81:0/1238888791 learned_addr learned my addr 172.21.15.81:0/1238888791 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/1238888791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 0x55b733763b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/1238888791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b733766d40 0x55b7337645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60d37fe640 1 -- 172.21.15.81:0/1238888791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b733766d40 msgr2=0x55b7337645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60d37fe640 1 --2- 172.21.15.81:0/1238888791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b733766d40 0x55b7337645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60d37fe640 1 -- 172.21.15.81:0/1238888791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 msgr2=0x55b733763b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60d37fe640 1 --2- 172.21.15.81:0/1238888791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 0x55b733763b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60d37fe640 1 -- 172.21.15.81:0/1238888791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7334326a0 con 0x55b73375c480 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60d37fe640 1 --2- 172.21.15.81:0/1238888791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 0x55b7337640a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f60c4031520 tx=0x7f60c40055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f609cee3a3b806c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60b2ffd640 1 -- 172.21.15.81:0/1238888791 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c404b070 con 0x55b73375c480 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60b2ffd640 1 -- 172.21.15.81:0/1238888791 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f60c4004be0 con 0x55b73375c480 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.225+0000 7f60dc020740 1 -- 172.21.15.81:0/1238888791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60c4005020 con 0x55b73375c480 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.226+0000 7f60b2ffd640 1 -- 172.21.15.81:0/1238888791 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f60c4057050 con 0x55b73375c480 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.226+0000 7f60dc020740 10 client.16827 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.226+0000 7f60dc020740 1 -- 172.21.15.81:0/1238888791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b733775430 con 0x55b73375c480 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.226+0000 7f60b2ffd640 1 -- 172.21.15.81:0/1238888791 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60c4005020 con 0x55b73375c480 2024-09-12T01:33:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.226+0000 7f60b2ffd640 1 -- 172.21.15.81:0/1238888791 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f60c40445c0 con 0x55b73375c480 2024-09-12T01:33:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.226+0000 7f60dc020740 10 client.16827 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.226+0000 7f60dc020740 10 client.16827 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.226+0000 7f60dc020740 20 client.16827 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.226+0000 7f60dc020740 1 --2- 172.21.15.81:0/1238888791 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b733776780 0x55b733778b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.226+0000 7f60dc020740 4 client.16827 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.226+0000 7f60dc020740 1 -- 172.21.15.81:0/1238888791 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7336ce7f0 con 0x55b733776780 2024-09-12T01:33:47.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.226+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/1238888791 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b733776780 0x55b733778b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.227+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/1238888791 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b733776780 0x55b733778b70 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1c428440351d750 server_cookie=e569bc726c02ce0e in_seq=0 out_seq=0 2024-09-12T01:33:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.227+0000 7f60b2ffd640 10 client.16827 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60b2ffd640 1 -- 172.21.15.81:0/1238888791 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7336ce7f0 con 0x55b733776780 2024-09-12T01:33:47.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60b2ffd640 10 client.16827 handle_command_reply: tid=0 2024-09-12T01:33:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60dc020740 1 client.16827 shutdown 2024-09-12T01:33:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60dc020740 1 -- 172.21.15.81:0/1238888791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 msgr2=0x55b7337640a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60dc020740 1 --2- 172.21.15.81:0/1238888791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 0x55b7337640a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f60c4031520 tx=0x7f60c40055f0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60dc020740 1 -- 172.21.15.81:0/1238888791 shutdown_connections 2024-09-12T01:33:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60dc020740 1 --2- 172.21.15.81:0/1238888791 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b733776780 0x55b733778b70 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60dc020740 1 --2- 172.21.15.81:0/1238888791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b733766d40 0x55b7337645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60dc020740 1 --2- 172.21.15.81:0/1238888791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b73375c480 0x55b7337640a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60dc020740 1 --2- 172.21.15.81:0/1238888791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 0x55b733763b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60b2ffd640 0 client.16827 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60dc020740 1 -- 172.21.15.81:0/1238888791 >> 172.21.15.81:0/1238888791 conn(0x55b7337580f0 msgr2=0x55b733757270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60dc020740 1 -- 172.21.15.81:0/1238888791 shutdown_connections 2024-09-12T01:33:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60dc020740 1 -- 172.21.15.81:0/1238888791 wait complete. 2024-09-12T01:33:47.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.228+0000 7f60dc020740 20 client.16827 trim_cache size 0 max 16384 2024-09-12T01:33:47.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60dc020740 1 Processor -- start 2024-09-12T01:33:47.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60dc020740 1 -- start start 2024-09-12T01:33:47.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60dc020740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b73375bb60 0x55b73377e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60dc020740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375c480 0x55b73377e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60dc020740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 0x55b733756a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60dc020740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60d41af850 con 0x55b733766d40 2024-09-12T01:33:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60dc020740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f60d41b1390 con 0x55b73375c480 2024-09-12T01:33:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60dc020740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f60d41aff20 con 0x55b73375bb60 2024-09-12T01:33:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60d2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 0x55b733756a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60d2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 0x55b733756a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34580/0 (socket says 172.21.15.81:34580) 2024-09-12T01:33:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60d2ffd640 1 -- 172.21.15.81:0/3108302461 learned_addr learned my addr 172.21.15.81:0/3108302461 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60d37fe640 1 --2- 172.21.15.81:0/3108302461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375c480 0x55b73377e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/3108302461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b73375bb60 0x55b73377e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60d2ffd640 1 -- 172.21.15.81:0/3108302461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b73375bb60 msgr2=0x55b73377e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/3108302461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b73375bb60 0x55b73377e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60d2ffd640 1 -- 172.21.15.81:0/3108302461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375c480 msgr2=0x55b73377e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/3108302461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375c480 0x55b73377e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.245+0000 7f60d2ffd640 1 -- 172.21.15.81:0/3108302461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b73375c2b0 con 0x55b733766d40 2024-09-12T01:33:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.246+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/3108302461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 0x55b733756a50 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x55b733759470 tx=0x7f60c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731c7938d84742b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.246+0000 7f60b97fa640 1 -- 172.21.15.81:0/3108302461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c80202f0 con 0x55b733766d40 2024-09-12T01:33:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.246+0000 7f60b97fa640 1 -- 172.21.15.81:0/3108302461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60c8026020 con 0x55b733766d40 2024-09-12T01:33:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.246+0000 7f60b97fa640 1 -- 172.21.15.81:0/3108302461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c8011830 con 0x55b733766d40 2024-09-12T01:33:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.246+0000 7f60dc020740 1 -- 172.21.15.81:0/3108302461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 msgr2=0x55b733756a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.246+0000 7f60dc020740 1 --2- 172.21.15.81:0/3108302461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 0x55b733756a50 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x55b733759470 tx=0x7f60c80046c0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.246+0000 7f60dc020740 1 -- 172.21.15.81:0/3108302461 shutdown_connections 2024-09-12T01:33:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.246+0000 7f60dc020740 1 --2- 172.21.15.81:0/3108302461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 0x55b733756a50 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.246+0000 7f60dc020740 1 --2- 172.21.15.81:0/3108302461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375c480 0x55b73377e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.246+0000 7f60dc020740 1 --2- 172.21.15.81:0/3108302461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b73375bb60 0x55b73377e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.246+0000 7f60dc020740 1 -- 172.21.15.81:0/3108302461 >> 172.21.15.81:0/3108302461 conn(0x55b7337580f0 msgr2=0x55b733762c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.246+0000 7f60dc020740 1 -- 172.21.15.81:0/3108302461 shutdown_connections 2024-09-12T01:33:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.246+0000 7f60dc020740 1 -- 172.21.15.81:0/3108302461 wait complete. 2024-09-12T01:33:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60dc020740 1 -- start start 2024-09-12T01:33:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60dc020740 1 Processor -- start 2024-09-12T01:33:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60dc020740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 0x55b733760c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60dc020740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b73375c480 0x55b733761180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60dc020740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 0x55b7337616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60dc020740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60d41b0cc0 con 0x55b733766d40 2024-09-12T01:33:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60dc020740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f60d41b05f0 con 0x55b73375bb60 2024-09-12T01:33:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60dc020740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f60d41ad830 con 0x55b73375c480 2024-09-12T01:33:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60dc020740 10 client.0 _ll_register_callbacks cb 0x7f60c4009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60d2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 0x55b7337616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60d2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 0x55b7337616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34590/0 (socket says 172.21.15.81:34590) 2024-09-12T01:33:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60d2ffd640 1 -- 172.21.15.81:0/2029469100 learned_addr learned my addr 172.21.15.81:0/2029469100 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60d37fe640 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b73375c480 0x55b733761180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.247+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 0x55b733760c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60d37fe640 1 -- 172.21.15.81:0/2029469100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 msgr2=0x55b733760c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60d37fe640 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 0x55b733760c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60d37fe640 1 -- 172.21.15.81:0/2029469100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 msgr2=0x55b7337616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60d37fe640 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 0x55b7337616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60d37fe640 1 -- 172.21.15.81:0/2029469100 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7337e01b0 con 0x55b73375c480 2024-09-12T01:33:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 0x55b7337616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:33:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60d37fe640 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b73375c480 0x55b733761180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60c4031550 tx=0x7f60c402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e80e6285f096cce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-12T01:33:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60b2ffd640 1 -- 172.21.15.81:0/2029469100 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c404b040 con 0x55b73375c480 2024-09-12T01:33:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60dc020740 1 -- 172.21.15.81:0/2029469100 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60c8026020 con 0x55b73375c480 2024-09-12T01:33:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60b2ffd640 1 -- 172.21.15.81:0/2029469100 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f60c40057f0 con 0x55b73375c480 2024-09-12T01:33:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60b2ffd640 1 -- 172.21.15.81:0/2029469100 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f60c4035030 con 0x55b73375c480 2024-09-12T01:33:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60dc020740 10 client.25849 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.248+0000 7f60dc020740 1 -- 172.21.15.81:0/2029469100 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b7337e1500 con 0x55b73375c480 2024-09-12T01:33:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.249+0000 7f60b2ffd640 1 -- 172.21.15.81:0/2029469100 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60c8026020 con 0x55b73375c480 2024-09-12T01:33:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.249+0000 7f60b2ffd640 1 -- 172.21.15.81:0/2029469100 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f60c4004c50 con 0x55b73375c480 2024-09-12T01:33:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.249+0000 7f60dc020740 10 client.25849 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.249+0000 7f60dc020740 10 client.25849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.249+0000 7f60dc020740 20 client.25849 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.249+0000 7f60dc020740 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7337e1c80 0x55b7337e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.249+0000 7f60dc020740 4 client.25849 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:33:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.249+0000 7f60dc020740 1 -- 172.21.15.81:0/2029469100 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b7336c8d00 con 0x55b7337e1c80 2024-09-12T01:33:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.249+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7337e1c80 0x55b7337e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.250+0000 7f60d2ffd640 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7337e1c80 0x55b7337e40a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f40a84f4ed179a48 server_cookie=6861e206c2f65cb1 in_seq=0 out_seq=0 2024-09-12T01:33:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.250+0000 7f60b2ffd640 10 client.25849 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.250+0000 7f60b2ffd640 1 -- 172.21.15.81:0/2029469100 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b7336c8d00 con 0x55b7337e1c80 2024-09-12T01:33:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.250+0000 7f60b2ffd640 10 client.25849 handle_command_reply: tid=0 2024-09-12T01:33:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.250+0000 7f60dc020740 1 client.25849 shutdown 2024-09-12T01:33:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60dc020740 1 -- 172.21.15.81:0/2029469100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b73375c480 msgr2=0x55b733761180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60dc020740 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b73375c480 0x55b733761180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60c4031550 tx=0x7f60c402a410 comp rx=0 tx=0).stop 2024-09-12T01:33:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60dc020740 1 -- 172.21.15.81:0/2029469100 shutdown_connections 2024-09-12T01:33:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60dc020740 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b7337e1c80 0x55b7337e40a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60dc020740 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b733766d40 0x55b7337616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60dc020740 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b73375c480 0x55b733761180 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60b2ffd640 0 client.25849 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60dc020740 1 --2- 172.21.15.81:0/2029469100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b73375bb60 0x55b733760c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60dc020740 1 -- 172.21.15.81:0/2029469100 >> 172.21.15.81:0/2029469100 conn(0x55b7337580f0 msgr2=0x55b73375d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60dc020740 1 -- 172.21.15.81:0/2029469100 shutdown_connections 2024-09-12T01:33:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60dc020740 1 -- 172.21.15.81:0/2029469100 wait complete. 2024-09-12T01:33:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60dc020740 20 client.25849 trim_cache size 0 max 16384 2024-09-12T01:33:47.257 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:33:47.257 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:33:47.257 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "5a3bc136-596e-466d-bfc3-a94e06980c9b", 2024-09-12T01:33:47.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:33:47.257 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:33:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60d9c47640 1 -- 172.21.15.81:0/1084611285 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f60bc0a2cf0 msgr2=0x7f60bc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60d9c47640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f60bc0a2cf0 0x7f60bc0a51b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0cd220 tx=0x7f60cc066b70 comp rx=0 tx=0).stop 2024-09-12T01:33:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60d9c47640 1 -- 172.21.15.81:0/1084611285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60d4106f10 msgr2=0x7f60d4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.251+0000 7f60d9c47640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60d4106f10 0x7f60d4074f70 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00cce0 tx=0x7f60cc00a620 comp rx=0 tx=0).stop 2024-09-12T01:33:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.252+0000 7f60d9c47640 1 -- 172.21.15.81:0/1084611285 shutdown_connections 2024-09-12T01:33:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.252+0000 7f60d9c47640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f60bc0a2cf0 0x7f60bc0a51b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.252+0000 7f60d9c47640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60d4106f10 0x7f60d4074f70 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.252+0000 7f60d9c47640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60d4102790 0x7f60d4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.252+0000 7f60d9c47640 1 --2- 172.21.15.81:0/1084611285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f60d4101de0 0x7f60d40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.252+0000 7f60d9c47640 1 -- 172.21.15.81:0/1084611285 >> 172.21.15.81:0/1084611285 conn(0x7f60d40fd8c0 msgr2=0x7f60d40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.252+0000 7f60d9c47640 1 -- 172.21.15.81:0/1084611285 shutdown_connections 2024-09-12T01:33:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:47.252+0000 7f60d9c47640 1 -- 172.21.15.81:0/1084611285 wait complete. 2024-09-12T01:33:47.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:47 smithi081 ceph-mon[30920]: pgmap v174: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:47.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:47 smithi100 ceph-mon[35275]: pgmap v174: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:47.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:47 smithi189 ceph-mon[35357]: pgmap v174: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:47.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:33:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:33:48.480 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:48 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:33:48.481 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:48 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:33:48.481 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:48 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:33:48.481 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:48 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:33:48.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:48 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:33:48.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:48 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:33:48.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:48 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:33:48.519 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:48 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:33:48.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:48 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:33:48.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:48 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:33:48.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:48 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:33:48.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:48 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:33:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.725+0000 7fc33295c640 1 -- 172.21.15.81:0/1987572265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c102570 msgr2=0x7fc32c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.725+0000 7fc33295c640 1 --2- 172.21.15.81:0/1987572265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c102570 0x7fc32c1029b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc314009900 tx=0x7fc31402a480 comp rx=0 tx=0).stop 2024-09-12T01:33:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.725+0000 7fc33295c640 1 -- 172.21.15.81:0/1987572265 shutdown_connections 2024-09-12T01:33:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.725+0000 7fc33295c640 1 --2- 172.21.15.81:0/1987572265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc32c102ef0 0x7fc32c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.725+0000 7fc33295c640 1 --2- 172.21.15.81:0/1987572265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c102570 0x7fc32c1029b0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.725+0000 7fc33295c640 1 --2- 172.21.15.81:0/1987572265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc32c100e20 0x7fc32c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.725+0000 7fc33295c640 1 -- 172.21.15.81:0/1987572265 >> 172.21.15.81:0/1987572265 conn(0x7fc32c0fc7d0 msgr2=0x7fc32c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.725+0000 7fc33295c640 1 -- 172.21.15.81:0/1987572265 shutdown_connections 2024-09-12T01:33:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.725+0000 7fc33295c640 1 -- 172.21.15.81:0/1987572265 wait complete. 2024-09-12T01:33:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc33295c640 1 Processor -- start 2024-09-12T01:33:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc33295c640 1 -- start start 2024-09-12T01:33:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc33295c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c100e20 0x7fc32c197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc33295c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc32c102570 0x7fc32c197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc33295c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc32c102ef0 0x7fc32c19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc33295c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c110fa0 con 0x7fc32c100e20 2024-09-12T01:33:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc33295c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c110e20 con 0x7fc32c102ef0 2024-09-12T01:33:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc33295c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c111120 con 0x7fc32c102570 2024-09-12T01:33:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc32bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c100e20 0x7fc32c197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc32bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c100e20 0x7fc32c197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34608/0 (socket says 172.21.15.81:34608) 2024-09-12T01:33:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc32bfff640 1 -- 172.21.15.81:0/316979401 learned_addr learned my addr 172.21.15.81:0/316979401 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc323fff640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc32c102570 0x7fc32c197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc32bfff640 1 -- 172.21.15.81:0/316979401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc32c102570 msgr2=0x7fc32c197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc32bfff640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc32c102570 0x7fc32c197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc32bfff640 1 -- 172.21.15.81:0/316979401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc32c102ef0 msgr2=0x7fc32c19bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc330ef9640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc32c102ef0 0x7fc32c19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc32bfff640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc32c102ef0 0x7fc32c19bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc32bfff640 1 -- 172.21.15.81:0/316979401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32c19c3d0 con 0x7fc32c100e20 2024-09-12T01:33:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.726+0000 7fc323fff640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc32c102570 0x7fc32c197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:33:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.727+0000 7fc32bfff640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c100e20 0x7fc32c197420 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c890 tx=0x7fc31c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.727+0000 7fc329ffb640 1 -- 172.21.15.81:0/316979401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c004220 con 0x7fc32c100e20 2024-09-12T01:33:48.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.727+0000 7fc329ffb640 1 -- 172.21.15.81:0/316979401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc31c0043c0 con 0x7fc32c100e20 2024-09-12T01:33:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.727+0000 7fc33295c640 1 -- 172.21.15.81:0/316979401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32c19c6c0 con 0x7fc32c100e20 2024-09-12T01:33:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.727+0000 7fc329ffb640 1 -- 172.21.15.81:0/316979401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0049e0 con 0x7fc32c100e20 2024-09-12T01:33:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.727+0000 7fc33295c640 1 -- 172.21.15.81:0/316979401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc32c1a3fa0 con 0x7fc32c100e20 2024-09-12T01:33:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.729+0000 7fc329ffb640 1 -- 172.21.15.81:0/316979401 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc31c0079b0 con 0x7fc32c100e20 2024-09-12T01:33:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.729+0000 7fc334d35740 1 Processor -- start 2024-09-12T01:33:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.729+0000 7fc334d35740 1 -- start start 2024-09-12T01:33:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.729+0000 7fc334d35740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701570 0x5602e4701950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc334d35740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e4701e90 0x5602e470e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc334d35740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e470ec80 0x5602e4711070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc334d35740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5602e46652e0 con 0x5602e470ec80 2024-09-12T01:33:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc334d35740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5602e460cce0 con 0x5602e4701570 2024-09-12T01:33:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc334d35740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5602e46612a0 con 0x5602e4701e90 2024-09-12T01:33:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc329ffb640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc3180a2cf0 0x7fc3180a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc323fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e470ec80 0x5602e4711070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc323fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e470ec80 0x5602e4711070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34612/0 (socket says 172.21.15.81:34612) 2024-09-12T01:33:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc323fff640 1 -- 172.21.15.81:0/2684600700 learned_addr learned my addr 172.21.15.81:0/2684600700 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc330ef9640 1 --2- 172.21.15.81:0/2684600700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701570 0x5602e4701950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc32bfff640 1 --2- 172.21.15.81:0/2684600700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e4701e90 0x5602e470e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc330ef9640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc3180a2cf0 0x7fc3180a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc329ffb640 1 -- 172.21.15.81:0/316979401 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fc31c0cf530 con 0x7fc32c100e20 2024-09-12T01:33:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc323fff640 1 -- 172.21.15.81:0/2684600700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e4701e90 msgr2=0x5602e470e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc323fff640 1 --2- 172.21.15.81:0/2684600700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e4701e90 0x5602e470e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc323fff640 1 -- 172.21.15.81:0/2684600700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701570 msgr2=0x5602e4701950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc323fff640 1 --2- 172.21.15.81:0/2684600700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701570 0x5602e4701950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc323fff640 1 -- 172.21.15.81:0/2684600700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e45f1440 con 0x5602e470ec80 2024-09-12T01:33:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc323fff640 1 --2- 172.21.15.81:0/2684600700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e470ec80 0x5602e4711070 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc314005ab0 tx=0x7fc314004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf89ba2b782dc7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.730+0000 7fc330ef9640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc3180a2cf0 0x7fc3180a51b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc324006d20 tx=0x7fc324005df0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.731+0000 7fc3227fc640 1 -- 172.21.15.81:0/2684600700 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31403f070 con 0x5602e470ec80 2024-09-12T01:33:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.731+0000 7fc3227fc640 1 -- 172.21.15.81:0/2684600700 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc314005520 con 0x5602e470ec80 2024-09-12T01:33:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.731+0000 7fc3227fc640 1 -- 172.21.15.81:0/2684600700 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314035030 con 0x5602e470ec80 2024-09-12T01:33:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.731+0000 7fc334d35740 1 -- 172.21.15.81:0/2684600700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e470ec80 msgr2=0x5602e4711070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.731+0000 7fc334d35740 1 --2- 172.21.15.81:0/2684600700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e470ec80 0x5602e4711070 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc314005ab0 tx=0x7fc314004200 comp rx=0 tx=0).stop 2024-09-12T01:33:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.731+0000 7fc334d35740 1 -- 172.21.15.81:0/2684600700 shutdown_connections 2024-09-12T01:33:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.731+0000 7fc334d35740 1 --2- 172.21.15.81:0/2684600700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e470ec80 0x5602e4711070 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.731+0000 7fc334d35740 1 --2- 172.21.15.81:0/2684600700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e4701e90 0x5602e470e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.731+0000 7fc334d35740 1 --2- 172.21.15.81:0/2684600700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701570 0x5602e4701950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.731+0000 7fc334d35740 1 -- 172.21.15.81:0/2684600700 >> 172.21.15.81:0/2684600700 conn(0x5602e46fdc40 msgr2=0x5602e46fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:48.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.731+0000 7fc334d35740 1 -- 172.21.15.81:0/2684600700 shutdown_connections 2024-09-12T01:33:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.732+0000 7fc334d35740 1 -- 172.21.15.81:0/2684600700 wait complete. 2024-09-12T01:33:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.732+0000 7fc334d35740 1 -- start start 2024-09-12T01:33:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.732+0000 7fc334d35740 1 Processor -- start 2024-09-12T01:33:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.732+0000 7fc334d35740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 0x5602e470e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.732+0000 7fc334d35740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e4701e90 0x5602e470b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.732+0000 7fc334d35740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e470ec80 0x5602e470bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.732+0000 7fc334d35740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5602e4711610 con 0x5602e4701570 2024-09-12T01:33:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.732+0000 7fc334d35740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5602e4620050 con 0x5602e470ec80 2024-09-12T01:33:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.732+0000 7fc334d35740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5602e4711790 con 0x5602e4701e90 2024-09-12T01:33:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.732+0000 7fc334d35740 10 client.0 _ll_register_callbacks cb 0x5602e4660160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.732+0000 7fc32bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 0x5602e470e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.732+0000 7fc32bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 0x5602e470e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34620/0 (socket says 172.21.15.81:34620) 2024-09-12T01:33:48.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.732+0000 7fc32bfff640 1 -- 172.21.15.81:0/713949232 learned_addr learned my addr 172.21.15.81:0/713949232 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:48.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc323fff640 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e4701e90 0x5602e470b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc330ef9640 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e470ec80 0x5602e470bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc32bfff640 1 -- 172.21.15.81:0/713949232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e4701e90 msgr2=0x5602e470b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:48.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc32bfff640 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e4701e90 0x5602e470b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc32bfff640 1 -- 172.21.15.81:0/713949232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e470ec80 msgr2=0x5602e470bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:48.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc32bfff640 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e470ec80 0x5602e470bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc32bfff640 1 -- 172.21.15.81:0/713949232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e43d63c0 con 0x5602e4701570 2024-09-12T01:33:48.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc330ef9640 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e470ec80 0x5602e470bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:48.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc32bfff640 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 0x5602e470e5b0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc31c005fd0 tx=0x7fc31c06a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcce84088145f6f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:48.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc30b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:48.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc30b7fe640 1 -- 172.21.15.81:0/713949232 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c01d030 con 0x5602e4701570 2024-09-12T01:33:48.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc30b7fe640 1 -- 172.21.15.81:0/713949232 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fc31c0a4260 con 0x5602e4701570 2024-09-12T01:33:48.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc334d35740 1 -- 172.21.15.81:0/713949232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc314005520 con 0x5602e4701570 2024-09-12T01:33:48.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc30b7fe640 1 -- 172.21.15.81:0/713949232 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc31c09c180 con 0x5602e4701570 2024-09-12T01:33:48.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc334d35740 10 client.16845 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:48.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc334d35740 1 -- 172.21.15.81:0/713949232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5602e471d060 con 0x5602e4701570 2024-09-12T01:33:48.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc30b7fe640 1 -- 172.21.15.81:0/713949232 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc314005520 con 0x5602e4701570 2024-09-12T01:33:48.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.733+0000 7fc30b7fe640 1 -- 172.21.15.81:0/713949232 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc31c0cf0d0 con 0x5602e4701570 2024-09-12T01:33:48.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.734+0000 7fc334d35740 10 client.16845 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:48.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.734+0000 7fc334d35740 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:48.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.734+0000 7fc334d35740 20 client.16845 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:48.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.734+0000 7fc334d35740 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5602e471e520 0x5602e4720950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.734+0000 7fc334d35740 4 client.16845 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:33:48.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.734+0000 7fc334d35740 1 -- 172.21.15.81:0/713949232 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602e4672850 con 0x5602e471e520 2024-09-12T01:33:48.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.734+0000 7fc323fff640 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5602e471e520 0x5602e4720950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.734+0000 7fc30b7fe640 10 client.16845 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.734+0000 7fc323fff640 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5602e471e520 0x5602e4720950 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a07e52d808eb2c41 server_cookie=224d80d7935a041 in_seq=0 out_seq=0 2024-09-12T01:33:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc30b7fe640 1 -- 172.21.15.81:0/713949232 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5602e4672850 con 0x5602e471e520 2024-09-12T01:33:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc30b7fe640 10 client.16845 handle_command_reply: tid=0 2024-09-12T01:33:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc334d35740 1 client.16845 shutdown 2024-09-12T01:33:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc334d35740 1 -- 172.21.15.81:0/713949232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 msgr2=0x5602e470e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc334d35740 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 0x5602e470e5b0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc31c005fd0 tx=0x7fc31c06a9b0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc334d35740 1 -- 172.21.15.81:0/713949232 shutdown_connections 2024-09-12T01:33:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc334d35740 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5602e471e520 0x5602e4720950 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc334d35740 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e470ec80 0x5602e470bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc334d35740 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e4701e90 0x5602e470b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc30b7fe640 0 client.16845 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:48.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc334d35740 1 --2- 172.21.15.81:0/713949232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 0x5602e470e5b0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc334d35740 1 -- 172.21.15.81:0/713949232 >> 172.21.15.81:0/713949232 conn(0x5602e46fdc40 msgr2=0x5602e47039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:48.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc334d35740 1 -- 172.21.15.81:0/713949232 shutdown_connections 2024-09-12T01:33:48.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.735+0000 7fc334d35740 1 -- 172.21.15.81:0/713949232 wait complete. 2024-09-12T01:33:48.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.736+0000 7fc334d35740 20 client.16845 trim_cache size 0 max 16384 2024-09-12T01:33:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.752+0000 7fc334d35740 1 Processor -- start 2024-09-12T01:33:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.752+0000 7fc334d35740 1 -- start start 2024-09-12T01:33:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc334d35740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e46fdc40 0x5602e471a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc334d35740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 0x5602e470a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc334d35740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701e90 0x5602e46fce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc334d35740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c1ab620 con 0x5602e4701570 2024-09-12T01:33:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc334d35740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c1ad160 con 0x5602e4701e90 2024-09-12T01:33:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc334d35740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c1abcf0 con 0x5602e46fdc40 2024-09-12T01:33:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc323fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 0x5602e470a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc323fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 0x5602e470a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34636/0 (socket says 172.21.15.81:34636) 2024-09-12T01:33:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc323fff640 1 -- 172.21.15.81:0/1499437336 learned_addr learned my addr 172.21.15.81:0/1499437336 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc330ef9640 1 --2- 172.21.15.81:0/1499437336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701e90 0x5602e46fce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc32bfff640 1 --2- 172.21.15.81:0/1499437336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e46fdc40 0x5602e471a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc323fff640 1 -- 172.21.15.81:0/1499437336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e46fdc40 msgr2=0x5602e471a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc323fff640 1 --2- 172.21.15.81:0/1499437336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e46fdc40 0x5602e471a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc323fff640 1 -- 172.21.15.81:0/1499437336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701e90 msgr2=0x5602e46fce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc323fff640 1 --2- 172.21.15.81:0/1499437336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701e90 0x5602e46fce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc323fff640 1 -- 172.21.15.81:0/1499437336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e470a810 con 0x5602e4701570 2024-09-12T01:33:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc323fff640 1 --2- 172.21.15.81:0/1499437336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 0x5602e470a130 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x5602e4702690 tx=0x7fc314004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98c4e372e98722f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc321ffb640 1 -- 172.21.15.81:0/1499437336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31403f040 con 0x5602e4701570 2024-09-12T01:33:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc321ffb640 1 -- 172.21.15.81:0/1499437336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc314005360 con 0x5602e4701570 2024-09-12T01:33:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.753+0000 7fc321ffb640 1 -- 172.21.15.81:0/1499437336 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314035040 con 0x5602e4701570 2024-09-12T01:33:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.754+0000 7fc334d35740 1 -- 172.21.15.81:0/1499437336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 msgr2=0x5602e470a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.754+0000 7fc334d35740 1 --2- 172.21.15.81:0/1499437336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 0x5602e470a130 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x5602e4702690 tx=0x7fc314004e10 comp rx=0 tx=0).stop 2024-09-12T01:33:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.754+0000 7fc334d35740 1 -- 172.21.15.81:0/1499437336 shutdown_connections 2024-09-12T01:33:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.754+0000 7fc334d35740 1 --2- 172.21.15.81:0/1499437336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701e90 0x5602e46fce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.754+0000 7fc334d35740 1 --2- 172.21.15.81:0/1499437336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701570 0x5602e470a130 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.754+0000 7fc334d35740 1 --2- 172.21.15.81:0/1499437336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e46fdc40 0x5602e471a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.754+0000 7fc334d35740 1 -- 172.21.15.81:0/1499437336 >> 172.21.15.81:0/1499437336 conn(0x5602e470bf00 msgr2=0x5602e46fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.754+0000 7fc334d35740 1 -- 172.21.15.81:0/1499437336 shutdown_connections 2024-09-12T01:33:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.754+0000 7fc334d35740 1 -- 172.21.15.81:0/1499437336 wait complete. 2024-09-12T01:33:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.754+0000 7fc334d35740 1 -- start start 2024-09-12T01:33:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc334d35740 1 Processor -- start 2024-09-12T01:33:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc334d35740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e46fdc40 0x5602e4716a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc334d35740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701570 0x5602e4716f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc334d35740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701e90 0x5602e47139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc334d35740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c1aca90 con 0x5602e4701e90 2024-09-12T01:33:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc334d35740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c1ac3c0 con 0x5602e4701570 2024-09-12T01:33:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc334d35740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c1a9620 con 0x5602e46fdc40 2024-09-12T01:33:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc334d35740 10 client.0 _ll_register_callbacks cb 0x7fc31c004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:33:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc330ef9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701e90 0x5602e47139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc330ef9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701e90 0x5602e47139f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34652/0 (socket says 172.21.15.81:34652) 2024-09-12T01:33:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc330ef9640 1 -- 172.21.15.81:0/1816148779 learned_addr learned my addr 172.21.15.81:0/1816148779 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:33:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc32bfff640 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e46fdc40 0x5602e4716a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc323fff640 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701570 0x5602e4716f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc330ef9640 1 -- 172.21.15.81:0/1816148779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e46fdc40 msgr2=0x5602e4716a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc330ef9640 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e46fdc40 0x5602e4716a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc330ef9640 1 -- 172.21.15.81:0/1816148779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701570 msgr2=0x5602e4716f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:33:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc330ef9640 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701570 0x5602e4716f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc330ef9640 1 -- 172.21.15.81:0/1816148779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e4713f30 con 0x5602e4701e90 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.755+0000 7fc323fff640 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701570 0x5602e4716f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc330ef9640 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701e90 0x5602e47139f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc324017e60 tx=0x7fc324004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08504af17dba9d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc30b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc30b7fe640 1 -- 172.21.15.81:0/1816148779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324025470 con 0x5602e4701e90 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc30b7fe640 1 -- 172.21.15.81:0/1816148779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fc324025610 con 0x5602e4701e90 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc334d35740 1 -- 172.21.15.81:0/1816148779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc314005360 con 0x5602e4701e90 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc30b7fe640 1 -- 172.21.15.81:0/1816148779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc324033050 con 0x5602e4701e90 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc334d35740 10 client.16851 fetch_fsmap learned FSMap version 28 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc334d35740 1 -- 172.21.15.81:0/1816148779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5602e47899d0 con 0x5602e4701e90 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc30b7fe640 1 -- 172.21.15.81:0/1816148779 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc314005360 con 0x5602e4701e90 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc30b7fe640 1 -- 172.21.15.81:0/1816148779 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc32402e900 con 0x5602e4701e90 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc334d35740 10 client.16851 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:33:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc334d35740 10 client.16851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:33:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc334d35740 20 client.16851 populate_metadata read hostname 'smithi081' 2024-09-12T01:33:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc334d35740 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5602e470ec80 0x5602e478c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:33:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc334d35740 4 client.16851 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:33:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.756+0000 7fc334d35740 1 -- 172.21.15.81:0/1816148779 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5602e466cd60 con 0x5602e470ec80 2024-09-12T01:33:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc32bfff640 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5602e470ec80 0x5602e478c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:33:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc32bfff640 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5602e470ec80 0x5602e478c240 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6074a9831478b40d server_cookie=86054175ee06a320 in_seq=0 out_seq=0 2024-09-12T01:33:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc30b7fe640 10 client.16851 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc30b7fe640 1 -- 172.21.15.81:0/1816148779 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5602e466cd60 con 0x5602e470ec80 2024-09-12T01:33:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc30b7fe640 10 client.16851 handle_command_reply: tid=0 2024-09-12T01:33:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc334d35740 1 client.16851 shutdown 2024-09-12T01:33:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc334d35740 1 -- 172.21.15.81:0/1816148779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701e90 msgr2=0x5602e47139f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc334d35740 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701e90 0x5602e47139f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc324017e60 tx=0x7fc324004b50 comp rx=0 tx=0).stop 2024-09-12T01:33:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc334d35740 1 -- 172.21.15.81:0/1816148779 shutdown_connections 2024-09-12T01:33:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc334d35740 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5602e470ec80 0x5602e478c240 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc334d35740 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602e4701e90 0x5602e47139f0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc334d35740 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5602e4701570 0x5602e4716f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc30b7fe640 0 client.16851 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:33:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc334d35740 1 --2- 172.21.15.81:0/1816148779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602e46fdc40 0x5602e4716a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.757+0000 7fc334d35740 1 -- 172.21.15.81:0/1816148779 >> 172.21.15.81:0/1816148779 conn(0x5602e470bf00 msgr2=0x5602e4703120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc334d35740 1 -- 172.21.15.81:0/1816148779 shutdown_connections 2024-09-12T01:33:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc334d35740 1 -- 172.21.15.81:0/1816148779 wait complete. 2024-09-12T01:33:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc334d35740 20 client.16851 trim_cache size 0 max 16384 2024-09-12T01:33:48.764 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:33:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:33:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-12T01:33:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "5a3bc136-596e-466d-bfc3-a94e06980c9b": { 2024-09-12T01:33:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-09-12T01:33:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "5a3bc136-596e-466d-bfc3-a94e06980c9b", 2024-09-12T01:33:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-12T01:33:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:33:48.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:33:48.765 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:33:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc33295c640 1 -- 172.21.15.81:0/316979401 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc3180a2cf0 msgr2=0x7fc3180a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc33295c640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc3180a2cf0 0x7fc3180a51b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc324006d20 tx=0x7fc324005df0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc33295c640 1 -- 172.21.15.81:0/316979401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c100e20 msgr2=0x7fc32c197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:33:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc33295c640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c100e20 0x7fc32c197420 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c890 tx=0x7fc31c00cd50 comp rx=0 tx=0).stop 2024-09-12T01:33:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc33295c640 1 -- 172.21.15.81:0/316979401 shutdown_connections 2024-09-12T01:33:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc33295c640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc3180a2cf0 0x7fc3180a51b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc33295c640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc32c102ef0 0x7fc32c19bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc33295c640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc32c102570 0x7fc32c197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc33295c640 1 --2- 172.21.15.81:0/316979401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc32c100e20 0x7fc32c197420 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:33:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc33295c640 1 -- 172.21.15.81:0/316979401 >> 172.21.15.81:0/316979401 conn(0x7fc32c0fc7d0 msgr2=0x7fc32c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:33:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc33295c640 1 -- 172.21.15.81:0/316979401 shutdown_connections 2024-09-12T01:33:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:33:48.758+0000 7fc33295c640 1 -- 172.21.15.81:0/316979401 wait complete. 2024-09-12T01:33:49.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:49 smithi081 ceph-mon[30920]: pgmap v175: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:49.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:49 smithi100 ceph-mon[35275]: pgmap v175: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:49.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:49 smithi189 ceph-mon[35357]: pgmap v175: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:33:49.534 INFO:tasks.cephfs.filesystem:scrub status for tag:5a3bc136-596e-466d-bfc3-a94e06980c9b - {'path': '/', 'tag': '5a3bc136-596e-466d-bfc3-a94e06980c9b', 'options': 'recursive,force'} 2024-09-12T01:33:50.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:50 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:33:50.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:50 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:33:50.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:50 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:33:51.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:51 smithi081 ceph-mon[30920]: pgmap v176: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:51.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:51 smithi100 ceph-mon[35275]: pgmap v176: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:51.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:51 smithi189 ceph-mon[35357]: pgmap v176: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:53.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:53 smithi081 ceph-mon[30920]: pgmap v177: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:53.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:53 smithi100 ceph-mon[35275]: pgmap v177: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:53.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:53 smithi189 ceph-mon[35357]: pgmap v177: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:55.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:55 smithi081 ceph-mon[30920]: pgmap v178: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:55.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:55 smithi100 ceph-mon[35275]: pgmap v178: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:55.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:55 smithi189 ceph-mon[35357]: pgmap v178: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:57.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:57 smithi081 ceph-mon[30920]: pgmap v179: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:57.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:57 smithi100 ceph-mon[35275]: pgmap v179: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:57.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:57 smithi189 ceph-mon[35357]: pgmap v179: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:33:59.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:33:59 smithi081 ceph-mon[30920]: pgmap v180: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:59.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:33:59 smithi100 ceph-mon[35275]: pgmap v180: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:33:59.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:33:59 smithi189 ceph-mon[35357]: pgmap v180: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:34:01.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:01 smithi081 ceph-mon[30920]: pgmap v181: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:34:01.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:01 smithi100 ceph-mon[35275]: pgmap v181: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:34:01.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:01 smithi189 ceph-mon[35357]: pgmap v181: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:34:03.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:03 smithi081 ceph-mon[30920]: pgmap v182: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:03.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:03 smithi100 ceph-mon[35275]: pgmap v182: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:03.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:03 smithi189 ceph-mon[35357]: pgmap v182: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:05.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:05 smithi081 ceph-mon[30920]: pgmap v183: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:05.524 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:05 smithi100 ceph-mon[35275]: pgmap v183: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:05.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:05 smithi189 ceph-mon[35357]: pgmap v183: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:07.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:07 smithi081 ceph-mon[30920]: pgmap v184: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:34:07.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:07 smithi100 ceph-mon[35275]: pgmap v184: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:34:07.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:07 smithi189 ceph-mon[35357]: pgmap v184: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:34:09.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:09 smithi081 ceph-mon[30920]: pgmap v185: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:34:09.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:09 smithi100 ceph-mon[35275]: pgmap v185: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:34:09.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:09 smithi189 ceph-mon[35357]: pgmap v185: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:34:11.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:11 smithi081 ceph-mon[30920]: pgmap v186: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:34:11.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:11 smithi100 ceph-mon[35275]: pgmap v186: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:34:11.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:11 smithi189 ceph-mon[35357]: pgmap v186: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:34:13.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:13 smithi081 ceph-mon[30920]: pgmap v187: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:34:13.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:13 smithi100 ceph-mon[35275]: pgmap v187: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:34:13.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:13 smithi189 ceph-mon[35357]: pgmap v187: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:34:15.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:15 smithi081 ceph-mon[30920]: pgmap v188: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:34:15.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:15 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:34:15.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:15 smithi100 ceph-mon[35275]: pgmap v188: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:34:15.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:15 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:34:15.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:15 smithi189 ceph-mon[35357]: pgmap v188: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T01:34:15.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:15 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:34:16.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:16 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:34:16.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:16 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:34:16.489 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:16 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:34:16.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:16 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:34:16.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:16 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:34:16.518 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:16 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:34:16.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:16 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:34:16.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:16 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:34:16.532 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:16 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:34:17.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:17 smithi081 ceph-mon[30920]: pgmap v189: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:34:17.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:17 smithi100 ceph-mon[35275]: pgmap v189: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:34:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:17 smithi189 ceph-mon[35357]: pgmap v189: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T01:34:19.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:34:19.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:19 smithi081 ceph-mon[30920]: pgmap v190: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T01:34:19.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:19 smithi100 ceph-mon[35275]: pgmap v190: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T01:34:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:19 smithi189 ceph-mon[35357]: pgmap v190: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T01:34:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:34:20.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.270+0000 7f7acd5b6640 1 -- 172.21.15.81:0/50551844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ac8100e20 msgr2=0x7f7ac8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:20.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.270+0000 7f7acd5b6640 1 --2- 172.21.15.81:0/50551844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ac8100e20 0x7f7ac8101200 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8009900 tx=0x7f7ab802a480 comp rx=0 tx=0).stop 2024-09-12T01:34:20.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.270+0000 7f7acd5b6640 1 -- 172.21.15.81:0/50551844 shutdown_connections 2024-09-12T01:34:20.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.270+0000 7f7acd5b6640 1 --2- 172.21.15.81:0/50551844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ac8102ef0 0x7f7ac810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.270+0000 7f7acd5b6640 1 --2- 172.21.15.81:0/50551844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ac8102570 0x7f7ac81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.270+0000 7f7acd5b6640 1 --2- 172.21.15.81:0/50551844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ac8100e20 0x7f7ac8101200 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.270+0000 7f7acd5b6640 1 -- 172.21.15.81:0/50551844 >> 172.21.15.81:0/50551844 conn(0x7f7ac80fc7d0 msgr2=0x7f7ac80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:20.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.270+0000 7f7acd5b6640 1 -- 172.21.15.81:0/50551844 shutdown_connections 2024-09-12T01:34:20.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.270+0000 7f7acd5b6640 1 -- 172.21.15.81:0/50551844 wait complete. 2024-09-12T01:34:20.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.270+0000 7f7acd5b6640 1 Processor -- start 2024-09-12T01:34:20.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.271+0000 7f7acd5b6640 1 -- start start 2024-09-12T01:34:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.271+0000 7f7acd5b6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ac8100e20 0x7f7ac8198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.271+0000 7f7acd5b6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ac8102570 0x7f7ac8198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.271+0000 7f7acd5b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ac8102ef0 0x7f7ac819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.271+0000 7f7acd5b6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac81120b0 con 0x7f7ac8102ef0 2024-09-12T01:34:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.271+0000 7f7acd5b6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac8111f30 con 0x7f7ac8102570 2024-09-12T01:34:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.271+0000 7f7acd5b6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac8112230 con 0x7f7ac8100e20 2024-09-12T01:34:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.271+0000 7f7ac77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ac8102ef0 0x7f7ac819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.271+0000 7f7ac77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ac8102ef0 0x7f7ac819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49084/0 (socket says 172.21.15.81:49084) 2024-09-12T01:34:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.271+0000 7f7ac77fe640 1 -- 172.21.15.81:0/1181768573 learned_addr learned my addr 172.21.15.81:0/1181768573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.271+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ac8102570 0x7f7ac8198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.271+0000 7f7ac6ffd640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ac8100e20 0x7f7ac8198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.272+0000 7f7ac77fe640 1 -- 172.21.15.81:0/1181768573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ac8100e20 msgr2=0x7f7ac8198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.272+0000 7f7ac77fe640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ac8100e20 0x7f7ac8198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.272+0000 7f7ac77fe640 1 -- 172.21.15.81:0/1181768573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ac8102570 msgr2=0x7f7ac8198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.272+0000 7f7ac77fe640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ac8102570 0x7f7ac8198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.272+0000 7f7ac77fe640 1 -- 172.21.15.81:0/1181768573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac819d4e0 con 0x7f7ac8102ef0 2024-09-12T01:34:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.272+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ac8102570 0x7f7ac8198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:34:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.272+0000 7f7ac77fe640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ac8102ef0 0x7f7ac819ce00 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000b970 tx=0x7f7ac000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.272+0000 7f7abffff640 1 -- 172.21.15.81:0/1181768573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0019070 con 0x7f7ac8102ef0 2024-09-12T01:34:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.272+0000 7f7acd5b6640 1 -- 172.21.15.81:0/1181768573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac819d7d0 con 0x7f7ac8102ef0 2024-09-12T01:34:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.272+0000 7f7abffff640 1 -- 172.21.15.81:0/1181768573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ac000cb40 con 0x7f7ac8102ef0 2024-09-12T01:34:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.272+0000 7f7abffff640 1 -- 172.21.15.81:0/1181768573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0007650 con 0x7f7ac8102ef0 2024-09-12T01:34:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.272+0000 7f7acd5b6640 1 -- 172.21.15.81:0/1181768573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac81a50b0 con 0x7f7ac8102ef0 2024-09-12T01:34:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.274+0000 7f7abffff640 1 -- 172.21.15.81:0/1181768573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7ac001c070 con 0x7f7ac8102ef0 2024-09-12T01:34:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7acf98f740 1 Processor -- start 2024-09-12T01:34:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7acf98f740 1 -- start start 2024-09-12T01:34:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7acf98f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8380 0x561770df8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7acf98f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770df8ca0 0x561770e07550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7acf98f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770e07a90 0x561770e09e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7acf98f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561770d5e2e0 con 0x561770e07a90 2024-09-12T01:34:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7acf98f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561770d05ce0 con 0x561770df8ca0 2024-09-12T01:34:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7acf98f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561770d5a2a0 con 0x561770df8380 2024-09-12T01:34:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7abffff640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ab40a2cf0 0x7f7ab40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7ac67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770e07a90 0x561770e09e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7ac77fe640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ab40a2cf0 0x7f7ab40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7ac67fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8380 0x561770df8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7ac6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770df8ca0 0x561770e07550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7ac67fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8380 0x561770df8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.81:45964/0 (socket says 172.21.15.81:45964) 2024-09-12T01:34:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.275+0000 7f7ac67fc640 1 -- 172.21.15.81:0/354837909 learned_addr learned my addr 172.21.15.81:0/354837909 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.276+0000 7f7abffff640 1 -- 172.21.15.81:0/1181768573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7ac00ce980 con 0x7f7ac8102ef0 2024-09-12T01:34:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.276+0000 7f7ac67fc640 1 -- 172.21.15.81:0/354837909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770df8ca0 msgr2=0x561770e07550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.276+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/354837909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770df8ca0 0x561770e07550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.276+0000 7f7ac67fc640 1 -- 172.21.15.81:0/354837909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770e07a90 msgr2=0x561770e09e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.276+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/354837909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770e07a90 0x561770e09e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.276+0000 7f7ac67fc640 1 -- 172.21.15.81:0/354837909 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561770cea440 con 0x561770df8380 2024-09-12T01:34:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.276+0000 7f7ac77fe640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ab40a2cf0 0x7f7ab40a51b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00cc2c0 tx=0x7f7ac000e040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.276+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/354837909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8380 0x561770df8760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000dfd0 tx=0x7f7ab0005d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11a5234a1acb6524 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.276+0000 7f7abd7fa640 1 -- 172.21.15.81:0/354837909 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0004020 con 0x561770df8380 2024-09-12T01:34:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.276+0000 7f7abd7fa640 1 -- 172.21.15.81:0/354837909 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ab00041c0 con 0x561770df8380 2024-09-12T01:34:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.276+0000 7f7abd7fa640 1 -- 172.21.15.81:0/354837909 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0003900 con 0x561770df8380 2024-09-12T01:34:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.277+0000 7f7acf98f740 1 -- 172.21.15.81:0/354837909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8380 msgr2=0x561770df8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.277+0000 7f7acf98f740 1 --2- 172.21.15.81:0/354837909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8380 0x561770df8760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000dfd0 tx=0x7f7ab0005d20 comp rx=0 tx=0).stop 2024-09-12T01:34:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.277+0000 7f7acf98f740 1 -- 172.21.15.81:0/354837909 shutdown_connections 2024-09-12T01:34:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.277+0000 7f7acf98f740 1 --2- 172.21.15.81:0/354837909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770e07a90 0x561770e09e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.277+0000 7f7acf98f740 1 --2- 172.21.15.81:0/354837909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770df8ca0 0x561770e07550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.278+0000 7f7acf98f740 1 --2- 172.21.15.81:0/354837909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8380 0x561770df8760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.278+0000 7f7acf98f740 1 -- 172.21.15.81:0/354837909 >> 172.21.15.81:0/354837909 conn(0x561770df4a30 msgr2=0x561770df4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.278+0000 7f7acf98f740 1 -- 172.21.15.81:0/354837909 shutdown_connections 2024-09-12T01:34:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.278+0000 7f7acf98f740 1 -- 172.21.15.81:0/354837909 wait complete. 2024-09-12T01:34:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.278+0000 7f7acf98f740 1 -- start start 2024-09-12T01:34:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.278+0000 7f7acf98f740 1 Processor -- start 2024-09-12T01:34:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.278+0000 7f7acf98f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.278+0000 7f7acf98f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8ca0 0x561770e04650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.278+0000 7f7acf98f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770e07a90 0x561770e04b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.278+0000 7f7acf98f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561770e0a660 con 0x561770df8380 2024-09-12T01:34:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.278+0000 7f7acf98f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561770d19050 con 0x561770e07a90 2024-09-12T01:34:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.278+0000 7f7acf98f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561770e0a7e0 con 0x561770df8ca0 2024-09-12T01:34:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7ac67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7acf98f740 10 client.0 _ll_register_callbacks cb 0x561770d59160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7ac67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49102/0 (socket says 172.21.15.81:49102) 2024-09-12T01:34:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7ac67fc640 1 -- 172.21.15.81:0/3723924976 learned_addr learned my addr 172.21.15.81:0/3723924976 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7ac6ffd640 1 --2- 172.21.15.81:0/3723924976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8ca0 0x561770e04650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/3723924976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770e07a90 0x561770e04b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7ac67fc640 1 -- 172.21.15.81:0/3723924976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8ca0 msgr2=0x561770e04650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/3723924976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8ca0 0x561770e04650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7ac67fc640 1 -- 172.21.15.81:0/3723924976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770e07a90 msgr2=0x561770e04b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/3723924976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770e07a90 0x561770e04b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7ac67fc640 1 -- 172.21.15.81:0/3723924976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561770acf3c0 con 0x561770df8380 2024-09-12T01:34:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/3723924976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e073a0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0011010 tx=0x7f7ab0005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ad14cfbfafe40b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7aae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7aae7fc640 1 -- 172.21.15.81:0/3723924976 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0005030 con 0x561770df8380 2024-09-12T01:34:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7aae7fc640 1 -- 172.21.15.81:0/3723924976 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7ab00051d0 con 0x561770df8380 2024-09-12T01:34:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7acf98f740 1 -- 172.21.15.81:0/3723924976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ab00041c0 con 0x561770df8380 2024-09-12T01:34:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.279+0000 7f7aae7fc640 1 -- 172.21.15.81:0/3723924976 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ab0032050 con 0x561770df8380 2024-09-12T01:34:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.280+0000 7f7acf98f740 10 client.16863 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.280+0000 7f7acf98f740 1 -- 172.21.15.81:0/3723924976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561770e16020 con 0x561770df8380 2024-09-12T01:34:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.280+0000 7f7aae7fc640 1 -- 172.21.15.81:0/3723924976 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ab00041c0 con 0x561770df8380 2024-09-12T01:34:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.280+0000 7f7aae7fc640 1 -- 172.21.15.81:0/3723924976 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ab002b060 con 0x561770df8380 2024-09-12T01:34:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.280+0000 7f7acf98f740 10 client.16863 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.280+0000 7f7acf98f740 10 client.16863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.280+0000 7f7acf98f740 20 client.16863 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.280+0000 7f7acf98f740 1 --2- 172.21.15.81:0/3723924976 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561770e173d0 0x561770e197c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.280+0000 7f7acf98f740 4 client.16863 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.280+0000 7f7acf98f740 1 -- 172.21.15.81:0/3723924976 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561770d6b850 con 0x561770e173d0 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.280+0000 7f7ac6ffd640 1 --2- 172.21.15.81:0/3723924976 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561770e173d0 0x561770e197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.281+0000 7f7aae7fc640 10 client.16863 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.281+0000 7f7ac6ffd640 1 --2- 172.21.15.81:0/3723924976 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561770e173d0 0x561770e197c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20b106d189a9d1e4 server_cookie=2590e39600583531 in_seq=0 out_seq=0 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.281+0000 7f7aae7fc640 1 -- 172.21.15.81:0/3723924976 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561770d6b850 con 0x561770e173d0 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.281+0000 7f7aae7fc640 10 client.16863 handle_command_reply: tid=0 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.282+0000 7f7acf98f740 1 client.16863 shutdown 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.282+0000 7f7acf98f740 1 -- 172.21.15.81:0/3723924976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 msgr2=0x561770e073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.282+0000 7f7acf98f740 1 --2- 172.21.15.81:0/3723924976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e073a0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0011010 tx=0x7f7ab0005ec0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.282+0000 7f7acf98f740 1 -- 172.21.15.81:0/3723924976 shutdown_connections 2024-09-12T01:34:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.282+0000 7f7acf98f740 1 --2- 172.21.15.81:0/3723924976 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561770e173d0 0x561770e197c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.282+0000 7f7acf98f740 1 --2- 172.21.15.81:0/3723924976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770e07a90 0x561770e04b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.282+0000 7f7acf98f740 1 --2- 172.21.15.81:0/3723924976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8ca0 0x561770e04650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.282+0000 7f7acf98f740 1 --2- 172.21.15.81:0/3723924976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e073a0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.282+0000 7f7aae7fc640 0 client.16863 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.282+0000 7f7acf98f740 1 -- 172.21.15.81:0/3723924976 >> 172.21.15.81:0/3723924976 conn(0x561770df4a30 msgr2=0x561770dfa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.282+0000 7f7acf98f740 1 -- 172.21.15.81:0/3723924976 shutdown_connections 2024-09-12T01:34:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.282+0000 7f7acf98f740 1 -- 172.21.15.81:0/3723924976 wait complete. 2024-09-12T01:34:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.282+0000 7f7acf98f740 20 client.16863 trim_cache size 0 max 16384 2024-09-12T01:34:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.312+0000 7f7acf98f740 1 Processor -- start 2024-09-12T01:34:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7acf98f740 1 -- start start 2024-09-12T01:34:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7acf98f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e13900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7acf98f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770df8ca0 0x561770e1eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7acf98f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770e07a90 0x561770e1f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7acf98f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac81ab640 con 0x561770df8380 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7acf98f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac81ad180 con 0x561770df8ca0 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7acf98f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac81abd10 con 0x561770e07a90 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7ac67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e13900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7ac67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e13900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49112/0 (socket says 172.21.15.81:49112) 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7ac67fc640 1 -- 172.21.15.81:0/1722689930 learned_addr learned my addr 172.21.15.81:0/1722689930 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7ac6ffd640 1 --2- 172.21.15.81:0/1722689930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770df8ca0 0x561770e1eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/1722689930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770e07a90 0x561770e1f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7ac67fc640 1 -- 172.21.15.81:0/1722689930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770e07a90 msgr2=0x561770e1f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/1722689930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770e07a90 0x561770e1f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7ac67fc640 1 -- 172.21.15.81:0/1722689930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770df8ca0 msgr2=0x561770e1eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/1722689930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770df8ca0 0x561770e1eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7ac67fc640 1 -- 172.21.15.81:0/1722689930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561770e0a1c0 con 0x561770df8380 2024-09-12T01:34:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.313+0000 7f7ac6ffd640 1 --2- 172.21.15.81:0/1722689930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770df8ca0 0x561770e1eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:34:20.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.314+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/1722689930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e13900 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0003650 tx=0x7f7ab0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9766088379dc275a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:20.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.314+0000 7f7abcff9640 1 -- 172.21.15.81:0/1722689930 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0010d70 con 0x561770df8380 2024-09-12T01:34:20.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.314+0000 7f7abcff9640 1 -- 172.21.15.81:0/1722689930 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ab0022040 con 0x561770df8380 2024-09-12T01:34:20.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.314+0000 7f7abcff9640 1 -- 172.21.15.81:0/1722689930 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00048c0 con 0x561770df8380 2024-09-12T01:34:20.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 -- 172.21.15.81:0/1722689930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 msgr2=0x561770e13900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:20.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 --2- 172.21.15.81:0/1722689930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e13900 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0003650 tx=0x7f7ab0000bc0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 -- 172.21.15.81:0/1722689930 shutdown_connections 2024-09-12T01:34:20.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 --2- 172.21.15.81:0/1722689930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770e07a90 0x561770e1f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 --2- 172.21.15.81:0/1722689930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770df8ca0 0x561770e1eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 --2- 172.21.15.81:0/1722689930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e13900 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 -- 172.21.15.81:0/1722689930 >> 172.21.15.81:0/1722689930 conn(0x561770df4a30 msgr2=0x561770dffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 -- 172.21.15.81:0/1722689930 shutdown_connections 2024-09-12T01:34:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 -- 172.21.15.81:0/1722689930 wait complete. 2024-09-12T01:34:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 -- start start 2024-09-12T01:34:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 Processor -- start 2024-09-12T01:34:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e0aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8ca0 0x561770e0afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770e07a90 0x561770e0b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac81acab0 con 0x561770df8380 2024-09-12T01:34:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac81ac3e0 con 0x561770e07a90 2024-09-12T01:34:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac81a9620 con 0x561770df8ca0 2024-09-12T01:34:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.315+0000 7f7acf98f740 10 client.0 _ll_register_callbacks cb 0x7f7ab000df20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7ac67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e0aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7ac67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e0aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49124/0 (socket says 172.21.15.81:49124) 2024-09-12T01:34:20.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7ac67fc640 1 -- 172.21.15.81:0/618755965 learned_addr learned my addr 172.21.15.81:0/618755965 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:20.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7ac6ffd640 1 --2- 172.21.15.81:0/618755965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8ca0 0x561770e0afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/618755965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770e07a90 0x561770e0b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7ac67fc640 1 -- 172.21.15.81:0/618755965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8ca0 msgr2=0x561770e0afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:20.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/618755965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8ca0 0x561770e0afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7ac67fc640 1 -- 172.21.15.81:0/618755965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770e07a90 msgr2=0x561770e0b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:20.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/618755965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770e07a90 0x561770e0b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7ac67fc640 1 -- 172.21.15.81:0/618755965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561770e801e0 con 0x561770df8380 2024-09-12T01:34:20.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7ac67fc640 1 --2- 172.21.15.81:0/618755965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e0aa70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0005ad0 tx=0x7f7ab0013740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834a0ce05800aaf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:20.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7aae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:20.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7aae7fc640 1 -- 172.21.15.81:0/618755965 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab003b070 con 0x561770df8380 2024-09-12T01:34:20.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7aae7fc640 1 -- 172.21.15.81:0/618755965 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f7ab0003e20 con 0x561770df8380 2024-09-12T01:34:20.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.316+0000 7f7acf98f740 1 -- 172.21.15.81:0/618755965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ab0022040 con 0x561770df8380 2024-09-12T01:34:20.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.317+0000 7f7aae7fc640 1 -- 172.21.15.81:0/618755965 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ab0004020 con 0x561770df8380 2024-09-12T01:34:20.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.317+0000 7f7acf98f740 10 client.16869 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:20.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.317+0000 7f7acf98f740 1 -- 172.21.15.81:0/618755965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561770e81490 con 0x561770df8380 2024-09-12T01:34:20.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.317+0000 7f7aae7fc640 1 -- 172.21.15.81:0/618755965 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ab0022040 con 0x561770df8380 2024-09-12T01:34:20.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.317+0000 7f7aae7fc640 1 -- 172.21.15.81:0/618755965 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ab002b030 con 0x561770df8380 2024-09-12T01:34:20.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.317+0000 7f7acf98f740 10 client.16869 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:20.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.317+0000 7f7acf98f740 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:34:20.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.317+0000 7f7acf98f740 20 client.16869 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:20.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.317+0000 7f7acf98f740 1 --2- 172.21.15.81:0/618755965 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561770e81960 0x561770e83d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:20.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.317+0000 7f7acf98f740 4 client.16869 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:34:20.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.317+0000 7f7acf98f740 1 -- 172.21.15.81:0/618755965 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561770d65d60 con 0x561770e81960 2024-09-12T01:34:20.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.317+0000 7f7ac6ffd640 1 --2- 172.21.15.81:0/618755965 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561770e81960 0x561770e83d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:20.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7ac6ffd640 1 --2- 172.21.15.81:0/618755965 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561770e81960 0x561770e83d50 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0340f18b2c93c39 server_cookie=9e0df18b52a4a27e in_seq=0 out_seq=0 2024-09-12T01:34:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7aae7fc640 10 client.16869 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7aae7fc640 1 -- 172.21.15.81:0/618755965 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561770d65d60 con 0x561770e81960 2024-09-12T01:34:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7aae7fc640 10 client.16869 handle_command_reply: tid=0 2024-09-12T01:34:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7acf98f740 1 client.16869 shutdown 2024-09-12T01:34:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7acf98f740 1 -- 172.21.15.81:0/618755965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 msgr2=0x561770e0aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7acf98f740 1 --2- 172.21.15.81:0/618755965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e0aa70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0005ad0 tx=0x7f7ab0013740 comp rx=0 tx=0).stop 2024-09-12T01:34:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7acf98f740 1 -- 172.21.15.81:0/618755965 shutdown_connections 2024-09-12T01:34:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7acf98f740 1 --2- 172.21.15.81:0/618755965 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x561770e81960 0x561770e83d50 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7acf98f740 1 --2- 172.21.15.81:0/618755965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561770e07a90 0x561770e0b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7aae7fc640 0 client.16869 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7acf98f740 1 --2- 172.21.15.81:0/618755965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561770df8ca0 0x561770e0afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7acf98f740 1 --2- 172.21.15.81:0/618755965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561770df8380 0x561770e0aa70 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7acf98f740 1 -- 172.21.15.81:0/618755965 >> 172.21.15.81:0/618755965 conn(0x561770df4a30 msgr2=0x561770e02f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7acf98f740 1 -- 172.21.15.81:0/618755965 shutdown_connections 2024-09-12T01:34:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7acf98f740 1 -- 172.21.15.81:0/618755965 wait complete. 2024-09-12T01:34:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.318+0000 7f7acf98f740 20 client.16869 trim_cache size 0 max 16384 2024-09-12T01:34:20.323 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:34:20.323 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:34:20.323 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:34:20.323 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:34:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.319+0000 7f7acd5b6640 1 -- 172.21.15.81:0/1181768573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ab40a2cf0 msgr2=0x7f7ab40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.319+0000 7f7acd5b6640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ab40a2cf0 0x7f7ab40a51b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00cc2c0 tx=0x7f7ac000e040 comp rx=0 tx=0).stop 2024-09-12T01:34:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.319+0000 7f7acd5b6640 1 -- 172.21.15.81:0/1181768573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ac8102ef0 msgr2=0x7f7ac819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.319+0000 7f7acd5b6640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ac8102ef0 0x7f7ac819ce00 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000b970 tx=0x7f7ac000be30 comp rx=0 tx=0).stop 2024-09-12T01:34:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.319+0000 7f7acd5b6640 1 -- 172.21.15.81:0/1181768573 shutdown_connections 2024-09-12T01:34:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.319+0000 7f7acd5b6640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f7ab40a2cf0 0x7f7ab40a51b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.319+0000 7f7acd5b6640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ac8102ef0 0x7f7ac819ce00 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.319+0000 7f7acd5b6640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ac8102570 0x7f7ac8198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.319+0000 7f7acd5b6640 1 --2- 172.21.15.81:0/1181768573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ac8100e20 0x7f7ac8198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.319+0000 7f7acd5b6640 1 -- 172.21.15.81:0/1181768573 >> 172.21.15.81:0/1181768573 conn(0x7f7ac80fc7d0 msgr2=0x7f7ac80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.319+0000 7f7acd5b6640 1 -- 172.21.15.81:0/1181768573 shutdown_connections 2024-09-12T01:34:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:20.319+0000 7f7acd5b6640 1 -- 172.21.15.81:0/1181768573 wait complete. 2024-09-12T01:34:21.317 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:34:21.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:34:21.566 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:34:21.682 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:21 smithi081 ceph-mon[30920]: pgmap v191: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T01:34:21.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:21 smithi100 ceph-mon[35275]: pgmap v191: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T01:34:21.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:21 smithi189 ceph-mon[35357]: pgmap v191: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T01:34:22.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.023+0000 7fce6912c640 1 -- 172.21.15.81:0/2160139008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce64101de0 msgr2=0x7fce641021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:22.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.023+0000 7fce6912c640 1 --2- 172.21.15.81:0/2160139008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce64101de0 0x7fce641021c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fce54009900 tx=0x7fce5402a410 comp rx=0 tx=0).stop 2024-09-12T01:34:22.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.023+0000 7fce6912c640 1 -- 172.21.15.81:0/2160139008 shutdown_connections 2024-09-12T01:34:22.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.023+0000 7fce6912c640 1 --2- 172.21.15.81:0/2160139008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce64106f10 0x7fce6410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.023+0000 7fce6912c640 1 --2- 172.21.15.81:0/2160139008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64102790 0x7fce641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.023+0000 7fce6912c640 1 --2- 172.21.15.81:0/2160139008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce64101de0 0x7fce641021c0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.023+0000 7fce6912c640 1 -- 172.21.15.81:0/2160139008 >> 172.21.15.81:0/2160139008 conn(0x7fce640fd8c0 msgr2=0x7fce640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.023+0000 7fce6912c640 1 -- 172.21.15.81:0/2160139008 shutdown_connections 2024-09-12T01:34:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.023+0000 7fce6912c640 1 -- 172.21.15.81:0/2160139008 wait complete. 2024-09-12T01:34:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.023+0000 7fce6912c640 1 Processor -- start 2024-09-12T01:34:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6912c640 1 -- start start 2024-09-12T01:34:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6912c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce64101de0 0x7fce640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6912c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64102790 0x7fce64074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6912c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce64106f10 0x7fce64074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6912c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fce64112010 con 0x7fce64106f10 2024-09-12T01:34:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6912c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce64111e90 con 0x7fce64102790 2024-09-12T01:34:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6912c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce64112190 con 0x7fce64101de0 2024-09-12T01:34:22.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce64106f10 0x7fce64074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:22.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce64106f10 0x7fce64074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49148/0 (socket says 172.21.15.81:49148) 2024-09-12T01:34:22.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6359e640 1 -- 172.21.15.81:0/1223735479 learned_addr learned my addr 172.21.15.81:0/1223735479 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:22.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce5bfff640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64102790 0x7fce64074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:22.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce62d9d640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce64101de0 0x7fce640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:22.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6359e640 1 -- 172.21.15.81:0/1223735479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce64101de0 msgr2=0x7fce640744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:22.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6359e640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce64101de0 0x7fce640744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6359e640 1 -- 172.21.15.81:0/1223735479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64102790 msgr2=0x7fce64074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:22.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6359e640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64102790 0x7fce64074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6359e640 1 -- 172.21.15.81:0/1223735479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce641a6a70 con 0x7fce64106f10 2024-09-12T01:34:22.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce6359e640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce64106f10 0x7fce64074f70 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00b970 tx=0x7fce5c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:22.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.024+0000 7fce60d99640 1 -- 172.21.15.81:0/1223735479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c019070 con 0x7fce64106f10 2024-09-12T01:34:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.025+0000 7fce60d99640 1 -- 172.21.15.81:0/1223735479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce5c00cb40 con 0x7fce64106f10 2024-09-12T01:34:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.025+0000 7fce6912c640 1 -- 172.21.15.81:0/1223735479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce641a6d60 con 0x7fce64106f10 2024-09-12T01:34:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.025+0000 7fce60d99640 1 -- 172.21.15.81:0/1223735479 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c007650 con 0x7fce64106f10 2024-09-12T01:34:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.025+0000 7fce6912c640 1 -- 172.21.15.81:0/1223735479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce641a72a0 con 0x7fce64106f10 2024-09-12T01:34:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.026+0000 7fce6912c640 1 -- 172.21.15.81:0/1223735479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce64102240 con 0x7fce64106f10 2024-09-12T01:34:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.027+0000 7fce60d99640 1 -- 172.21.15.81:0/1223735479 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fce5c01c070 con 0x7fce64106f10 2024-09-12T01:34:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.027+0000 7fce60d99640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fce500a2cf0 0x7fce500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.028+0000 7fce62d9d640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fce500a2cf0 0x7fce500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.028+0000 7fce60d99640 1 -- 172.21.15.81:0/1223735479 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fce5c0cee70 con 0x7fce64106f10 2024-09-12T01:34:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.028+0000 7fce62d9d640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fce500a2cf0 0x7fce500a51b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fce540096c0 tx=0x7fce54000bc0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.031+0000 7fce60d99640 1 -- 172.21.15.81:0/1223735479 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce5c09bb70 con 0x7fce64106f10 2024-09-12T01:34:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.230+0000 7fce6912c640 1 -- 172.21.15.81:0/1223735479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce6410a120 con 0x7fce64106f10 2024-09-12T01:34:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.231+0000 7fce60d99640 1 -- 172.21.15.81:0/1223735479 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fce5c09b470 con 0x7fce64106f10 2024-09-12T01:34:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:34:22.231 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:34:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:34:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.233+0000 7fce6912c640 1 -- 172.21.15.81:0/1223735479 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fce500a2cf0 msgr2=0x7fce500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.233+0000 7fce6912c640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fce500a2cf0 0x7fce500a51b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fce540096c0 tx=0x7fce54000bc0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.233+0000 7fce6912c640 1 -- 172.21.15.81:0/1223735479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce64106f10 msgr2=0x7fce64074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.233+0000 7fce6912c640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce64106f10 0x7fce64074f70 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00b970 tx=0x7fce5c00be30 comp rx=0 tx=0).stop 2024-09-12T01:34:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.233+0000 7fce6912c640 1 -- 172.21.15.81:0/1223735479 shutdown_connections 2024-09-12T01:34:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.233+0000 7fce6912c640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fce500a2cf0 0x7fce500a51b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.233+0000 7fce6912c640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce64106f10 0x7fce64074f70 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.233+0000 7fce6912c640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce64102790 0x7fce64074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.233+0000 7fce6912c640 1 --2- 172.21.15.81:0/1223735479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce64101de0 0x7fce640744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.233+0000 7fce6912c640 1 -- 172.21.15.81:0/1223735479 >> 172.21.15.81:0/1223735479 conn(0x7fce640fd8c0 msgr2=0x7fce640fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:22.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.233+0000 7fce6912c640 1 -- 172.21.15.81:0/1223735479 shutdown_connections 2024-09-12T01:34:22.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:22.233+0000 7fce6912c640 1 -- 172.21.15.81:0/1223735479 wait complete. 2024-09-12T01:34:22.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:22 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1223735479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:34:22.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:22 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1223735479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:34:22.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:22 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1223735479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:34:22.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:34:23.170 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:34:23.576 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:23 smithi081 ceph-mon[30920]: pgmap v192: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:23.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.658+0000 7f2a755a2640 1 -- 172.21.15.81:0/3075661674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a701008d0 msgr2=0x7f2a70100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:23.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.658+0000 7f2a755a2640 1 --2- 172.21.15.81:0/3075661674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a701008d0 0x7f2a70100d30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009930 tx=0x7f2a5802a420 comp rx=0 tx=0).stop 2024-09-12T01:34:23.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.658+0000 7f2a755a2640 1 -- 172.21.15.81:0/3075661674 shutdown_connections 2024-09-12T01:34:23.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.658+0000 7f2a755a2640 1 --2- 172.21.15.81:0/3075661674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a70101270 0x7f2a7010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.658+0000 7f2a755a2640 1 --2- 172.21.15.81:0/3075661674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a701008d0 0x7f2a70100d30 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.658+0000 7f2a755a2640 1 --2- 172.21.15.81:0/3075661674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a701068d0 0x7f2a70106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.658+0000 7f2a755a2640 1 -- 172.21.15.81:0/3075661674 >> 172.21.15.81:0/3075661674 conn(0x7f2a700fc630 msgr2=0x7f2a700fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.658+0000 7f2a755a2640 1 -- 172.21.15.81:0/3075661674 shutdown_connections 2024-09-12T01:34:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.658+0000 7f2a755a2640 1 -- 172.21.15.81:0/3075661674 wait complete. 2024-09-12T01:34:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.658+0000 7f2a755a2640 1 Processor -- start 2024-09-12T01:34:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a755a2640 1 -- start start 2024-09-12T01:34:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a755a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a701008d0 0x7f2a701981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a755a2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a70101270 0x7f2a701986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a755a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a701068d0 0x7f2a7019ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a755a2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70110cd0 con 0x7f2a701068d0 2024-09-12T01:34:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a755a2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70110b50 con 0x7f2a701008d0 2024-09-12T01:34:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a755a2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70110e50 con 0x7f2a70101270 2024-09-12T01:34:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a74da1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a701068d0 0x7f2a7019ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a74da1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a701068d0 0x7f2a7019ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36874/0 (socket says 172.21.15.81:36874) 2024-09-12T01:34:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a74da1640 1 -- 172.21.15.81:0/3311628417 learned_addr learned my addr 172.21.15.81:0/3311628417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a6ffff640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a701008d0 0x7f2a701981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a67fff640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a70101270 0x7f2a701986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a74da1640 1 -- 172.21.15.81:0/3311628417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a70101270 msgr2=0x7f2a701986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a74da1640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a70101270 0x7f2a701986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a74da1640 1 -- 172.21.15.81:0/3311628417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a701008d0 msgr2=0x7f2a701981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a74da1640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a701008d0 0x7f2a701981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a74da1640 1 -- 172.21.15.81:0/3311628417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7019d150 con 0x7f2a701068d0 2024-09-12T01:34:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.659+0000 7f2a74da1640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a701068d0 0x7f2a7019ca70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800cce0 tx=0x7f2a6800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:23.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.660+0000 7f2a6dffb640 1 -- 172.21.15.81:0/3311628417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800f450 con 0x7f2a701068d0 2024-09-12T01:34:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.660+0000 7f2a6dffb640 1 -- 172.21.15.81:0/3311628417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a6800fad0 con 0x7f2a701068d0 2024-09-12T01:34:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.660+0000 7f2a755a2640 1 -- 172.21.15.81:0/3311628417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7019d440 con 0x7f2a701068d0 2024-09-12T01:34:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.660+0000 7f2a6dffb640 1 -- 172.21.15.81:0/3311628417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a68018b60 con 0x7f2a701068d0 2024-09-12T01:34:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.660+0000 7f2a755a2640 1 -- 172.21.15.81:0/3311628417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a701a4d20 con 0x7f2a701068d0 2024-09-12T01:34:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.662+0000 7f2a6dffb640 1 -- 172.21.15.81:0/3311628417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f2a6800fc80 con 0x7f2a701068d0 2024-09-12T01:34:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.662+0000 7f2a78bdd740 1 Processor -- start 2024-09-12T01:34:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.662+0000 7f2a78bdd740 1 -- start start 2024-09-12T01:34:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.662+0000 7f2a78bdd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fcd20 0x56532c8fb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.662+0000 7f2a78bdd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fb7b0 0x56532c8fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.662+0000 7f2a78bdd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c90a960 0x56532c90cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.662+0000 7f2a78bdd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56532c8612f0 con 0x56532c8fcd20 2024-09-12T01:34:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.662+0000 7f2a78bdd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56532c808cf0 con 0x56532c90a960 2024-09-12T01:34:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.662+0000 7f2a78bdd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56532c85d2b0 con 0x56532c8fb7b0 2024-09-12T01:34:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.662+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fcd20 0x56532c8fb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.662+0000 7f2a6ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fb7b0 0x56532c8fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.662+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fcd20 0x56532c8fb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36882/0 (socket says 172.21.15.81:36882) 2024-09-12T01:34:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.662+0000 7f2a67fff640 1 -- 172.21.15.81:0/55583204 learned_addr learned my addr 172.21.15.81:0/55583204 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a6dffb640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2a5c0a2cf0 0x7f2a5c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a67fff640 1 --2- 172.21.15.81:0/55583204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c90a960 0x56532c90cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a74da1640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2a5c0a2cf0 0x7f2a5c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a67fff640 1 -- 172.21.15.81:0/55583204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fb7b0 msgr2=0x56532c8fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a67fff640 1 --2- 172.21.15.81:0/55583204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fb7b0 0x56532c8fbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a67fff640 1 -- 172.21.15.81:0/55583204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c90a960 msgr2=0x56532c90cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a67fff640 1 --2- 172.21.15.81:0/55583204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c90a960 0x56532c90cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a67fff640 1 -- 172.21.15.81:0/55583204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56532c7ed3a0 con 0x56532c8fcd20 2024-09-12T01:34:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a6ffff640 1 --2- 172.21.15.81:0/55583204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fb7b0 0x56532c8fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:34:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a6dffb640 1 -- 172.21.15.81:0/3311628417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2a680cf950 con 0x7f2a701068d0 2024-09-12T01:34:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a67fff640 1 --2- 172.21.15.81:0/55583204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fcd20 0x56532c8fb270 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2a58031550 tx=0x7f2a58005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eccbb602b11f33c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a74da1640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2a5c0a2cf0 0x7f2a5c0a51b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2a6809bba0 tx=0x7f2a680c6a30 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a667fc640 1 -- 172.21.15.81:0/55583204 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a58035070 con 0x56532c8fcd20 2024-09-12T01:34:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a667fc640 1 -- 172.21.15.81:0/55583204 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a58005040 con 0x56532c8fcd20 2024-09-12T01:34:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.663+0000 7f2a667fc640 1 -- 172.21.15.81:0/55583204 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a58004a40 con 0x56532c8fcd20 2024-09-12T01:34:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.664+0000 7f2a78bdd740 1 -- 172.21.15.81:0/55583204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fcd20 msgr2=0x56532c8fb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.664+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/55583204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fcd20 0x56532c8fb270 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2a58031550 tx=0x7f2a58005a20 comp rx=0 tx=0).stop 2024-09-12T01:34:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.664+0000 7f2a78bdd740 1 -- 172.21.15.81:0/55583204 shutdown_connections 2024-09-12T01:34:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.664+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/55583204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c90a960 0x56532c90cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.664+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/55583204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fb7b0 0x56532c8fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.664+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/55583204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fcd20 0x56532c8fb270 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.664+0000 7f2a78bdd740 1 -- 172.21.15.81:0/55583204 >> 172.21.15.81:0/55583204 conn(0x56532c8c4310 msgr2=0x56532c8f7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.664+0000 7f2a78bdd740 1 -- 172.21.15.81:0/55583204 shutdown_connections 2024-09-12T01:34:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.664+0000 7f2a78bdd740 1 -- 172.21.15.81:0/55583204 wait complete. 2024-09-12T01:34:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.664+0000 7f2a78bdd740 1 -- start start 2024-09-12T01:34:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a78bdd740 1 Processor -- start 2024-09-12T01:34:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a78bdd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fb7b0 0x56532c90a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a78bdd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fcd20 0x56532c907660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a78bdd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 0x56532c907df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a78bdd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56532c90d600 con 0x56532c90a960 2024-09-12T01:34:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a78bdd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56532c81c060 con 0x56532c8fb7b0 2024-09-12T01:34:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a78bdd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56532c90d780 con 0x56532c8fcd20 2024-09-12T01:34:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a78bdd740 10 client.0 _ll_register_callbacks cb 0x56532c56f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 0x56532c907df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 0x56532c907df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36892/0 (socket says 172.21.15.81:36892) 2024-09-12T01:34:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a67fff640 1 -- 172.21.15.81:0/2552451281 learned_addr learned my addr 172.21.15.81:0/2552451281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a67fff640 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fb7b0 0x56532c90a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a6ffff640 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fcd20 0x56532c907660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a67fff640 1 -- 172.21.15.81:0/2552451281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fcd20 msgr2=0x56532c907660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a67fff640 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fcd20 0x56532c907660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a67fff640 1 -- 172.21.15.81:0/2552451281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fb7b0 msgr2=0x56532c90a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a67fff640 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fb7b0 0x56532c90a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a67fff640 1 -- 172.21.15.81:0/2552451281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56532c5d23c0 con 0x56532c90a960 2024-09-12T01:34:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.665+0000 7f2a6ffff640 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fcd20 0x56532c907660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:34:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a67fff640 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 0x56532c907df0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2a580092b0 tx=0x7f2a580045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383011cdd7024c7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a4f7fe640 1 -- 172.21.15.81:0/2552451281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a58035070 con 0x56532c90a960 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a4f7fe640 1 -- 172.21.15.81:0/2552451281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2a580051f0 con 0x56532c90a960 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a78bdd740 1 -- 172.21.15.81:0/2552451281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a58005040 con 0x56532c90a960 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a4f7fe640 1 -- 172.21.15.81:0/2552451281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a5802aa60 con 0x56532c90a960 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a78bdd740 10 client.16887 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a78bdd740 1 -- 172.21.15.81:0/2552451281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56532c919110 con 0x56532c90a960 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a4f7fe640 1 -- 172.21.15.81:0/2552451281 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a58005040 con 0x56532c90a960 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a4f7fe640 1 -- 172.21.15.81:0/2552451281 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2a58003710 con 0x56532c90a960 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a78bdd740 10 client.16887 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a78bdd740 10 client.16887 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a78bdd740 20 client.16887 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56532c91a460 0x56532c91c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a78bdd740 4 client.16887 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.666+0000 7f2a78bdd740 1 -- 172.21.15.81:0/2552451281 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56532c86e860 con 0x56532c91a460 2024-09-12T01:34:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.667+0000 7f2a6ffff640 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56532c91a460 0x56532c91c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.667+0000 7f2a6ffff640 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56532c91a460 0x56532c91c850 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c303c193cb27c7a9 server_cookie=45457e6d95c9e1ce in_seq=0 out_seq=0 2024-09-12T01:34:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.667+0000 7f2a4f7fe640 10 client.16887 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:34:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a4f7fe640 1 -- 172.21.15.81:0/2552451281 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56532c86e860 con 0x56532c91a460 2024-09-12T01:34:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a4f7fe640 10 client.16887 handle_command_reply: tid=0 2024-09-12T01:34:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a78bdd740 1 client.16887 shutdown 2024-09-12T01:34:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a78bdd740 1 -- 172.21.15.81:0/2552451281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 msgr2=0x56532c907df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 0x56532c907df0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2a580092b0 tx=0x7f2a580045a0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a78bdd740 1 -- 172.21.15.81:0/2552451281 shutdown_connections 2024-09-12T01:34:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 0x56532c907df0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56532c91a460 0x56532c91c850 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fcd20 0x56532c907660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/2552451281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fb7b0 0x56532c90a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a4f7fe640 0 client.16887 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:34:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a78bdd740 1 -- 172.21.15.81:0/2552451281 >> 172.21.15.81:0/2552451281 conn(0x56532c8c4310 msgr2=0x56532c8fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a78bdd740 1 -- 172.21.15.81:0/2552451281 shutdown_connections 2024-09-12T01:34:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a78bdd740 1 -- 172.21.15.81:0/2552451281 wait complete. 2024-09-12T01:34:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.668+0000 7f2a78bdd740 20 client.16887 trim_cache size 0 max 16384 2024-09-12T01:34:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a78bdd740 1 Processor -- start 2024-09-12T01:34:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a78bdd740 1 -- start start 2024-09-12T01:34:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a78bdd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fb7b0 0x56532c8fc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a78bdd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fcd20 0x56532c916120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a78bdd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 0x56532c8f7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a78bdd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2a701ab280 con 0x56532c90a960 2024-09-12T01:34:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a78bdd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2a701acdc0 con 0x56532c8fcd20 2024-09-12T01:34:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a78bdd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2a701ab950 con 0x56532c8fb7b0 2024-09-12T01:34:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 0x56532c8f7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 0x56532c8f7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36900/0 (socket says 172.21.15.81:36900) 2024-09-12T01:34:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a67fff640 1 -- 172.21.15.81:0/2267570191 learned_addr learned my addr 172.21.15.81:0/2267570191 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a67fff640 1 --2- 172.21.15.81:0/2267570191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fb7b0 0x56532c8fc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a6ffff640 1 --2- 172.21.15.81:0/2267570191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fcd20 0x56532c916120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a67fff640 1 -- 172.21.15.81:0/2267570191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fb7b0 msgr2=0x56532c8fc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a67fff640 1 --2- 172.21.15.81:0/2267570191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fb7b0 0x56532c8fc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a67fff640 1 -- 172.21.15.81:0/2267570191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fcd20 msgr2=0x56532c916120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a67fff640 1 --2- 172.21.15.81:0/2267570191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fcd20 0x56532c916120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a67fff640 1 -- 172.21.15.81:0/2267570191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56532c9085a0 con 0x56532c90a960 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a6ffff640 1 --2- 172.21.15.81:0/2267570191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fcd20 0x56532c916120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.681+0000 7f2a67fff640 1 --2- 172.21.15.81:0/2267570191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 0x56532c8f7790 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2a5802a940 tx=0x7f2a58001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdfb5e050c03c95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.682+0000 7f2a65ffb640 1 -- 172.21.15.81:0/2267570191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a58035030 con 0x56532c90a960 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.682+0000 7f2a65ffb640 1 -- 172.21.15.81:0/2267570191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a58003d80 con 0x56532c90a960 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.682+0000 7f2a65ffb640 1 -- 172.21.15.81:0/2267570191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a580046c0 con 0x56532c90a960 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.682+0000 7f2a78bdd740 1 -- 172.21.15.81:0/2267570191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 msgr2=0x56532c8f7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.682+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/2267570191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 0x56532c8f7790 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2a5802a940 tx=0x7f2a58001e70 comp rx=0 tx=0).stop 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.682+0000 7f2a78bdd740 1 -- 172.21.15.81:0/2267570191 shutdown_connections 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.682+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/2267570191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c90a960 0x56532c8f7790 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.682+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/2267570191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fcd20 0x56532c916120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.682+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/2267570191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c8fb7b0 0x56532c8fc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.682+0000 7f2a78bdd740 1 -- 172.21.15.81:0/2267570191 >> 172.21.15.81:0/2267570191 conn(0x56532c8c4310 msgr2=0x56532c915a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.682+0000 7f2a78bdd740 1 -- 172.21.15.81:0/2267570191 shutdown_connections 2024-09-12T01:34:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.682+0000 7f2a78bdd740 1 -- 172.21.15.81:0/2267570191 wait complete. 2024-09-12T01:34:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a78bdd740 1 -- start start 2024-09-12T01:34:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a78bdd740 1 Processor -- start 2024-09-12T01:34:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a78bdd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fb7b0 0x56532c91d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a78bdd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fcd20 0x56532c91dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a78bdd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c90a960 0x56532c91e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a78bdd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2a701ac6f0 con 0x56532c8fb7b0 2024-09-12T01:34:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a78bdd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2a701ac020 con 0x56532c8fcd20 2024-09-12T01:34:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a78bdd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2a701a9260 con 0x56532c90a960 2024-09-12T01:34:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a78bdd740 10 client.0 _ll_register_callbacks cb 0x7f2a6000a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fb7b0 0x56532c91d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fb7b0 0x56532c91d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36912/0 (socket says 172.21.15.81:36912) 2024-09-12T01:34:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a67fff640 1 -- 172.21.15.81:0/412174108 learned_addr learned my addr 172.21.15.81:0/412174108 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a6ffff640 1 --2- 172.21.15.81:0/412174108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fcd20 0x56532c91dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a67fff640 1 -- 172.21.15.81:0/412174108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c90a960 msgr2=0x56532c91e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:23.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a67fff640 1 --2- 172.21.15.81:0/412174108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c90a960 0x56532c91e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a67fff640 1 -- 172.21.15.81:0/412174108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fcd20 msgr2=0x56532c91dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:23.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a67fff640 1 --2- 172.21.15.81:0/412174108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fcd20 0x56532c91dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a67fff640 1 -- 172.21.15.81:0/412174108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56532c983e50 con 0x56532c8fb7b0 2024-09-12T01:34:23.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.683+0000 7f2a6ffff640 1 --2- 172.21.15.81:0/412174108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fcd20 0x56532c91dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:34:23.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a67fff640 1 --2- 172.21.15.81:0/412174108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fb7b0 0x56532c91d690 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009850 tx=0x7f2a580043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8795bff2d284ea37 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:23.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:23.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a4f7fe640 1 -- 172.21.15.81:0/412174108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5805d470 con 0x56532c8fb7b0 2024-09-12T01:34:23.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a4f7fe640 1 -- 172.21.15.81:0/412174108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2a58045040 con 0x56532c8fb7b0 2024-09-12T01:34:23.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a78bdd740 1 -- 172.21.15.81:0/412174108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a58003d80 con 0x56532c8fb7b0 2024-09-12T01:34:23.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a4f7fe640 1 -- 172.21.15.81:0/412174108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a5805d610 con 0x56532c8fb7b0 2024-09-12T01:34:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a78bdd740 10 client.16893 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a78bdd740 1 -- 172.21.15.81:0/412174108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56532c985080 con 0x56532c8fb7b0 2024-09-12T01:34:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a4f7fe640 1 -- 172.21.15.81:0/412174108 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a58003d80 con 0x56532c8fb7b0 2024-09-12T01:34:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a4f7fe640 1 -- 172.21.15.81:0/412174108 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2a58066870 con 0x56532c8fb7b0 2024-09-12T01:34:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a78bdd740 10 client.16893 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a78bdd740 10 client.16893 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:34:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a78bdd740 20 client.16893 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/412174108 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56532c9856d0 0x56532c987ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a78bdd740 4 client.16893 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:34:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.684+0000 7f2a78bdd740 1 -- 172.21.15.81:0/412174108 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56532c868d70 con 0x56532c9856d0 2024-09-12T01:34:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.685+0000 7f2a6ffff640 1 --2- 172.21.15.81:0/412174108 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56532c9856d0 0x56532c987ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.685+0000 7f2a6ffff640 1 --2- 172.21.15.81:0/412174108 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56532c9856d0 0x56532c987ac0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fb9fb826f76b0483 server_cookie=cee71c3692416ff9 in_seq=0 out_seq=0 2024-09-12T01:34:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.685+0000 7f2a4f7fe640 10 client.16893 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:34:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.685+0000 7f2a4f7fe640 1 -- 172.21.15.81:0/412174108 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56532c868d70 con 0x56532c9856d0 2024-09-12T01:34:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.685+0000 7f2a4f7fe640 10 client.16893 handle_command_reply: tid=0 2024-09-12T01:34:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.685+0000 7f2a78bdd740 1 client.16893 shutdown 2024-09-12T01:34:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.685+0000 7f2a78bdd740 1 -- 172.21.15.81:0/412174108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fb7b0 msgr2=0x56532c91d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.685+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/412174108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fb7b0 0x56532c91d690 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009850 tx=0x7f2a580043b0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.685+0000 7f2a78bdd740 1 -- 172.21.15.81:0/412174108 shutdown_connections 2024-09-12T01:34:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.685+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/412174108 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56532c9856d0 0x56532c987ac0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.685+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/412174108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56532c90a960 0x56532c91e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/412174108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56532c8fcd20 0x56532c91dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a78bdd740 1 --2- 172.21.15.81:0/412174108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56532c8fb7b0 0x56532c91d690 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a4f7fe640 0 client.16893 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:34:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a78bdd740 1 -- 172.21.15.81:0/412174108 >> 172.21.15.81:0/412174108 conn(0x56532c8c4310 msgr2=0x56532c9096e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a78bdd740 1 -- 172.21.15.81:0/412174108 shutdown_connections 2024-09-12T01:34:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a78bdd740 1 -- 172.21.15.81:0/412174108 wait complete. 2024-09-12T01:34:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a78bdd740 20 client.16893 trim_cache size 0 max 16384 2024-09-12T01:34:23.705 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:34:23.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a755a2640 1 -- 172.21.15.81:0/3311628417 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2a5c0a2cf0 msgr2=0x7f2a5c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:23.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a755a2640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2a5c0a2cf0 0x7f2a5c0a51b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2a6809bba0 tx=0x7f2a680c6a30 comp rx=0 tx=0).stop 2024-09-12T01:34:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a755a2640 1 -- 172.21.15.81:0/3311628417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a701068d0 msgr2=0x7f2a7019ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a755a2640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a701068d0 0x7f2a7019ca70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800cce0 tx=0x7f2a6800a620 comp rx=0 tx=0).stop 2024-09-12T01:34:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a755a2640 1 -- 172.21.15.81:0/3311628417 shutdown_connections 2024-09-12T01:34:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a755a2640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2a5c0a2cf0 0x7f2a5c0a51b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a755a2640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a701068d0 0x7f2a7019ca70 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a755a2640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a70101270 0x7f2a701986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a755a2640 1 --2- 172.21.15.81:0/3311628417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a701008d0 0x7f2a701981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a755a2640 1 -- 172.21.15.81:0/3311628417 >> 172.21.15.81:0/3311628417 conn(0x7f2a700fc630 msgr2=0x7f2a7006a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a755a2640 1 -- 172.21.15.81:0/3311628417 shutdown_connections 2024-09-12T01:34:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:23.686+0000 7f2a755a2640 1 -- 172.21.15.81:0/3311628417 wait complete. 2024-09-12T01:34:23.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:23 smithi100 ceph-mon[35275]: pgmap v192: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:23 smithi189 ceph-mon[35357]: pgmap v192: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:24.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:34:24.669 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:34:25.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.131+0000 7fc2554a6640 1 -- 172.21.15.81:0/4153527200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250106a80 msgr2=0x7fc250106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:25.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.131+0000 7fc2554a6640 1 --2- 172.21.15.81:0/4153527200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250106a80 0x7fc250106e60 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fc240009cd0 tx=0x7fc24002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.131+0000 7fc2554a6640 1 -- 172.21.15.81:0/4153527200 shutdown_connections 2024-09-12T01:34:25.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.131+0000 7fc2554a6640 1 --2- 172.21.15.81:0/4153527200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc250101420 0x7fc25010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.131+0000 7fc2554a6640 1 --2- 172.21.15.81:0/4153527200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc250100a80 0x7fc250100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.131+0000 7fc2554a6640 1 --2- 172.21.15.81:0/4153527200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250106a80 0x7fc250106e60 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.131+0000 7fc2554a6640 1 -- 172.21.15.81:0/4153527200 >> 172.21.15.81:0/4153527200 conn(0x7fc2500fc7a0 msgr2=0x7fc2500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:25.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.131+0000 7fc2554a6640 1 -- 172.21.15.81:0/4153527200 shutdown_connections 2024-09-12T01:34:25.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.131+0000 7fc2554a6640 1 -- 172.21.15.81:0/4153527200 wait complete. 2024-09-12T01:34:25.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc2554a6640 1 Processor -- start 2024-09-12T01:34:25.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc2554a6640 1 -- start start 2024-09-12T01:34:25.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc2554a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250100a80 0x7fc250197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc2554a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc250101420 0x7fc250197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc2554a6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc250106a80 0x7fc25019bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc2554a6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc250110e40 con 0x7fc250100a80 2024-09-12T01:34:25.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc2554a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc250110cc0 con 0x7fc250101420 2024-09-12T01:34:25.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc2554a6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc250110fc0 con 0x7fc250106a80 2024-09-12T01:34:25.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc24effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250100a80 0x7fc250197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc24effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250100a80 0x7fc250197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36920/0 (socket says 172.21.15.81:36920) 2024-09-12T01:34:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc24effd640 1 -- 172.21.15.81:0/337136975 learned_addr learned my addr 172.21.15.81:0/337136975 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc24f7fe640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc250106a80 0x7fc25019bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc2467fc640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc250101420 0x7fc250197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc24effd640 1 -- 172.21.15.81:0/337136975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc250106a80 msgr2=0x7fc25019bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc24effd640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc250106a80 0x7fc25019bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc24effd640 1 -- 172.21.15.81:0/337136975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc250101420 msgr2=0x7fc250197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc24effd640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc250101420 0x7fc250197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.132+0000 7fc24effd640 1 -- 172.21.15.81:0/337136975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25019c2d0 con 0x7fc250100a80 2024-09-12T01:34:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.133+0000 7fc24effd640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250100a80 0x7fc250197320 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fc24002ae00 tx=0x7fc240003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.133+0000 7fc24cff9640 1 -- 172.21.15.81:0/337136975 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240004240 con 0x7fc250100a80 2024-09-12T01:34:25.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.133+0000 7fc2554a6640 1 -- 172.21.15.81:0/337136975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25019c560 con 0x7fc250100a80 2024-09-12T01:34:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.133+0000 7fc24cff9640 1 -- 172.21.15.81:0/337136975 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2400305a0 con 0x7fc250100a80 2024-09-12T01:34:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.133+0000 7fc24cff9640 1 -- 172.21.15.81:0/337136975 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24003a660 con 0x7fc250100a80 2024-09-12T01:34:25.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.133+0000 7fc2554a6640 1 -- 172.21.15.81:0/337136975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2501a3ea0 con 0x7fc250100a80 2024-09-12T01:34:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.135+0000 7fc24cff9640 1 -- 172.21.15.81:0/337136975 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc240030ac0 con 0x7fc250100a80 2024-09-12T01:34:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.135+0000 7fc25787f740 1 Processor -- start 2024-09-12T01:34:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.135+0000 7fc25787f740 1 -- start start 2024-09-12T01:34:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc25787f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02bbb40 0x5560c02ba090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc25787f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02ba5d0 0x5560c02baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc25787f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02c5370 0x5560c02c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc25787f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5560c02202f0 con 0x5560c02ba5d0 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc25787f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5560c01c7cf0 con 0x5560c02bbb40 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc25787f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5560c021c2b0 con 0x5560c02c5370 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc24cff9640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc23c0a2cf0 0x7fc23c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc24effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02ba5d0 0x5560c02baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc24f7fe640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc23c0a2cf0 0x7fc23c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc24effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02ba5d0 0x5560c02baa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36934/0 (socket says 172.21.15.81:36934) 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc24effd640 1 -- 172.21.15.81:0/1097406867 learned_addr learned my addr 172.21.15.81:0/1097406867 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc24f7fe640 1 --2- 172.21.15.81:0/1097406867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02bbb40 0x5560c02ba090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc24cff9640 1 -- 172.21.15.81:0/337136975 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fc24002e030 con 0x7fc250100a80 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.136+0000 7fc2467fc640 1 --2- 172.21.15.81:0/1097406867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02c5370 0x5560c02c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.137+0000 7fc24f7fe640 1 -- 172.21.15.81:0/1097406867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02c5370 msgr2=0x5560c02c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.137+0000 7fc24f7fe640 1 --2- 172.21.15.81:0/1097406867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02c5370 0x5560c02c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.137+0000 7fc24f7fe640 1 -- 172.21.15.81:0/1097406867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02ba5d0 msgr2=0x5560c02baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.137+0000 7fc24f7fe640 1 --2- 172.21.15.81:0/1097406867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02ba5d0 0x5560c02baa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.137+0000 7fc24f7fe640 1 -- 172.21.15.81:0/1097406867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c01ac3a0 con 0x5560c02bbb40 2024-09-12T01:34:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.137+0000 7fc24effd640 1 --2- 172.21.15.81:0/1097406867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02ba5d0 0x5560c02baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:34:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.137+0000 7fc24f7fe640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc23c0a2cf0 0x7fc23c0a51b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc248005d50 tx=0x7fc24800e9b0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.137+0000 7fc24f7fe640 1 --2- 172.21.15.81:0/1097406867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02bbb40 0x5560c02ba090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc24800ec60 tx=0x7fc24801a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd94854e0d2927f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.137+0000 7fc2457fa640 1 -- 172.21.15.81:0/1097406867 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24800b8e0 con 0x5560c02bbb40 2024-09-12T01:34:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.137+0000 7fc2457fa640 1 -- 172.21.15.81:0/1097406867 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc248024070 con 0x5560c02bbb40 2024-09-12T01:34:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.137+0000 7fc2457fa640 1 -- 172.21.15.81:0/1097406867 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24801f8c0 con 0x5560c02bbb40 2024-09-12T01:34:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.138+0000 7fc25787f740 1 -- 172.21.15.81:0/1097406867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02bbb40 msgr2=0x5560c02ba090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.138+0000 7fc25787f740 1 --2- 172.21.15.81:0/1097406867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02bbb40 0x5560c02ba090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc24800ec60 tx=0x7fc24801a000 comp rx=0 tx=0).stop 2024-09-12T01:34:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.138+0000 7fc25787f740 1 -- 172.21.15.81:0/1097406867 shutdown_connections 2024-09-12T01:34:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.138+0000 7fc25787f740 1 --2- 172.21.15.81:0/1097406867 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02c5370 0x5560c02c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.138+0000 7fc25787f740 1 --2- 172.21.15.81:0/1097406867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02ba5d0 0x5560c02baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.138+0000 7fc25787f740 1 --2- 172.21.15.81:0/1097406867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02bbb40 0x5560c02ba090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.138+0000 7fc25787f740 1 -- 172.21.15.81:0/1097406867 >> 172.21.15.81:0/1097406867 conn(0x5560c0283310 msgr2=0x5560c02b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.138+0000 7fc25787f740 1 -- 172.21.15.81:0/1097406867 shutdown_connections 2024-09-12T01:34:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.138+0000 7fc25787f740 1 -- 172.21.15.81:0/1097406867 wait complete. 2024-09-12T01:34:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.138+0000 7fc25787f740 1 -- start start 2024-09-12T01:34:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.138+0000 7fc25787f740 1 Processor -- start 2024-09-12T01:34:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc25787f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02ba5d0 0x5560c02c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc25787f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 0x5560c02c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc25787f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02c5370 0x5560c02c2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc25787f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5560c02c8010 con 0x5560c02bbb40 2024-09-12T01:34:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc25787f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5560c01db060 con 0x5560c02c5370 2024-09-12T01:34:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc25787f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5560c02c8190 con 0x5560c02ba5d0 2024-09-12T01:34:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc25787f740 10 client.0 _ll_register_callbacks cb 0x5560bff2e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc2467fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 0x5560c02c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc2467fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 0x5560c02c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36936/0 (socket says 172.21.15.81:36936) 2024-09-12T01:34:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc2467fc640 1 -- 172.21.15.81:0/3212008024 learned_addr learned my addr 172.21.15.81:0/3212008024 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc24f7fe640 1 --2- 172.21.15.81:0/3212008024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02c5370 0x5560c02c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc24effd640 1 --2- 172.21.15.81:0/3212008024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02ba5d0 0x5560c02c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc2467fc640 1 -- 172.21.15.81:0/3212008024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02ba5d0 msgr2=0x5560c02c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc2467fc640 1 --2- 172.21.15.81:0/3212008024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02ba5d0 0x5560c02c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc2467fc640 1 -- 172.21.15.81:0/3212008024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02c5370 msgr2=0x5560c02c2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:25.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc2467fc640 1 --2- 172.21.15.81:0/3212008024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02c5370 0x5560c02c2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc2467fc640 1 -- 172.21.15.81:0/3212008024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560bff913c0 con 0x5560c02bbb40 2024-09-12T01:34:25.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc2467fc640 1 --2- 172.21.15.81:0/3212008024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 0x5560c02c2010 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc238004650 tx=0x7fc2380039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de077392fe4f15ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:25.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc2367fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:25.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc2367fc640 1 -- 172.21.15.81:0/3212008024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238011910 con 0x5560c02bbb40 2024-09-12T01:34:25.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc2367fc640 1 -- 172.21.15.81:0/3212008024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fc238011ab0 con 0x5560c02bbb40 2024-09-12T01:34:25.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.139+0000 7fc25787f740 1 -- 172.21.15.81:0/3212008024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc248024070 con 0x5560c02bbb40 2024-09-12T01:34:25.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.140+0000 7fc2367fc640 1 -- 172.21.15.81:0/3212008024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc238011cb0 con 0x5560c02bbb40 2024-09-12T01:34:25.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.140+0000 7fc25787f740 10 client.16905 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:25.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.140+0000 7fc25787f740 1 -- 172.21.15.81:0/3212008024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5560c02d3bb0 con 0x5560c02bbb40 2024-09-12T01:34:25.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.140+0000 7fc2367fc640 1 -- 172.21.15.81:0/3212008024 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc248024070 con 0x5560c02bbb40 2024-09-12T01:34:25.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.140+0000 7fc2367fc640 1 -- 172.21.15.81:0/3212008024 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc238018070 con 0x5560c02bbb40 2024-09-12T01:34:25.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.140+0000 7fc25787f740 10 client.16905 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:25.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.140+0000 7fc25787f740 10 client.16905 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:34:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.140+0000 7fc25787f740 20 client.16905 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.140+0000 7fc25787f740 1 --2- 172.21.15.81:0/3212008024 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5560c02d5110 0x5560c02d7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.140+0000 7fc25787f740 4 client.16905 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:34:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.140+0000 7fc25787f740 1 -- 172.21.15.81:0/3212008024 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560c022d860 con 0x5560c02d5110 2024-09-12T01:34:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.140+0000 7fc24effd640 1 --2- 172.21.15.81:0/3212008024 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5560c02d5110 0x5560c02d7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.141+0000 7fc24effd640 1 --2- 172.21.15.81:0/3212008024 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5560c02d5110 0x5560c02d7530 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=977653d4551c5fd5 server_cookie=2c3c86a14263fe36 in_seq=0 out_seq=0 2024-09-12T01:34:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.141+0000 7fc2367fc640 10 client.16905 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:34:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.141+0000 7fc2367fc640 1 -- 172.21.15.81:0/3212008024 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560c022d860 con 0x5560c02d5110 2024-09-12T01:34:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.141+0000 7fc2367fc640 10 client.16905 handle_command_reply: tid=0 2024-09-12T01:34:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.141+0000 7fc25787f740 1 client.16905 shutdown 2024-09-12T01:34:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.142+0000 7fc25787f740 1 -- 172.21.15.81:0/3212008024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 msgr2=0x5560c02c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.142+0000 7fc25787f740 1 --2- 172.21.15.81:0/3212008024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 0x5560c02c2010 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc238004650 tx=0x7fc2380039c0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.142+0000 7fc25787f740 1 -- 172.21.15.81:0/3212008024 shutdown_connections 2024-09-12T01:34:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.142+0000 7fc25787f740 1 --2- 172.21.15.81:0/3212008024 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5560c02d5110 0x5560c02d7530 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.142+0000 7fc25787f740 1 --2- 172.21.15.81:0/3212008024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02c5370 0x5560c02c2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.142+0000 7fc25787f740 1 --2- 172.21.15.81:0/3212008024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 0x5560c02c2010 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.142+0000 7fc25787f740 1 --2- 172.21.15.81:0/3212008024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02ba5d0 0x5560c02c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.142+0000 7fc2367fc640 0 client.16905 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:34:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.142+0000 7fc25787f740 1 -- 172.21.15.81:0/3212008024 >> 172.21.15.81:0/3212008024 conn(0x5560c0283310 msgr2=0x5560c02bc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.142+0000 7fc25787f740 1 -- 172.21.15.81:0/3212008024 shutdown_connections 2024-09-12T01:34:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.142+0000 7fc25787f740 1 -- 172.21.15.81:0/3212008024 wait complete. 2024-09-12T01:34:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.142+0000 7fc25787f740 20 client.16905 trim_cache size 0 max 16384 2024-09-12T01:34:25.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.154+0000 7fc25787f740 1 Processor -- start 2024-09-12T01:34:25.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.154+0000 7fc25787f740 1 -- start start 2024-09-12T01:34:25.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc25787f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02ba5d0 0x5560c02d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc25787f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02bbb40 0x5560c02c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc25787f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02c5370 0x5560c02cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc25787f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2501ab530 con 0x5560c02c5370 2024-09-12T01:34:25.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc25787f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2501ad070 con 0x5560c02ba5d0 2024-09-12T01:34:25.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc25787f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc2501abc00 con 0x5560c02bbb40 2024-09-12T01:34:25.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc24f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02c5370 0x5560c02cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc24f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02c5370 0x5560c02cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36946/0 (socket says 172.21.15.81:36946) 2024-09-12T01:34:25.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc24f7fe640 1 -- 172.21.15.81:0/838749166 learned_addr learned my addr 172.21.15.81:0/838749166 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:25.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc24effd640 1 --2- 172.21.15.81:0/838749166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02ba5d0 0x5560c02d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc24f7fe640 1 -- 172.21.15.81:0/838749166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02bbb40 msgr2=0x5560c02c0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:25.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc2467fc640 1 --2- 172.21.15.81:0/838749166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02bbb40 0x5560c02c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc24f7fe640 1 --2- 172.21.15.81:0/838749166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02bbb40 0x5560c02c0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc24f7fe640 1 -- 172.21.15.81:0/838749166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02ba5d0 msgr2=0x5560c02d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:25.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc24f7fe640 1 --2- 172.21.15.81:0/838749166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02ba5d0 0x5560c02d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.155+0000 7fc24f7fe640 1 -- 172.21.15.81:0/838749166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c02b6ed0 con 0x5560c02c5370 2024-09-12T01:34:25.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.156+0000 7fc24f7fe640 1 --2- 172.21.15.81:0/838749166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02c5370 0x5560c02cd850 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc24801f4b0 tx=0x7fc24800e3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffb64ccc341e64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:25.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.156+0000 7fc244ff9640 1 -- 172.21.15.81:0/838749166 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248005240 con 0x5560c02c5370 2024-09-12T01:34:25.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.156+0000 7fc244ff9640 1 -- 172.21.15.81:0/838749166 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc248024040 con 0x5560c02c5370 2024-09-12T01:34:25.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.156+0000 7fc244ff9640 1 -- 172.21.15.81:0/838749166 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24800b6b0 con 0x5560c02c5370 2024-09-12T01:34:25.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.156+0000 7fc25787f740 1 -- 172.21.15.81:0/838749166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02c5370 msgr2=0x5560c02cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:25.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.156+0000 7fc25787f740 1 --2- 172.21.15.81:0/838749166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02c5370 0x5560c02cd850 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc24801f4b0 tx=0x7fc24800e3a0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 -- 172.21.15.81:0/838749166 shutdown_connections 2024-09-12T01:34:25.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 --2- 172.21.15.81:0/838749166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02c5370 0x5560c02cd850 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 --2- 172.21.15.81:0/838749166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02bbb40 0x5560c02c0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 --2- 172.21.15.81:0/838749166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02ba5d0 0x5560c02d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 -- 172.21.15.81:0/838749166 >> 172.21.15.81:0/838749166 conn(0x5560c0283310 msgr2=0x5560c02c08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:25.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 -- 172.21.15.81:0/838749166 shutdown_connections 2024-09-12T01:34:25.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 -- 172.21.15.81:0/838749166 wait complete. 2024-09-12T01:34:25.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 -- start start 2024-09-12T01:34:25.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 Processor -- start 2024-09-12T01:34:25.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02ba5d0 0x5560c02dca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 0x5560c02dcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02c5370 0x5560c033b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2501ac9a0 con 0x5560c02bbb40 2024-09-12T01:34:25.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2501ac2d0 con 0x5560c02c5370 2024-09-12T01:34:25.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc2501a9510 con 0x5560c02ba5d0 2024-09-12T01:34:25.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc25787f740 10 client.0 _ll_register_callbacks cb 0x7fc238004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:25.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc2467fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 0x5560c02dcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc2467fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 0x5560c02dcfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36956/0 (socket says 172.21.15.81:36956) 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc2467fc640 1 -- 172.21.15.81:0/2706242120 learned_addr learned my addr 172.21.15.81:0/2706242120 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.157+0000 7fc24f7fe640 1 --2- 172.21.15.81:0/2706242120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02c5370 0x5560c033b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc24effd640 1 --2- 172.21.15.81:0/2706242120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02ba5d0 0x5560c02dca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc2467fc640 1 -- 172.21.15.81:0/2706242120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02ba5d0 msgr2=0x5560c02dca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc2467fc640 1 --2- 172.21.15.81:0/2706242120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02ba5d0 0x5560c02dca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc2467fc640 1 -- 172.21.15.81:0/2706242120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02c5370 msgr2=0x5560c033b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc2467fc640 1 --2- 172.21.15.81:0/2706242120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02c5370 0x5560c033b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc2467fc640 1 -- 172.21.15.81:0/2706242120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c033b850 con 0x5560c02bbb40 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc2467fc640 1 --2- 172.21.15.81:0/2706242120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 0x5560c02dcfa0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc238019830 tx=0x7fc238005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c27552243f0a899 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc2367fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc2367fc640 1 -- 172.21.15.81:0/2706242120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238027070 con 0x5560c02bbb40 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc2367fc640 1 -- 172.21.15.81:0/2706242120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fc238019cc0 con 0x5560c02bbb40 2024-09-12T01:34:25.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc25787f740 1 -- 172.21.15.81:0/2706242120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc248024040 con 0x5560c02bbb40 2024-09-12T01:34:25.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc2367fc640 1 -- 172.21.15.81:0/2706242120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc238011710 con 0x5560c02bbb40 2024-09-12T01:34:25.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc25787f740 10 client.16911 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:25.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc25787f740 1 -- 172.21.15.81:0/2706242120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5560c0343de0 con 0x5560c02bbb40 2024-09-12T01:34:25.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.158+0000 7fc2367fc640 1 -- 172.21.15.81:0/2706242120 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc248024040 con 0x5560c02bbb40 2024-09-12T01:34:25.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc2367fc640 1 -- 172.21.15.81:0/2706242120 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc238018070 con 0x5560c02bbb40 2024-09-12T01:34:25.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc25787f740 10 client.16911 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:25.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc25787f740 10 client.16911 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:34:25.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc25787f740 20 client.16911 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:25.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc25787f740 1 --2- 172.21.15.81:0/2706242120 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5560c0344560 0x5560c0346980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc25787f740 4 client.16911 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:34:25.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc25787f740 1 -- 172.21.15.81:0/2706242120 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5560c0227d70 con 0x5560c0344560 2024-09-12T01:34:25.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc24effd640 1 --2- 172.21.15.81:0/2706242120 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5560c0344560 0x5560c0346980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc2367fc640 10 client.16911 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:34:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc24effd640 1 --2- 172.21.15.81:0/2706242120 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5560c0344560 0x5560c0346980 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e7644e23b6fe803f server_cookie=8fdd68ffe2c0080 in_seq=0 out_seq=0 2024-09-12T01:34:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc2367fc640 1 -- 172.21.15.81:0/2706242120 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5560c0227d70 con 0x5560c0344560 2024-09-12T01:34:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc2367fc640 10 client.16911 handle_command_reply: tid=0 2024-09-12T01:34:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc25787f740 1 client.16911 shutdown 2024-09-12T01:34:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc25787f740 1 -- 172.21.15.81:0/2706242120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 msgr2=0x5560c02dcfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.159+0000 7fc25787f740 1 --2- 172.21.15.81:0/2706242120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 0x5560c02dcfa0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc238019830 tx=0x7fc238005d60 comp rx=0 tx=0).stop 2024-09-12T01:34:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc25787f740 1 -- 172.21.15.81:0/2706242120 shutdown_connections 2024-09-12T01:34:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc25787f740 1 --2- 172.21.15.81:0/2706242120 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x5560c0344560 0x5560c0346980 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc25787f740 1 --2- 172.21.15.81:0/2706242120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560c02c5370 0x5560c033b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc25787f740 1 --2- 172.21.15.81:0/2706242120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560c02bbb40 0x5560c02dcfa0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc2367fc640 0 client.16911 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:34:25.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc25787f740 1 --2- 172.21.15.81:0/2706242120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5560c02ba5d0 0x5560c02dca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc25787f740 1 -- 172.21.15.81:0/2706242120 >> 172.21.15.81:0/2706242120 conn(0x5560c0283310 msgr2=0x5560c02c1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:25.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc25787f740 1 -- 172.21.15.81:0/2706242120 shutdown_connections 2024-09-12T01:34:25.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc25787f740 1 -- 172.21.15.81:0/2706242120 wait complete. 2024-09-12T01:34:25.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc25787f740 20 client.16911 trim_cache size 0 max 16384 2024-09-12T01:34:25.166 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:34:25.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc2554a6640 1 -- 172.21.15.81:0/337136975 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc23c0a2cf0 msgr2=0x7fc23c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:25.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc2554a6640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc23c0a2cf0 0x7fc23c0a51b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc248005d50 tx=0x7fc24800e9b0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc2554a6640 1 -- 172.21.15.81:0/337136975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250100a80 msgr2=0x7fc250197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:25.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc2554a6640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250100a80 0x7fc250197320 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fc24002ae00 tx=0x7fc240003ba0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc2554a6640 1 -- 172.21.15.81:0/337136975 shutdown_connections 2024-09-12T01:34:25.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc2554a6640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc23c0a2cf0 0x7fc23c0a51b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc2554a6640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc250106a80 0x7fc25019bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc2554a6640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc250101420 0x7fc250197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc2554a6640 1 --2- 172.21.15.81:0/337136975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250100a80 0x7fc250197320 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc2554a6640 1 -- 172.21.15.81:0/337136975 >> 172.21.15.81:0/337136975 conn(0x7fc2500fc7a0 msgr2=0x7fc2500fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc2554a6640 1 -- 172.21.15.81:0/337136975 shutdown_connections 2024-09-12T01:34:25.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:25.160+0000 7fc2554a6640 1 -- 172.21.15.81:0/337136975 wait complete. 2024-09-12T01:34:25.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:25 smithi081 ceph-mon[30920]: pgmap v193: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:25.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:25 smithi100 ceph-mon[35275]: pgmap v193: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:25 smithi189 ceph-mon[35357]: pgmap v193: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:25.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:34:26.139 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:34:26.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.608+0000 7fd4f7f1d640 1 -- 172.21.15.81:0/3864278196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f0106b70 msgr2=0x7fd4f0106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:26.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.608+0000 7fd4f7f1d640 1 --2- 172.21.15.81:0/3864278196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f0106b70 0x7fd4f0106f50 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009900 tx=0x7fd4ec02a410 comp rx=0 tx=0).stop 2024-09-12T01:34:26.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.608+0000 7fd4f7f1d640 1 -- 172.21.15.81:0/3864278196 shutdown_connections 2024-09-12T01:34:26.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.608+0000 7fd4f7f1d640 1 --2- 172.21.15.81:0/3864278196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4f0100a50 0x7fd4f01057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.608+0000 7fd4f7f1d640 1 --2- 172.21.15.81:0/3864278196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4f0100090 0x7fd4f0100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.608+0000 7fd4f7f1d640 1 --2- 172.21.15.81:0/3864278196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f0106b70 0x7fd4f0106f50 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.608+0000 7fd4f7f1d640 1 -- 172.21.15.81:0/3864278196 >> 172.21.15.81:0/3864278196 conn(0x7fd4f0077210 msgr2=0x7fd4f00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.608+0000 7fd4f7f1d640 1 -- 172.21.15.81:0/3864278196 shutdown_connections 2024-09-12T01:34:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.608+0000 7fd4f7f1d640 1 -- 172.21.15.81:0/3864278196 wait complete. 2024-09-12T01:34:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.609+0000 7fd4f7f1d640 1 Processor -- start 2024-09-12T01:34:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.609+0000 7fd4f7f1d640 1 -- start start 2024-09-12T01:34:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.609+0000 7fd4f7f1d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f0100090 0x7fd4f01a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.609+0000 7fd4f7f1d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4f0100a50 0x7fd4f01a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.609+0000 7fd4f7f1d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4f0106b70 0x7fd4f019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.609+0000 7fd4f7f1d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01185c0 con 0x7fd4f0100090 2024-09-12T01:34:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.609+0000 7fd4f7f1d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0118440 con 0x7fd4f0100a50 2024-09-12T01:34:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.609+0000 7fd4f7f1d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0118740 con 0x7fd4f0106b70 2024-09-12T01:34:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.609+0000 7fd4f5cb9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f0100090 0x7fd4f01a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.609+0000 7fd4f5cb9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f0100090 0x7fd4f01a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36960/0 (socket says 172.21.15.81:36960) 2024-09-12T01:34:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.609+0000 7fd4f5cb9640 1 -- 172.21.15.81:0/2732797272 learned_addr learned my addr 172.21.15.81:0/2732797272 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.609+0000 7fd4f64ba640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4f0106b70 0x7fd4f019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.610+0000 7fd4f54b8640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4f0100a50 0x7fd4f01a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.610+0000 7fd4f5cb9640 1 -- 172.21.15.81:0/2732797272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4f0106b70 msgr2=0x7fd4f019e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.610+0000 7fd4f5cb9640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4f0106b70 0x7fd4f019e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.610+0000 7fd4f5cb9640 1 -- 172.21.15.81:0/2732797272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4f0100a50 msgr2=0x7fd4f01a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.610+0000 7fd4f5cb9640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4f0100a50 0x7fd4f01a4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.610+0000 7fd4f5cb9640 1 -- 172.21.15.81:0/2732797272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f019efd0 con 0x7fd4f0100090 2024-09-12T01:34:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.610+0000 7fd4f5cb9640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f0100090 0x7fd4f01a46e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec006010 tx=0x7fd4ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.610+0000 7fd4e6ffd640 1 -- 172.21.15.81:0/2732797272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec03f030 con 0x7fd4f0100090 2024-09-12T01:34:26.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.610+0000 7fd4f7f1d640 1 -- 172.21.15.81:0/2732797272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f019f260 con 0x7fd4f0100090 2024-09-12T01:34:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.610+0000 7fd4e6ffd640 1 -- 172.21.15.81:0/2732797272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4ec003ce0 con 0x7fd4f0100090 2024-09-12T01:34:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.610+0000 7fd4e6ffd640 1 -- 172.21.15.81:0/2732797272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec035070 con 0x7fd4f0100090 2024-09-12T01:34:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.610+0000 7fd4f7f1d640 1 -- 172.21.15.81:0/2732797272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f01ab5b0 con 0x7fd4f0100090 2024-09-12T01:34:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.612+0000 7fd4e6ffd640 1 -- 172.21.15.81:0/2732797272 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fd4ec042030 con 0x7fd4f0100090 2024-09-12T01:34:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.612+0000 7fd4fa2f6740 1 Processor -- start 2024-09-12T01:34:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4fa2f6740 1 -- start start 2024-09-12T01:34:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4fa2f6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 0x55a61af7b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4fa2f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af7b5d0 0x55a61af7ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4fa2f6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af86370 0x55a61af88760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4fa2f6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a61aee12f0 con 0x55a61af7cb40 2024-09-12T01:34:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4fa2f6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a61ae88cf0 con 0x55a61af86370 2024-09-12T01:34:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4fa2f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a61aedd2b0 con 0x55a61af7b5d0 2024-09-12T01:34:26.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4f64ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 0x55a61af7b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4f64ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 0x55a61af7b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36970/0 (socket says 172.21.15.81:36970) 2024-09-12T01:34:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4f64ba640 1 -- 172.21.15.81:0/4136072133 learned_addr learned my addr 172.21.15.81:0/4136072133 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4f5cb9640 1 --2- 172.21.15.81:0/4136072133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af7b5d0 0x55a61af7ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4e6ffd640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd4dc0a2cf0 0x7fd4dc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4f54b8640 1 --2- 172.21.15.81:0/4136072133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af86370 0x55a61af88760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4f64ba640 1 -- 172.21.15.81:0/4136072133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af7b5d0 msgr2=0x55a61af7ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4f64ba640 1 --2- 172.21.15.81:0/4136072133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af7b5d0 0x55a61af7ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4f64ba640 1 -- 172.21.15.81:0/4136072133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af86370 msgr2=0x55a61af88760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4f64ba640 1 --2- 172.21.15.81:0/4136072133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af86370 0x55a61af88760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.613+0000 7fd4f64ba640 1 -- 172.21.15.81:0/4136072133 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a61ae6d3a0 con 0x55a61af7cb40 2024-09-12T01:34:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.614+0000 7fd4f5cb9640 1 --2- 172.21.15.81:0/4136072133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af7b5d0 0x55a61af7ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:34:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.614+0000 7fd4f54b8640 1 --2- 172.21.15.81:0/4136072133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af86370 0x55a61af88760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:34:26.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.614+0000 7fd4f64ba640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd4dc0a2cf0 0x7fd4dc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.614+0000 7fd4e6ffd640 1 -- 172.21.15.81:0/2732797272 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fd4ec0efb60 con 0x7fd4f0100090 2024-09-12T01:34:26.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.614+0000 7fd4f64ba640 1 --2- 172.21.15.81:0/4136072133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 0x55a61af7b090 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009fd0 tx=0x7fd4e8010880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3979e44600ae66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:26.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.614+0000 7fd4dbfff640 1 -- 172.21.15.81:0/4136072133 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e801c900 con 0x55a61af7cb40 2024-09-12T01:34:26.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.614+0000 7fd4dbfff640 1 -- 172.21.15.81:0/4136072133 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4e80113e0 con 0x55a61af7cb40 2024-09-12T01:34:26.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.614+0000 7fd4dbfff640 1 -- 172.21.15.81:0/4136072133 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e801b630 con 0x55a61af7cb40 2024-09-12T01:34:26.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.615+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/4136072133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 msgr2=0x55a61af7b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:26.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.615+0000 7fd4f64ba640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd4dc0a2cf0 0x7fd4dc0a51b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8020000 tx=0x7fd4e801d000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:26.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.615+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/4136072133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 0x55a61af7b090 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009fd0 tx=0x7fd4e8010880 comp rx=0 tx=0).stop 2024-09-12T01:34:26.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.615+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/4136072133 shutdown_connections 2024-09-12T01:34:26.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.615+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/4136072133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af86370 0x55a61af88760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.615+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/4136072133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af7b5d0 0x55a61af7ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.615+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/4136072133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 0x55a61af7b090 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.615+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/4136072133 >> 172.21.15.81:0/4136072133 conn(0x55a61af44310 msgr2=0x55a61af77c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.615+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/4136072133 shutdown_connections 2024-09-12T01:34:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.615+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/4136072133 wait complete. 2024-09-12T01:34:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.615+0000 7fd4fa2f6740 1 -- start start 2024-09-12T01:34:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.615+0000 7fd4fa2f6740 1 Processor -- start 2024-09-12T01:34:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4fa2f6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7b5d0 0x55a61af85d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4fa2f6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7cb40 0x55a61af82fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4fa2f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af86370 0x55a61af83560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4fa2f6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a61af89070 con 0x55a61af7b5d0 2024-09-12T01:34:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4fa2f6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a61ae9c060 con 0x55a61af7cb40 2024-09-12T01:34:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4fa2f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a61af891f0 con 0x55a61af86370 2024-09-12T01:34:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4fa2f6740 10 client.0 _ll_register_callbacks cb 0x55a61abef8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:26.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4f5cb9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7b5d0 0x55a61af85d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4f5cb9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7b5d0 0x55a61af85d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36982/0 (socket says 172.21.15.81:36982) 2024-09-12T01:34:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4f5cb9640 1 -- 172.21.15.81:0/658198346 learned_addr learned my addr 172.21.15.81:0/658198346 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4f54b8640 1 --2- 172.21.15.81:0/658198346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7cb40 0x55a61af82fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4f5cb9640 1 -- 172.21.15.81:0/658198346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af86370 msgr2=0x55a61af83560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4f5cb9640 1 --2- 172.21.15.81:0/658198346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af86370 0x55a61af83560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4f5cb9640 1 -- 172.21.15.81:0/658198346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7cb40 msgr2=0x55a61af82fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4f5cb9640 1 --2- 172.21.15.81:0/658198346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7cb40 0x55a61af82fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4f5cb9640 1 -- 172.21.15.81:0/658198346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a61ac523c0 con 0x55a61af7b5d0 2024-09-12T01:34:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4f5cb9640 1 --2- 172.21.15.81:0/658198346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7b5d0 0x55a61af85d10 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0c4850 tx=0x7fd4ec009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ae161485a1a4ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4d97fa640 1 -- 172.21.15.81:0/658198346 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec049050 con 0x55a61af7b5d0 2024-09-12T01:34:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4d97fa640 1 -- 172.21.15.81:0/658198346 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fd4ec0ed500 con 0x55a61af7b5d0 2024-09-12T01:34:26.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/658198346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4e80113e0 con 0x55a61af7b5d0 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4d97fa640 1 -- 172.21.15.81:0/658198346 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd4ec0bbc50 con 0x55a61af7b5d0 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4fa2f6740 10 client.16923 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.616+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/658198346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a61af94a30 con 0x55a61af7b5d0 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.617+0000 7fd4d97fa640 1 -- 172.21.15.81:0/658198346 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4e80113e0 con 0x55a61af7b5d0 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.617+0000 7fd4d97fa640 1 -- 172.21.15.81:0/658198346 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd4ec0d7050 con 0x55a61af7b5d0 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.617+0000 7fd4fa2f6740 10 client.16923 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.617+0000 7fd4fa2f6740 10 client.16923 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.617+0000 7fd4fa2f6740 20 client.16923 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.617+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/658198346 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a61af95e20 0x55a61af98270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.617+0000 7fd4fa2f6740 4 client.16923 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.617+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/658198346 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a61aeee860 con 0x55a61af95e20 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.617+0000 7fd4f54b8640 1 --2- 172.21.15.81:0/658198346 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a61af95e20 0x55a61af98270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4f54b8640 1 --2- 172.21.15.81:0/658198346 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a61af95e20 0x55a61af98270 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c8defcb82bd2453 server_cookie=57847bd097a8dc23 in_seq=0 out_seq=0 2024-09-12T01:34:26.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4d97fa640 10 client.16923 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:34:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4d97fa640 1 -- 172.21.15.81:0/658198346 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a61aeee860 con 0x55a61af95e20 2024-09-12T01:34:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4d97fa640 10 client.16923 handle_command_reply: tid=0 2024-09-12T01:34:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4fa2f6740 1 client.16923 shutdown 2024-09-12T01:34:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/658198346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7b5d0 msgr2=0x55a61af85d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/658198346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7b5d0 0x55a61af85d10 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0c4850 tx=0x7fd4ec009650 comp rx=0 tx=0).stop 2024-09-12T01:34:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/658198346 shutdown_connections 2024-09-12T01:34:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/658198346 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a61af95e20 0x55a61af98270 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/658198346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af86370 0x55a61af83560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4d97fa640 0 client.16923 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:34:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/658198346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7cb40 0x55a61af82fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/658198346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7b5d0 0x55a61af85d10 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.618+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/658198346 >> 172.21.15.81:0/658198346 conn(0x55a61af44310 msgr2=0x55a61af7d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:26.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.619+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/658198346 shutdown_connections 2024-09-12T01:34:26.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.619+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/658198346 wait complete. 2024-09-12T01:34:26.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.619+0000 7fd4fa2f6740 20 client.16923 trim_cache size 0 max 16384 2024-09-12T01:34:26.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.631+0000 7fd4fa2f6740 1 Processor -- start 2024-09-12T01:34:26.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.631+0000 7fd4fa2f6740 1 -- start start 2024-09-12T01:34:26.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.631+0000 7fd4fa2f6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7b5d0 0x55a61af92310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.631+0000 7fd4fa2f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af7cb40 0x55a61af9db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.631+0000 7fd4fa2f6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af86370 0x55a61af9e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4fa2f6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01b3f20 con 0x55a61af86370 2024-09-12T01:34:26.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4fa2f6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01b5a60 con 0x55a61af7b5d0 2024-09-12T01:34:26.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4fa2f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01b45f0 con 0x55a61af7cb40 2024-09-12T01:34:26.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4f64ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af86370 0x55a61af9e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4f64ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af86370 0x55a61af9e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36990/0 (socket says 172.21.15.81:36990) 2024-09-12T01:34:26.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4f64ba640 1 -- 172.21.15.81:0/1640540126 learned_addr learned my addr 172.21.15.81:0/1640540126 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:26.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4f5cb9640 1 --2- 172.21.15.81:0/1640540126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7b5d0 0x55a61af92310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4f64ba640 1 -- 172.21.15.81:0/1640540126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af7cb40 msgr2=0x55a61af9db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:26.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4f54b8640 1 --2- 172.21.15.81:0/1640540126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af7cb40 0x55a61af9db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4f64ba640 1 --2- 172.21.15.81:0/1640540126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af7cb40 0x55a61af9db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4f64ba640 1 -- 172.21.15.81:0/1640540126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7b5d0 msgr2=0x55a61af92310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:26.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4f64ba640 1 --2- 172.21.15.81:0/1640540126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7b5d0 0x55a61af92310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4f64ba640 1 -- 172.21.15.81:0/1640540126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a61af7b400 con 0x55a61af86370 2024-09-12T01:34:26.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4f5cb9640 1 --2- 172.21.15.81:0/1640540126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7b5d0 0x55a61af92310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:34:26.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4f64ba640 1 --2- 172.21.15.81:0/1640540126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af86370 0x55a61af9e0c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009fa0 tx=0x7fd4e8015f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85a69efee5c2fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4db7fe640 1 -- 172.21.15.81:0/1640540126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8013680 con 0x55a61af86370 2024-09-12T01:34:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4db7fe640 1 -- 172.21.15.81:0/1640540126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4e801bdb0 con 0x55a61af86370 2024-09-12T01:34:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.632+0000 7fd4db7fe640 1 -- 172.21.15.81:0/1640540126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e801caf0 con 0x55a61af86370 2024-09-12T01:34:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.633+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/1640540126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af86370 msgr2=0x55a61af9e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.633+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/1640540126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af86370 0x55a61af9e0c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009fa0 tx=0x7fd4e8015f70 comp rx=0 tx=0).stop 2024-09-12T01:34:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.633+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/1640540126 shutdown_connections 2024-09-12T01:34:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.633+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/1640540126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af86370 0x55a61af9e0c0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.633+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/1640540126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af7cb40 0x55a61af9db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.633+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/1640540126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7b5d0 0x55a61af92310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.633+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/1640540126 >> 172.21.15.81:0/1640540126 conn(0x55a61af44310 msgr2=0x55a61af7e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.633+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/1640540126 shutdown_connections 2024-09-12T01:34:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.633+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/1640540126 wait complete. 2024-09-12T01:34:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.633+0000 7fd4fa2f6740 1 -- start start 2024-09-12T01:34:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.633+0000 7fd4fa2f6740 1 Processor -- start 2024-09-12T01:34:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4fa2f6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7b5d0 0x55a61af8e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4fa2f6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 0x55a61af8e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4fa2f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af86370 0x55a61af8b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4fa2f6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01b5390 con 0x55a61af7cb40 2024-09-12T01:34:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4fa2f6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01b4cc0 con 0x55a61af7b5d0 2024-09-12T01:34:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4fa2f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01b1f00 con 0x55a61af86370 2024-09-12T01:34:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4fa2f6740 10 client.0 _ll_register_callbacks cb 0x7fd4ec0b8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4f54b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 0x55a61af8e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4f54b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 0x55a61af8e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37002/0 (socket says 172.21.15.81:37002) 2024-09-12T01:34:26.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4f54b8640 1 -- 172.21.15.81:0/4228180059 learned_addr learned my addr 172.21.15.81:0/4228180059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4f5cb9640 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7b5d0 0x55a61af8e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4f64ba640 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af86370 0x55a61af8b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4f54b8640 1 -- 172.21.15.81:0/4228180059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af86370 msgr2=0x55a61af8b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4f54b8640 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af86370 0x55a61af8b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4f54b8640 1 -- 172.21.15.81:0/4228180059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7b5d0 msgr2=0x55a61af8e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4f54b8640 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7b5d0 0x55a61af8e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4f54b8640 1 -- 172.21.15.81:0/4228180059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a61af8f030 con 0x55a61af7cb40 2024-09-12T01:34:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4f64ba640 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af86370 0x55a61af8b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:34:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4f54b8640 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 0x55a61af8e9c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x55a61af7c070 tx=0x7fd4e000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a3ec01cf2a0409 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4d97fa640 1 -- 172.21.15.81:0/4228180059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0015bf0 con 0x55a61af7cb40 2024-09-12T01:34:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4d97fa640 1 -- 172.21.15.81:0/4228180059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fd4e0015d90 con 0x55a61af7cb40 2024-09-12T01:34:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.634+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/4228180059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4e801bdb0 con 0x55a61af7cb40 2024-09-12T01:34:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.635+0000 7fd4d97fa640 1 -- 172.21.15.81:0/4228180059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd4e002b050 con 0x55a61af7cb40 2024-09-12T01:34:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.635+0000 7fd4fa2f6740 10 client.16929 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.635+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/4228180059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a61b001160 con 0x55a61af7cb40 2024-09-12T01:34:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.635+0000 7fd4d97fa640 1 -- 172.21.15.81:0/4228180059 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4e801bdb0 con 0x55a61af7cb40 2024-09-12T01:34:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.635+0000 7fd4d97fa640 1 -- 172.21.15.81:0/4228180059 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd4e001b4f0 con 0x55a61af7cb40 2024-09-12T01:34:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.635+0000 7fd4fa2f6740 10 client.16929 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.635+0000 7fd4fa2f6740 10 client.16929 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:34:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.635+0000 7fd4fa2f6740 20 client.16929 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.635+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a61b0018c0 0x55a61b003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.635+0000 7fd4fa2f6740 4 client.16929 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:34:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.635+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/4228180059 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a61aee8d70 con 0x55a61b0018c0 2024-09-12T01:34:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.635+0000 7fd4f5cb9640 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a61b0018c0 0x55a61b003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4d97fa640 10 client.16929 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:34:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4f5cb9640 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a61b0018c0 0x55a61b003ce0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=38bcd43e87321310 server_cookie=a818d5df4ca1a913 in_seq=0 out_seq=0 2024-09-12T01:34:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4d97fa640 1 -- 172.21.15.81:0/4228180059 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a61aee8d70 con 0x55a61b0018c0 2024-09-12T01:34:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4d97fa640 10 client.16929 handle_command_reply: tid=0 2024-09-12T01:34:26.660 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:34:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4fa2f6740 1 client.16929 shutdown 2024-09-12T01:34:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/4228180059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 msgr2=0x55a61af8e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 0x55a61af8e9c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x55a61af7c070 tx=0x7fd4e000be70 comp rx=0 tx=0).stop 2024-09-12T01:34:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/4228180059 shutdown_connections 2024-09-12T01:34:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55a61b0018c0 0x55a61b003ce0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a61af86370 0x55a61af8b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61af7cb40 0x55a61af8e9c0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4fa2f6740 1 --2- 172.21.15.81:0/4228180059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a61af7b5d0 0x55a61af8e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4d97fa640 0 client.16929 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:34:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/4228180059 >> 172.21.15.81:0/4228180059 conn(0x55a61af44310 msgr2=0x55a61af76d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/4228180059 shutdown_connections 2024-09-12T01:34:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4fa2f6740 1 -- 172.21.15.81:0/4228180059 wait complete. 2024-09-12T01:34:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.636+0000 7fd4fa2f6740 20 client.16929 trim_cache size 0 max 16384 2024-09-12T01:34:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.637+0000 7fd4f7f1d640 1 -- 172.21.15.81:0/2732797272 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd4dc0a2cf0 msgr2=0x7fd4dc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.637+0000 7fd4f7f1d640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd4dc0a2cf0 0x7fd4dc0a51b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8020000 tx=0x7fd4e801d000 comp rx=0 tx=0).stop 2024-09-12T01:34:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.637+0000 7fd4f7f1d640 1 -- 172.21.15.81:0/2732797272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f0100090 msgr2=0x7fd4f01a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.637+0000 7fd4f7f1d640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f0100090 0x7fd4f01a46e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec006010 tx=0x7fd4ec0042f0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.637+0000 7fd4f7f1d640 1 -- 172.21.15.81:0/2732797272 shutdown_connections 2024-09-12T01:34:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.637+0000 7fd4f7f1d640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd4dc0a2cf0 0x7fd4dc0a51b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.637+0000 7fd4f7f1d640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4f0106b70 0x7fd4f019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.637+0000 7fd4f7f1d640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4f0100a50 0x7fd4f01a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.637+0000 7fd4f7f1d640 1 --2- 172.21.15.81:0/2732797272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f0100090 0x7fd4f01a46e0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.637+0000 7fd4f7f1d640 1 -- 172.21.15.81:0/2732797272 >> 172.21.15.81:0/2732797272 conn(0x7fd4f0077210 msgr2=0x7fd4f01037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.637+0000 7fd4f7f1d640 1 -- 172.21.15.81:0/2732797272 shutdown_connections 2024-09-12T01:34:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:26.637+0000 7fd4f7f1d640 1 -- 172.21.15.81:0/2732797272 wait complete. 2024-09-12T01:34:27.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:34:27.689 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:34:27.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:27 smithi081 ceph-mon[30920]: pgmap v194: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:34:27.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:27 smithi100 ceph-mon[35275]: pgmap v194: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:34:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:27 smithi189 ceph-mon[35357]: pgmap v194: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:34:28.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.133+0000 7fd58b3dc640 1 -- 172.21.15.81:0/1210252754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd584106a90 msgr2=0x7fd584106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:28.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.133+0000 7fd58b3dc640 1 --2- 172.21.15.81:0/1210252754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd584106a90 0x7fd584106e70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd578009930 tx=0x7fd57802a420 comp rx=0 tx=0).stop 2024-09-12T01:34:28.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.133+0000 7fd58b3dc640 1 -- 172.21.15.81:0/1210252754 shutdown_connections 2024-09-12T01:34:28.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.133+0000 7fd58b3dc640 1 --2- 172.21.15.81:0/1210252754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd584101430 0x7fd58410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.133+0000 7fd58b3dc640 1 --2- 172.21.15.81:0/1210252754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd584100a90 0x7fd584100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.133+0000 7fd58b3dc640 1 --2- 172.21.15.81:0/1210252754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd584106a90 0x7fd584106e70 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.133+0000 7fd58b3dc640 1 -- 172.21.15.81:0/1210252754 >> 172.21.15.81:0/1210252754 conn(0x7fd5840fc7d0 msgr2=0x7fd5840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:28.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.133+0000 7fd58b3dc640 1 -- 172.21.15.81:0/1210252754 shutdown_connections 2024-09-12T01:34:28.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.133+0000 7fd58b3dc640 1 -- 172.21.15.81:0/1210252754 wait complete. 2024-09-12T01:34:28.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd58b3dc640 1 Processor -- start 2024-09-12T01:34:28.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd58b3dc640 1 -- start start 2024-09-12T01:34:28.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd58b3dc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd584100a90 0x7fd584198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd58b3dc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd584101430 0x7fd584198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd58b3dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd584106a90 0x7fd58419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd58b3dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd584110eb0 con 0x7fd584106a90 2024-09-12T01:34:28.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd58b3dc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd584110d30 con 0x7fd584101430 2024-09-12T01:34:28.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd58b3dc640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd584111030 con 0x7fd584100a90 2024-09-12T01:34:28.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd589979640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd584106a90 0x7fd58419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd589979640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd584106a90 0x7fd58419ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37014/0 (socket says 172.21.15.81:37014) 2024-09-12T01:34:28.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd589979640 1 -- 172.21.15.81:0/2793290192 learned_addr learned my addr 172.21.15.81:0/2793290192 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:28.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd589178640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd584100a90 0x7fd584198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd588977640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd584101430 0x7fd584198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd589979640 1 -- 172.21.15.81:0/2793290192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd584100a90 msgr2=0x7fd584198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:28.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd589979640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd584100a90 0x7fd584198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd589979640 1 -- 172.21.15.81:0/2793290192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd584101430 msgr2=0x7fd584198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:28.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd589979640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd584101430 0x7fd584198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.134+0000 7fd589979640 1 -- 172.21.15.81:0/2793290192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58419d4e0 con 0x7fd584106a90 2024-09-12T01:34:28.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.135+0000 7fd589979640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd584106a90 0x7fd58419ce00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00cad0 tx=0x7fd57c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:28.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.135+0000 7fd5767fc640 1 -- 172.21.15.81:0/2793290192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c00ae20 con 0x7fd584106a90 2024-09-12T01:34:28.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.135+0000 7fd5767fc640 1 -- 172.21.15.81:0/2793290192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57c005020 con 0x7fd584106a90 2024-09-12T01:34:28.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.135+0000 7fd5767fc640 1 -- 172.21.15.81:0/2793290192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c00f6f0 con 0x7fd584106a90 2024-09-12T01:34:28.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.135+0000 7fd58b3dc640 1 -- 172.21.15.81:0/2793290192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58419d7d0 con 0x7fd584106a90 2024-09-12T01:34:28.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.135+0000 7fd58b3dc640 1 -- 172.21.15.81:0/2793290192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5841a50b0 con 0x7fd584106a90 2024-09-12T01:34:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.137+0000 7fd5767fc640 1 -- 172.21.15.81:0/2793290192 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fd57c0051d0 con 0x7fd584106a90 2024-09-12T01:34:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.138+0000 7fd5767fc640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd5700a2cf0 0x7fd5700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.138+0000 7fd589178640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd5700a2cf0 0x7fd5700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.138+0000 7fd58d7b5740 1 Processor -- start 2024-09-12T01:34:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.138+0000 7fd5767fc640 1 -- 172.21.15.81:0/2793290192 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fd57c0cf570 con 0x7fd584106a90 2024-09-12T01:34:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.138+0000 7fd58d7b5740 1 -- start start 2024-09-12T01:34:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd58d7b5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec29b40 0x55f8dec28090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd589178640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd5700a2cf0 0x7fd5700a51b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd5780096c0 tx=0x7fd578000bc0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd58d7b5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 0x55f8dec28a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd58d7b5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec33370 0x55f8dec35760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd58d7b5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f8deb8e2f0 con 0x55f8dec285d0 2024-09-12T01:34:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd58d7b5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f8deb35cf0 con 0x55f8dec29b40 2024-09-12T01:34:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd58d7b5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f8deb8a2b0 con 0x55f8dec33370 2024-09-12T01:34:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd588977640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 0x55f8dec28a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd588977640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 0x55f8dec28a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37026/0 (socket says 172.21.15.81:37026) 2024-09-12T01:34:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd588977640 1 -- 172.21.15.81:0/3965126137 learned_addr learned my addr 172.21.15.81:0/3965126137 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd589178640 1 --2- 172.21.15.81:0/3965126137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec29b40 0x55f8dec28090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd589979640 1 --2- 172.21.15.81:0/3965126137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec33370 0x55f8dec35760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd588977640 1 -- 172.21.15.81:0/3965126137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec33370 msgr2=0x55f8dec35760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd588977640 1 --2- 172.21.15.81:0/3965126137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec33370 0x55f8dec35760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd588977640 1 -- 172.21.15.81:0/3965126137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec29b40 msgr2=0x55f8dec28090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd588977640 1 --2- 172.21.15.81:0/3965126137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec29b40 0x55f8dec28090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.139+0000 7fd588977640 1 -- 172.21.15.81:0/3965126137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8deb1a3a0 con 0x55f8dec285d0 2024-09-12T01:34:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.140+0000 7fd588977640 1 --2- 172.21.15.81:0/3965126137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 0x55f8dec28a10 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd58000a8e0 tx=0x7fd58000ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aae4206222928df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.140+0000 7fd56f7fe640 1 -- 172.21.15.81:0/3965126137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580015070 con 0x55f8dec285d0 2024-09-12T01:34:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.140+0000 7fd56f7fe640 1 -- 172.21.15.81:0/3965126137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd58000cb40 con 0x55f8dec285d0 2024-09-12T01:34:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.140+0000 7fd56f7fe640 1 -- 172.21.15.81:0/3965126137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580018650 con 0x55f8dec285d0 2024-09-12T01:34:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.140+0000 7fd58d7b5740 1 -- 172.21.15.81:0/3965126137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 msgr2=0x55f8dec28a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/3965126137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 0x55f8dec28a10 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd58000a8e0 tx=0x7fd58000ada0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 -- 172.21.15.81:0/3965126137 shutdown_connections 2024-09-12T01:34:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/3965126137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec33370 0x55f8dec35760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/3965126137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 0x55f8dec28a10 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/3965126137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec29b40 0x55f8dec28090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 -- 172.21.15.81:0/3965126137 >> 172.21.15.81:0/3965126137 conn(0x55f8debf1310 msgr2=0x55f8dec24c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 -- 172.21.15.81:0/3965126137 shutdown_connections 2024-09-12T01:34:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 -- 172.21.15.81:0/3965126137 wait complete. 2024-09-12T01:34:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 -- start start 2024-09-12T01:34:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 Processor -- start 2024-09-12T01:34:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 0x55f8dec32d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec29b40 0x55f8dec30000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec33370 0x55f8dec305d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f8dec36070 con 0x55f8dec285d0 2024-09-12T01:34:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f8deb49060 con 0x55f8dec33370 2024-09-12T01:34:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.141+0000 7fd58d7b5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f8dec361f0 con 0x55f8dec29b40 2024-09-12T01:34:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd58d7b5740 10 client.0 _ll_register_callbacks cb 0x55f8de89c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd589178640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 0x55f8dec32d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd589178640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 0x55f8dec32d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37040/0 (socket says 172.21.15.81:37040) 2024-09-12T01:34:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd589178640 1 -- 172.21.15.81:0/2581591694 learned_addr learned my addr 172.21.15.81:0/2581591694 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd588977640 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec29b40 0x55f8dec30000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd589979640 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec33370 0x55f8dec305d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd589178640 1 -- 172.21.15.81:0/2581591694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec29b40 msgr2=0x55f8dec30000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd589178640 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec29b40 0x55f8dec30000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd589178640 1 -- 172.21.15.81:0/2581591694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec33370 msgr2=0x55f8dec305d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd589178640 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec33370 0x55f8dec305d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd589178640 1 -- 172.21.15.81:0/2581591694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8de8ff3c0 con 0x55f8dec285d0 2024-09-12T01:34:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd588977640 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec29b40 0x55f8dec30000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:34:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd589979640 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec33370 0x55f8dec305d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:34:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd589178640 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 0x55f8dec32d50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd578033000 tx=0x7fd578009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3385fb917476e4b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd56cff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd56cff9640 1 -- 172.21.15.81:0/2581591694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57804b070 con 0x55f8dec285d0 2024-09-12T01:34:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd56cff9640 1 -- 172.21.15.81:0/2581591694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fd578005450 con 0x55f8dec285d0 2024-09-12T01:34:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd58d7b5740 1 -- 172.21.15.81:0/2581591694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd58000cb40 con 0x55f8dec285d0 2024-09-12T01:34:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd56cff9640 1 -- 172.21.15.81:0/2581591694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd578057050 con 0x55f8dec285d0 2024-09-12T01:34:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd58d7b5740 10 client.16941 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.142+0000 7fd58d7b5740 1 -- 172.21.15.81:0/2581591694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f8dec41b40 con 0x55f8dec285d0 2024-09-12T01:34:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.143+0000 7fd56cff9640 1 -- 172.21.15.81:0/2581591694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd58000cb40 con 0x55f8dec285d0 2024-09-12T01:34:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.143+0000 7fd56cff9640 1 -- 172.21.15.81:0/2581591694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd578046040 con 0x55f8dec285d0 2024-09-12T01:34:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.143+0000 7fd58d7b5740 10 client.16941 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.143+0000 7fd58d7b5740 10 client.16941 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:34:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.143+0000 7fd58d7b5740 20 client.16941 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.143+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f8dec42f50 0x55f8dec453f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.143+0000 7fd58d7b5740 4 client.16941 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:34:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.143+0000 7fd58d7b5740 1 -- 172.21.15.81:0/2581591694 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8deb9b860 con 0x55f8dec42f50 2024-09-12T01:34:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.143+0000 7fd588977640 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f8dec42f50 0x55f8dec453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.144+0000 7fd588977640 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f8dec42f50 0x55f8dec453f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c1c6683b0ab3a94f server_cookie=b8c20b23b3cd6f1d in_seq=0 out_seq=0 2024-09-12T01:34:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.144+0000 7fd56cff9640 10 client.16941 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:34:28.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.144+0000 7fd56cff9640 1 -- 172.21.15.81:0/2581591694 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8deb9b860 con 0x55f8dec42f50 2024-09-12T01:34:28.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.144+0000 7fd56cff9640 10 client.16941 handle_command_reply: tid=0 2024-09-12T01:34:28.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.144+0000 7fd58d7b5740 1 client.16941 shutdown 2024-09-12T01:34:28.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.144+0000 7fd58d7b5740 1 -- 172.21.15.81:0/2581591694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 msgr2=0x55f8dec32d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:28.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.144+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 0x55f8dec32d50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd578033000 tx=0x7fd578009260 comp rx=0 tx=0).stop 2024-09-12T01:34:28.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.145+0000 7fd58d7b5740 1 -- 172.21.15.81:0/2581591694 shutdown_connections 2024-09-12T01:34:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.145+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec33370 0x55f8dec305d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.145+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec29b40 0x55f8dec30000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.145+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f8dec42f50 0x55f8dec453f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.145+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/2581591694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec285d0 0x55f8dec32d50 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.145+0000 7fd58d7b5740 1 -- 172.21.15.81:0/2581591694 >> 172.21.15.81:0/2581591694 conn(0x55f8debf1310 msgr2=0x55f8dec2a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.145+0000 7fd56cff9640 0 client.16941 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:34:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.145+0000 7fd58d7b5740 1 -- 172.21.15.81:0/2581591694 shutdown_connections 2024-09-12T01:34:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.145+0000 7fd58d7b5740 1 -- 172.21.15.81:0/2581591694 wait complete. 2024-09-12T01:34:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.145+0000 7fd58d7b5740 20 client.16941 trim_cache size 0 max 16384 2024-09-12T01:34:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd58d7b5740 1 Processor -- start 2024-09-12T01:34:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd58d7b5740 1 -- start start 2024-09-12T01:34:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd58d7b5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec285d0 0x55f8dec24e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd58d7b5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec29b40 0x55f8dec3f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd58d7b5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec33370 0x55f8dec3b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd58d7b5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd5841ad820 con 0x55f8dec33370 2024-09-12T01:34:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd58d7b5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd5841af360 con 0x55f8dec285d0 2024-09-12T01:34:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd58d7b5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd5841adef0 con 0x55f8dec29b40 2024-09-12T01:34:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd589979640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec33370 0x55f8dec3b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd589979640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec33370 0x55f8dec3b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37056/0 (socket says 172.21.15.81:37056) 2024-09-12T01:34:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd589979640 1 -- 172.21.15.81:0/2453322082 learned_addr learned my addr 172.21.15.81:0/2453322082 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd588977640 1 --2- 172.21.15.81:0/2453322082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec29b40 0x55f8dec3f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd589178640 1 --2- 172.21.15.81:0/2453322082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec285d0 0x55f8dec24e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd589979640 1 -- 172.21.15.81:0/2453322082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec29b40 msgr2=0x55f8dec3f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd589979640 1 --2- 172.21.15.81:0/2453322082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec29b40 0x55f8dec3f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd589979640 1 -- 172.21.15.81:0/2453322082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec285d0 msgr2=0x55f8dec24e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd589979640 1 --2- 172.21.15.81:0/2453322082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec285d0 0x55f8dec24e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd589979640 1 -- 172.21.15.81:0/2453322082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8dec24320 con 0x55f8dec33370 2024-09-12T01:34:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.158+0000 7fd589979640 1 --2- 172.21.15.81:0/2453322082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec33370 0x55f8dec3b860 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005ba0 tx=0x7fd57c09ffb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c3e9f75f5c048b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.159+0000 7fd56effd640 1 -- 172.21.15.81:0/2453322082 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c01d040 con 0x55f8dec33370 2024-09-12T01:34:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.159+0000 7fd56effd640 1 -- 172.21.15.81:0/2453322082 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57c005560 con 0x55f8dec33370 2024-09-12T01:34:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.159+0000 7fd56effd640 1 -- 172.21.15.81:0/2453322082 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c09b170 con 0x55f8dec33370 2024-09-12T01:34:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.159+0000 7fd58d7b5740 1 -- 172.21.15.81:0/2453322082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec33370 msgr2=0x55f8dec3b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.159+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/2453322082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec33370 0x55f8dec3b860 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005ba0 tx=0x7fd57c09ffb0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.159+0000 7fd58d7b5740 1 -- 172.21.15.81:0/2453322082 shutdown_connections 2024-09-12T01:34:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.159+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/2453322082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec33370 0x55f8dec3b860 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.159+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/2453322082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec29b40 0x55f8dec3f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.159+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/2453322082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec285d0 0x55f8dec24e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.159+0000 7fd58d7b5740 1 -- 172.21.15.81:0/2453322082 >> 172.21.15.81:0/2453322082 conn(0x55f8debf1310 msgr2=0x55f8dec24700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.159+0000 7fd58d7b5740 1 -- 172.21.15.81:0/2453322082 shutdown_connections 2024-09-12T01:34:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.159+0000 7fd58d7b5740 1 -- 172.21.15.81:0/2453322082 wait complete. 2024-09-12T01:34:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.160+0000 7fd58d7b5740 1 -- start start 2024-09-12T01:34:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.160+0000 7fd58d7b5740 1 Processor -- start 2024-09-12T01:34:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.160+0000 7fd58d7b5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec285d0 0x55f8dec2d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.160+0000 7fd58d7b5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec29b40 0x55f8dec2dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.160+0000 7fd58d7b5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec33370 0x55f8dec2c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.160+0000 7fd58d7b5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd5841aec90 con 0x55f8dec29b40 2024-09-12T01:34:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.160+0000 7fd58d7b5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd5841ae5c0 con 0x55f8dec33370 2024-09-12T01:34:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.160+0000 7fd58d7b5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd5841ab800 con 0x55f8dec285d0 2024-09-12T01:34:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.160+0000 7fd58d7b5740 10 client.0 _ll_register_callbacks cb 0x7fd578031710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.160+0000 7fd588977640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec29b40 0x55f8dec2dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.160+0000 7fd588977640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec29b40 0x55f8dec2dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37070/0 (socket says 172.21.15.81:37070) 2024-09-12T01:34:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.160+0000 7fd588977640 1 -- 172.21.15.81:0/1469239155 learned_addr learned my addr 172.21.15.81:0/1469239155 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd589178640 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec285d0 0x55f8dec2d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd589979640 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec33370 0x55f8dec2c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd588977640 1 -- 172.21.15.81:0/1469239155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec285d0 msgr2=0x55f8dec2d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd588977640 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec285d0 0x55f8dec2d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd588977640 1 -- 172.21.15.81:0/1469239155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec33370 msgr2=0x55f8dec2c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd588977640 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec33370 0x55f8dec2c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd588977640 1 -- 172.21.15.81:0/1469239155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8dec2ccf0 con 0x55f8dec29b40 2024-09-12T01:34:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd589178640 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec285d0 0x55f8dec2d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:34:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd588977640 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec29b40 0x55f8dec2dcf0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fd580006c60 tx=0x7fd58001c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b5b94c705b748c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd56cff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd56cff9640 1 -- 172.21.15.81:0/1469239155 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580015040 con 0x55f8dec29b40 2024-09-12T01:34:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd56cff9640 1 -- 172.21.15.81:0/1469239155 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fd5800113f0 con 0x55f8dec29b40 2024-09-12T01:34:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd58d7b5740 1 -- 172.21.15.81:0/1469239155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd57c005560 con 0x55f8dec29b40 2024-09-12T01:34:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd56cff9640 1 -- 172.21.15.81:0/1469239155 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd5800115f0 con 0x55f8dec29b40 2024-09-12T01:34:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd58d7b5740 10 client.16947 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd58d7b5740 1 -- 172.21.15.81:0/1469239155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f8decb1a10 con 0x55f8dec29b40 2024-09-12T01:34:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd56cff9640 1 -- 172.21.15.81:0/1469239155 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57c005560 con 0x55f8dec29b40 2024-09-12T01:34:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.161+0000 7fd56cff9640 1 -- 172.21.15.81:0/1469239155 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd58002b020 con 0x55f8dec29b40 2024-09-12T01:34:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.162+0000 7fd58d7b5740 10 client.16947 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:28.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.162+0000 7fd58d7b5740 10 client.16947 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:34:28.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.162+0000 7fd58d7b5740 20 client.16947 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:28.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.162+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f8decb1f30 0x55f8decb4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:28.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.162+0000 7fd58d7b5740 4 client.16947 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:34:28.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.162+0000 7fd58d7b5740 1 -- 172.21.15.81:0/1469239155 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f8deb95d70 con 0x55f8decb1f30 2024-09-12T01:34:28.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.162+0000 7fd589178640 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f8decb1f30 0x55f8decb4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:28.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.162+0000 7fd56cff9640 10 client.16947 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:34:28.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.162+0000 7fd589178640 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f8decb1f30 0x55f8decb4350 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5e4098faccf610d5 server_cookie=412cfc2edc0dfa64 in_seq=0 out_seq=0 2024-09-12T01:34:28.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.162+0000 7fd56cff9640 1 -- 172.21.15.81:0/1469239155 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f8deb95d70 con 0x55f8decb1f30 2024-09-12T01:34:28.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.162+0000 7fd56cff9640 10 client.16947 handle_command_reply: tid=0 2024-09-12T01:34:28.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.162+0000 7fd58d7b5740 1 client.16947 shutdown 2024-09-12T01:34:28.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58d7b5740 1 -- 172.21.15.81:0/1469239155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec29b40 msgr2=0x55f8dec2dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:28.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec29b40 0x55f8dec2dcf0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fd580006c60 tx=0x7fd58001c040 comp rx=0 tx=0).stop 2024-09-12T01:34:28.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58d7b5740 1 -- 172.21.15.81:0/1469239155 shutdown_connections 2024-09-12T01:34:28.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8dec33370 0x55f8dec2c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55f8decb1f30 0x55f8decb4350 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f8dec29b40 0x55f8dec2dcf0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58d7b5740 1 --2- 172.21.15.81:0/1469239155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f8dec285d0 0x55f8dec2d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58d7b5740 1 -- 172.21.15.81:0/1469239155 >> 172.21.15.81:0/1469239155 conn(0x55f8debf1310 msgr2=0x55f8dec23310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:28.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd56cff9640 0 client.16947 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:34:28.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58d7b5740 1 -- 172.21.15.81:0/1469239155 shutdown_connections 2024-09-12T01:34:28.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58d7b5740 1 -- 172.21.15.81:0/1469239155 wait complete. 2024-09-12T01:34:28.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58d7b5740 20 client.16947 trim_cache size 0 max 16384 2024-09-12T01:34:28.168 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:34:28.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58b3dc640 1 -- 172.21.15.81:0/2793290192 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd5700a2cf0 msgr2=0x7fd5700a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:28.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58b3dc640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd5700a2cf0 0x7fd5700a51b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd5780096c0 tx=0x7fd578000bc0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58b3dc640 1 -- 172.21.15.81:0/2793290192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd584106a90 msgr2=0x7fd58419ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:28.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58b3dc640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd584106a90 0x7fd58419ce00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00cad0 tx=0x7fd57c00cf90 comp rx=0 tx=0).stop 2024-09-12T01:34:28.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58b3dc640 1 -- 172.21.15.81:0/2793290192 shutdown_connections 2024-09-12T01:34:28.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58b3dc640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd5700a2cf0 0x7fd5700a51b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.163+0000 7fd58b3dc640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd584106a90 0x7fd58419ce00 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.164+0000 7fd58b3dc640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd584101430 0x7fd584198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.164+0000 7fd58b3dc640 1 --2- 172.21.15.81:0/2793290192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd584100a90 0x7fd584198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:28.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.164+0000 7fd58b3dc640 1 -- 172.21.15.81:0/2793290192 >> 172.21.15.81:0/2793290192 conn(0x7fd5840fc7d0 msgr2=0x7fd58406aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:28.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.164+0000 7fd58b3dc640 1 -- 172.21.15.81:0/2793290192 shutdown_connections 2024-09-12T01:34:28.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:28.164+0000 7fd58b3dc640 1 -- 172.21.15.81:0/2793290192 wait complete. 2024-09-12T01:34:28.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:34:29.085 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:34:29.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.552+0000 7f56fc1b8640 1 -- 172.21.15.81:0/1895908779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f4102ef0 msgr2=0x7f56f410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:29.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.552+0000 7f56fc1b8640 1 --2- 172.21.15.81:0/1895908779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f4102ef0 0x7f56f410da40 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009ca0 tx=0x7f56ec02a950 comp rx=0 tx=0).stop 2024-09-12T01:34:29.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.552+0000 7f56fc1b8640 1 -- 172.21.15.81:0/1895908779 shutdown_connections 2024-09-12T01:34:29.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.552+0000 7f56fc1b8640 1 --2- 172.21.15.81:0/1895908779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f4102ef0 0x7f56f410da40 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.552+0000 7f56fc1b8640 1 --2- 172.21.15.81:0/1895908779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f4102570 0x7f56f41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.552+0000 7f56fc1b8640 1 --2- 172.21.15.81:0/1895908779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56f4100e20 0x7f56f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.552+0000 7f56fc1b8640 1 -- 172.21.15.81:0/1895908779 >> 172.21.15.81:0/1895908779 conn(0x7f56f40fc7d0 msgr2=0x7f56f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.552+0000 7f56fc1b8640 1 -- 172.21.15.81:0/1895908779 shutdown_connections 2024-09-12T01:34:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.552+0000 7f56fc1b8640 1 -- 172.21.15.81:0/1895908779 wait complete. 2024-09-12T01:34:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.552+0000 7f56fc1b8640 1 Processor -- start 2024-09-12T01:34:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.552+0000 7f56fc1b8640 1 -- start start 2024-09-12T01:34:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fc1b8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f4100e20 0x7f56f4198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fc1b8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56f4102570 0x7f56f4198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fc1b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f4102ef0 0x7f56f419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fc1b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56f4110f80 con 0x7f56f4102ef0 2024-09-12T01:34:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fc1b8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56f4110e00 con 0x7f56f4102570 2024-09-12T01:34:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fc1b8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f56f4111100 con 0x7f56f4100e20 2024-09-12T01:34:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fa755640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f4102ef0 0x7f56f419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fa755640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f4102ef0 0x7f56f419ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37084/0 (socket says 172.21.15.81:37084) 2024-09-12T01:34:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fa755640 1 -- 172.21.15.81:0/2641861316 learned_addr learned my addr 172.21.15.81:0/2641861316 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56f9f54640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f4100e20 0x7f56f4198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56f9753640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56f4102570 0x7f56f4198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fa755640 1 -- 172.21.15.81:0/2641861316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f4100e20 msgr2=0x7f56f4198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fa755640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f4100e20 0x7f56f4198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fa755640 1 -- 172.21.15.81:0/2641861316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56f4102570 msgr2=0x7f56f4198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fa755640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56f4102570 0x7f56f4198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fa755640 1 -- 172.21.15.81:0/2641861316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f419d4e0 con 0x7f56f4102ef0 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56f9f54640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f4100e20 0x7f56f4198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fa755640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f4102ef0 0x7f56f419ce00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f56ec02ae70 tx=0x7f56ec02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56eaffd640 1 -- 172.21.15.81:0/2641861316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec034040 con 0x7f56f4102ef0 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56eaffd640 1 -- 172.21.15.81:0/2641861316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56ec030920 con 0x7f56f4102ef0 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56eaffd640 1 -- 172.21.15.81:0/2641861316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec045480 con 0x7f56f4102ef0 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.553+0000 7f56fc1b8640 1 -- 172.21.15.81:0/2641861316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f419d770 con 0x7f56f4102ef0 2024-09-12T01:34:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.554+0000 7f56fc1b8640 1 -- 172.21.15.81:0/2641861316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f41a50b0 con 0x7f56f4102ef0 2024-09-12T01:34:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.556+0000 7f56eaffd640 1 -- 172.21.15.81:0/2641861316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f56ec037020 con 0x7f56f4102ef0 2024-09-12T01:34:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.556+0000 7f56fe591740 1 Processor -- start 2024-09-12T01:34:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.556+0000 7f56fe591740 1 -- start start 2024-09-12T01:34:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.556+0000 7f56fe591740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f64090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.556+0000 7f56fe591740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 0x562cb0f64a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.556+0000 7f56fe591740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f6f370 0x562cb0f71760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.556+0000 7f56fe591740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562cb0eca2f0 con 0x562cb0f65b40 2024-09-12T01:34:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.556+0000 7f56fe591740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562cb0e71cf0 con 0x562cb0f645d0 2024-09-12T01:34:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.556+0000 7f56fe591740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562cb0ec62b0 con 0x562cb0f6f370 2024-09-12T01:34:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56eaffd640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f56e00a2cf0 0x7f56e00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56f9753640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f64090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56f9753640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f64090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37094/0 (socket says 172.21.15.81:37094) 2024-09-12T01:34:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56f9753640 1 -- 172.21.15.81:0/3755661947 learned_addr learned my addr 172.21.15.81:0/3755661947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56fa755640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f56e00a2cf0 0x7f56e00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56f9f54640 1 --2- 172.21.15.81:0/3755661947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 0x562cb0f64a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56eaffd640 1 -- 172.21.15.81:0/2641861316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f56ec0f0330 con 0x7f56f4102ef0 2024-09-12T01:34:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56f9753640 1 --2- 172.21.15.81:0/3755661947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f6f370 0x562cb0f71760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56f9753640 1 -- 172.21.15.81:0/3755661947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f6f370 msgr2=0x562cb0f71760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56f9753640 1 --2- 172.21.15.81:0/3755661947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f6f370 0x562cb0f71760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56f9753640 1 -- 172.21.15.81:0/3755661947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 msgr2=0x562cb0f64a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56f9753640 1 --2- 172.21.15.81:0/3755661947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 0x562cb0f64a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56f9753640 1 -- 172.21.15.81:0/3755661947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cb0e563a0 con 0x562cb0f65b40 2024-09-12T01:34:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56fa755640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f56e00a2cf0 0x7f56e00a51b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0bc8c0 tx=0x7f56ec087950 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56f9753640 1 --2- 172.21.15.81:0/3755661947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f64090 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f56e4005fd0 tx=0x7f56e400b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de691f51956d7855 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56dffff640 1 -- 172.21.15.81:0/3755661947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4012650 con 0x562cb0f65b40 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56dffff640 1 -- 172.21.15.81:0/3755661947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56e4012cd0 con 0x562cb0f65b40 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.557+0000 7f56dffff640 1 -- 172.21.15.81:0/3755661947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4011c30 con 0x562cb0f65b40 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.558+0000 7f56fe591740 1 -- 172.21.15.81:0/3755661947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 msgr2=0x562cb0f64090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.558+0000 7f56fe591740 1 --2- 172.21.15.81:0/3755661947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f64090 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f56e4005fd0 tx=0x7f56e400b3f0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.558+0000 7f56fe591740 1 -- 172.21.15.81:0/3755661947 shutdown_connections 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.558+0000 7f56fe591740 1 --2- 172.21.15.81:0/3755661947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f6f370 0x562cb0f71760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.558+0000 7f56fe591740 1 --2- 172.21.15.81:0/3755661947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 0x562cb0f64a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.558+0000 7f56fe591740 1 --2- 172.21.15.81:0/3755661947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f64090 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.558+0000 7f56fe591740 1 -- 172.21.15.81:0/3755661947 >> 172.21.15.81:0/3755661947 conn(0x562cb0f2d310 msgr2=0x562cb0f60c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.558+0000 7f56fe591740 1 -- 172.21.15.81:0/3755661947 shutdown_connections 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.558+0000 7f56fe591740 1 -- 172.21.15.81:0/3755661947 wait complete. 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56fe591740 1 -- start start 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56fe591740 1 Processor -- start 2024-09-12T01:34:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56fe591740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 0x562cb0f6ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56fe591740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f6c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56fe591740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f6f370 0x562cb0f6c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56fe591740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562cb0f72070 con 0x562cb0f65b40 2024-09-12T01:34:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56fe591740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562cb0e85060 con 0x562cb0f645d0 2024-09-12T01:34:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56fe591740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562cb0f721f0 con 0x562cb0f6f370 2024-09-12T01:34:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56fe591740 10 client.0 _ll_register_callbacks cb 0x562cb0bd88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56f9f54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f6c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56f9f54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f6c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37098/0 (socket says 172.21.15.81:37098) 2024-09-12T01:34:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56f9f54640 1 -- 172.21.15.81:0/4176827697 learned_addr learned my addr 172.21.15.81:0/4176827697 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56f9753640 1 --2- 172.21.15.81:0/4176827697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 0x562cb0f6ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56f9753640 1 --2- 172.21.15.81:0/4176827697 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f6f370 0x562cb0f6c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56f9f54640 1 -- 172.21.15.81:0/4176827697 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f6f370 msgr2=0x562cb0f6c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56f9f54640 1 --2- 172.21.15.81:0/4176827697 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f6f370 0x562cb0f6c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.559+0000 7f56f9f54640 1 -- 172.21.15.81:0/4176827697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 msgr2=0x562cb0f6ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56f9f54640 1 --2- 172.21.15.81:0/4176827697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 0x562cb0f6ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56f9f54640 1 -- 172.21.15.81:0/4176827697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cb0c3b3c0 con 0x562cb0f65b40 2024-09-12T01:34:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56f9f54640 1 --2- 172.21.15.81:0/4176827697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f6c090 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009fc0 tx=0x7f56f0011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1d1171a056dd0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56dd7fa640 1 -- 172.21.15.81:0/4176827697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0012920 con 0x562cb0f65b40 2024-09-12T01:34:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56dd7fa640 1 -- 172.21.15.81:0/4176827697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f56f0012ac0 con 0x562cb0f65b40 2024-09-12T01:34:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56fe591740 1 -- 172.21.15.81:0/4176827697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56e4012cd0 con 0x562cb0f65b40 2024-09-12T01:34:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56dd7fa640 1 -- 172.21.15.81:0/4176827697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f56f0012cc0 con 0x562cb0f65b40 2024-09-12T01:34:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56fe591740 10 client.16959 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56fe591740 1 -- 172.21.15.81:0/4176827697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562cb0f7dc00 con 0x562cb0f65b40 2024-09-12T01:34:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56dd7fa640 1 -- 172.21.15.81:0/4176827697 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56e4012cd0 con 0x562cb0f65b40 2024-09-12T01:34:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56dd7fa640 1 -- 172.21.15.81:0/4176827697 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f56f000f040 con 0x562cb0f65b40 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56fe591740 10 client.16959 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56fe591740 10 client.16959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56fe591740 20 client.16959 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56fe591740 1 --2- 172.21.15.81:0/4176827697 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562cb0f7f0c0 0x562cb0f81520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56fe591740 4 client.16959 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.560+0000 7f56fe591740 1 -- 172.21.15.81:0/4176827697 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cb0ed7860 con 0x562cb0f7f0c0 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.561+0000 7f56f9753640 1 --2- 172.21.15.81:0/4176827697 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562cb0f7f0c0 0x562cb0f81520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.561+0000 7f56f9753640 1 --2- 172.21.15.81:0/4176827697 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562cb0f7f0c0 0x562cb0f81520 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d76902dc00d4d50a server_cookie=9cc418bc295a0856 in_seq=0 out_seq=0 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.561+0000 7f56dd7fa640 10 client.16959 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56dd7fa640 1 -- 172.21.15.81:0/4176827697 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562cb0ed7860 con 0x562cb0f7f0c0 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56dd7fa640 10 client.16959 handle_command_reply: tid=0 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56fe591740 1 client.16959 shutdown 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56fe591740 1 -- 172.21.15.81:0/4176827697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 msgr2=0x562cb0f6c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:29.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56fe591740 1 --2- 172.21.15.81:0/4176827697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f6c090 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009fc0 tx=0x7f56f0011870 comp rx=0 tx=0).stop 2024-09-12T01:34:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56fe591740 1 -- 172.21.15.81:0/4176827697 shutdown_connections 2024-09-12T01:34:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56fe591740 1 --2- 172.21.15.81:0/4176827697 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562cb0f7f0c0 0x562cb0f81520 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56fe591740 1 --2- 172.21.15.81:0/4176827697 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f6f370 0x562cb0f6c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56dd7fa640 0 client.16959 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56fe591740 1 --2- 172.21.15.81:0/4176827697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f6c090 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56fe591740 1 --2- 172.21.15.81:0/4176827697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 0x562cb0f6ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56fe591740 1 -- 172.21.15.81:0/4176827697 >> 172.21.15.81:0/4176827697 conn(0x562cb0f2d310 msgr2=0x562cb0f66930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56fe591740 1 -- 172.21.15.81:0/4176827697 shutdown_connections 2024-09-12T01:34:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56fe591740 1 -- 172.21.15.81:0/4176827697 wait complete. 2024-09-12T01:34:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.562+0000 7f56fe591740 20 client.16959 trim_cache size 0 max 16384 2024-09-12T01:34:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.575+0000 7f56fe591740 1 Processor -- start 2024-09-12T01:34:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.575+0000 7f56fe591740 1 -- start start 2024-09-12T01:34:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.575+0000 7f56fe591740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f645d0 0x562cb0f7b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.575+0000 7f56fe591740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f67120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.575+0000 7f56fe591740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f6f370 0x562cb0f67660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.575+0000 7f56fe591740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56f41ad7b0 con 0x562cb0f65b40 2024-09-12T01:34:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.575+0000 7f56fe591740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56f41af2f0 con 0x562cb0f6f370 2024-09-12T01:34:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.575+0000 7f56fe591740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f56f41ade80 con 0x562cb0f645d0 2024-09-12T01:34:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.575+0000 7f56f9f54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f67120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.575+0000 7f56f9f54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f67120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37102/0 (socket says 172.21.15.81:37102) 2024-09-12T01:34:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.575+0000 7f56f9f54640 1 -- 172.21.15.81:0/930214925 learned_addr learned my addr 172.21.15.81:0/930214925 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.575+0000 7f56f9753640 1 --2- 172.21.15.81:0/930214925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f645d0 0x562cb0f7b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.576+0000 7f56f9f54640 1 -- 172.21.15.81:0/930214925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f645d0 msgr2=0x562cb0f7b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.576+0000 7f56f9f54640 1 --2- 172.21.15.81:0/930214925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f645d0 0x562cb0f7b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.576+0000 7f56f9f54640 1 -- 172.21.15.81:0/930214925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f6f370 msgr2=0x562cb0f67660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.576+0000 7f56f9f54640 1 --2- 172.21.15.81:0/930214925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f6f370 0x562cb0f67660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.576+0000 7f56f9f54640 1 -- 172.21.15.81:0/930214925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cb0f7b850 con 0x562cb0f65b40 2024-09-12T01:34:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.576+0000 7f56f9f54640 1 --2- 172.21.15.81:0/930214925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f67120 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f56f00196f0 tx=0x7f56f0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60044626712363b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.576+0000 7f56df7fe640 1 -- 172.21.15.81:0/930214925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0031070 con 0x562cb0f65b40 2024-09-12T01:34:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.576+0000 7f56df7fe640 1 -- 172.21.15.81:0/930214925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56f0011d70 con 0x562cb0f65b40 2024-09-12T01:34:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.576+0000 7f56df7fe640 1 -- 172.21.15.81:0/930214925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f00199d0 con 0x562cb0f65b40 2024-09-12T01:34:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.577+0000 7f56fe591740 1 -- 172.21.15.81:0/930214925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 msgr2=0x562cb0f67120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.577+0000 7f56fe591740 1 --2- 172.21.15.81:0/930214925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f67120 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f56f00196f0 tx=0x7f56f0009c30 comp rx=0 tx=0).stop 2024-09-12T01:34:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.577+0000 7f56fe591740 1 -- 172.21.15.81:0/930214925 shutdown_connections 2024-09-12T01:34:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.577+0000 7f56fe591740 1 --2- 172.21.15.81:0/930214925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f6f370 0x562cb0f67660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.577+0000 7f56fe591740 1 --2- 172.21.15.81:0/930214925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f65b40 0x562cb0f67120 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.577+0000 7f56fe591740 1 --2- 172.21.15.81:0/930214925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f645d0 0x562cb0f7b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.577+0000 7f56fe591740 1 -- 172.21.15.81:0/930214925 >> 172.21.15.81:0/930214925 conn(0x562cb0f2d310 msgr2=0x562cb0f6b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.577+0000 7f56fe591740 1 -- 172.21.15.81:0/930214925 shutdown_connections 2024-09-12T01:34:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.577+0000 7f56fe591740 1 -- 172.21.15.81:0/930214925 wait complete. 2024-09-12T01:34:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.577+0000 7f56fe591740 1 -- start start 2024-09-12T01:34:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.577+0000 7f56fe591740 1 Processor -- start 2024-09-12T01:34:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56fe591740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 0x562cb0f73150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56fe591740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f65b40 0x562cb0f73690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56fe591740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f6f370 0x562cb0f73bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56fe591740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56f41aec20 con 0x562cb0f6f370 2024-09-12T01:34:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56fe591740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56f41ae550 con 0x562cb0f645d0 2024-09-12T01:34:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56fe591740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f56f41ab790 con 0x562cb0f65b40 2024-09-12T01:34:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56fe591740 10 client.0 _ll_register_callbacks cb 0x7f56f00097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56f9753640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f6f370 0x562cb0f73bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56f9753640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f6f370 0x562cb0f73bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37106/0 (socket says 172.21.15.81:37106) 2024-09-12T01:34:29.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56f9753640 1 -- 172.21.15.81:0/996745547 learned_addr learned my addr 172.21.15.81:0/996745547 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56f9753640 1 --2- 172.21.15.81:0/996745547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 0x562cb0f73150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56f9f54640 1 --2- 172.21.15.81:0/996745547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f65b40 0x562cb0f73690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56f9753640 1 -- 172.21.15.81:0/996745547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f65b40 msgr2=0x562cb0f73690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56f9753640 1 --2- 172.21.15.81:0/996745547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f65b40 0x562cb0f73690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56f9753640 1 -- 172.21.15.81:0/996745547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 msgr2=0x562cb0f73150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56f9753640 1 --2- 172.21.15.81:0/996745547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 0x562cb0f73150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56f9753640 1 -- 172.21.15.81:0/996745547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cb0fed1d0 con 0x562cb0f6f370 2024-09-12T01:34:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56f9753640 1 --2- 172.21.15.81:0/996745547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f6f370 0x562cb0f73bd0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f56e400b930 tx=0x7f56f0009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3018784e6cdb4c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56dd7fa640 1 -- 172.21.15.81:0/996745547 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e402e070 con 0x562cb0f6f370 2024-09-12T01:34:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56dd7fa640 1 -- 172.21.15.81:0/996745547 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f56e4011d00 con 0x562cb0f6f370 2024-09-12T01:34:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.578+0000 7f56fe591740 1 -- 172.21.15.81:0/996745547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56f0011d70 con 0x562cb0f6f370 2024-09-12T01:34:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.579+0000 7f56dd7fa640 1 -- 172.21.15.81:0/996745547 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f56e4005de0 con 0x562cb0f6f370 2024-09-12T01:34:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.579+0000 7f56fe591740 10 client.16965 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.579+0000 7f56fe591740 1 -- 172.21.15.81:0/996745547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562cb0fee430 con 0x562cb0f6f370 2024-09-12T01:34:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.579+0000 7f56dd7fa640 1 -- 172.21.15.81:0/996745547 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56f0011d70 con 0x562cb0f6f370 2024-09-12T01:34:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.579+0000 7f56dd7fa640 1 -- 172.21.15.81:0/996745547 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f56e4031020 con 0x562cb0f6f370 2024-09-12T01:34:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.579+0000 7f56fe591740 10 client.16965 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.579+0000 7f56fe591740 10 client.16965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:34:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.579+0000 7f56fe591740 20 client.16965 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.579+0000 7f56fe591740 1 --2- 172.21.15.81:0/996745547 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562cb0feeaa0 0x562cb0ff0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.579+0000 7f56fe591740 4 client.16965 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:34:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.579+0000 7f56fe591740 1 -- 172.21.15.81:0/996745547 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562cb0ed1d70 con 0x562cb0feeaa0 2024-09-12T01:34:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.579+0000 7f56f9f54640 1 --2- 172.21.15.81:0/996745547 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562cb0feeaa0 0x562cb0ff0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56dd7fa640 10 client.16965 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56f9f54640 1 --2- 172.21.15.81:0/996745547 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562cb0feeaa0 0x562cb0ff0ee0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9192be182bb39bcd server_cookie=a8e015d37bf485c in_seq=0 out_seq=0 2024-09-12T01:34:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56dd7fa640 1 -- 172.21.15.81:0/996745547 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562cb0ed1d70 con 0x562cb0feeaa0 2024-09-12T01:34:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56dd7fa640 10 client.16965 handle_command_reply: tid=0 2024-09-12T01:34:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56fe591740 1 client.16965 shutdown 2024-09-12T01:34:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56fe591740 1 -- 172.21.15.81:0/996745547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f6f370 msgr2=0x562cb0f73bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56fe591740 1 --2- 172.21.15.81:0/996745547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f6f370 0x562cb0f73bd0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f56e400b930 tx=0x7f56f0009b40 comp rx=0 tx=0).stop 2024-09-12T01:34:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56fe591740 1 -- 172.21.15.81:0/996745547 shutdown_connections 2024-09-12T01:34:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56fe591740 1 --2- 172.21.15.81:0/996745547 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562cb0feeaa0 0x562cb0ff0ee0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56fe591740 1 --2- 172.21.15.81:0/996745547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562cb0f6f370 0x562cb0f73bd0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56fe591740 1 --2- 172.21.15.81:0/996745547 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562cb0f65b40 0x562cb0f73690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56fe591740 1 --2- 172.21.15.81:0/996745547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562cb0f645d0 0x562cb0f73150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56dd7fa640 0 client.16965 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56fe591740 1 -- 172.21.15.81:0/996745547 >> 172.21.15.81:0/996745547 conn(0x562cb0f2d310 msgr2=0x562cb0f6d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:29.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56fe591740 1 -- 172.21.15.81:0/996745547 shutdown_connections 2024-09-12T01:34:29.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56fe591740 1 -- 172.21.15.81:0/996745547 wait complete. 2024-09-12T01:34:29.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.580+0000 7f56fe591740 20 client.16965 trim_cache size 0 max 16384 2024-09-12T01:34:29.597 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:34:29.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.581+0000 7f56fc1b8640 1 -- 172.21.15.81:0/2641861316 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f56e00a2cf0 msgr2=0x7f56e00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:29.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.581+0000 7f56fc1b8640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f56e00a2cf0 0x7f56e00a51b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0bc8c0 tx=0x7f56ec087950 comp rx=0 tx=0).stop 2024-09-12T01:34:29.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.581+0000 7f56fc1b8640 1 -- 172.21.15.81:0/2641861316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f4102ef0 msgr2=0x7f56f419ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:29.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.581+0000 7f56fc1b8640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f4102ef0 0x7f56f419ce00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f56ec02ae70 tx=0x7f56ec02f5d0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.581+0000 7f56fc1b8640 1 -- 172.21.15.81:0/2641861316 shutdown_connections 2024-09-12T01:34:29.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.581+0000 7f56fc1b8640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f56e00a2cf0 0x7f56e00a51b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.581+0000 7f56fc1b8640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56f4102ef0 0x7f56f419ce00 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.581+0000 7f56fc1b8640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56f4102570 0x7f56f4198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.581+0000 7f56fc1b8640 1 --2- 172.21.15.81:0/2641861316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f4100e20 0x7f56f4198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:29.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.581+0000 7f56fc1b8640 1 -- 172.21.15.81:0/2641861316 >> 172.21.15.81:0/2641861316 conn(0x7f56f40fc7d0 msgr2=0x7f56f406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:29.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.581+0000 7f56fc1b8640 1 -- 172.21.15.81:0/2641861316 shutdown_connections 2024-09-12T01:34:29.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:29.581+0000 7f56fc1b8640 1 -- 172.21.15.81:0/2641861316 wait complete. 2024-09-12T01:34:29.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:29 smithi081 ceph-mon[30920]: pgmap v195: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:29.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:29 smithi100 ceph-mon[35275]: pgmap v195: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:29.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:29 smithi189 ceph-mon[35357]: pgmap v195: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:31.244 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:34:31.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:34:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:34:31.617 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:31 smithi081 ceph-mon[30920]: pgmap v196: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:34:31.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:31 smithi100 ceph-mon[35275]: pgmap v196: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:34:31.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:31 smithi189 ceph-mon[35357]: pgmap v196: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:34:31.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.994+0000 7f6d3205f640 1 -- 172.21.15.81:0/2433396910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2c102790 msgr2=0x7f6d2c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.994+0000 7f6d3205f640 1 --2- 172.21.15.81:0/2433396910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2c102790 0x7f6d2c1067e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009900 tx=0x7f6d1402a410 comp rx=0 tx=0).stop 2024-09-12T01:34:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.994+0000 7f6d3205f640 1 -- 172.21.15.81:0/2433396910 shutdown_connections 2024-09-12T01:34:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.994+0000 7f6d3205f640 1 --2- 172.21.15.81:0/2433396910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d2c106f10 0x7f6d2c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.994+0000 7f6d3205f640 1 --2- 172.21.15.81:0/2433396910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2c102790 0x7f6d2c1067e0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.994+0000 7f6d3205f640 1 --2- 172.21.15.81:0/2433396910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d2c101de0 0x7f6d2c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.994+0000 7f6d3205f640 1 -- 172.21.15.81:0/2433396910 >> 172.21.15.81:0/2433396910 conn(0x7f6d2c0fd880 msgr2=0x7f6d2c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.994+0000 7f6d3205f640 1 -- 172.21.15.81:0/2433396910 shutdown_connections 2024-09-12T01:34:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.994+0000 7f6d3205f640 1 -- 172.21.15.81:0/2433396910 wait complete. 2024-09-12T01:34:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d3205f640 1 Processor -- start 2024-09-12T01:34:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d3205f640 1 -- start start 2024-09-12T01:34:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d3205f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2c101de0 0x7f6d2c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:31.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d3205f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d2c102790 0x7f6d2c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d3205f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d2c106f10 0x7f6d2c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d3205f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c111f90 con 0x7f6d2c101de0 2024-09-12T01:34:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d3205f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c111e10 con 0x7f6d2c106f10 2024-09-12T01:34:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d3205f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c112110 con 0x7f6d2c102790 2024-09-12T01:34:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d2b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2c101de0 0x7f6d2c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d2b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2c101de0 0x7f6d2c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37122/0 (socket says 172.21.15.81:37122) 2024-09-12T01:34:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d2b7fe640 1 -- 172.21.15.81:0/4170697379 learned_addr learned my addr 172.21.15.81:0/4170697379 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d2bfff640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d2c106f10 0x7f6d2c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d23fff640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d2c102790 0x7f6d2c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d2b7fe640 1 -- 172.21.15.81:0/4170697379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d2c102790 msgr2=0x7f6d2c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d2b7fe640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d2c102790 0x7f6d2c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d2b7fe640 1 -- 172.21.15.81:0/4170697379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d2c106f10 msgr2=0x7f6d2c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:31.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d2b7fe640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d2c106f10 0x7f6d2c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.995+0000 7f6d2b7fe640 1 -- 172.21.15.81:0/4170697379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c19d420 con 0x7f6d2c101de0 2024-09-12T01:34:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.996+0000 7f6d2b7fe640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2c101de0 0x7f6d2c198470 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00c890 tx=0x7f6d1c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.996+0000 7f6d297fa640 1 -- 172.21.15.81:0/4170697379 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c004220 con 0x7f6d2c101de0 2024-09-12T01:34:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.996+0000 7f6d297fa640 1 -- 172.21.15.81:0/4170697379 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d1c0043c0 con 0x7f6d2c101de0 2024-09-12T01:34:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.996+0000 7f6d3205f640 1 -- 172.21.15.81:0/4170697379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2c19d710 con 0x7f6d2c101de0 2024-09-12T01:34:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.996+0000 7f6d297fa640 1 -- 172.21.15.81:0/4170697379 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0049e0 con 0x7f6d2c101de0 2024-09-12T01:34:31.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.996+0000 7f6d3205f640 1 -- 172.21.15.81:0/4170697379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d2c1a4ff0 con 0x7f6d2c101de0 2024-09-12T01:34:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.998+0000 7f6d297fa640 1 -- 172.21.15.81:0/4170697379 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6d1c0079b0 con 0x7f6d2c101de0 2024-09-12T01:34:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.998+0000 7f6d34438740 1 Processor -- start 2024-09-12T01:34:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d34438740 1 -- start start 2024-09-12T01:34:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d34438740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1a2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d34438740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a3340 0x55b2ab1b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d34438740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 0x55b2ab1b4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d34438740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b2ab108280 con 0x55b2ab1b2150 2024-09-12T01:34:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d34438740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b2ab0afb10 con 0x55b2ab1a2a20 2024-09-12T01:34:32.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d34438740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b2ab104240 con 0x55b2ab1a3340 2024-09-12T01:34:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d297fa640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6d180a2d70 0x7f6d180a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 0x55b2ab1b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 0x55b2ab1b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37134/0 (socket says 172.21.15.81:37134) 2024-09-12T01:34:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d23fff640 1 -- 172.21.15.81:0/1681044762 learned_addr learned my addr 172.21.15.81:0/1681044762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d2bfff640 1 --2- 172.21.15.81:0/1681044762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1a2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d2bfff640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6d180a2d70 0x7f6d180a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d297fa640 1 -- 172.21.15.81:0/4170697379 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f6d1c0cf400 con 0x7f6d2c101de0 2024-09-12T01:34:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d2b7fe640 1 --2- 172.21.15.81:0/1681044762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a3340 0x55b2ab1b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d23fff640 1 -- 172.21.15.81:0/1681044762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a3340 msgr2=0x55b2ab1b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d23fff640 1 --2- 172.21.15.81:0/1681044762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a3340 0x55b2ab1b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d23fff640 1 -- 172.21.15.81:0/1681044762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a2a20 msgr2=0x55b2ab1a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d23fff640 1 --2- 172.21.15.81:0/1681044762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1a2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:31.999+0000 7f6d23fff640 1 -- 172.21.15.81:0/1681044762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2ab0bc1f0 con 0x55b2ab1b2150 2024-09-12T01:34:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.000+0000 7f6d23fff640 1 --2- 172.21.15.81:0/1681044762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 0x55b2ab1b4540 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6d14005ab0 tx=0x7f6d14031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720523199675fc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.000+0000 7f6d2bfff640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6d180a2d70 0x7f6d180a5230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400bd50 tx=0x7f6d24009650 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.000+0000 7f6d21ffb640 1 -- 172.21.15.81:0/1681044762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1403f070 con 0x55b2ab1b2150 2024-09-12T01:34:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.000+0000 7f6d21ffb640 1 -- 172.21.15.81:0/1681044762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d14031a20 con 0x55b2ab1b2150 2024-09-12T01:34:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.000+0000 7f6d21ffb640 1 -- 172.21.15.81:0/1681044762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14035070 con 0x55b2ab1b2150 2024-09-12T01:34:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 -- 172.21.15.81:0/1681044762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 msgr2=0x55b2ab1b4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 --2- 172.21.15.81:0/1681044762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 0x55b2ab1b4540 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6d14005ab0 tx=0x7f6d14031630 comp rx=0 tx=0).stop 2024-09-12T01:34:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 -- 172.21.15.81:0/1681044762 shutdown_connections 2024-09-12T01:34:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 --2- 172.21.15.81:0/1681044762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 0x55b2ab1b4540 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 --2- 172.21.15.81:0/1681044762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a3340 0x55b2ab1b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 --2- 172.21.15.81:0/1681044762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1a2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 -- 172.21.15.81:0/1681044762 >> 172.21.15.81:0/1681044762 conn(0x55b2ab19f0f0 msgr2=0x55b2ab19f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 -- 172.21.15.81:0/1681044762 shutdown_connections 2024-09-12T01:34:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 -- 172.21.15.81:0/1681044762 wait complete. 2024-09-12T01:34:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 -- start start 2024-09-12T01:34:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 Processor -- start 2024-09-12T01:34:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1af050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a3340 0x55b2ab1af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.001+0000 7f6d34438740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1b2150 0x55b2ab1afad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d34438740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b2ab1b4cc0 con 0x55b2ab1a2a20 2024-09-12T01:34:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d34438740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b2ab0c2f10 con 0x55b2ab1b2150 2024-09-12T01:34:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d34438740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b2ab1b4e40 con 0x55b2ab1a3340 2024-09-12T01:34:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d34438740 10 client.0 _ll_register_callbacks cb 0x55b2ab08ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d2b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d2b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37140/0 (socket says 172.21.15.81:37140) 2024-09-12T01:34:32.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d2b7fe640 1 -- 172.21.15.81:0/509504112 learned_addr learned my addr 172.21.15.81:0/509504112 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d2bfff640 1 --2- 172.21.15.81:0/509504112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1b2150 0x55b2ab1afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d23fff640 1 --2- 172.21.15.81:0/509504112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a3340 0x55b2ab1af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d2b7fe640 1 -- 172.21.15.81:0/509504112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a3340 msgr2=0x55b2ab1af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d2b7fe640 1 --2- 172.21.15.81:0/509504112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a3340 0x55b2ab1af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d2b7fe640 1 -- 172.21.15.81:0/509504112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1b2150 msgr2=0x55b2ab1afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d2b7fe640 1 --2- 172.21.15.81:0/509504112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1b2150 0x55b2ab1afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d2b7fe640 1 -- 172.21.15.81:0/509504112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2aae796a0 con 0x55b2ab1a2a20 2024-09-12T01:34:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d2b7fe640 1 --2- 172.21.15.81:0/509504112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1af050 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c005840 tx=0x7f6d1c09b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739f6c00005af6d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d0affd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d0affd640 1 -- 172.21.15.81:0/509504112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0b4060 con 0x55b2ab1a2a20 2024-09-12T01:34:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d0affd640 1 -- 172.21.15.81:0/509504112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f6d1c0a4130 con 0x55b2ab1a2a20 2024-09-12T01:34:32.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d34438740 1 -- 172.21.15.81:0/509504112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d14031a20 con 0x55b2ab1a2a20 2024-09-12T01:34:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d0affd640 1 -- 172.21.15.81:0/509504112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d1c01d040 con 0x55b2ab1a2a20 2024-09-12T01:34:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d34438740 10 client.16977 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.002+0000 7f6d34438740 1 -- 172.21.15.81:0/509504112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b2ab1c0990 con 0x55b2ab1a2a20 2024-09-12T01:34:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.003+0000 7f6d0affd640 1 -- 172.21.15.81:0/509504112 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d14031a20 con 0x55b2ab1a2a20 2024-09-12T01:34:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.003+0000 7f6d0affd640 1 -- 172.21.15.81:0/509504112 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6d1c0ba170 con 0x55b2ab1a2a20 2024-09-12T01:34:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.003+0000 7f6d34438740 10 client.16977 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.003+0000 7f6d34438740 10 client.16977 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:34:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.003+0000 7f6d34438740 20 client.16977 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.003+0000 7f6d34438740 1 --2- 172.21.15.81:0/509504112 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b2ab1c1da0 0x55b2ab1c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.003+0000 7f6d34438740 4 client.16977 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:34:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.003+0000 7f6d34438740 1 -- 172.21.15.81:0/509504112 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2ab1157f0 con 0x55b2ab1c1da0 2024-09-12T01:34:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.003+0000 7f6d23fff640 1 --2- 172.21.15.81:0/509504112 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b2ab1c1da0 0x55b2ab1c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.004+0000 7f6d0affd640 10 client.16977 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:32.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.004+0000 7f6d23fff640 1 --2- 172.21.15.81:0/509504112 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b2ab1c1da0 0x55b2ab1c41f0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88bfbbd8248e2c40 server_cookie=6d1a208ae8364156 in_seq=0 out_seq=0 2024-09-12T01:34:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.004+0000 7f6d0affd640 1 -- 172.21.15.81:0/509504112 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2ab1157f0 con 0x55b2ab1c1da0 2024-09-12T01:34:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.004+0000 7f6d0affd640 10 client.16977 handle_command_reply: tid=0 2024-09-12T01:34:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.004+0000 7f6d34438740 1 client.16977 shutdown 2024-09-12T01:34:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.005+0000 7f6d34438740 1 -- 172.21.15.81:0/509504112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a2a20 msgr2=0x55b2ab1af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.005+0000 7f6d34438740 1 --2- 172.21.15.81:0/509504112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1af050 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c005840 tx=0x7f6d1c09b510 comp rx=0 tx=0).stop 2024-09-12T01:34:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.005+0000 7f6d34438740 1 -- 172.21.15.81:0/509504112 shutdown_connections 2024-09-12T01:34:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.005+0000 7f6d34438740 1 --2- 172.21.15.81:0/509504112 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b2ab1c1da0 0x55b2ab1c41f0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.005+0000 7f6d34438740 1 --2- 172.21.15.81:0/509504112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1b2150 0x55b2ab1afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.005+0000 7f6d34438740 1 --2- 172.21.15.81:0/509504112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a3340 0x55b2ab1af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.005+0000 7f6d0affd640 0 client.16977 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.005+0000 7f6d34438740 1 --2- 172.21.15.81:0/509504112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1af050 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.005+0000 7f6d34438740 1 -- 172.21.15.81:0/509504112 >> 172.21.15.81:0/509504112 conn(0x55b2ab19f0f0 msgr2=0x55b2ab1a4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.005+0000 7f6d34438740 1 -- 172.21.15.81:0/509504112 shutdown_connections 2024-09-12T01:34:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.005+0000 7f6d34438740 1 -- 172.21.15.81:0/509504112 wait complete. 2024-09-12T01:34:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.005+0000 7f6d34438740 20 client.16977 trim_cache size 0 max 16384 2024-09-12T01:34:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d34438740 1 Processor -- start 2024-09-12T01:34:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d34438740 1 -- start start 2024-09-12T01:34:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d34438740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d34438740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a3340 0x55b2ab1c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d34438740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1b2150 0x55b2ab1ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d34438740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1ab5a0 con 0x55b2ab1a3340 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d34438740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1ad0e0 con 0x55b2ab1a2a20 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d34438740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1abc70 con 0x55b2ab1b2150 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a3340 0x55b2ab1c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a3340 0x55b2ab1c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37156/0 (socket says 172.21.15.81:37156) 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d23fff640 1 -- 172.21.15.81:0/2155594765 learned_addr learned my addr 172.21.15.81:0/2155594765 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d2b7fe640 1 --2- 172.21.15.81:0/2155594765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d23fff640 1 -- 172.21.15.81:0/2155594765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1b2150 msgr2=0x55b2ab1ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d23fff640 1 --2- 172.21.15.81:0/2155594765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1b2150 0x55b2ab1ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d23fff640 1 -- 172.21.15.81:0/2155594765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a2a20 msgr2=0x55b2ab1ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d23fff640 1 --2- 172.21.15.81:0/2155594765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d23fff640 1 -- 172.21.15.81:0/2155594765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2ab1ad5a0 con 0x55b2ab1a3340 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d2b7fe640 1 --2- 172.21.15.81:0/2155594765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:34:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.022+0000 7f6d23fff640 1 --2- 172.21.15.81:0/2155594765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a3340 0x55b2ab1c9ac0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6d140096c0 tx=0x7f6d14005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d9f24c19fd9504 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.023+0000 7f6d217fa640 1 -- 172.21.15.81:0/2155594765 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14035040 con 0x55b2ab1a3340 2024-09-12T01:34:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.023+0000 7f6d217fa640 1 -- 172.21.15.81:0/2155594765 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d1403b650 con 0x55b2ab1a3340 2024-09-12T01:34:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.023+0000 7f6d217fa640 1 -- 172.21.15.81:0/2155594765 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1403f040 con 0x55b2ab1a3340 2024-09-12T01:34:32.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.023+0000 7f6d34438740 1 -- 172.21.15.81:0/2155594765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a3340 msgr2=0x55b2ab1c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:32.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.023+0000 7f6d34438740 1 --2- 172.21.15.81:0/2155594765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a3340 0x55b2ab1c9ac0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6d140096c0 tx=0x7f6d14005660 comp rx=0 tx=0).stop 2024-09-12T01:34:32.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.023+0000 7f6d34438740 1 -- 172.21.15.81:0/2155594765 shutdown_connections 2024-09-12T01:34:32.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.023+0000 7f6d34438740 1 --2- 172.21.15.81:0/2155594765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1b2150 0x55b2ab1ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.023+0000 7f6d34438740 1 --2- 172.21.15.81:0/2155594765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1a3340 0x55b2ab1c9ac0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.023+0000 7f6d34438740 1 --2- 172.21.15.81:0/2155594765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.023+0000 7f6d34438740 1 -- 172.21.15.81:0/2155594765 >> 172.21.15.81:0/2155594765 conn(0x55b2ab19f0f0 msgr2=0x55b2ab1a4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.023+0000 7f6d34438740 1 -- 172.21.15.81:0/2155594765 shutdown_connections 2024-09-12T01:34:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.023+0000 7f6d34438740 1 -- 172.21.15.81:0/2155594765 wait complete. 2024-09-12T01:34:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d34438740 1 -- start start 2024-09-12T01:34:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d34438740 1 Processor -- start 2024-09-12T01:34:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d34438740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d34438740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a3340 0x55b2ab1b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d34438740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 0x55b2ab1b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d34438740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1aca10 con 0x55b2ab1b2150 2024-09-12T01:34:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d34438740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1ac340 con 0x55b2ab1a3340 2024-09-12T01:34:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d34438740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c1a9580 con 0x55b2ab1a2a20 2024-09-12T01:34:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d34438740 10 client.0 _ll_register_callbacks cb 0x7f6d1c0058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d2bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 0x55b2ab1b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d2bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 0x55b2ab1b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37168/0 (socket says 172.21.15.81:37168) 2024-09-12T01:34:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d2b7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d2bfff640 1 -- 172.21.15.81:0/3571127805 learned_addr learned my addr 172.21.15.81:0/3571127805 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.024+0000 7f6d23fff640 1 --2- 172.21.15.81:0/3571127805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a3340 0x55b2ab1b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d2bfff640 1 -- 172.21.15.81:0/3571127805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a2a20 msgr2=0x55b2ab1b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d2bfff640 1 --2- 172.21.15.81:0/3571127805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d2bfff640 1 -- 172.21.15.81:0/3571127805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a3340 msgr2=0x55b2ab1b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d2bfff640 1 --2- 172.21.15.81:0/3571127805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a3340 0x55b2ab1b64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d2bfff640 1 -- 172.21.15.81:0/3571127805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2ab22bc00 con 0x55b2ab1b2150 2024-09-12T01:34:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d2bfff640 1 --2- 172.21.15.81:0/3571127805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 0x55b2ab1b6a10 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6d24017e20 tx=0x7f6d24009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc4cd82660e8491 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d0affd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d0affd640 1 -- 172.21.15.81:0/3571127805 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24014040 con 0x55b2ab1b2150 2024-09-12T01:34:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d34438740 1 -- 172.21.15.81:0/3571127805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d1403b650 con 0x55b2ab1b2150 2024-09-12T01:34:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d0affd640 1 -- 172.21.15.81:0/3571127805 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f6d24026660 con 0x55b2ab1b2150 2024-09-12T01:34:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d0affd640 1 -- 172.21.15.81:0/3571127805 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d24026860 con 0x55b2ab1b2150 2024-09-12T01:34:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d34438740 10 client.16983 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d34438740 1 -- 172.21.15.81:0/3571127805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b2ab22ce70 con 0x55b2ab1b2150 2024-09-12T01:34:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.025+0000 7f6d0affd640 1 -- 172.21.15.81:0/3571127805 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d1403b650 con 0x55b2ab1b2150 2024-09-12T01:34:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.026+0000 7f6d0affd640 1 -- 172.21.15.81:0/3571127805 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6d24030a10 con 0x55b2ab1b2150 2024-09-12T01:34:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.026+0000 7f6d34438740 10 client.16983 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.026+0000 7f6d34438740 10 client.16983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:34:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.026+0000 7f6d34438740 20 client.16983 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.026+0000 7f6d34438740 1 --2- 172.21.15.81:0/3571127805 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b2ab22d640 0x55b2ab22fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.026+0000 7f6d34438740 4 client.16983 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.026+0000 7f6d34438740 1 -- 172.21.15.81:0/3571127805 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b2ab10fd00 con 0x55b2ab22d640 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.026+0000 7f6d2b7fe640 1 --2- 172.21.15.81:0/3571127805 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b2ab22d640 0x55b2ab22fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.026+0000 7f6d2b7fe640 1 --2- 172.21.15.81:0/3571127805 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b2ab22d640 0x55b2ab22fa60 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6b3c1c48c20fd05 server_cookie=9fbf700c23af3885 in_seq=0 out_seq=0 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.026+0000 7f6d0affd640 10 client.16983 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.027+0000 7f6d0affd640 1 -- 172.21.15.81:0/3571127805 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b2ab10fd00 con 0x55b2ab22d640 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.027+0000 7f6d0affd640 10 client.16983 handle_command_reply: tid=0 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.027+0000 7f6d34438740 1 client.16983 shutdown 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.027+0000 7f6d34438740 1 -- 172.21.15.81:0/3571127805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 msgr2=0x55b2ab1b6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.027+0000 7f6d34438740 1 --2- 172.21.15.81:0/3571127805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 0x55b2ab1b6a10 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6d24017e20 tx=0x7f6d24009bb0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.027+0000 7f6d34438740 1 -- 172.21.15.81:0/3571127805 shutdown_connections 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.027+0000 7f6d34438740 1 --2- 172.21.15.81:0/3571127805 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55b2ab22d640 0x55b2ab22fa60 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d34438740 1 --2- 172.21.15.81:0/3571127805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2ab1b2150 0x55b2ab1b6a10 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d34438740 1 --2- 172.21.15.81:0/3571127805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2ab1a3340 0x55b2ab1b64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d34438740 1 --2- 172.21.15.81:0/3571127805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2ab1a2a20 0x55b2ab1b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d34438740 1 -- 172.21.15.81:0/3571127805 >> 172.21.15.81:0/3571127805 conn(0x55b2ab19f0f0 msgr2=0x55b2ab1af800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:32.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d0affd640 0 client.16983 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:32.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d34438740 1 -- 172.21.15.81:0/3571127805 shutdown_connections 2024-09-12T01:34:32.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d34438740 1 -- 172.21.15.81:0/3571127805 wait complete. 2024-09-12T01:34:32.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d34438740 20 client.16983 trim_cache size 0 max 16384 2024-09-12T01:34:32.033 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:34:32.033 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:34:32.033 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "21a6e639-f530-40ab-8548-9ee72e8c27d1", 2024-09-12T01:34:32.033 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:34:32.033 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:34:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d3205f640 1 -- 172.21.15.81:0/4170697379 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6d180a2d70 msgr2=0x7f6d180a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d3205f640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6d180a2d70 0x7f6d180a5230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400bd50 tx=0x7f6d24009650 comp rx=0 tx=0).stop 2024-09-12T01:34:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d3205f640 1 -- 172.21.15.81:0/4170697379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2c101de0 msgr2=0x7f6d2c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d3205f640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2c101de0 0x7f6d2c198470 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00c890 tx=0x7f6d1c00cd50 comp rx=0 tx=0).stop 2024-09-12T01:34:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d3205f640 1 -- 172.21.15.81:0/4170697379 shutdown_connections 2024-09-12T01:34:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d3205f640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6d180a2d70 0x7f6d180a5230 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d3205f640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d2c106f10 0x7f6d2c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d3205f640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d2c102790 0x7f6d2c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d3205f640 1 --2- 172.21.15.81:0/4170697379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2c101de0 0x7f6d2c198470 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.028+0000 7f6d3205f640 1 -- 172.21.15.81:0/4170697379 >> 172.21.15.81:0/4170697379 conn(0x7f6d2c0fd880 msgr2=0x7f6d2c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.029+0000 7f6d3205f640 1 -- 172.21.15.81:0/4170697379 shutdown_connections 2024-09-12T01:34:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:32.029+0000 7f6d3205f640 1 -- 172.21.15.81:0/4170697379 wait complete. 2024-09-12T01:34:32.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:34:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:34:33.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.432+0000 7fe0f474a640 1 -- 172.21.15.81:0/3582393868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec100b20 msgr2=0x7fe0ec100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:33.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.432+0000 7fe0f474a640 1 --2- 172.21.15.81:0/3582393868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec100b20 0x7fe0ec100f00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009ca0 tx=0x7fe0dc02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 -- 172.21.15.81:0/3582393868 shutdown_connections 2024-09-12T01:34:33.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 --2- 172.21.15.81:0/3582393868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0ec10e500 0x7fe0ec110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 --2- 172.21.15.81:0/3582393868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0ec101440 0x7fe0ec10df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 --2- 172.21.15.81:0/3582393868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec100b20 0x7fe0ec100f00 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 -- 172.21.15.81:0/3582393868 >> 172.21.15.81:0/3582393868 conn(0x7fe0ec0fc7d0 msgr2=0x7fe0ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:33.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 -- 172.21.15.81:0/3582393868 shutdown_connections 2024-09-12T01:34:33.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 -- 172.21.15.81:0/3582393868 wait complete. 2024-09-12T01:34:33.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 Processor -- start 2024-09-12T01:34:33.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 -- start start 2024-09-12T01:34:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0ec100b20 0x7fe0ec1a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0ec101440 0x7fe0ec1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec10e500 0x7fe0ec19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec114370 con 0x7fe0ec10e500 2024-09-12T01:34:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1141f0 con 0x7fe0ec100b20 2024-09-12T01:34:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f474a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1144f0 con 0x7fe0ec101440 2024-09-12T01:34:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.433+0000 7fe0f2ce7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec10e500 0x7fe0ec19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0f2ce7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec10e500 0x7fe0ec19a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40598/0 (socket says 172.21.15.81:40598) 2024-09-12T01:34:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0f2ce7640 1 -- 172.21.15.81:0/3849122785 learned_addr learned my addr 172.21.15.81:0/3849122785 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0f24e6640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0ec100b20 0x7fe0ec1a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0f2ce7640 1 -- 172.21.15.81:0/3849122785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0ec101440 msgr2=0x7fe0ec1a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0f2ce7640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0ec101440 0x7fe0ec1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0f2ce7640 1 -- 172.21.15.81:0/3849122785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0ec100b20 msgr2=0x7fe0ec1a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0f2ce7640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0ec100b20 0x7fe0ec1a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0f2ce7640 1 -- 172.21.15.81:0/3849122785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec19af90 con 0x7fe0ec10e500 2024-09-12T01:34:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0f24e6640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0ec100b20 0x7fe0ec1a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:34:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0f2ce7640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec10e500 0x7fe0ec19a720 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400b3f0 tx=0x7fe0e400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0eb7fe640 1 -- 172.21.15.81:0/3849122785 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4015020 con 0x7fe0ec10e500 2024-09-12T01:34:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0f474a640 1 -- 172.21.15.81:0/3849122785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ec19b280 con 0x7fe0ec10e500 2024-09-12T01:34:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0eb7fe640 1 -- 172.21.15.81:0/3849122785 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0e4011d10 con 0x7fe0ec10e500 2024-09-12T01:34:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0eb7fe640 1 -- 172.21.15.81:0/3849122785 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400f2e0 con 0x7fe0ec10e500 2024-09-12T01:34:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.434+0000 7fe0f474a640 1 -- 172.21.15.81:0/3849122785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ec1a7400 con 0x7fe0ec10e500 2024-09-12T01:34:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.437+0000 7fe0eb7fe640 1 -- 172.21.15.81:0/3849122785 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fe0e4018020 con 0x7fe0ec10e500 2024-09-12T01:34:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.437+0000 7fe0f6b23740 1 Processor -- start 2024-09-12T01:34:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.437+0000 7fe0f6b23740 1 -- start start 2024-09-12T01:34:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.437+0000 7fe0f6b23740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb484a0 0x55c9cbb48880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.437+0000 7fe0f6b23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb53140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.437+0000 7fe0f6b23740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 0x55c9cbb55a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.437+0000 7fe0f6b23740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c9cbaae2e0 con 0x55c9cbb53680 2024-09-12T01:34:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.437+0000 7fe0f6b23740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c9cba55ce0 con 0x55c9cbb484a0 2024-09-12T01:34:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.437+0000 7fe0f6b23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c9cbaaa2a0 con 0x55c9cbb48dc0 2024-09-12T01:34:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.437+0000 7fe0f1ce5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 0x55c9cbb55a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0f1ce5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 0x55c9cbb55a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40600/0 (socket says 172.21.15.81:40600) 2024-09-12T01:34:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/3625909163 learned_addr learned my addr 172.21.15.81:0/3625909163 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0f24e6640 1 --2- 172.21.15.81:0/3625909163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb53140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/3625909163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb484a0 0x55c9cbb48880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0eb7fe640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe0d40a2cf0 0x7fe0d40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0f2ce7640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe0d40a2cf0 0x7fe0d40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/3625909163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 msgr2=0x55c9cbb53140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/3625909163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb53140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/3625909163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb484a0 msgr2=0x55c9cbb48880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/3625909163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb484a0 0x55c9cbb48880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/3625909163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9cba3a440 con 0x55c9cbb53680 2024-09-12T01:34:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0eb7fe640 1 -- 172.21.15.81:0/3849122785 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe0e40cec50 con 0x7fe0ec10e500 2024-09-12T01:34:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/3625909163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 0x55c9cbb55a70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0001b50 tx=0x7fe0e0009d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8215a78eaf02abab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0e8ff9640 1 -- 172.21.15.81:0/3625909163 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0010af0 con 0x55c9cbb53680 2024-09-12T01:34:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0e8ff9640 1 -- 172.21.15.81:0/3625909163 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0e00075d0 con 0x55c9cbb53680 2024-09-12T01:34:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0e8ff9640 1 -- 172.21.15.81:0/3625909163 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00049b0 con 0x55c9cbb53680 2024-09-12T01:34:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.438+0000 7fe0f2ce7640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe0d40a2cf0 0x7fe0d40a51b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe0e409afb0 tx=0x7fe0e40bb040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.439+0000 7fe0f6b23740 1 -- 172.21.15.81:0/3625909163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 msgr2=0x55c9cbb55a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.439+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/3625909163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 0x55c9cbb55a70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0001b50 tx=0x7fe0e0009d80 comp rx=0 tx=0).stop 2024-09-12T01:34:33.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.439+0000 7fe0f6b23740 1 -- 172.21.15.81:0/3625909163 shutdown_connections 2024-09-12T01:34:33.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.439+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/3625909163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 0x55c9cbb55a70 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.439+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/3625909163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb53140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.439+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/3625909163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb484a0 0x55c9cbb48880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.439+0000 7fe0f6b23740 1 -- 172.21.15.81:0/3625909163 >> 172.21.15.81:0/3625909163 conn(0x55c9cbb44a30 msgr2=0x55c9cbb44e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:33.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.439+0000 7fe0f6b23740 1 -- 172.21.15.81:0/3625909163 shutdown_connections 2024-09-12T01:34:33.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.439+0000 7fe0f6b23740 1 -- 172.21.15.81:0/3625909163 wait complete. 2024-09-12T01:34:33.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f6b23740 1 -- start start 2024-09-12T01:34:33.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f6b23740 1 Processor -- start 2024-09-12T01:34:33.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f6b23740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb484a0 0x55c9cbb530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f6b23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb50350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f6b23740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 0x55c9cbb50960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f6b23740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c9cbb56250 con 0x55c9cbb53680 2024-09-12T01:34:33.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f6b23740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c9cba69050 con 0x55c9cbb484a0 2024-09-12T01:34:33.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f6b23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c9cbb563d0 con 0x55c9cbb48dc0 2024-09-12T01:34:33.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f6b23740 10 client.0 _ll_register_callbacks cb 0x55c9cbaa9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:33.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f1ce5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 0x55c9cbb50960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f1ce5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 0x55c9cbb50960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40608/0 (socket says 172.21.15.81:40608) 2024-09-12T01:34:33.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/1771472836 learned_addr learned my addr 172.21.15.81:0/1771472836 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:33.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/1771472836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb484a0 0x55c9cbb530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/1771472836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 msgr2=0x55c9cbb50350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:33.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/1771472836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb50350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/1771472836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb484a0 msgr2=0x55c9cbb530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:33.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/1771472836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb484a0 0x55c9cbb530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/1771472836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9cb81f3c0 con 0x55c9cbb53680 2024-09-12T01:34:33.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/1771472836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 0x55c9cbb50960 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0007570 tx=0x7fe0e0008c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d384f20dac4e49db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:33.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.440+0000 7fe0d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:33.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0d1ffb640 1 -- 172.21.15.81:0/1771472836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0004220 con 0x55c9cbb53680 2024-09-12T01:34:33.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0d1ffb640 1 -- 172.21.15.81:0/1771472836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe0e00043c0 con 0x55c9cbb53680 2024-09-12T01:34:33.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0f6b23740 1 -- 172.21.15.81:0/1771472836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0e00075d0 con 0x55c9cbb53680 2024-09-12T01:34:33.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0d1ffb640 1 -- 172.21.15.81:0/1771472836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0e0004750 con 0x55c9cbb53680 2024-09-12T01:34:33.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0f6b23740 10 client.16995 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:33.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0f6b23740 1 -- 172.21.15.81:0/1771472836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c9cbb61d10 con 0x55c9cbb53680 2024-09-12T01:34:33.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0d1ffb640 1 -- 172.21.15.81:0/1771472836 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0e00075d0 con 0x55c9cbb53680 2024-09-12T01:34:33.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0d1ffb640 1 -- 172.21.15.81:0/1771472836 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe0e0003c60 con 0x55c9cbb53680 2024-09-12T01:34:33.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0f6b23740 10 client.16995 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:33.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0f6b23740 10 client.16995 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:34:33.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0f6b23740 20 client.16995 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:33.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/1771472836 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c9cbb63060 0x55c9cbb65450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0f6b23740 4 client.16995 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:34:33.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.441+0000 7fe0f6b23740 1 -- 172.21.15.81:0/1771472836 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9cbabb850 con 0x55c9cbb63060 2024-09-12T01:34:33.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.442+0000 7fe0f24e6640 1 --2- 172.21.15.81:0/1771472836 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c9cbb63060 0x55c9cbb65450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.442+0000 7fe0f24e6640 1 --2- 172.21.15.81:0/1771472836 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c9cbb63060 0x55c9cbb65450 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb643aa4d4ff2649 server_cookie=1cb58d0633a5767b in_seq=0 out_seq=0 2024-09-12T01:34:33.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.442+0000 7fe0d1ffb640 10 client.16995 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:33.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0d1ffb640 1 -- 172.21.15.81:0/1771472836 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c9cbabb850 con 0x55c9cbb63060 2024-09-12T01:34:33.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0d1ffb640 10 client.16995 handle_command_reply: tid=0 2024-09-12T01:34:33.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0f6b23740 1 client.16995 shutdown 2024-09-12T01:34:33.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0f6b23740 1 -- 172.21.15.81:0/1771472836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 msgr2=0x55c9cbb50960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:33.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/1771472836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 0x55c9cbb50960 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0007570 tx=0x7fe0e0008c90 comp rx=0 tx=0).stop 2024-09-12T01:34:33.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0f6b23740 1 -- 172.21.15.81:0/1771472836 shutdown_connections 2024-09-12T01:34:33.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/1771472836 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c9cbb63060 0x55c9cbb65450 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/1771472836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb53680 0x55c9cbb50960 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/1771472836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb50350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/1771472836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb484a0 0x55c9cbb530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0f6b23740 1 -- 172.21.15.81:0/1771472836 >> 172.21.15.81:0/1771472836 conn(0x55c9cbb44a30 msgr2=0x55c9cbb4a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0d1ffb640 0 client.16995 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0f6b23740 1 -- 172.21.15.81:0/1771472836 shutdown_connections 2024-09-12T01:34:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0f6b23740 1 -- 172.21.15.81:0/1771472836 wait complete. 2024-09-12T01:34:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.443+0000 7fe0f6b23740 20 client.16995 trim_cache size 0 max 16384 2024-09-12T01:34:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.459+0000 7fe0f6b23740 1 Processor -- start 2024-09-12T01:34:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.459+0000 7fe0f6b23740 1 -- start start 2024-09-12T01:34:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f6b23740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 0x55c9cbb52680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f6b23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb5f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f6b23740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb53680 0x55c9cbb6aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f6b23740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1afbb0 con 0x55c9cbb484a0 2024-09-12T01:34:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f6b23740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b16f0 con 0x55c9cbb53680 2024-09-12T01:34:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f6b23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b0280 con 0x55c9cbb48dc0 2024-09-12T01:34:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f1ce5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 0x55c9cbb52680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f1ce5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 0x55c9cbb52680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40616/0 (socket says 172.21.15.81:40616) 2024-09-12T01:34:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/1538225373 learned_addr learned my addr 172.21.15.81:0/1538225373 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/1538225373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 msgr2=0x55c9cbb5f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f24e6640 1 --2- 172.21.15.81:0/1538225373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb5f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/1538225373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb5f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/1538225373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb53680 msgr2=0x55c9cbb6aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/1538225373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb53680 0x55c9cbb6aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/1538225373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9cbb53410 con 0x55c9cbb484a0 2024-09-12T01:34:33.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f24e6640 1 --2- 172.21.15.81:0/1538225373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb5f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:34:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/1538225373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 0x55c9cbb52680 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0000c00 tx=0x7fe0e00109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c04827f883b9bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0d3fff640 1 -- 172.21.15.81:0/1538225373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0008d00 con 0x55c9cbb484a0 2024-09-12T01:34:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0d3fff640 1 -- 172.21.15.81:0/1538225373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0e0001280 con 0x55c9cbb484a0 2024-09-12T01:34:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.460+0000 7fe0d3fff640 1 -- 172.21.15.81:0/1538225373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0004280 con 0x55c9cbb484a0 2024-09-12T01:34:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.461+0000 7fe0f6b23740 1 -- 172.21.15.81:0/1538225373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 msgr2=0x55c9cbb52680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.461+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/1538225373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 0x55c9cbb52680 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0000c00 tx=0x7fe0e00109c0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.461+0000 7fe0f6b23740 1 -- 172.21.15.81:0/1538225373 shutdown_connections 2024-09-12T01:34:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.461+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/1538225373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb53680 0x55c9cbb6aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.461+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/1538225373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb5f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.461+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/1538225373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 0x55c9cbb52680 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.461+0000 7fe0f6b23740 1 -- 172.21.15.81:0/1538225373 >> 172.21.15.81:0/1538225373 conn(0x55c9cbb44a30 msgr2=0x55c9cbb43b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.461+0000 7fe0f6b23740 1 -- 172.21.15.81:0/1538225373 shutdown_connections 2024-09-12T01:34:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.461+0000 7fe0f6b23740 1 -- 172.21.15.81:0/1538225373 wait complete. 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.461+0000 7fe0f6b23740 1 -- start start 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.461+0000 7fe0f6b23740 1 Processor -- start 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f6b23740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 0x55c9cbb5bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f6b23740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb57000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f6b23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb53680 0x55c9cbb57540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f6b23740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b1020 con 0x55c9cbb484a0 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f6b23740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b0950 con 0x55c9cbb48dc0 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f6b23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1adb90 con 0x55c9cbb53680 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f6b23740 10 client.0 _ll_register_callbacks cb 0x7fe0dc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f1ce5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 0x55c9cbb5bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f1ce5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 0x55c9cbb5bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40622/0 (socket says 172.21.15.81:40622) 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/515740399 learned_addr learned my addr 172.21.15.81:0/515740399 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f24e6640 1 --2- 172.21.15.81:0/515740399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb57000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/515740399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb53680 msgr2=0x55c9cbb57540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/515740399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb53680 0x55c9cbb57540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/515740399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb48dc0 msgr2=0x55c9cbb57000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:34:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/515740399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb57000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f1ce5640 1 -- 172.21.15.81:0/515740399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9cbb57d70 con 0x55c9cbb484a0 2024-09-12T01:34:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f1ce5640 1 --2- 172.21.15.81:0/515740399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 0x55c9cbb5bcd0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0004ca0 tx=0x7fe0e00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b48f6d3f99ebe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:34:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0d1ffb640 1 -- 172.21.15.81:0/515740399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0001030 con 0x55c9cbb484a0 2024-09-12T01:34:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0d1ffb640 1 -- 172.21.15.81:0/515740399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fe0e00048f0 con 0x55c9cbb484a0 2024-09-12T01:34:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f6b23740 1 -- 172.21.15.81:0/515740399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0e0001280 con 0x55c9cbb484a0 2024-09-12T01:34:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0d1ffb640 1 -- 172.21.15.81:0/515740399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0e0009330 con 0x55c9cbb484a0 2024-09-12T01:34:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f6b23740 10 client.17001 fetch_fsmap learned FSMap version 28 2024-09-12T01:34:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.462+0000 7fe0f6b23740 1 -- 172.21.15.81:0/515740399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c9cbbcd910 con 0x55c9cbb484a0 2024-09-12T01:34:33.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.463+0000 7fe0d1ffb640 1 -- 172.21.15.81:0/515740399 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0e0001280 con 0x55c9cbb484a0 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.463+0000 7fe0d1ffb640 1 -- 172.21.15.81:0/515740399 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe0e0003c60 con 0x55c9cbb484a0 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.463+0000 7fe0f6b23740 10 client.17001 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.463+0000 7fe0f6b23740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.463+0000 7fe0f6b23740 20 client.17001 populate_metadata read hostname 'smithi081' 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.463+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/515740399 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c9cbbcdec0 0x55c9cbbd02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.463+0000 7fe0f6b23740 4 client.17001 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.463+0000 7fe0f6b23740 1 -- 172.21.15.81:0/515740399 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c9cbab5d60 con 0x55c9cbbcdec0 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.463+0000 7fe0f24e6640 1 --2- 172.21.15.81:0/515740399 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c9cbbcdec0 0x55c9cbbd02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0d1ffb640 10 client.17001 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0f24e6640 1 --2- 172.21.15.81:0/515740399 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c9cbbcdec0 0x55c9cbbd02b0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9cc8e0b61d4c431 server_cookie=16579b07c9a840e2 in_seq=0 out_seq=0 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0d1ffb640 1 -- 172.21.15.81:0/515740399 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c9cbab5d60 con 0x55c9cbbcdec0 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0d1ffb640 10 client.17001 handle_command_reply: tid=0 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0f6b23740 1 client.17001 shutdown 2024-09-12T01:34:33.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0f6b23740 1 -- 172.21.15.81:0/515740399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 msgr2=0x55c9cbb5bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:33.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/515740399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 0x55c9cbb5bcd0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0004ca0 tx=0x7fe0e00014a0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.485 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:34:33.485 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:34:33.485 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-12T01:34:33.485 INFO:teuthology.orchestra.run.smithi081.stdout: "21a6e639-f530-40ab-8548-9ee72e8c27d1": { 2024-09-12T01:34:33.485 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-09-12T01:34:33.485 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "21a6e639-f530-40ab-8548-9ee72e8c27d1", 2024-09-12T01:34:33.485 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-12T01:34:33.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:34:33.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:34:33.486 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:34:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0f6b23740 1 -- 172.21.15.81:0/515740399 shutdown_connections 2024-09-12T01:34:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/515740399 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c9cbbcdec0 0x55c9cbbd02b0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/515740399 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c9cbb53680 0x55c9cbb57540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/515740399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9cbb48dc0 0x55c9cbb57000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0d1ffb640 0 client.17001 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:34:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0f6b23740 1 --2- 172.21.15.81:0/515740399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cbb484a0 0x55c9cbb5bcd0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0f6b23740 1 -- 172.21.15.81:0/515740399 >> 172.21.15.81:0/515740399 conn(0x55c9cbb44a30 msgr2=0x55c9cbb4eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0f6b23740 1 -- 172.21.15.81:0/515740399 shutdown_connections 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0f6b23740 1 -- 172.21.15.81:0/515740399 wait complete. 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.464+0000 7fe0f6b23740 20 client.17001 trim_cache size 0 max 16384 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.465+0000 7fe0f474a640 1 -- 172.21.15.81:0/3849122785 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe0d40a2cf0 msgr2=0x7fe0d40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.465+0000 7fe0f474a640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe0d40a2cf0 0x7fe0d40a51b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe0e409afb0 tx=0x7fe0e40bb040 comp rx=0 tx=0).stop 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.465+0000 7fe0f474a640 1 -- 172.21.15.81:0/3849122785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec10e500 msgr2=0x7fe0ec19a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.465+0000 7fe0f474a640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec10e500 0x7fe0ec19a720 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400b3f0 tx=0x7fe0e400b8b0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.465+0000 7fe0f474a640 1 -- 172.21.15.81:0/3849122785 shutdown_connections 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.465+0000 7fe0f474a640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe0d40a2cf0 0x7fe0d40a51b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.465+0000 7fe0f474a640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0ec10e500 0x7fe0ec19a720 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.465+0000 7fe0f474a640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0ec101440 0x7fe0ec1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.465+0000 7fe0f474a640 1 --2- 172.21.15.81:0/3849122785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0ec100b20 0x7fe0ec1a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.465+0000 7fe0f474a640 1 -- 172.21.15.81:0/3849122785 >> 172.21.15.81:0/3849122785 conn(0x7fe0ec0fc7d0 msgr2=0x7fe0ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.465+0000 7fe0f474a640 1 -- 172.21.15.81:0/3849122785 shutdown_connections 2024-09-12T01:34:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:34:33.465+0000 7fe0f474a640 1 -- 172.21.15.81:0/3849122785 wait complete. 2024-09-12T01:34:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:33 smithi081 ceph-mon[30920]: pgmap v197: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:33 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:34:33.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:33 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:34:33.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:33 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:34:33.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:33 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:34:33.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:33 smithi100 ceph-mon[35275]: pgmap v197: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:33.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:33 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:34:33.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:33 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:34:33.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:33 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:34:33.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:33 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:34:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:33 smithi189 ceph-mon[35357]: pgmap v197: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:33 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:34:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:33 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:34:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:33 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:34:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:33 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:34:34.201 INFO:tasks.cephfs.filesystem:scrub status for tag:21a6e639-f530-40ab-8548-9ee72e8c27d1 - {'path': '/', 'tag': '21a6e639-f530-40ab-8548-9ee72e8c27d1', 'options': 'recursive,force'} 2024-09-12T01:34:35.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:35 smithi081 ceph-mon[30920]: pgmap v198: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:35.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:35 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:34:35.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:35 smithi100 ceph-mon[35275]: pgmap v198: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:35.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:35 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:34:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:35 smithi189 ceph-mon[35357]: pgmap v198: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:35 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:34:37.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:37 smithi081 ceph-mon[30920]: pgmap v199: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:34:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:37 smithi100 ceph-mon[35275]: pgmap v199: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:34:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:37 smithi189 ceph-mon[35357]: pgmap v199: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:34:39.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:39 smithi100 ceph-mon[35275]: pgmap v200: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:34:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:39 smithi189 ceph-mon[35357]: pgmap v200: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:34:39.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:39 smithi081 ceph-mon[30920]: pgmap v200: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:34:41.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:41 smithi100 ceph-mon[35275]: pgmap v201: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:34:41.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:41 smithi189 ceph-mon[35357]: pgmap v201: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:34:41.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:41 smithi081 ceph-mon[30920]: pgmap v201: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:34:43.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:43 smithi100 ceph-mon[35275]: pgmap v202: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:34:43.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:43 smithi189 ceph-mon[35357]: pgmap v202: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:34:43.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:43 smithi081 ceph-mon[30920]: pgmap v202: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:34:45.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:45 smithi100 ceph-mon[35275]: pgmap v203: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:34:45.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:45 smithi189 ceph-mon[35357]: pgmap v203: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:34:45.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:45 smithi081 ceph-mon[30920]: pgmap v203: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:34:47.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:47 smithi100 ceph-mon[35275]: pgmap v204: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:34:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:47 smithi189 ceph-mon[35357]: pgmap v204: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:34:47.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:47 smithi081 ceph-mon[30920]: pgmap v204: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:34:49.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:49 smithi100 ceph-mon[35275]: pgmap v205: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:49 smithi189 ceph-mon[35357]: pgmap v205: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:49.791 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:49 smithi081 ceph-mon[30920]: pgmap v205: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:51.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:51 smithi100 ceph-mon[35275]: pgmap v206: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:34:51.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:51 smithi189 ceph-mon[35357]: pgmap v206: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:34:51.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:51 smithi081 ceph-mon[30920]: pgmap v206: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:34:53.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:53 smithi100 ceph-mon[35275]: pgmap v207: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:53 smithi189 ceph-mon[35357]: pgmap v207: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:53.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:53 smithi081 ceph-mon[30920]: pgmap v207: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:55.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:55 smithi100 ceph-mon[35275]: pgmap v208: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:55.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:55 smithi189 ceph-mon[35357]: pgmap v208: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:55.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:55 smithi081 ceph-mon[30920]: pgmap v208: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:57 smithi189 ceph-mon[35357]: pgmap v209: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:34:57.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:57 smithi081 ceph-mon[30920]: pgmap v209: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:34:58.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:57 smithi100 ceph-mon[35275]: pgmap v209: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:34:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:34:59 smithi189 ceph-mon[35357]: pgmap v210: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:34:59.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:34:59 smithi081 ceph-mon[30920]: pgmap v210: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:00.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:34:59 smithi100 ceph-mon[35275]: pgmap v210: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:01 smithi189 ceph-mon[35357]: pgmap v211: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:01.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:01 smithi081 ceph-mon[30920]: pgmap v211: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:02.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:01 smithi100 ceph-mon[35275]: pgmap v211: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:03 smithi189 ceph-mon[35357]: pgmap v212: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:03.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:03 smithi081 ceph-mon[30920]: pgmap v212: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:04.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:03 smithi100 ceph-mon[35275]: pgmap v212: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:04.203 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:35:04.466 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.936+0000 7fcacdad9640 1 -- 172.21.15.81:0/3899675904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8102790 msgr2=0x7fcac81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.936+0000 7fcacdad9640 1 --2- 172.21.15.81:0/3899675904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8102790 0x7fcac81067e0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fcab0009900 tx=0x7fcab002a410 comp rx=0 tx=0).stop 2024-09-12T01:35:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.936+0000 7fcacdad9640 1 -- 172.21.15.81:0/3899675904 shutdown_connections 2024-09-12T01:35:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.936+0000 7fcacdad9640 1 --2- 172.21.15.81:0/3899675904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac8106f10 0x7fcac810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.936+0000 7fcacdad9640 1 --2- 172.21.15.81:0/3899675904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8102790 0x7fcac81067e0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.936+0000 7fcacdad9640 1 --2- 172.21.15.81:0/3899675904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcac8101de0 0x7fcac81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.936+0000 7fcacdad9640 1 -- 172.21.15.81:0/3899675904 >> 172.21.15.81:0/3899675904 conn(0x7fcac80fd8c0 msgr2=0x7fcac80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.936+0000 7fcacdad9640 1 -- 172.21.15.81:0/3899675904 shutdown_connections 2024-09-12T01:35:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.936+0000 7fcacdad9640 1 -- 172.21.15.81:0/3899675904 wait complete. 2024-09-12T01:35:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.937+0000 7fcacdad9640 1 Processor -- start 2024-09-12T01:35:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.937+0000 7fcacdad9640 1 -- start start 2024-09-12T01:35:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.937+0000 7fcacdad9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8101de0 0x7fcac80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.937+0000 7fcacdad9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcac8102790 0x7fcac8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.937+0000 7fcacdad9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac8106f10 0x7fcac8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.937+0000 7fcacdad9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcac8111f70 con 0x7fcac8101de0 2024-09-12T01:35:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.937+0000 7fcacdad9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcac8111df0 con 0x7fcac8106f10 2024-09-12T01:35:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.937+0000 7fcacdad9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81120f0 con 0x7fcac8102790 2024-09-12T01:35:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.937+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8101de0 0x7fcac80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.937+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8101de0 0x7fcac80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52982/0 (socket says 172.21.15.81:52982) 2024-09-12T01:35:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.937+0000 7fcac77fe640 1 -- 172.21.15.81:0/3108510423 learned_addr learned my addr 172.21.15.81:0/3108510423 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.937+0000 7fcabffff640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcac8102790 0x7fcac8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcac7fff640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac8106f10 0x7fcac8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcac77fe640 1 -- 172.21.15.81:0/3108510423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcac8102790 msgr2=0x7fcac8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcac77fe640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcac8102790 0x7fcac8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcac77fe640 1 -- 172.21.15.81:0/3108510423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac8106f10 msgr2=0x7fcac8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcac77fe640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac8106f10 0x7fcac8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcac77fe640 1 -- 172.21.15.81:0/3108510423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac81aaec0 con 0x7fcac8101de0 2024-09-12T01:35:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcac7fff640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac8106f10 0x7fcac8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcabffff640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcac8102790 0x7fcac8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcac77fe640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8101de0 0x7fcac80744f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fcab800c970 tx=0x7fcab800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcac57fa640 1 -- 172.21.15.81:0/3108510423 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8007bb0 con 0x7fcac8101de0 2024-09-12T01:35:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcac57fa640 1 -- 172.21.15.81:0/3108510423 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcab8007d50 con 0x7fcac8101de0 2024-09-12T01:35:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcacdad9640 1 -- 172.21.15.81:0/3108510423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac81ab0f0 con 0x7fcac8101de0 2024-09-12T01:35:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcac57fa640 1 -- 172.21.15.81:0/3108510423 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab800f450 con 0x7fcac8101de0 2024-09-12T01:35:04.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.938+0000 7fcacdad9640 1 -- 172.21.15.81:0/3108510423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac81ab5b0 con 0x7fcac8101de0 2024-09-12T01:35:04.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.941+0000 7fcac57fa640 1 -- 172.21.15.81:0/3108510423 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fcab8005020 con 0x7fcac8101de0 2024-09-12T01:35:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.941+0000 7fcacfeb2740 1 Processor -- start 2024-09-12T01:35:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.941+0000 7fcacfeb2740 1 -- start start 2024-09-12T01:35:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.941+0000 7fcacfeb2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 0x56229ecdf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.941+0000 7fcacfeb2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecdfdc0 0x56229ecea140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.941+0000 7fcacfeb2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecea680 0x56229ececa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.941+0000 7fcacfeb2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56229ec452e0 con 0x56229ecdfdc0 2024-09-12T01:35:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.941+0000 7fcacfeb2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56229ebecce0 con 0x56229ecea680 2024-09-12T01:35:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.941+0000 7fcacfeb2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56229ec412a0 con 0x56229ecdf4a0 2024-09-12T01:35:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.941+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecdfdc0 0x56229ecea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecdfdc0 0x56229ecea140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52996/0 (socket says 172.21.15.81:52996) 2024-09-12T01:35:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcac77fe640 1 -- 172.21.15.81:0/2860931084 learned_addr learned my addr 172.21.15.81:0/2860931084 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:04.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcac7fff640 1 --2- 172.21.15.81:0/2860931084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 0x56229ecdf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcabffff640 1 --2- 172.21.15.81:0/2860931084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecea680 0x56229ececa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcac57fa640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fcab40a2cf0 0x7fcab40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcac77fe640 1 -- 172.21.15.81:0/2860931084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 msgr2=0x56229ecdf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:04.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcac77fe640 1 --2- 172.21.15.81:0/2860931084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 0x56229ecdf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcac77fe640 1 -- 172.21.15.81:0/2860931084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecea680 msgr2=0x56229ececa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:04.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcac77fe640 1 --2- 172.21.15.81:0/2860931084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecea680 0x56229ececa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcac57fa640 1 -- 172.21.15.81:0/3108510423 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fcab80cf380 con 0x7fcac8101de0 2024-09-12T01:35:04.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcac77fe640 1 -- 172.21.15.81:0/2860931084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56229ebd1440 con 0x56229ecdfdc0 2024-09-12T01:35:04.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcac7fff640 1 --2- 172.21.15.81:0/2860931084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 0x56229ecdf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:04.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcac7fff640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fcab40a2cf0 0x7fcab40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcac77fe640 1 --2- 172.21.15.81:0/2860931084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecdfdc0 0x56229ecea140 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fcab80cca70 tx=0x7fcab8004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e3381ced66d29a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:04.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcabdffb640 1 -- 172.21.15.81:0/2860931084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab801d030 con 0x56229ecdfdc0 2024-09-12T01:35:04.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcabdffb640 1 -- 172.21.15.81:0/2860931084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcab809bfd0 con 0x56229ecdfdc0 2024-09-12T01:35:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.942+0000 7fcabdffb640 1 -- 172.21.15.81:0/2860931084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab80a4540 con 0x56229ecdfdc0 2024-09-12T01:35:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.943+0000 7fcacfeb2740 1 -- 172.21.15.81:0/2860931084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecdfdc0 msgr2=0x56229ecea140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.943+0000 7fcac7fff640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fcab40a2cf0 0x7fcab40a51b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005fd0 tx=0x7fcac0004a40 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.943+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/2860931084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecdfdc0 0x56229ecea140 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fcab80cca70 tx=0x7fcab8004a20 comp rx=0 tx=0).stop 2024-09-12T01:35:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.943+0000 7fcacfeb2740 1 -- 172.21.15.81:0/2860931084 shutdown_connections 2024-09-12T01:35:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.943+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/2860931084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecea680 0x56229ececa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.943+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/2860931084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecdfdc0 0x56229ecea140 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.943+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/2860931084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 0x56229ecdf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.943+0000 7fcacfeb2740 1 -- 172.21.15.81:0/2860931084 >> 172.21.15.81:0/2860931084 conn(0x56229ecdba30 msgr2=0x56229ecdbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.943+0000 7fcacfeb2740 1 -- 172.21.15.81:0/2860931084 shutdown_connections 2024-09-12T01:35:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.943+0000 7fcacfeb2740 1 -- 172.21.15.81:0/2860931084 wait complete. 2024-09-12T01:35:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcacfeb2740 1 -- start start 2024-09-12T01:35:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcacfeb2740 1 Processor -- start 2024-09-12T01:35:04.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcacfeb2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdf4a0 0x56229ece9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcacfeb2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdfdc0 0x56229ece7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcacfeb2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ece7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcacfeb2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56229eced250 con 0x56229ecea680 2024-09-12T01:35:04.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcacfeb2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56229ec00050 con 0x56229ecdf4a0 2024-09-12T01:35:04.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcacfeb2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56229eced3d0 con 0x56229ecdfdc0 2024-09-12T01:35:04.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcacfeb2740 10 client.0 _ll_register_callbacks cb 0x56229ec40160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:04.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcac7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ece7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcac7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ece7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53012/0 (socket says 172.21.15.81:53012) 2024-09-12T01:35:04.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcac7fff640 1 -- 172.21.15.81:0/2131152104 learned_addr learned my addr 172.21.15.81:0/2131152104 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:04.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcabffff640 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdfdc0 0x56229ece7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcac7fff640 1 -- 172.21.15.81:0/2131152104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdfdc0 msgr2=0x56229ece7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:04.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcac7fff640 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdfdc0 0x56229ece7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcac77fe640 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdf4a0 0x56229ece9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcac7fff640 1 -- 172.21.15.81:0/2131152104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdf4a0 msgr2=0x56229ece9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:04.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcac7fff640 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdf4a0 0x56229ece9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcac7fff640 1 -- 172.21.15.81:0/2131152104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56229e9b63c0 con 0x56229ecea680 2024-09-12T01:35:04.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.944+0000 7fcac77fe640 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdf4a0 0x56229ece9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:04.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcac7fff640 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ece7780 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcac000bfd0 tx=0x7fcac0008420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44bf17c5a88f78f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:04.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcaa6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:04.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcaa6ffd640 1 -- 172.21.15.81:0/2131152104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac001cd80 con 0x56229ecea680 2024-09-12T01:35:04.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcaa6ffd640 1 -- 172.21.15.81:0/2131152104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fcac001a450 con 0x56229ecea680 2024-09-12T01:35:04.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcacfeb2740 1 -- 172.21.15.81:0/2131152104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcab809bfd0 con 0x56229ecea680 2024-09-12T01:35:04.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcaa6ffd640 1 -- 172.21.15.81:0/2131152104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcac001a650 con 0x56229ecea680 2024-09-12T01:35:04.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcacfeb2740 10 client.17013 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:04.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcacfeb2740 1 -- 172.21.15.81:0/2131152104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56229ecf8c80 con 0x56229ecea680 2024-09-12T01:35:04.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcaa6ffd640 1 -- 172.21.15.81:0/2131152104 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcab809bfd0 con 0x56229ecea680 2024-09-12T01:35:04.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcaa6ffd640 1 -- 172.21.15.81:0/2131152104 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcac0023070 con 0x56229ecea680 2024-09-12T01:35:04.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcacfeb2740 10 client.17013 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:04.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcacfeb2740 10 client.17013 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:35:04.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcacfeb2740 20 client.17013 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:04.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.945+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56229ecfa140 0x56229ecfc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.946+0000 7fcacfeb2740 4 client.17013 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:04.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.946+0000 7fcacfeb2740 1 -- 172.21.15.81:0/2131152104 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56229ec52850 con 0x56229ecfa140 2024-09-12T01:35:04.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.946+0000 7fcac77fe640 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56229ecfa140 0x56229ecfc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.946+0000 7fcac77fe640 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56229ecfa140 0x56229ecfc550 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=126aaf89eaaab06f server_cookie=206163e53245b3b5 in_seq=0 out_seq=0 2024-09-12T01:35:04.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.946+0000 7fcaa6ffd640 10 client.17013 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:04.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcaa6ffd640 1 -- 172.21.15.81:0/2131152104 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56229ec52850 con 0x56229ecfa140 2024-09-12T01:35:04.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcaa6ffd640 10 client.17013 handle_command_reply: tid=0 2024-09-12T01:35:04.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcacfeb2740 1 client.17013 shutdown 2024-09-12T01:35:04.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcacfeb2740 1 -- 172.21.15.81:0/2131152104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 msgr2=0x56229ece7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:04.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ece7780 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcac000bfd0 tx=0x7fcac0008420 comp rx=0 tx=0).stop 2024-09-12T01:35:04.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcacfeb2740 1 -- 172.21.15.81:0/2131152104 shutdown_connections 2024-09-12T01:35:04.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56229ecfa140 0x56229ecfc550 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ece7780 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdfdc0 0x56229ece7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/2131152104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdf4a0 0x56229ece9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcaa6ffd640 0 client.17013 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:04.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcacfeb2740 1 -- 172.21.15.81:0/2131152104 >> 172.21.15.81:0/2131152104 conn(0x56229ecdba30 msgr2=0x56229ece1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:04.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcacfeb2740 1 -- 172.21.15.81:0/2131152104 shutdown_connections 2024-09-12T01:35:04.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcacfeb2740 1 -- 172.21.15.81:0/2131152104 wait complete. 2024-09-12T01:35:04.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.947+0000 7fcacfeb2740 20 client.17013 trim_cache size 0 max 16384 2024-09-12T01:35:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.964+0000 7fcacfeb2740 1 Processor -- start 2024-09-12T01:35:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.964+0000 7fcacfeb2740 1 -- start start 2024-09-12T01:35:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.964+0000 7fcacfeb2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 0x56229ecf64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.964+0000 7fcacfeb2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdfdc0 0x56229ece27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.964+0000 7fcacfeb2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ed01df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.964+0000 7fcacfeb2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81b3e50 con 0x56229ecea680 2024-09-12T01:35:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.964+0000 7fcacfeb2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81b5990 con 0x56229ecdfdc0 2024-09-12T01:35:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.964+0000 7fcacfeb2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81b4520 con 0x56229ecdf4a0 2024-09-12T01:35:04.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.964+0000 7fcac7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ed01df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.964+0000 7fcac7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ed01df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53022/0 (socket says 172.21.15.81:53022) 2024-09-12T01:35:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.964+0000 7fcac7fff640 1 -- 172.21.15.81:0/4212725950 learned_addr learned my addr 172.21.15.81:0/4212725950 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.965+0000 7fcabffff640 1 --2- 172.21.15.81:0/4212725950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdfdc0 0x56229ece27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.965+0000 7fcac7fff640 1 -- 172.21.15.81:0/4212725950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 msgr2=0x56229ecf64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.965+0000 7fcac77fe640 1 --2- 172.21.15.81:0/4212725950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 0x56229ecf64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.965+0000 7fcac7fff640 1 --2- 172.21.15.81:0/4212725950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 0x56229ecf64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.965+0000 7fcac7fff640 1 -- 172.21.15.81:0/4212725950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdfdc0 msgr2=0x56229ece27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.965+0000 7fcac7fff640 1 --2- 172.21.15.81:0/4212725950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdfdc0 0x56229ece27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.965+0000 7fcac7fff640 1 -- 172.21.15.81:0/4212725950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56229ecdb860 con 0x56229ecea680 2024-09-12T01:35:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.965+0000 7fcabffff640 1 --2- 172.21.15.81:0/4212725950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdfdc0 0x56229ece27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.965+0000 7fcac7fff640 1 --2- 172.21.15.81:0/4212725950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ed01df0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fcac0008560 tx=0x7fcac0005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f515352eb29671 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.965+0000 7fcabd7fa640 1 -- 172.21.15.81:0/4212725950 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0032070 con 0x56229ecea680 2024-09-12T01:35:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.965+0000 7fcabd7fa640 1 -- 172.21.15.81:0/4212725950 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac001c0b0 con 0x56229ecea680 2024-09-12T01:35:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.965+0000 7fcabd7fa640 1 -- 172.21.15.81:0/4212725950 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac001ac70 con 0x56229ecea680 2024-09-12T01:35:04.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.966+0000 7fcacfeb2740 1 -- 172.21.15.81:0/4212725950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 msgr2=0x56229ed01df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.966+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/4212725950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ed01df0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fcac0008560 tx=0x7fcac0005bf0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.966+0000 7fcacfeb2740 1 -- 172.21.15.81:0/4212725950 shutdown_connections 2024-09-12T01:35:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.966+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/4212725950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ed01df0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.966+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/4212725950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdfdc0 0x56229ece27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.966+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/4212725950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 0x56229ecf64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.966+0000 7fcacfeb2740 1 -- 172.21.15.81:0/4212725950 >> 172.21.15.81:0/4212725950 conn(0x56229ecdba30 msgr2=0x56229ece20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.966+0000 7fcacfeb2740 1 -- 172.21.15.81:0/4212725950 shutdown_connections 2024-09-12T01:35:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.966+0000 7fcacfeb2740 1 -- 172.21.15.81:0/4212725950 wait complete. 2024-09-12T01:35:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.966+0000 7fcacfeb2740 1 -- start start 2024-09-12T01:35:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.966+0000 7fcacfeb2740 1 Processor -- start 2024-09-12T01:35:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcacfeb2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 0x56229ecf2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcacfeb2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdfdc0 0x56229eceddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcacfeb2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ecee330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcacfeb2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81b52c0 con 0x56229ecea680 2024-09-12T01:35:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcacfeb2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81b4bf0 con 0x56229ecdfdc0 2024-09-12T01:35:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcacfeb2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81b1e30 con 0x56229ecdf4a0 2024-09-12T01:35:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcacfeb2740 10 client.0 _ll_register_callbacks cb 0x7fcac0008e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcac7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ecee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcac7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ecee330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53028/0 (socket says 172.21.15.81:53028) 2024-09-12T01:35:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcac7fff640 1 -- 172.21.15.81:0/3226189331 learned_addr learned my addr 172.21.15.81:0/3226189331 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcac77fe640 1 --2- 172.21.15.81:0/3226189331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 0x56229ecf2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcabffff640 1 --2- 172.21.15.81:0/3226189331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdfdc0 0x56229eceddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcac7fff640 1 -- 172.21.15.81:0/3226189331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 msgr2=0x56229ecf2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcac7fff640 1 --2- 172.21.15.81:0/3226189331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 0x56229ecf2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcac7fff640 1 -- 172.21.15.81:0/3226189331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdfdc0 msgr2=0x56229eceddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcac7fff640 1 --2- 172.21.15.81:0/3226189331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdfdc0 0x56229eceddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcac7fff640 1 -- 172.21.15.81:0/3226189331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56229ecee870 con 0x56229ecea680 2024-09-12T01:35:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcac7fff640 1 --2- 172.21.15.81:0/3226189331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ecee330 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fcac0025a60 tx=0x7fcac001de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a927cf0444739ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.967+0000 7fcaa6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcaa6ffd640 1 -- 172.21.15.81:0/3226189331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac003f060 con 0x56229ecea680 2024-09-12T01:35:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcaa6ffd640 1 -- 172.21.15.81:0/3226189331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fcac0025650 con 0x56229ecea680 2024-09-12T01:35:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcacfeb2740 1 -- 172.21.15.81:0/3226189331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcac001c0b0 con 0x56229ecea680 2024-09-12T01:35:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcaa6ffd640 1 -- 172.21.15.81:0/3226189331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcac0032070 con 0x56229ecea680 2024-09-12T01:35:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcacfeb2740 10 client.17019 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcacfeb2740 1 -- 172.21.15.81:0/3226189331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56229ed64ac0 con 0x56229ecea680 2024-09-12T01:35:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcaa6ffd640 1 -- 172.21.15.81:0/3226189331 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac001c0b0 con 0x56229ecea680 2024-09-12T01:35:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcaa6ffd640 1 -- 172.21.15.81:0/3226189331 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcac0023070 con 0x56229ecea680 2024-09-12T01:35:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcacfeb2740 10 client.17019 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:04.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcacfeb2740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:35:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcacfeb2740 20 client.17019 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/3226189331 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56229ed650c0 0x56229ed674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcacfeb2740 4 client.17019 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:35:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.968+0000 7fcacfeb2740 1 -- 172.21.15.81:0/3226189331 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56229ece7b10 con 0x56229ed650c0 2024-09-12T01:35:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcac77fe640 1 --2- 172.21.15.81:0/3226189331 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56229ed650c0 0x56229ed674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcac77fe640 1 --2- 172.21.15.81:0/3226189331 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56229ed650c0 0x56229ed674b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41c6814b978d94b server_cookie=e38db7d24c0b5440 in_seq=0 out_seq=0 2024-09-12T01:35:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcaa6ffd640 10 client.17019 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcaa6ffd640 1 -- 172.21.15.81:0/3226189331 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56229ece7b10 con 0x56229ed650c0 2024-09-12T01:35:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcaa6ffd640 10 client.17019 handle_command_reply: tid=0 2024-09-12T01:35:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcacfeb2740 1 client.17019 shutdown 2024-09-12T01:35:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcacfeb2740 1 -- 172.21.15.81:0/3226189331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 msgr2=0x56229ecee330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/3226189331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ecee330 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fcac0025a60 tx=0x7fcac001de40 comp rx=0 tx=0).stop 2024-09-12T01:35:04.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcacfeb2740 1 -- 172.21.15.81:0/3226189331 shutdown_connections 2024-09-12T01:35:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/3226189331 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56229ed650c0 0x56229ed674b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcaa6ffd640 0 client.17019 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/3226189331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229ecea680 0x56229ecee330 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/3226189331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56229ecdfdc0 0x56229eceddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcacfeb2740 1 --2- 172.21.15.81:0/3226189331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56229ecdf4a0 0x56229ecf2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcacfeb2740 1 -- 172.21.15.81:0/3226189331 >> 172.21.15.81:0/3226189331 conn(0x56229ecdba30 msgr2=0x56229ece5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcacfeb2740 1 -- 172.21.15.81:0/3226189331 shutdown_connections 2024-09-12T01:35:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.969+0000 7fcacfeb2740 1 -- 172.21.15.81:0/3226189331 wait complete. 2024-09-12T01:35:04.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.970+0000 7fcacfeb2740 20 client.17019 trim_cache size 0 max 16384 2024-09-12T01:35:04.975 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:35:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:35:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:35:04.976 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:35:04.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.970+0000 7fcacdad9640 1 -- 172.21.15.81:0/3108510423 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fcab40a2cf0 msgr2=0x7fcab40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:04.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.970+0000 7fcacdad9640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fcab40a2cf0 0x7fcab40a51b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005fd0 tx=0x7fcac0004a40 comp rx=0 tx=0).stop 2024-09-12T01:35:04.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.970+0000 7fcacdad9640 1 -- 172.21.15.81:0/3108510423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8101de0 msgr2=0x7fcac80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:04.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.970+0000 7fcacdad9640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8101de0 0x7fcac80744f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fcab800c970 tx=0x7fcab800ce30 comp rx=0 tx=0).stop 2024-09-12T01:35:04.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.970+0000 7fcacdad9640 1 -- 172.21.15.81:0/3108510423 shutdown_connections 2024-09-12T01:35:04.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.970+0000 7fcacdad9640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fcab40a2cf0 0x7fcab40a51b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.970+0000 7fcacdad9640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac8106f10 0x7fcac8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.970+0000 7fcacdad9640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcac8102790 0x7fcac8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.970+0000 7fcacdad9640 1 --2- 172.21.15.81:0/3108510423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac8101de0 0x7fcac80744f0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.970+0000 7fcacdad9640 1 -- 172.21.15.81:0/3108510423 >> 172.21.15.81:0/3108510423 conn(0x7fcac80fd8c0 msgr2=0x7fcac80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:04.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.970+0000 7fcacdad9640 1 -- 172.21.15.81:0/3108510423 shutdown_connections 2024-09-12T01:35:04.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:04.970+0000 7fcacdad9640 1 -- 172.21.15.81:0/3108510423 wait complete. 2024-09-12T01:35:05.773 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:35:05.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:35:05.797 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:05 smithi081 ceph-mon[30920]: pgmap v213: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:05.820 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:05 smithi100 ceph-mon[35275]: pgmap v213: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:05 smithi189 ceph-mon[35357]: pgmap v213: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:06.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.517+0000 7fbd89b51640 1 -- 172.21.15.81:0/2124680628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd84103660 msgr2=0x7fbd8410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:06.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.517+0000 7fbd89b51640 1 --2- 172.21.15.81:0/2124680628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd84103660 0x7fbd8410bb50 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009900 tx=0x7fbd7802a480 comp rx=0 tx=0).stop 2024-09-12T01:35:06.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.517+0000 7fbd89b51640 1 -- 172.21.15.81:0/2124680628 shutdown_connections 2024-09-12T01:35:06.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.517+0000 7fbd89b51640 1 --2- 172.21.15.81:0/2124680628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd8410c170 0x7fbd8410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.517+0000 7fbd89b51640 1 --2- 172.21.15.81:0/2124680628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd84103660 0x7fbd8410bb50 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.517+0000 7fbd89b51640 1 --2- 172.21.15.81:0/2124680628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd84102d40 0x7fbd84103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.517+0000 7fbd89b51640 1 -- 172.21.15.81:0/2124680628 >> 172.21.15.81:0/2124680628 conn(0x7fbd840fc7a0 msgr2=0x7fbd840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:06.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.517+0000 7fbd89b51640 1 -- 172.21.15.81:0/2124680628 shutdown_connections 2024-09-12T01:35:06.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.517+0000 7fbd89b51640 1 -- 172.21.15.81:0/2124680628 wait complete. 2024-09-12T01:35:06.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd89b51640 1 Processor -- start 2024-09-12T01:35:06.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd89b51640 1 -- start start 2024-09-12T01:35:06.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd89b51640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd84102d40 0x7fbd841984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:06.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd89b51640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd84103660 0x7fbd84198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:06.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd89b51640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd8410c170 0x7fbd8419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:06.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd89b51640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84111fb0 con 0x7fbd84103660 2024-09-12T01:35:06.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd89b51640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84111e30 con 0x7fbd84102d40 2024-09-12T01:35:06.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd89b51640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84112130 con 0x7fbd8410c170 2024-09-12T01:35:06.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd82ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd84103660 0x7fbd84198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:06.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd82ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd84103660 0x7fbd84198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53040/0 (socket says 172.21.15.81:53040) 2024-09-12T01:35:06.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd82ffd640 1 -- 172.21.15.81:0/2083649464 learned_addr learned my addr 172.21.15.81:0/2083649464 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:06.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd837fe640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd84102d40 0x7fbd841984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:06.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd83fff640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd8410c170 0x7fbd8419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:06.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd82ffd640 1 -- 172.21.15.81:0/2083649464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd8410c170 msgr2=0x7fbd8419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:06.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd82ffd640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd8410c170 0x7fbd8419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd82ffd640 1 -- 172.21.15.81:0/2083649464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd84102d40 msgr2=0x7fbd841984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:06.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd82ffd640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd84102d40 0x7fbd841984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.518+0000 7fbd82ffd640 1 -- 172.21.15.81:0/2083649464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8419d470 con 0x7fbd84103660 2024-09-12T01:35:06.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.519+0000 7fbd82ffd640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd84103660 0x7fbd84198a00 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fbd78005ab0 tx=0x7fbd780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:06.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.519+0000 7fbd80ff9640 1 -- 172.21.15.81:0/2083649464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7803f030 con 0x7fbd84103660 2024-09-12T01:35:06.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.519+0000 7fbd89b51640 1 -- 172.21.15.81:0/2083649464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8419d700 con 0x7fbd84103660 2024-09-12T01:35:06.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.519+0000 7fbd80ff9640 1 -- 172.21.15.81:0/2083649464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd78003ce0 con 0x7fbd84103660 2024-09-12T01:35:06.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.519+0000 7fbd80ff9640 1 -- 172.21.15.81:0/2083649464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd78035070 con 0x7fbd84103660 2024-09-12T01:35:06.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.519+0000 7fbd89b51640 1 -- 172.21.15.81:0/2083649464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd841a5040 con 0x7fbd84103660 2024-09-12T01:35:06.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.520+0000 7fbd89b51640 1 -- 172.21.15.81:0/2083649464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd84103120 con 0x7fbd84103660 2024-09-12T01:35:06.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.522+0000 7fbd80ff9640 1 -- 172.21.15.81:0/2083649464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fbd78042030 con 0x7fbd84103660 2024-09-12T01:35:06.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.522+0000 7fbd80ff9640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbd6c0a2cf0 0x7fbd6c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:06.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.522+0000 7fbd80ff9640 1 -- 172.21.15.81:0/2083649464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7fbd780efea0 con 0x7fbd84103660 2024-09-12T01:35:06.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.522+0000 7fbd837fe640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbd6c0a2cf0 0x7fbd6c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:06.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.523+0000 7fbd837fe640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbd6c0a2cf0 0x7fbd6c0a51b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009990 tx=0x7fbd74009110 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:06.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.526+0000 7fbd80ff9640 1 -- 172.21.15.81:0/2083649464 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd780bcaf0 con 0x7fbd84103660 2024-09-12T01:35:06.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.729+0000 7fbd89b51640 1 -- 172.21.15.81:0/2083649464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd841071e0 con 0x7fbd84103660 2024-09-12T01:35:06.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.729+0000 7fbd80ff9640 1 -- 172.21.15.81:0/2083649464 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fbd780bc3f0 con 0x7fbd84103660 2024-09-12T01:35:06.729 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:35:06.729 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:35:06.730 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:35:06.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.731+0000 7fbd89b51640 1 -- 172.21.15.81:0/2083649464 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbd6c0a2cf0 msgr2=0x7fbd6c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:06.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.731+0000 7fbd89b51640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbd6c0a2cf0 0x7fbd6c0a51b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009990 tx=0x7fbd74009110 comp rx=0 tx=0).stop 2024-09-12T01:35:06.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.731+0000 7fbd89b51640 1 -- 172.21.15.81:0/2083649464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd84103660 msgr2=0x7fbd84198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:06.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.731+0000 7fbd89b51640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd84103660 0x7fbd84198a00 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fbd78005ab0 tx=0x7fbd780042f0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.732+0000 7fbd89b51640 1 -- 172.21.15.81:0/2083649464 shutdown_connections 2024-09-12T01:35:06.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.732+0000 7fbd89b51640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbd6c0a2cf0 0x7fbd6c0a51b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.732+0000 7fbd89b51640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd8410c170 0x7fbd8419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.732+0000 7fbd89b51640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd84103660 0x7fbd84198a00 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.732+0000 7fbd89b51640 1 --2- 172.21.15.81:0/2083649464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd84102d40 0x7fbd841984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.732+0000 7fbd89b51640 1 -- 172.21.15.81:0/2083649464 >> 172.21.15.81:0/2083649464 conn(0x7fbd840fc7a0 msgr2=0x7fbd840fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:06.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.732+0000 7fbd89b51640 1 -- 172.21.15.81:0/2083649464 shutdown_connections 2024-09-12T01:35:06.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:06.732+0000 7fbd89b51640 1 -- 172.21.15.81:0/2083649464 wait complete. 2024-09-12T01:35:07.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:35:07.659 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:07.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:07 smithi081 ceph-mon[30920]: pgmap v214: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:35:07.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:07 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2083649464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:35:08.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:07 smithi100 ceph-mon[35275]: pgmap v214: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:35:08.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:07 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2083649464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:35:08.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:07 smithi189 ceph-mon[35357]: pgmap v214: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:35:08.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:07 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2083649464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:35:08.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.057+0000 7f20212ad640 1 -- 172.21.15.81:0/1535024518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c103650 msgr2=0x7f201c10bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.057+0000 7f20212ad640 1 --2- 172.21.15.81:0/1535024518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c103650 0x7f201c10bb40 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2004009900 tx=0x7f200402a480 comp rx=0 tx=0).stop 2024-09-12T01:35:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.058+0000 7f20212ad640 1 -- 172.21.15.81:0/1535024518 shutdown_connections 2024-09-12T01:35:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.058+0000 7f20212ad640 1 --2- 172.21.15.81:0/1535024518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f201c10c160 0x7f201c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.058+0000 7f20212ad640 1 --2- 172.21.15.81:0/1535024518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c103650 0x7f201c10bb40 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.058+0000 7f20212ad640 1 --2- 172.21.15.81:0/1535024518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f201c102d30 0x7f201c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.058+0000 7f20212ad640 1 -- 172.21.15.81:0/1535024518 >> 172.21.15.81:0/1535024518 conn(0x7f201c0fc790 msgr2=0x7f201c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.058+0000 7f20212ad640 1 -- 172.21.15.81:0/1535024518 shutdown_connections 2024-09-12T01:35:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.058+0000 7f20212ad640 1 -- 172.21.15.81:0/1535024518 wait complete. 2024-09-12T01:35:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.058+0000 7f20212ad640 1 Processor -- start 2024-09-12T01:35:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.058+0000 7f20212ad640 1 -- start start 2024-09-12T01:35:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f20212ad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f201c102d30 0x7f201c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f20212ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c103650 0x7f201c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f20212ad640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f201c10c160 0x7f201c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f20212ad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f201c111f60 con 0x7f201c103650 2024-09-12T01:35:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f20212ad640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f201c111de0 con 0x7f201c102d30 2024-09-12T01:35:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f20212ad640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f201c1120e0 con 0x7f201c10c160 2024-09-12T01:35:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f201a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c103650 0x7f201c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f201a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c103650 0x7f201c198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53072/0 (socket says 172.21.15.81:53072) 2024-09-12T01:35:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f201a7fc640 1 -- 172.21.15.81:0/1551855381 learned_addr learned my addr 172.21.15.81:0/1551855381 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f201affd640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f201c102d30 0x7f201c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f201b7fe640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f201c10c160 0x7f201c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f201a7fc640 1 -- 172.21.15.81:0/1551855381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f201c10c160 msgr2=0x7f201c19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f201a7fc640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f201c10c160 0x7f201c19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f201a7fc640 1 -- 172.21.15.81:0/1551855381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f201c102d30 msgr2=0x7f201c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f201a7fc640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f201c102d30 0x7f201c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f201a7fc640 1 -- 172.21.15.81:0/1551855381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c19d3f0 con 0x7f201c103650 2024-09-12T01:35:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f201b7fe640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f201c10c160 0x7f201c19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f201a7fc640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c103650 0x7f201c198980 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2004005940 tx=0x7f20040040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:08.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f2013fff640 1 -- 172.21.15.81:0/1551855381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200403f030 con 0x7f201c103650 2024-09-12T01:35:08.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f2013fff640 1 -- 172.21.15.81:0/1551855381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20040044c0 con 0x7f201c103650 2024-09-12T01:35:08.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f20212ad640 1 -- 172.21.15.81:0/1551855381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201c19d680 con 0x7f201c103650 2024-09-12T01:35:08.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.059+0000 7f2013fff640 1 -- 172.21.15.81:0/1551855381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004035070 con 0x7f201c103650 2024-09-12T01:35:08.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.060+0000 7f20212ad640 1 -- 172.21.15.81:0/1551855381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201c1a4fc0 con 0x7f201c103650 2024-09-12T01:35:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.062+0000 7f2013fff640 1 -- 172.21.15.81:0/1551855381 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f2004042030 con 0x7f201c103650 2024-09-12T01:35:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.062+0000 7f2023686740 1 Processor -- start 2024-09-12T01:35:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f2023686740 1 -- start start 2024-09-12T01:35:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f2023686740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c370b40 0x56363c36f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f2023686740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c36f5d0 0x56363c36fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f2023686740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c37a370 0x56363c37c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f2023686740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56363c2d52f0 con 0x56363c370b40 2024-09-12T01:35:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f2023686740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56363c27ccf0 con 0x56363c36f5d0 2024-09-12T01:35:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f2023686740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56363c2d12b0 con 0x56363c37a370 2024-09-12T01:35:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c370b40 0x56363c36f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c370b40 0x56363c36f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53082/0 (socket says 172.21.15.81:53082) 2024-09-12T01:35:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f201b7fe640 1 -- 172.21.15.81:0/2949682302 learned_addr learned my addr 172.21.15.81:0/2949682302 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f201affd640 1 --2- 172.21.15.81:0/2949682302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c36f5d0 0x56363c36fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f2013fff640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f20080a2cf0 0x7f20080a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f201a7fc640 1 --2- 172.21.15.81:0/2949682302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c37a370 0x56363c37c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f201b7fe640 1 -- 172.21.15.81:0/2949682302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c37a370 msgr2=0x56363c37c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f201b7fe640 1 --2- 172.21.15.81:0/2949682302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c37a370 0x56363c37c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f201b7fe640 1 -- 172.21.15.81:0/2949682302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c36f5d0 msgr2=0x56363c36fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.063+0000 7f201b7fe640 1 --2- 172.21.15.81:0/2949682302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c36f5d0 0x56363c36fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.064+0000 7f201b7fe640 1 -- 172.21.15.81:0/2949682302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56363c2613a0 con 0x56363c370b40 2024-09-12T01:35:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.064+0000 7f201affd640 1 --2- 172.21.15.81:0/2949682302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c36f5d0 0x56363c36fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.064+0000 7f201b7fe640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f20080a2cf0 0x7f20080a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.064+0000 7f2013fff640 1 -- 172.21.15.81:0/1551855381 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f20040efbc0 con 0x7f201c103650 2024-09-12T01:35:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.064+0000 7f201b7fe640 1 --2- 172.21.15.81:0/2949682302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c370b40 0x56363c36f090 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2014009c90 tx=0x7f201400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a215bf5bfb4eaa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.064+0000 7f20117fa640 1 -- 172.21.15.81:0/2949682302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201401a410 con 0x56363c370b40 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.064+0000 7f20117fa640 1 -- 172.21.15.81:0/2949682302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f201401aa90 con 0x56363c370b40 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.064+0000 7f20117fa640 1 -- 172.21.15.81:0/2949682302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014011850 con 0x56363c370b40 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.064+0000 7f201b7fe640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f20080a2cf0 0x7f20080a51b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f201401f000 tx=0x7f2014020000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.065+0000 7f2023686740 1 -- 172.21.15.81:0/2949682302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c370b40 msgr2=0x56363c36f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.065+0000 7f2023686740 1 --2- 172.21.15.81:0/2949682302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c370b40 0x56363c36f090 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2014009c90 tx=0x7f201400e6c0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.065+0000 7f2023686740 1 -- 172.21.15.81:0/2949682302 shutdown_connections 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.065+0000 7f2023686740 1 --2- 172.21.15.81:0/2949682302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c37a370 0x56363c37c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.065+0000 7f2023686740 1 --2- 172.21.15.81:0/2949682302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c36f5d0 0x56363c36fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.065+0000 7f2023686740 1 --2- 172.21.15.81:0/2949682302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c370b40 0x56363c36f090 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.065+0000 7f2023686740 1 -- 172.21.15.81:0/2949682302 >> 172.21.15.81:0/2949682302 conn(0x56363c338310 msgr2=0x56363c36bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.065+0000 7f2023686740 1 -- 172.21.15.81:0/2949682302 shutdown_connections 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.065+0000 7f2023686740 1 -- 172.21.15.81:0/2949682302 wait complete. 2024-09-12T01:35:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.065+0000 7f2023686740 1 -- start start 2024-09-12T01:35:08.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.065+0000 7f2023686740 1 Processor -- start 2024-09-12T01:35:08.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f2023686740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c36f5d0 0x56363c379d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f2023686740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c370b40 0x56363c377030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f2023686740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 0x56363c377640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f2023686740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56363c37d070 con 0x56363c37a370 2024-09-12T01:35:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f2023686740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56363c290060 con 0x56363c370b40 2024-09-12T01:35:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f2023686740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56363c37d1f0 con 0x56363c36f5d0 2024-09-12T01:35:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f2023686740 10 client.0 _ll_register_callbacks cb 0x56363bfe38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 0x56363c377640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 0x56363c377640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53098/0 (socket says 172.21.15.81:53098) 2024-09-12T01:35:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f201b7fe640 1 -- 172.21.15.81:0/4051142117 learned_addr learned my addr 172.21.15.81:0/4051142117 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f201a7fc640 1 --2- 172.21.15.81:0/4051142117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c370b40 0x56363c377030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f201affd640 1 --2- 172.21.15.81:0/4051142117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c36f5d0 0x56363c379d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f201b7fe640 1 -- 172.21.15.81:0/4051142117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c36f5d0 msgr2=0x56363c379d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f201b7fe640 1 --2- 172.21.15.81:0/4051142117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c36f5d0 0x56363c379d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f201b7fe640 1 -- 172.21.15.81:0/4051142117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c370b40 msgr2=0x56363c377030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f201b7fe640 1 --2- 172.21.15.81:0/4051142117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c370b40 0x56363c377030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f201b7fe640 1 -- 172.21.15.81:0/4051142117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56363c0463c0 con 0x56363c37a370 2024-09-12T01:35:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f201b7fe640 1 --2- 172.21.15.81:0/4051142117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 0x56363c377640 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f201400eda0 tx=0x7f2014011800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b16e04c29646977 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.066+0000 7f20027fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f20027fc640 1 -- 172.21.15.81:0/4051142117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014034060 con 0x56363c37a370 2024-09-12T01:35:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f20027fc640 1 -- 172.21.15.81:0/4051142117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f2014021070 con 0x56363c37a370 2024-09-12T01:35:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f2023686740 1 -- 172.21.15.81:0/4051142117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f201401aa90 con 0x56363c37a370 2024-09-12T01:35:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f20027fc640 1 -- 172.21.15.81:0/4051142117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2014011d80 con 0x56363c37a370 2024-09-12T01:35:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f2023686740 10 client.17037 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f2023686740 1 -- 172.21.15.81:0/4051142117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56363c388b40 con 0x56363c37a370 2024-09-12T01:35:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f20027fc640 1 -- 172.21.15.81:0/4051142117 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f201401aa90 con 0x56363c37a370 2024-09-12T01:35:08.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f20027fc640 1 -- 172.21.15.81:0/4051142117 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f201400f040 con 0x56363c37a370 2024-09-12T01:35:08.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f2023686740 10 client.17037 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:08.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f2023686740 10 client.17037 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:35:08.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f2023686740 20 client.17037 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:08.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f2023686740 1 --2- 172.21.15.81:0/4051142117 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56363c38a000 0x56363c38c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f2023686740 4 client.17037 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:08.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.067+0000 7f2023686740 1 -- 172.21.15.81:0/4051142117 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56363c2e2860 con 0x56363c38a000 2024-09-12T01:35:08.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.068+0000 7f201affd640 1 --2- 172.21.15.81:0/4051142117 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56363c38a000 0x56363c38c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.068+0000 7f20027fc640 10 client.17037 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:35:08.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.068+0000 7f201affd640 1 --2- 172.21.15.81:0/4051142117 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56363c38a000 0x56363c38c3f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1841829108c04b72 server_cookie=43bda36a9f72085e in_seq=0 out_seq=0 2024-09-12T01:35:08.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f20027fc640 1 -- 172.21.15.81:0/4051142117 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56363c2e2860 con 0x56363c38a000 2024-09-12T01:35:08.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f20027fc640 10 client.17037 handle_command_reply: tid=0 2024-09-12T01:35:08.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f2023686740 1 client.17037 shutdown 2024-09-12T01:35:08.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f2023686740 1 -- 172.21.15.81:0/4051142117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 msgr2=0x56363c377640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:08.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f2023686740 1 --2- 172.21.15.81:0/4051142117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 0x56363c377640 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f201400eda0 tx=0x7f2014011800 comp rx=0 tx=0).stop 2024-09-12T01:35:08.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f2023686740 1 -- 172.21.15.81:0/4051142117 shutdown_connections 2024-09-12T01:35:08.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f2023686740 1 --2- 172.21.15.81:0/4051142117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 0x56363c377640 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f2023686740 1 --2- 172.21.15.81:0/4051142117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c370b40 0x56363c377030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f2023686740 1 --2- 172.21.15.81:0/4051142117 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56363c38a000 0x56363c38c3f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f2023686740 1 --2- 172.21.15.81:0/4051142117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c36f5d0 0x56363c379d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f2023686740 1 -- 172.21.15.81:0/4051142117 >> 172.21.15.81:0/4051142117 conn(0x56363c338310 msgr2=0x56363c371930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:08.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f20027fc640 0 client.17037 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:35:08.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f2023686740 1 -- 172.21.15.81:0/4051142117 shutdown_connections 2024-09-12T01:35:08.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f2023686740 1 -- 172.21.15.81:0/4051142117 wait complete. 2024-09-12T01:35:08.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.069+0000 7f2023686740 20 client.17037 trim_cache size 0 max 16384 2024-09-12T01:35:08.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.082+0000 7f2023686740 1 Processor -- start 2024-09-12T01:35:08.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.082+0000 7f2023686740 1 -- start start 2024-09-12T01:35:08.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.082+0000 7f2023686740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c36f5d0 0x56363c386310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.082+0000 7f2023686740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c370b40 0x56363c372120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.082+0000 7f2023686740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 0x56363c372660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.082+0000 7f2023686740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f201c1ad880 con 0x56363c37a370 2024-09-12T01:35:08.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.082+0000 7f2023686740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f201c1af3c0 con 0x56363c370b40 2024-09-12T01:35:08.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.082+0000 7f2023686740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f201c1adf50 con 0x56363c36f5d0 2024-09-12T01:35:08.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 0x56363c372660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 0x56363c372660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53102/0 (socket says 172.21.15.81:53102) 2024-09-12T01:35:08.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f201b7fe640 1 -- 172.21.15.81:0/514481609 learned_addr learned my addr 172.21.15.81:0/514481609 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:08.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f201affd640 1 --2- 172.21.15.81:0/514481609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c36f5d0 0x56363c386310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f201a7fc640 1 --2- 172.21.15.81:0/514481609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c370b40 0x56363c372120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f201b7fe640 1 -- 172.21.15.81:0/514481609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c36f5d0 msgr2=0x56363c386310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:08.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f201b7fe640 1 --2- 172.21.15.81:0/514481609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c36f5d0 0x56363c386310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f201b7fe640 1 -- 172.21.15.81:0/514481609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c370b40 msgr2=0x56363c372120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:08.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f201b7fe640 1 --2- 172.21.15.81:0/514481609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c370b40 0x56363c372120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f201b7fe640 1 -- 172.21.15.81:0/514481609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56363c36f2d0 con 0x56363c37a370 2024-09-12T01:35:08.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f201affd640 1 --2- 172.21.15.81:0/514481609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c36f5d0 0x56363c386310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:08.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f201a7fc640 1 --2- 172.21.15.81:0/514481609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c370b40 0x56363c372120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:08.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f201b7fe640 1 --2- 172.21.15.81:0/514481609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 0x56363c372660 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f201400ed70 tx=0x7f201400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fd266da5d9ec04 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:08.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f2010ff9640 1 -- 172.21.15.81:0/514481609 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014034040 con 0x56363c37a370 2024-09-12T01:35:08.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f2010ff9640 1 -- 172.21.15.81:0/514481609 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20140099f0 con 0x56363c37a370 2024-09-12T01:35:08.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.083+0000 7f2010ff9640 1 -- 172.21.15.81:0/514481609 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20140257b0 con 0x56363c37a370 2024-09-12T01:35:08.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.084+0000 7f2023686740 1 -- 172.21.15.81:0/514481609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 msgr2=0x56363c372660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:08.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.084+0000 7f2023686740 1 --2- 172.21.15.81:0/514481609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 0x56363c372660 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f201400ed70 tx=0x7f201400e6c0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.084+0000 7f2023686740 1 -- 172.21.15.81:0/514481609 shutdown_connections 2024-09-12T01:35:08.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.084+0000 7f2023686740 1 --2- 172.21.15.81:0/514481609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c37a370 0x56363c372660 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.084+0000 7f2023686740 1 --2- 172.21.15.81:0/514481609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c370b40 0x56363c372120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.084+0000 7f2023686740 1 --2- 172.21.15.81:0/514481609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c36f5d0 0x56363c386310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.084+0000 7f2023686740 1 -- 172.21.15.81:0/514481609 >> 172.21.15.81:0/514481609 conn(0x56363c338310 msgr2=0x56363c3790b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:08.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.084+0000 7f2023686740 1 -- 172.21.15.81:0/514481609 shutdown_connections 2024-09-12T01:35:08.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.084+0000 7f2023686740 1 -- 172.21.15.81:0/514481609 wait complete. 2024-09-12T01:35:08.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.084+0000 7f2023686740 1 -- start start 2024-09-12T01:35:08.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.084+0000 7f2023686740 1 Processor -- start 2024-09-12T01:35:08.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f2023686740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c36f5d0 0x56363c37d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f2023686740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c370b40 0x56363c37d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f2023686740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c37a370 0x56363c3f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f2023686740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f201c1aecf0 con 0x56363c36f5d0 2024-09-12T01:35:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f2023686740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f201c1ae620 con 0x56363c37a370 2024-09-12T01:35:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f2023686740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f201c1ab860 con 0x56363c370b40 2024-09-12T01:35:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f2023686740 10 client.0 _ll_register_callbacks cb 0x7f201401e020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f201affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c36f5d0 0x56363c37d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f201affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c36f5d0 0x56363c37d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53114/0 (socket says 172.21.15.81:53114) 2024-09-12T01:35:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f201affd640 1 -- 172.21.15.81:0/758898384 learned_addr learned my addr 172.21.15.81:0/758898384 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f201b7fe640 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c37a370 0x56363c3f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f201a7fc640 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c370b40 0x56363c37d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f201affd640 1 -- 172.21.15.81:0/758898384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c370b40 msgr2=0x56363c37d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f201affd640 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c370b40 0x56363c37d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f201affd640 1 -- 172.21.15.81:0/758898384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c37a370 msgr2=0x56363c3f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f201affd640 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c37a370 0x56363c3f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f201affd640 1 -- 172.21.15.81:0/758898384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56363c36b4f0 con 0x56363c36f5d0 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f201b7fe640 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c37a370 0x56363c3f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f201a7fc640 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c370b40 0x56363c37d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f201affd640 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c36f5d0 0x56363c37d480 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f200c005fd0 tx=0x7f200c0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b47b9cd96f2153 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.085+0000 7f20027fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f20027fc640 1 -- 172.21.15.81:0/758898384 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c01b7c0 con 0x56363c36f5d0 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f20027fc640 1 -- 172.21.15.81:0/758898384 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f200c01b960 con 0x56363c36f5d0 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f2023686740 1 -- 172.21.15.81:0/758898384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20140099f0 con 0x56363c36f5d0 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f20027fc640 1 -- 172.21.15.81:0/758898384 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f200c01bb60 con 0x56363c36f5d0 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f2023686740 10 client.17043 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f2023686740 1 -- 172.21.15.81:0/758898384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56363c3f8250 con 0x56363c36f5d0 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f20027fc640 1 -- 172.21.15.81:0/758898384 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20140099f0 con 0x56363c36f5d0 2024-09-12T01:35:08.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f20027fc640 1 -- 172.21.15.81:0/758898384 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f200c022070 con 0x56363c36f5d0 2024-09-12T01:35:08.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f2023686740 10 client.17043 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:08.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f2023686740 10 client.17043 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:35:08.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f2023686740 20 client.17043 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:08.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f2023686740 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56363c3f89a0 0x56363c3fadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:08.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f2023686740 4 client.17043 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:35:08.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f2023686740 1 -- 172.21.15.81:0/758898384 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56363c2dcd70 con 0x56363c3f89a0 2024-09-12T01:35:08.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.086+0000 7f201a7fc640 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56363c3f89a0 0x56363c3fadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:08.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f20027fc640 10 client.17043 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:35:08.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f201a7fc640 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56363c3f89a0 0x56363c3fadc0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b6b165df166b580c server_cookie=cb4b5c1cd3eed867 in_seq=0 out_seq=0 2024-09-12T01:35:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f20027fc640 1 -- 172.21.15.81:0/758898384 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56363c2dcd70 con 0x56363c3f89a0 2024-09-12T01:35:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f20027fc640 10 client.17043 handle_command_reply: tid=0 2024-09-12T01:35:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f2023686740 1 client.17043 shutdown 2024-09-12T01:35:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f2023686740 1 -- 172.21.15.81:0/758898384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c36f5d0 msgr2=0x56363c37d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f2023686740 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c36f5d0 0x56363c37d480 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f200c005fd0 tx=0x7f200c0128e0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f2023686740 1 -- 172.21.15.81:0/758898384 shutdown_connections 2024-09-12T01:35:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f2023686740 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56363c37a370 0x56363c3f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f2023686740 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x56363c3f89a0 0x56363c3fadc0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f2023686740 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56363c370b40 0x56363c37d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f2023686740 1 --2- 172.21.15.81:0/758898384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56363c36f5d0 0x56363c37d480 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f2023686740 1 -- 172.21.15.81:0/758898384 >> 172.21.15.81:0/758898384 conn(0x56363c338310 msgr2=0x56363c36a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:08.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f20027fc640 0 client.17043 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:35:08.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f2023686740 1 -- 172.21.15.81:0/758898384 shutdown_connections 2024-09-12T01:35:08.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f2023686740 1 -- 172.21.15.81:0/758898384 wait complete. 2024-09-12T01:35:08.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.087+0000 7f2023686740 20 client.17043 trim_cache size 0 max 16384 2024-09-12T01:35:08.094 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:35:08.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.088+0000 7f20212ad640 1 -- 172.21.15.81:0/1551855381 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f20080a2cf0 msgr2=0x7f20080a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:08.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.088+0000 7f20212ad640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f20080a2cf0 0x7f20080a51b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f201401f000 tx=0x7f2014020000 comp rx=0 tx=0).stop 2024-09-12T01:35:08.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.088+0000 7f20212ad640 1 -- 172.21.15.81:0/1551855381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c103650 msgr2=0x7f201c198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:08.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.088+0000 7f20212ad640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c103650 0x7f201c198980 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2004005940 tx=0x7f20040040c0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.088+0000 7f20212ad640 1 -- 172.21.15.81:0/1551855381 shutdown_connections 2024-09-12T01:35:08.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.088+0000 7f20212ad640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f20080a2cf0 0x7f20080a51b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.088+0000 7f20212ad640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f201c10c160 0x7f201c19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.088+0000 7f20212ad640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f201c103650 0x7f201c198980 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.088+0000 7f20212ad640 1 --2- 172.21.15.81:0/1551855381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f201c102d30 0x7f201c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:08.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.088+0000 7f20212ad640 1 -- 172.21.15.81:0/1551855381 >> 172.21.15.81:0/1551855381 conn(0x7f201c0fc790 msgr2=0x7f201c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:08.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.088+0000 7f20212ad640 1 -- 172.21.15.81:0/1551855381 shutdown_connections 2024-09-12T01:35:08.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:08.088+0000 7f20212ad640 1 -- 172.21.15.81:0/1551855381 wait complete. 2024-09-12T01:35:08.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:35:09.048 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.502+0000 7f8978268640 1 -- 172.21.15.81:0/3494965477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8970106f10 msgr2=0x7f897010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.502+0000 7f8978268640 1 --2- 172.21.15.81:0/3494965477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8970106f10 0x7f897010ea90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8968009ca0 tx=0x7f896802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.502+0000 7f8978268640 1 -- 172.21.15.81:0/3494965477 shutdown_connections 2024-09-12T01:35:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.502+0000 7f8978268640 1 --2- 172.21.15.81:0/3494965477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8970106f10 0x7f897010ea90 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.502+0000 7f8978268640 1 --2- 172.21.15.81:0/3494965477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8970102790 0x7f89701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.502+0000 7f8978268640 1 --2- 172.21.15.81:0/3494965477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8970101de0 0x7f89701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.502+0000 7f8978268640 1 -- 172.21.15.81:0/3494965477 >> 172.21.15.81:0/3494965477 conn(0x7f89700fd8c0 msgr2=0x7f89700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.502+0000 7f8978268640 1 -- 172.21.15.81:0/3494965477 shutdown_connections 2024-09-12T01:35:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.502+0000 7f8978268640 1 -- 172.21.15.81:0/3494965477 wait complete. 2024-09-12T01:35:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.503+0000 7f8978268640 1 Processor -- start 2024-09-12T01:35:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.503+0000 7f8978268640 1 -- start start 2024-09-12T01:35:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.503+0000 7f8978268640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8970101de0 0x7f8970198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.503+0000 7f8978268640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8970102790 0x7f8970198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8978268640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8970106f10 0x7f897019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8978268640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8970111f70 con 0x7f8970102790 2024-09-12T01:35:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8978268640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8970111df0 con 0x7f8970106f10 2024-09-12T01:35:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8978268640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f89701120f0 con 0x7f8970101de0 2024-09-12T01:35:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8975803640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8970102790 0x7f8970198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8975803640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8970102790 0x7f8970198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53134/0 (socket says 172.21.15.81:53134) 2024-09-12T01:35:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8975803640 1 -- 172.21.15.81:0/4289479286 learned_addr learned my addr 172.21.15.81:0/4289479286 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8976805640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8970106f10 0x7f897019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8976004640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8970101de0 0x7f8970198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8975803640 1 -- 172.21.15.81:0/4289479286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8970101de0 msgr2=0x7f8970198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8975803640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8970101de0 0x7f8970198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8975803640 1 -- 172.21.15.81:0/4289479286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8970106f10 msgr2=0x7f897019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8975803640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8970106f10 0x7f897019cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8975803640 1 -- 172.21.15.81:0/4289479286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897019d2e0 con 0x7f8970102790 2024-09-12T01:35:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8976805640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8970106f10 0x7f897019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8975803640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8970102790 0x7f8970198870 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f896000c970 tx=0x7f896000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f89677fe640 1 -- 172.21.15.81:0/4289479286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960007bb0 con 0x7f8970102790 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f89677fe640 1 -- 172.21.15.81:0/4289479286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8960007d50 con 0x7f8970102790 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f89677fe640 1 -- 172.21.15.81:0/4289479286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896000f450 con 0x7f8970102790 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.504+0000 7f8978268640 1 -- 172.21.15.81:0/4289479286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897019d5d0 con 0x7f8970102790 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.505+0000 7f8978268640 1 -- 172.21.15.81:0/4289479286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89701a4eb0 con 0x7f8970102790 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.507+0000 7f89677fe640 1 -- 172.21.15.81:0/4289479286 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f8960005020 con 0x7f8970102790 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.507+0000 7f897a641740 1 Processor -- start 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.507+0000 7f897a641740 1 -- start start 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.507+0000 7f897a641740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 0x55863bf6f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f897a641740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 0x55863bf6fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f897a641740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf7c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f897a641740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55863bed52f0 con 0x55863bf7a370 2024-09-12T01:35:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f897a641740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55863be7ccf0 con 0x55863bf6f5d0 2024-09-12T01:35:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f897a641740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55863bed12b0 con 0x55863bf70b40 2024-09-12T01:35:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f8975803640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf7c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f8975803640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf7c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53142/0 (socket says 172.21.15.81:53142) 2024-09-12T01:35:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f8975803640 1 -- 172.21.15.81:0/2981183429 learned_addr learned my addr 172.21.15.81:0/2981183429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f8976004640 1 --2- 172.21.15.81:0/2981183429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 0x55863bf6fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f8976805640 1 --2- 172.21.15.81:0/2981183429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 0x55863bf6f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f89677fe640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f895c0a2cf0 0x7f895c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f8975803640 1 -- 172.21.15.81:0/2981183429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 msgr2=0x55863bf6f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f8975803640 1 --2- 172.21.15.81:0/2981183429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 0x55863bf6f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f8975803640 1 -- 172.21.15.81:0/2981183429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 msgr2=0x55863bf6fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f8975803640 1 --2- 172.21.15.81:0/2981183429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 0x55863bf6fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f8975803640 1 -- 172.21.15.81:0/2981183429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55863be613a0 con 0x55863bf7a370 2024-09-12T01:35:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f8976805640 1 --2- 172.21.15.81:0/2981183429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 0x55863bf6f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:09.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f8976805640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f895c0a2cf0 0x7f895c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f89677fe640 1 -- 172.21.15.81:0/4289479286 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f89600cf2a0 con 0x7f8970102790 2024-09-12T01:35:09.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.508+0000 7f8975803640 1 --2- 172.21.15.81:0/2981183429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf7c760 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f89600cc900 tx=0x7f8960090c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7285bea10b373b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:09.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.509+0000 7f8964dea640 1 -- 172.21.15.81:0/2981183429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896009b2d0 con 0x55863bf7a370 2024-09-12T01:35:09.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.509+0000 7f8964dea640 1 -- 172.21.15.81:0/2981183429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8960094540 con 0x55863bf7a370 2024-09-12T01:35:09.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.509+0000 7f8976805640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f895c0a2cf0 0x7f895c0a51b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8968005cc0 tx=0x7f89680095c0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:09.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.509+0000 7f8964dea640 1 -- 172.21.15.81:0/2981183429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896006b660 con 0x55863bf7a370 2024-09-12T01:35:09.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.509+0000 7f897a641740 1 -- 172.21.15.81:0/2981183429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 msgr2=0x55863bf7c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:09.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.509+0000 7f897a641740 1 --2- 172.21.15.81:0/2981183429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf7c760 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f89600cc900 tx=0x7f8960090c20 comp rx=0 tx=0).stop 2024-09-12T01:35:09.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.509+0000 7f897a641740 1 -- 172.21.15.81:0/2981183429 shutdown_connections 2024-09-12T01:35:09.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.509+0000 7f897a641740 1 --2- 172.21.15.81:0/2981183429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf7c760 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.509+0000 7f897a641740 1 --2- 172.21.15.81:0/2981183429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 0x55863bf6fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.509+0000 7f897a641740 1 --2- 172.21.15.81:0/2981183429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 0x55863bf6f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.509+0000 7f897a641740 1 -- 172.21.15.81:0/2981183429 >> 172.21.15.81:0/2981183429 conn(0x55863bf38310 msgr2=0x55863bf6bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f897a641740 1 -- 172.21.15.81:0/2981183429 shutdown_connections 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f897a641740 1 -- 172.21.15.81:0/2981183429 wait complete. 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f897a641740 1 -- start start 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f897a641740 1 Processor -- start 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f897a641740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 0x55863bf79d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f897a641740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 0x55863bf76fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f897a641740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf77570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f897a641740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55863bf7d010 con 0x55863bf7a370 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f897a641740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55863be90060 con 0x55863bf6f5d0 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f897a641740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55863bf7d190 con 0x55863bf70b40 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f897a641740 10 client.0 _ll_register_callbacks cb 0x55863bbe38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:09.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f8976805640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf77570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f8976805640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf77570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53146/0 (socket says 172.21.15.81:53146) 2024-09-12T01:35:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.510+0000 7f8976805640 1 -- 172.21.15.81:0/172615637 learned_addr learned my addr 172.21.15.81:0/172615637 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f8975803640 1 --2- 172.21.15.81:0/172615637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 0x55863bf76fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f8976004640 1 --2- 172.21.15.81:0/172615637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 0x55863bf79d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f8976805640 1 -- 172.21.15.81:0/172615637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 msgr2=0x55863bf76fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f8976805640 1 --2- 172.21.15.81:0/172615637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 0x55863bf76fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f8976805640 1 -- 172.21.15.81:0/172615637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 msgr2=0x55863bf79d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f8976805640 1 --2- 172.21.15.81:0/172615637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 0x55863bf79d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f8976805640 1 -- 172.21.15.81:0/172615637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55863bc463c0 con 0x55863bf7a370 2024-09-12T01:35:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f8976805640 1 --2- 172.21.15.81:0/172615637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf77570 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8968035000 tx=0x7f8968031820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf10a3f81eed583 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f8959ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f8959ffb640 1 -- 172.21.15.81:0/172615637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968031d50 con 0x55863bf7a370 2024-09-12T01:35:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f8959ffb640 1 -- 172.21.15.81:0/172615637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f89680045c0 con 0x55863bf7a370 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f897a641740 1 -- 172.21.15.81:0/172615637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55863bee2860 con 0x55863bf7a370 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f8959ffb640 1 -- 172.21.15.81:0/172615637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f89680047c0 con 0x55863bf7a370 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f897a641740 10 client.17055 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f897a641740 1 -- 172.21.15.81:0/172615637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55863bf889d0 con 0x55863bf7a370 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.511+0000 7f8959ffb640 1 -- 172.21.15.81:0/172615637 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55863bee2860 con 0x55863bf7a370 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.512+0000 7f8959ffb640 1 -- 172.21.15.81:0/172615637 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f896804f070 con 0x55863bf7a370 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.512+0000 7f897a641740 10 client.17055 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.512+0000 7f897a641740 10 client.17055 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.512+0000 7f897a641740 20 client.17055 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.512+0000 7f897a641740 1 --2- 172.21.15.81:0/172615637 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55863bf89de0 0x55863bf8c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.512+0000 7f897a641740 4 client.17055 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.512+0000 7f897a641740 1 -- 172.21.15.81:0/172615637 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55863bedcd70 con 0x55863bf89de0 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.512+0000 7f8976004640 1 --2- 172.21.15.81:0/172615637 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55863bf89de0 0x55863bf8c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.512+0000 7f8976004640 1 --2- 172.21.15.81:0/172615637 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55863bf89de0 0x55863bf8c200 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=92532a59dab8ada7 server_cookie=836abe719c5173a7 in_seq=0 out_seq=0 2024-09-12T01:35:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.512+0000 7f8959ffb640 10 client.17055 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:35:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f8959ffb640 1 -- 172.21.15.81:0/172615637 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55863bedcd70 con 0x55863bf89de0 2024-09-12T01:35:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f8959ffb640 10 client.17055 handle_command_reply: tid=0 2024-09-12T01:35:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f897a641740 1 client.17055 shutdown 2024-09-12T01:35:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f897a641740 1 -- 172.21.15.81:0/172615637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 msgr2=0x55863bf77570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f897a641740 1 --2- 172.21.15.81:0/172615637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf77570 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8968035000 tx=0x7f8968031820 comp rx=0 tx=0).stop 2024-09-12T01:35:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f897a641740 1 -- 172.21.15.81:0/172615637 shutdown_connections 2024-09-12T01:35:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f897a641740 1 --2- 172.21.15.81:0/172615637 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55863bf89de0 0x55863bf8c200 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f897a641740 1 --2- 172.21.15.81:0/172615637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf77570 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f897a641740 1 --2- 172.21.15.81:0/172615637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 0x55863bf76fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f897a641740 1 --2- 172.21.15.81:0/172615637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 0x55863bf79d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f8959ffb640 0 client.17055 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:35:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f897a641740 1 -- 172.21.15.81:0/172615637 >> 172.21.15.81:0/172615637 conn(0x55863bf38310 msgr2=0x55863bf71990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f897a641740 1 -- 172.21.15.81:0/172615637 shutdown_connections 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f897a641740 1 -- 172.21.15.81:0/172615637 wait complete. 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.513+0000 7f897a641740 20 client.17055 trim_cache size 0 max 16384 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.526+0000 7f897a641740 1 Processor -- start 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.526+0000 7f897a641740 1 -- start start 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.526+0000 7f897a641740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 0x55863bf862b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.526+0000 7f897a641740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 0x55863bf6b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.526+0000 7f897a641740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf6ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.526+0000 7f897a641740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89701ad710 con 0x55863bf7a370 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.526+0000 7f897a641740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f89701af250 con 0x55863bf6f5d0 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.526+0000 7f897a641740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f89701adde0 con 0x55863bf70b40 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.526+0000 7f8976805640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf6ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f8976805640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf6ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53148/0 (socket says 172.21.15.81:53148) 2024-09-12T01:35:09.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f8976805640 1 -- 172.21.15.81:0/3221387090 learned_addr learned my addr 172.21.15.81:0/3221387090 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f8976004640 1 --2- 172.21.15.81:0/3221387090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 0x55863bf862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f8975803640 1 --2- 172.21.15.81:0/3221387090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 0x55863bf6b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f8976805640 1 -- 172.21.15.81:0/3221387090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 msgr2=0x55863bf6b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f8976805640 1 --2- 172.21.15.81:0/3221387090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 0x55863bf6b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f8976805640 1 -- 172.21.15.81:0/3221387090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 msgr2=0x55863bf862b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f8976805640 1 --2- 172.21.15.81:0/3221387090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 0x55863bf862b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f8976805640 1 -- 172.21.15.81:0/3221387090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55863bf70300 con 0x55863bf7a370 2024-09-12T01:35:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f8976004640 1 --2- 172.21.15.81:0/3221387090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 0x55863bf862b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f8976805640 1 --2- 172.21.15.81:0/3221387090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf6ba50 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8968031c20 tx=0x7f896802f4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f718f2e7b186bea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f895bfff640 1 -- 172.21.15.81:0/3221387090 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896805c070 con 0x55863bf7a370 2024-09-12T01:35:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f895bfff640 1 -- 172.21.15.81:0/3221387090 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8968036050 con 0x55863bf7a370 2024-09-12T01:35:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.527+0000 7f895bfff640 1 -- 172.21.15.81:0/3221387090 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896802fd50 con 0x55863bf7a370 2024-09-12T01:35:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.528+0000 7f897a641740 1 -- 172.21.15.81:0/3221387090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 msgr2=0x55863bf6ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.528+0000 7f897a641740 1 --2- 172.21.15.81:0/3221387090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf6ba50 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8968031c20 tx=0x7f896802f4e0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.528+0000 7f897a641740 1 -- 172.21.15.81:0/3221387090 shutdown_connections 2024-09-12T01:35:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.528+0000 7f897a641740 1 --2- 172.21.15.81:0/3221387090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf6ba50 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.528+0000 7f897a641740 1 --2- 172.21.15.81:0/3221387090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf70b40 0x55863bf6b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.528+0000 7f897a641740 1 --2- 172.21.15.81:0/3221387090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf6f5d0 0x55863bf862b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.528+0000 7f897a641740 1 -- 172.21.15.81:0/3221387090 >> 172.21.15.81:0/3221387090 conn(0x55863bf38310 msgr2=0x55863bf79050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.528+0000 7f897a641740 1 -- 172.21.15.81:0/3221387090 shutdown_connections 2024-09-12T01:35:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.528+0000 7f897a641740 1 -- 172.21.15.81:0/3221387090 wait complete. 2024-09-12T01:35:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.528+0000 7f897a641740 1 -- start start 2024-09-12T01:35:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.528+0000 7f897a641740 1 Processor -- start 2024-09-12T01:35:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f897a641740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf6f5d0 0x55863bf828c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f897a641740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf70b40 0x55863bf7dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f897a641740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf7e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f897a641740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89701aeb80 con 0x55863bf7a370 2024-09-12T01:35:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f897a641740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f89701ae4b0 con 0x55863bf70b40 2024-09-12T01:35:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f897a641740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f89701ab6f0 con 0x55863bf6f5d0 2024-09-12T01:35:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f897a641740 10 client.0 _ll_register_callbacks cb 0x7f8968009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8976805640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf7e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8976805640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf7e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53162/0 (socket says 172.21.15.81:53162) 2024-09-12T01:35:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8976805640 1 -- 172.21.15.81:0/2119795368 learned_addr learned my addr 172.21.15.81:0/2119795368 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8975803640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf70b40 0x55863bf7dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8976004640 1 --2- 172.21.15.81:0/2119795368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf6f5d0 0x55863bf828c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8976805640 1 -- 172.21.15.81:0/2119795368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf6f5d0 msgr2=0x55863bf828c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8976805640 1 --2- 172.21.15.81:0/2119795368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf6f5d0 0x55863bf828c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8976805640 1 -- 172.21.15.81:0/2119795368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf70b40 msgr2=0x55863bf7dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8976805640 1 --2- 172.21.15.81:0/2119795368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf70b40 0x55863bf7dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8976805640 1 -- 172.21.15.81:0/2119795368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55863bf7e670 con 0x55863bf7a370 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8976805640 1 --2- 172.21.15.81:0/2119795368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf7e130 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f89680307f0 tx=0x7f8968031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec07b92d2e015240 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8959ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8959ffb640 1 -- 172.21.15.81:0/2119795368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896805c040 con 0x55863bf7a370 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f8959ffb640 1 -- 172.21.15.81:0/2119795368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8469+0+0 (secure 0 0 0) 0x7f896802f810 con 0x55863bf7a370 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.529+0000 7f897a641740 1 -- 172.21.15.81:0/2119795368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8968036050 con 0x55863bf7a370 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.530+0000 7f8959ffb640 1 -- 172.21.15.81:0/2119795368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f896802fa10 con 0x55863bf7a370 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.530+0000 7f897a641740 10 client.17061 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.530+0000 7f897a641740 1 -- 172.21.15.81:0/2119795368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55863bff47f0 con 0x55863bf7a370 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.530+0000 7f8959ffb640 1 -- 172.21.15.81:0/2119795368 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8968036050 con 0x55863bf7a370 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.530+0000 7f8959ffb640 1 -- 172.21.15.81:0/2119795368 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f896804f040 con 0x55863bf7a370 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.530+0000 7f897a641740 10 client.17061 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.530+0000 7f897a641740 10 client.17061 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:35:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.530+0000 7f897a641740 20 client.17061 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.530+0000 7f897a641740 1 --2- 172.21.15.81:0/2119795368 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55863bff4e50 0x55863bff7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.530+0000 7f897a641740 4 client.17061 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:35:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.530+0000 7f897a641740 1 -- 172.21.15.81:0/2119795368 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55863be59170 con 0x55863bff4e50 2024-09-12T01:35:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.530+0000 7f8976004640 1 --2- 172.21.15.81:0/2119795368 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55863bff4e50 0x55863bff7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f8976004640 1 --2- 172.21.15.81:0/2119795368 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55863bff4e50 0x55863bff7240 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3b47bf4f59a3bb96 server_cookie=d42d4e728440aeba in_seq=0 out_seq=0 2024-09-12T01:35:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f8959ffb640 10 client.17061 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:35:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f8959ffb640 1 -- 172.21.15.81:0/2119795368 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55863be59170 con 0x55863bff4e50 2024-09-12T01:35:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f8959ffb640 10 client.17061 handle_command_reply: tid=0 2024-09-12T01:35:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f897a641740 1 client.17061 shutdown 2024-09-12T01:35:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f897a641740 1 -- 172.21.15.81:0/2119795368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 msgr2=0x55863bf7e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f897a641740 1 --2- 172.21.15.81:0/2119795368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf7e130 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f89680307f0 tx=0x7f8968031000 comp rx=0 tx=0).stop 2024-09-12T01:35:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f897a641740 1 -- 172.21.15.81:0/2119795368 shutdown_connections 2024-09-12T01:35:09.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f897a641740 1 --2- 172.21.15.81:0/2119795368 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55863bff4e50 0x55863bff7240 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f897a641740 1 --2- 172.21.15.81:0/2119795368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863bf7a370 0x55863bf7e130 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f897a641740 1 --2- 172.21.15.81:0/2119795368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55863bf70b40 0x55863bf7dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f8959ffb640 0 client.17061 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:35:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f897a641740 1 --2- 172.21.15.81:0/2119795368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55863bf6f5d0 0x55863bf828c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f897a641740 1 -- 172.21.15.81:0/2119795368 >> 172.21.15.81:0/2119795368 conn(0x55863bf38310 msgr2=0x55863bf71110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f897a641740 1 -- 172.21.15.81:0/2119795368 shutdown_connections 2024-09-12T01:35:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f897a641740 1 -- 172.21.15.81:0/2119795368 wait complete. 2024-09-12T01:35:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.531+0000 7f897a641740 20 client.17061 trim_cache size 0 max 16384 2024-09-12T01:35:09.547 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:35:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.532+0000 7f8978268640 1 -- 172.21.15.81:0/4289479286 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f895c0a2cf0 msgr2=0x7f895c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.532+0000 7f8978268640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f895c0a2cf0 0x7f895c0a51b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8968005cc0 tx=0x7f89680095c0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.532+0000 7f8978268640 1 -- 172.21.15.81:0/4289479286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8970102790 msgr2=0x7f8970198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.532+0000 7f8978268640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8970102790 0x7f8970198870 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f896000c970 tx=0x7f896000ce30 comp rx=0 tx=0).stop 2024-09-12T01:35:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.532+0000 7f8978268640 1 -- 172.21.15.81:0/4289479286 shutdown_connections 2024-09-12T01:35:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.532+0000 7f8978268640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f895c0a2cf0 0x7f895c0a51b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.532+0000 7f8978268640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8970106f10 0x7f897019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.532+0000 7f8978268640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8970102790 0x7f8970198870 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.532+0000 7f8978268640 1 --2- 172.21.15.81:0/4289479286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8970101de0 0x7f8970198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.532+0000 7f8978268640 1 -- 172.21.15.81:0/4289479286 >> 172.21.15.81:0/4289479286 conn(0x7f89700fd8c0 msgr2=0x7f89700febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.532+0000 7f8978268640 1 -- 172.21.15.81:0/4289479286 shutdown_connections 2024-09-12T01:35:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:09.532+0000 7f8978268640 1 -- 172.21.15.81:0/4289479286 wait complete. 2024-09-12T01:35:09.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:09 smithi081 ceph-mon[30920]: pgmap v215: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T01:35:10.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:09 smithi100 ceph-mon[35275]: pgmap v215: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T01:35:10.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:09 smithi189 ceph-mon[35357]: pgmap v215: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T01:35:10.277 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:35:10.522 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.980+0000 7fb1f7ca1640 1 -- 172.21.15.81:0/4220185449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0102790 msgr2=0x7fb1f01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.980+0000 7fb1f7ca1640 1 --2- 172.21.15.81:0/4220185449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0102790 0x7fb1f01067e0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009900 tx=0x7fb1e002a410 comp rx=0 tx=0).stop 2024-09-12T01:35:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.980+0000 7fb1f7ca1640 1 -- 172.21.15.81:0/4220185449 shutdown_connections 2024-09-12T01:35:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.980+0000 7fb1f7ca1640 1 --2- 172.21.15.81:0/4220185449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1f0106f10 0x7fb1f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.980+0000 7fb1f7ca1640 1 --2- 172.21.15.81:0/4220185449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0102790 0x7fb1f01067e0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.980+0000 7fb1f7ca1640 1 --2- 172.21.15.81:0/4220185449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f0101de0 0x7fb1f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.980+0000 7fb1f7ca1640 1 -- 172.21.15.81:0/4220185449 >> 172.21.15.81:0/4220185449 conn(0x7fb1f00fd8c0 msgr2=0x7fb1f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.980+0000 7fb1f7ca1640 1 -- 172.21.15.81:0/4220185449 shutdown_connections 2024-09-12T01:35:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.980+0000 7fb1f7ca1640 1 -- 172.21.15.81:0/4220185449 wait complete. 2024-09-12T01:35:10.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.981+0000 7fb1f7ca1640 1 Processor -- start 2024-09-12T01:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.981+0000 7fb1f7ca1640 1 -- start start 2024-09-12T01:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.981+0000 7fb1f7ca1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1f0101de0 0x7fb1f01a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.981+0000 7fb1f7ca1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f0102790 0x7fb1f01a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.981+0000 7fb1f7ca1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0106f10 0x7fb1f019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.981+0000 7fb1f7ca1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f0112010 con 0x7fb1f0106f10 2024-09-12T01:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.981+0000 7fb1f7ca1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f0111e90 con 0x7fb1f0101de0 2024-09-12T01:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.981+0000 7fb1f7ca1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f0112190 con 0x7fb1f0102790 2024-09-12T01:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.981+0000 7fb1f623e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0106f10 0x7fb1f019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.981+0000 7fb1f623e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0106f10 0x7fb1f019a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53190/0 (socket says 172.21.15.81:53190) 2024-09-12T01:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.981+0000 7fb1f623e640 1 -- 172.21.15.81:0/3490087667 learned_addr learned my addr 172.21.15.81:0/3490087667 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.981+0000 7fb1f5a3d640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1f0101de0 0x7fb1f01a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.981+0000 7fb1f523c640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f0102790 0x7fb1f01a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:10.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.982+0000 7fb1f623e640 1 -- 172.21.15.81:0/3490087667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f0102790 msgr2=0x7fb1f01a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.982+0000 7fb1f623e640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f0102790 0x7fb1f01a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.982+0000 7fb1f623e640 1 -- 172.21.15.81:0/3490087667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1f0101de0 msgr2=0x7fb1f01a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.982+0000 7fb1f623e640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1f0101de0 0x7fb1f01a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.982+0000 7fb1f623e640 1 -- 172.21.15.81:0/3490087667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f019ad00 con 0x7fb1f0106f10 2024-09-12T01:35:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.982+0000 7fb1f5a3d640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1f0101de0 0x7fb1f01a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.982+0000 7fb1f623e640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0106f10 0x7fb1f019a5d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800b970 tx=0x7fb1e800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.982+0000 7fb1e6ffd640 1 -- 172.21.15.81:0/3490087667 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8019070 con 0x7fb1f0106f10 2024-09-12T01:35:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.982+0000 7fb1e6ffd640 1 -- 172.21.15.81:0/3490087667 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1e800cb40 con 0x7fb1f0106f10 2024-09-12T01:35:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.982+0000 7fb1f7ca1640 1 -- 172.21.15.81:0/3490087667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f019aff0 con 0x7fb1f0106f10 2024-09-12T01:35:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.982+0000 7fb1e6ffd640 1 -- 172.21.15.81:0/3490087667 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8007650 con 0x7fb1f0106f10 2024-09-12T01:35:10.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.982+0000 7fb1f7ca1640 1 -- 172.21.15.81:0/3490087667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f01a72e0 con 0x7fb1f0106f10 2024-09-12T01:35:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.984+0000 7fb1e6ffd640 1 -- 172.21.15.81:0/3490087667 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb1e801c070 con 0x7fb1f0106f10 2024-09-12T01:35:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.984+0000 7fb1fa07a740 1 Processor -- start 2024-09-12T01:35:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1fa07a740 1 -- start start 2024-09-12T01:35:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1fa07a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aebb40 0x557276aea090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1fa07a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aea5d0 0x557276aeaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1fa07a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276af7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1fa07a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557276a502f0 con 0x557276af5370 2024-09-12T01:35:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1fa07a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5572769f7cf0 con 0x557276aea5d0 2024-09-12T01:35:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1fa07a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557276a4c2b0 con 0x557276aebb40 2024-09-12T01:35:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1f523c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276af7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1f523c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276af7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53196/0 (socket says 172.21.15.81:53196) 2024-09-12T01:35:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1e6ffd640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb1dc0a2cf0 0x7fb1dc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1f523c640 1 -- 172.21.15.81:0/2226746145 learned_addr learned my addr 172.21.15.81:0/2226746145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1f523c640 1 --2- 172.21.15.81:0/2226746145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aebb40 0x557276aea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1f5a3d640 1 --2- 172.21.15.81:0/2226746145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aea5d0 0x557276aeaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1f623e640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb1dc0a2cf0 0x7fb1dc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1e6ffd640 1 -- 172.21.15.81:0/3490087667 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fb1e80cea00 con 0x7fb1f0106f10 2024-09-12T01:35:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1f523c640 1 -- 172.21.15.81:0/2226746145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aebb40 msgr2=0x557276aea090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1f523c640 1 --2- 172.21.15.81:0/2226746145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aebb40 0x557276aea090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1f523c640 1 -- 172.21.15.81:0/2226746145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aea5d0 msgr2=0x557276aeaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1f523c640 1 --2- 172.21.15.81:0/2226746145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aea5d0 0x557276aeaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.985+0000 7fb1f523c640 1 -- 172.21.15.81:0/2226746145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572769dc3a0 con 0x557276af5370 2024-09-12T01:35:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.986+0000 7fb1f523c640 1 --2- 172.21.15.81:0/2226746145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276af7760 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0031550 tx=0x7fb1e00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc691323bb2ec974 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.986+0000 7fb1f623e640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb1dc0a2cf0 0x7fb1dc0a51b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80cc2f0 tx=0x7fb1e80660e0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.986+0000 7fb1dbfff640 1 -- 172.21.15.81:0/2226746145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0035040 con 0x557276af5370 2024-09-12T01:35:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.986+0000 7fb1dbfff640 1 -- 172.21.15.81:0/2226746145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1e00319e0 con 0x557276af5370 2024-09-12T01:35:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.986+0000 7fb1dbfff640 1 -- 172.21.15.81:0/2226746145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0004a00 con 0x557276af5370 2024-09-12T01:35:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.987+0000 7fb1fa07a740 1 -- 172.21.15.81:0/2226746145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 msgr2=0x557276af7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.987+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/2226746145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276af7760 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0031550 tx=0x7fb1e00058d0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.987+0000 7fb1fa07a740 1 -- 172.21.15.81:0/2226746145 shutdown_connections 2024-09-12T01:35:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.987+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/2226746145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276af7760 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.987+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/2226746145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aea5d0 0x557276aeaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.987+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/2226746145 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aebb40 0x557276aea090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.987+0000 7fb1fa07a740 1 -- 172.21.15.81:0/2226746145 >> 172.21.15.81:0/2226746145 conn(0x557276ab3310 msgr2=0x557276ae6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.987+0000 7fb1fa07a740 1 -- 172.21.15.81:0/2226746145 shutdown_connections 2024-09-12T01:35:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.987+0000 7fb1fa07a740 1 -- 172.21.15.81:0/2226746145 wait complete. 2024-09-12T01:35:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.987+0000 7fb1fa07a740 1 -- start start 2024-09-12T01:35:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.987+0000 7fb1fa07a740 1 Processor -- start 2024-09-12T01:35:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1fa07a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276af4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1fa07a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 0x557276af2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1fa07a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276af2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1fa07a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557276af8010 con 0x557276af5370 2024-09-12T01:35:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1fa07a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557276a0b060 con 0x557276aebb40 2024-09-12T01:35:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1fa07a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557276af8190 con 0x557276aea5d0 2024-09-12T01:35:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1fa07a740 10 client.0 _ll_register_callbacks cb 0x55727675e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1f523c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276af2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1f523c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276af2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53198/0 (socket says 172.21.15.81:53198) 2024-09-12T01:35:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1f523c640 1 -- 172.21.15.81:0/3829435700 learned_addr learned my addr 172.21.15.81:0/3829435700 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1f5a3d640 1 --2- 172.21.15.81:0/3829435700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 0x557276af2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1f523c640 1 --2- 172.21.15.81:0/3829435700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276af4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1f523c640 1 -- 172.21.15.81:0/3829435700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 msgr2=0x557276af4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1f523c640 1 --2- 172.21.15.81:0/3829435700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276af4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1f523c640 1 -- 172.21.15.81:0/3829435700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 msgr2=0x557276af2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1f523c640 1 --2- 172.21.15.81:0/3829435700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 0x557276af2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1f523c640 1 -- 172.21.15.81:0/3829435700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572767c13c0 con 0x557276af5370 2024-09-12T01:35:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1f523c640 1 --2- 172.21.15.81:0/3829435700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276af2610 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0004650 tx=0x7fb1e0004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a5cff6c959e58a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1d97fa640 1 -- 172.21.15.81:0/3829435700 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0035040 con 0x557276af5370 2024-09-12T01:35:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1d97fa640 1 -- 172.21.15.81:0/3829435700 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fb1e0004bb0 con 0x557276af5370 2024-09-12T01:35:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.988+0000 7fb1fa07a740 1 -- 172.21.15.81:0/3829435700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1e00319e0 con 0x557276af5370 2024-09-12T01:35:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.989+0000 7fb1d97fa640 1 -- 172.21.15.81:0/3829435700 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb1e005b050 con 0x557276af5370 2024-09-12T01:35:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.989+0000 7fb1fa07a740 10 client.17073 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.989+0000 7fb1fa07a740 1 -- 172.21.15.81:0/3829435700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557276b03ab0 con 0x557276af5370 2024-09-12T01:35:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.989+0000 7fb1d97fa640 1 -- 172.21.15.81:0/3829435700 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1e00319e0 con 0x557276af5370 2024-09-12T01:35:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.989+0000 7fb1d97fa640 1 -- 172.21.15.81:0/3829435700 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb1e003a040 con 0x557276af5370 2024-09-12T01:35:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.989+0000 7fb1fa07a740 10 client.17073 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.989+0000 7fb1fa07a740 10 client.17073 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:35:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.989+0000 7fb1fa07a740 20 client.17073 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.989+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/3829435700 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x557276b04e00 0x557276b071f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.989+0000 7fb1fa07a740 4 client.17073 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.989+0000 7fb1fa07a740 1 -- 172.21.15.81:0/3829435700 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557276a5d860 con 0x557276b04e00 2024-09-12T01:35:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.989+0000 7fb1f5a3d640 1 --2- 172.21.15.81:0/3829435700 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x557276b04e00 0x557276b071f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:10.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.990+0000 7fb1d97fa640 10 client.17073 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:35:10.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.990+0000 7fb1f5a3d640 1 --2- 172.21.15.81:0/3829435700 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x557276b04e00 0x557276b071f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=22f671a3b7642aec server_cookie=f10aa84f2138dd38 in_seq=0 out_seq=0 2024-09-12T01:35:10.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1d97fa640 1 -- 172.21.15.81:0/3829435700 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557276a5d860 con 0x557276b04e00 2024-09-12T01:35:10.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1d97fa640 10 client.17073 handle_command_reply: tid=0 2024-09-12T01:35:10.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1fa07a740 1 client.17073 shutdown 2024-09-12T01:35:10.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1fa07a740 1 -- 172.21.15.81:0/3829435700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 msgr2=0x557276af2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:10.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/3829435700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276af2610 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0004650 tx=0x7fb1e0004490 comp rx=0 tx=0).stop 2024-09-12T01:35:10.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1fa07a740 1 -- 172.21.15.81:0/3829435700 shutdown_connections 2024-09-12T01:35:10.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/3829435700 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x557276b04e00 0x557276b071f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/3829435700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276af2610 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1d97fa640 0 client.17073 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:35:10.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/3829435700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 0x557276af2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/3829435700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276af4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:10.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1fa07a740 1 -- 172.21.15.81:0/3829435700 >> 172.21.15.81:0/3829435700 conn(0x557276ab3310 msgr2=0x557276aec960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:10.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1fa07a740 1 -- 172.21.15.81:0/3829435700 shutdown_connections 2024-09-12T01:35:10.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1fa07a740 1 -- 172.21.15.81:0/3829435700 wait complete. 2024-09-12T01:35:10.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:10.991+0000 7fb1fa07a740 20 client.17073 trim_cache size 0 max 16384 2024-09-12T01:35:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.004+0000 7fb1fa07a740 1 Processor -- start 2024-09-12T01:35:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.004+0000 7fb1fa07a740 1 -- start start 2024-09-12T01:35:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.004+0000 7fb1fa07a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276af3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.004+0000 7fb1fa07a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 0x557276b0a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.004+0000 7fb1fa07a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276b0a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.004+0000 7fb1fa07a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f01afbd0 con 0x557276af5370 2024-09-12T01:35:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.004+0000 7fb1fa07a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f01b1710 con 0x557276aebb40 2024-09-12T01:35:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.004+0000 7fb1fa07a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f01b02a0 con 0x557276aea5d0 2024-09-12T01:35:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.004+0000 7fb1f523c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276b0a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.004+0000 7fb1f523c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276b0a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53212/0 (socket says 172.21.15.81:53212) 2024-09-12T01:35:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.004+0000 7fb1f523c640 1 -- 172.21.15.81:0/4034735284 learned_addr learned my addr 172.21.15.81:0/4034735284 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.004+0000 7fb1f5a3d640 1 --2- 172.21.15.81:0/4034735284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 0x557276b0a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.005+0000 7fb1f523c640 1 --2- 172.21.15.81:0/4034735284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276af3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.005+0000 7fb1f523c640 1 -- 172.21.15.81:0/4034735284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 msgr2=0x557276af3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.005+0000 7fb1f523c640 1 --2- 172.21.15.81:0/4034735284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276af3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.005+0000 7fb1f523c640 1 -- 172.21.15.81:0/4034735284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 msgr2=0x557276b0a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:11.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.005+0000 7fb1f523c640 1 --2- 172.21.15.81:0/4034735284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 0x557276b0a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.005+0000 7fb1f523c640 1 -- 172.21.15.81:0/4034735284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557276aea2d0 con 0x557276af5370 2024-09-12T01:35:11.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.005+0000 7fb1f523c640 1 --2- 172.21.15.81:0/4034735284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276b0a750 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb1e004a570 tx=0x7fb1e0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc635df84dd221c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:11.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.005+0000 7fb1db7fe640 1 -- 172.21.15.81:0/4034735284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0035070 con 0x557276af5370 2024-09-12T01:35:11.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.005+0000 7fb1db7fe640 1 -- 172.21.15.81:0/4034735284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1e0052070 con 0x557276af5370 2024-09-12T01:35:11.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.005+0000 7fb1db7fe640 1 -- 172.21.15.81:0/4034735284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e003d960 con 0x557276af5370 2024-09-12T01:35:11.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 -- 172.21.15.81:0/4034735284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 msgr2=0x557276b0a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:11.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/4034735284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276b0a750 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb1e004a570 tx=0x7fb1e0005fd0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 -- 172.21.15.81:0/4034735284 shutdown_connections 2024-09-12T01:35:11.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/4034735284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276b0a750 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/4034735284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 0x557276b0a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/4034735284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276af3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 -- 172.21.15.81:0/4034735284 >> 172.21.15.81:0/4034735284 conn(0x557276ab3310 msgr2=0x557276af3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:11.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 -- 172.21.15.81:0/4034735284 shutdown_connections 2024-09-12T01:35:11.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 -- 172.21.15.81:0/4034735284 wait complete. 2024-09-12T01:35:11.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 -- start start 2024-09-12T01:35:11.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 Processor -- start 2024-09-12T01:35:11.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276b0a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:11.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 0x557276b07ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:11.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276b08010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:11.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f01b1040 con 0x557276af5370 2024-09-12T01:35:11.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f01b0970 con 0x557276aebb40 2024-09-12T01:35:11.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f01adbd0 con 0x557276aea5d0 2024-09-12T01:35:11.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.006+0000 7fb1fa07a740 10 client.0 _ll_register_callbacks cb 0x7fb1ec0071a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:11.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1f523c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276b08010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:11.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1f523c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276b0a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:11.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1f523c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276b0a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.81:43730/0 (socket says 172.21.15.81:43730) 2024-09-12T01:35:11.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1f523c640 1 -- 172.21.15.81:0/464001648 learned_addr learned my addr 172.21.15.81:0/464001648 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:11.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1f5a3d640 1 --2- 172.21.15.81:0/464001648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 0x557276b07ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:11.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1f5a3d640 1 -- 172.21.15.81:0/464001648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 msgr2=0x557276b0a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:11.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1f5a3d640 1 --2- 172.21.15.81:0/464001648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276b0a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1f5a3d640 1 -- 172.21.15.81:0/464001648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 msgr2=0x557276b08010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:11.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1f5a3d640 1 --2- 172.21.15.81:0/464001648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276b08010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1f5a3d640 1 -- 172.21.15.81:0/464001648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557276b08650 con 0x557276aebb40 2024-09-12T01:35:11.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1f523c640 1 --2- 172.21.15.81:0/464001648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276b0a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:11.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1f5a3d640 1 --2- 172.21.15.81:0/464001648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 0x557276b07ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x557276af8220 tx=0x7fb1ec0157f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f4272a789e38b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:11.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-12T01:35:11.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1d97fa640 1 -- 172.21.15.81:0/464001648 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0145c0 con 0x557276aebb40 2024-09-12T01:35:11.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1fa07a740 1 -- 172.21.15.81:0/464001648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1e0052070 con 0x557276aebb40 2024-09-12T01:35:11.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.007+0000 7fb1d97fa640 1 -- 172.21.15.81:0/464001648 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fb1ec014760 con 0x557276aebb40 2024-09-12T01:35:11.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.008+0000 7fb1d97fa640 1 -- 172.21.15.81:0/464001648 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb1ec014960 con 0x557276aebb40 2024-09-12T01:35:11.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.008+0000 7fb1fa07a740 10 client.26204 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:11.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.008+0000 7fb1fa07a740 1 -- 172.21.15.81:0/464001648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557276b6f600 con 0x557276aebb40 2024-09-12T01:35:11.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.008+0000 7fb1d97fa640 1 -- 172.21.15.81:0/464001648 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1e0052070 con 0x557276aebb40 2024-09-12T01:35:11.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.008+0000 7fb1d97fa640 1 -- 172.21.15.81:0/464001648 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb1ec025af0 con 0x557276aebb40 2024-09-12T01:35:11.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.008+0000 7fb1fa07a740 10 client.26204 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:11.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.008+0000 7fb1fa07a740 10 client.26204 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:35:11.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.008+0000 7fb1fa07a740 20 client.26204 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:11.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.008+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/464001648 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x557276b6fd00 0x557276b72120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:11.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.008+0000 7fb1fa07a740 4 client.26204 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:35:11.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.008+0000 7fb1fa07a740 1 -- 172.21.15.81:0/464001648 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557276a57d70 con 0x557276b6fd00 2024-09-12T01:35:11.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.008+0000 7fb1f523c640 1 --2- 172.21.15.81:0/464001648 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x557276b6fd00 0x557276b72120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:11.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1d97fa640 10 client.26204 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:35:11.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1f523c640 1 --2- 172.21.15.81:0/464001648 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x557276b6fd00 0x557276b72120 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=55e921ed21c1743a server_cookie=b055ab77cf84bac1 in_seq=0 out_seq=0 2024-09-12T01:35:11.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1d97fa640 1 -- 172.21.15.81:0/464001648 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557276a57d70 con 0x557276b6fd00 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1d97fa640 10 client.26204 handle_command_reply: tid=0 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1fa07a740 1 client.26204 shutdown 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1fa07a740 1 -- 172.21.15.81:0/464001648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 msgr2=0x557276b07ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/464001648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 0x557276b07ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x557276af8220 tx=0x7fb1ec0157f0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1fa07a740 1 -- 172.21.15.81:0/464001648 shutdown_connections 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/464001648 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x557276b6fd00 0x557276b72120 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/464001648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557276af5370 0x557276b08010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/464001648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557276aebb40 0x557276b07ad0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1d97fa640 0 client.26204 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1fa07a740 1 --2- 172.21.15.81:0/464001648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557276aea5d0 0x557276b0a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1fa07a740 1 -- 172.21.15.81:0/464001648 >> 172.21.15.81:0/464001648 conn(0x557276ab3310 msgr2=0x557276af40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1fa07a740 1 -- 172.21.15.81:0/464001648 shutdown_connections 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1fa07a740 1 -- 172.21.15.81:0/464001648 wait complete. 2024-09-12T01:35:11.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.009+0000 7fb1fa07a740 20 client.26204 trim_cache size 0 max 16384 2024-09-12T01:35:11.018 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:35:11.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.010+0000 7fb1f7ca1640 1 -- 172.21.15.81:0/3490087667 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb1dc0a2cf0 msgr2=0x7fb1dc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:11.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.010+0000 7fb1f7ca1640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb1dc0a2cf0 0x7fb1dc0a51b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80cc2f0 tx=0x7fb1e80660e0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.010+0000 7fb1f7ca1640 1 -- 172.21.15.81:0/3490087667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0106f10 msgr2=0x7fb1f019a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:11.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.010+0000 7fb1f7ca1640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0106f10 0x7fb1f019a5d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800b970 tx=0x7fb1e800be30 comp rx=0 tx=0).stop 2024-09-12T01:35:11.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.010+0000 7fb1f7ca1640 1 -- 172.21.15.81:0/3490087667 shutdown_connections 2024-09-12T01:35:11.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.010+0000 7fb1f7ca1640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb1dc0a2cf0 0x7fb1dc0a51b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.010+0000 7fb1f7ca1640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1f0106f10 0x7fb1f019a5d0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.010+0000 7fb1f7ca1640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1f0102790 0x7fb1f01a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.010+0000 7fb1f7ca1640 1 --2- 172.21.15.81:0/3490087667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1f0101de0 0x7fb1f01a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:11.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.010+0000 7fb1f7ca1640 1 -- 172.21.15.81:0/3490087667 >> 172.21.15.81:0/3490087667 conn(0x7fb1f00fd8c0 msgr2=0x7fb1f00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:11.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.010+0000 7fb1f7ca1640 1 -- 172.21.15.81:0/3490087667 shutdown_connections 2024-09-12T01:35:11.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:11.010+0000 7fb1f7ca1640 1 -- 172.21.15.81:0/3490087667 wait complete. 2024-09-12T01:35:11.719 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:11 smithi081 ceph-mon[30920]: pgmap v216: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-12T01:35:11.719 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:11 smithi081 ceph-mon[30920]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T01:35:11.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:35:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:12.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:11 smithi100 ceph-mon[35275]: pgmap v216: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-12T01:35:12.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:11 smithi100 ceph-mon[35275]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T01:35:12.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:11 smithi189 ceph-mon[35357]: pgmap v216: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-12T01:35:12.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:11 smithi189 ceph-mon[35357]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T01:35:12.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.434+0000 7fd48f150640 1 -- 172.21.15.81:0/3893086059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd488106f10 msgr2=0x7fd48810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.434+0000 7fd48f150640 1 --2- 172.21.15.81:0/3893086059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd488106f10 0x7fd48810ea90 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fd480009ca0 tx=0x7fd48002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.434+0000 7fd48f150640 1 -- 172.21.15.81:0/3893086059 shutdown_connections 2024-09-12T01:35:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.434+0000 7fd48f150640 1 --2- 172.21.15.81:0/3893086059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd488106f10 0x7fd48810ea90 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.434+0000 7fd48f150640 1 --2- 172.21.15.81:0/3893086059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd488102790 0x7fd4881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.434+0000 7fd48f150640 1 --2- 172.21.15.81:0/3893086059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd488101de0 0x7fd4881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.434+0000 7fd48f150640 1 -- 172.21.15.81:0/3893086059 >> 172.21.15.81:0/3893086059 conn(0x7fd4880fd8c0 msgr2=0x7fd4880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.434+0000 7fd48f150640 1 -- 172.21.15.81:0/3893086059 shutdown_connections 2024-09-12T01:35:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.434+0000 7fd48f150640 1 -- 172.21.15.81:0/3893086059 wait complete. 2024-09-12T01:35:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.435+0000 7fd48f150640 1 Processor -- start 2024-09-12T01:35:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.435+0000 7fd48f150640 1 -- start start 2024-09-12T01:35:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.435+0000 7fd48f150640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd488101de0 0x7fd4880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.435+0000 7fd48f150640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd488102790 0x7fd488074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.435+0000 7fd48f150640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd488106f10 0x7fd488074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.435+0000 7fd48f150640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd488111f70 con 0x7fd488102790 2024-09-12T01:35:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.435+0000 7fd48f150640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd488111df0 con 0x7fd488101de0 2024-09-12T01:35:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.435+0000 7fd48f150640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881120f0 con 0x7fd488106f10 2024-09-12T01:35:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.435+0000 7fd487fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd488102790 0x7fd488074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.435+0000 7fd487fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd488102790 0x7fd488074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55088/0 (socket says 172.21.15.81:55088) 2024-09-12T01:35:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.435+0000 7fd487fff640 1 -- 172.21.15.81:0/3028070495 learned_addr learned my addr 172.21.15.81:0/3028070495 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.435+0000 7fd48d6ed640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd488106f10 0x7fd488074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.435+0000 7fd48ceec640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd488101de0 0x7fd4880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.436+0000 7fd487fff640 1 -- 172.21.15.81:0/3028070495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd488106f10 msgr2=0x7fd488074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.436+0000 7fd487fff640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd488106f10 0x7fd488074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.436+0000 7fd487fff640 1 -- 172.21.15.81:0/3028070495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd488101de0 msgr2=0x7fd4880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.436+0000 7fd487fff640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd488101de0 0x7fd4880744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.436+0000 7fd487fff640 1 -- 172.21.15.81:0/3028070495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4881a67e0 con 0x7fd488102790 2024-09-12T01:35:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.436+0000 7fd48d6ed640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd488106f10 0x7fd488074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.436+0000 7fd487fff640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd488102790 0x7fd488074a30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fd47400c920 tx=0x7fd47400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.436+0000 7fd485ffb640 1 -- 172.21.15.81:0/3028070495 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474007c70 con 0x7fd488102790 2024-09-12T01:35:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.436+0000 7fd48f150640 1 -- 172.21.15.81:0/3028070495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4881a6ad0 con 0x7fd488102790 2024-09-12T01:35:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.436+0000 7fd485ffb640 1 -- 172.21.15.81:0/3028070495 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd474007e10 con 0x7fd488102790 2024-09-12T01:35:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.436+0000 7fd485ffb640 1 -- 172.21.15.81:0/3028070495 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474018890 con 0x7fd488102790 2024-09-12T01:35:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.436+0000 7fd48f150640 1 -- 172.21.15.81:0/3028070495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4881a7060 con 0x7fd488102790 2024-09-12T01:35:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.438+0000 7fd485ffb640 1 -- 172.21.15.81:0/3028070495 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fd474018a70 con 0x7fd488102790 2024-09-12T01:35:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd491529740 1 Processor -- start 2024-09-12T01:35:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd491529740 1 -- start start 2024-09-12T01:35:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd485ffb640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd4780a2cf0 0x7fd4780a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd491529740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 0x558a799f5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd491529740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 0x558a799f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd491529740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 0x558a79a02760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd491529740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558a7995b2f0 con 0x558a799f6b40 2024-09-12T01:35:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd491529740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558a79902cf0 con 0x558a799f55d0 2024-09-12T01:35:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd491529740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558a799572b0 con 0x558a79a00370 2024-09-12T01:35:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd48ceec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 0x558a799f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd48d6ed640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd4780a2cf0 0x7fd4780a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd485ffb640 1 -- 172.21.15.81:0/3028070495 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fd4740cf650 con 0x7fd488102790 2024-09-12T01:35:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd48ceec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 0x558a799f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55094/0 (socket says 172.21.15.81:55094) 2024-09-12T01:35:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd48ceec640 1 -- 172.21.15.81:0/332608361 learned_addr learned my addr 172.21.15.81:0/332608361 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd48d6ed640 1 --2- 172.21.15.81:0/332608361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 0x558a79a02760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd48ceec640 1 -- 172.21.15.81:0/332608361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 msgr2=0x558a79a02760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd48ceec640 1 --2- 172.21.15.81:0/332608361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 0x558a79a02760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd48ceec640 1 -- 172.21.15.81:0/332608361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 msgr2=0x558a799f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd48ceec640 1 --2- 172.21.15.81:0/332608361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 0x558a799f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd48ceec640 1 -- 172.21.15.81:0/332608361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a798e73a0 con 0x558a799f6b40 2024-09-12T01:35:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd48d6ed640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd4780a2cf0 0x7fd4780a51b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd480006010 tx=0x7fd480009950 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.439+0000 7fd48ceec640 1 --2- 172.21.15.81:0/332608361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 0x558a799f5090 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009bc0 tx=0x7fd47c00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaf9cf55416c58e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.440+0000 7fd472ffd640 1 -- 172.21.15.81:0/332608361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c016070 con 0x558a799f6b40 2024-09-12T01:35:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.440+0000 7fd472ffd640 1 -- 172.21.15.81:0/332608361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd47c005500 con 0x558a799f6b40 2024-09-12T01:35:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.440+0000 7fd472ffd640 1 -- 172.21.15.81:0/332608361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c011470 con 0x558a799f6b40 2024-09-12T01:35:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.440+0000 7fd491529740 1 -- 172.21.15.81:0/332608361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 msgr2=0x558a799f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.440+0000 7fd491529740 1 --2- 172.21.15.81:0/332608361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 0x558a799f5090 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009bc0 tx=0x7fd47c00e6c0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.440+0000 7fd491529740 1 -- 172.21.15.81:0/332608361 shutdown_connections 2024-09-12T01:35:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.440+0000 7fd491529740 1 --2- 172.21.15.81:0/332608361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 0x558a79a02760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.440+0000 7fd491529740 1 --2- 172.21.15.81:0/332608361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 0x558a799f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.440+0000 7fd491529740 1 --2- 172.21.15.81:0/332608361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 0x558a799f5090 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.440+0000 7fd491529740 1 -- 172.21.15.81:0/332608361 >> 172.21.15.81:0/332608361 conn(0x558a799be310 msgr2=0x558a799f1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.440+0000 7fd491529740 1 -- 172.21.15.81:0/332608361 shutdown_connections 2024-09-12T01:35:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.440+0000 7fd491529740 1 -- 172.21.15.81:0/332608361 wait complete. 2024-09-12T01:35:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.441+0000 7fd491529740 1 -- start start 2024-09-12T01:35:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.441+0000 7fd491529740 1 Processor -- start 2024-09-12T01:35:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.441+0000 7fd491529740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 0x558a799ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.441+0000 7fd491529740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a799f6b40 0x558a799fcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.441+0000 7fd491529740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a79a00370 0x558a799fd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.441+0000 7fd491529740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558a79a03070 con 0x558a79a00370 2024-09-12T01:35:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.441+0000 7fd491529740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558a79916060 con 0x558a799f55d0 2024-09-12T01:35:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.441+0000 7fd491529740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558a79a031f0 con 0x558a799f6b40 2024-09-12T01:35:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.441+0000 7fd491529740 10 client.0 _ll_register_callbacks cb 0x558a796698c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.441+0000 7fd48d6ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a79a00370 0x558a799fd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.441+0000 7fd48d6ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a79a00370 0x558a799fd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55100/0 (socket says 172.21.15.81:55100) 2024-09-12T01:35:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.441+0000 7fd48d6ed640 1 -- 172.21.15.81:0/2147784970 learned_addr learned my addr 172.21.15.81:0/2147784970 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.441+0000 7fd487fff640 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a799f6b40 0x558a799fcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd48ceec640 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 0x558a799ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd48d6ed640 1 -- 172.21.15.81:0/2147784970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a799f6b40 msgr2=0x558a799fcfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd48d6ed640 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a799f6b40 0x558a799fcfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd48d6ed640 1 -- 172.21.15.81:0/2147784970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 msgr2=0x558a799ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd48d6ed640 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 0x558a799ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd48d6ed640 1 -- 172.21.15.81:0/2147784970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a796cc3c0 con 0x558a79a00370 2024-09-12T01:35:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd48ceec640 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 0x558a799ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd48d6ed640 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a79a00370 0x558a799fd5d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd480009ca0 tx=0x7fd48002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151ad693558fd870 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd467fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd467fff640 1 -- 172.21.15.81:0/2147784970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48004d070 con 0x558a79a00370 2024-09-12T01:35:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd467fff640 1 -- 172.21.15.81:0/2147784970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fd48003c110 con 0x558a79a00370 2024-09-12T01:35:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd491529740 1 -- 172.21.15.81:0/2147784970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd47c005500 con 0x558a79a00370 2024-09-12T01:35:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd467fff640 1 -- 172.21.15.81:0/2147784970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd480059050 con 0x558a79a00370 2024-09-12T01:35:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd491529740 10 client.17091 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd491529740 1 -- 172.21.15.81:0/2147784970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a79a0eb00 con 0x558a79a00370 2024-09-12T01:35:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.442+0000 7fd467fff640 1 -- 172.21.15.81:0/2147784970 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd47c005500 con 0x558a79a00370 2024-09-12T01:35:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.443+0000 7fd467fff640 1 -- 172.21.15.81:0/2147784970 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd48002faf0 con 0x558a79a00370 2024-09-12T01:35:12.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.443+0000 7fd491529740 10 client.17091 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.443+0000 7fd491529740 10 client.17091 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:35:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.443+0000 7fd491529740 20 client.17091 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.443+0000 7fd491529740 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x558a79a0ff10 0x558a79a12350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.443+0000 7fd491529740 4 client.17091 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.443+0000 7fd491529740 1 -- 172.21.15.81:0/2147784970 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a79968860 con 0x558a79a0ff10 2024-09-12T01:35:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.443+0000 7fd48ceec640 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x558a79a0ff10 0x558a79a12350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.443+0000 7fd48ceec640 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x558a79a0ff10 0x558a79a12350 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e4e70aec65734dc server_cookie=e07d1e8dead0f5ce in_seq=0 out_seq=0 2024-09-12T01:35:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.443+0000 7fd467fff640 10 client.17091 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:35:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.444+0000 7fd467fff640 1 -- 172.21.15.81:0/2147784970 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a79968860 con 0x558a79a0ff10 2024-09-12T01:35:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.444+0000 7fd467fff640 10 client.17091 handle_command_reply: tid=0 2024-09-12T01:35:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.444+0000 7fd491529740 1 client.17091 shutdown 2024-09-12T01:35:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.444+0000 7fd491529740 1 -- 172.21.15.81:0/2147784970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a79a00370 msgr2=0x558a799fd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:12.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.444+0000 7fd491529740 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a79a00370 0x558a799fd5d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd480009ca0 tx=0x7fd48002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.444+0000 7fd491529740 1 -- 172.21.15.81:0/2147784970 shutdown_connections 2024-09-12T01:35:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.444+0000 7fd491529740 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x558a79a0ff10 0x558a79a12350 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.444+0000 7fd491529740 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a79a00370 0x558a799fd5d0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.444+0000 7fd467fff640 0 client.17091 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:35:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.444+0000 7fd491529740 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a799f6b40 0x558a799fcfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.444+0000 7fd491529740 1 --2- 172.21.15.81:0/2147784970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 0x558a799ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.444+0000 7fd491529740 1 -- 172.21.15.81:0/2147784970 >> 172.21.15.81:0/2147784970 conn(0x558a799be310 msgr2=0x558a799f7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.445+0000 7fd491529740 1 -- 172.21.15.81:0/2147784970 shutdown_connections 2024-09-12T01:35:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.445+0000 7fd491529740 1 -- 172.21.15.81:0/2147784970 wait complete. 2024-09-12T01:35:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.445+0000 7fd491529740 20 client.17091 trim_cache size 0 max 16384 2024-09-12T01:35:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd491529740 1 Processor -- start 2024-09-12T01:35:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd491529740 1 -- start start 2024-09-12T01:35:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd491529740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 0x558a79a0c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd491529740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 0x558a799f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd491529740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 0x558a79a17c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd491529740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881afa80 con 0x558a799f6b40 2024-09-12T01:35:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd491529740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881b15c0 con 0x558a799f55d0 2024-09-12T01:35:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd491529740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881b0150 con 0x558a79a00370 2024-09-12T01:35:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd487fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 0x558a799f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd487fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 0x558a799f4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55106/0 (socket says 172.21.15.81:55106) 2024-09-12T01:35:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd487fff640 1 -- 172.21.15.81:0/4285698344 learned_addr learned my addr 172.21.15.81:0/4285698344 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd48ceec640 1 --2- 172.21.15.81:0/4285698344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 0x558a79a0c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd487fff640 1 -- 172.21.15.81:0/4285698344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 msgr2=0x558a79a17c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd487fff640 1 --2- 172.21.15.81:0/4285698344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 0x558a79a17c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd487fff640 1 -- 172.21.15.81:0/4285698344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 msgr2=0x558a79a0c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd487fff640 1 --2- 172.21.15.81:0/4285698344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 0x558a79a0c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd487fff640 1 -- 172.21.15.81:0/4285698344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a799f5d50 con 0x558a799f6b40 2024-09-12T01:35:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.458+0000 7fd487fff640 1 --2- 172.21.15.81:0/4285698344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 0x558a799f4bd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fd474007590 tx=0x7fd47409b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f11133db7cf14b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.459+0000 7fd4727fc640 1 -- 172.21.15.81:0/4285698344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4740b4070 con 0x558a799f6b40 2024-09-12T01:35:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.459+0000 7fd4727fc640 1 -- 172.21.15.81:0/4285698344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4740a4760 con 0x558a799f6b40 2024-09-12T01:35:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.459+0000 7fd4727fc640 1 -- 172.21.15.81:0/4285698344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4740ccfa0 con 0x558a799f6b40 2024-09-12T01:35:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.459+0000 7fd491529740 1 -- 172.21.15.81:0/4285698344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 msgr2=0x558a799f4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.459+0000 7fd491529740 1 --2- 172.21.15.81:0/4285698344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 0x558a799f4bd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fd474007590 tx=0x7fd47409b730 comp rx=0 tx=0).stop 2024-09-12T01:35:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.459+0000 7fd491529740 1 -- 172.21.15.81:0/4285698344 shutdown_connections 2024-09-12T01:35:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.459+0000 7fd491529740 1 --2- 172.21.15.81:0/4285698344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 0x558a79a17c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.459+0000 7fd491529740 1 --2- 172.21.15.81:0/4285698344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f6b40 0x558a799f4bd0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.459+0000 7fd491529740 1 --2- 172.21.15.81:0/4285698344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f55d0 0x558a79a0c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.459+0000 7fd491529740 1 -- 172.21.15.81:0/4285698344 >> 172.21.15.81:0/4285698344 conn(0x558a799be310 msgr2=0x558a799fb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.459+0000 7fd491529740 1 -- 172.21.15.81:0/4285698344 shutdown_connections 2024-09-12T01:35:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.460+0000 7fd491529740 1 -- 172.21.15.81:0/4285698344 wait complete. 2024-09-12T01:35:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.460+0000 7fd491529740 1 -- start start 2024-09-12T01:35:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.460+0000 7fd491529740 1 Processor -- start 2024-09-12T01:35:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.460+0000 7fd491529740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f55d0 0x558a79a043b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.460+0000 7fd491529740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f6b40 0x558a79a048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.460+0000 7fd491529740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 0x558a79a04e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.460+0000 7fd491529740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881b0ef0 con 0x558a799f55d0 2024-09-12T01:35:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.460+0000 7fd491529740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881b0820 con 0x558a799f6b40 2024-09-12T01:35:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.460+0000 7fd491529740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881ada80 con 0x558a79a00370 2024-09-12T01:35:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.460+0000 7fd48ceec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f55d0 0x558a79a043b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.460+0000 7fd491529740 10 client.0 _ll_register_callbacks cb 0x7fd480009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.460+0000 7fd48ceec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f55d0 0x558a79a043b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55114/0 (socket says 172.21.15.81:55114) 2024-09-12T01:35:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.460+0000 7fd48ceec640 1 -- 172.21.15.81:0/3826868231 learned_addr learned my addr 172.21.15.81:0/3826868231 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd487fff640 1 --2- 172.21.15.81:0/3826868231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f6b40 0x558a79a048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd48d6ed640 1 --2- 172.21.15.81:0/3826868231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 0x558a79a04e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd48ceec640 1 -- 172.21.15.81:0/3826868231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 msgr2=0x558a79a04e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:12.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd48ceec640 1 --2- 172.21.15.81:0/3826868231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 0x558a79a04e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd48ceec640 1 -- 172.21.15.81:0/3826868231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f6b40 msgr2=0x558a79a048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd48ceec640 1 --2- 172.21.15.81:0/3826868231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f6b40 0x558a79a048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd48ceec640 1 -- 172.21.15.81:0/3826868231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a79a79de0 con 0x558a799f55d0 2024-09-12T01:35:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd48ceec640 1 --2- 172.21.15.81:0/3826868231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f55d0 0x558a79a043b0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0098e0 tx=0x7fd47c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d555c232906764 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd467fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd467fff640 1 -- 172.21.15.81:0/3826868231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c016040 con 0x558a799f55d0 2024-09-12T01:35:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd467fff640 1 -- 172.21.15.81:0/3826868231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fd47c011470 con 0x558a799f55d0 2024-09-12T01:35:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd491529740 1 -- 172.21.15.81:0/3826868231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4740a4760 con 0x558a799f55d0 2024-09-12T01:35:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd467fff640 1 -- 172.21.15.81:0/3826868231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd47c011690 con 0x558a799f55d0 2024-09-12T01:35:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd491529740 10 client.17097 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.461+0000 7fd491529740 1 -- 172.21.15.81:0/3826868231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a79a7b120 con 0x558a799f55d0 2024-09-12T01:35:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.462+0000 7fd467fff640 1 -- 172.21.15.81:0/3826868231 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4740a4760 con 0x558a799f55d0 2024-09-12T01:35:12.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.462+0000 7fd467fff640 1 -- 172.21.15.81:0/3826868231 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd47c00f040 con 0x558a799f55d0 2024-09-12T01:35:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.462+0000 7fd491529740 10 client.17097 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.462+0000 7fd491529740 10 client.17097 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:35:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.462+0000 7fd491529740 20 client.17097 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.462+0000 7fd491529740 1 --2- 172.21.15.81:0/3826868231 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x558a79a7b6e0 0x558a79a7db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.462+0000 7fd491529740 4 client.17097 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:35:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.462+0000 7fd491529740 1 -- 172.21.15.81:0/3826868231 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558a79962d70 con 0x558a79a7b6e0 2024-09-12T01:35:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.462+0000 7fd487fff640 1 --2- 172.21.15.81:0/3826868231 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x558a79a7b6e0 0x558a79a7db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd487fff640 1 --2- 172.21.15.81:0/3826868231 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x558a79a7b6e0 0x558a79a7db00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf5ccd6eedf69447 server_cookie=3f4ea78f0c7ba238 in_seq=0 out_seq=0 2024-09-12T01:35:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd467fff640 10 client.17097 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:35:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd467fff640 1 -- 172.21.15.81:0/3826868231 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558a79962d70 con 0x558a79a7b6e0 2024-09-12T01:35:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd467fff640 10 client.17097 handle_command_reply: tid=0 2024-09-12T01:35:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd491529740 1 client.17097 shutdown 2024-09-12T01:35:12.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd491529740 1 -- 172.21.15.81:0/3826868231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f55d0 msgr2=0x558a79a043b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:12.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd491529740 1 --2- 172.21.15.81:0/3826868231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f55d0 0x558a79a043b0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0098e0 tx=0x7fd47c00eef0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd491529740 1 -- 172.21.15.81:0/3826868231 shutdown_connections 2024-09-12T01:35:12.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd491529740 1 --2- 172.21.15.81:0/3826868231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558a79a00370 0x558a79a04e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd491529740 1 --2- 172.21.15.81:0/3826868231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a799f6b40 0x558a79a048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd491529740 1 --2- 172.21.15.81:0/3826868231 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x558a79a7b6e0 0x558a79a7db00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd491529740 1 --2- 172.21.15.81:0/3826868231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a799f55d0 0x558a79a043b0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd467fff640 0 client.17097 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:35:12.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd491529740 1 -- 172.21.15.81:0/3826868231 >> 172.21.15.81:0/3826868231 conn(0x558a799be310 msgr2=0x558a799fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:12.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd491529740 1 -- 172.21.15.81:0/3826868231 shutdown_connections 2024-09-12T01:35:12.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd491529740 1 -- 172.21.15.81:0/3826868231 wait complete. 2024-09-12T01:35:12.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.463+0000 7fd491529740 20 client.17097 trim_cache size 0 max 16384 2024-09-12T01:35:12.518 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:35:12.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.464+0000 7fd48f150640 1 -- 172.21.15.81:0/3028070495 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd4780a2cf0 msgr2=0x7fd4780a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:12.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.464+0000 7fd48f150640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd4780a2cf0 0x7fd4780a51b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd480006010 tx=0x7fd480009950 comp rx=0 tx=0).stop 2024-09-12T01:35:12.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.464+0000 7fd48f150640 1 -- 172.21.15.81:0/3028070495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd488102790 msgr2=0x7fd488074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:12.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.464+0000 7fd48f150640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd488102790 0x7fd488074a30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fd47400c920 tx=0x7fd47400cde0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.464+0000 7fd48f150640 1 -- 172.21.15.81:0/3028070495 shutdown_connections 2024-09-12T01:35:12.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.464+0000 7fd48f150640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd4780a2cf0 0x7fd4780a51b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.464+0000 7fd48f150640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd488106f10 0x7fd488074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.464+0000 7fd48f150640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd488102790 0x7fd488074a30 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.464+0000 7fd48f150640 1 --2- 172.21.15.81:0/3028070495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd488101de0 0x7fd4880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.464+0000 7fd48f150640 1 -- 172.21.15.81:0/3028070495 >> 172.21.15.81:0/3028070495 conn(0x7fd4880fd8c0 msgr2=0x7fd4880febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:12.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.464+0000 7fd48f150640 1 -- 172.21.15.81:0/3028070495 shutdown_connections 2024-09-12T01:35:12.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:12.464+0000 7fd48f150640 1 -- 172.21.15.81:0/3028070495 wait complete. 2024-09-12T01:35:13.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:35:13.331 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:13.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:13 smithi081 ceph-mon[30920]: pgmap v218: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:35:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.777+0000 7f74a222a640 1 -- 172.21.15.81:0/136948378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c106b80 msgr2=0x7f749c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.777+0000 7f74a222a640 1 --2- 172.21.15.81:0/136948378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c106b80 0x7f749c106f60 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f748c009900 tx=0x7f748c02a410 comp rx=0 tx=0).stop 2024-09-12T01:35:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.777+0000 7f74a222a640 1 -- 172.21.15.81:0/136948378 shutdown_connections 2024-09-12T01:35:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.777+0000 7f74a222a640 1 --2- 172.21.15.81:0/136948378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f749c1005a0 0x7f749c10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.777+0000 7f74a222a640 1 --2- 172.21.15.81:0/136948378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f749c0ffc00 0x7f749c100060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.777+0000 7f74a222a640 1 --2- 172.21.15.81:0/136948378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c106b80 0x7f749c106f60 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.777+0000 7f74a222a640 1 -- 172.21.15.81:0/136948378 >> 172.21.15.81:0/136948378 conn(0x7f749c0fba90 msgr2=0x7f749c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.777+0000 7f74a222a640 1 -- 172.21.15.81:0/136948378 shutdown_connections 2024-09-12T01:35:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.777+0000 7f74a222a640 1 -- 172.21.15.81:0/136948378 wait complete. 2024-09-12T01:35:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.777+0000 7f74a222a640 1 Processor -- start 2024-09-12T01:35:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.777+0000 7f74a222a640 1 -- start start 2024-09-12T01:35:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f74a222a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c0ffc00 0x7f749c101670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f74a222a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f749c1005a0 0x7f749c101bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f74a222a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f749c106b80 0x7f749c1020f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f74a222a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f749c112020 con 0x7f749c0ffc00 2024-09-12T01:35:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f74a222a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f749c111ea0 con 0x7f749c1005a0 2024-09-12T01:35:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f74a222a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f749c1121a0 con 0x7f749c106b80 2024-09-12T01:35:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f749b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c0ffc00 0x7f749c101670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f749b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c0ffc00 0x7f749c101670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55128/0 (socket says 172.21.15.81:55128) 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f749b7fe640 1 -- 172.21.15.81:0/1132093000 learned_addr learned my addr 172.21.15.81:0/1132093000 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f7492ffd640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f749c1005a0 0x7f749c101bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f749bfff640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f749c106b80 0x7f749c1020f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f749b7fe640 1 -- 172.21.15.81:0/1132093000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f749c106b80 msgr2=0x7f749c1020f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f749b7fe640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f749c106b80 0x7f749c1020f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f749b7fe640 1 -- 172.21.15.81:0/1132093000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f749c1005a0 msgr2=0x7f749c101bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f749b7fe640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f749c1005a0 0x7f749c101bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f749b7fe640 1 -- 172.21.15.81:0/1132093000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749c1a6a40 con 0x7f749c0ffc00 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f7492ffd640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f749c1005a0 0x7f749c101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f749b7fe640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c0ffc00 0x7f749c101670 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f748c006010 tx=0x7f748c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.778+0000 7f74997fa640 1 -- 172.21.15.81:0/1132093000 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c03f070 con 0x7f749c0ffc00 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.779+0000 7f74a222a640 1 -- 172.21.15.81:0/1132093000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f749c1a6cd0 con 0x7f749c0ffc00 2024-09-12T01:35:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.779+0000 7f74997fa640 1 -- 172.21.15.81:0/1132093000 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f748c031e30 con 0x7f749c0ffc00 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.779+0000 7f74997fa640 1 -- 172.21.15.81:0/1132093000 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c035030 con 0x7f749c0ffc00 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.779+0000 7f74a222a640 1 -- 172.21.15.81:0/1132093000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f749c1a71b0 con 0x7f749c0ffc00 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.781+0000 7f74997fa640 1 -- 172.21.15.81:0/1132093000 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f748c042070 con 0x7f749c0ffc00 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.781+0000 7f74a4603740 1 Processor -- start 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.781+0000 7f74a4603740 1 -- start start 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f74a4603740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60df9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f74a4603740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60df95d0 0x55ec60df9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f74a4603740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60e04370 0x55ec60e06760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f74a4603740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ec60d5f2f0 con 0x55ec60dfab40 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f74a4603740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ec60d06cf0 con 0x55ec60e04370 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f74a4603740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ec60d5b2b0 con 0x55ec60df95d0 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f749bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60df9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f749bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60df9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55130/0 (socket says 172.21.15.81:55130) 2024-09-12T01:35:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f749bfff640 1 -- 172.21.15.81:0/2458217324 learned_addr learned my addr 172.21.15.81:0/2458217324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f74997fa640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f74880a2cf0 0x7f74880a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f7492ffd640 1 --2- 172.21.15.81:0/2458217324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60e04370 0x55ec60e06760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f749b7fe640 1 --2- 172.21.15.81:0/2458217324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60df95d0 0x55ec60df9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f749bfff640 1 -- 172.21.15.81:0/2458217324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60df95d0 msgr2=0x55ec60df9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f749bfff640 1 --2- 172.21.15.81:0/2458217324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60df95d0 0x55ec60df9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f749bfff640 1 -- 172.21.15.81:0/2458217324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60e04370 msgr2=0x55ec60e06760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f749bfff640 1 --2- 172.21.15.81:0/2458217324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60e04370 0x55ec60e06760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f749bfff640 1 -- 172.21.15.81:0/2458217324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec60ceb3a0 con 0x55ec60dfab40 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f749b7fe640 1 --2- 172.21.15.81:0/2458217324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60df95d0 0x55ec60df9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f74997fa640 1 -- 172.21.15.81:0/1132093000 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f748c0efed0 con 0x7f749c0ffc00 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f749bfff640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f74880a2cf0 0x7f74880a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f749bfff640 1 --2- 172.21.15.81:0/2458217324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60df9090 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f749400c470 tx=0x7f749400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de70db7c0cf39c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.782+0000 7f7491ffb640 1 -- 172.21.15.81:0/2458217324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7494018440 con 0x55ec60dfab40 2024-09-12T01:35:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.783+0000 7f7491ffb640 1 -- 172.21.15.81:0/2458217324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f749401e070 con 0x55ec60dfab40 2024-09-12T01:35:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.783+0000 7f7491ffb640 1 -- 172.21.15.81:0/2458217324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749400a8a0 con 0x55ec60dfab40 2024-09-12T01:35:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.783+0000 7f74a4603740 1 -- 172.21.15.81:0/2458217324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 msgr2=0x55ec60df9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.783+0000 7f749bfff640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f74880a2cf0 0x7f74880a51b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f749401d000 tx=0x7f7494018000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.783+0000 7f74a4603740 1 --2- 172.21.15.81:0/2458217324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60df9090 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f749400c470 tx=0x7f749400c930 comp rx=0 tx=0).stop 2024-09-12T01:35:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.783+0000 7f74a4603740 1 -- 172.21.15.81:0/2458217324 shutdown_connections 2024-09-12T01:35:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.783+0000 7f74a4603740 1 --2- 172.21.15.81:0/2458217324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60e04370 0x55ec60e06760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.783+0000 7f74a4603740 1 --2- 172.21.15.81:0/2458217324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60df95d0 0x55ec60df9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.783+0000 7f74a4603740 1 --2- 172.21.15.81:0/2458217324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60df9090 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.783+0000 7f74a4603740 1 -- 172.21.15.81:0/2458217324 >> 172.21.15.81:0/2458217324 conn(0x55ec60dc2310 msgr2=0x55ec60df5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.783+0000 7f74a4603740 1 -- 172.21.15.81:0/2458217324 shutdown_connections 2024-09-12T01:35:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.783+0000 7f74a4603740 1 -- 172.21.15.81:0/2458217324 wait complete. 2024-09-12T01:35:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f74a4603740 1 -- start start 2024-09-12T01:35:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f74a4603740 1 Processor -- start 2024-09-12T01:35:13.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f74a4603740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60df95d0 0x55ec60e03d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f74a4603740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60e00fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f74a4603740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60e04370 0x55ec60e01570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f74a4603740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ec60e07070 con 0x55ec60dfab40 2024-09-12T01:35:13.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f74a4603740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ec60d1a060 con 0x55ec60e04370 2024-09-12T01:35:13.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f74a4603740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ec60e071f0 con 0x55ec60df95d0 2024-09-12T01:35:13.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f74a4603740 10 client.0 _ll_register_callbacks cb 0x55ec60a6d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:13.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f7492ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60e00fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f7492ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60e00fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55136/0 (socket says 172.21.15.81:55136) 2024-09-12T01:35:13.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f7492ffd640 1 -- 172.21.15.81:0/2874499064 learned_addr learned my addr 172.21.15.81:0/2874499064 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:13.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f749b7fe640 1 --2- 172.21.15.81:0/2874499064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60df95d0 0x55ec60e03d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f7492ffd640 1 -- 172.21.15.81:0/2874499064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60df95d0 msgr2=0x55ec60e03d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:13.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f749bfff640 1 --2- 172.21.15.81:0/2874499064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60e04370 0x55ec60e01570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f7492ffd640 1 --2- 172.21.15.81:0/2874499064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60df95d0 0x55ec60e03d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f7492ffd640 1 -- 172.21.15.81:0/2874499064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60e04370 msgr2=0x55ec60e01570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:13.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f7492ffd640 1 --2- 172.21.15.81:0/2874499064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60e04370 0x55ec60e01570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.784+0000 7f7492ffd640 1 -- 172.21.15.81:0/2874499064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec60ad03c0 con 0x55ec60dfab40 2024-09-12T01:35:13.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f7492ffd640 1 --2- 172.21.15.81:0/2874499064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60e00fd0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f748400bf70 tx=0x7f748400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c82a0a3d5f71cc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:13.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f747affd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:13.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f747affd640 1 -- 172.21.15.81:0/2874499064 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7484018020 con 0x55ec60dfab40 2024-09-12T01:35:13.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f747affd640 1 -- 172.21.15.81:0/2874499064 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f7484014670 con 0x55ec60dfab40 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f74a4603740 1 -- 172.21.15.81:0/2874499064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f749401e070 con 0x55ec60dfab40 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f747affd640 1 -- 172.21.15.81:0/2874499064 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7484023050 con 0x55ec60dfab40 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f74a4603740 10 client.17109 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f74a4603740 1 -- 172.21.15.81:0/2874499064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ec60e12ac0 con 0x55ec60dfab40 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f747affd640 1 -- 172.21.15.81:0/2874499064 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f749401e070 con 0x55ec60dfab40 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f747affd640 1 -- 172.21.15.81:0/2874499064 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7484013bb0 con 0x55ec60dfab40 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f74a4603740 10 client.17109 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f74a4603740 10 client.17109 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f74a4603740 20 client.17109 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f74a4603740 1 --2- 172.21.15.81:0/2874499064 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ec60e14020 0x55ec60e16460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f74a4603740 4 client.17109 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.785+0000 7f74a4603740 1 -- 172.21.15.81:0/2874499064 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec60d6c860 con 0x55ec60e14020 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.786+0000 7f749b7fe640 1 --2- 172.21.15.81:0/2874499064 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ec60e14020 0x55ec60e16460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.786+0000 7f749b7fe640 1 --2- 172.21.15.81:0/2874499064 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ec60e14020 0x55ec60e16460 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cea6d3931a80c60 server_cookie=41a2f1715aa7e796 in_seq=0 out_seq=0 2024-09-12T01:35:13.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.786+0000 7f747affd640 10 client.17109 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:13.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f747affd640 1 -- 172.21.15.81:0/2874499064 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec60d6c860 con 0x55ec60e14020 2024-09-12T01:35:13.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f747affd640 10 client.17109 handle_command_reply: tid=0 2024-09-12T01:35:13.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f74a4603740 1 client.17109 shutdown 2024-09-12T01:35:13.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f74a4603740 1 -- 172.21.15.81:0/2874499064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 msgr2=0x55ec60e00fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:13.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f74a4603740 1 --2- 172.21.15.81:0/2874499064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60e00fd0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f748400bf70 tx=0x7f748400f670 comp rx=0 tx=0).stop 2024-09-12T01:35:13.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f74a4603740 1 -- 172.21.15.81:0/2874499064 shutdown_connections 2024-09-12T01:35:13.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f74a4603740 1 --2- 172.21.15.81:0/2874499064 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ec60e14020 0x55ec60e16460 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f747affd640 0 client.17109 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:13.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f74a4603740 1 --2- 172.21.15.81:0/2874499064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60e04370 0x55ec60e01570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f74a4603740 1 --2- 172.21.15.81:0/2874499064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60e00fd0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f74a4603740 1 --2- 172.21.15.81:0/2874499064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60df95d0 0x55ec60e03d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f74a4603740 1 -- 172.21.15.81:0/2874499064 >> 172.21.15.81:0/2874499064 conn(0x55ec60dc2310 msgr2=0x55ec60dfb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f74a4603740 1 -- 172.21.15.81:0/2874499064 shutdown_connections 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f74a4603740 1 -- 172.21.15.81:0/2874499064 wait complete. 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.787+0000 7f74a4603740 20 client.17109 trim_cache size 0 max 16384 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f74a4603740 1 Processor -- start 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f74a4603740 1 -- start start 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f74a4603740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60df95d0 0x55ec60e10340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f74a4603740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60dfab40 0x55ec60e1bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f74a4603740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60e04370 0x55ec60e1c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f74a4603740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f749c1afb90 con 0x55ec60e04370 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f74a4603740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f749c1b16d0 con 0x55ec60df95d0 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f74a4603740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f749c1b0260 con 0x55ec60dfab40 2024-09-12T01:35:13.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f749bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60e04370 0x55ec60e1c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f749bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60e04370 0x55ec60e1c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55142/0 (socket says 172.21.15.81:55142) 2024-09-12T01:35:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f749bfff640 1 -- 172.21.15.81:0/1867042694 learned_addr learned my addr 172.21.15.81:0/1867042694 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f749b7fe640 1 --2- 172.21.15.81:0/1867042694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60df95d0 0x55ec60e10340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f7492ffd640 1 --2- 172.21.15.81:0/1867042694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60dfab40 0x55ec60e1bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f749bfff640 1 -- 172.21.15.81:0/1867042694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60dfab40 msgr2=0x55ec60e1bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f749bfff640 1 --2- 172.21.15.81:0/1867042694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60dfab40 0x55ec60e1bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f749bfff640 1 -- 172.21.15.81:0/1867042694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60df95d0 msgr2=0x55ec60e10340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f749bfff640 1 --2- 172.21.15.81:0/1867042694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60df95d0 0x55ec60e10340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f749bfff640 1 -- 172.21.15.81:0/1867042694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec60e018e0 con 0x55ec60e04370 2024-09-12T01:35:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f749b7fe640 1 --2- 172.21.15.81:0/1867042694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60df95d0 0x55ec60e10340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.800+0000 7f749bfff640 1 --2- 172.21.15.81:0/1867042694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60e04370 0x55ec60e1c270 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7494007490 tx=0x7f7494010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d55dadc09d83ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.801+0000 7f74917fa640 1 -- 172.21.15.81:0/1867042694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7494007df0 con 0x55ec60e04370 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.801+0000 7f74917fa640 1 -- 172.21.15.81:0/1867042694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f749401e040 con 0x55ec60e04370 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.801+0000 7f74917fa640 1 -- 172.21.15.81:0/1867042694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74940186a0 con 0x55ec60e04370 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.801+0000 7f74a4603740 1 -- 172.21.15.81:0/1867042694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60e04370 msgr2=0x55ec60e1c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.801+0000 7f74a4603740 1 --2- 172.21.15.81:0/1867042694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60e04370 0x55ec60e1c270 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7494007490 tx=0x7f7494010000 comp rx=0 tx=0).stop 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.801+0000 7f74a4603740 1 -- 172.21.15.81:0/1867042694 shutdown_connections 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.801+0000 7f74a4603740 1 --2- 172.21.15.81:0/1867042694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60e04370 0x55ec60e1c270 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.801+0000 7f74a4603740 1 --2- 172.21.15.81:0/1867042694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60dfab40 0x55ec60e1bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.801+0000 7f74a4603740 1 --2- 172.21.15.81:0/1867042694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60df95d0 0x55ec60e10340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.801+0000 7f74a4603740 1 -- 172.21.15.81:0/1867042694 >> 172.21.15.81:0/1867042694 conn(0x55ec60dc2310 msgr2=0x55ec60e000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.801+0000 7f74a4603740 1 -- 172.21.15.81:0/1867042694 shutdown_connections 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.801+0000 7f74a4603740 1 -- 172.21.15.81:0/1867042694 wait complete. 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.801+0000 7f74a4603740 1 -- start start 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f74a4603740 1 Processor -- start 2024-09-12T01:35:13.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f74a4603740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60df95d0 0x55ec60e0cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f74a4603740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60e08100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f74a4603740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60e04370 0x55ec60e08890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f74a4603740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f749c1b1000 con 0x55ec60dfab40 2024-09-12T01:35:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f74a4603740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f749c1b0930 con 0x55ec60df95d0 2024-09-12T01:35:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f74a4603740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f749c1adb90 con 0x55ec60e04370 2024-09-12T01:35:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f74a4603740 10 client.0 _ll_register_callbacks cb 0x7f748400b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f7492ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60e08100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f7492ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60e08100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55158/0 (socket says 172.21.15.81:55158) 2024-09-12T01:35:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f7492ffd640 1 -- 172.21.15.81:0/3952534260 learned_addr learned my addr 172.21.15.81:0/3952534260 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f749bfff640 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60e04370 0x55ec60e08890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f749b7fe640 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60df95d0 0x55ec60e0cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f7492ffd640 1 -- 172.21.15.81:0/3952534260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60e04370 msgr2=0x55ec60e08890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f7492ffd640 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60e04370 0x55ec60e08890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f7492ffd640 1 -- 172.21.15.81:0/3952534260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60df95d0 msgr2=0x55ec60e0cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f7492ffd640 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60df95d0 0x55ec60e0cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f7492ffd640 1 -- 172.21.15.81:0/3952534260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec60e7dd00 con 0x55ec60dfab40 2024-09-12T01:35:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f749bfff640 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60e04370 0x55ec60e08890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f7492ffd640 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60e08100 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f748401c490 tx=0x7f748401c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff7d3958eea5466 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.802+0000 7f747affd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f747affd640 1 -- 172.21.15.81:0/3952534260 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748402c020 con 0x55ec60dfab40 2024-09-12T01:35:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f747affd640 1 -- 172.21.15.81:0/3952534260 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7f748401cbc0 con 0x55ec60dfab40 2024-09-12T01:35:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f74a4603740 1 -- 172.21.15.81:0/3952534260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f749401e040 con 0x55ec60dfab40 2024-09-12T01:35:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f747affd640 1 -- 172.21.15.81:0/3952534260 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7484037050 con 0x55ec60dfab40 2024-09-12T01:35:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f74a4603740 10 client.17115 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f74a4603740 1 -- 172.21.15.81:0/3952534260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ec60e7ef10 con 0x55ec60dfab40 2024-09-12T01:35:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f747affd640 1 -- 172.21.15.81:0/3952534260 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f749401e040 con 0x55ec60dfab40 2024-09-12T01:35:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f747affd640 1 -- 172.21.15.81:0/3952534260 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7484013450 con 0x55ec60dfab40 2024-09-12T01:35:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f74a4603740 10 client.17115 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f74a4603740 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f74a4603740 20 client.17115 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f74a4603740 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ec60e14020 0x55ec60e81720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f74a4603740 4 client.17115 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f74a4603740 1 -- 172.21.15.81:0/3952534260 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ec60d66d70 con 0x55ec60e14020 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.803+0000 7f749b7fe640 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ec60e14020 0x55ec60e81720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f749b7fe640 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ec60e14020 0x55ec60e81720 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1f6123abc78ee53 server_cookie=825532874580d37 in_seq=0 out_seq=0 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f747affd640 10 client.17115 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f747affd640 1 -- 172.21.15.81:0/3952534260 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ec60d66d70 con 0x55ec60e14020 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f747affd640 10 client.17115 handle_command_reply: tid=0 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f74a4603740 1 client.17115 shutdown 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f74a4603740 1 -- 172.21.15.81:0/3952534260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 msgr2=0x55ec60e08100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f74a4603740 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60e08100 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f748401c490 tx=0x7f748401c7c0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f74a4603740 1 -- 172.21.15.81:0/3952534260 shutdown_connections 2024-09-12T01:35:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f74a4603740 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ec60e14020 0x55ec60e81720 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f74a4603740 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec60e04370 0x55ec60e08890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f74a4603740 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec60dfab40 0x55ec60e08100 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f747affd640 0 client.17115 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:13.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f74a4603740 1 --2- 172.21.15.81:0/3952534260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ec60df95d0 0x55ec60e0cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f74a4603740 1 -- 172.21.15.81:0/3952534260 >> 172.21.15.81:0/3952534260 conn(0x55ec60dc2310 msgr2=0x55ec60df44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:13.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f74a4603740 1 -- 172.21.15.81:0/3952534260 shutdown_connections 2024-09-12T01:35:13.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f74a4603740 1 -- 172.21.15.81:0/3952534260 wait complete. 2024-09-12T01:35:13.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.804+0000 7f74a4603740 20 client.17115 trim_cache size 0 max 16384 2024-09-12T01:35:13.829 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:35:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.805+0000 7f74a222a640 1 -- 172.21.15.81:0/1132093000 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f74880a2cf0 msgr2=0x7f74880a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.805+0000 7f74a222a640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f74880a2cf0 0x7f74880a51b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f749401d000 tx=0x7f7494018000 comp rx=0 tx=0).stop 2024-09-12T01:35:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.805+0000 7f74a222a640 1 -- 172.21.15.81:0/1132093000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c0ffc00 msgr2=0x7f749c101670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.805+0000 7f74a222a640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c0ffc00 0x7f749c101670 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f748c006010 tx=0x7f748c003c80 comp rx=0 tx=0).stop 2024-09-12T01:35:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.805+0000 7f74a222a640 1 -- 172.21.15.81:0/1132093000 shutdown_connections 2024-09-12T01:35:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.805+0000 7f74a222a640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f74880a2cf0 0x7f74880a51b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.805+0000 7f74a222a640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f749c106b80 0x7f749c1020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.805+0000 7f74a222a640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f749c1005a0 0x7f749c101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.805+0000 7f74a222a640 1 --2- 172.21.15.81:0/1132093000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749c0ffc00 0x7f749c101670 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.805+0000 7f74a222a640 1 -- 172.21.15.81:0/1132093000 >> 172.21.15.81:0/1132093000 conn(0x7f749c0fba90 msgr2=0x7f749c0fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.805+0000 7f74a222a640 1 -- 172.21.15.81:0/1132093000 shutdown_connections 2024-09-12T01:35:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:13.805+0000 7f74a222a640 1 -- 172.21.15.81:0/1132093000 wait complete. 2024-09-12T01:35:14.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:13 smithi100 ceph-mon[35275]: pgmap v218: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:35:14.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:13 smithi189 ceph-mon[35357]: pgmap v218: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:35:15.451 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:35:15.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:35:15.735 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:15.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:15 smithi081 ceph-mon[30920]: pgmap v219: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:35:16.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:15 smithi100 ceph-mon[35275]: pgmap v219: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:35:16.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:15 smithi189 ceph-mon[35357]: pgmap v219: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:35:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.200+0000 7ff8e5daa640 1 -- 172.21.15.81:0/2164181567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e0100e20 msgr2=0x7ff8e0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.200+0000 7ff8e5daa640 1 --2- 172.21.15.81:0/2164181567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e0100e20 0x7ff8e0101200 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009900 tx=0x7ff8d002a480 comp rx=0 tx=0).stop 2024-09-12T01:35:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.200+0000 7ff8e5daa640 1 -- 172.21.15.81:0/2164181567 shutdown_connections 2024-09-12T01:35:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.200+0000 7ff8e5daa640 1 --2- 172.21.15.81:0/2164181567 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8e0102ef0 0x7ff8e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.200+0000 7ff8e5daa640 1 --2- 172.21.15.81:0/2164181567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e0102570 0x7ff8e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.200+0000 7ff8e5daa640 1 --2- 172.21.15.81:0/2164181567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e0100e20 0x7ff8e0101200 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.200+0000 7ff8e5daa640 1 -- 172.21.15.81:0/2164181567 >> 172.21.15.81:0/2164181567 conn(0x7ff8e00fc7d0 msgr2=0x7ff8e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.200+0000 7ff8e5daa640 1 -- 172.21.15.81:0/2164181567 shutdown_connections 2024-09-12T01:35:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.200+0000 7ff8e5daa640 1 -- 172.21.15.81:0/2164181567 wait complete. 2024-09-12T01:35:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.201+0000 7ff8e5daa640 1 Processor -- start 2024-09-12T01:35:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.201+0000 7ff8e5daa640 1 -- start start 2024-09-12T01:35:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.201+0000 7ff8e5daa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e0100e20 0x7ff8e0199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.201+0000 7ff8e5daa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e0102570 0x7ff8e0199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.201+0000 7ff8e5daa640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8e0102ef0 0x7ff8e01a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.201+0000 7ff8e5daa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e0110f80 con 0x7ff8e0102570 2024-09-12T01:35:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.201+0000 7ff8e5daa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e0110e00 con 0x7ff8e0100e20 2024-09-12T01:35:16.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.201+0000 7ff8e5daa640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e0111100 con 0x7ff8e0102ef0 2024-09-12T01:35:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8d6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e0102570 0x7ff8e0199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8df7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e0100e20 0x7ff8e0199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8d6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e0102570 0x7ff8e0199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55180/0 (socket says 172.21.15.81:55180) 2024-09-12T01:35:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8d6ffd640 1 -- 172.21.15.81:0/3969601626 learned_addr learned my addr 172.21.15.81:0/3969601626 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8dffff640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8e0102ef0 0x7ff8e01a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8df7fe640 1 -- 172.21.15.81:0/3969601626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8e0102ef0 msgr2=0x7ff8e01a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8e0102ef0 0x7ff8e01a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8df7fe640 1 -- 172.21.15.81:0/3969601626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e0102570 msgr2=0x7ff8e0199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e0102570 0x7ff8e0199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8df7fe640 1 -- 172.21.15.81:0/3969601626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e01a4910 con 0x7ff8e0100e20 2024-09-12T01:35:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8d6ffd640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e0102570 0x7ff8e0199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e0100e20 0x7ff8e0199350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0005940 tx=0x7ff8d0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:16.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8dd7fa640 1 -- 172.21.15.81:0/3969601626 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d003f070 con 0x7ff8e0100e20 2024-09-12T01:35:16.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8e5daa640 1 -- 172.21.15.81:0/3969601626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e01a4ae0 con 0x7ff8e0100e20 2024-09-12T01:35:16.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8dd7fa640 1 -- 172.21.15.81:0/3969601626 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8d0031c30 con 0x7ff8e0100e20 2024-09-12T01:35:16.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8dd7fa640 1 -- 172.21.15.81:0/3969601626 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0035030 con 0x7ff8e0100e20 2024-09-12T01:35:16.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.202+0000 7ff8e5daa640 1 -- 172.21.15.81:0/3969601626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e01a4f90 con 0x7ff8e0100e20 2024-09-12T01:35:16.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.205+0000 7ff8dd7fa640 1 -- 172.21.15.81:0/3969601626 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff8d0042070 con 0x7ff8e0100e20 2024-09-12T01:35:16.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.205+0000 7ff8e8183740 1 Processor -- start 2024-09-12T01:35:16.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.205+0000 7ff8e8183740 1 -- start start 2024-09-12T01:35:16.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8e8183740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f34eb60 0x564c3f34ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8e8183740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f359800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8e8183740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f359d40 0x564c3f35c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8e8183740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564c3f2b4280 con 0x564c3f34f480 2024-09-12T01:35:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8e8183740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564c3f25bb10 con 0x564c3f34eb60 2024-09-12T01:35:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8e8183740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564c3f2b0240 con 0x564c3f359d40 2024-09-12T01:35:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8df7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f359800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8df7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f359800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55182/0 (socket says 172.21.15.81:55182) 2024-09-12T01:35:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8df7fe640 1 -- 172.21.15.81:0/2013694570 learned_addr learned my addr 172.21.15.81:0/2013694570 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8dffff640 1 --2- 172.21.15.81:0/2013694570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f34eb60 0x564c3f34ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8d6ffd640 1 --2- 172.21.15.81:0/2013694570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f359d40 0x564c3f35c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8df7fe640 1 -- 172.21.15.81:0/2013694570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f359d40 msgr2=0x564c3f35c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/2013694570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f359d40 0x564c3f35c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8df7fe640 1 -- 172.21.15.81:0/2013694570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f34eb60 msgr2=0x564c3f34ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/2013694570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f34eb60 0x564c3f34ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8df7fe640 1 -- 172.21.15.81:0/2013694570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c3f2681f0 con 0x564c3f34f480 2024-09-12T01:35:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8dffff640 1 --2- 172.21.15.81:0/2013694570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f34eb60 0x564c3f34ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.206+0000 7ff8dd7fa640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff8cc0a2cf0 0x7ff8cc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.207+0000 7ff8dffff640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff8cc0a2cf0 0x7ff8cc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.207+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/2013694570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f359800 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00ed110 tx=0x7ff8d00f3bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ae0105b0d3d9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.207+0000 7ff8dd7fa640 1 -- 172.21.15.81:0/3969601626 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7ff8d00efa70 con 0x7ff8e0100e20 2024-09-12T01:35:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.207+0000 7ff8d5ffb640 1 -- 172.21.15.81:0/2013694570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00b82c0 con 0x564c3f34f480 2024-09-12T01:35:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.207+0000 7ff8d5ffb640 1 -- 172.21.15.81:0/2013694570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8d0031de0 con 0x564c3f34f480 2024-09-12T01:35:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.207+0000 7ff8d5ffb640 1 -- 172.21.15.81:0/2013694570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00bb980 con 0x564c3f34f480 2024-09-12T01:35:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.208+0000 7ff8e8183740 1 -- 172.21.15.81:0/2013694570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 msgr2=0x564c3f359800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.208+0000 7ff8dffff640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff8cc0a2cf0 0x7ff8cc0a51b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8005fd0 tx=0x7ff8d80096a0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.208+0000 7ff8e8183740 1 --2- 172.21.15.81:0/2013694570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f359800 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00ed110 tx=0x7ff8d00f3bb0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.208+0000 7ff8e8183740 1 -- 172.21.15.81:0/2013694570 shutdown_connections 2024-09-12T01:35:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.208+0000 7ff8e8183740 1 --2- 172.21.15.81:0/2013694570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f359d40 0x564c3f35c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.208+0000 7ff8e8183740 1 --2- 172.21.15.81:0/2013694570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f359800 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.208+0000 7ff8e8183740 1 --2- 172.21.15.81:0/2013694570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f34eb60 0x564c3f34ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.208+0000 7ff8e8183740 1 -- 172.21.15.81:0/2013694570 >> 172.21.15.81:0/2013694570 conn(0x564c3f34b0f0 msgr2=0x564c3f34b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.208+0000 7ff8e8183740 1 -- 172.21.15.81:0/2013694570 shutdown_connections 2024-09-12T01:35:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.208+0000 7ff8e8183740 1 -- 172.21.15.81:0/2013694570 wait complete. 2024-09-12T01:35:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.208+0000 7ff8e8183740 1 -- start start 2024-09-12T01:35:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.208+0000 7ff8e8183740 1 Processor -- start 2024-09-12T01:35:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8e8183740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f34eb60 0x564c3f356c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8e8183740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f357170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8e8183740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f359d40 0x564c3f3576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8e8183740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564c3f35c6d0 con 0x564c3f34f480 2024-09-12T01:35:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8e8183740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564c3f26ef10 con 0x564c3f359d40 2024-09-12T01:35:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8e8183740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564c3f35c850 con 0x564c3f34eb60 2024-09-12T01:35:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8e8183740 10 client.0 _ll_register_callbacks cb 0x564c3f237a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8d6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f357170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8d6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f357170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55190/0 (socket says 172.21.15.81:55190) 2024-09-12T01:35:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8d6ffd640 1 -- 172.21.15.81:0/3350547025 learned_addr learned my addr 172.21.15.81:0/3350547025 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/3350547025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f34eb60 0x564c3f356c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8dffff640 1 --2- 172.21.15.81:0/3350547025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f359d40 0x564c3f3576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8d6ffd640 1 -- 172.21.15.81:0/3350547025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f34eb60 msgr2=0x564c3f356c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8d6ffd640 1 --2- 172.21.15.81:0/3350547025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f34eb60 0x564c3f356c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8d6ffd640 1 -- 172.21.15.81:0/3350547025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f359d40 msgr2=0x564c3f3576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8d6ffd640 1 --2- 172.21.15.81:0/3350547025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f359d40 0x564c3f3576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8d6ffd640 1 -- 172.21.15.81:0/3350547025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c3f0256a0 con 0x564c3f34f480 2024-09-12T01:35:16.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8d6ffd640 1 --2- 172.21.15.81:0/3350547025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f357170 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8012d50 tx=0x7ff8c800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1ffe94fe899d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:16.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.209+0000 7ff8beffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:16.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8beffd640 1 -- 172.21.15.81:0/3350547025 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8012110 con 0x564c3f34f480 2024-09-12T01:35:16.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8beffd640 1 -- 172.21.15.81:0/3350547025 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7ff8c8004050 con 0x564c3f34f480 2024-09-12T01:35:16.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8e8183740 1 -- 172.21.15.81:0/3350547025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8d0031de0 con 0x564c3f34f480 2024-09-12T01:35:16.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8beffd640 1 -- 172.21.15.81:0/3350547025 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff8c80122b0 con 0x564c3f34f480 2024-09-12T01:35:16.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8e8183740 10 client.17127 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:16.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8e8183740 1 -- 172.21.15.81:0/3350547025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564c3f3682b0 con 0x564c3f34f480 2024-09-12T01:35:16.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8beffd640 1 -- 172.21.15.81:0/3350547025 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8c8004250 con 0x564c3f34f480 2024-09-12T01:35:16.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8beffd640 1 -- 172.21.15.81:0/3350547025 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff8c80104c0 con 0x564c3f34f480 2024-09-12T01:35:16.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8e8183740 10 client.17127 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:16.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8e8183740 10 client.17127 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:35:16.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8e8183740 20 client.17127 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:16.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8e8183740 1 --2- 172.21.15.81:0/3350547025 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x564c3f3696c0 0x564c3f36bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8e8183740 4 client.17127 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:16.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.210+0000 7ff8e8183740 1 -- 172.21.15.81:0/3350547025 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff8d0031de0 con 0x564c3f3696c0 2024-09-12T01:35:16.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.211+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/3350547025 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x564c3f3696c0 0x564c3f36bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.211+0000 7ff8beffd640 10 client.17127 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:16.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.211+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/3350547025 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x564c3f3696c0 0x564c3f36bad0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c41dd29ef369989e server_cookie=e49687f01b16d7fc in_seq=0 out_seq=0 2024-09-12T01:35:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.211+0000 7ff8beffd640 1 -- 172.21.15.81:0/3350547025 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff8d0031de0 con 0x564c3f3696c0 2024-09-12T01:35:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.211+0000 7ff8beffd640 10 client.17127 handle_command_reply: tid=0 2024-09-12T01:35:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.212+0000 7ff8e8183740 1 client.17127 shutdown 2024-09-12T01:35:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.212+0000 7ff8e8183740 1 -- 172.21.15.81:0/3350547025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 msgr2=0x564c3f357170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.212+0000 7ff8e8183740 1 --2- 172.21.15.81:0/3350547025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f357170 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8012d50 tx=0x7ff8c800f790 comp rx=0 tx=0).stop 2024-09-12T01:35:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.212+0000 7ff8e8183740 1 -- 172.21.15.81:0/3350547025 shutdown_connections 2024-09-12T01:35:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.212+0000 7ff8e8183740 1 --2- 172.21.15.81:0/3350547025 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x564c3f3696c0 0x564c3f36bad0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.212+0000 7ff8e8183740 1 --2- 172.21.15.81:0/3350547025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f359d40 0x564c3f3576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.212+0000 7ff8beffd640 0 client.17127 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:16.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.212+0000 7ff8e8183740 1 --2- 172.21.15.81:0/3350547025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f357170 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.212+0000 7ff8e8183740 1 --2- 172.21.15.81:0/3350547025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f34eb60 0x564c3f356c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.212+0000 7ff8e8183740 1 -- 172.21.15.81:0/3350547025 >> 172.21.15.81:0/3350547025 conn(0x564c3f34b0f0 msgr2=0x564c3f350e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:16.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.212+0000 7ff8e8183740 1 -- 172.21.15.81:0/3350547025 shutdown_connections 2024-09-12T01:35:16.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.212+0000 7ff8e8183740 1 -- 172.21.15.81:0/3350547025 wait complete. 2024-09-12T01:35:16.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.212+0000 7ff8e8183740 20 client.17127 trim_cache size 0 max 16384 2024-09-12T01:35:16.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.232+0000 7ff8e8183740 1 Processor -- start 2024-09-12T01:35:16.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.232+0000 7ff8e8183740 1 -- start start 2024-09-12T01:35:16.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.232+0000 7ff8e8183740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34eb60 0x564c3f358a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.232+0000 7ff8e8183740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f34f480 0x564c3f3713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.232+0000 7ff8e8183740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f359d40 0x564c3f371920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.232+0000 7ff8e8183740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e01ad950 con 0x564c3f34eb60 2024-09-12T01:35:16.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.232+0000 7ff8e8183740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e01af490 con 0x564c3f359d40 2024-09-12T01:35:16.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.232+0000 7ff8e8183740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e01ae020 con 0x564c3f34f480 2024-09-12T01:35:16.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.232+0000 7ff8df7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34eb60 0x564c3f358a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.232+0000 7ff8df7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34eb60 0x564c3f358a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55198/0 (socket says 172.21.15.81:55198) 2024-09-12T01:35:16.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.232+0000 7ff8df7fe640 1 -- 172.21.15.81:0/188804797 learned_addr learned my addr 172.21.15.81:0/188804797 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:16.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.233+0000 7ff8d6ffd640 1 --2- 172.21.15.81:0/188804797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f34f480 0x564c3f3713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.233+0000 7ff8df7fe640 1 -- 172.21.15.81:0/188804797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f34f480 msgr2=0x564c3f3713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:16.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.233+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/188804797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f34f480 0x564c3f3713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.233+0000 7ff8df7fe640 1 -- 172.21.15.81:0/188804797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f359d40 msgr2=0x564c3f371920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:16.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.233+0000 7ff8dffff640 1 --2- 172.21.15.81:0/188804797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f359d40 0x564c3f371920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.233+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/188804797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f359d40 0x564c3f371920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.233+0000 7ff8df7fe640 1 -- 172.21.15.81:0/188804797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c3f355be0 con 0x564c3f34eb60 2024-09-12T01:35:16.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.233+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/188804797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34eb60 0x564c3f358a90 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00ed7a0 tx=0x7ff8d003b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7753ec7e7083d5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:16.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.233+0000 7ff8d57fa640 1 -- 172.21.15.81:0/188804797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00d6070 con 0x564c3f34eb60 2024-09-12T01:35:16.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.233+0000 7ff8d57fa640 1 -- 172.21.15.81:0/188804797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8d0031de0 con 0x564c3f34eb60 2024-09-12T01:35:16.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.233+0000 7ff8d57fa640 1 -- 172.21.15.81:0/188804797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0049040 con 0x564c3f34eb60 2024-09-12T01:35:16.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.234+0000 7ff8e8183740 1 -- 172.21.15.81:0/188804797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34eb60 msgr2=0x564c3f358a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:16.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.234+0000 7ff8e8183740 1 --2- 172.21.15.81:0/188804797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34eb60 0x564c3f358a90 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00ed7a0 tx=0x7ff8d003b790 comp rx=0 tx=0).stop 2024-09-12T01:35:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.234+0000 7ff8e8183740 1 -- 172.21.15.81:0/188804797 shutdown_connections 2024-09-12T01:35:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.234+0000 7ff8e8183740 1 --2- 172.21.15.81:0/188804797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f359d40 0x564c3f371920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.234+0000 7ff8e8183740 1 --2- 172.21.15.81:0/188804797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f34f480 0x564c3f3713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.234+0000 7ff8e8183740 1 --2- 172.21.15.81:0/188804797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34eb60 0x564c3f358a90 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.234+0000 7ff8e8183740 1 -- 172.21.15.81:0/188804797 >> 172.21.15.81:0/188804797 conn(0x564c3f34b0f0 msgr2=0x564c3f358380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.234+0000 7ff8e8183740 1 -- 172.21.15.81:0/188804797 shutdown_connections 2024-09-12T01:35:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.234+0000 7ff8e8183740 1 -- 172.21.15.81:0/188804797 wait complete. 2024-09-12T01:35:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.234+0000 7ff8e8183740 1 -- start start 2024-09-12T01:35:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.234+0000 7ff8e8183740 1 Processor -- start 2024-09-12T01:35:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8e8183740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f34eb60 0x564c3f3619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8e8183740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f361ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8e8183740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f359d40 0x564c3f35e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8e8183740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e01aedc0 con 0x564c3f34f480 2024-09-12T01:35:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8e8183740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e01ae6f0 con 0x564c3f34eb60 2024-09-12T01:35:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8e8183740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e01ab950 con 0x564c3f359d40 2024-09-12T01:35:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8e8183740 10 client.0 _ll_register_callbacks cb 0x7ff8c8009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8d6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f361ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8d6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f361ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55214/0 (socket says 172.21.15.81:55214) 2024-09-12T01:35:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8d6ffd640 1 -- 172.21.15.81:0/3631665935 learned_addr learned my addr 172.21.15.81:0/3631665935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f34eb60 0x564c3f3619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8dffff640 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f359d40 0x564c3f35e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8d6ffd640 1 -- 172.21.15.81:0/3631665935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f359d40 msgr2=0x564c3f35e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8d6ffd640 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f359d40 0x564c3f35e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8d6ffd640 1 -- 172.21.15.81:0/3631665935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f34eb60 msgr2=0x564c3f3619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8d6ffd640 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f34eb60 0x564c3f3619a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8d6ffd640 1 -- 172.21.15.81:0/3631665935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c3f35eeb0 con 0x564c3f34f480 2024-09-12T01:35:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8dffff640 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f359d40 0x564c3f35e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8d6ffd640 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f361ee0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x564c3f358270 tx=0x7ff8c8010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33af83c1c12ba4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8beffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.235+0000 7ff8beffd640 1 -- 172.21.15.81:0/3631665935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8029040 con 0x564c3f34f480 2024-09-12T01:35:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8e8183740 1 -- 172.21.15.81:0/3631665935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8d0031de0 con 0x564c3f34f480 2024-09-12T01:35:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8beffd640 1 -- 172.21.15.81:0/3631665935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7ff8c8010430 con 0x564c3f34f480 2024-09-12T01:35:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8beffd640 1 -- 172.21.15.81:0/3631665935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff8c8012110 con 0x564c3f34f480 2024-09-12T01:35:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8e8183740 10 client.17133 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8e8183740 1 -- 172.21.15.81:0/3631665935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564c3f3d4ba0 con 0x564c3f34f480 2024-09-12T01:35:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8beffd640 1 -- 172.21.15.81:0/3631665935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8d0031de0 con 0x564c3f34f480 2024-09-12T01:35:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8beffd640 1 -- 172.21.15.81:0/3631665935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff8c802c020 con 0x564c3f34f480 2024-09-12T01:35:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8e8183740 10 client.17133 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8e8183740 10 client.17133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:35:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8e8183740 20 client.17133 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8e8183740 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x564c3f3696c0 0x564c3f3d7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8e8183740 4 client.17133 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:35:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8e8183740 1 -- 172.21.15.81:0/3631665935 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564c3f2c17f0 con 0x564c3f3696c0 2024-09-12T01:35:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.236+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x564c3f3696c0 0x564c3f3d7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.237+0000 7ff8df7fe640 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x564c3f3696c0 0x564c3f3d7330 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0931a5f1107a2e5 server_cookie=d4299af09e534522 in_seq=0 out_seq=0 2024-09-12T01:35:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.237+0000 7ff8beffd640 10 client.17133 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.237+0000 7ff8beffd640 1 -- 172.21.15.81:0/3631665935 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564c3f2c17f0 con 0x564c3f3696c0 2024-09-12T01:35:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.237+0000 7ff8beffd640 10 client.17133 handle_command_reply: tid=0 2024-09-12T01:35:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.237+0000 7ff8e8183740 1 client.17133 shutdown 2024-09-12T01:35:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e8183740 1 -- 172.21.15.81:0/3631665935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 msgr2=0x564c3f361ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e8183740 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f361ee0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x564c3f358270 tx=0x7ff8c8010d10 comp rx=0 tx=0).stop 2024-09-12T01:35:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e8183740 1 -- 172.21.15.81:0/3631665935 shutdown_connections 2024-09-12T01:35:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e8183740 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x564c3f3696c0 0x564c3f3d7330 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e8183740 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564c3f359d40 0x564c3f35e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e8183740 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3f34f480 0x564c3f361ee0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e8183740 1 --2- 172.21.15.81:0/3631665935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564c3f34eb60 0x564c3f3619a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8beffd640 0 client.17133 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e8183740 1 -- 172.21.15.81:0/3631665935 >> 172.21.15.81:0/3631665935 conn(0x564c3f34b0f0 msgr2=0x564c3f3573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e8183740 1 -- 172.21.15.81:0/3631665935 shutdown_connections 2024-09-12T01:35:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e8183740 1 -- 172.21.15.81:0/3631665935 wait complete. 2024-09-12T01:35:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e8183740 20 client.17133 trim_cache size 0 max 16384 2024-09-12T01:35:16.243 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:35:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:35:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "56fab538-66a4-4109-bb74-d2fb73cd3fdd", 2024-09-12T01:35:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:35:16.244 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:35:16.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e5daa640 1 -- 172.21.15.81:0/3969601626 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff8cc0a2cf0 msgr2=0x7ff8cc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:16.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e5daa640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff8cc0a2cf0 0x7ff8cc0a51b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8005fd0 tx=0x7ff8d80096a0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.238+0000 7ff8e5daa640 1 -- 172.21.15.81:0/3969601626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e0100e20 msgr2=0x7ff8e0199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.239+0000 7ff8e5daa640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e0100e20 0x7ff8e0199350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0005940 tx=0x7ff8d0003c10 comp rx=0 tx=0).stop 2024-09-12T01:35:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.239+0000 7ff8e5daa640 1 -- 172.21.15.81:0/3969601626 shutdown_connections 2024-09-12T01:35:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.239+0000 7ff8e5daa640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff8cc0a2cf0 0x7ff8cc0a51b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.239+0000 7ff8e5daa640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff8e0102ef0 0x7ff8e01a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.239+0000 7ff8e5daa640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e0102570 0x7ff8e0199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.239+0000 7ff8e5daa640 1 --2- 172.21.15.81:0/3969601626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8e0100e20 0x7ff8e0199350 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.239+0000 7ff8e5daa640 1 -- 172.21.15.81:0/3969601626 >> 172.21.15.81:0/3969601626 conn(0x7ff8e00fc7d0 msgr2=0x7ff8e00fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.239+0000 7ff8e5daa640 1 -- 172.21.15.81:0/3969601626 shutdown_connections 2024-09-12T01:35:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:16.239+0000 7ff8e5daa640 1 -- 172.21.15.81:0/3969601626 wait complete. 2024-09-12T01:35:16.879 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:16 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:35:16.879 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:16 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:35:16.879 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:16 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:35:16.879 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:16 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:35:16.969 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:35:17.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:16 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:35:17.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:16 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:35:17.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:16 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:35:17.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:16 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:35:17.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:16 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:35:17.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:16 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:35:17.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:16 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:35:17.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:16 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:35:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:17.603 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:17 smithi081 ceph-mon[30920]: pgmap v220: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T01:35:17.603 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:17 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:35:17.603 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:17 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:35:17.603 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:17 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:35:17.603 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:17 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:35:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.683+0000 7fd32b2f9640 1 -- 172.21.15.81:0/4049778353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd324106b70 msgr2=0x7fd324106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.683+0000 7fd32b2f9640 1 --2- 172.21.15.81:0/4049778353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd324106b70 0x7fd324106f50 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd320009ca0 tx=0x7fd32002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 -- 172.21.15.81:0/4049778353 shutdown_connections 2024-09-12T01:35:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 --2- 172.21.15.81:0/4049778353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd324100a50 0x7fd3241057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 --2- 172.21.15.81:0/4049778353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd324100090 0x7fd324100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 --2- 172.21.15.81:0/4049778353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd324106b70 0x7fd324106f50 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 -- 172.21.15.81:0/4049778353 >> 172.21.15.81:0/4049778353 conn(0x7fd324077210 msgr2=0x7fd3240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 -- 172.21.15.81:0/4049778353 shutdown_connections 2024-09-12T01:35:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 -- 172.21.15.81:0/4049778353 wait complete. 2024-09-12T01:35:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 Processor -- start 2024-09-12T01:35:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 -- start start 2024-09-12T01:35:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd324100090 0x7fd3241a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd324100a50 0x7fd3241a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd324106b70 0x7fd32419e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd3241185c0 con 0x7fd324100a50 2024-09-12T01:35:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.684+0000 7fd32b2f9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd324118440 con 0x7fd324100090 2024-09-12T01:35:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd32b2f9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd324118740 con 0x7fd324106b70 2024-09-12T01:35:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd328894640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd324100a50 0x7fd3241a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd328894640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd324100a50 0x7fd3241a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55230/0 (socket says 172.21.15.81:55230) 2024-09-12T01:35:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd328894640 1 -- 172.21.15.81:0/3285744454 learned_addr learned my addr 172.21.15.81:0/3285744454 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd329095640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd324100090 0x7fd3241a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd329896640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd324106b70 0x7fd32419e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd328894640 1 -- 172.21.15.81:0/3285744454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd324106b70 msgr2=0x7fd32419e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd328894640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd324106b70 0x7fd32419e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd328894640 1 -- 172.21.15.81:0/3285744454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd324100090 msgr2=0x7fd3241a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd328894640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd324100090 0x7fd3241a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd328894640 1 -- 172.21.15.81:0/3285744454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32419ef80 con 0x7fd324100a50 2024-09-12T01:35:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd329095640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd324100090 0x7fd3241a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd328894640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd324100a50 0x7fd3241a4ba0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd31400c970 tx=0x7fd31400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:17.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd31a7fc640 1 -- 172.21.15.81:0/3285744454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314007bb0 con 0x7fd324100a50 2024-09-12T01:35:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd31a7fc640 1 -- 172.21.15.81:0/3285744454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd314007d50 con 0x7fd324100a50 2024-09-12T01:35:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd31a7fc640 1 -- 172.21.15.81:0/3285744454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31400f450 con 0x7fd324100a50 2024-09-12T01:35:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd32b2f9640 1 -- 172.21.15.81:0/3285744454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32419f270 con 0x7fd324100a50 2024-09-12T01:35:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.685+0000 7fd32b2f9640 1 -- 172.21.15.81:0/3285744454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3241ab4c0 con 0x7fd324100a50 2024-09-12T01:35:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd31a7fc640 1 -- 172.21.15.81:0/3285744454 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fd314005020 con 0x7fd324100a50 2024-09-12T01:35:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd32d6d2740 1 Processor -- start 2024-09-12T01:35:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd32d6d2740 1 -- start start 2024-09-12T01:35:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd32d6d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911e4a0 0x55ca9911e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd32d6d2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911edc0 0x55ca99129140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd32d6d2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca9912ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd32d6d2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ca990842e0 con 0x55ca99129680 2024-09-12T01:35:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd32d6d2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ca9902bce0 con 0x55ca9911edc0 2024-09-12T01:35:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd32d6d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ca990802a0 con 0x55ca9911e4a0 2024-09-12T01:35:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd328894640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca9912ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd328894640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca9912ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55246/0 (socket says 172.21.15.81:55246) 2024-09-12T01:35:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd328894640 1 -- 172.21.15.81:0/2698677927 learned_addr learned my addr 172.21.15.81:0/2698677927 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd31a7fc640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3100a2d70 0x7fd3100a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.688+0000 7fd329095640 1 --2- 172.21.15.81:0/2698677927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911edc0 0x55ca99129140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.689+0000 7fd329896640 1 --2- 172.21.15.81:0/2698677927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911e4a0 0x55ca9911e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.689+0000 7fd31a7fc640 1 -- 172.21.15.81:0/3285744454 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fd3140cf2a0 con 0x7fd324100a50 2024-09-12T01:35:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.689+0000 7fd329896640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3100a2d70 0x7fd3100a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.689+0000 7fd328894640 1 -- 172.21.15.81:0/2698677927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911e4a0 msgr2=0x55ca9911e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.689+0000 7fd328894640 1 --2- 172.21.15.81:0/2698677927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911e4a0 0x55ca9911e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.689+0000 7fd328894640 1 -- 172.21.15.81:0/2698677927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911edc0 msgr2=0x55ca99129140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.689+0000 7fd328894640 1 --2- 172.21.15.81:0/2698677927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911edc0 0x55ca99129140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.689+0000 7fd328894640 1 -- 172.21.15.81:0/2698677927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca99010440 con 0x55ca99129680 2024-09-12T01:35:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.689+0000 7fd328894640 1 --2- 172.21.15.81:0/2698677927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca9912ba70 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fd3140a3ec0 tx=0x7fd314004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dea57a3f0d0444 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.689+0000 7fd30f7fe640 1 -- 172.21.15.81:0/2698677927 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31401d050 con 0x55ca99129680 2024-09-12T01:35:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.689+0000 7fd30f7fe640 1 -- 172.21.15.81:0/2698677927 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd31409be80 con 0x55ca99129680 2024-09-12T01:35:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.689+0000 7fd329896640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3100a2d70 0x7fd3100a5230 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00ef20 tx=0x7fd31c005e50 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.689+0000 7fd30f7fe640 1 -- 172.21.15.81:0/2698677927 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314097df0 con 0x55ca99129680 2024-09-12T01:35:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.690+0000 7fd32d6d2740 1 -- 172.21.15.81:0/2698677927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 msgr2=0x55ca9912ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.690+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/2698677927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca9912ba70 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fd3140a3ec0 tx=0x7fd314004a20 comp rx=0 tx=0).stop 2024-09-12T01:35:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.690+0000 7fd32d6d2740 1 -- 172.21.15.81:0/2698677927 shutdown_connections 2024-09-12T01:35:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.690+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/2698677927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca9912ba70 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.690+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/2698677927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911edc0 0x55ca99129140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.690+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/2698677927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911e4a0 0x55ca9911e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.690+0000 7fd32d6d2740 1 -- 172.21.15.81:0/2698677927 >> 172.21.15.81:0/2698677927 conn(0x55ca9911aa30 msgr2=0x55ca9911ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.690+0000 7fd32d6d2740 1 -- 172.21.15.81:0/2698677927 shutdown_connections 2024-09-12T01:35:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.690+0000 7fd32d6d2740 1 -- 172.21.15.81:0/2698677927 wait complete. 2024-09-12T01:35:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.690+0000 7fd32d6d2740 1 -- start start 2024-09-12T01:35:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.690+0000 7fd32d6d2740 1 Processor -- start 2024-09-12T01:35:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd32d6d2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 0x55ca99128fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd32d6d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911edc0 0x55ca99126270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd32d6d2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca991267b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd32d6d2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ca9912c1f0 con 0x55ca99129680 2024-09-12T01:35:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd32d6d2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ca9903f050 con 0x55ca9911e4a0 2024-09-12T01:35:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd32d6d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ca9912c370 con 0x55ca9911edc0 2024-09-12T01:35:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd32d6d2740 10 client.0 _ll_register_callbacks cb 0x55ca9907f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:17.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd329896640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca991267b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd329896640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca991267b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55262/0 (socket says 172.21.15.81:55262) 2024-09-12T01:35:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd329896640 1 -- 172.21.15.81:0/3192485231 learned_addr learned my addr 172.21.15.81:0/3192485231 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd329095640 1 --2- 172.21.15.81:0/3192485231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 0x55ca99128fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd329896640 1 -- 172.21.15.81:0/3192485231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911edc0 msgr2=0x55ca99126270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd329896640 1 --2- 172.21.15.81:0/3192485231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911edc0 0x55ca99126270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd329896640 1 -- 172.21.15.81:0/3192485231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 msgr2=0x55ca99128fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd329896640 1 --2- 172.21.15.81:0/3192485231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 0x55ca99128fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd329896640 1 -- 172.21.15.81:0/3192485231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca98df53c0 con 0x55ca99129680 2024-09-12T01:35:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd329095640 1 --2- 172.21.15.81:0/3192485231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 0x55ca99128fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd329896640 1 --2- 172.21.15.81:0/3192485231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca991267b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fd31c010c00 tx=0x7fd31c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be4140c46329c90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd30cff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd30cff9640 1 -- 172.21.15.81:0/3192485231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c01d450 con 0x55ca99129680 2024-09-12T01:35:17.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd30cff9640 1 -- 172.21.15.81:0/3192485231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fd31c01d5f0 con 0x55ca99129680 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.691+0000 7fd32d6d2740 1 -- 172.21.15.81:0/3192485231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd31409be80 con 0x55ca99129680 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.692+0000 7fd30cff9640 1 -- 172.21.15.81:0/3192485231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd31c005020 con 0x55ca99129680 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.692+0000 7fd32d6d2740 10 client.17145 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.692+0000 7fd32d6d2740 1 -- 172.21.15.81:0/3192485231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca99137c00 con 0x55ca99129680 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.692+0000 7fd30cff9640 1 -- 172.21.15.81:0/3192485231 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd31409be80 con 0x55ca99129680 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.692+0000 7fd30cff9640 1 -- 172.21.15.81:0/3192485231 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd31c01a040 con 0x55ca99129680 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.692+0000 7fd32d6d2740 10 client.17145 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.692+0000 7fd32d6d2740 10 client.17145 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.692+0000 7fd32d6d2740 20 client.17145 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.692+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/3192485231 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ca99139010 0x55ca9913b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.692+0000 7fd32d6d2740 4 client.17145 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.692+0000 7fd32d6d2740 1 -- 172.21.15.81:0/3192485231 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca99091850 con 0x55ca99139010 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.692+0000 7fd329095640 1 --2- 172.21.15.81:0/3192485231 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ca99139010 0x55ca9913b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.693+0000 7fd30cff9640 10 client.17145 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.693+0000 7fd329095640 1 --2- 172.21.15.81:0/3192485231 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ca99139010 0x55ca9913b4a0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67a1dd1b48f06d59 server_cookie=812f72499f34f5cd in_seq=0 out_seq=0 2024-09-12T01:35:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.693+0000 7fd30cff9640 1 -- 172.21.15.81:0/3192485231 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca99091850 con 0x55ca99139010 2024-09-12T01:35:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.693+0000 7fd30cff9640 10 client.17145 handle_command_reply: tid=0 2024-09-12T01:35:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.693+0000 7fd32d6d2740 1 client.17145 shutdown 2024-09-12T01:35:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.694+0000 7fd32d6d2740 1 -- 172.21.15.81:0/3192485231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 msgr2=0x55ca991267b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.694+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/3192485231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca991267b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fd31c010c00 tx=0x7fd31c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.694+0000 7fd32d6d2740 1 -- 172.21.15.81:0/3192485231 shutdown_connections 2024-09-12T01:35:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.694+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/3192485231 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ca99139010 0x55ca9913b4a0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.694+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/3192485231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca991267b0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.694+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/3192485231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911edc0 0x55ca99126270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.694+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/3192485231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 0x55ca99128fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.694+0000 7fd30cff9640 0 client.17145 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.694+0000 7fd32d6d2740 1 -- 172.21.15.81:0/3192485231 >> 172.21.15.81:0/3192485231 conn(0x55ca9911aa30 msgr2=0x55ca99120710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:17.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.694+0000 7fd32d6d2740 1 -- 172.21.15.81:0/3192485231 shutdown_connections 2024-09-12T01:35:17.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.694+0000 7fd32d6d2740 1 -- 172.21.15.81:0/3192485231 wait complete. 2024-09-12T01:35:17.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.694+0000 7fd32d6d2740 20 client.17145 trim_cache size 0 max 16384 2024-09-12T01:35:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.711+0000 7fd32d6d2740 1 Processor -- start 2024-09-12T01:35:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd32d6d2740 1 -- start start 2024-09-12T01:35:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd32d6d2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 0x55ca99135450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd32d6d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911edc0 0x55ca99124b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd32d6d2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca99140d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd32d6d2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd3241b3e80 con 0x55ca99129680 2024-09-12T01:35:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd32d6d2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd3241b59c0 con 0x55ca9911e4a0 2024-09-12T01:35:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd32d6d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd3241b4550 con 0x55ca9911edc0 2024-09-12T01:35:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd329896640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca99140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd329896640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca99140d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55272/0 (socket says 172.21.15.81:55272) 2024-09-12T01:35:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd329896640 1 -- 172.21.15.81:0/2804235931 learned_addr learned my addr 172.21.15.81:0/2804235931 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd329095640 1 --2- 172.21.15.81:0/2804235931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 0x55ca99135450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd328894640 1 --2- 172.21.15.81:0/2804235931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911edc0 0x55ca99124b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd329896640 1 -- 172.21.15.81:0/2804235931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911edc0 msgr2=0x55ca99124b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd329896640 1 --2- 172.21.15.81:0/2804235931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911edc0 0x55ca99124b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd329896640 1 -- 172.21.15.81:0/2804235931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 msgr2=0x55ca99135450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd329896640 1 --2- 172.21.15.81:0/2804235931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 0x55ca99135450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd329896640 1 -- 172.21.15.81:0/2804235931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca99125220 con 0x55ca99129680 2024-09-12T01:35:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.712+0000 7fd329896640 1 --2- 172.21.15.81:0/2804235931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca99140d70 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fd31c004910 tx=0x7fd31c00e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc78a03b7505e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.713+0000 7fd30effd640 1 -- 172.21.15.81:0/2804235931 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00f850 con 0x55ca99129680 2024-09-12T01:35:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.713+0000 7fd30effd640 1 -- 172.21.15.81:0/2804235931 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd31c00fcd0 con 0x55ca99129680 2024-09-12T01:35:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.713+0000 7fd30effd640 1 -- 172.21.15.81:0/2804235931 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c01d6b0 con 0x55ca99129680 2024-09-12T01:35:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.713+0000 7fd32d6d2740 1 -- 172.21.15.81:0/2804235931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 msgr2=0x55ca99140d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.713+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/2804235931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca99140d70 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fd31c004910 tx=0x7fd31c00e750 comp rx=0 tx=0).stop 2024-09-12T01:35:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.713+0000 7fd32d6d2740 1 -- 172.21.15.81:0/2804235931 shutdown_connections 2024-09-12T01:35:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.713+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/2804235931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca99129680 0x55ca99140d70 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.713+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/2804235931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca9911edc0 0x55ca99124b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.713+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/2804235931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 0x55ca99135450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.713+0000 7fd32d6d2740 1 -- 172.21.15.81:0/2804235931 >> 172.21.15.81:0/2804235931 conn(0x55ca9911aa30 msgr2=0x55ca991218b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.713+0000 7fd32d6d2740 1 -- 172.21.15.81:0/2804235931 shutdown_connections 2024-09-12T01:35:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.713+0000 7fd32d6d2740 1 -- 172.21.15.81:0/2804235931 wait complete. 2024-09-12T01:35:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd32d6d2740 1 -- start start 2024-09-12T01:35:17.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd32d6d2740 1 Processor -- start 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd32d6d2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 0x55ca99131e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd32d6d2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca9911edc0 0x55ca9912d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd32d6d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca99129680 0x55ca9912d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd32d6d2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd3241b52f0 con 0x55ca9911edc0 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd32d6d2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd3241b4c20 con 0x55ca9911e4a0 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd32d6d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd3241b1e80 con 0x55ca99129680 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd32d6d2740 10 client.0 _ll_register_callbacks cb 0x7fd324107710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd328894640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca9911edc0 0x55ca9912d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd328894640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca9911edc0 0x55ca9912d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55280/0 (socket says 172.21.15.81:55280) 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd328894640 1 -- 172.21.15.81:0/4053006030 learned_addr learned my addr 172.21.15.81:0/4053006030 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd329095640 1 --2- 172.21.15.81:0/4053006030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 0x55ca99131e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.714+0000 7fd329896640 1 --2- 172.21.15.81:0/4053006030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca99129680 0x55ca9912d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd328894640 1 -- 172.21.15.81:0/4053006030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca99129680 msgr2=0x55ca9912d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:17.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd328894640 1 --2- 172.21.15.81:0/4053006030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca99129680 0x55ca9912d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd328894640 1 -- 172.21.15.81:0/4053006030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 msgr2=0x55ca99131e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd328894640 1 --2- 172.21.15.81:0/4053006030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 0x55ca99131e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd328894640 1 -- 172.21.15.81:0/4053006030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca991a2d40 con 0x55ca9911edc0 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd328894640 1 --2- 172.21.15.81:0/4053006030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca9911edc0 0x55ca9912d1c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fd314097be0 tx=0x7fd31409be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccda0b40cacca4c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd30cff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd30cff9640 1 -- 172.21.15.81:0/4053006030 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31409b780 con 0x55ca9911edc0 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd30cff9640 1 -- 172.21.15.81:0/4053006030 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8557+0+0 (secure 0 0 0) 0x7fd314005310 con 0x55ca9911edc0 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd32d6d2740 1 -- 172.21.15.81:0/4053006030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd31c00fcd0 con 0x55ca9911edc0 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd30cff9640 1 -- 172.21.15.81:0/4053006030 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd31401d070 con 0x55ca9911edc0 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd32d6d2740 10 client.17151 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd32d6d2740 1 -- 172.21.15.81:0/4053006030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ca991a3ee0 con 0x55ca9911edc0 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd30cff9640 1 -- 172.21.15.81:0/4053006030 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd31c00fcd0 con 0x55ca9911edc0 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.715+0000 7fd30cff9640 1 -- 172.21.15.81:0/4053006030 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd3140cccc0 con 0x55ca9911edc0 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.716+0000 7fd32d6d2740 10 client.17151 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:17.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.716+0000 7fd32d6d2740 10 client.17151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:35:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.716+0000 7fd32d6d2740 20 client.17151 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.716+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/4053006030 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ca991a4270 0x55ca991a6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.716+0000 7fd32d6d2740 4 client.17151 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:35:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.716+0000 7fd32d6d2740 1 -- 172.21.15.81:0/4053006030 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ca9908bd60 con 0x55ca991a4270 2024-09-12T01:35:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.716+0000 7fd329095640 1 --2- 172.21.15.81:0/4053006030 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ca991a4270 0x55ca991a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.716+0000 7fd329095640 1 --2- 172.21.15.81:0/4053006030 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ca991a4270 0x55ca991a6690 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f12c0f7f42ae82e0 server_cookie=18ab9546eefcd67b in_seq=0 out_seq=0 2024-09-12T01:35:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.716+0000 7fd30cff9640 10 client.17151 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd30cff9640 1 -- 172.21.15.81:0/4053006030 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ca9908bd60 con 0x55ca991a4270 2024-09-12T01:35:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd30cff9640 10 client.17151 handle_command_reply: tid=0 2024-09-12T01:35:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32d6d2740 1 client.17151 shutdown 2024-09-12T01:35:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32d6d2740 1 -- 172.21.15.81:0/4053006030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca9911edc0 msgr2=0x55ca9912d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:17.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/4053006030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca9911edc0 0x55ca9912d1c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fd314097be0 tx=0x7fd31409be80 comp rx=0 tx=0).stop 2024-09-12T01:35:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32d6d2740 1 -- 172.21.15.81:0/4053006030 shutdown_connections 2024-09-12T01:35:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/4053006030 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ca991a4270 0x55ca991a6690 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/4053006030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ca99129680 0x55ca9912d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/4053006030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca9911edc0 0x55ca9912d1c0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32d6d2740 1 --2- 172.21.15.81:0/4053006030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca9911e4a0 0x55ca99131e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32d6d2740 1 -- 172.21.15.81:0/4053006030 >> 172.21.15.81:0/4053006030 conn(0x55ca9911aa30 msgr2=0x55ca99127ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd30cff9640 0 client.17151 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32d6d2740 1 -- 172.21.15.81:0/4053006030 shutdown_connections 2024-09-12T01:35:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32d6d2740 1 -- 172.21.15.81:0/4053006030 wait complete. 2024-09-12T01:35:17.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32d6d2740 20 client.17151 trim_cache size 0 max 16384 2024-09-12T01:35:17.722 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:35:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:35:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-12T01:35:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "56fab538-66a4-4109-bb74-d2fb73cd3fdd": { 2024-09-12T01:35:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-09-12T01:35:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "56fab538-66a4-4109-bb74-d2fb73cd3fdd", 2024-09-12T01:35:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-12T01:35:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:35:17.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:35:17.723 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:35:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32b2f9640 1 -- 172.21.15.81:0/3285744454 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3100a2d70 msgr2=0x7fd3100a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32b2f9640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3100a2d70 0x7fd3100a5230 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00ef20 tx=0x7fd31c005e50 comp rx=0 tx=0).stop 2024-09-12T01:35:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32b2f9640 1 -- 172.21.15.81:0/3285744454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd324100a50 msgr2=0x7fd3241a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.717+0000 7fd32b2f9640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd324100a50 0x7fd3241a4ba0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd31400c970 tx=0x7fd31400ce30 comp rx=0 tx=0).stop 2024-09-12T01:35:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.718+0000 7fd32b2f9640 1 -- 172.21.15.81:0/3285744454 shutdown_connections 2024-09-12T01:35:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.718+0000 7fd32b2f9640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3100a2d70 0x7fd3100a5230 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.718+0000 7fd32b2f9640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd324106b70 0x7fd32419e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.718+0000 7fd32b2f9640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd324100a50 0x7fd3241a4ba0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.718+0000 7fd32b2f9640 1 --2- 172.21.15.81:0/3285744454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd324100090 0x7fd3241a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.718+0000 7fd32b2f9640 1 -- 172.21.15.81:0/3285744454 >> 172.21.15.81:0/3285744454 conn(0x7fd324077210 msgr2=0x7fd3241037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:17.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.718+0000 7fd32b2f9640 1 -- 172.21.15.81:0/3285744454 shutdown_connections 2024-09-12T01:35:17.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:17.718+0000 7fd32b2f9640 1 -- 172.21.15.81:0/3285744454 wait complete. 2024-09-12T01:35:18.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:17 smithi100 ceph-mon[35275]: pgmap v220: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T01:35:18.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:17 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:35:18.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:17 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:35:18.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:17 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:35:18.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:17 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:35:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:17 smithi189 ceph-mon[35357]: pgmap v220: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T01:35:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:17 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:35:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:17 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:35:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:17 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:35:18.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:17 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:35:18.502 INFO:tasks.cephfs.filesystem:scrub status for tag:56fab538-66a4-4109-bb74-d2fb73cd3fdd - {'path': '/', 'tag': '56fab538-66a4-4109-bb74-d2fb73cd3fdd', 'options': 'recursive,force'} 2024-09-12T01:35:19.913 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:19 smithi081 ceph-mon[30920]: pgmap v221: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T01:35:19.914 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:19 smithi081 ceph-mon[30920]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T01:35:20.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:19 smithi100 ceph-mon[35275]: pgmap v221: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T01:35:20.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:19 smithi100 ceph-mon[35275]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T01:35:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:19 smithi189 ceph-mon[35357]: pgmap v221: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T01:35:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:19 smithi189 ceph-mon[35357]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T01:35:20.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:20 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:35:21.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:20 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:35:21.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:20 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:35:21.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:21 smithi081 ceph-mon[30920]: pgmap v223: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 110 B/s wr, 11 op/s 2024-09-12T01:35:22.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:21 smithi100 ceph-mon[35275]: pgmap v223: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 110 B/s wr, 11 op/s 2024-09-12T01:35:22.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:21 smithi189 ceph-mon[35357]: pgmap v223: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 110 B/s wr, 11 op/s 2024-09-12T01:35:23.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:23 smithi081 ceph-mon[30920]: pgmap v224: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:35:24.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:23 smithi100 ceph-mon[35275]: pgmap v224: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:35:24.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:23 smithi189 ceph-mon[35357]: pgmap v224: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:35:25.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:25 smithi081 ceph-mon[30920]: pgmap v225: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:35:26.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:25 smithi100 ceph-mon[35275]: pgmap v225: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:35:26.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:25 smithi189 ceph-mon[35357]: pgmap v225: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:35:27.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:27 smithi081 ceph-mon[30920]: pgmap v226: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-12T01:35:28.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:27 smithi100 ceph-mon[35275]: pgmap v226: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-12T01:35:28.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:27 smithi189 ceph-mon[35357]: pgmap v226: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-12T01:35:29.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:29 smithi081 ceph-mon[30920]: pgmap v227: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-12T01:35:30.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:29 smithi100 ceph-mon[35275]: pgmap v227: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-12T01:35:30.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:29 smithi189 ceph-mon[35357]: pgmap v227: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-12T01:35:31.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:31 smithi081 ceph-mon[30920]: pgmap v228: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 op/s 2024-09-12T01:35:32.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:31 smithi100 ceph-mon[35275]: pgmap v228: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 op/s 2024-09-12T01:35:32.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:31 smithi189 ceph-mon[35357]: pgmap v228: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 op/s 2024-09-12T01:35:33.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:33 smithi081 ceph-mon[30920]: pgmap v229: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:34.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:33 smithi100 ceph-mon[35275]: pgmap v229: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:34.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:33 smithi189 ceph-mon[35357]: pgmap v229: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:35.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:35 smithi081 ceph-mon[30920]: pgmap v230: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:36.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:35 smithi100 ceph-mon[35275]: pgmap v230: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:36.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:35 smithi189 ceph-mon[35357]: pgmap v230: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:37.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:37 smithi081 ceph-mon[30920]: pgmap v231: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:38.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:37 smithi100 ceph-mon[35275]: pgmap v231: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:38.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:37 smithi189 ceph-mon[35357]: pgmap v231: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:39.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:39 smithi081 ceph-mon[30920]: pgmap v232: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:40.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:39 smithi100 ceph-mon[35275]: pgmap v232: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:40.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:39 smithi189 ceph-mon[35357]: pgmap v232: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:41.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:41 smithi081 ceph-mon[30920]: pgmap v233: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:42.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:41 smithi100 ceph-mon[35275]: pgmap v233: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:42.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:41 smithi189 ceph-mon[35357]: pgmap v233: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:43.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:43 smithi081 ceph-mon[30920]: pgmap v234: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:44.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:43 smithi100 ceph-mon[35275]: pgmap v234: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:44.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:43 smithi189 ceph-mon[35357]: pgmap v234: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:45.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:45 smithi081 ceph-mon[30920]: pgmap v235: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:46.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:45 smithi100 ceph-mon[35275]: pgmap v235: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:46.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:45 smithi189 ceph-mon[35357]: pgmap v235: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:47.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:47 smithi081 ceph-mon[30920]: pgmap v236: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:48.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:47 smithi100 ceph-mon[35275]: pgmap v236: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:48.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:47 smithi189 ceph-mon[35357]: pgmap v236: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:48.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:35:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:49.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.248+0000 7faea2a47640 1 -- 172.21.15.81:0/3355511361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae9c102790 msgr2=0x7fae9c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:49.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.248+0000 7faea2a47640 1 --2- 172.21.15.81:0/3355511361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae9c102790 0x7fae9c1067e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fae90009900 tx=0x7fae9002a410 comp rx=0 tx=0).stop 2024-09-12T01:35:49.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.248+0000 7faea2a47640 1 -- 172.21.15.81:0/3355511361 shutdown_connections 2024-09-12T01:35:49.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.248+0000 7faea2a47640 1 --2- 172.21.15.81:0/3355511361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae9c106f10 0x7fae9c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.248+0000 7faea2a47640 1 --2- 172.21.15.81:0/3355511361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae9c102790 0x7fae9c1067e0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.248+0000 7faea2a47640 1 --2- 172.21.15.81:0/3355511361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae9c101de0 0x7fae9c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.248+0000 7faea2a47640 1 -- 172.21.15.81:0/3355511361 >> 172.21.15.81:0/3355511361 conn(0x7fae9c0fd8c0 msgr2=0x7fae9c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:49.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.248+0000 7faea2a47640 1 -- 172.21.15.81:0/3355511361 shutdown_connections 2024-09-12T01:35:49.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.248+0000 7faea2a47640 1 -- 172.21.15.81:0/3355511361 wait complete. 2024-09-12T01:35:49.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.249+0000 7faea2a47640 1 Processor -- start 2024-09-12T01:35:49.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.249+0000 7faea2a47640 1 -- start start 2024-09-12T01:35:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea2a47640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae9c101de0 0x7fae9c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea2a47640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae9c102790 0x7fae9c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea2a47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae9c106f10 0x7fae9c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea2a47640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c112010 con 0x7fae9c106f10 2024-09-12T01:35:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea2a47640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c111e90 con 0x7fae9c102790 2024-09-12T01:35:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea2a47640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c112190 con 0x7fae9c101de0 2024-09-12T01:35:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea0fe4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae9c106f10 0x7fae9c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea0fe4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae9c106f10 0x7fae9c19ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55932/0 (socket says 172.21.15.81:55932) 2024-09-12T01:35:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea0fe4640 1 -- 172.21.15.81:0/3845463509 learned_addr learned my addr 172.21.15.81:0/3845463509 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae9c102790 0x7fae9c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7fae9bfff640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae9c101de0 0x7fae9c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea0fe4640 1 -- 172.21.15.81:0/3845463509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae9c101de0 msgr2=0x7fae9c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea0fe4640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae9c101de0 0x7fae9c1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea0fe4640 1 -- 172.21.15.81:0/3845463509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae9c102790 msgr2=0x7fae9c198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea0fe4640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae9c102790 0x7fae9c198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea0fe4640 1 -- 172.21.15.81:0/3845463509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9c19d560 con 0x7fae9c106f10 2024-09-12T01:35:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7fae9bfff640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae9c101de0 0x7fae9c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea0fe4640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae9c106f10 0x7fae9c19ce80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fae9400b970 tx=0x7fae9400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7fae997fa640 1 -- 172.21.15.81:0/3845463509 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94019070 con 0x7fae9c106f10 2024-09-12T01:35:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7fae997fa640 1 -- 172.21.15.81:0/3845463509 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae9400cb40 con 0x7fae9c106f10 2024-09-12T01:35:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7fae997fa640 1 -- 172.21.15.81:0/3845463509 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94007650 con 0x7fae9c106f10 2024-09-12T01:35:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea2a47640 1 -- 172.21.15.81:0/3845463509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae9c19d850 con 0x7fae9c106f10 2024-09-12T01:35:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.250+0000 7faea2a47640 1 -- 172.21.15.81:0/3845463509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae9c1a5130 con 0x7fae9c106f10 2024-09-12T01:35:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.253+0000 7fae997fa640 1 -- 172.21.15.81:0/3845463509 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fae9401c070 con 0x7fae9c106f10 2024-09-12T01:35:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.253+0000 7faea4e20740 1 Processor -- start 2024-09-12T01:35:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.253+0000 7faea4e20740 1 -- start start 2024-09-12T01:35:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7faea4e20740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c24a0 0x557a9a7c2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7faea4e20740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7c2dc0 0x557a9a7cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7faea4e20740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7cd680 0x557a9a7cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7faea4e20740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557a9a7282e0 con 0x557a9a7c24a0 2024-09-12T01:35:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7faea4e20740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557a9a6cfce0 con 0x557a9a7cd680 2024-09-12T01:35:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7faea4e20740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557a9a7242a0 con 0x557a9a7c2dc0 2024-09-12T01:35:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c24a0 0x557a9a7c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c24a0 0x557a9a7c2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55940/0 (socket says 172.21.15.81:55940) 2024-09-12T01:35:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae9b7fe640 1 -- 172.21.15.81:0/2967730070 learned_addr learned my addr 172.21.15.81:0/2967730070 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae9bfff640 1 --2- 172.21.15.81:0/2967730070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7c2dc0 0x557a9a7cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae997fa640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fae840a2d70 0x7fae840a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/2967730070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7cd680 0x557a9a7cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae9b7fe640 1 -- 172.21.15.81:0/2967730070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7c2dc0 msgr2=0x557a9a7cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/2967730070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7c2dc0 0x557a9a7cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae9b7fe640 1 -- 172.21.15.81:0/2967730070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7cd680 msgr2=0x557a9a7cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/2967730070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7cd680 0x557a9a7cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae9b7fe640 1 -- 172.21.15.81:0/2967730070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a9a6b4440 con 0x557a9a7c24a0 2024-09-12T01:35:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7faea0fe4640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fae840a2d70 0x7fae840a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae997fa640 1 -- 172.21.15.81:0/3845463509 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fae940ce8c0 con 0x7fae9c106f10 2024-09-12T01:35:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/2967730070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c24a0 0x557a9a7c2880 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fae90005ec0 tx=0x7fae90005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c75e4d76e30c86a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.254+0000 7fae827fc640 1 -- 172.21.15.81:0/2967730070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90035040 con 0x557a9a7c24a0 2024-09-12T01:35:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.255+0000 7fae827fc640 1 -- 172.21.15.81:0/2967730070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae90042070 con 0x557a9a7c24a0 2024-09-12T01:35:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.255+0000 7fae827fc640 1 -- 172.21.15.81:0/2967730070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90004b20 con 0x557a9a7c24a0 2024-09-12T01:35:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.255+0000 7faea4e20740 1 -- 172.21.15.81:0/2967730070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c24a0 msgr2=0x557a9a7c2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.255+0000 7faea0fe4640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fae840a2d70 0x7fae840a5230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae940cc1d0 tx=0x7fae94090430 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.255+0000 7faea4e20740 1 --2- 172.21.15.81:0/2967730070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c24a0 0x557a9a7c2880 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fae90005ec0 tx=0x7fae90005d90 comp rx=0 tx=0).stop 2024-09-12T01:35:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.255+0000 7faea4e20740 1 -- 172.21.15.81:0/2967730070 shutdown_connections 2024-09-12T01:35:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.255+0000 7faea4e20740 1 --2- 172.21.15.81:0/2967730070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7cd680 0x557a9a7cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.255+0000 7faea4e20740 1 --2- 172.21.15.81:0/2967730070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7c2dc0 0x557a9a7cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.255+0000 7faea4e20740 1 --2- 172.21.15.81:0/2967730070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c24a0 0x557a9a7c2880 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.255+0000 7faea4e20740 1 -- 172.21.15.81:0/2967730070 >> 172.21.15.81:0/2967730070 conn(0x557a9a7bea30 msgr2=0x557a9a7bee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.255+0000 7faea4e20740 1 -- 172.21.15.81:0/2967730070 shutdown_connections 2024-09-12T01:35:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.255+0000 7faea4e20740 1 -- 172.21.15.81:0/2967730070 wait complete. 2024-09-12T01:35:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7faea4e20740 1 -- start start 2024-09-12T01:35:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7faea4e20740 1 Processor -- start 2024-09-12T01:35:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7faea4e20740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 0x557a9a7ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7faea4e20740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7c2dc0 0x557a9a7ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7faea4e20740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7cd680 0x557a9a7ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7faea4e20740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557a9a7d0250 con 0x557a9a7cd680 2024-09-12T01:35:49.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7faea4e20740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557a9a6e3050 con 0x557a9a7c24a0 2024-09-12T01:35:49.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7faea4e20740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557a9a7d03d0 con 0x557a9a7c2dc0 2024-09-12T01:35:49.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7faea4e20740 10 client.0 _ll_register_callbacks cb 0x557a9a723160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:49.315 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:35:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:35:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:35:49.316 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:35:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7fae9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7cd680 0x557a9a7ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7fae9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7cd680 0x557a9a7ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55952/0 (socket says 172.21.15.81:55952) 2024-09-12T01:35:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7fae9b7fe640 1 -- 172.21.15.81:0/2569693077 learned_addr learned my addr 172.21.15.81:0/2569693077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/2569693077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 0x557a9a7ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7fae9bfff640 1 --2- 172.21.15.81:0/2569693077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7c2dc0 0x557a9a7ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7fae9b7fe640 1 -- 172.21.15.81:0/2569693077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7c2dc0 msgr2=0x557a9a7ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.256+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/2569693077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7c2dc0 0x557a9a7ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7fae9b7fe640 1 -- 172.21.15.81:0/2569693077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 msgr2=0x557a9a7ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/2569693077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 0x557a9a7ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7fae9b7fe640 1 -- 172.21.15.81:0/2569693077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a9a4993c0 con 0x557a9a7cd680 2024-09-12T01:35:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/2569693077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7cd680 0x557a9a7ca7e0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fae90004650 tx=0x7fae90004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e098be4f1802b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7fae7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7fae7b7fe640 1 -- 172.21.15.81:0/2569693077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90035030 con 0x557a9a7cd680 2024-09-12T01:35:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7fae7b7fe640 1 -- 172.21.15.81:0/2569693077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fae90005230 con 0x557a9a7cd680 2024-09-12T01:35:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7faea4e20740 1 -- 172.21.15.81:0/2569693077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae90042070 con 0x557a9a7cd680 2024-09-12T01:35:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7fae7b7fe640 1 -- 172.21.15.81:0/2569693077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fae90005430 con 0x557a9a7cd680 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7faea4e20740 10 client.17163 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7faea4e20740 1 -- 172.21.15.81:0/2569693077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557a9a7dbc20 con 0x557a9a7cd680 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7fae7b7fe640 1 -- 172.21.15.81:0/2569693077 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae90042070 con 0x557a9a7cd680 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7fae7b7fe640 1 -- 172.21.15.81:0/2569693077 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fae90053400 con 0x557a9a7cd680 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7faea4e20740 10 client.17163 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7faea4e20740 10 client.17163 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7faea4e20740 20 client.17163 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7faea4e20740 1 --2- 172.21.15.81:0/2569693077 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557a9a7dcf70 0x557a9a7df360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7faea4e20740 4 client.17163 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.257+0000 7faea4e20740 1 -- 172.21.15.81:0/2569693077 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a9a735850 con 0x557a9a7dcf70 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.258+0000 7fae9bfff640 1 --2- 172.21.15.81:0/2569693077 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557a9a7dcf70 0x557a9a7df360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.258+0000 7fae9bfff640 1 --2- 172.21.15.81:0/2569693077 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557a9a7dcf70 0x557a9a7df360 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f72ee4d072a8a574 server_cookie=8a7e2a2c980f4ff7 in_seq=0 out_seq=0 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.258+0000 7fae7b7fe640 10 client.17163 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7fae7b7fe640 1 -- 172.21.15.81:0/2569693077 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a9a735850 con 0x557a9a7dcf70 2024-09-12T01:35:49.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7fae7b7fe640 10 client.17163 handle_command_reply: tid=0 2024-09-12T01:35:49.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7faea4e20740 1 client.17163 shutdown 2024-09-12T01:35:49.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7faea4e20740 1 -- 172.21.15.81:0/2569693077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7cd680 msgr2=0x557a9a7ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:49.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7faea4e20740 1 --2- 172.21.15.81:0/2569693077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7cd680 0x557a9a7ca7e0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fae90004650 tx=0x7fae90004590 comp rx=0 tx=0).stop 2024-09-12T01:35:49.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7faea4e20740 1 -- 172.21.15.81:0/2569693077 shutdown_connections 2024-09-12T01:35:49.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7faea4e20740 1 --2- 172.21.15.81:0/2569693077 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557a9a7dcf70 0x557a9a7df360 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7faea4e20740 1 --2- 172.21.15.81:0/2569693077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7cd680 0x557a9a7ca7e0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7faea4e20740 1 --2- 172.21.15.81:0/2569693077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7c2dc0 0x557a9a7ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7fae7b7fe640 0 client.17163 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:49.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7faea4e20740 1 --2- 172.21.15.81:0/2569693077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 0x557a9a7ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7faea4e20740 1 -- 172.21.15.81:0/2569693077 >> 172.21.15.81:0/2569693077 conn(0x557a9a7bea30 msgr2=0x557a9a7c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7faea4e20740 1 -- 172.21.15.81:0/2569693077 shutdown_connections 2024-09-12T01:35:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7faea4e20740 1 -- 172.21.15.81:0/2569693077 wait complete. 2024-09-12T01:35:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.259+0000 7faea4e20740 20 client.17163 trim_cache size 0 max 16384 2024-09-12T01:35:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7faea4e20740 1 Processor -- start 2024-09-12T01:35:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7faea4e20740 1 -- start start 2024-09-12T01:35:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7faea4e20740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 0x557a9a7bda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7faea4e20740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 0x557a9a7e2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7faea4e20740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7cd680 0x557a9a7e28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7faea4e20740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c1ad7f0 con 0x557a9a7c2dc0 2024-09-12T01:35:49.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7faea4e20740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c1af330 con 0x557a9a7c24a0 2024-09-12T01:35:49.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7faea4e20740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c1adec0 con 0x557a9a7cd680 2024-09-12T01:35:49.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7fae9bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 0x557a9a7e2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7fae9bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 0x557a9a7e2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55968/0 (socket says 172.21.15.81:55968) 2024-09-12T01:35:49.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7fae9bfff640 1 -- 172.21.15.81:0/1372152042 learned_addr learned my addr 172.21.15.81:0/1372152042 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:49.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/1372152042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 0x557a9a7bda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/1372152042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7cd680 0x557a9a7e28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7fae9bfff640 1 -- 172.21.15.81:0/1372152042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7cd680 msgr2=0x557a9a7e28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:49.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7fae9bfff640 1 --2- 172.21.15.81:0/1372152042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7cd680 0x557a9a7e28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7fae9bfff640 1 -- 172.21.15.81:0/1372152042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 msgr2=0x557a9a7bda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:49.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7fae9bfff640 1 --2- 172.21.15.81:0/1372152042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 0x557a9a7bda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7fae9bfff640 1 -- 172.21.15.81:0/1372152042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a9a7cd340 con 0x557a9a7c2dc0 2024-09-12T01:35:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/1372152042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 0x557a9a7bda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.276+0000 7fae9bfff640 1 --2- 172.21.15.81:0/1372152042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 0x557a9a7e2390 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x557a9a7cb8c0 tx=0x7fae8c006da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ce6141096f170e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.277+0000 7fae81ffb640 1 -- 172.21.15.81:0/1372152042 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c016a60 con 0x557a9a7c2dc0 2024-09-12T01:35:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.277+0000 7fae81ffb640 1 -- 172.21.15.81:0/1372152042 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae8c01f030 con 0x557a9a7c2dc0 2024-09-12T01:35:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.277+0000 7fae81ffb640 1 -- 172.21.15.81:0/1372152042 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0143b0 con 0x557a9a7c2dc0 2024-09-12T01:35:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.277+0000 7faea4e20740 1 -- 172.21.15.81:0/1372152042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 msgr2=0x557a9a7e2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.277+0000 7faea4e20740 1 --2- 172.21.15.81:0/1372152042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 0x557a9a7e2390 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x557a9a7cb8c0 tx=0x7fae8c006da0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.277+0000 7faea4e20740 1 -- 172.21.15.81:0/1372152042 shutdown_connections 2024-09-12T01:35:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.277+0000 7faea4e20740 1 --2- 172.21.15.81:0/1372152042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7cd680 0x557a9a7e28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.277+0000 7faea4e20740 1 --2- 172.21.15.81:0/1372152042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 0x557a9a7e2390 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.277+0000 7faea4e20740 1 --2- 172.21.15.81:0/1372152042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 0x557a9a7bda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.277+0000 7faea4e20740 1 -- 172.21.15.81:0/1372152042 >> 172.21.15.81:0/1372152042 conn(0x557a9a7bea30 msgr2=0x557a9a7bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.277+0000 7faea4e20740 1 -- 172.21.15.81:0/1372152042 shutdown_connections 2024-09-12T01:35:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.277+0000 7faea4e20740 1 -- 172.21.15.81:0/1372152042 wait complete. 2024-09-12T01:35:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.277+0000 7faea4e20740 1 -- start start 2024-09-12T01:35:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7faea4e20740 1 Processor -- start 2024-09-12T01:35:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7faea4e20740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 0x557a9a7e1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7faea4e20740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 0x557a9a7e24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7faea4e20740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7cd680 0x557a9a83ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7faea4e20740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c1aec60 con 0x557a9a7c2dc0 2024-09-12T01:35:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7faea4e20740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c1ae590 con 0x557a9a7c24a0 2024-09-12T01:35:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7faea4e20740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c1ab7f0 con 0x557a9a7cd680 2024-09-12T01:35:49.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7faea4e20740 10 client.0 _ll_register_callbacks cb 0x7fae8c00a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7fae9bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 0x557a9a7e24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7fae9bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 0x557a9a7e24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55972/0 (socket says 172.21.15.81:55972) 2024-09-12T01:35:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7fae9bfff640 1 -- 172.21.15.81:0/1717627662 learned_addr learned my addr 172.21.15.81:0/1717627662 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7fae9bfff640 1 -- 172.21.15.81:0/1717627662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7cd680 msgr2=0x557a9a83ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7fae9bfff640 1 --2- 172.21.15.81:0/1717627662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7cd680 0x557a9a83ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7fae9bfff640 1 -- 172.21.15.81:0/1717627662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 msgr2=0x557a9a7e1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/1717627662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 0x557a9a7e1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7fae9bfff640 1 --2- 172.21.15.81:0/1717627662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 0x557a9a7e1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7fae9bfff640 1 -- 172.21.15.81:0/1717627662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a9a83f260 con 0x557a9a7c2dc0 2024-09-12T01:35:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7fae9bfff640 1 --2- 172.21.15.81:0/1717627662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 0x557a9a7e24b0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fae8c008010 tx=0x7fae8c023f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffcc640d88556b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.278+0000 7fae7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7fae7b7fe640 1 -- 172.21.15.81:0/1717627662 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c02a070 con 0x557a9a7c2dc0 2024-09-12T01:35:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7fae7b7fe640 1 -- 172.21.15.81:0/1717627662 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fae8c017d70 con 0x557a9a7c2dc0 2024-09-12T01:35:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7faea4e20740 1 -- 172.21.15.81:0/1717627662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae8c01f030 con 0x557a9a7c2dc0 2024-09-12T01:35:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7fae7b7fe640 1 -- 172.21.15.81:0/1717627662 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fae8c036050 con 0x557a9a7c2dc0 2024-09-12T01:35:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7faea4e20740 10 client.17169 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7faea4e20740 1 -- 172.21.15.81:0/1717627662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557a9a847770 con 0x557a9a7c2dc0 2024-09-12T01:35:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7fae7b7fe640 1 -- 172.21.15.81:0/1717627662 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae8c01f030 con 0x557a9a7c2dc0 2024-09-12T01:35:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7fae7b7fe640 1 -- 172.21.15.81:0/1717627662 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fae8c006040 con 0x557a9a7c2dc0 2024-09-12T01:35:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7faea4e20740 10 client.17169 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7faea4e20740 10 client.17169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:35:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7faea4e20740 20 client.17169 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7faea4e20740 1 --2- 172.21.15.81:0/1717627662 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557a9a847e30 0x557a9a84a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7faea4e20740 4 client.17169 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:35:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.279+0000 7faea4e20740 1 -- 172.21.15.81:0/1717627662 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557a9a72fd60 con 0x557a9a847e30 2024-09-12T01:35:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/1717627662 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557a9a847e30 0x557a9a84a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7fae9b7fe640 1 --2- 172.21.15.81:0/1717627662 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557a9a847e30 0x557a9a84a250 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d52a2bbb329501d8 server_cookie=3a3f5db7c346fe3c in_seq=0 out_seq=0 2024-09-12T01:35:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7fae7b7fe640 10 client.17169 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7fae7b7fe640 1 -- 172.21.15.81:0/1717627662 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557a9a72fd60 con 0x557a9a847e30 2024-09-12T01:35:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7fae7b7fe640 10 client.17169 handle_command_reply: tid=0 2024-09-12T01:35:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7faea4e20740 1 client.17169 shutdown 2024-09-12T01:35:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7faea4e20740 1 -- 172.21.15.81:0/1717627662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 msgr2=0x557a9a7e24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7faea4e20740 1 --2- 172.21.15.81:0/1717627662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 0x557a9a7e24b0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fae8c008010 tx=0x7fae8c023f00 comp rx=0 tx=0).stop 2024-09-12T01:35:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7faea4e20740 1 -- 172.21.15.81:0/1717627662 shutdown_connections 2024-09-12T01:35:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7faea4e20740 1 --2- 172.21.15.81:0/1717627662 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x557a9a847e30 0x557a9a84a250 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7faea4e20740 1 --2- 172.21.15.81:0/1717627662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a9a7cd680 0x557a9a83ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7faea4e20740 1 --2- 172.21.15.81:0/1717627662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a9a7c2dc0 0x557a9a7e24b0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7fae7b7fe640 0 client.17169 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:49.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7faea4e20740 1 --2- 172.21.15.81:0/1717627662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557a9a7c24a0 0x557a9a7e1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7faea4e20740 1 -- 172.21.15.81:0/1717627662 >> 172.21.15.81:0/1717627662 conn(0x557a9a7bea30 msgr2=0x557a9a7bdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:49.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7faea4e20740 1 -- 172.21.15.81:0/1717627662 shutdown_connections 2024-09-12T01:35:49.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7faea4e20740 1 -- 172.21.15.81:0/1717627662 wait complete. 2024-09-12T01:35:49.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.280+0000 7faea4e20740 20 client.17169 trim_cache size 0 max 16384 2024-09-12T01:35:49.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.281+0000 7faea2a47640 1 -- 172.21.15.81:0/3845463509 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fae840a2d70 msgr2=0x7fae840a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:49.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.281+0000 7faea2a47640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fae840a2d70 0x7fae840a5230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae940cc1d0 tx=0x7fae94090430 comp rx=0 tx=0).stop 2024-09-12T01:35:49.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.281+0000 7faea2a47640 1 -- 172.21.15.81:0/3845463509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae9c106f10 msgr2=0x7fae9c19ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:49.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.281+0000 7faea2a47640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae9c106f10 0x7fae9c19ce80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fae9400b970 tx=0x7fae9400be30 comp rx=0 tx=0).stop 2024-09-12T01:35:49.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.281+0000 7faea2a47640 1 -- 172.21.15.81:0/3845463509 shutdown_connections 2024-09-12T01:35:49.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.281+0000 7faea2a47640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fae840a2d70 0x7fae840a5230 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.281+0000 7faea2a47640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae9c106f10 0x7fae9c19ce80 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.281+0000 7faea2a47640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae9c102790 0x7fae9c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.281+0000 7faea2a47640 1 --2- 172.21.15.81:0/3845463509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae9c101de0 0x7fae9c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.281+0000 7faea2a47640 1 -- 172.21.15.81:0/3845463509 >> 172.21.15.81:0/3845463509 conn(0x7fae9c0fd8c0 msgr2=0x7fae9c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:49.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.281+0000 7faea2a47640 1 -- 172.21.15.81:0/3845463509 shutdown_connections 2024-09-12T01:35:49.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:49.281+0000 7faea2a47640 1 -- 172.21.15.81:0/3845463509 wait complete. 2024-09-12T01:35:49.912 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:49 smithi081 ceph-mon[30920]: pgmap v237: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:49.990 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:35:49.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:35:50.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:49 smithi100 ceph-mon[35275]: pgmap v237: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:50.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:49 smithi189 ceph-mon[35357]: pgmap v237: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:50.246 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:50.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.739+0000 7f72ede50640 1 -- 172.21.15.81:0/118157644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8101420 msgr2=0x7f72e810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.739+0000 7f72ede50640 1 --2- 172.21.15.81:0/118157644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8101420 0x7f72e810d950 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009cd0 tx=0x7f72e002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.739+0000 7f72ede50640 1 -- 172.21.15.81:0/118157644 shutdown_connections 2024-09-12T01:35:50.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.739+0000 7f72ede50640 1 --2- 172.21.15.81:0/118157644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8101420 0x7f72e810d950 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.739+0000 7f72ede50640 1 --2- 172.21.15.81:0/118157644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72e8100a80 0x7f72e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.739+0000 7f72ede50640 1 --2- 172.21.15.81:0/118157644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e8106a80 0x7f72e8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.739+0000 7f72ede50640 1 -- 172.21.15.81:0/118157644 >> 172.21.15.81:0/118157644 conn(0x7f72e80fc7a0 msgr2=0x7f72e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:50.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.739+0000 7f72ede50640 1 -- 172.21.15.81:0/118157644 shutdown_connections 2024-09-12T01:35:50.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.739+0000 7f72ede50640 1 -- 172.21.15.81:0/118157644 wait complete. 2024-09-12T01:35:50.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72ede50640 1 Processor -- start 2024-09-12T01:35:50.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72ede50640 1 -- start start 2024-09-12T01:35:50.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72ede50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8100a80 0x7f72e81992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72ede50640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72e8101420 0x7f72e8199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72ede50640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e8106a80 0x7f72e81a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72ede50640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72e8110ea0 con 0x7f72e8100a80 2024-09-12T01:35:50.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72ede50640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f72e8110d20 con 0x7f72e8106a80 2024-09-12T01:35:50.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72ede50640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f72e8111020 con 0x7f72e8101420 2024-09-12T01:35:50.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72e77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8100a80 0x7f72e81992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72e77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8100a80 0x7f72e81992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55986/0 (socket says 172.21.15.81:55986) 2024-09-12T01:35:50.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72e77fe640 1 -- 172.21.15.81:0/4002862573 learned_addr learned my addr 172.21.15.81:0/4002862573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72e7fff640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e8106a80 0x7f72e81a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72dffff640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72e8101420 0x7f72e8199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72e77fe640 1 -- 172.21.15.81:0/4002862573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72e8101420 msgr2=0x7f72e8199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72e77fe640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72e8101420 0x7f72e8199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72e77fe640 1 -- 172.21.15.81:0/4002862573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e8106a80 msgr2=0x7f72e81a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72e77fe640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e8106a80 0x7f72e81a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72e77fe640 1 -- 172.21.15.81:0/4002862573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e81a48b0 con 0x7f72e8100a80 2024-09-12T01:35:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72e7fff640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e8106a80 0x7f72e81a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.740+0000 7f72e77fe640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8100a80 0x7f72e81992f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f72d800d950 tx=0x7f72d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.741+0000 7f72e57fa640 1 -- 172.21.15.81:0/4002862573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d8017070 con 0x7f72e8100a80 2024-09-12T01:35:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.741+0000 7f72ede50640 1 -- 172.21.15.81:0/4002862573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e81a4a80 con 0x7f72e8100a80 2024-09-12T01:35:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.741+0000 7f72e57fa640 1 -- 172.21.15.81:0/4002862573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72d8009c30 con 0x7f72e8100a80 2024-09-12T01:35:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.741+0000 7f72ede50640 1 -- 172.21.15.81:0/4002862573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e81a4fc0 con 0x7f72e8100a80 2024-09-12T01:35:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.741+0000 7f72e57fa640 1 -- 172.21.15.81:0/4002862573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d800f6b0 con 0x7f72e8100a80 2024-09-12T01:35:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.742+0000 7f72ede50640 1 -- 172.21.15.81:0/4002862573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e8100ee0 con 0x7f72e8100a80 2024-09-12T01:35:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.743+0000 7f72e57fa640 1 -- 172.21.15.81:0/4002862573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f72d80109d0 con 0x7f72e8100a80 2024-09-12T01:35:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.743+0000 7f72e57fa640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f72d40a2d70 0x7f72d40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.744+0000 7f72dffff640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f72d40a2d70 0x7f72d40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.744+0000 7f72e57fa640 1 -- 172.21.15.81:0/4002862573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f72d80cf400 con 0x7f72e8100a80 2024-09-12T01:35:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.744+0000 7f72dffff640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f72d40a2d70 0x7f72d40a5230 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f72e806b2e0 tx=0x7f72d0008040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.747+0000 7f72e57fa640 1 -- 172.21.15.81:0/4002862573 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72d8009de0 con 0x7f72e8100a80 2024-09-12T01:35:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.947+0000 7f72ede50640 1 -- 172.21.15.81:0/4002862573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72e8109010 con 0x7f72e8100a80 2024-09-12T01:35:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.948+0000 7f72e57fa640 1 -- 172.21.15.81:0/4002862573 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f72d809c0a0 con 0x7f72e8100a80 2024-09-12T01:35:50.948 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:35:50.948 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:35:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:35:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.950+0000 7f72ede50640 1 -- 172.21.15.81:0/4002862573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f72d40a2d70 msgr2=0x7f72d40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.950+0000 7f72ede50640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f72d40a2d70 0x7f72d40a5230 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f72e806b2e0 tx=0x7f72d0008040 comp rx=0 tx=0).stop 2024-09-12T01:35:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.950+0000 7f72ede50640 1 -- 172.21.15.81:0/4002862573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8100a80 msgr2=0x7f72e81992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.950+0000 7f72ede50640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8100a80 0x7f72e81992f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f72d800d950 tx=0x7f72d800de10 comp rx=0 tx=0).stop 2024-09-12T01:35:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.950+0000 7f72ede50640 1 -- 172.21.15.81:0/4002862573 shutdown_connections 2024-09-12T01:35:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.950+0000 7f72ede50640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f72d40a2d70 0x7f72d40a5230 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.950+0000 7f72ede50640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72e8106a80 0x7f72e81a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.950+0000 7f72ede50640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72e8101420 0x7f72e8199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.950+0000 7f72ede50640 1 --2- 172.21.15.81:0/4002862573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8100a80 0x7f72e81992f0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.950+0000 7f72ede50640 1 -- 172.21.15.81:0/4002862573 >> 172.21.15.81:0/4002862573 conn(0x7f72e80fc7a0 msgr2=0x7f72e80fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.950+0000 7f72ede50640 1 -- 172.21.15.81:0/4002862573 shutdown_connections 2024-09-12T01:35:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:50.950+0000 7f72ede50640 1 -- 172.21.15.81:0/4002862573 wait complete. 2024-09-12T01:35:51.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:35:51.871 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:51.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:51 smithi081 ceph-mon[30920]: pgmap v238: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:51.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:51 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/4002862573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:35:52.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:51 smithi100 ceph-mon[35275]: pgmap v238: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:52.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:51 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/4002862573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:35:52.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:51 smithi189 ceph-mon[35357]: pgmap v238: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:52.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:51 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/4002862573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:35:52.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.388+0000 7f6ae7362640 1 -- 172.21.15.81:0/389059780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ae0100e20 msgr2=0x7f6ae0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.388+0000 7f6ae7362640 1 --2- 172.21.15.81:0/389059780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ae0100e20 0x7f6ae0101200 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009900 tx=0x7f6adc02a480 comp rx=0 tx=0).stop 2024-09-12T01:35:52.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.388+0000 7f6ae7362640 1 -- 172.21.15.81:0/389059780 shutdown_connections 2024-09-12T01:35:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.388+0000 7f6ae7362640 1 --2- 172.21.15.81:0/389059780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ae0102ef0 0x7f6ae010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.388+0000 7f6ae7362640 1 --2- 172.21.15.81:0/389059780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ae0102570 0x7f6ae01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.388+0000 7f6ae7362640 1 --2- 172.21.15.81:0/389059780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ae0100e20 0x7f6ae0101200 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.388+0000 7f6ae7362640 1 -- 172.21.15.81:0/389059780 >> 172.21.15.81:0/389059780 conn(0x7f6ae00fc7d0 msgr2=0x7f6ae00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.389+0000 7f6ae7362640 1 -- 172.21.15.81:0/389059780 shutdown_connections 2024-09-12T01:35:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.389+0000 7f6ae7362640 1 -- 172.21.15.81:0/389059780 wait complete. 2024-09-12T01:35:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.389+0000 7f6ae7362640 1 Processor -- start 2024-09-12T01:35:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.389+0000 7f6ae7362640 1 -- start start 2024-09-12T01:35:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae7362640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ae0100e20 0x7f6ae0199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae7362640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ae0102570 0x7f6ae0199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae7362640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ae0102ef0 0x7f6ae01a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae7362640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0110f80 con 0x7f6ae0102ef0 2024-09-12T01:35:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae7362640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0110e00 con 0x7f6ae0102570 2024-09-12T01:35:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae7362640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0111100 con 0x7f6ae0100e20 2024-09-12T01:35:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae58ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ae0102ef0 0x7f6ae01a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae58ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ae0102ef0 0x7f6ae01a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46820/0 (socket says 172.21.15.81:46820) 2024-09-12T01:35:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae58ff640 1 -- 172.21.15.81:0/4051006319 learned_addr learned my addr 172.21.15.81:0/4051006319 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae48fd640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ae0102570 0x7f6ae0199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ae0100e20 0x7f6ae0199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae58ff640 1 -- 172.21.15.81:0/4051006319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ae0100e20 msgr2=0x7f6ae0199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae58ff640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ae0100e20 0x7f6ae0199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae58ff640 1 -- 172.21.15.81:0/4051006319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ae0102570 msgr2=0x7f6ae0199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae58ff640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ae0102570 0x7f6ae0199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae58ff640 1 -- 172.21.15.81:0/4051006319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae01a4910 con 0x7f6ae0102ef0 2024-09-12T01:35:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ae0100e20 0x7f6ae0199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae58ff640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ae0102ef0 0x7f6ae01a43d0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800cad0 tx=0x7f6ad800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ad67fc640 1 -- 172.21.15.81:0/4051006319 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800ae20 con 0x7f6ae0102ef0 2024-09-12T01:35:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ad67fc640 1 -- 172.21.15.81:0/4051006319 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad8005020 con 0x7f6ae0102ef0 2024-09-12T01:35:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae7362640 1 -- 172.21.15.81:0/4051006319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae01a4ae0 con 0x7f6ae0102ef0 2024-09-12T01:35:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ad67fc640 1 -- 172.21.15.81:0/4051006319 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800f6f0 con 0x7f6ae0102ef0 2024-09-12T01:35:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.390+0000 7f6ae7362640 1 -- 172.21.15.81:0/4051006319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae01a4ff0 con 0x7f6ae0102ef0 2024-09-12T01:35:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.393+0000 7f6ad67fc640 1 -- 172.21.15.81:0/4051006319 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6ad80051d0 con 0x7f6ae0102ef0 2024-09-12T01:35:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.393+0000 7f6ae973b740 1 Processor -- start 2024-09-12T01:35:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae973b740 1 -- start start 2024-09-12T01:35:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ad67fc640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6acc0a2cf0 0x7f6acc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae973b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fcb40 0x561d811fb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae973b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d811fb5d0 0x561d811fba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ad67fc640 1 -- 172.21.15.81:0/4051006319 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f6ad80cf730 con 0x7f6ae0102ef0 2024-09-12T01:35:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae973b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d8120a780 0x561d8120cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae973b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561d811612f0 con 0x561d811fcb40 2024-09-12T01:35:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae973b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561d81108cf0 con 0x561d8120a780 2024-09-12T01:35:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae973b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561d8115d2b0 con 0x561d811fb5d0 2024-09-12T01:35:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae48fd640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6acc0a2cf0 0x7f6acc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae50fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fcb40 0x561d811fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae50fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fcb40 0x561d811fb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46828/0 (socket says 172.21.15.81:46828) 2024-09-12T01:35:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae50fe640 1 -- 172.21.15.81:0/982549977 learned_addr learned my addr 172.21.15.81:0/982549977 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae58ff640 1 --2- 172.21.15.81:0/982549977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d8120a780 0x561d8120cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae50fe640 1 -- 172.21.15.81:0/982549977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d811fb5d0 msgr2=0x561d811fba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/982549977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d811fb5d0 0x561d811fba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae50fe640 1 -- 172.21.15.81:0/982549977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d8120a780 msgr2=0x561d8120cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:52.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/982549977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d8120a780 0x561d8120cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae50fe640 1 -- 172.21.15.81:0/982549977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d810ed3a0 con 0x561d811fcb40 2024-09-12T01:35:52.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.394+0000 7f6ae48fd640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6acc0a2cf0 0x7f6acc0a51b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ae006aac0 tx=0x7f6ad000a6f0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:52.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.395+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/982549977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fcb40 0x561d811fb090 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f6adc000c00 tx=0x7f6adc0041f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fb150c825d4783 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:52.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.395+0000 7f6acb7fe640 1 -- 172.21.15.81:0/982549977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc03f070 con 0x561d811fcb40 2024-09-12T01:35:52.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.395+0000 7f6acb7fe640 1 -- 172.21.15.81:0/982549977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6adc005520 con 0x561d811fcb40 2024-09-12T01:35:52.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.395+0000 7f6acb7fe640 1 -- 172.21.15.81:0/982549977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc035030 con 0x561d811fcb40 2024-09-12T01:35:52.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.395+0000 7f6ae973b740 1 -- 172.21.15.81:0/982549977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fcb40 msgr2=0x561d811fb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.395+0000 7f6ae973b740 1 --2- 172.21.15.81:0/982549977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fcb40 0x561d811fb090 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f6adc000c00 tx=0x7f6adc0041f0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 -- 172.21.15.81:0/982549977 shutdown_connections 2024-09-12T01:35:52.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 --2- 172.21.15.81:0/982549977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d8120a780 0x561d8120cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 --2- 172.21.15.81:0/982549977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d811fb5d0 0x561d811fba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 --2- 172.21.15.81:0/982549977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fcb40 0x561d811fb090 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 -- 172.21.15.81:0/982549977 >> 172.21.15.81:0/982549977 conn(0x561d811c4310 msgr2=0x561d811f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 -- 172.21.15.81:0/982549977 shutdown_connections 2024-09-12T01:35:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 -- 172.21.15.81:0/982549977 wait complete. 2024-09-12T01:35:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 -- start start 2024-09-12T01:35:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 Processor -- start 2024-09-12T01:35:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d811fb5d0 0x561d8120a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d811fcb40 0x561d81207360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d8120a780 0x561d812078a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561d8120d420 con 0x561d8120a780 2024-09-12T01:35:52.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561d8111c060 con 0x561d811fb5d0 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561d8120d5a0 con 0x561d811fcb40 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae973b740 10 client.0 _ll_register_callbacks cb 0x561d80e6f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.396+0000 7f6ae58ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d8120a780 0x561d812078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae58ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d8120a780 0x561d812078a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46832/0 (socket says 172.21.15.81:46832) 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae58ff640 1 -- 172.21.15.81:0/880845308 learned_addr learned my addr 172.21.15.81:0/880845308 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae48fd640 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d811fcb40 0x561d81207360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d811fb5d0 0x561d8120a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae58ff640 1 -- 172.21.15.81:0/880845308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d811fcb40 msgr2=0x561d81207360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae58ff640 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d811fcb40 0x561d81207360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae58ff640 1 -- 172.21.15.81:0/880845308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d811fb5d0 msgr2=0x561d8120a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae58ff640 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d811fb5d0 0x561d8120a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae58ff640 1 -- 172.21.15.81:0/880845308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d80ed23c0 con 0x561d8120a780 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d811fb5d0 0x561d8120a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae58ff640 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d8120a780 0x561d812078a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800caa0 tx=0x7f6ad809c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89793d9ec79643df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:52.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ac8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:52.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ac8ff9640 1 -- 172.21.15.81:0/880845308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80b1020 con 0x561d8120a780 2024-09-12T01:35:52.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ac8ff9640 1 -- 172.21.15.81:0/880845308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f6ad80a4430 con 0x561d8120a780 2024-09-12T01:35:52.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae973b740 1 -- 172.21.15.81:0/880845308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6adc005520 con 0x561d8120a780 2024-09-12T01:35:52.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ac8ff9640 1 -- 172.21.15.81:0/880845308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6ad801d040 con 0x561d8120a780 2024-09-12T01:35:52.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae973b740 10 client.17187 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:52.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ae973b740 1 -- 172.21.15.81:0/880845308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561d81218e70 con 0x561d8120a780 2024-09-12T01:35:52.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.397+0000 7f6ac8ff9640 1 -- 172.21.15.81:0/880845308 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6adc005520 con 0x561d8120a780 2024-09-12T01:35:52.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.398+0000 7f6ac8ff9640 1 -- 172.21.15.81:0/880845308 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6ad809b0a0 con 0x561d8120a780 2024-09-12T01:35:52.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.398+0000 7f6ae973b740 10 client.17187 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:52.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.398+0000 7f6ae973b740 10 client.17187 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:35:52.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.398+0000 7f6ae973b740 20 client.17187 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:52.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.398+0000 7f6ae973b740 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x561d8121a380 0x561d8121c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.398+0000 7f6ae973b740 4 client.17187 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:52.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.398+0000 7f6ae973b740 1 -- 172.21.15.81:0/880845308 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d8116e860 con 0x561d8121a380 2024-09-12T01:35:52.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.398+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x561d8121a380 0x561d8121c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x561d8121a380 0x561d8121c820 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ca355e79c2c8db86 server_cookie=71f21680d180416a in_seq=0 out_seq=0 2024-09-12T01:35:52.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ac8ff9640 10 client.17187 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:35:52.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ac8ff9640 1 -- 172.21.15.81:0/880845308 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d8116e860 con 0x561d8121a380 2024-09-12T01:35:52.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ac8ff9640 10 client.17187 handle_command_reply: tid=0 2024-09-12T01:35:52.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ae973b740 1 client.17187 shutdown 2024-09-12T01:35:52.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ae973b740 1 -- 172.21.15.81:0/880845308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d8120a780 msgr2=0x561d812078a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ae973b740 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d8120a780 0x561d812078a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800caa0 tx=0x7f6ad809c410 comp rx=0 tx=0).stop 2024-09-12T01:35:52.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ae973b740 1 -- 172.21.15.81:0/880845308 shutdown_connections 2024-09-12T01:35:52.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ae973b740 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d8120a780 0x561d812078a0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ae973b740 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x561d8121a380 0x561d8121c820 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ae973b740 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d811fcb40 0x561d81207360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ae973b740 1 --2- 172.21.15.81:0/880845308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d811fb5d0 0x561d8120a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ae973b740 1 -- 172.21.15.81:0/880845308 >> 172.21.15.81:0/880845308 conn(0x561d811c4310 msgr2=0x561d811fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:52.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.399+0000 7f6ac8ff9640 0 client.17187 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:35:52.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.400+0000 7f6ae973b740 1 -- 172.21.15.81:0/880845308 shutdown_connections 2024-09-12T01:35:52.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.400+0000 7f6ae973b740 1 -- 172.21.15.81:0/880845308 wait complete. 2024-09-12T01:35:52.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.400+0000 7f6ae973b740 20 client.17187 trim_cache size 0 max 16384 2024-09-12T01:35:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae973b740 1 Processor -- start 2024-09-12T01:35:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae973b740 1 -- start start 2024-09-12T01:35:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae973b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 0x561d812166c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae973b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d811fcb40 0x561d8121c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae973b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d8120a780 0x561d81206340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae973b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01ab760 con 0x561d811fb5d0 2024-09-12T01:35:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae973b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01ad2a0 con 0x561d8120a780 2024-09-12T01:35:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae973b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01abe30 con 0x561d811fcb40 2024-09-12T01:35:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae50fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 0x561d812166c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae50fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 0x561d812166c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46840/0 (socket says 172.21.15.81:46840) 2024-09-12T01:35:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae50fe640 1 -- 172.21.15.81:0/379779848 learned_addr learned my addr 172.21.15.81:0/379779848 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae50fe640 1 -- 172.21.15.81:0/379779848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d811fcb40 msgr2=0x561d8121c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/379779848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d811fcb40 0x561d8121c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae50fe640 1 -- 172.21.15.81:0/379779848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d8120a780 msgr2=0x561d81206340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/379779848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d8120a780 0x561d81206340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae50fe640 1 -- 172.21.15.81:0/379779848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d812058b0 con 0x561d811fb5d0 2024-09-12T01:35:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.413+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/379779848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 0x561d812166c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0314e0 tx=0x7f6adc004900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b462c2a2af6d1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.414+0000 7f6acaffd640 1 -- 172.21.15.81:0/379779848 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc03f040 con 0x561d811fb5d0 2024-09-12T01:35:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.414+0000 7f6acaffd640 1 -- 172.21.15.81:0/379779848 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6adc003cd0 con 0x561d811fb5d0 2024-09-12T01:35:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.414+0000 7f6acaffd640 1 -- 172.21.15.81:0/379779848 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc035040 con 0x561d811fb5d0 2024-09-12T01:35:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.414+0000 7f6ae973b740 1 -- 172.21.15.81:0/379779848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 msgr2=0x561d812166c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.414+0000 7f6ae973b740 1 --2- 172.21.15.81:0/379779848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 0x561d812166c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0314e0 tx=0x7f6adc004900 comp rx=0 tx=0).stop 2024-09-12T01:35:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.414+0000 7f6ae973b740 1 -- 172.21.15.81:0/379779848 shutdown_connections 2024-09-12T01:35:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.414+0000 7f6ae973b740 1 --2- 172.21.15.81:0/379779848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d8120a780 0x561d81206340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.414+0000 7f6ae973b740 1 --2- 172.21.15.81:0/379779848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d811fcb40 0x561d8121c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.414+0000 7f6ae973b740 1 --2- 172.21.15.81:0/379779848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 0x561d812166c0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.414+0000 7f6ae973b740 1 -- 172.21.15.81:0/379779848 >> 172.21.15.81:0/379779848 conn(0x561d811c4310 msgr2=0x561d81205c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.414+0000 7f6ae973b740 1 -- 172.21.15.81:0/379779848 shutdown_connections 2024-09-12T01:35:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.414+0000 7f6ae973b740 1 -- 172.21.15.81:0/379779848 wait complete. 2024-09-12T01:35:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae973b740 1 -- start start 2024-09-12T01:35:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae973b740 1 Processor -- start 2024-09-12T01:35:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae973b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 0x561d81212ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae973b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d811fcb40 0x561d81203ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae973b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d8120a780 0x561d81204530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae973b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01acbd0 con 0x561d811fb5d0 2024-09-12T01:35:52.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae973b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01ac500 con 0x561d811fcb40 2024-09-12T01:35:52.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae973b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01a9740 con 0x561d8120a780 2024-09-12T01:35:52.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae973b740 10 client.0 _ll_register_callbacks cb 0x7f6ad800a810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:52.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae50fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 0x561d81212ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae50fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 0x561d81212ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46848/0 (socket says 172.21.15.81:46848) 2024-09-12T01:35:52.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae50fe640 1 -- 172.21.15.81:0/1836458275 learned_addr learned my addr 172.21.15.81:0/1836458275 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:52.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae48fd640 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d811fcb40 0x561d81203ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae58ff640 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d8120a780 0x561d81204530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae50fe640 1 -- 172.21.15.81:0/1836458275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d8120a780 msgr2=0x561d81204530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d8120a780 0x561d81204530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae50fe640 1 -- 172.21.15.81:0/1836458275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d811fcb40 msgr2=0x561d81203ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d811fcb40 0x561d81203ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae50fe640 1 -- 172.21.15.81:0/1836458275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d81204d60 con 0x561d811fb5d0 2024-09-12T01:35:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae48fd640 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d811fcb40 0x561d81203ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.415+0000 7f6ae58ff640 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d8120a780 0x561d81204530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ae50fe640 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 0x561d81212ee0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f6adc004c00 tx=0x7f6adc0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6d90e306d162b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ac8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ac8ff9640 1 -- 172.21.15.81:0/1836458275 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc05d060 con 0x561d811fb5d0 2024-09-12T01:35:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ac8ff9640 1 -- 172.21.15.81:0/1836458275 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f6adc050b70 con 0x561d811fb5d0 2024-09-12T01:35:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ae973b740 1 -- 172.21.15.81:0/1836458275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6adc003cd0 con 0x561d811fb5d0 2024-09-12T01:35:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ac8ff9640 1 -- 172.21.15.81:0/1836458275 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6adc035070 con 0x561d811fb5d0 2024-09-12T01:35:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ae973b740 10 client.17193 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ae973b740 1 -- 172.21.15.81:0/1836458275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561d812850a0 con 0x561d811fb5d0 2024-09-12T01:35:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ac8ff9640 1 -- 172.21.15.81:0/1836458275 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6adc003cd0 con 0x561d811fb5d0 2024-09-12T01:35:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ac8ff9640 1 -- 172.21.15.81:0/1836458275 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6adc04d070 con 0x561d811fb5d0 2024-09-12T01:35:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ae973b740 10 client.17193 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ae973b740 10 client.17193 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:35:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ae973b740 20 client.17193 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ae973b740 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x561d812852d0 0x561d812876c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ae973b740 4 client.17193 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:35:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.416+0000 7f6ae973b740 1 -- 172.21.15.81:0/1836458275 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561d81168d70 con 0x561d812852d0 2024-09-12T01:35:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.417+0000 7f6ae48fd640 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x561d812852d0 0x561d812876c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.417+0000 7f6ac8ff9640 10 client.17193 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:35:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.417+0000 7f6ae48fd640 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x561d812852d0 0x561d812876c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d56bacf3caa3c2b server_cookie=f7adbb987f3b13c6 in_seq=0 out_seq=0 2024-09-12T01:35:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.417+0000 7f6ac8ff9640 1 -- 172.21.15.81:0/1836458275 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561d81168d70 con 0x561d812852d0 2024-09-12T01:35:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.417+0000 7f6ac8ff9640 10 client.17193 handle_command_reply: tid=0 2024-09-12T01:35:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.417+0000 7f6ae973b740 1 client.17193 shutdown 2024-09-12T01:35:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.417+0000 7f6ae973b740 1 -- 172.21.15.81:0/1836458275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 msgr2=0x561d81212ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae973b740 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 0x561d81212ee0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f6adc004c00 tx=0x7f6adc0058b0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae973b740 1 -- 172.21.15.81:0/1836458275 shutdown_connections 2024-09-12T01:35:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae973b740 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x561d812852d0 0x561d812876c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae973b740 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561d8120a780 0x561d81204530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae973b740 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561d811fcb40 0x561d81203ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ac8ff9640 0 client.17193 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:35:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae973b740 1 --2- 172.21.15.81:0/1836458275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d811fb5d0 0x561d81212ee0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae973b740 1 -- 172.21.15.81:0/1836458275 >> 172.21.15.81:0/1836458275 conn(0x561d811c4310 msgr2=0x561d81206450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae973b740 1 -- 172.21.15.81:0/1836458275 shutdown_connections 2024-09-12T01:35:52.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae973b740 1 -- 172.21.15.81:0/1836458275 wait complete. 2024-09-12T01:35:52.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae973b740 20 client.17193 trim_cache size 0 max 16384 2024-09-12T01:35:52.429 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:35:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae7362640 1 -- 172.21.15.81:0/4051006319 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6acc0a2cf0 msgr2=0x7f6acc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae7362640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6acc0a2cf0 0x7f6acc0a51b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ae006aac0 tx=0x7f6ad000a6f0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae7362640 1 -- 172.21.15.81:0/4051006319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ae0102ef0 msgr2=0x7f6ae01a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae7362640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ae0102ef0 0x7f6ae01a43d0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800cad0 tx=0x7f6ad800cf90 comp rx=0 tx=0).stop 2024-09-12T01:35:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae7362640 1 -- 172.21.15.81:0/4051006319 shutdown_connections 2024-09-12T01:35:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae7362640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6acc0a2cf0 0x7f6acc0a51b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae7362640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ae0102ef0 0x7f6ae01a43d0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae7362640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ae0102570 0x7f6ae0199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae7362640 1 --2- 172.21.15.81:0/4051006319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ae0100e20 0x7f6ae0199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.418+0000 7f6ae7362640 1 -- 172.21.15.81:0/4051006319 >> 172.21.15.81:0/4051006319 conn(0x7f6ae00fc7d0 msgr2=0x7f6ae00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.419+0000 7f6ae7362640 1 -- 172.21.15.81:0/4051006319 shutdown_connections 2024-09-12T01:35:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:52.419+0000 7f6ae7362640 1 -- 172.21.15.81:0/4051006319 wait complete. 2024-09-12T01:35:53.038 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:35:53.284 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:53.723 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:53 smithi081 ceph-mon[30920]: pgmap v239: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:53.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.723+0000 7f0be4b1b640 1 -- 172.21.15.81:0/1057721322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be0101420 msgr2=0x7f0be010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.723+0000 7f0be4b1b640 1 --2- 172.21.15.81:0/1057721322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be0101420 0x7f0be010d950 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009cd0 tx=0x7f0bd802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.723+0000 7f0be4b1b640 1 -- 172.21.15.81:0/1057721322 shutdown_connections 2024-09-12T01:35:53.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.723+0000 7f0be4b1b640 1 --2- 172.21.15.81:0/1057721322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be0101420 0x7f0be010d950 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.723+0000 7f0be4b1b640 1 --2- 172.21.15.81:0/1057721322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0be0100a80 0x7f0be0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.723+0000 7f0be4b1b640 1 --2- 172.21.15.81:0/1057721322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0be0106a80 0x7f0be0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.723+0000 7f0be4b1b640 1 -- 172.21.15.81:0/1057721322 >> 172.21.15.81:0/1057721322 conn(0x7f0be00fc7a0 msgr2=0x7f0be00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:53.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.723+0000 7f0be4b1b640 1 -- 172.21.15.81:0/1057721322 shutdown_connections 2024-09-12T01:35:53.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.723+0000 7f0be4b1b640 1 -- 172.21.15.81:0/1057721322 wait complete. 2024-09-12T01:35:53.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.724+0000 7f0be4b1b640 1 Processor -- start 2024-09-12T01:35:53.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.724+0000 7f0be4b1b640 1 -- start start 2024-09-12T01:35:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.724+0000 7f0be4b1b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0be0100a80 0x7f0be010e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.724+0000 7f0be4b1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be0101420 0x7f0be010e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.724+0000 7f0be4b1b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0be0106a80 0x7f0be010ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.724+0000 7f0be4b1b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0be0111fa0 con 0x7f0be0101420 2024-09-12T01:35:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.724+0000 7f0be4b1b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0be0111e20 con 0x7f0be0106a80 2024-09-12T01:35:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.724+0000 7f0be4b1b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0be0112120 con 0x7f0be0100a80 2024-09-12T01:35:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.724+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be0101420 0x7f0be010e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.724+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be0101420 0x7f0be010e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46860/0 (socket says 172.21.15.81:46860) 2024-09-12T01:35:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.724+0000 7f0bd7fff640 1 -- 172.21.15.81:0/3177196265 learned_addr learned my addr 172.21.15.81:0/3177196265 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.724+0000 7f0bded9d640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0be0106a80 0x7f0be010ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.724+0000 7f0bde59c640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0be0100a80 0x7f0be010e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.725+0000 7f0bd7fff640 1 -- 172.21.15.81:0/3177196265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0be0100a80 msgr2=0x7f0be010e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.725+0000 7f0bd7fff640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0be0100a80 0x7f0be010e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.725+0000 7f0bd7fff640 1 -- 172.21.15.81:0/3177196265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0be0106a80 msgr2=0x7f0be010ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.725+0000 7f0bd7fff640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0be0106a80 0x7f0be010ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.725+0000 7f0bd7fff640 1 -- 172.21.15.81:0/3177196265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be01a68e0 con 0x7f0be0101420 2024-09-12T01:35:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.725+0000 7f0bd7fff640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be0101420 0x7f0be010e920 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800d770 tx=0x7f0bc800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.725+0000 7f0bd77fe640 1 -- 172.21.15.81:0/3177196265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8017070 con 0x7f0be0101420 2024-09-12T01:35:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.725+0000 7f0be4b1b640 1 -- 172.21.15.81:0/3177196265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be01a6bd0 con 0x7f0be0101420 2024-09-12T01:35:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.725+0000 7f0bd77fe640 1 -- 172.21.15.81:0/3177196265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc8005500 con 0x7f0be0101420 2024-09-12T01:35:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.725+0000 7f0bd77fe640 1 -- 172.21.15.81:0/3177196265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8004e00 con 0x7f0be0101420 2024-09-12T01:35:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.725+0000 7f0be4b1b640 1 -- 172.21.15.81:0/3177196265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be01a70c0 con 0x7f0be0101420 2024-09-12T01:35:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.727+0000 7f0bd77fe640 1 -- 172.21.15.81:0/3177196265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f0bc8004fa0 con 0x7f0be0101420 2024-09-12T01:35:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.727+0000 7f0be6ef4740 1 Processor -- start 2024-09-12T01:35:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0be6ef4740 1 -- start start 2024-09-12T01:35:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0be6ef4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0ee3b40 0x561df0ee2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0be6ef4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 0x561df0ee2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0be6ef4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 0x561df0eef760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0be6ef4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561df0e482f0 con 0x561df0eed370 2024-09-12T01:35:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0be6ef4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561df0defcf0 con 0x561df0ee25d0 2024-09-12T01:35:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0be6ef4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561df0e442b0 con 0x561df0ee3b40 2024-09-12T01:35:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 0x561df0eef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 0x561df0eef760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46870/0 (socket says 172.21.15.81:46870) 2024-09-12T01:35:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0bd7fff640 1 -- 172.21.15.81:0/1664537753 learned_addr learned my addr 172.21.15.81:0/1664537753 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0bd77fe640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0bcc0a2cf0 0x7f0bcc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0bde59c640 1 --2- 172.21.15.81:0/1664537753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 0x561df0ee2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0bded9d640 1 --2- 172.21.15.81:0/1664537753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0ee3b40 0x561df0ee2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.728+0000 7f0bded9d640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0bcc0a2cf0 0x7f0bcc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.729+0000 7f0bd7fff640 1 -- 172.21.15.81:0/1664537753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0ee3b40 msgr2=0x561df0ee2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:53.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.729+0000 7f0bd7fff640 1 --2- 172.21.15.81:0/1664537753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0ee3b40 0x561df0ee2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.729+0000 7f0bd7fff640 1 -- 172.21.15.81:0/1664537753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 msgr2=0x561df0ee2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:53.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.729+0000 7f0bd7fff640 1 --2- 172.21.15.81:0/1664537753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 0x561df0ee2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.729+0000 7f0bd77fe640 1 -- 172.21.15.81:0/3177196265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f0bc80cee30 con 0x7f0be0101420 2024-09-12T01:35:53.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.729+0000 7f0bd7fff640 1 -- 172.21.15.81:0/1664537753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df0dd43a0 con 0x561df0eed370 2024-09-12T01:35:53.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.729+0000 7f0bded9d640 1 --2- 172.21.15.81:0/1664537753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0ee3b40 0x561df0ee2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:53.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.729+0000 7f0bd7fff640 1 --2- 172.21.15.81:0/1664537753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 0x561df0eef760 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80cc490 tx=0x7f0bc8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839cedc4d90a9ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.729+0000 7f0bd4ff9640 1 -- 172.21.15.81:0/1664537753 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8020070 con 0x561df0eed370 2024-09-12T01:35:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.729+0000 7f0bded9d640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0bcc0a2cf0 0x7f0bcc0a51b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8004ab0 tx=0x7f0bd8004a40 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.729+0000 7f0bd4ff9640 1 -- 172.21.15.81:0/1664537753 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc80046c0 con 0x561df0eed370 2024-09-12T01:35:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.729+0000 7f0bd4ff9640 1 -- 172.21.15.81:0/1664537753 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8097a10 con 0x561df0eed370 2024-09-12T01:35:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.730+0000 7f0be6ef4740 1 -- 172.21.15.81:0/1664537753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 msgr2=0x561df0eef760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.730+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/1664537753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 0x561df0eef760 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80cc490 tx=0x7f0bc8009c30 comp rx=0 tx=0).stop 2024-09-12T01:35:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.730+0000 7f0be6ef4740 1 -- 172.21.15.81:0/1664537753 shutdown_connections 2024-09-12T01:35:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.730+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/1664537753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 0x561df0eef760 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.730+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/1664537753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 0x561df0ee2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.730+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/1664537753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0ee3b40 0x561df0ee2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.730+0000 7f0be6ef4740 1 -- 172.21.15.81:0/1664537753 >> 172.21.15.81:0/1664537753 conn(0x561df0eab310 msgr2=0x561df0edec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.730+0000 7f0be6ef4740 1 -- 172.21.15.81:0/1664537753 shutdown_connections 2024-09-12T01:35:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.730+0000 7f0be6ef4740 1 -- 172.21.15.81:0/1664537753 wait complete. 2024-09-12T01:35:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.730+0000 7f0be6ef4740 1 -- start start 2024-09-12T01:35:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.730+0000 7f0be6ef4740 1 Processor -- start 2024-09-12T01:35:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0be6ef4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 0x561df0eecce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0be6ef4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 0x561df0ee9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0be6ef4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0eed370 0x561df0eea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0be6ef4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561df0ef0010 con 0x561df0ee3b40 2024-09-12T01:35:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0be6ef4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561df0e03060 con 0x561df0ee25d0 2024-09-12T01:35:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0be6ef4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561df0ef0190 con 0x561df0eed370 2024-09-12T01:35:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0be6ef4740 10 client.0 _ll_register_callbacks cb 0x561df0b568c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 0x561df0ee9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 0x561df0ee9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46878/0 (socket says 172.21.15.81:46878) 2024-09-12T01:35:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0bd7fff640 1 -- 172.21.15.81:0/775056347 learned_addr learned my addr 172.21.15.81:0/775056347 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0bde59c640 1 --2- 172.21.15.81:0/775056347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 0x561df0eecce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0bd7fff640 1 -- 172.21.15.81:0/775056347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0eed370 msgr2=0x561df0eea4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0bd7fff640 1 --2- 172.21.15.81:0/775056347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0eed370 0x561df0eea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0bd7fff640 1 -- 172.21.15.81:0/775056347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 msgr2=0x561df0eecce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0bd7fff640 1 --2- 172.21.15.81:0/775056347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 0x561df0eecce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0bd7fff640 1 -- 172.21.15.81:0/775056347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561df0bb93c0 con 0x561df0ee3b40 2024-09-12T01:35:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0bd7fff640 1 --2- 172.21.15.81:0/775056347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 0x561df0ee9f90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8097d70 tx=0x7f0bc80cf0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c497748dd46f738b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0bc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0bc5ffb640 1 -- 172.21.15.81:0/775056347 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8020070 con 0x561df0ee3b40 2024-09-12T01:35:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0bc5ffb640 1 -- 172.21.15.81:0/775056347 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f0bc80cc7a0 con 0x561df0ee3b40 2024-09-12T01:35:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.731+0000 7f0be6ef4740 1 -- 172.21.15.81:0/775056347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561df0e55860 con 0x561df0ee3b40 2024-09-12T01:35:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.732+0000 7f0bc5ffb640 1 -- 172.21.15.81:0/775056347 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0bc80cc9a0 con 0x561df0ee3b40 2024-09-12T01:35:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.732+0000 7f0be6ef4740 10 client.17205 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.732+0000 7f0be6ef4740 1 -- 172.21.15.81:0/775056347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561df0efba50 con 0x561df0ee3b40 2024-09-12T01:35:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.732+0000 7f0bc5ffb640 1 -- 172.21.15.81:0/775056347 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561df0e55860 con 0x561df0ee3b40 2024-09-12T01:35:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.732+0000 7f0bc5ffb640 1 -- 172.21.15.81:0/775056347 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0bc805fc90 con 0x561df0ee3b40 2024-09-12T01:35:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.732+0000 7f0be6ef4740 10 client.17205 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.732+0000 7f0be6ef4740 10 client.17205 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:35:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.732+0000 7f0be6ef4740 20 client.17205 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.732+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/775056347 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561df0efcda0 0x561df0eff190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.732+0000 7f0be6ef4740 4 client.17205 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.732+0000 7f0be6ef4740 1 -- 172.21.15.81:0/775056347 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561df0e4fd70 con 0x561df0efcda0 2024-09-12T01:35:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.732+0000 7f0bde59c640 1 --2- 172.21.15.81:0/775056347 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561df0efcda0 0x561df0eff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.733+0000 7f0bde59c640 1 --2- 172.21.15.81:0/775056347 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561df0efcda0 0x561df0eff190 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d92afc6345974e83 server_cookie=d2debf6a705a3d13 in_seq=0 out_seq=0 2024-09-12T01:35:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.733+0000 7f0bc5ffb640 10 client.17205 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:35:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.733+0000 7f0bc5ffb640 1 -- 172.21.15.81:0/775056347 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561df0e4fd70 con 0x561df0efcda0 2024-09-12T01:35:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.733+0000 7f0bc5ffb640 10 client.17205 handle_command_reply: tid=0 2024-09-12T01:35:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.733+0000 7f0be6ef4740 1 client.17205 shutdown 2024-09-12T01:35:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.733+0000 7f0be6ef4740 1 -- 172.21.15.81:0/775056347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 msgr2=0x561df0ee9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.733+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/775056347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 0x561df0ee9f90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8097d70 tx=0x7f0bc80cf0b0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.734+0000 7f0be6ef4740 1 -- 172.21.15.81:0/775056347 shutdown_connections 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.734+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/775056347 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561df0efcda0 0x561df0eff190 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.734+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/775056347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0eed370 0x561df0eea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.734+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/775056347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 0x561df0ee9f90 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.734+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/775056347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 0x561df0eecce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.734+0000 7f0bc5ffb640 0 client.17205 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.734+0000 7f0be6ef4740 1 -- 172.21.15.81:0/775056347 >> 172.21.15.81:0/775056347 conn(0x561df0eab310 msgr2=0x561df0ee4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.734+0000 7f0be6ef4740 1 -- 172.21.15.81:0/775056347 shutdown_connections 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.734+0000 7f0be6ef4740 1 -- 172.21.15.81:0/775056347 wait complete. 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.734+0000 7f0be6ef4740 20 client.17205 trim_cache size 0 max 16384 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.746+0000 7f0be6ef4740 1 Processor -- start 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.746+0000 7f0be6ef4740 1 -- start start 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0be6ef4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0ee25d0 0x561df0ee8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0be6ef4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee3b40 0x561df0eee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0be6ef4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 0x561df0eeeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0be6ef4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0be01afa70 con 0x561df0eed370 2024-09-12T01:35:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0be6ef4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0be01b15b0 con 0x561df0ee3b40 2024-09-12T01:35:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0be6ef4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0be01b0140 con 0x561df0ee25d0 2024-09-12T01:35:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0bded9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 0x561df0eeeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0bded9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 0x561df0eeeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46892/0 (socket says 172.21.15.81:46892) 2024-09-12T01:35:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0bded9d640 1 -- 172.21.15.81:0/2230452012 learned_addr learned my addr 172.21.15.81:0/2230452012 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0bd7fff640 1 --2- 172.21.15.81:0/2230452012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee3b40 0x561df0eee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0bded9d640 1 -- 172.21.15.81:0/2230452012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0ee25d0 msgr2=0x561df0ee8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0bded9d640 1 --2- 172.21.15.81:0/2230452012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0ee25d0 0x561df0ee8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0bded9d640 1 -- 172.21.15.81:0/2230452012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee3b40 msgr2=0x561df0eee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0bded9d640 1 --2- 172.21.15.81:0/2230452012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee3b40 0x561df0eee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0bded9d640 1 -- 172.21.15.81:0/2230452012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df0ee5120 con 0x561df0eed370 2024-09-12T01:35:53.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0bded9d640 1 --2- 172.21.15.81:0/2230452012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 0x561df0eeeca0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009cd0 tx=0x7f0bd80093a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4398bac0b1e29c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:53.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0bc7fff640 1 -- 172.21.15.81:0/2230452012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8004410 con 0x561df0eed370 2024-09-12T01:35:53.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0bc7fff640 1 -- 172.21.15.81:0/2230452012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bd8036040 con 0x561df0eed370 2024-09-12T01:35:53.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.747+0000 7f0bc7fff640 1 -- 172.21.15.81:0/2230452012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8048430 con 0x561df0eed370 2024-09-12T01:35:53.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.748+0000 7f0be6ef4740 1 -- 172.21.15.81:0/2230452012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 msgr2=0x561df0eeeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.748+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/2230452012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 0x561df0eeeca0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009cd0 tx=0x7f0bd80093a0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.748+0000 7f0be6ef4740 1 -- 172.21.15.81:0/2230452012 shutdown_connections 2024-09-12T01:35:53.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.748+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/2230452012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0eed370 0x561df0eeeca0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.748+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/2230452012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee3b40 0x561df0eee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.748+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/2230452012 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0ee25d0 0x561df0ee8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.748+0000 7f0be6ef4740 1 -- 172.21.15.81:0/2230452012 >> 172.21.15.81:0/2230452012 conn(0x561df0eab310 msgr2=0x561df0ee8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:53.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.748+0000 7f0be6ef4740 1 -- 172.21.15.81:0/2230452012 shutdown_connections 2024-09-12T01:35:53.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.748+0000 7f0be6ef4740 1 -- 172.21.15.81:0/2230452012 wait complete. 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0be6ef4740 1 -- start start 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0be6ef4740 1 Processor -- start 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0be6ef4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 0x561df0f02a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0be6ef4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 0x561df0ee6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0be6ef4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0eed370 0x561df0ee7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0be6ef4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0be01b0ee0 con 0x561df0ee3b40 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0be6ef4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0be01b0810 con 0x561df0ee25d0 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0be6ef4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0be01ada70 con 0x561df0eed370 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0be6ef4740 10 client.0 _ll_register_callbacks cb 0x7f0bd00097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 0x561df0ee6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 0x561df0ee6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46898/0 (socket says 172.21.15.81:46898) 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0bd7fff640 1 -- 172.21.15.81:0/4046468761 learned_addr learned my addr 172.21.15.81:0/4046468761 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0bde59c640 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 0x561df0f02a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0bded9d640 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0eed370 0x561df0ee7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0bd7fff640 1 -- 172.21.15.81:0/4046468761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0eed370 msgr2=0x561df0ee7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0bd7fff640 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0eed370 0x561df0ee7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0bd7fff640 1 -- 172.21.15.81:0/4046468761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 msgr2=0x561df0f02a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0bd7fff640 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 0x561df0f02a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0bd7fff640 1 -- 172.21.15.81:0/4046468761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561df0eef1e0 con 0x561df0ee3b40 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.749+0000 7f0bde59c640 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 0x561df0f02a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0bd7fff640 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 0x561df0ee6d80 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8097d20 tx=0x7f0bc80998b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9aec28ffa4a344 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0bc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0bc5ffb640 1 -- 172.21.15.81:0/4046468761 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8097640 con 0x561df0ee3b40 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0bc5ffb640 1 -- 172.21.15.81:0/4046468761 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f0bc805fbf0 con 0x561df0ee3b40 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0be6ef4740 1 -- 172.21.15.81:0/4046468761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bd8036040 con 0x561df0ee3b40 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0bc5ffb640 1 -- 172.21.15.81:0/4046468761 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0bc80cc9a0 con 0x561df0ee3b40 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0be6ef4740 10 client.17211 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:53.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0be6ef4740 1 -- 172.21.15.81:0/4046468761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561df0f675c0 con 0x561df0ee3b40 2024-09-12T01:35:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0bc5ffb640 1 -- 172.21.15.81:0/4046468761 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bd8036040 con 0x561df0ee3b40 2024-09-12T01:35:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0bc5ffb640 1 -- 172.21.15.81:0/4046468761 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0bc809a7f0 con 0x561df0ee3b40 2024-09-12T01:35:53.782 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:35:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0be6ef4740 10 client.17211 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0be6ef4740 10 client.17211 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:35:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0be6ef4740 20 client.17211 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561df0f67b20 0x561df0f69f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0be6ef4740 4 client.17211 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:35:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.750+0000 7f0be6ef4740 1 -- 172.21.15.81:0/4046468761 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561df0dcc170 con 0x561df0f67b20 2024-09-12T01:35:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0bde59c640 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561df0f67b20 0x561df0f69f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0bde59c640 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561df0f67b20 0x561df0f69f40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c86370f4cf8e5d5 server_cookie=6f79564b503d4eea in_seq=0 out_seq=0 2024-09-12T01:35:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0bc5ffb640 10 client.17211 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:35:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0bc5ffb640 1 -- 172.21.15.81:0/4046468761 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561df0dcc170 con 0x561df0f67b20 2024-09-12T01:35:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0bc5ffb640 10 client.17211 handle_command_reply: tid=0 2024-09-12T01:35:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0be6ef4740 1 client.17211 shutdown 2024-09-12T01:35:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0be6ef4740 1 -- 172.21.15.81:0/4046468761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 msgr2=0x561df0ee6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 0x561df0ee6d80 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8097d20 tx=0x7f0bc80998b0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0be6ef4740 1 -- 172.21.15.81:0/4046468761 shutdown_connections 2024-09-12T01:35:53.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561df0f67b20 0x561df0f69f40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561df0eed370 0x561df0ee7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df0ee3b40 0x561df0ee6d80 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0bc5ffb640 0 client.17211 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0be6ef4740 1 --2- 172.21.15.81:0/4046468761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561df0ee25d0 0x561df0f02a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0be6ef4740 1 -- 172.21.15.81:0/4046468761 >> 172.21.15.81:0/4046468761 conn(0x561df0eab310 msgr2=0x561df0eec010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0be6ef4740 1 -- 172.21.15.81:0/4046468761 shutdown_connections 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0be6ef4740 1 -- 172.21.15.81:0/4046468761 wait complete. 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.751+0000 7f0be6ef4740 20 client.17211 trim_cache size 0 max 16384 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.752+0000 7f0be4b1b640 1 -- 172.21.15.81:0/3177196265 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0bcc0a2cf0 msgr2=0x7f0bcc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.752+0000 7f0be4b1b640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0bcc0a2cf0 0x7f0bcc0a51b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8004ab0 tx=0x7f0bd8004a40 comp rx=0 tx=0).stop 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.752+0000 7f0be4b1b640 1 -- 172.21.15.81:0/3177196265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be0101420 msgr2=0x7f0be010e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.752+0000 7f0be4b1b640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be0101420 0x7f0be010e920 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800d770 tx=0x7f0bc800dc30 comp rx=0 tx=0).stop 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.752+0000 7f0be4b1b640 1 -- 172.21.15.81:0/3177196265 shutdown_connections 2024-09-12T01:35:53.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.752+0000 7f0be4b1b640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0bcc0a2cf0 0x7f0bcc0a51b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.752+0000 7f0be4b1b640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0be0106a80 0x7f0be010ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.752+0000 7f0be4b1b640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0be0101420 0x7f0be010e920 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.752+0000 7f0be4b1b640 1 --2- 172.21.15.81:0/3177196265 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0be0100a80 0x7f0be010e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.752+0000 7f0be4b1b640 1 -- 172.21.15.81:0/3177196265 >> 172.21.15.81:0/3177196265 conn(0x7f0be00fc7a0 msgr2=0x7f0be00fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:53.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.752+0000 7f0be4b1b640 1 -- 172.21.15.81:0/3177196265 shutdown_connections 2024-09-12T01:35:53.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:53.752+0000 7f0be4b1b640 1 -- 172.21.15.81:0/3177196265 wait complete. 2024-09-12T01:35:54.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:53 smithi100 ceph-mon[35275]: pgmap v239: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:54.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:53 smithi189 ceph-mon[35357]: pgmap v239: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:54.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:35:54.668 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:55.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.130+0000 7fb481422640 1 -- 172.21.15.81:0/1932183057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c10c170 msgr2=0x7fb47c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.130+0000 7fb481422640 1 --2- 172.21.15.81:0/1932183057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c10c170 0x7fb47c10e610 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fb474009900 tx=0x7fb47402a480 comp rx=0 tx=0).stop 2024-09-12T01:35:55.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.130+0000 7fb481422640 1 -- 172.21.15.81:0/1932183057 shutdown_connections 2024-09-12T01:35:55.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.130+0000 7fb481422640 1 --2- 172.21.15.81:0/1932183057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c10c170 0x7fb47c10e610 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.130+0000 7fb481422640 1 --2- 172.21.15.81:0/1932183057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb47c103660 0x7fb47c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.130+0000 7fb481422640 1 --2- 172.21.15.81:0/1932183057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb47c102d40 0x7fb47c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.130+0000 7fb481422640 1 -- 172.21.15.81:0/1932183057 >> 172.21.15.81:0/1932183057 conn(0x7fb47c0fc7a0 msgr2=0x7fb47c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:55.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.131+0000 7fb481422640 1 -- 172.21.15.81:0/1932183057 shutdown_connections 2024-09-12T01:35:55.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.131+0000 7fb481422640 1 -- 172.21.15.81:0/1932183057 wait complete. 2024-09-12T01:35:55.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.131+0000 7fb481422640 1 Processor -- start 2024-09-12T01:35:55.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.131+0000 7fb481422640 1 -- start start 2024-09-12T01:35:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.131+0000 7fb481422640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb47c102d40 0x7fb47c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.131+0000 7fb481422640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb47c103660 0x7fb47c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.131+0000 7fb481422640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c10c170 0x7fb47c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb481422640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c111fb0 con 0x7fb47c10c170 2024-09-12T01:35:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb481422640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c111e30 con 0x7fb47c102d40 2024-09-12T01:35:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb481422640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c112130 con 0x7fb47c103660 2024-09-12T01:35:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb47b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c10c170 0x7fb47c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb47b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c10c170 0x7fb47c101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46928/0 (socket says 172.21.15.81:46928) 2024-09-12T01:35:55.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb47b7fe640 1 -- 172.21.15.81:0/1601582023 learned_addr learned my addr 172.21.15.81:0/1601582023 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb47affd640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb47c102d40 0x7fb47c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb47c103660 0x7fb47c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb47b7fe640 1 -- 172.21.15.81:0/1601582023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb47c103660 msgr2=0x7fb47c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb47b7fe640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb47c103660 0x7fb47c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb47b7fe640 1 -- 172.21.15.81:0/1601582023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb47c102d40 msgr2=0x7fb47c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb47b7fe640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb47c102d40 0x7fb47c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb47b7fe640 1 -- 172.21.15.81:0/1601582023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb47c1a68f0 con 0x7fb47c10c170 2024-09-12T01:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb47b7fe640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c10c170 0x7fb47c101420 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb474005ab0 tx=0x7fb4740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb463fff640 1 -- 172.21.15.81:0/1601582023 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47403f030 con 0x7fb47c10c170 2024-09-12T01:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb463fff640 1 -- 172.21.15.81:0/1601582023 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb474003ce0 con 0x7fb47c10c170 2024-09-12T01:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb463fff640 1 -- 172.21.15.81:0/1601582023 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb474035070 con 0x7fb47c10c170 2024-09-12T01:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.132+0000 7fb481422640 1 -- 172.21.15.81:0/1601582023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb47c1a6b80 con 0x7fb47c10c170 2024-09-12T01:35:55.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.133+0000 7fb481422640 1 -- 172.21.15.81:0/1601582023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb47c1a7010 con 0x7fb47c10c170 2024-09-12T01:35:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb463fff640 1 -- 172.21.15.81:0/1601582023 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb474042030 con 0x7fb47c10c170 2024-09-12T01:35:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb4837fb740 1 Processor -- start 2024-09-12T01:35:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb4837fb740 1 -- start start 2024-09-12T01:35:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb4837fb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a3db40 0x564174a3c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb4837fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3c5d0 0x564174a3ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb4837fb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a47370 0x564174a49760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb4837fb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5641749a22f0 con 0x564174a47370 2024-09-12T01:35:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb4837fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564174949cf0 con 0x564174a3c5d0 2024-09-12T01:35:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb4837fb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56417499e2b0 con 0x564174a3db40 2024-09-12T01:35:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb463fff640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb4640a2cf0 0x7fb4640a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb47a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a47370 0x564174a49760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb47b7fe640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb4640a2cf0 0x7fb4640a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb47a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a47370 0x564174a49760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46942/0 (socket says 172.21.15.81:46942) 2024-09-12T01:35:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.135+0000 7fb47a7fc640 1 -- 172.21.15.81:0/2559716483 learned_addr learned my addr 172.21.15.81:0/2559716483 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.136+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/2559716483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a3db40 0x564174a3c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.136+0000 7fb47affd640 1 --2- 172.21.15.81:0/2559716483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3c5d0 0x564174a3ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.136+0000 7fb463fff640 1 -- 172.21.15.81:0/1601582023 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fb4740efc40 con 0x7fb47c10c170 2024-09-12T01:35:55.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.136+0000 7fb47a7fc640 1 -- 172.21.15.81:0/2559716483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a3db40 msgr2=0x564174a3c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:55.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.136+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/2559716483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a3db40 0x564174a3c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.136+0000 7fb47a7fc640 1 -- 172.21.15.81:0/2559716483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3c5d0 msgr2=0x564174a3ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:55.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.136+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/2559716483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3c5d0 0x564174a3ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.136+0000 7fb47a7fc640 1 -- 172.21.15.81:0/2559716483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56417492e3a0 con 0x564174a47370 2024-09-12T01:35:55.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.136+0000 7fb47b7fe640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb4640a2cf0 0x7fb4640a51b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb4740ed990 tx=0x7fb47408e120 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:55.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.136+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/2559716483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a47370 0x564174a49760 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb470016530 tx=0x7fb47000a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1dad262a2ec9fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:55.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.136+0000 7fb4617fa640 1 -- 172.21.15.81:0/2559716483 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb470018430 con 0x564174a47370 2024-09-12T01:35:55.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.136+0000 7fb4617fa640 1 -- 172.21.15.81:0/2559716483 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb470018ab0 con 0x564174a47370 2024-09-12T01:35:55.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.136+0000 7fb4617fa640 1 -- 172.21.15.81:0/2559716483 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4700178e0 con 0x564174a47370 2024-09-12T01:35:55.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.137+0000 7fb4837fb740 1 -- 172.21.15.81:0/2559716483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a47370 msgr2=0x564174a49760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.137+0000 7fb4837fb740 1 --2- 172.21.15.81:0/2559716483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a47370 0x564174a49760 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb470016530 tx=0x7fb47000a360 comp rx=0 tx=0).stop 2024-09-12T01:35:55.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.137+0000 7fb4837fb740 1 -- 172.21.15.81:0/2559716483 shutdown_connections 2024-09-12T01:35:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.137+0000 7fb4837fb740 1 --2- 172.21.15.81:0/2559716483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a47370 0x564174a49760 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.137+0000 7fb4837fb740 1 --2- 172.21.15.81:0/2559716483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3c5d0 0x564174a3ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.137+0000 7fb4837fb740 1 --2- 172.21.15.81:0/2559716483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a3db40 0x564174a3c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.137+0000 7fb4837fb740 1 -- 172.21.15.81:0/2559716483 >> 172.21.15.81:0/2559716483 conn(0x564174a05310 msgr2=0x564174a38c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.137+0000 7fb4837fb740 1 -- 172.21.15.81:0/2559716483 shutdown_connections 2024-09-12T01:35:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.137+0000 7fb4837fb740 1 -- 172.21.15.81:0/2559716483 wait complete. 2024-09-12T01:35:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.137+0000 7fb4837fb740 1 -- start start 2024-09-12T01:35:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.137+0000 7fb4837fb740 1 Processor -- start 2024-09-12T01:35:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb4837fb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 0x564174a46d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb4837fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3db40 0x564174a44020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb4837fb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 0x564174a44610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb4837fb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564174a4a010 con 0x564174a3c5d0 2024-09-12T01:35:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb4837fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56417495d060 con 0x564174a3db40 2024-09-12T01:35:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb4837fb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564174a4a190 con 0x564174a47370 2024-09-12T01:35:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb4837fb740 10 client.0 _ll_register_callbacks cb 0x5641746b08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb47a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 0x564174a46d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb47a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 0x564174a46d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46952/0 (socket says 172.21.15.81:46952) 2024-09-12T01:35:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb47a7fc640 1 -- 172.21.15.81:0/3287953080 learned_addr learned my addr 172.21.15.81:0/3287953080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb47affd640 1 --2- 172.21.15.81:0/3287953080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3db40 0x564174a44020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb47a7fc640 1 -- 172.21.15.81:0/3287953080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 msgr2=0x564174a44610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/3287953080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 0x564174a44610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb47a7fc640 1 -- 172.21.15.81:0/3287953080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3db40 msgr2=0x564174a44020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/3287953080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3db40 0x564174a44020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb47a7fc640 1 -- 172.21.15.81:0/3287953080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641747133c0 con 0x564174a3c5d0 2024-09-12T01:35:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/3287953080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 0x564174a46d70 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb470016500 tx=0x7fb470016f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8809ecda6752296 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.138+0000 7fb45eff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb45eff5640 1 -- 172.21.15.81:0/3287953080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4700184f0 con 0x564174a3c5d0 2024-09-12T01:35:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb4837fb740 1 -- 172.21.15.81:0/3287953080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb470018ab0 con 0x564174a3c5d0 2024-09-12T01:35:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb45eff5640 1 -- 172.21.15.81:0/3287953080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fb470018690 con 0x564174a3c5d0 2024-09-12T01:35:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb45eff5640 1 -- 172.21.15.81:0/3287953080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb47002f050 con 0x564174a3c5d0 2024-09-12T01:35:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb4837fb740 10 client.17223 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb4837fb740 1 -- 172.21.15.81:0/3287953080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564174a55ab0 con 0x564174a3c5d0 2024-09-12T01:35:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb45eff5640 1 -- 172.21.15.81:0/3287953080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb470018ab0 con 0x564174a3c5d0 2024-09-12T01:35:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb45eff5640 1 -- 172.21.15.81:0/3287953080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb470021070 con 0x564174a3c5d0 2024-09-12T01:35:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb4837fb740 10 client.17223 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb4837fb740 10 client.17223 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:35:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb4837fb740 20 client.17223 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb4837fb740 1 --2- 172.21.15.81:0/3287953080 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x564174a56e00 0x564174a591f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb4837fb740 4 client.17223 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.139+0000 7fb4837fb740 1 -- 172.21.15.81:0/3287953080 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641749af860 con 0x564174a56e00 2024-09-12T01:35:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.140+0000 7fb47affd640 1 --2- 172.21.15.81:0/3287953080 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x564174a56e00 0x564174a591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.140+0000 7fb45eff5640 10 client.17223 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:35:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.140+0000 7fb47affd640 1 --2- 172.21.15.81:0/3287953080 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x564174a56e00 0x564174a591f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea97fece975715f6 server_cookie=a2b6f54e286c86a4 in_seq=0 out_seq=0 2024-09-12T01:35:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb45eff5640 1 -- 172.21.15.81:0/3287953080 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5641749af860 con 0x564174a56e00 2024-09-12T01:35:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb45eff5640 10 client.17223 handle_command_reply: tid=0 2024-09-12T01:35:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb4837fb740 1 client.17223 shutdown 2024-09-12T01:35:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb4837fb740 1 -- 172.21.15.81:0/3287953080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 msgr2=0x564174a46d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb4837fb740 1 --2- 172.21.15.81:0/3287953080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 0x564174a46d70 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb470016500 tx=0x7fb470016f40 comp rx=0 tx=0).stop 2024-09-12T01:35:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb4837fb740 1 -- 172.21.15.81:0/3287953080 shutdown_connections 2024-09-12T01:35:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb4837fb740 1 --2- 172.21.15.81:0/3287953080 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x564174a56e00 0x564174a591f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb4837fb740 1 --2- 172.21.15.81:0/3287953080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 0x564174a44610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb4837fb740 1 --2- 172.21.15.81:0/3287953080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3db40 0x564174a44020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb45eff5640 0 client.17223 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:35:55.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb4837fb740 1 --2- 172.21.15.81:0/3287953080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 0x564174a46d70 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb4837fb740 1 -- 172.21.15.81:0/3287953080 >> 172.21.15.81:0/3287953080 conn(0x564174a05310 msgr2=0x564174a3e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:55.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb4837fb740 1 -- 172.21.15.81:0/3287953080 shutdown_connections 2024-09-12T01:35:55.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb4837fb740 1 -- 172.21.15.81:0/3287953080 wait complete. 2024-09-12T01:35:55.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.141+0000 7fb4837fb740 20 client.17223 trim_cache size 0 max 16384 2024-09-12T01:35:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb4837fb740 1 Processor -- start 2024-09-12T01:35:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb4837fb740 1 -- start start 2024-09-12T01:35:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb4837fb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 0x564174a532b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb4837fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3db40 0x564174a438e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb4837fb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 0x564174a42ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb4837fb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c1afac0 con 0x564174a3c5d0 2024-09-12T01:35:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb4837fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c1b1600 con 0x564174a3db40 2024-09-12T01:35:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb4837fb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c1b0190 con 0x564174a47370 2024-09-12T01:35:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb47a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 0x564174a532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb47a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 0x564174a532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46968/0 (socket says 172.21.15.81:46968) 2024-09-12T01:35:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb47a7fc640 1 -- 172.21.15.81:0/137209865 learned_addr learned my addr 172.21.15.81:0/137209865 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb47affd640 1 --2- 172.21.15.81:0/137209865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3db40 0x564174a438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb47a7fc640 1 -- 172.21.15.81:0/137209865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 msgr2=0x564174a42ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/137209865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 0x564174a42ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb47a7fc640 1 -- 172.21.15.81:0/137209865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3db40 msgr2=0x564174a438e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:55.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/137209865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3db40 0x564174a438e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb47a7fc640 1 -- 172.21.15.81:0/137209865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564174a42590 con 0x564174a3c5d0 2024-09-12T01:35:55.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb47affd640 1 --2- 172.21.15.81:0/137209865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3db40 0x564174a438e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:55.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.154+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/137209865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 0x564174a532b0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fb47000a110 tx=0x7fb470006d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e17998dc6687ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:55.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.155+0000 7fb460ff9640 1 -- 172.21.15.81:0/137209865 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb470037020 con 0x564174a3c5d0 2024-09-12T01:35:55.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.155+0000 7fb460ff9640 1 -- 172.21.15.81:0/137209865 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb470016fb0 con 0x564174a3c5d0 2024-09-12T01:35:55.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.155+0000 7fb460ff9640 1 -- 172.21.15.81:0/137209865 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb470022e60 con 0x564174a3c5d0 2024-09-12T01:35:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.155+0000 7fb4837fb740 1 -- 172.21.15.81:0/137209865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 msgr2=0x564174a532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.155+0000 7fb4837fb740 1 --2- 172.21.15.81:0/137209865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 0x564174a532b0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fb47000a110 tx=0x7fb470006d30 comp rx=0 tx=0).stop 2024-09-12T01:35:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.155+0000 7fb4837fb740 1 -- 172.21.15.81:0/137209865 shutdown_connections 2024-09-12T01:35:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.155+0000 7fb4837fb740 1 --2- 172.21.15.81:0/137209865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 0x564174a42ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.155+0000 7fb4837fb740 1 --2- 172.21.15.81:0/137209865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3db40 0x564174a438e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.155+0000 7fb4837fb740 1 --2- 172.21.15.81:0/137209865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3c5d0 0x564174a532b0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.155+0000 7fb4837fb740 1 -- 172.21.15.81:0/137209865 >> 172.21.15.81:0/137209865 conn(0x564174a05310 msgr2=0x564174a427e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.155+0000 7fb4837fb740 1 -- 172.21.15.81:0/137209865 shutdown_connections 2024-09-12T01:35:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.155+0000 7fb4837fb740 1 -- 172.21.15.81:0/137209865 wait complete. 2024-09-12T01:35:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb4837fb740 1 -- start start 2024-09-12T01:35:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb4837fb740 1 Processor -- start 2024-09-12T01:35:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb4837fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3c5d0 0x564174a4f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb4837fb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3db40 0x564174a4f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb4837fb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 0x564174a40670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb4837fb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c1b0f30 con 0x564174a3db40 2024-09-12T01:35:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb4837fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c1b0860 con 0x564174a3c5d0 2024-09-12T01:35:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb4837fb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c1adac0 con 0x564174a47370 2024-09-12T01:35:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb4837fb740 10 client.0 _ll_register_callbacks cb 0x7fb47000ac60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb47affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3db40 0x564174a4f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb47affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3db40 0x564174a4f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46974/0 (socket says 172.21.15.81:46974) 2024-09-12T01:35:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb47affd640 1 -- 172.21.15.81:0/3593142815 learned_addr learned my addr 172.21.15.81:0/3593142815 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 0x564174a40670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3c5d0 0x564174a4f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb47affd640 1 -- 172.21.15.81:0/3593142815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 msgr2=0x564174a40670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb47affd640 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 0x564174a40670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb47affd640 1 -- 172.21.15.81:0/3593142815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3c5d0 msgr2=0x564174a4f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb47affd640 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3c5d0 0x564174a4f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb47affd640 1 -- 172.21.15.81:0/3593142815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564174a40c30 con 0x564174a3db40 2024-09-12T01:35:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.156+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 0x564174a40670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb47affd640 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3db40 0x564174a4f960 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0039e0 tx=0x7fb46c0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92156d73b1361f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb45eff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb45eff5640 1 -- 172.21.15.81:0/3593142815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c01b850 con 0x564174a3db40 2024-09-12T01:35:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb45eff5640 1 -- 172.21.15.81:0/3593142815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fb46c01b9f0 con 0x564174a3db40 2024-09-12T01:35:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb4837fb740 1 -- 172.21.15.81:0/3593142815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb470016fb0 con 0x564174a3db40 2024-09-12T01:35:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb45eff5640 1 -- 172.21.15.81:0/3593142815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb46c02b050 con 0x564174a3db40 2024-09-12T01:35:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb4837fb740 10 client.17229 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb4837fb740 1 -- 172.21.15.81:0/3593142815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564174ac10b0 con 0x564174a3db40 2024-09-12T01:35:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb45eff5640 1 -- 172.21.15.81:0/3593142815 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb470016fb0 con 0x564174a3db40 2024-09-12T01:35:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb45eff5640 1 -- 172.21.15.81:0/3593142815 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb46c00f040 con 0x564174a3db40 2024-09-12T01:35:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb4837fb740 10 client.17229 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb4837fb740 10 client.17229 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:35:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb4837fb740 20 client.17229 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb4837fb740 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x564174ac1810 0x564174ac3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb4837fb740 4 client.17229 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:35:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.157+0000 7fb4837fb740 1 -- 172.21.15.81:0/3593142815 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5641749a9d70 con 0x564174ac1810 2024-09-12T01:35:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.158+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x564174ac1810 0x564174ac3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.158+0000 7fb45eff5640 10 client.17229 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:35:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.158+0000 7fb47a7fc640 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x564174ac1810 0x564174ac3c30 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85d66fa36b1f4497 server_cookie=f279bfc564574a72 in_seq=0 out_seq=0 2024-09-12T01:35:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.158+0000 7fb45eff5640 1 -- 172.21.15.81:0/3593142815 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5641749a9d70 con 0x564174ac1810 2024-09-12T01:35:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.158+0000 7fb45eff5640 10 client.17229 handle_command_reply: tid=0 2024-09-12T01:35:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.158+0000 7fb4837fb740 1 client.17229 shutdown 2024-09-12T01:35:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.158+0000 7fb4837fb740 1 -- 172.21.15.81:0/3593142815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3db40 msgr2=0x564174a4f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.158+0000 7fb4837fb740 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3db40 0x564174a4f960 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0039e0 tx=0x7fb46c0128e0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb4837fb740 1 -- 172.21.15.81:0/3593142815 shutdown_connections 2024-09-12T01:35:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb4837fb740 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x564174ac1810 0x564174ac3c30 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb4837fb740 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564174a47370 0x564174a40670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb4837fb740 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564174a3db40 0x564174a4f960 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb4837fb740 1 --2- 172.21.15.81:0/3593142815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564174a3c5d0 0x564174a4f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb45eff5640 0 client.17229 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:35:55.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb4837fb740 1 -- 172.21.15.81:0/3593142815 >> 172.21.15.81:0/3593142815 conn(0x564174a05310 msgr2=0x564174a43000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:55.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb4837fb740 1 -- 172.21.15.81:0/3593142815 shutdown_connections 2024-09-12T01:35:55.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb4837fb740 1 -- 172.21.15.81:0/3593142815 wait complete. 2024-09-12T01:35:55.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb4837fb740 20 client.17229 trim_cache size 0 max 16384 2024-09-12T01:35:55.165 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:35:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb481422640 1 -- 172.21.15.81:0/1601582023 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb4640a2cf0 msgr2=0x7fb4640a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb481422640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb4640a2cf0 0x7fb4640a51b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb4740ed990 tx=0x7fb47408e120 comp rx=0 tx=0).stop 2024-09-12T01:35:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb481422640 1 -- 172.21.15.81:0/1601582023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c10c170 msgr2=0x7fb47c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb481422640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c10c170 0x7fb47c101420 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb474005ab0 tx=0x7fb4740042f0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb481422640 1 -- 172.21.15.81:0/1601582023 shutdown_connections 2024-09-12T01:35:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb481422640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb4640a2cf0 0x7fb4640a51b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb481422640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c10c170 0x7fb47c101420 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb481422640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb47c103660 0x7fb47c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb481422640 1 --2- 172.21.15.81:0/1601582023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb47c102d40 0x7fb47c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.159+0000 7fb481422640 1 -- 172.21.15.81:0/1601582023 >> 172.21.15.81:0/1601582023 conn(0x7fb47c0fc7a0 msgr2=0x7fb47c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.160+0000 7fb481422640 1 -- 172.21.15.81:0/1601582023 shutdown_connections 2024-09-12T01:35:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:55.160+0000 7fb481422640 1 -- 172.21.15.81:0/1601582023 wait complete. 2024-09-12T01:35:55.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:55 smithi081 ceph-mon[30920]: pgmap v240: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:55.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:35:56.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:55 smithi100 ceph-mon[35275]: pgmap v240: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:55 smithi189 ceph-mon[35357]: pgmap v240: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:35:56.194 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.658+0000 7f36394eb640 1 -- 172.21.15.81:0/2108647230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3634102790 msgr2=0x7f36341067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.658+0000 7f36394eb640 1 --2- 172.21.15.81:0/2108647230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3634102790 0x7f36341067e0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f361c009900 tx=0x7f361c02a410 comp rx=0 tx=0).stop 2024-09-12T01:35:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.658+0000 7f36394eb640 1 -- 172.21.15.81:0/2108647230 shutdown_connections 2024-09-12T01:35:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.658+0000 7f36394eb640 1 --2- 172.21.15.81:0/2108647230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3634106f10 0x7f363410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.658+0000 7f36394eb640 1 --2- 172.21.15.81:0/2108647230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3634102790 0x7f36341067e0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.658+0000 7f36394eb640 1 --2- 172.21.15.81:0/2108647230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3634101de0 0x7f36341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.658+0000 7f36394eb640 1 -- 172.21.15.81:0/2108647230 >> 172.21.15.81:0/2108647230 conn(0x7f36340fd8c0 msgr2=0x7f36340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.658+0000 7f36394eb640 1 -- 172.21.15.81:0/2108647230 shutdown_connections 2024-09-12T01:35:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.658+0000 7f36394eb640 1 -- 172.21.15.81:0/2108647230 wait complete. 2024-09-12T01:35:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.658+0000 7f36394eb640 1 Processor -- start 2024-09-12T01:35:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.658+0000 7f36394eb640 1 -- start start 2024-09-12T01:35:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f36394eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3634101de0 0x7f3634198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f36394eb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3634102790 0x7f3634198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f36394eb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3634106f10 0x7f363419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f36394eb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3634111f90 con 0x7f3634101de0 2024-09-12T01:35:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f36394eb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3634111e10 con 0x7f3634106f10 2024-09-12T01:35:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f36394eb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3634112110 con 0x7f3634102790 2024-09-12T01:35:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f3632ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3634101de0 0x7f3634198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f3632ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3634101de0 0x7f3634198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46992/0 (socket says 172.21.15.81:46992) 2024-09-12T01:35:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f3632ffd640 1 -- 172.21.15.81:0/2761093822 learned_addr learned my addr 172.21.15.81:0/2761093822 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f36337fe640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3634106f10 0x7f363419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f362bfff640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3634102790 0x7f3634198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f3632ffd640 1 -- 172.21.15.81:0/2761093822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3634102790 msgr2=0x7f3634198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f3632ffd640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3634102790 0x7f3634198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f3632ffd640 1 -- 172.21.15.81:0/2761093822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3634106f10 msgr2=0x7f363419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f3632ffd640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3634106f10 0x7f363419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f3632ffd640 1 -- 172.21.15.81:0/2761093822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363419d4c0 con 0x7f3634101de0 2024-09-12T01:35:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f3632ffd640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3634101de0 0x7f3634198510 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f362400b4a0 tx=0x7f362400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.659+0000 7f3630ff9640 1 -- 172.21.15.81:0/2761093822 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624014070 con 0x7f3634101de0 2024-09-12T01:35:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.660+0000 7f36394eb640 1 -- 172.21.15.81:0/2761093822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363419d7b0 con 0x7f3634101de0 2024-09-12T01:35:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.660+0000 7f3630ff9640 1 -- 172.21.15.81:0/2761093822 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3624010af0 con 0x7f3634101de0 2024-09-12T01:35:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.660+0000 7f3630ff9640 1 -- 172.21.15.81:0/2761093822 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624017d10 con 0x7f3634101de0 2024-09-12T01:35:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.660+0000 7f36394eb640 1 -- 172.21.15.81:0/2761093822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36341a5090 con 0x7f3634101de0 2024-09-12T01:35:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.662+0000 7f3630ff9640 1 -- 172.21.15.81:0/2761093822 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f3624017070 con 0x7f3634101de0 2024-09-12T01:35:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.662+0000 7f363b8c4740 1 Processor -- start 2024-09-12T01:35:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.662+0000 7f363b8c4740 1 -- start start 2024-09-12T01:35:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f363b8c4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277bbb40 0x55d3277ba090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f363b8c4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 0x55d3277baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f363b8c4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f363b8c4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d3277202f0 con 0x55d3277ba5d0 2024-09-12T01:35:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f363b8c4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d3276c7cf0 con 0x55d3277c5370 2024-09-12T01:35:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f363b8c4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d32771c2b0 con 0x55d3277bbb40 2024-09-12T01:35:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f3632ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 0x55d3277baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f3632ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 0x55d3277baa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47002/0 (socket says 172.21.15.81:47002) 2024-09-12T01:35:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f3632ffd640 1 -- 172.21.15.81:0/3079285176 learned_addr learned my addr 172.21.15.81:0/3079285176 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f3630ff9640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f36200a2cf0 0x7f36200a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f36337fe640 1 --2- 172.21.15.81:0/3079285176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277bbb40 0x55d3277ba090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f362bfff640 1 --2- 172.21.15.81:0/3079285176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f36337fe640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f36200a2cf0 0x7f36200a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f3630ff9640 1 -- 172.21.15.81:0/2761093822 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f36240ce850 con 0x7f3634101de0 2024-09-12T01:35:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f3632ffd640 1 -- 172.21.15.81:0/3079285176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277bbb40 msgr2=0x55d3277ba090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f3632ffd640 1 --2- 172.21.15.81:0/3079285176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277bbb40 0x55d3277ba090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f3632ffd640 1 -- 172.21.15.81:0/3079285176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 msgr2=0x55d3277c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f3632ffd640 1 --2- 172.21.15.81:0/3079285176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f3632ffd640 1 -- 172.21.15.81:0/3079285176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3276ac3a0 con 0x55d3277ba5d0 2024-09-12T01:35:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.663+0000 7f362bfff640 1 --2- 172.21.15.81:0/3079285176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.664+0000 7f3632ffd640 1 --2- 172.21.15.81:0/3079285176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 0x55d3277baa10 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f36240cbfc0 tx=0x7f3624009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544ea3309c3e5a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.664+0000 7f36337fe640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f36200a2cf0 0x7f36200a51b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f362c00bfd0 tx=0x7f362c007220 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.664+0000 7f36297fa640 1 -- 172.21.15.81:0/3079285176 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362401e070 con 0x55d3277ba5d0 2024-09-12T01:35:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.664+0000 7f36297fa640 1 -- 172.21.15.81:0/3079285176 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f362409ae20 con 0x55d3277ba5d0 2024-09-12T01:35:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.664+0000 7f36297fa640 1 -- 172.21.15.81:0/3079285176 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624010e00 con 0x55d3277ba5d0 2024-09-12T01:35:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.664+0000 7f363b8c4740 1 -- 172.21.15.81:0/3079285176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 msgr2=0x55d3277baa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.664+0000 7f363b8c4740 1 --2- 172.21.15.81:0/3079285176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 0x55d3277baa10 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f36240cbfc0 tx=0x7f3624009390 comp rx=0 tx=0).stop 2024-09-12T01:35:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 -- 172.21.15.81:0/3079285176 shutdown_connections 2024-09-12T01:35:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 --2- 172.21.15.81:0/3079285176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 --2- 172.21.15.81:0/3079285176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 0x55d3277baa10 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 --2- 172.21.15.81:0/3079285176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277bbb40 0x55d3277ba090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 -- 172.21.15.81:0/3079285176 >> 172.21.15.81:0/3079285176 conn(0x55d327783310 msgr2=0x55d3277b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 -- 172.21.15.81:0/3079285176 shutdown_connections 2024-09-12T01:35:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 -- 172.21.15.81:0/3079285176 wait complete. 2024-09-12T01:35:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 -- start start 2024-09-12T01:35:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 Processor -- start 2024-09-12T01:35:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 0x55d3277c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277bbb40 0x55d3277c2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d3277c8010 con 0x55d3277ba5d0 2024-09-12T01:35:56.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d3276db060 con 0x55d3277c5370 2024-09-12T01:35:56.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d3277c8190 con 0x55d3277bbb40 2024-09-12T01:35:56.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f363b8c4740 10 client.0 _ll_register_callbacks cb 0x55d32742e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:56.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f3632ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 0x55d3277c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f3632ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 0x55d3277c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47018/0 (socket says 172.21.15.81:47018) 2024-09-12T01:35:56.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f3632ffd640 1 -- 172.21.15.81:0/2117024551 learned_addr learned my addr 172.21.15.81:0/2117024551 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:56.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.665+0000 7f362bfff640 1 --2- 172.21.15.81:0/2117024551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277bbb40 0x55d3277c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f36337fe640 1 --2- 172.21.15.81:0/2117024551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f3632ffd640 1 -- 172.21.15.81:0/2117024551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277bbb40 msgr2=0x55d3277c2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f3632ffd640 1 --2- 172.21.15.81:0/2117024551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277bbb40 0x55d3277c2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f3632ffd640 1 -- 172.21.15.81:0/2117024551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 msgr2=0x55d3277c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f3632ffd640 1 --2- 172.21.15.81:0/2117024551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f3632ffd640 1 -- 172.21.15.81:0/2117024551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3274913c0 con 0x55d3277ba5d0 2024-09-12T01:35:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f3632ffd640 1 --2- 172.21.15.81:0/2117024551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 0x55d3277c4d70 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f3624097280 tx=0x7f36240047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800d37ec47723d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f361a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f361a7fc640 1 -- 172.21.15.81:0/2117024551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36240d4020 con 0x55d3277ba5d0 2024-09-12T01:35:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f361a7fc640 1 -- 172.21.15.81:0/2117024551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f3624010da0 con 0x55d3277ba5d0 2024-09-12T01:35:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f363b8c4740 1 -- 172.21.15.81:0/2117024551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f362409ae20 con 0x55d3277ba5d0 2024-09-12T01:35:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f361a7fc640 1 -- 172.21.15.81:0/2117024551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f362401e070 con 0x55d3277ba5d0 2024-09-12T01:35:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f363b8c4740 10 client.17241 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f363b8c4740 1 -- 172.21.15.81:0/2117024551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d3277d3ab0 con 0x55d3277ba5d0 2024-09-12T01:35:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.666+0000 7f361a7fc640 1 -- 172.21.15.81:0/2117024551 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f362409ae20 con 0x55d3277ba5d0 2024-09-12T01:35:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.667+0000 7f361a7fc640 1 -- 172.21.15.81:0/2117024551 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f36240cc130 con 0x55d3277ba5d0 2024-09-12T01:35:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.667+0000 7f363b8c4740 10 client.17241 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.667+0000 7f363b8c4740 10 client.17241 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:35:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.667+0000 7f363b8c4740 20 client.17241 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.667+0000 7f363b8c4740 1 --2- 172.21.15.81:0/2117024551 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55d3277d4e00 0x55d3277d71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.667+0000 7f363b8c4740 4 client.17241 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.667+0000 7f363b8c4740 1 -- 172.21.15.81:0/2117024551 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d32772d860 con 0x55d3277d4e00 2024-09-12T01:35:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.667+0000 7f362bfff640 1 --2- 172.21.15.81:0/2117024551 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55d3277d4e00 0x55d3277d71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.667+0000 7f362bfff640 1 --2- 172.21.15.81:0/2117024551 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55d3277d4e00 0x55d3277d71f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9dd701bda60d285f server_cookie=6a627516a262115f in_seq=0 out_seq=0 2024-09-12T01:35:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.667+0000 7f361a7fc640 10 client.17241 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:35:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.668+0000 7f361a7fc640 1 -- 172.21.15.81:0/2117024551 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d32772d860 con 0x55d3277d4e00 2024-09-12T01:35:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.668+0000 7f361a7fc640 10 client.17241 handle_command_reply: tid=0 2024-09-12T01:35:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.668+0000 7f363b8c4740 1 client.17241 shutdown 2024-09-12T01:35:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.668+0000 7f363b8c4740 1 -- 172.21.15.81:0/2117024551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 msgr2=0x55d3277c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.668+0000 7f363b8c4740 1 --2- 172.21.15.81:0/2117024551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 0x55d3277c4d70 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f3624097280 tx=0x7f36240047d0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.668+0000 7f363b8c4740 1 -- 172.21.15.81:0/2117024551 shutdown_connections 2024-09-12T01:35:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.668+0000 7f363b8c4740 1 --2- 172.21.15.81:0/2117024551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.668+0000 7f363b8c4740 1 --2- 172.21.15.81:0/2117024551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277bbb40 0x55d3277c2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.668+0000 7f363b8c4740 1 --2- 172.21.15.81:0/2117024551 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55d3277d4e00 0x55d3277d71f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.669+0000 7f363b8c4740 1 --2- 172.21.15.81:0/2117024551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277ba5d0 0x55d3277c4d70 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.669+0000 7f361a7fc640 0 client.17241 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:35:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.669+0000 7f363b8c4740 1 -- 172.21.15.81:0/2117024551 >> 172.21.15.81:0/2117024551 conn(0x55d327783310 msgr2=0x55d3277bc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.669+0000 7f363b8c4740 1 -- 172.21.15.81:0/2117024551 shutdown_connections 2024-09-12T01:35:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.669+0000 7f363b8c4740 1 -- 172.21.15.81:0/2117024551 wait complete. 2024-09-12T01:35:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.669+0000 7f363b8c4740 20 client.17241 trim_cache size 0 max 16384 2024-09-12T01:35:56.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.681+0000 7f363b8c4740 1 Processor -- start 2024-09-12T01:35:56.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.681+0000 7f363b8c4740 1 -- start start 2024-09-12T01:35:56.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f363b8c4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277ba5d0 0x55d3277c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f363b8c4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 0x55d3277d9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f363b8c4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277da370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f363b8c4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36341ad990 con 0x55d3277bbb40 2024-09-12T01:35:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f363b8c4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f36341af4d0 con 0x55d3277c5370 2024-09-12T01:35:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f363b8c4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f36341ae060 con 0x55d3277ba5d0 2024-09-12T01:35:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f362bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 0x55d3277d9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f362bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 0x55d3277d9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47024/0 (socket says 172.21.15.81:47024) 2024-09-12T01:35:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f362bfff640 1 -- 172.21.15.81:0/2949363762 learned_addr learned my addr 172.21.15.81:0/2949363762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f36337fe640 1 --2- 172.21.15.81:0/2949363762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277da370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f3632ffd640 1 --2- 172.21.15.81:0/2949363762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277ba5d0 0x55d3277c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f362bfff640 1 -- 172.21.15.81:0/2949363762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277ba5d0 msgr2=0x55d3277c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f362bfff640 1 --2- 172.21.15.81:0/2949363762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277ba5d0 0x55d3277c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f362bfff640 1 -- 172.21.15.81:0/2949363762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 msgr2=0x55d3277da370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:56.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f362bfff640 1 --2- 172.21.15.81:0/2949363762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277da370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f362bfff640 1 -- 172.21.15.81:0/2949363762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3277c0590 con 0x55d3277bbb40 2024-09-12T01:35:56.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.682+0000 7f362bfff640 1 --2- 172.21.15.81:0/2949363762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 0x55d3277d9e30 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f361c0096c0 tx=0x7f361c0314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe90a26398ebf42a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:56.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.683+0000 7f3628ff9640 1 -- 172.21.15.81:0/2949363762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c035040 con 0x55d3277bbb40 2024-09-12T01:35:56.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.683+0000 7f3628ff9640 1 -- 172.21.15.81:0/2949363762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f361c005520 con 0x55d3277bbb40 2024-09-12T01:35:56.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.683+0000 7f3628ff9640 1 -- 172.21.15.81:0/2949363762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c004da0 con 0x55d3277bbb40 2024-09-12T01:35:56.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.683+0000 7f363b8c4740 1 -- 172.21.15.81:0/2949363762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 msgr2=0x55d3277d9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.683+0000 7f363b8c4740 1 --2- 172.21.15.81:0/2949363762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 0x55d3277d9e30 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f361c0096c0 tx=0x7f361c0314e0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.683+0000 7f363b8c4740 1 -- 172.21.15.81:0/2949363762 shutdown_connections 2024-09-12T01:35:56.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.683+0000 7f363b8c4740 1 --2- 172.21.15.81:0/2949363762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277da370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.683+0000 7f363b8c4740 1 --2- 172.21.15.81:0/2949363762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 0x55d3277d9e30 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.683+0000 7f363b8c4740 1 --2- 172.21.15.81:0/2949363762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277ba5d0 0x55d3277c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.683+0000 7f363b8c4740 1 -- 172.21.15.81:0/2949363762 >> 172.21.15.81:0/2949363762 conn(0x55d327783310 msgr2=0x55d3277c0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.683+0000 7f363b8c4740 1 -- 172.21.15.81:0/2949363762 shutdown_connections 2024-09-12T01:35:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f363b8c4740 1 -- 172.21.15.81:0/2949363762 wait complete. 2024-09-12T01:35:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f363b8c4740 1 -- start start 2024-09-12T01:35:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f363b8c4740 1 Processor -- start 2024-09-12T01:35:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f363b8c4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277ba5d0 0x55d3277da310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f363b8c4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 0x55d3277d7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f363b8c4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277d7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f363b8c4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36341aee00 con 0x55d3277bbb40 2024-09-12T01:35:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f363b8c4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f36341ae730 con 0x55d3277c5370 2024-09-12T01:35:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f363b8c4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f36341ab990 con 0x55d3277ba5d0 2024-09-12T01:35:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f363b8c4740 10 client.0 _ll_register_callbacks cb 0x7f362c00bd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f362bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 0x55d3277d7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f362bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 0x55d3277d7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47034/0 (socket says 172.21.15.81:47034) 2024-09-12T01:35:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f362bfff640 1 -- 172.21.15.81:0/740252121 learned_addr learned my addr 172.21.15.81:0/740252121 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f36337fe640 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277d7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.684+0000 7f3632ffd640 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277ba5d0 0x55d3277da310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f362bfff640 1 -- 172.21.15.81:0/740252121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277ba5d0 msgr2=0x55d3277da310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f362bfff640 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277ba5d0 0x55d3277da310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f362bfff640 1 -- 172.21.15.81:0/740252121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 msgr2=0x55d3277d7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f362bfff640 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277d7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f362bfff640 1 -- 172.21.15.81:0/740252121 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3277d8160 con 0x55d3277bbb40 2024-09-12T01:35:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f36337fe640 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277d7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f362bfff640 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 0x55d3277d7660 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f361c009850 tx=0x7f361c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b82fed47c45cb64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f361a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f361a7fc640 1 -- 172.21.15.81:0/740252121 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c050070 con 0x55d3277bbb40 2024-09-12T01:35:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f363b8c4740 1 -- 172.21.15.81:0/740252121 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f361c005520 con 0x55d3277bbb40 2024-09-12T01:35:56.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f361a7fc640 1 -- 172.21.15.81:0/740252121 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f361c0315b0 con 0x55d3277bbb40 2024-09-12T01:35:56.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f361a7fc640 1 -- 172.21.15.81:0/740252121 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f361c035040 con 0x55d3277bbb40 2024-09-12T01:35:56.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f363b8c4740 10 client.17247 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:56.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f363b8c4740 1 -- 172.21.15.81:0/740252121 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d32783f4b0 con 0x55d3277bbb40 2024-09-12T01:35:56.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f361a7fc640 1 -- 172.21.15.81:0/740252121 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f361c005520 con 0x55d3277bbb40 2024-09-12T01:35:56.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.685+0000 7f361a7fc640 1 -- 172.21.15.81:0/740252121 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f361c005020 con 0x55d3277bbb40 2024-09-12T01:35:56.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f363b8c4740 10 client.17247 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:56.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f363b8c4740 10 client.17247 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:35:56.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f363b8c4740 20 client.17247 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:56.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f363b8c4740 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55d32783fc00 0x55d327842020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f363b8c4740 4 client.17247 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:35:56.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f363b8c4740 1 -- 172.21.15.81:0/740252121 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d327727d70 con 0x55d32783fc00 2024-09-12T01:35:56.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f3632ffd640 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55d32783fc00 0x55d327842020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f3632ffd640 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55d32783fc00 0x55d327842020 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=59bf7dc5eeb80fe4 server_cookie=484e72650b38945 in_seq=0 out_seq=0 2024-09-12T01:35:56.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f361a7fc640 10 client.17247 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:35:56.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f361a7fc640 1 -- 172.21.15.81:0/740252121 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d327727d70 con 0x55d32783fc00 2024-09-12T01:35:56.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f361a7fc640 10 client.17247 handle_command_reply: tid=0 2024-09-12T01:35:56.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f363b8c4740 1 client.17247 shutdown 2024-09-12T01:35:56.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f363b8c4740 1 -- 172.21.15.81:0/740252121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 msgr2=0x55d3277d7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f363b8c4740 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 0x55d3277d7660 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f361c009850 tx=0x7f361c000bc0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f363b8c4740 1 -- 172.21.15.81:0/740252121 shutdown_connections 2024-09-12T01:35:56.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f363b8c4740 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3277c5370 0x55d3277d7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.686+0000 7f363b8c4740 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55d32783fc00 0x55d327842020 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f363b8c4740 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3277bbb40 0x55d3277d7660 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f363b8c4740 1 --2- 172.21.15.81:0/740252121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d3277ba5d0 0x55d3277da310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f363b8c4740 1 -- 172.21.15.81:0/740252121 >> 172.21.15.81:0/740252121 conn(0x55d327783310 msgr2=0x55d3277bc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f361a7fc640 0 client.17247 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:35:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f363b8c4740 1 -- 172.21.15.81:0/740252121 shutdown_connections 2024-09-12T01:35:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f363b8c4740 1 -- 172.21.15.81:0/740252121 wait complete. 2024-09-12T01:35:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f363b8c4740 20 client.17247 trim_cache size 0 max 16384 2024-09-12T01:35:56.693 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:35:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f36394eb640 1 -- 172.21.15.81:0/2761093822 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f36200a2cf0 msgr2=0x7f36200a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f36394eb640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f36200a2cf0 0x7f36200a51b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f362c00bfd0 tx=0x7f362c007220 comp rx=0 tx=0).stop 2024-09-12T01:35:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f36394eb640 1 -- 172.21.15.81:0/2761093822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3634101de0 msgr2=0x7f3634198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f36394eb640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3634101de0 0x7f3634198510 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f362400b4a0 tx=0x7f362400b960 comp rx=0 tx=0).stop 2024-09-12T01:35:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f36394eb640 1 -- 172.21.15.81:0/2761093822 shutdown_connections 2024-09-12T01:35:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f36394eb640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f36200a2cf0 0x7f36200a51b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f36394eb640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3634106f10 0x7f363419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f36394eb640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3634102790 0x7f3634198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f36394eb640 1 --2- 172.21.15.81:0/2761093822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3634101de0 0x7f3634198510 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f36394eb640 1 -- 172.21.15.81:0/2761093822 >> 172.21.15.81:0/2761093822 conn(0x7f36340fd8c0 msgr2=0x7f36340fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f36394eb640 1 -- 172.21.15.81:0/2761093822 shutdown_connections 2024-09-12T01:35:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:56.687+0000 7f36394eb640 1 -- 172.21.15.81:0/2761093822 wait complete. 2024-09-12T01:35:57.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:35:57.575 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:57.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:57 smithi081 ceph-mon[30920]: pgmap v241: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.990+0000 7f6626629640 1 -- 172.21.15.81:0/1678748087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6620106a80 msgr2=0x7f6620106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.990+0000 7f6626629640 1 --2- 172.21.15.81:0/1678748087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6620106a80 0x7f6620106e60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6610009930 tx=0x7f661002a420 comp rx=0 tx=0).stop 2024-09-12T01:35:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.990+0000 7f6626629640 1 -- 172.21.15.81:0/1678748087 shutdown_connections 2024-09-12T01:35:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.990+0000 7f6626629640 1 --2- 172.21.15.81:0/1678748087 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6620101420 0x7f662010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.990+0000 7f6626629640 1 --2- 172.21.15.81:0/1678748087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6620100a80 0x7f6620100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.990+0000 7f6626629640 1 --2- 172.21.15.81:0/1678748087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6620106a80 0x7f6620106e60 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.990+0000 7f6626629640 1 -- 172.21.15.81:0/1678748087 >> 172.21.15.81:0/1678748087 conn(0x7f66200fc7a0 msgr2=0x7f66200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.990+0000 7f6626629640 1 -- 172.21.15.81:0/1678748087 shutdown_connections 2024-09-12T01:35:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.990+0000 7f6626629640 1 -- 172.21.15.81:0/1678748087 wait complete. 2024-09-12T01:35:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.991+0000 7f6626629640 1 Processor -- start 2024-09-12T01:35:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.991+0000 7f6626629640 1 -- start start 2024-09-12T01:35:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6626629640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6620100a80 0x7f6620198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6626629640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6620101420 0x7f6620198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6626629640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6620106a80 0x7f662019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6626629640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6620110ea0 con 0x7f6620106a80 2024-09-12T01:35:58.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6626629640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6620110d20 con 0x7f6620101420 2024-09-12T01:35:58.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6626629640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6620111020 con 0x7f6620100a80 2024-09-12T01:35:58.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6624bc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6620106a80 0x7f662019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6624bc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6620106a80 0x7f662019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47046/0 (socket says 172.21.15.81:47046) 2024-09-12T01:35:58.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6624bc6640 1 -- 172.21.15.81:0/3448595563 learned_addr learned my addr 172.21.15.81:0/3448595563 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:58.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f661f7fe640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6620101420 0x7f6620198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6624bc6640 1 -- 172.21.15.81:0/3448595563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6620100a80 msgr2=0x7f6620198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f661ffff640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6620100a80 0x7f6620198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6624bc6640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6620100a80 0x7f6620198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6624bc6640 1 -- 172.21.15.81:0/3448595563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6620101420 msgr2=0x7f6620198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6624bc6640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6620101420 0x7f6620198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6624bc6640 1 -- 172.21.15.81:0/3448595563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662019d4c0 con 0x7f6620106a80 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6624bc6640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6620106a80 0x7f662019cde0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f661800b970 tx=0x7f661800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f661d7fa640 1 -- 172.21.15.81:0/3448595563 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618019070 con 0x7f6620106a80 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f661d7fa640 1 -- 172.21.15.81:0/3448595563 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f661800cb40 con 0x7f6620106a80 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f6626629640 1 -- 172.21.15.81:0/3448595563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f662019d7b0 con 0x7f6620106a80 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.992+0000 7f661d7fa640 1 -- 172.21.15.81:0/3448595563 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618007650 con 0x7f6620106a80 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.993+0000 7f6626629640 1 -- 172.21.15.81:0/3448595563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66201a5090 con 0x7f6620106a80 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f661d7fa640 1 -- 172.21.15.81:0/3448595563 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f661801c070 con 0x7f6620106a80 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f6628a02740 1 Processor -- start 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f6628a02740 1 -- start start 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f6628a02740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e7b40 0x5620784e6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f6628a02740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e65d0 0x5620784e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f661d7fa640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f66080a2cf0 0x7f66080a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f6628a02740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784f1370 0x5620784f3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f6628a02740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56207844c2f0 con 0x5620784e65d0 2024-09-12T01:35:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f6628a02740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5620783f3cf0 con 0x5620784e7b40 2024-09-12T01:35:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f6628a02740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5620784482b0 con 0x5620784f1370 2024-09-12T01:35:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f661ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e65d0 0x5620784e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f661f7fe640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f66080a2cf0 0x7f66080a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f661ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e65d0 0x5620784e6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47048/0 (socket says 172.21.15.81:47048) 2024-09-12T01:35:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f661ffff640 1 -- 172.21.15.81:0/1544960408 learned_addr learned my addr 172.21.15.81:0/1544960408 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.995+0000 7f661d7fa640 1 -- 172.21.15.81:0/3448595563 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f66180ce8a0 con 0x7f6620106a80 2024-09-12T01:35:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.996+0000 7f661f7fe640 1 --2- 172.21.15.81:0/1544960408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e7b40 0x5620784e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.996+0000 7f6624bc6640 1 --2- 172.21.15.81:0/1544960408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784f1370 0x5620784f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.996+0000 7f661ffff640 1 -- 172.21.15.81:0/1544960408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784f1370 msgr2=0x5620784f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.996+0000 7f661ffff640 1 --2- 172.21.15.81:0/1544960408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784f1370 0x5620784f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.996+0000 7f661ffff640 1 -- 172.21.15.81:0/1544960408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e7b40 msgr2=0x5620784e6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.996+0000 7f661ffff640 1 --2- 172.21.15.81:0/1544960408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e7b40 0x5620784e6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.996+0000 7f661ffff640 1 -- 172.21.15.81:0/1544960408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620783d83a0 con 0x5620784e65d0 2024-09-12T01:35:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.996+0000 7f661f7fe640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f66080a2cf0 0x7f66080a51b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f66200feae0 tx=0x7f661400b840 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.996+0000 7f661ffff640 1 --2- 172.21.15.81:0/1544960408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e65d0 0x5620784e6a10 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f6610006010 tx=0x7f6610005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ca2d352d938645 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.996+0000 7f66067fc640 1 -- 172.21.15.81:0/1544960408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661003f070 con 0x5620784e65d0 2024-09-12T01:35:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.996+0000 7f66067fc640 1 -- 172.21.15.81:0/1544960408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6610004030 con 0x5620784e65d0 2024-09-12T01:35:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.996+0000 7f66067fc640 1 -- 172.21.15.81:0/1544960408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610035070 con 0x5620784e65d0 2024-09-12T01:35:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.997+0000 7f6628a02740 1 -- 172.21.15.81:0/1544960408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e65d0 msgr2=0x5620784e6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.997+0000 7f6628a02740 1 --2- 172.21.15.81:0/1544960408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e65d0 0x5620784e6a10 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f6610006010 tx=0x7f6610005e80 comp rx=0 tx=0).stop 2024-09-12T01:35:58.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.997+0000 7f6628a02740 1 -- 172.21.15.81:0/1544960408 shutdown_connections 2024-09-12T01:35:58.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.997+0000 7f6628a02740 1 --2- 172.21.15.81:0/1544960408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784f1370 0x5620784f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.997+0000 7f6628a02740 1 --2- 172.21.15.81:0/1544960408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e65d0 0x5620784e6a10 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.997+0000 7f6628a02740 1 --2- 172.21.15.81:0/1544960408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e7b40 0x5620784e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.997+0000 7f6628a02740 1 -- 172.21.15.81:0/1544960408 >> 172.21.15.81:0/1544960408 conn(0x5620784af310 msgr2=0x5620784e2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:58.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.997+0000 7f6628a02740 1 -- 172.21.15.81:0/1544960408 shutdown_connections 2024-09-12T01:35:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.997+0000 7f6628a02740 1 -- 172.21.15.81:0/1544960408 wait complete. 2024-09-12T01:35:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.997+0000 7f6628a02740 1 -- start start 2024-09-12T01:35:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.997+0000 7f6628a02740 1 Processor -- start 2024-09-12T01:35:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6628a02740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e65d0 0x5620784f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6628a02740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e7b40 0x5620784edf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6628a02740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 0x5620784ee4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6628a02740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5620784f4010 con 0x5620784f1370 2024-09-12T01:35:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6628a02740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562078407060 con 0x5620784e65d0 2024-09-12T01:35:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6628a02740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5620784f4190 con 0x5620784e7b40 2024-09-12T01:35:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6628a02740 10 client.0 _ll_register_callbacks cb 0x56207815a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6624bc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 0x5620784ee4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6624bc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 0x5620784ee4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47056/0 (socket says 172.21.15.81:47056) 2024-09-12T01:35:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6624bc6640 1 -- 172.21.15.81:0/2763672904 learned_addr learned my addr 172.21.15.81:0/2763672904 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f661ffff640 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e65d0 0x5620784f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f661f7fe640 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e7b40 0x5620784edf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6624bc6640 1 -- 172.21.15.81:0/2763672904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e7b40 msgr2=0x5620784edf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6624bc6640 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e7b40 0x5620784edf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6624bc6640 1 -- 172.21.15.81:0/2763672904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e65d0 msgr2=0x5620784f0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6624bc6640 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e65d0 0x5620784f0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6624bc6640 1 -- 172.21.15.81:0/2763672904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620781bd3c0 con 0x5620784f1370 2024-09-12T01:35:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f661f7fe640 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e7b40 0x5620784edf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f6624bc6640 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 0x5620784ee4f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f6618000f80 tx=0x7f661809b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d851cc8e670676 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f65ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.998+0000 7f65ff7fe640 1 -- 172.21.15.81:0/2763672904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66180a2130 con 0x5620784f1370 2024-09-12T01:35:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f65ff7fe640 1 -- 172.21.15.81:0/2763672904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f66180975f0 con 0x5620784f1370 2024-09-12T01:35:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f6628a02740 1 -- 172.21.15.81:0/2763672904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6610004030 con 0x5620784f1370 2024-09-12T01:35:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f65ff7fe640 1 -- 172.21.15.81:0/2763672904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f66180a3b40 con 0x5620784f1370 2024-09-12T01:35:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f6628a02740 10 client.17259 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f6628a02740 1 -- 172.21.15.81:0/2763672904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620784ffa80 con 0x5620784f1370 2024-09-12T01:35:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f65ff7fe640 1 -- 172.21.15.81:0/2763672904 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6610004030 con 0x5620784f1370 2024-09-12T01:35:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f65ff7fe640 1 -- 172.21.15.81:0/2763672904 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f66180a14c0 con 0x5620784f1370 2024-09-12T01:35:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f6628a02740 10 client.17259 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f6628a02740 10 client.17259 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:35:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f6628a02740 20 client.17259 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f6628a02740 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562078500f30 0x562078503380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f6628a02740 4 client.17259 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:35:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f6628a02740 1 -- 172.21.15.81:0/2763672904 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562078459860 con 0x562078500f30 2024-09-12T01:35:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:57.999+0000 7f661ffff640 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562078500f30 0x562078503380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.000+0000 7f65ff7fe640 10 client.17259 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.000+0000 7f661ffff640 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562078500f30 0x562078503380 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efeb013b9b9395ee server_cookie=bdf0d95626d8e687 in_seq=0 out_seq=0 2024-09-12T01:35:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.000+0000 7f65ff7fe640 1 -- 172.21.15.81:0/2763672904 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562078459860 con 0x562078500f30 2024-09-12T01:35:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.000+0000 7f65ff7fe640 10 client.17259 handle_command_reply: tid=0 2024-09-12T01:35:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.000+0000 7f6628a02740 1 client.17259 shutdown 2024-09-12T01:35:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.001+0000 7f6628a02740 1 -- 172.21.15.81:0/2763672904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 msgr2=0x5620784ee4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.001+0000 7f6628a02740 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 0x5620784ee4f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f6618000f80 tx=0x7f661809b040 comp rx=0 tx=0).stop 2024-09-12T01:35:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.001+0000 7f6628a02740 1 -- 172.21.15.81:0/2763672904 shutdown_connections 2024-09-12T01:35:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.001+0000 7f6628a02740 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562078500f30 0x562078503380 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.001+0000 7f6628a02740 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 0x5620784ee4f0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.001+0000 7f65ff7fe640 0 client.17259 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.001+0000 7f6628a02740 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e7b40 0x5620784edf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.001+0000 7f6628a02740 1 --2- 172.21.15.81:0/2763672904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e65d0 0x5620784f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.001+0000 7f6628a02740 1 -- 172.21.15.81:0/2763672904 >> 172.21.15.81:0/2763672904 conn(0x5620784af310 msgr2=0x5620784e8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.001+0000 7f6628a02740 1 -- 172.21.15.81:0/2763672904 shutdown_connections 2024-09-12T01:35:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.001+0000 7f6628a02740 1 -- 172.21.15.81:0/2763672904 wait complete. 2024-09-12T01:35:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.001+0000 7f6628a02740 20 client.17259 trim_cache size 0 max 16384 2024-09-12T01:35:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6628a02740 1 Processor -- start 2024-09-12T01:35:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6628a02740 1 -- start start 2024-09-12T01:35:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6628a02740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e65d0 0x5620784e2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6628a02740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e7b40 0x5620784fd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6628a02740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 0x562078508c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6628a02740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66201ad850 con 0x5620784f1370 2024-09-12T01:35:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6628a02740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f66201af390 con 0x5620784e7b40 2024-09-12T01:35:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6628a02740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f66201adf20 con 0x5620784e65d0 2024-09-12T01:35:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6624bc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 0x562078508c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6624bc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 0x562078508c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47064/0 (socket says 172.21.15.81:47064) 2024-09-12T01:35:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6624bc6640 1 -- 172.21.15.81:0/3104351890 learned_addr learned my addr 172.21.15.81:0/3104351890 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6624bc6640 1 -- 172.21.15.81:0/3104351890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e65d0 msgr2=0x5620784e2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6624bc6640 1 --2- 172.21.15.81:0/3104351890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e65d0 0x5620784e2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6624bc6640 1 -- 172.21.15.81:0/3104351890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e7b40 msgr2=0x5620784fd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6624bc6640 1 --2- 172.21.15.81:0/3104351890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e7b40 0x5620784fd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6624bc6640 1 -- 172.21.15.81:0/3104351890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620784e62d0 con 0x5620784f1370 2024-09-12T01:35:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6624bc6640 1 --2- 172.21.15.81:0/3104351890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 0x562078508c50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f66180973e0 tx=0x7f6618014d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c4589e9820553 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6605ffb640 1 -- 172.21.15.81:0/3104351890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661807d070 con 0x5620784f1370 2024-09-12T01:35:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6605ffb640 1 -- 172.21.15.81:0/3104351890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6618084120 con 0x5620784f1370 2024-09-12T01:35:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.014+0000 7f6605ffb640 1 -- 172.21.15.81:0/3104351890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66180a36b0 con 0x5620784f1370 2024-09-12T01:35:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.015+0000 7f6628a02740 1 -- 172.21.15.81:0/3104351890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 msgr2=0x562078508c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.015+0000 7f6628a02740 1 --2- 172.21.15.81:0/3104351890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 0x562078508c50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f66180973e0 tx=0x7f6618014d00 comp rx=0 tx=0).stop 2024-09-12T01:35:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.015+0000 7f6628a02740 1 -- 172.21.15.81:0/3104351890 shutdown_connections 2024-09-12T01:35:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.015+0000 7f6628a02740 1 --2- 172.21.15.81:0/3104351890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784f1370 0x562078508c50 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.015+0000 7f6628a02740 1 --2- 172.21.15.81:0/3104351890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784e7b40 0x5620784fd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.015+0000 7f6628a02740 1 --2- 172.21.15.81:0/3104351890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e65d0 0x5620784e2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.015+0000 7f6628a02740 1 -- 172.21.15.81:0/3104351890 >> 172.21.15.81:0/3104351890 conn(0x5620784af310 msgr2=0x5620784e2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.015+0000 7f6628a02740 1 -- 172.21.15.81:0/3104351890 shutdown_connections 2024-09-12T01:35:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.015+0000 7f6628a02740 1 -- 172.21.15.81:0/3104351890 wait complete. 2024-09-12T01:35:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.015+0000 7f6628a02740 1 -- start start 2024-09-12T01:35:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.015+0000 7f6628a02740 1 Processor -- start 2024-09-12T01:35:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f6628a02740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e65d0 0x5620784f99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f6628a02740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e7b40 0x5620784eaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f6628a02740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784f1370 0x5620784eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f6628a02740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66201aecc0 con 0x5620784e7b40 2024-09-12T01:35:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f6628a02740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f66201ae5f0 con 0x5620784f1370 2024-09-12T01:35:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f6628a02740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f66201ab850 con 0x5620784e65d0 2024-09-12T01:35:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f6628a02740 10 client.0 _ll_register_callbacks cb 0x7f6618097220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:35:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f661f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e7b40 0x5620784eaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f661f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e7b40 0x5620784eaa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47080/0 (socket says 172.21.15.81:47080) 2024-09-12T01:35:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f661f7fe640 1 -- 172.21.15.81:0/1586027934 learned_addr learned my addr 172.21.15.81:0/1586027934 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:35:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f6624bc6640 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784f1370 0x5620784eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f661ffff640 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e65d0 0x5620784f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f661f7fe640 1 -- 172.21.15.81:0/1586027934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e65d0 msgr2=0x5620784f99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f661f7fe640 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e65d0 0x5620784f99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f661f7fe640 1 -- 172.21.15.81:0/1586027934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784f1370 msgr2=0x5620784eaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f661f7fe640 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784f1370 0x5620784eaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f661f7fe640 1 -- 172.21.15.81:0/1586027934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620784eb5b0 con 0x5620784e7b40 2024-09-12T01:35:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f661ffff640 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e65d0 0x5620784f99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f6624bc6640 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784f1370 0x5620784eaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f661f7fe640 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e7b40 0x5620784eaa30 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f661400be40 tx=0x7f661400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df46c039bef60aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f65ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:35:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f65ff7fe640 1 -- 172.21.15.81:0/1586027934 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6614012860 con 0x5620784e7b40 2024-09-12T01:35:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f65ff7fe640 1 -- 172.21.15.81:0/1586027934 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f6614012a00 con 0x5620784e7b40 2024-09-12T01:35:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.016+0000 7f6628a02740 1 -- 172.21.15.81:0/1586027934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6618084120 con 0x5620784e7b40 2024-09-12T01:35:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.017+0000 7f65ff7fe640 1 -- 172.21.15.81:0/1586027934 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6614012c00 con 0x5620784e7b40 2024-09-12T01:35:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.017+0000 7f6628a02740 10 client.17265 fetch_fsmap learned FSMap version 28 2024-09-12T01:35:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.017+0000 7f6628a02740 1 -- 172.21.15.81:0/1586027934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56207856bad0 con 0x5620784e7b40 2024-09-12T01:35:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.017+0000 7f65ff7fe640 1 -- 172.21.15.81:0/1586027934 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6618084120 con 0x5620784e7b40 2024-09-12T01:35:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.017+0000 7f65ff7fe640 1 -- 172.21.15.81:0/1586027934 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f661401c040 con 0x5620784e7b40 2024-09-12T01:35:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.017+0000 7f6628a02740 10 client.17265 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:35:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.017+0000 7f6628a02740 10 client.17265 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:35:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.017+0000 7f6628a02740 20 client.17265 populate_metadata read hostname 'smithi081' 2024-09-12T01:35:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.017+0000 7f6628a02740 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56207856c270 0x56207856e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.017+0000 7f6628a02740 4 client.17265 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:35:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.017+0000 7f6628a02740 1 -- 172.21.15.81:0/1586027934 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562078453d70 con 0x56207856c270 2024-09-12T01:35:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.017+0000 7f661ffff640 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56207856c270 0x56207856e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f661ffff640 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56207856c270 0x56207856e690 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dcb42fde00b20b3 server_cookie=7267bd8ca7fd6db5 in_seq=0 out_seq=0 2024-09-12T01:35:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f65ff7fe640 10 client.17265 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f65ff7fe640 1 -- 172.21.15.81:0/1586027934 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562078453d70 con 0x56207856c270 2024-09-12T01:35:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f65ff7fe640 10 client.17265 handle_command_reply: tid=0 2024-09-12T01:35:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f6628a02740 1 client.17265 shutdown 2024-09-12T01:35:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f6628a02740 1 -- 172.21.15.81:0/1586027934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e7b40 msgr2=0x5620784eaa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f6628a02740 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e7b40 0x5620784eaa30 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f661400be40 tx=0x7f661400b8b0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f6628a02740 1 -- 172.21.15.81:0/1586027934 shutdown_connections 2024-09-12T01:35:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f6628a02740 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56207856c270 0x56207856e690 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f65ff7fe640 0 client.17265 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:35:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f6628a02740 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620784f1370 0x5620784eaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f6628a02740 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620784e7b40 0x5620784eaa30 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f6628a02740 1 --2- 172.21.15.81:0/1586027934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5620784e65d0 0x5620784f99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f6628a02740 1 -- 172.21.15.81:0/1586027934 >> 172.21.15.81:0/1586027934 conn(0x5620784af310 msgr2=0x5620784f0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f6628a02740 1 -- 172.21.15.81:0/1586027934 shutdown_connections 2024-09-12T01:35:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f6628a02740 1 -- 172.21.15.81:0/1586027934 wait complete. 2024-09-12T01:35:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.018+0000 7f6628a02740 20 client.17265 trim_cache size 0 max 16384 2024-09-12T01:35:58.039 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:35:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.019+0000 7f6626629640 1 -- 172.21.15.81:0/3448595563 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f66080a2cf0 msgr2=0x7f66080a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.019+0000 7f6626629640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f66080a2cf0 0x7f66080a51b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f66200feae0 tx=0x7f661400b840 comp rx=0 tx=0).stop 2024-09-12T01:35:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.019+0000 7f6626629640 1 -- 172.21.15.81:0/3448595563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6620106a80 msgr2=0x7f662019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.019+0000 7f6626629640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6620106a80 0x7f662019cde0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f661800b970 tx=0x7f661800be30 comp rx=0 tx=0).stop 2024-09-12T01:35:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.019+0000 7f6626629640 1 -- 172.21.15.81:0/3448595563 shutdown_connections 2024-09-12T01:35:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.019+0000 7f6626629640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f66080a2cf0 0x7f66080a51b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.019+0000 7f6626629640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6620106a80 0x7f662019cde0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.019+0000 7f6626629640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6620101420 0x7f6620198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.019+0000 7f6626629640 1 --2- 172.21.15.81:0/3448595563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6620100a80 0x7f6620198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.019+0000 7f6626629640 1 -- 172.21.15.81:0/3448595563 >> 172.21.15.81:0/3448595563 conn(0x7f66200fc7a0 msgr2=0x7f662006a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:58.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.019+0000 7f6626629640 1 -- 172.21.15.81:0/3448595563 shutdown_connections 2024-09-12T01:35:58.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:35:58.019+0000 7f6626629640 1 -- 172.21.15.81:0/3448595563 wait complete. 2024-09-12T01:35:58.041 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:57 smithi189 ceph-mon[35357]: pgmap v241: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:58.041 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:57 smithi100 ceph-mon[35275]: pgmap v241: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:35:59.716 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:35:59.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:35:59.978 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:35:59.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:35:59 smithi081 ceph-mon[30920]: pgmap v242: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:00.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:35:59 smithi100 ceph-mon[35275]: pgmap v242: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:35:59 smithi189 ceph-mon[35357]: pgmap v242: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.477+0000 7f7932df0640 1 -- 172.21.15.81:0/2956110876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c100a80 msgr2=0x7f792c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.477+0000 7f7932df0640 1 --2- 172.21.15.81:0/2956110876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c100a80 0x7f792c100ee0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f7918009930 tx=0x7f791802a420 comp rx=0 tx=0).stop 2024-09-12T01:36:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.477+0000 7f7932df0640 1 -- 172.21.15.81:0/2956110876 shutdown_connections 2024-09-12T01:36:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.477+0000 7f7932df0640 1 --2- 172.21.15.81:0/2956110876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792c101420 0x7f792c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.477+0000 7f7932df0640 1 --2- 172.21.15.81:0/2956110876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c100a80 0x7f792c100ee0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.477+0000 7f7932df0640 1 --2- 172.21.15.81:0/2956110876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f792c106a80 0x7f792c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.477+0000 7f7932df0640 1 -- 172.21.15.81:0/2956110876 >> 172.21.15.81:0/2956110876 conn(0x7f792c0fc7a0 msgr2=0x7f792c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.477+0000 7f7932df0640 1 -- 172.21.15.81:0/2956110876 shutdown_connections 2024-09-12T01:36:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.477+0000 7f7932df0640 1 -- 172.21.15.81:0/2956110876 wait complete. 2024-09-12T01:36:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f7932df0640 1 Processor -- start 2024-09-12T01:36:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f7932df0640 1 -- start start 2024-09-12T01:36:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f7932df0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f792c100a80 0x7f792c0fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f7932df0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792c101420 0x7f792c0fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f7932df0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c106a80 0x7f792c0fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f7932df0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f792c110e80 con 0x7f792c106a80 2024-09-12T01:36:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f7932df0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f792c110d00 con 0x7f792c101420 2024-09-12T01:36:00.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f7932df0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f792c111000 con 0x7f792c100a80 2024-09-12T01:36:00.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f793138d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c106a80 0x7f792c0fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f793138d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c106a80 0x7f792c0fd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47096/0 (socket says 172.21.15.81:47096) 2024-09-12T01:36:00.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f793138d640 1 -- 172.21.15.81:0/1272520157 learned_addr learned my addr 172.21.15.81:0/1272520157 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:00.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f7930b8c640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f792c100a80 0x7f792c0fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f793138d640 1 -- 172.21.15.81:0/1272520157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f792c100a80 msgr2=0x7f792c0fcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f793138d640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f792c100a80 0x7f792c0fcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f793138d640 1 -- 172.21.15.81:0/1272520157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792c101420 msgr2=0x7f792c0fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f792bfff640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792c101420 0x7f792c0fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f793138d640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792c101420 0x7f792c0fd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f793138d640 1 -- 172.21.15.81:0/1272520157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792c1a6900 con 0x7f792c106a80 2024-09-12T01:36:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.478+0000 7f7930b8c640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f792c100a80 0x7f792c0fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.479+0000 7f793138d640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c106a80 0x7f792c0fd7c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f792400eaa0 tx=0x7f792400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.479+0000 7f7929ffb640 1 -- 172.21.15.81:0/1272520157 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792400cdb0 con 0x7f792c106a80 2024-09-12T01:36:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.479+0000 7f7929ffb640 1 -- 172.21.15.81:0/1272520157 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7924005020 con 0x7f792c106a80 2024-09-12T01:36:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.479+0000 7f7932df0640 1 -- 172.21.15.81:0/1272520157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f792c1a6bf0 con 0x7f792c106a80 2024-09-12T01:36:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.479+0000 7f7929ffb640 1 -- 172.21.15.81:0/1272520157 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79240116b0 con 0x7f792c106a80 2024-09-12T01:36:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.479+0000 7f7932df0640 1 -- 172.21.15.81:0/1272520157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f792c1a7130 con 0x7f792c106a80 2024-09-12T01:36:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.481+0000 7f7929ffb640 1 -- 172.21.15.81:0/1272520157 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7924005560 con 0x7f792c106a80 2024-09-12T01:36:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.481+0000 7f79351c9740 1 Processor -- start 2024-09-12T01:36:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.481+0000 7f79351c9740 1 -- start start 2024-09-12T01:36:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f79351c9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e91b60 0x55ad67e91f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f7929ffb640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f791c0a2cf0 0x7f791c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f79351c9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e92480 0x55ad67e9c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f79351c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e9cd40 0x55ad67e9f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f79351c9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ad67df7280 con 0x55ad67e91b60 2024-09-12T01:36:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f79351c9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ad67d9eb10 con 0x55ad67e92480 2024-09-12T01:36:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f79351c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ad67df3240 con 0x55ad67e9cd40 2024-09-12T01:36:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f792bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e91b60 0x55ad67e91f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f7930b8c640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f791c0a2cf0 0x7f791c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f7929ffb640 1 -- 172.21.15.81:0/1272520157 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f79240cf750 con 0x7f792c106a80 2024-09-12T01:36:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f792bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e91b60 0x55ad67e91f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47112/0 (socket says 172.21.15.81:47112) 2024-09-12T01:36:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f792bfff640 1 -- 172.21.15.81:0/4178918081 learned_addr learned my addr 172.21.15.81:0/4178918081 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f792bfff640 1 --2- 172.21.15.81:0/4178918081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e92480 0x55ad67e9c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f793138d640 1 --2- 172.21.15.81:0/4178918081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e9cd40 0x55ad67e9f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f792bfff640 1 -- 172.21.15.81:0/4178918081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e9cd40 msgr2=0x55ad67e9f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:00.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f792bfff640 1 --2- 172.21.15.81:0/4178918081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e9cd40 0x55ad67e9f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f792bfff640 1 -- 172.21.15.81:0/4178918081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e92480 msgr2=0x55ad67e9c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:00.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f792bfff640 1 --2- 172.21.15.81:0/4178918081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e92480 0x55ad67e9c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f792bfff640 1 -- 172.21.15.81:0/4178918081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad67dab1f0 con 0x55ad67e91b60 2024-09-12T01:36:00.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f7930b8c640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f791c0a2cf0 0x7f791c0a51b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f79200058c0 tx=0x7f7920005cb0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f792bfff640 1 --2- 172.21.15.81:0/4178918081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e91b60 0x55ad67e91f40 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x55ad67e8ef50 tx=0x7f7918000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86c418c94d998a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.482+0000 7f7916ffd640 1 -- 172.21.15.81:0/4178918081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918035070 con 0x55ad67e91b60 2024-09-12T01:36:00.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.483+0000 7f7916ffd640 1 -- 172.21.15.81:0/4178918081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7918005070 con 0x55ad67e91b60 2024-09-12T01:36:00.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.483+0000 7f7916ffd640 1 -- 172.21.15.81:0/4178918081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918004920 con 0x55ad67e91b60 2024-09-12T01:36:00.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.483+0000 7f79351c9740 1 -- 172.21.15.81:0/4178918081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e91b60 msgr2=0x55ad67e91f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.483+0000 7f79351c9740 1 --2- 172.21.15.81:0/4178918081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e91b60 0x55ad67e91f40 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x55ad67e8ef50 tx=0x7f7918000bc0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.483+0000 7f79351c9740 1 -- 172.21.15.81:0/4178918081 shutdown_connections 2024-09-12T01:36:00.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.483+0000 7f79351c9740 1 --2- 172.21.15.81:0/4178918081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e9cd40 0x55ad67e9f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.483+0000 7f79351c9740 1 --2- 172.21.15.81:0/4178918081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e92480 0x55ad67e9c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.483+0000 7f79351c9740 1 --2- 172.21.15.81:0/4178918081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e91b60 0x55ad67e91f40 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.483+0000 7f79351c9740 1 -- 172.21.15.81:0/4178918081 >> 172.21.15.81:0/4178918081 conn(0x55ad67e8e0f0 msgr2=0x55ad67e8e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:00.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.483+0000 7f79351c9740 1 -- 172.21.15.81:0/4178918081 shutdown_connections 2024-09-12T01:36:00.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.483+0000 7f79351c9740 1 -- 172.21.15.81:0/4178918081 wait complete. 2024-09-12T01:36:00.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f79351c9740 1 -- start start 2024-09-12T01:36:00.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f79351c9740 1 Processor -- start 2024-09-12T01:36:00.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f79351c9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e91b60 0x55ad67e99ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f79351c9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 0x55ad67e9a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f79351c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e9cd40 0x55ad67e9a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f79351c9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ad67e9f910 con 0x55ad67e92480 2024-09-12T01:36:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f79351c9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ad67db1f10 con 0x55ad67e91b60 2024-09-12T01:36:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f79351c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ad67e9fa90 con 0x55ad67e9cd40 2024-09-12T01:36:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f79351c9740 10 client.0 _ll_register_callbacks cb 0x55ad67d7aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f792bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 0x55ad67e9a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f792bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 0x55ad67e9a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47122/0 (socket says 172.21.15.81:47122) 2024-09-12T01:36:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f792bfff640 1 -- 172.21.15.81:0/1522558225 learned_addr learned my addr 172.21.15.81:0/1522558225 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f7930b8c640 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e91b60 0x55ad67e99ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.484+0000 7f793138d640 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e9cd40 0x55ad67e9a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f792bfff640 1 -- 172.21.15.81:0/1522558225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e9cd40 msgr2=0x55ad67e9a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f792bfff640 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e9cd40 0x55ad67e9a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f792bfff640 1 -- 172.21.15.81:0/1522558225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e91b60 msgr2=0x55ad67e99ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f792bfff640 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e91b60 0x55ad67e99ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f792bfff640 1 -- 172.21.15.81:0/1522558225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad67b686a0 con 0x55ad67e92480 2024-09-12T01:36:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f793138d640 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e9cd40 0x55ad67e9a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f7930b8c640 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e91b60 0x55ad67e99ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f792bfff640 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 0x55ad67e9a1e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f7918009a50 tx=0x7f791802ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb19d0b5cb474a50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f790bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f790bfff640 1 -- 172.21.15.81:0/1522558225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791804e020 con 0x55ad67e92480 2024-09-12T01:36:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f790bfff640 1 -- 172.21.15.81:0/1522558225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f7918004ad0 con 0x55ad67e92480 2024-09-12T01:36:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f79351c9740 1 -- 172.21.15.81:0/1522558225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7918005070 con 0x55ad67e92480 2024-09-12T01:36:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f790bfff640 1 -- 172.21.15.81:0/1522558225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7918059050 con 0x55ad67e92480 2024-09-12T01:36:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f79351c9740 10 client.17277 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:00.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f79351c9740 1 -- 172.21.15.81:0/1522558225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad67eab590 con 0x55ad67e92480 2024-09-12T01:36:00.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.485+0000 7f790bfff640 1 -- 172.21.15.81:0/1522558225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7918005070 con 0x55ad67e92480 2024-09-12T01:36:00.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.486+0000 7f790bfff640 1 -- 172.21.15.81:0/1522558225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f791803a040 con 0x55ad67e92480 2024-09-12T01:36:00.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.486+0000 7f79351c9740 10 client.17277 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:00.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.486+0000 7f79351c9740 10 client.17277 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:36:00.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.486+0000 7f79351c9740 20 client.17277 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:00.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.486+0000 7f79351c9740 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ad67eac8e0 0x55ad67eaecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.486+0000 7f79351c9740 4 client.17277 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:36:00.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.486+0000 7f79351c9740 1 -- 172.21.15.81:0/1522558225 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad67e047f0 con 0x55ad67eac8e0 2024-09-12T01:36:00.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.486+0000 7f7930b8c640 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ad67eac8e0 0x55ad67eaecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.486+0000 7f790bfff640 10 client.17277 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:00.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.486+0000 7f7930b8c640 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ad67eac8e0 0x55ad67eaecd0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=146c23493d543a3 server_cookie=e4f6bb29f11c5523 in_seq=0 out_seq=0 2024-09-12T01:36:00.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f790bfff640 1 -- 172.21.15.81:0/1522558225 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad67e047f0 con 0x55ad67eac8e0 2024-09-12T01:36:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f790bfff640 10 client.17277 handle_command_reply: tid=0 2024-09-12T01:36:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f79351c9740 1 client.17277 shutdown 2024-09-12T01:36:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f79351c9740 1 -- 172.21.15.81:0/1522558225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 msgr2=0x55ad67e9a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f79351c9740 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 0x55ad67e9a1e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f7918009a50 tx=0x7f791802ab60 comp rx=0 tx=0).stop 2024-09-12T01:36:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f79351c9740 1 -- 172.21.15.81:0/1522558225 shutdown_connections 2024-09-12T01:36:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f79351c9740 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ad67eac8e0 0x55ad67eaecd0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f79351c9740 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e9cd40 0x55ad67e9a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f79351c9740 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 0x55ad67e9a1e0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f79351c9740 1 --2- 172.21.15.81:0/1522558225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e91b60 0x55ad67e99ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f79351c9740 1 -- 172.21.15.81:0/1522558225 >> 172.21.15.81:0/1522558225 conn(0x55ad67e8e0f0 msgr2=0x55ad67e93e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f790bfff640 0 client.17277 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f79351c9740 1 -- 172.21.15.81:0/1522558225 shutdown_connections 2024-09-12T01:36:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f79351c9740 1 -- 172.21.15.81:0/1522558225 wait complete. 2024-09-12T01:36:00.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.487+0000 7f79351c9740 20 client.17277 trim_cache size 0 max 16384 2024-09-12T01:36:00.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.504+0000 7f79351c9740 1 Processor -- start 2024-09-12T01:36:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.504+0000 7f79351c9740 1 -- start start 2024-09-12T01:36:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.504+0000 7f79351c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e91b60 0x55ad67e94610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.504+0000 7f79351c9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e92480 0x55ad67e96f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.504+0000 7f79351c9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e9cd40 0x55ad67e97440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f79351c9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f792c1afaa0 con 0x55ad67e9cd40 2024-09-12T01:36:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f79351c9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f792c1b15e0 con 0x55ad67e92480 2024-09-12T01:36:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f79351c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f792c1b0170 con 0x55ad67e91b60 2024-09-12T01:36:00.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f793138d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e9cd40 0x55ad67e97440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f793138d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e9cd40 0x55ad67e97440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47124/0 (socket says 172.21.15.81:47124) 2024-09-12T01:36:00.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f793138d640 1 -- 172.21.15.81:0/727897554 learned_addr learned my addr 172.21.15.81:0/727897554 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:00.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f792bfff640 1 --2- 172.21.15.81:0/727897554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e92480 0x55ad67e96f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f7930b8c640 1 --2- 172.21.15.81:0/727897554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e91b60 0x55ad67e94610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f793138d640 1 -- 172.21.15.81:0/727897554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e91b60 msgr2=0x55ad67e94610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:00.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f793138d640 1 --2- 172.21.15.81:0/727897554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e91b60 0x55ad67e94610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f793138d640 1 -- 172.21.15.81:0/727897554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e92480 msgr2=0x55ad67e96f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:00.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f793138d640 1 --2- 172.21.15.81:0/727897554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e92480 0x55ad67e96f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f793138d640 1 -- 172.21.15.81:0/727897554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad67e89830 con 0x55ad67e9cd40 2024-09-12T01:36:00.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f793138d640 1 --2- 172.21.15.81:0/727897554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e9cd40 0x55ad67e97440 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f7924098640 tx=0x7f792409bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4012b1a3164f0a70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f79167fc640 1 -- 172.21.15.81:0/727897554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792401f040 con 0x55ad67e9cd40 2024-09-12T01:36:00.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f79167fc640 1 -- 172.21.15.81:0/727897554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7924099f70 con 0x55ad67e9cd40 2024-09-12T01:36:00.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.505+0000 7f79167fc640 1 -- 172.21.15.81:0/727897554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79240763e0 con 0x55ad67e9cd40 2024-09-12T01:36:00.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.506+0000 7f79351c9740 1 -- 172.21.15.81:0/727897554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e9cd40 msgr2=0x55ad67e97440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.506+0000 7f79351c9740 1 --2- 172.21.15.81:0/727897554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e9cd40 0x55ad67e97440 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f7924098640 tx=0x7f792409bd30 comp rx=0 tx=0).stop 2024-09-12T01:36:00.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.506+0000 7f79351c9740 1 -- 172.21.15.81:0/727897554 shutdown_connections 2024-09-12T01:36:00.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.506+0000 7f79351c9740 1 --2- 172.21.15.81:0/727897554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e9cd40 0x55ad67e97440 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.506+0000 7f79351c9740 1 --2- 172.21.15.81:0/727897554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e92480 0x55ad67e96f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.506+0000 7f79351c9740 1 --2- 172.21.15.81:0/727897554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e91b60 0x55ad67e94610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.506+0000 7f79351c9740 1 -- 172.21.15.81:0/727897554 >> 172.21.15.81:0/727897554 conn(0x55ad67e8e0f0 msgr2=0x55ad67e98570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:00.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.506+0000 7f79351c9740 1 -- 172.21.15.81:0/727897554 shutdown_connections 2024-09-12T01:36:00.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.506+0000 7f79351c9740 1 -- 172.21.15.81:0/727897554 wait complete. 2024-09-12T01:36:00.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.506+0000 7f79351c9740 1 -- start start 2024-09-12T01:36:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f79351c9740 1 Processor -- start 2024-09-12T01:36:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f79351c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e91b60 0x55ad67eae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f79351c9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 0x55ad67eaee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f79351c9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e9cd40 0x55ad67eaf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f79351c9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f792c1b0f10 con 0x55ad67e92480 2024-09-12T01:36:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f79351c9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f792c1b0840 con 0x55ad67e9cd40 2024-09-12T01:36:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f79351c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f792c1adaa0 con 0x55ad67e91b60 2024-09-12T01:36:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f79351c9740 10 client.0 _ll_register_callbacks cb 0x7f7918041070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f792bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 0x55ad67eaee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f792bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 0x55ad67eaee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47130/0 (socket says 172.21.15.81:47130) 2024-09-12T01:36:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f792bfff640 1 -- 172.21.15.81:0/2655733093 learned_addr learned my addr 172.21.15.81:0/2655733093 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f7930b8c640 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e91b60 0x55ad67eae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f793138d640 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e9cd40 0x55ad67eaf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f792bfff640 1 -- 172.21.15.81:0/2655733093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e91b60 msgr2=0x55ad67eae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f792bfff640 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e91b60 0x55ad67eae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f792bfff640 1 -- 172.21.15.81:0/2655733093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e9cd40 msgr2=0x55ad67eaf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f792bfff640 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e9cd40 0x55ad67eaf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f792bfff640 1 -- 172.21.15.81:0/2655733093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad67f15460 con 0x55ad67e92480 2024-09-12T01:36:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f7930b8c640 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e91b60 0x55ad67eae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.507+0000 7f793138d640 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e9cd40 0x55ad67eaf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f792bfff640 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 0x55ad67eaee20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f79180092a0 tx=0x7f7918005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cd55808c1c3114 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f790bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f790bfff640 1 -- 172.21.15.81:0/2655733093 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791804e040 con 0x55ad67e92480 2024-09-12T01:36:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f790bfff640 1 -- 172.21.15.81:0/2655733093 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7f7918004ad0 con 0x55ad67e92480 2024-09-12T01:36:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f79351c9740 1 -- 172.21.15.81:0/2655733093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7924099f70 con 0x55ad67e92480 2024-09-12T01:36:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f790bfff640 1 -- 172.21.15.81:0/2655733093 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7918035040 con 0x55ad67e92480 2024-09-12T01:36:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f79351c9740 10 client.17283 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f79351c9740 1 -- 172.21.15.81:0/2655733093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad67f16780 con 0x55ad67e92480 2024-09-12T01:36:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f790bfff640 1 -- 172.21.15.81:0/2655733093 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7924099f70 con 0x55ad67e92480 2024-09-12T01:36:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f790bfff640 1 -- 172.21.15.81:0/2655733093 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f791803a070 con 0x55ad67e92480 2024-09-12T01:36:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f79351c9740 10 client.17283 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f79351c9740 10 client.17283 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:36:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f79351c9740 20 client.17283 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f79351c9740 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ad67f16ec0 0x55ad67f192e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f79351c9740 4 client.17283 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:36:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.508+0000 7f79351c9740 1 -- 172.21.15.81:0/2655733093 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ad67dfed00 con 0x55ad67f16ec0 2024-09-12T01:36:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.509+0000 7f7930b8c640 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ad67f16ec0 0x55ad67f192e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.509+0000 7f790bfff640 10 client.17283 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.509+0000 7f7930b8c640 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ad67f16ec0 0x55ad67f192e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=894f60be4f75894f server_cookie=26deaf96b039702c in_seq=0 out_seq=0 2024-09-12T01:36:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f790bfff640 1 -- 172.21.15.81:0/2655733093 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ad67dfed00 con 0x55ad67f16ec0 2024-09-12T01:36:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f790bfff640 10 client.17283 handle_command_reply: tid=0 2024-09-12T01:36:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f79351c9740 1 client.17283 shutdown 2024-09-12T01:36:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f79351c9740 1 -- 172.21.15.81:0/2655733093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 msgr2=0x55ad67eaee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f79351c9740 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 0x55ad67eaee20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f79180092a0 tx=0x7f7918005760 comp rx=0 tx=0).stop 2024-09-12T01:36:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f79351c9740 1 -- 172.21.15.81:0/2655733093 shutdown_connections 2024-09-12T01:36:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f79351c9740 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ad67f16ec0 0x55ad67f192e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f79351c9740 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ad67e9cd40 0x55ad67eaf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f79351c9740 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad67e92480 0x55ad67eaee20 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f79351c9740 1 --2- 172.21.15.81:0/2655733093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ad67e91b60 0x55ad67eae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f790bfff640 0 client.17283 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:00.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f79351c9740 1 -- 172.21.15.81:0/2655733093 >> 172.21.15.81:0/2655733093 conn(0x55ad67e8e0f0 msgr2=0x55ad67e98960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:00.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f79351c9740 1 -- 172.21.15.81:0/2655733093 shutdown_connections 2024-09-12T01:36:00.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.510+0000 7f79351c9740 1 -- 172.21.15.81:0/2655733093 wait complete. 2024-09-12T01:36:00.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.511+0000 7f79351c9740 20 client.17283 trim_cache size 0 max 16384 2024-09-12T01:36:00.516 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:36:00.516 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:36:00.517 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "73fefc63-4002-4f38-9f67-7083cd021853", 2024-09-12T01:36:00.517 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:36:00.517 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:36:00.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.511+0000 7f7932df0640 1 -- 172.21.15.81:0/1272520157 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f791c0a2cf0 msgr2=0x7f791c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.511+0000 7f7932df0640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f791c0a2cf0 0x7f791c0a51b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f79200058c0 tx=0x7f7920005cb0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.511+0000 7f7932df0640 1 -- 172.21.15.81:0/1272520157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c106a80 msgr2=0x7f792c0fd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.511+0000 7f7932df0640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c106a80 0x7f792c0fd7c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f792400eaa0 tx=0x7f792400ef60 comp rx=0 tx=0).stop 2024-09-12T01:36:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.511+0000 7f7932df0640 1 -- 172.21.15.81:0/1272520157 shutdown_connections 2024-09-12T01:36:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.511+0000 7f7932df0640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f791c0a2cf0 0x7f791c0a51b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.511+0000 7f7932df0640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792c106a80 0x7f792c0fd7c0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.511+0000 7f7932df0640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f792c101420 0x7f792c0fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.511+0000 7f7932df0640 1 --2- 172.21.15.81:0/1272520157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f792c100a80 0x7f792c0fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.511+0000 7f7932df0640 1 -- 172.21.15.81:0/1272520157 >> 172.21.15.81:0/1272520157 conn(0x7f792c0fc7a0 msgr2=0x7f792c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.511+0000 7f7932df0640 1 -- 172.21.15.81:0/1272520157 shutdown_connections 2024-09-12T01:36:00.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:00.511+0000 7f7932df0640 1 -- 172.21.15.81:0/1272520157 wait complete. 2024-09-12T01:36:01.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:36:01.412 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:36:01.786 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:01 smithi081 ceph-mon[30920]: pgmap v243: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:36:01.786 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:01 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:36:01.786 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:01 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:36:01.786 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:01 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:36:01.786 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:01 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:36:01.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.867+0000 7fc835b7d640 1 -- 172.21.15.81:0/141816523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc83010c170 msgr2=0x7fc83010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:01.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.867+0000 7fc835b7d640 1 --2- 172.21.15.81:0/141816523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc83010c170 0x7fc83010e610 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fc828009ca0 tx=0x7fc82802a950 comp rx=0 tx=0).stop 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.867+0000 7fc835b7d640 1 -- 172.21.15.81:0/141816523 shutdown_connections 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.867+0000 7fc835b7d640 1 --2- 172.21.15.81:0/141816523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc83010c170 0x7fc83010e610 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.867+0000 7fc835b7d640 1 --2- 172.21.15.81:0/141816523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc830103660 0x7fc83010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.867+0000 7fc835b7d640 1 --2- 172.21.15.81:0/141816523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc830102d40 0x7fc830103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.867+0000 7fc835b7d640 1 -- 172.21.15.81:0/141816523 >> 172.21.15.81:0/141816523 conn(0x7fc8300fc7a0 msgr2=0x7fc8300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.867+0000 7fc835b7d640 1 -- 172.21.15.81:0/141816523 shutdown_connections 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.867+0000 7fc835b7d640 1 -- 172.21.15.81:0/141816523 wait complete. 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.868+0000 7fc835b7d640 1 Processor -- start 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.868+0000 7fc835b7d640 1 -- start start 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.868+0000 7fc835b7d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc830102d40 0x7fc8301009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.868+0000 7fc835b7d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830103660 0x7fc830100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.868+0000 7fc835b7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc83010c170 0x7fc830101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.868+0000 7fc835b7d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc830111fc0 con 0x7fc830103660 2024-09-12T01:36:01.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.868+0000 7fc835b7d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc830111e40 con 0x7fc83010c170 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.868+0000 7fc835b7d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc830112140 con 0x7fc830102d40 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.868+0000 7fc827fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830103660 0x7fc830100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.868+0000 7fc827fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830103660 0x7fc830100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47144/0 (socket says 172.21.15.81:47144) 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.868+0000 7fc827fff640 1 -- 172.21.15.81:0/241752731 learned_addr learned my addr 172.21.15.81:0/241752731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.868+0000 7fc82f7fe640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc830102d40 0x7fc8301009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.869+0000 7fc827fff640 1 -- 172.21.15.81:0/241752731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc830102d40 msgr2=0x7fc8301009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.869+0000 7fc827fff640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc830102d40 0x7fc8301009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.869+0000 7fc82ffff640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc83010c170 0x7fc830101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.869+0000 7fc827fff640 1 -- 172.21.15.81:0/241752731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc83010c170 msgr2=0x7fc830101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.869+0000 7fc827fff640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc83010c170 0x7fc830101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.869+0000 7fc827fff640 1 -- 172.21.15.81:0/241752731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8301a6880 con 0x7fc830103660 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.869+0000 7fc82f7fe640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc830102d40 0x7fc8301009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.869+0000 7fc827fff640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830103660 0x7fc830100ee0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc81800d750 tx=0x7fc81800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.869+0000 7fc82d7fa640 1 -- 172.21.15.81:0/241752731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818017070 con 0x7fc830103660 2024-09-12T01:36:01.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.869+0000 7fc82d7fa640 1 -- 172.21.15.81:0/241752731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc818005020 con 0x7fc830103660 2024-09-12T01:36:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.869+0000 7fc835b7d640 1 -- 172.21.15.81:0/241752731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8301a6b70 con 0x7fc830103660 2024-09-12T01:36:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.869+0000 7fc82d7fa640 1 -- 172.21.15.81:0/241752731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818004d00 con 0x7fc830103660 2024-09-12T01:36:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.869+0000 7fc835b7d640 1 -- 172.21.15.81:0/241752731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8301a70b0 con 0x7fc830103660 2024-09-12T01:36:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.871+0000 7fc82d7fa640 1 -- 172.21.15.81:0/241752731 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc818009a30 con 0x7fc830103660 2024-09-12T01:36:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc837f56740 1 Processor -- start 2024-09-12T01:36:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc837f56740 1 -- start start 2024-09-12T01:36:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc837f56740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600205880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc837f56740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600205dc0 0x562600210140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc837f56740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600210680 0x562600212a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc837f56740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56260016b2e0 con 0x5626002054a0 2024-09-12T01:36:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc837f56740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562600112ce0 con 0x562600210680 2024-09-12T01:36:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc837f56740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5626001672a0 con 0x562600205dc0 2024-09-12T01:36:01.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc82d7fa640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc81c0a2d70 0x7fc81c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc82ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600205880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc82ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600205880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47146/0 (socket says 172.21.15.81:47146) 2024-09-12T01:36:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc82ffff640 1 -- 172.21.15.81:0/3993235285 learned_addr learned my addr 172.21.15.81:0/3993235285 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc82ffff640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc81c0a2d70 0x7fc81c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc82f7fe640 1 --2- 172.21.15.81:0/3993235285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600205dc0 0x562600210140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc82d7fa640 1 -- 172.21.15.81:0/241752731 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fc8180cee90 con 0x7fc830103660 2024-09-12T01:36:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc827fff640 1 --2- 172.21.15.81:0/3993235285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600210680 0x562600212a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc82ffff640 1 -- 172.21.15.81:0/3993235285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600205dc0 msgr2=0x562600210140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc82ffff640 1 --2- 172.21.15.81:0/3993235285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600205dc0 0x562600210140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc82ffff640 1 -- 172.21.15.81:0/3993235285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600210680 msgr2=0x562600212a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc82ffff640 1 --2- 172.21.15.81:0/3993235285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600210680 0x562600212a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc82ffff640 1 -- 172.21.15.81:0/3993235285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626000f7440 con 0x5626002054a0 2024-09-12T01:36:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.872+0000 7fc827fff640 1 --2- 172.21.15.81:0/3993235285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600210680 0x562600212a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.873+0000 7fc82ffff640 1 --2- 172.21.15.81:0/3993235285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600205880 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc828003c10 tx=0x7fc828003c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36644c0b8be898ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.873+0000 7fc82ffff640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc81c0a2d70 0x7fc81c0a5230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc82802ae70 tx=0x7fc828041000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.873+0000 7fc825ffb640 1 -- 172.21.15.81:0/3993235285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82804c070 con 0x5626002054a0 2024-09-12T01:36:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.873+0000 7fc825ffb640 1 -- 172.21.15.81:0/3993235285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc82802fdd0 con 0x5626002054a0 2024-09-12T01:36:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.873+0000 7fc825ffb640 1 -- 172.21.15.81:0/3993235285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828034040 con 0x5626002054a0 2024-09-12T01:36:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.873+0000 7fc837f56740 1 -- 172.21.15.81:0/3993235285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 msgr2=0x562600205880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.873+0000 7fc837f56740 1 --2- 172.21.15.81:0/3993235285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600205880 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc828003c10 tx=0x7fc828003c40 comp rx=0 tx=0).stop 2024-09-12T01:36:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.873+0000 7fc837f56740 1 -- 172.21.15.81:0/3993235285 shutdown_connections 2024-09-12T01:36:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.873+0000 7fc837f56740 1 --2- 172.21.15.81:0/3993235285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600210680 0x562600212a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.873+0000 7fc837f56740 1 --2- 172.21.15.81:0/3993235285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600205dc0 0x562600210140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc837f56740 1 --2- 172.21.15.81:0/3993235285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600205880 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc837f56740 1 -- 172.21.15.81:0/3993235285 >> 172.21.15.81:0/3993235285 conn(0x562600201a30 msgr2=0x562600201e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc837f56740 1 -- 172.21.15.81:0/3993235285 shutdown_connections 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc837f56740 1 -- 172.21.15.81:0/3993235285 wait complete. 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc837f56740 1 -- start start 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc837f56740 1 Processor -- start 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc837f56740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600210040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc837f56740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 0x56260020d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc837f56740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600210680 0x56260020d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc837f56740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562600213250 con 0x5626002054a0 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc837f56740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562600126050 con 0x562600205dc0 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc837f56740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5626002133d0 con 0x562600210680 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc837f56740 10 client.0 _ll_register_callbacks cb 0x562600166160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc82f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600210040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc82f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600210040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47154/0 (socket says 172.21.15.81:47154) 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.874+0000 7fc82f7fe640 1 -- 172.21.15.81:0/2219027453 learned_addr learned my addr 172.21.15.81:0/2219027453 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:01.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc82ffff640 1 --2- 172.21.15.81:0/2219027453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600210680 0x56260020d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc827fff640 1 --2- 172.21.15.81:0/2219027453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 0x56260020d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc82f7fe640 1 -- 172.21.15.81:0/2219027453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600210680 msgr2=0x56260020d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:01.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc82f7fe640 1 --2- 172.21.15.81:0/2219027453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600210680 0x56260020d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc82f7fe640 1 -- 172.21.15.81:0/2219027453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 msgr2=0x56260020d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:01.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc82f7fe640 1 --2- 172.21.15.81:0/2219027453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 0x56260020d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc82f7fe640 1 -- 172.21.15.81:0/2219027453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625ffedc3c0 con 0x5626002054a0 2024-09-12T01:36:01.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc82f7fe640 1 --2- 172.21.15.81:0/2219027453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600210040 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fc820010820 tx=0x7fc820010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f68448aaf38bc1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:01.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc80effd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:01.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc80effd640 1 -- 172.21.15.81:0/2219027453 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82001d060 con 0x5626002054a0 2024-09-12T01:36:01.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc80effd640 1 -- 172.21.15.81:0/2219027453 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fc82000eda0 con 0x5626002054a0 2024-09-12T01:36:01.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc837f56740 1 -- 172.21.15.81:0/2219027453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc82802fdd0 con 0x5626002054a0 2024-09-12T01:36:01.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc80effd640 1 -- 172.21.15.81:0/2219027453 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc820018430 con 0x5626002054a0 2024-09-12T01:36:01.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc837f56740 10 client.17295 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc837f56740 1 -- 172.21.15.81:0/2219027453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56260021ed20 con 0x5626002054a0 2024-09-12T01:36:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc80effd640 1 -- 172.21.15.81:0/2219027453 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc82802fdd0 con 0x5626002054a0 2024-09-12T01:36:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.875+0000 7fc80effd640 1 -- 172.21.15.81:0/2219027453 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc8200207f0 con 0x5626002054a0 2024-09-12T01:36:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.876+0000 7fc837f56740 10 client.17295 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.876+0000 7fc837f56740 10 client.17295 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:36:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.876+0000 7fc837f56740 20 client.17295 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.876+0000 7fc837f56740 1 --2- 172.21.15.81:0/2219027453 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5626002201e0 0x5626002225f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.876+0000 7fc837f56740 4 client.17295 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:36:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.876+0000 7fc837f56740 1 -- 172.21.15.81:0/2219027453 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562600178850 con 0x5626002201e0 2024-09-12T01:36:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.876+0000 7fc827fff640 1 --2- 172.21.15.81:0/2219027453 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5626002201e0 0x5626002225f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.876+0000 7fc827fff640 1 --2- 172.21.15.81:0/2219027453 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5626002201e0 0x5626002225f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eb6e50978147f97 server_cookie=4367ebf729cae623 in_seq=0 out_seq=0 2024-09-12T01:36:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.876+0000 7fc80effd640 10 client.17295 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc80effd640 1 -- 172.21.15.81:0/2219027453 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562600178850 con 0x5626002201e0 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc80effd640 10 client.17295 handle_command_reply: tid=0 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc837f56740 1 client.17295 shutdown 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc837f56740 1 -- 172.21.15.81:0/2219027453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 msgr2=0x562600210040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc837f56740 1 --2- 172.21.15.81:0/2219027453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600210040 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fc820010820 tx=0x7fc820010ce0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc837f56740 1 -- 172.21.15.81:0/2219027453 shutdown_connections 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc837f56740 1 --2- 172.21.15.81:0/2219027453 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5626002201e0 0x5626002225f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc837f56740 1 --2- 172.21.15.81:0/2219027453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600210680 0x56260020d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc837f56740 1 --2- 172.21.15.81:0/2219027453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 0x56260020d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc837f56740 1 --2- 172.21.15.81:0/2219027453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600210040 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc837f56740 1 -- 172.21.15.81:0/2219027453 >> 172.21.15.81:0/2219027453 conn(0x562600201a30 msgr2=0x562600207710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc80effd640 0 client.17295 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc837f56740 1 -- 172.21.15.81:0/2219027453 shutdown_connections 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc837f56740 1 -- 172.21.15.81:0/2219027453 wait complete. 2024-09-12T01:36:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.877+0000 7fc837f56740 20 client.17295 trim_cache size 0 max 16384 2024-09-12T01:36:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.894+0000 7fc837f56740 1 Processor -- start 2024-09-12T01:36:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.894+0000 7fc837f56740 1 -- start start 2024-09-12T01:36:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc837f56740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600200a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc837f56740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 0x562600227ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc837f56740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600210680 0x562600228400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc837f56740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc8301af980 con 0x5626002054a0 2024-09-12T01:36:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc837f56740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc8301b14c0 con 0x562600205dc0 2024-09-12T01:36:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc837f56740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8301b0050 con 0x562600210680 2024-09-12T01:36:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc82f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600200a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc82f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600200a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47162/0 (socket says 172.21.15.81:47162) 2024-09-12T01:36:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc82f7fe640 1 -- 172.21.15.81:0/680479558 learned_addr learned my addr 172.21.15.81:0/680479558 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc827fff640 1 --2- 172.21.15.81:0/680479558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 0x562600227ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc82f7fe640 1 -- 172.21.15.81:0/680479558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600210680 msgr2=0x562600228400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc82f7fe640 1 --2- 172.21.15.81:0/680479558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600210680 0x562600228400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc82f7fe640 1 -- 172.21.15.81:0/680479558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 msgr2=0x562600227ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc82f7fe640 1 --2- 172.21.15.81:0/680479558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 0x562600227ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc82f7fe640 1 -- 172.21.15.81:0/680479558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56260020c2a0 con 0x5626002054a0 2024-09-12T01:36:01.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc827fff640 1 --2- 172.21.15.81:0/680479558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 0x562600227ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:01.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc82f7fe640 1 --2- 172.21.15.81:0/680479558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600200a80 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fc8200058c0 tx=0x7fc820010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee867145bef766 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:01.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc8257fa640 1 -- 172.21.15.81:0/680479558 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82002d020 con 0x5626002054a0 2024-09-12T01:36:01.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc8257fa640 1 -- 172.21.15.81:0/680479558 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc82000eda0 con 0x5626002054a0 2024-09-12T01:36:01.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.895+0000 7fc8257fa640 1 -- 172.21.15.81:0/680479558 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8200056a0 con 0x5626002054a0 2024-09-12T01:36:01.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.896+0000 7fc837f56740 1 -- 172.21.15.81:0/680479558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 msgr2=0x562600200a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:01.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.896+0000 7fc837f56740 1 --2- 172.21.15.81:0/680479558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600200a80 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fc8200058c0 tx=0x7fc820010430 comp rx=0 tx=0).stop 2024-09-12T01:36:01.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.896+0000 7fc837f56740 1 -- 172.21.15.81:0/680479558 shutdown_connections 2024-09-12T01:36:01.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.896+0000 7fc837f56740 1 --2- 172.21.15.81:0/680479558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562600210680 0x562600228400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.896+0000 7fc837f56740 1 --2- 172.21.15.81:0/680479558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 0x562600227ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.896+0000 7fc837f56740 1 --2- 172.21.15.81:0/680479558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626002054a0 0x562600200a80 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.896+0000 7fc837f56740 1 -- 172.21.15.81:0/680479558 >> 172.21.15.81:0/680479558 conn(0x562600201a30 msgr2=0x562600200370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.896+0000 7fc837f56740 1 -- 172.21.15.81:0/680479558 shutdown_connections 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.896+0000 7fc837f56740 1 -- 172.21.15.81:0/680479558 wait complete. 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.896+0000 7fc837f56740 1 -- start start 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc837f56740 1 Processor -- start 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc837f56740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5626002054a0 0x562600215ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc837f56740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 0x562600216410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc837f56740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562600210680 0x562600218420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc837f56740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc8301b0df0 con 0x562600210680 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc837f56740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc8301b0720 con 0x562600205dc0 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc837f56740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8301ad980 con 0x5626002054a0 2024-09-12T01:36:01.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc837f56740 10 client.0 _ll_register_callbacks cb 0x7fc82000b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:01.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc82ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562600210680 0x562600218420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc82ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562600210680 0x562600218420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47174/0 (socket says 172.21.15.81:47174) 2024-09-12T01:36:01.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc82ffff640 1 -- 172.21.15.81:0/3365703427 learned_addr learned my addr 172.21.15.81:0/3365703427 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:01.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc827fff640 1 --2- 172.21.15.81:0/3365703427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 0x562600216410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc82f7fe640 1 --2- 172.21.15.81:0/3365703427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5626002054a0 0x562600215ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc82ffff640 1 -- 172.21.15.81:0/3365703427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5626002054a0 msgr2=0x562600215ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:01.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc82ffff640 1 --2- 172.21.15.81:0/3365703427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5626002054a0 0x562600215ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc82ffff640 1 -- 172.21.15.81:0/3365703427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 msgr2=0x562600216410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:01.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc82ffff640 1 --2- 172.21.15.81:0/3365703427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 0x562600216410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc82ffff640 1 -- 172.21.15.81:0/3365703427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562600218a60 con 0x562600210680 2024-09-12T01:36:01.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc82ffff640 1 --2- 172.21.15.81:0/3365703427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562600210680 0x562600218420 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc828003cb0 tx=0x7fc828030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5951e90f3bf1af33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:01.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.897+0000 7fc80effd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:01.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc80effd640 1 -- 172.21.15.81:0/3365703427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828034070 con 0x562600210680 2024-09-12T01:36:01.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc80effd640 1 -- 172.21.15.81:0/3365703427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8513+0+0 (secure 0 0 0) 0x7fc828004780 con 0x562600210680 2024-09-12T01:36:01.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc837f56740 1 -- 172.21.15.81:0/3365703427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc82000eda0 con 0x562600210680 2024-09-12T01:36:01.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc80effd640 1 -- 172.21.15.81:0/3365703427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc82804c040 con 0x562600210680 2024-09-12T01:36:01.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc837f56740 10 client.17301 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:01.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc837f56740 1 -- 172.21.15.81:0/3365703427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56260028aa30 con 0x562600210680 2024-09-12T01:36:01.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc80effd640 1 -- 172.21.15.81:0/3365703427 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc82000eda0 con 0x562600210680 2024-09-12T01:36:01.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc80effd640 1 -- 172.21.15.81:0/3365703427 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc8280051b0 con 0x562600210680 2024-09-12T01:36:01.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc837f56740 10 client.17301 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:01.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc837f56740 10 client.17301 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:36:01.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc837f56740 20 client.17301 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:01.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc837f56740 1 --2- 172.21.15.81:0/3365703427 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56260028ad80 0x56260028d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:01.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc837f56740 4 client.17301 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc837f56740 1 -- 172.21.15.81:0/3365703427 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562600172d60 con 0x56260028ad80 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.898+0000 7fc82f7fe640 1 --2- 172.21.15.81:0/3365703427 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56260028ad80 0x56260028d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc80effd640 10 client.17301 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc82f7fe640 1 --2- 172.21.15.81:0/3365703427 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56260028ad80 0x56260028d1a0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b922200bfa46328f server_cookie=b78ffc9fbde7afbb in_seq=0 out_seq=0 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc80effd640 1 -- 172.21.15.81:0/3365703427 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562600172d60 con 0x56260028ad80 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc80effd640 10 client.17301 handle_command_reply: tid=0 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc837f56740 1 client.17301 shutdown 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc837f56740 1 -- 172.21.15.81:0/3365703427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562600210680 msgr2=0x562600218420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc837f56740 1 --2- 172.21.15.81:0/3365703427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562600210680 0x562600218420 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc828003cb0 tx=0x7fc828030000 comp rx=0 tx=0).stop 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc837f56740 1 -- 172.21.15.81:0/3365703427 shutdown_connections 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc837f56740 1 --2- 172.21.15.81:0/3365703427 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56260028ad80 0x56260028d1a0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc837f56740 1 --2- 172.21.15.81:0/3365703427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562600210680 0x562600218420 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc837f56740 1 --2- 172.21.15.81:0/3365703427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562600205dc0 0x562600216410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc837f56740 1 --2- 172.21.15.81:0/3365703427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5626002054a0 0x562600215ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc837f56740 1 -- 172.21.15.81:0/3365703427 >> 172.21.15.81:0/3365703427 conn(0x562600201a30 msgr2=0x562600200b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:01.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc80effd640 0 client.17301 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:01.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc837f56740 1 -- 172.21.15.81:0/3365703427 shutdown_connections 2024-09-12T01:36:01.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc837f56740 1 -- 172.21.15.81:0/3365703427 wait complete. 2024-09-12T01:36:01.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.899+0000 7fc837f56740 20 client.17301 trim_cache size 0 max 16384 2024-09-12T01:36:01.906 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:36:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:36:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-12T01:36:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "73fefc63-4002-4f38-9f67-7083cd021853": { 2024-09-12T01:36:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-09-12T01:36:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "73fefc63-4002-4f38-9f67-7083cd021853", 2024-09-12T01:36:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-12T01:36:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:36:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:36:01.907 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:36:01.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.900+0000 7fc835b7d640 1 -- 172.21.15.81:0/241752731 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc81c0a2d70 msgr2=0x7fc81c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:01.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.900+0000 7fc835b7d640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc81c0a2d70 0x7fc81c0a5230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc82802ae70 tx=0x7fc828041000 comp rx=0 tx=0).stop 2024-09-12T01:36:01.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.900+0000 7fc835b7d640 1 -- 172.21.15.81:0/241752731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830103660 msgr2=0x7fc830100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:01.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.900+0000 7fc835b7d640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830103660 0x7fc830100ee0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc81800d750 tx=0x7fc81800dc10 comp rx=0 tx=0).stop 2024-09-12T01:36:01.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.900+0000 7fc835b7d640 1 -- 172.21.15.81:0/241752731 shutdown_connections 2024-09-12T01:36:01.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.900+0000 7fc835b7d640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc81c0a2d70 0x7fc81c0a5230 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.900+0000 7fc835b7d640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc83010c170 0x7fc830101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.900+0000 7fc835b7d640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc830103660 0x7fc830100ee0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.900+0000 7fc835b7d640 1 --2- 172.21.15.81:0/241752731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc830102d40 0x7fc8301009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.900+0000 7fc835b7d640 1 -- 172.21.15.81:0/241752731 >> 172.21.15.81:0/241752731 conn(0x7fc8300fc7a0 msgr2=0x7fc8300fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:01.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.900+0000 7fc835b7d640 1 -- 172.21.15.81:0/241752731 shutdown_connections 2024-09-12T01:36:01.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:01.900+0000 7fc835b7d640 1 -- 172.21.15.81:0/241752731 wait complete. 2024-09-12T01:36:02.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:01 smithi100 ceph-mon[35275]: pgmap v243: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:36:02.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:01 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:36:02.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:01 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:36:02.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:01 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:36:02.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:01 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:36:02.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:01 smithi189 ceph-mon[35357]: pgmap v243: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:36:02.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:01 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:36:02.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:01 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:36:02.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:01 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:36:02.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:01 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:36:02.644 INFO:tasks.cephfs.filesystem:scrub status for tag:73fefc63-4002-4f38-9f67-7083cd021853 - {'path': '/', 'tag': '73fefc63-4002-4f38-9f67-7083cd021853', 'options': 'recursive,force'} 2024-09-12T01:36:03.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:03 smithi081 ceph-mon[30920]: pgmap v244: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:04.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:03 smithi100 ceph-mon[35275]: pgmap v244: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:04.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:03 smithi189 ceph-mon[35357]: pgmap v244: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:05.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:05 smithi081 ceph-mon[30920]: pgmap v245: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:05.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:05 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:36:06.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:05 smithi100 ceph-mon[35275]: pgmap v245: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:06.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:05 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:36:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:05 smithi189 ceph-mon[35357]: pgmap v245: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:06.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:05 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:36:07.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:07 smithi081 ceph-mon[30920]: pgmap v246: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:36:08.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:07 smithi100 ceph-mon[35275]: pgmap v246: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:36:08.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:07 smithi189 ceph-mon[35357]: pgmap v246: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:36:09.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:09 smithi081 ceph-mon[30920]: pgmap v247: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T01:36:10.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:09 smithi100 ceph-mon[35275]: pgmap v247: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T01:36:10.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:09 smithi189 ceph-mon[35357]: pgmap v247: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T01:36:10.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:10 smithi081 ceph-mon[30920]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T01:36:11.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:10 smithi100 ceph-mon[35275]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T01:36:11.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:10 smithi189 ceph-mon[35357]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T01:36:11.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:11 smithi081 ceph-mon[30920]: pgmap v249: 97 pgs: 97 active+clean; 2.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-12T01:36:12.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:11 smithi100 ceph-mon[35275]: pgmap v249: 97 pgs: 97 active+clean; 2.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-12T01:36:12.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:11 smithi189 ceph-mon[35357]: pgmap v249: 97 pgs: 97 active+clean; 2.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-12T01:36:13.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:13 smithi081 ceph-mon[30920]: pgmap v250: 97 pgs: 97 active+clean; 2.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-12T01:36:14.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:13 smithi100 ceph-mon[35275]: pgmap v250: 97 pgs: 97 active+clean; 2.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-12T01:36:14.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:13 smithi189 ceph-mon[35357]: pgmap v250: 97 pgs: 97 active+clean; 2.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-12T01:36:15.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:15 smithi081 ceph-mon[30920]: pgmap v251: 97 pgs: 97 active+clean; 2.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-12T01:36:15.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:15 smithi081 ceph-mon[30920]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T01:36:15.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:15 smithi100 ceph-mon[35275]: pgmap v251: 97 pgs: 97 active+clean; 2.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-12T01:36:15.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:15 smithi100 ceph-mon[35275]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T01:36:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:15 smithi189 ceph-mon[35357]: pgmap v251: 97 pgs: 97 active+clean; 2.0 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-09-12T01:36:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:15 smithi189 ceph-mon[35357]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T01:36:16.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:16 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:36:16.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:16 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:36:16.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:16 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:36:17.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:17 smithi081 ceph-mon[30920]: pgmap v253: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T01:36:17.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:17 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:17.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:17 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:36:17.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:17 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:36:17.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:17 smithi100 ceph-mon[35275]: pgmap v253: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T01:36:17.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:17 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:17.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:17 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:36:17.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:17 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:36:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:17 smithi189 ceph-mon[35357]: pgmap v253: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T01:36:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:17 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:17 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:36:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:17 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:36:19.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:19 smithi081 ceph-mon[30920]: pgmap v254: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2024-09-12T01:36:19.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:19 smithi100 ceph-mon[35275]: pgmap v254: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2024-09-12T01:36:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:19 smithi189 ceph-mon[35357]: pgmap v254: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 249 B/s wr, 12 op/s 2024-09-12T01:36:21.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:21 smithi081 ceph-mon[30920]: pgmap v255: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:36:21.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:21 smithi100 ceph-mon[35275]: pgmap v255: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:36:21.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:21 smithi189 ceph-mon[35357]: pgmap v255: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:36:23.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:23 smithi081 ceph-mon[30920]: pgmap v256: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:36:23.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:23 smithi100 ceph-mon[35275]: pgmap v256: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:36:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:23 smithi189 ceph-mon[35357]: pgmap v256: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:36:25.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:25 smithi081 ceph-mon[30920]: pgmap v257: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:36:25.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:25 smithi100 ceph-mon[35275]: pgmap v257: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:36:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:25 smithi189 ceph-mon[35357]: pgmap v257: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:36:27.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:27 smithi081 ceph-mon[30920]: pgmap v258: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 89 B/s wr, 13 op/s 2024-09-12T01:36:27.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:27 smithi100 ceph-mon[35275]: pgmap v258: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 89 B/s wr, 13 op/s 2024-09-12T01:36:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:27 smithi189 ceph-mon[35357]: pgmap v258: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 89 B/s wr, 13 op/s 2024-09-12T01:36:29.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:29 smithi081 ceph-mon[30920]: pgmap v259: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:29.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:29 smithi100 ceph-mon[35275]: pgmap v259: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:29.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:29 smithi189 ceph-mon[35357]: pgmap v259: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:31.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:31 smithi081 ceph-mon[30920]: pgmap v260: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:36:31.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:31 smithi100 ceph-mon[35275]: pgmap v260: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:36:31.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:31 smithi189 ceph-mon[35357]: pgmap v260: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:36:32.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:36:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:36:33.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.506+0000 7fb08cef5640 1 -- 172.21.15.81:0/3187540483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb088102570 msgr2=0x7fb0881029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.506+0000 7fb08cef5640 1 --2- 172.21.15.81:0/3187540483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb088102570 0x7fb0881029b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009900 tx=0x7fb07c02a480 comp rx=0 tx=0).stop 2024-09-12T01:36:33.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.507+0000 7fb08cef5640 1 -- 172.21.15.81:0/3187540483 shutdown_connections 2024-09-12T01:36:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.507+0000 7fb08cef5640 1 --2- 172.21.15.81:0/3187540483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb088102ef0 0x7fb08810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.507+0000 7fb08cef5640 1 --2- 172.21.15.81:0/3187540483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb088102570 0x7fb0881029b0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.507+0000 7fb08cef5640 1 --2- 172.21.15.81:0/3187540483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb088100e20 0x7fb088101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.507+0000 7fb08cef5640 1 -- 172.21.15.81:0/3187540483 >> 172.21.15.81:0/3187540483 conn(0x7fb0880fc7d0 msgr2=0x7fb0880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.507+0000 7fb08cef5640 1 -- 172.21.15.81:0/3187540483 shutdown_connections 2024-09-12T01:36:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.507+0000 7fb08cef5640 1 -- 172.21.15.81:0/3187540483 wait complete. 2024-09-12T01:36:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.507+0000 7fb08cef5640 1 Processor -- start 2024-09-12T01:36:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.507+0000 7fb08cef5640 1 -- start start 2024-09-12T01:36:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb08cef5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb088100e20 0x7fb08819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb08cef5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb088102570 0x7fb08819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb08cef5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb088102ef0 0x7fb08819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb08cef5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb088110f80 con 0x7fb088102ef0 2024-09-12T01:36:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb08cef5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb088110e00 con 0x7fb088102570 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb08cef5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb088111100 con 0x7fb088100e20 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb086d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb088102ef0 0x7fb08819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb086d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb088102ef0 0x7fb08819efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56200/0 (socket says 172.21.15.81:56200) 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb086d9d640 1 -- 172.21.15.81:0/2862267141 learned_addr learned my addr 172.21.15.81:0/2862267141 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb08659c640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb088100e20 0x7fb08819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb085d9b640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb088102570 0x7fb08819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb086d9d640 1 -- 172.21.15.81:0/2862267141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb088100e20 msgr2=0x7fb08819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb086d9d640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb088100e20 0x7fb08819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb086d9d640 1 -- 172.21.15.81:0/2862267141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb088102570 msgr2=0x7fb08819ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb086d9d640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb088102570 0x7fb08819ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb086d9d640 1 -- 172.21.15.81:0/2862267141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08819f680 con 0x7fb088102ef0 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb08659c640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb088100e20 0x7fb08819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb086d9d640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb088102ef0 0x7fb08819efa0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fb080009fd0 tx=0x7fb08000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.508+0000 7fb0777fe640 1 -- 172.21.15.81:0/2862267141 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080017070 con 0x7fb088102ef0 2024-09-12T01:36:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.509+0000 7fb08cef5640 1 -- 172.21.15.81:0/2862267141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08819f970 con 0x7fb088102ef0 2024-09-12T01:36:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.509+0000 7fb0777fe640 1 -- 172.21.15.81:0/2862267141 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb080003e50 con 0x7fb088102ef0 2024-09-12T01:36:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.509+0000 7fb0777fe640 1 -- 172.21.15.81:0/2862267141 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0800106c0 con 0x7fb088102ef0 2024-09-12T01:36:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.509+0000 7fb08cef5640 1 -- 172.21.15.81:0/2862267141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0881a7250 con 0x7fb088102ef0 2024-09-12T01:36:33.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.511+0000 7fb0777fe640 1 -- 172.21.15.81:0/2862267141 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb080003970 con 0x7fb088102ef0 2024-09-12T01:36:33.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb0777fe640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb0700a2d70 0x7fb0700a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb08f2ce740 1 Processor -- start 2024-09-12T01:36:33.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb08659c640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb0700a2d70 0x7fb0700a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb0777fe640 1 -- 172.21.15.81:0/2862267141 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fb0800cf1b0 con 0x7fb088102ef0 2024-09-12T01:36:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb08f2ce740 1 -- start start 2024-09-12T01:36:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb08f2ce740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178d4a0 0x563fb178d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb08f2ce740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178ddc0 0x563fb1798140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb08f2ce740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb179aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb08f2ce740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563fb16f32e0 con 0x563fb1798680 2024-09-12T01:36:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb08f2ce740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563fb169ace0 con 0x563fb178d4a0 2024-09-12T01:36:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb08f2ce740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563fb16ef2a0 con 0x563fb178ddc0 2024-09-12T01:36:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb086d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb179aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb08659c640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb0700a2d70 0x7fb0700a5230 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb078009fc0 tx=0x7fb078005f90 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb086d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb179aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56210/0 (socket says 172.21.15.81:56210) 2024-09-12T01:36:33.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.512+0000 7fb086d9d640 1 -- 172.21.15.81:0/3264874441 learned_addr learned my addr 172.21.15.81:0/3264874441 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:33.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.513+0000 7fb085d9b640 1 --2- 172.21.15.81:0/3264874441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178ddc0 0x563fb1798140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.513+0000 7fb08659c640 1 --2- 172.21.15.81:0/3264874441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178d4a0 0x563fb178d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.513+0000 7fb086d9d640 1 -- 172.21.15.81:0/3264874441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178ddc0 msgr2=0x563fb1798140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.513+0000 7fb086d9d640 1 --2- 172.21.15.81:0/3264874441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178ddc0 0x563fb1798140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.513+0000 7fb086d9d640 1 -- 172.21.15.81:0/3264874441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178d4a0 msgr2=0x563fb178d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.513+0000 7fb086d9d640 1 --2- 172.21.15.81:0/3264874441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178d4a0 0x563fb178d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.513+0000 7fb086d9d640 1 -- 172.21.15.81:0/3264874441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb167f440 con 0x563fb1798680 2024-09-12T01:36:33.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.513+0000 7fb08659c640 1 --2- 172.21.15.81:0/3264874441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178d4a0 0x563fb178d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:33.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.513+0000 7fb086d9d640 1 --2- 172.21.15.81:0/3264874441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb179aa70 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fb0800a3db0 tx=0x7fb08009b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949d68a2020d88d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.513+0000 7fb074ff9640 1 -- 172.21.15.81:0/3264874441 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080020030 con 0x563fb1798680 2024-09-12T01:36:33.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.513+0000 7fb074ff9640 1 -- 172.21.15.81:0/3264874441 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb08009fa20 con 0x563fb1798680 2024-09-12T01:36:33.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.513+0000 7fb074ff9640 1 -- 172.21.15.81:0/3264874441 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0800ccb20 con 0x563fb1798680 2024-09-12T01:36:33.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.514+0000 7fb08f2ce740 1 -- 172.21.15.81:0/3264874441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 msgr2=0x563fb179aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.514+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/3264874441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb179aa70 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fb0800a3db0 tx=0x7fb08009b620 comp rx=0 tx=0).stop 2024-09-12T01:36:33.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.514+0000 7fb08f2ce740 1 -- 172.21.15.81:0/3264874441 shutdown_connections 2024-09-12T01:36:33.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.514+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/3264874441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb179aa70 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.514+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/3264874441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178ddc0 0x563fb1798140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.514+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/3264874441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178d4a0 0x563fb178d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.514+0000 7fb08f2ce740 1 -- 172.21.15.81:0/3264874441 >> 172.21.15.81:0/3264874441 conn(0x563fb1789a30 msgr2=0x563fb1789e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:33.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.514+0000 7fb08f2ce740 1 -- 172.21.15.81:0/3264874441 shutdown_connections 2024-09-12T01:36:33.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.514+0000 7fb08f2ce740 1 -- 172.21.15.81:0/3264874441 wait complete. 2024-09-12T01:36:33.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb08f2ce740 1 -- start start 2024-09-12T01:36:33.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb08f2ce740 1 Processor -- start 2024-09-12T01:36:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb08f2ce740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 0x563fb1797fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb08f2ce740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb178ddc0 0x563fb1795250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb08f2ce740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb1798680 0x563fb1795790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb08f2ce740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563fb179b1f0 con 0x563fb178ddc0 2024-09-12T01:36:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb08f2ce740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563fb16ae050 con 0x563fb1798680 2024-09-12T01:36:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb08f2ce740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563fb179b370 con 0x563fb178d4a0 2024-09-12T01:36:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb085d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb178ddc0 0x563fb1795250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb08f2ce740 10 client.0 _ll_register_callbacks cb 0x563fb16ee160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb085d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb178ddc0 0x563fb1795250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56214/0 (socket says 172.21.15.81:56214) 2024-09-12T01:36:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb085d9b640 1 -- 172.21.15.81:0/4231463948 learned_addr learned my addr 172.21.15.81:0/4231463948 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb08659c640 1 --2- 172.21.15.81:0/4231463948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 0x563fb1797fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.515+0000 7fb086d9d640 1 --2- 172.21.15.81:0/4231463948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb1798680 0x563fb1795790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.516+0000 7fb085d9b640 1 -- 172.21.15.81:0/4231463948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 msgr2=0x563fb1797fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.516+0000 7fb085d9b640 1 --2- 172.21.15.81:0/4231463948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 0x563fb1797fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.516+0000 7fb085d9b640 1 -- 172.21.15.81:0/4231463948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb1798680 msgr2=0x563fb1795790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.516+0000 7fb085d9b640 1 --2- 172.21.15.81:0/4231463948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb1798680 0x563fb1795790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.516+0000 7fb085d9b640 1 -- 172.21.15.81:0/4231463948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fb14643c0 con 0x563fb178ddc0 2024-09-12T01:36:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.516+0000 7fb085d9b640 1 --2- 172.21.15.81:0/4231463948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb178ddc0 0x563fb1795250 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fb07c02a9a0 tx=0x7fb07c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc06b9774add97b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.516+0000 7fb06dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.516+0000 7fb06dffb640 1 -- 172.21.15.81:0/4231463948 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c035070 con 0x563fb178ddc0 2024-09-12T01:36:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.516+0000 7fb06dffb640 1 -- 172.21.15.81:0/4231463948 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fb07c003a00 con 0x563fb178ddc0 2024-09-12T01:36:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.516+0000 7fb08f2ce740 1 -- 172.21.15.81:0/4231463948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb08009fa20 con 0x563fb178ddc0 2024-09-12T01:36:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.516+0000 7fb06dffb640 1 -- 172.21.15.81:0/4231463948 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb07c003c20 con 0x563fb178ddc0 2024-09-12T01:36:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.516+0000 7fb08f2ce740 10 client.17313 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.516+0000 7fb08f2ce740 1 -- 172.21.15.81:0/4231463948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563fb17a6b70 con 0x563fb178ddc0 2024-09-12T01:36:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.517+0000 7fb06dffb640 1 -- 172.21.15.81:0/4231463948 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb08009fa20 con 0x563fb178ddc0 2024-09-12T01:36:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.517+0000 7fb06dffb640 1 -- 172.21.15.81:0/4231463948 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb07c04e510 con 0x563fb178ddc0 2024-09-12T01:36:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.517+0000 7fb08f2ce740 10 client.17313 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.517+0000 7fb08f2ce740 10 client.17313 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:36:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.517+0000 7fb08f2ce740 20 client.17313 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.517+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/4231463948 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563fb17a7fd0 0x563fb17aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.517+0000 7fb08f2ce740 4 client.17313 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:36:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.517+0000 7fb08f2ce740 1 -- 172.21.15.81:0/4231463948 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fb1700850 con 0x563fb17a7fd0 2024-09-12T01:36:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.518+0000 7fb08659c640 1 --2- 172.21.15.81:0/4231463948 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563fb17a7fd0 0x563fb17aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.518+0000 7fb08659c640 1 --2- 172.21.15.81:0/4231463948 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563fb17a7fd0 0x563fb17aa3f0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b71fb2eba7bb4540 server_cookie=f76dab04a43da09 in_seq=0 out_seq=0 2024-09-12T01:36:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.518+0000 7fb06dffb640 10 client.17313 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb06dffb640 1 -- 172.21.15.81:0/4231463948 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563fb1700850 con 0x563fb17a7fd0 2024-09-12T01:36:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb06dffb640 10 client.17313 handle_command_reply: tid=0 2024-09-12T01:36:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb08f2ce740 1 client.17313 shutdown 2024-09-12T01:36:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb08f2ce740 1 -- 172.21.15.81:0/4231463948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb178ddc0 msgr2=0x563fb1795250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/4231463948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb178ddc0 0x563fb1795250 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fb07c02a9a0 tx=0x7fb07c0042e0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb08f2ce740 1 -- 172.21.15.81:0/4231463948 shutdown_connections 2024-09-12T01:36:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/4231463948 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563fb17a7fd0 0x563fb17aa3f0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/4231463948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb1798680 0x563fb1795790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/4231463948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb178ddc0 0x563fb1795250 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb06dffb640 0 client.17313 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/4231463948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 0x563fb1797fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb08f2ce740 1 -- 172.21.15.81:0/4231463948 >> 172.21.15.81:0/4231463948 conn(0x563fb1789a30 msgr2=0x563fb178f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb08f2ce740 1 -- 172.21.15.81:0/4231463948 shutdown_connections 2024-09-12T01:36:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb08f2ce740 1 -- 172.21.15.81:0/4231463948 wait complete. 2024-09-12T01:36:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.519+0000 7fb08f2ce740 20 client.17313 trim_cache size 0 max 16384 2024-09-12T01:36:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.536+0000 7fb08f2ce740 1 Processor -- start 2024-09-12T01:36:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.536+0000 7fb08f2ce740 1 -- start start 2024-09-12T01:36:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.536+0000 7fb08f2ce740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 0x563fb17a4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.536+0000 7fb08f2ce740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178ddc0 0x563fb17afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.536+0000 7fb08f2ce740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb17b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.536+0000 7fb08f2ce740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0881afa30 con 0x563fb1798680 2024-09-12T01:36:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.536+0000 7fb08f2ce740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb0881b1570 con 0x563fb178ddc0 2024-09-12T01:36:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.536+0000 7fb08f2ce740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb0881b0100 con 0x563fb178d4a0 2024-09-12T01:36:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.537+0000 7fb086d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb17b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.537+0000 7fb086d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb17b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56230/0 (socket says 172.21.15.81:56230) 2024-09-12T01:36:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.537+0000 7fb086d9d640 1 -- 172.21.15.81:0/3212571273 learned_addr learned my addr 172.21.15.81:0/3212571273 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.537+0000 7fb085d9b640 1 --2- 172.21.15.81:0/3212571273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178ddc0 0x563fb17afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.537+0000 7fb08659c640 1 --2- 172.21.15.81:0/3212571273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 0x563fb17a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.537+0000 7fb085d9b640 1 -- 172.21.15.81:0/3212571273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 msgr2=0x563fb17a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.537+0000 7fb085d9b640 1 --2- 172.21.15.81:0/3212571273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 0x563fb17a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.537+0000 7fb085d9b640 1 -- 172.21.15.81:0/3212571273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 msgr2=0x563fb17b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.537+0000 7fb085d9b640 1 --2- 172.21.15.81:0/3212571273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb17b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.537+0000 7fb085d9b640 1 -- 172.21.15.81:0/3212571273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb1790e50 con 0x563fb178ddc0 2024-09-12T01:36:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.537+0000 7fb086d9d640 1 --2- 172.21.15.81:0/3212571273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb17b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.537+0000 7fb085d9b640 1 --2- 172.21.15.81:0/3212571273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178ddc0 0x563fb17afcc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009900 tx=0x7fb07c02a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b525351066ee617 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.538+0000 7fb06ffff640 1 -- 172.21.15.81:0/3212571273 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c035040 con 0x563fb178ddc0 2024-09-12T01:36:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.538+0000 7fb06ffff640 1 -- 172.21.15.81:0/3212571273 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb07c053020 con 0x563fb178ddc0 2024-09-12T01:36:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.538+0000 7fb06ffff640 1 -- 172.21.15.81:0/3212571273 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c04e480 con 0x563fb178ddc0 2024-09-12T01:36:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.538+0000 7fb08f2ce740 1 -- 172.21.15.81:0/3212571273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178ddc0 msgr2=0x563fb17afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.538+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/3212571273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178ddc0 0x563fb17afcc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009900 tx=0x7fb07c02a480 comp rx=0 tx=0).stop 2024-09-12T01:36:33.539 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:33 smithi081 ceph-mon[30920]: pgmap v261: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.538+0000 7fb08f2ce740 1 -- 172.21.15.81:0/3212571273 shutdown_connections 2024-09-12T01:36:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.538+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/3212571273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb17b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.538+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/3212571273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178ddc0 0x563fb17afcc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.538+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/3212571273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 0x563fb17a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.538+0000 7fb08f2ce740 1 -- 172.21.15.81:0/3212571273 >> 172.21.15.81:0/3212571273 conn(0x563fb1789a30 msgr2=0x563fb1794340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.539+0000 7fb08f2ce740 1 -- 172.21.15.81:0/3212571273 shutdown_connections 2024-09-12T01:36:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.539+0000 7fb08f2ce740 1 -- 172.21.15.81:0/3212571273 wait complete. 2024-09-12T01:36:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.539+0000 7fb08f2ce740 1 -- start start 2024-09-12T01:36:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.539+0000 7fb08f2ce740 1 Processor -- start 2024-09-12T01:36:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.539+0000 7fb08f2ce740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 0x563fb17a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.539+0000 7fb08f2ce740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178ddc0 0x563fb179be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.539+0000 7fb08f2ce740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb179c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.539+0000 7fb08f2ce740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0881b0ea0 con 0x563fb1798680 2024-09-12T01:36:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.539+0000 7fb08f2ce740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb0881b07d0 con 0x563fb178ddc0 2024-09-12T01:36:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.539+0000 7fb08f2ce740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb0881ada30 con 0x563fb178d4a0 2024-09-12T01:36:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.539+0000 7fb08f2ce740 10 client.0 _ll_register_callbacks cb 0x7fb07c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb086d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb179c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb085d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178ddc0 0x563fb179be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb085d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178ddc0 0x563fb179be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:37946/0 (socket says 172.21.15.81:37946) 2024-09-12T01:36:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb085d9b640 1 -- 172.21.15.81:0/1069478007 learned_addr learned my addr 172.21.15.81:0/1069478007 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb086d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb179c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56236/0 (socket says 172.21.15.81:56236) 2024-09-12T01:36:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb08659c640 1 --2- 172.21.15.81:0/1069478007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 0x563fb17a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb086d9d640 1 -- 172.21.15.81:0/1069478007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 msgr2=0x563fb17a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb086d9d640 1 --2- 172.21.15.81:0/1069478007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 0x563fb17a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb086d9d640 1 -- 172.21.15.81:0/1069478007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178ddc0 msgr2=0x563fb179be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb086d9d640 1 --2- 172.21.15.81:0/1069478007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178ddc0 0x563fb179be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb086d9d640 1 -- 172.21.15.81:0/1069478007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fb1798310 con 0x563fb1798680 2024-09-12T01:36:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb08659c640 1 --2- 172.21.15.81:0/1069478007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 0x563fb17a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb086d9d640 1 --2- 172.21.15.81:0/1069478007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb179c340 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fb08009b6b0 tx=0x7fb080009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7145f72f8e4c0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb06dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb06dffb640 1 -- 172.21.15.81:0/1069478007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0800b3070 con 0x563fb1798680 2024-09-12T01:36:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb06dffb640 1 -- 172.21.15.81:0/1069478007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fb08007a1a0 con 0x563fb1798680 2024-09-12T01:36:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.540+0000 7fb08f2ce740 1 -- 172.21.15.81:0/1069478007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb07c053020 con 0x563fb1798680 2024-09-12T01:36:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.541+0000 7fb06dffb640 1 -- 172.21.15.81:0/1069478007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb080020040 con 0x563fb1798680 2024-09-12T01:36:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.541+0000 7fb08f2ce740 10 client.17319 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.541+0000 7fb08f2ce740 1 -- 172.21.15.81:0/1069478007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563fb1812840 con 0x563fb1798680 2024-09-12T01:36:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.541+0000 7fb06dffb640 1 -- 172.21.15.81:0/1069478007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb07c053020 con 0x563fb1798680 2024-09-12T01:36:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.541+0000 7fb06dffb640 1 -- 172.21.15.81:0/1069478007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb0800ccb20 con 0x563fb1798680 2024-09-12T01:36:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.541+0000 7fb08f2ce740 10 client.17319 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.541+0000 7fb08f2ce740 10 client.17319 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:36:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.541+0000 7fb08f2ce740 20 client.17319 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.541+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/1069478007 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563fb1812b30 0x563fb1814f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.541+0000 7fb08f2ce740 4 client.17319 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:36:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.541+0000 7fb08f2ce740 1 -- 172.21.15.81:0/1069478007 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563fb16fad60 con 0x563fb1812b30 2024-09-12T01:36:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.541+0000 7fb08659c640 1 --2- 172.21.15.81:0/1069478007 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563fb1812b30 0x563fb1814f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb08659c640 1 --2- 172.21.15.81:0/1069478007 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563fb1812b30 0x563fb1814f20 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28dce9205b277076 server_cookie=b6e4a0d6dc674bf1 in_seq=0 out_seq=0 2024-09-12T01:36:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb06dffb640 10 client.17319 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb06dffb640 1 -- 172.21.15.81:0/1069478007 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563fb16fad60 con 0x563fb1812b30 2024-09-12T01:36:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb06dffb640 10 client.17319 handle_command_reply: tid=0 2024-09-12T01:36:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb08f2ce740 1 client.17319 shutdown 2024-09-12T01:36:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb08f2ce740 1 -- 172.21.15.81:0/1069478007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 msgr2=0x563fb179c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/1069478007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb179c340 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fb08009b6b0 tx=0x7fb080009940 comp rx=0 tx=0).stop 2024-09-12T01:36:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb08f2ce740 1 -- 172.21.15.81:0/1069478007 shutdown_connections 2024-09-12T01:36:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/1069478007 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563fb1812b30 0x563fb1814f20 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/1069478007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fb1798680 0x563fb179c340 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/1069478007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fb178ddc0 0x563fb179be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb08f2ce740 1 --2- 172.21.15.81:0/1069478007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb178d4a0 0x563fb17a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb08f2ce740 1 -- 172.21.15.81:0/1069478007 >> 172.21.15.81:0/1069478007 conn(0x563fb1789a30 msgr2=0x563fb1788350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb06dffb640 0 client.17319 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb08f2ce740 1 -- 172.21.15.81:0/1069478007 shutdown_connections 2024-09-12T01:36:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb08f2ce740 1 -- 172.21.15.81:0/1069478007 wait complete. 2024-09-12T01:36:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.542+0000 7fb08f2ce740 20 client.17319 trim_cache size 0 max 16384 2024-09-12T01:36:33.548 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:36:33.548 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:36:33.548 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:36:33.548 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:36:33.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.543+0000 7fb08cef5640 1 -- 172.21.15.81:0/2862267141 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb0700a2d70 msgr2=0x7fb0700a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.543+0000 7fb08cef5640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb0700a2d70 0x7fb0700a5230 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb078009fc0 tx=0x7fb078005f90 comp rx=0 tx=0).stop 2024-09-12T01:36:33.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.543+0000 7fb08cef5640 1 -- 172.21.15.81:0/2862267141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb088102ef0 msgr2=0x7fb08819efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.543+0000 7fb08cef5640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb088102ef0 0x7fb08819efa0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fb080009fd0 tx=0x7fb08000b260 comp rx=0 tx=0).stop 2024-09-12T01:36:33.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.543+0000 7fb08cef5640 1 -- 172.21.15.81:0/2862267141 shutdown_connections 2024-09-12T01:36:33.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.543+0000 7fb08cef5640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fb0700a2d70 0x7fb0700a5230 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.543+0000 7fb08cef5640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb088102ef0 0x7fb08819efa0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.543+0000 7fb08cef5640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb088102570 0x7fb08819ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.543+0000 7fb08cef5640 1 --2- 172.21.15.81:0/2862267141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb088100e20 0x7fb08819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.543+0000 7fb08cef5640 1 -- 172.21.15.81:0/2862267141 >> 172.21.15.81:0/2862267141 conn(0x7fb0880fc7d0 msgr2=0x7fb08806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:33.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.543+0000 7fb08cef5640 1 -- 172.21.15.81:0/2862267141 shutdown_connections 2024-09-12T01:36:33.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:33.543+0000 7fb08cef5640 1 -- 172.21.15.81:0/2862267141 wait complete. 2024-09-12T01:36:33.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:33 smithi100 ceph-mon[35275]: pgmap v261: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:33.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:33 smithi189 ceph-mon[35357]: pgmap v261: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:34.287 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:36:34.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:36:34.545 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:36:35.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.051+0000 7f87e09cd640 1 -- 172.21.15.81:0/4227675302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87dc102d30 msgr2=0x7f87dc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.051+0000 7f87e09cd640 1 --2- 172.21.15.81:0/4227675302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87dc102d30 0x7f87dc103110 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009cd0 tx=0x7f87cc02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.051+0000 7f87e09cd640 1 -- 172.21.15.81:0/4227675302 shutdown_connections 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.051+0000 7f87e09cd640 1 --2- 172.21.15.81:0/4227675302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87dc1082a0 0x7f87dc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.051+0000 7f87e09cd640 1 --2- 172.21.15.81:0/4227675302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87dc1036e0 0x7f87dc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.051+0000 7f87e09cd640 1 --2- 172.21.15.81:0/4227675302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87dc102d30 0x7f87dc103110 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.051+0000 7f87e09cd640 1 -- 172.21.15.81:0/4227675302 >> 172.21.15.81:0/4227675302 conn(0x7f87dc0fc7d0 msgr2=0x7f87dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.051+0000 7f87e09cd640 1 -- 172.21.15.81:0/4227675302 shutdown_connections 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.051+0000 7f87e09cd640 1 -- 172.21.15.81:0/4227675302 wait complete. 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87e09cd640 1 Processor -- start 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87e09cd640 1 -- start start 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87e09cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87dc102d30 0x7f87dc198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87e09cd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87dc1036e0 0x7f87dc198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87e09cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87dc1082a0 0x7f87dc19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87e09cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f87dc112100 con 0x7f87dc1082a0 2024-09-12T01:36:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87e09cd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f87dc111f80 con 0x7f87dc102d30 2024-09-12T01:36:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87e09cd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f87dc112280 con 0x7f87dc1036e0 2024-09-12T01:36:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87dad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87dc1082a0 0x7f87dc19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87dad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87dc1082a0 0x7f87dc19ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56254/0 (socket says 172.21.15.81:56254) 2024-09-12T01:36:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87dad9d640 1 -- 172.21.15.81:0/3420571120 learned_addr learned my addr 172.21.15.81:0/3420571120 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87da59c640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87dc102d30 0x7f87dc198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87dad9d640 1 -- 172.21.15.81:0/3420571120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87dc1036e0 msgr2=0x7f87dc198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87d9d9b640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87dc1036e0 0x7f87dc198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87dad9d640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87dc1036e0 0x7f87dc198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87dad9d640 1 -- 172.21.15.81:0/3420571120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87dc102d30 msgr2=0x7f87dc198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:35.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87dad9d640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87dc102d30 0x7f87dc198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87dad9d640 1 -- 172.21.15.81:0/3420571120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87dc19d5b0 con 0x7f87dc1082a0 2024-09-12T01:36:35.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87da59c640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87dc102d30 0x7f87dc198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:35.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.052+0000 7f87d9d9b640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87dc1036e0 0x7f87dc198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:35.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.053+0000 7f87dad9d640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87dc1082a0 0x7f87dc19ced0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009fd0 tx=0x7f87d400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:35.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.053+0000 7f87d37fe640 1 -- 172.21.15.81:0/3420571120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4011830 con 0x7f87dc1082a0 2024-09-12T01:36:35.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.053+0000 7f87d37fe640 1 -- 172.21.15.81:0/3420571120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d4016070 con 0x7f87dc1082a0 2024-09-12T01:36:35.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.053+0000 7f87d37fe640 1 -- 172.21.15.81:0/3420571120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d400f2e0 con 0x7f87dc1082a0 2024-09-12T01:36:35.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.053+0000 7f87e09cd640 1 -- 172.21.15.81:0/3420571120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87dc19d8a0 con 0x7f87dc1082a0 2024-09-12T01:36:35.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.053+0000 7f87e09cd640 1 -- 172.21.15.81:0/3420571120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87dc1a5180 con 0x7f87dc1082a0 2024-09-12T01:36:35.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.054+0000 7f87e09cd640 1 -- 172.21.15.81:0/3420571120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87dc06a850 con 0x7f87dc1082a0 2024-09-12T01:36:35.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.055+0000 7f87d37fe640 1 -- 172.21.15.81:0/3420571120 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f87d40119d0 con 0x7f87dc1082a0 2024-09-12T01:36:35.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.056+0000 7f87d37fe640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f87c80a2cf0 0x7f87c80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:35.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.056+0000 7f87da59c640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f87c80a2cf0 0x7f87c80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:35.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.056+0000 7f87d37fe640 1 -- 172.21.15.81:0/3420571120 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f87d40cea20 con 0x7f87dc1082a0 2024-09-12T01:36:35.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.056+0000 7f87da59c640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f87c80a2cf0 0x7f87c80a51b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f87cc000f80 tx=0x7f87cc031510 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:35.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.060+0000 7f87d37fe640 1 -- 172.21.15.81:0/3420571120 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f87d409b750 con 0x7f87dc1082a0 2024-09-12T01:36:35.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.261+0000 7f87e09cd640 1 -- 172.21.15.81:0/3420571120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87dc10a2b0 con 0x7f87dc1082a0 2024-09-12T01:36:35.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.261+0000 7f87d37fe640 1 -- 172.21.15.81:0/3420571120 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f87d409b050 con 0x7f87dc1082a0 2024-09-12T01:36:35.261 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:36:35.261 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:36:35.261 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:36:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.263+0000 7f87e09cd640 1 -- 172.21.15.81:0/3420571120 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f87c80a2cf0 msgr2=0x7f87c80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.263+0000 7f87e09cd640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f87c80a2cf0 0x7f87c80a51b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f87cc000f80 tx=0x7f87cc031510 comp rx=0 tx=0).stop 2024-09-12T01:36:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.263+0000 7f87e09cd640 1 -- 172.21.15.81:0/3420571120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87dc1082a0 msgr2=0x7f87dc19ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.263+0000 7f87e09cd640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87dc1082a0 0x7f87dc19ced0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009fd0 tx=0x7f87d400b8e0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.263+0000 7f87e09cd640 1 -- 172.21.15.81:0/3420571120 shutdown_connections 2024-09-12T01:36:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.263+0000 7f87e09cd640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f87c80a2cf0 0x7f87c80a51b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.263+0000 7f87e09cd640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87dc1082a0 0x7f87dc19ced0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.263+0000 7f87e09cd640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87dc1036e0 0x7f87dc198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.263+0000 7f87e09cd640 1 --2- 172.21.15.81:0/3420571120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87dc102d30 0x7f87dc198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.263+0000 7f87e09cd640 1 -- 172.21.15.81:0/3420571120 >> 172.21.15.81:0/3420571120 conn(0x7f87dc0fc7d0 msgr2=0x7f87dc105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.264+0000 7f87e09cd640 1 -- 172.21.15.81:0/3420571120 shutdown_connections 2024-09-12T01:36:35.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:35.264+0000 7f87e09cd640 1 -- 172.21.15.81:0/3420571120 wait complete. 2024-09-12T01:36:35.583 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:35 smithi081 ceph-mon[30920]: pgmap v262: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:35.583 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:35 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3420571120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:36:35.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:35 smithi100 ceph-mon[35275]: pgmap v262: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:35.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:35 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3420571120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:36:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:35 smithi189 ceph-mon[35357]: pgmap v262: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:35.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:35 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3420571120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:36:35.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:36:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:36:36.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.596+0000 7fe2be851640 1 -- 172.21.15.81:0/701900259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b8102d20 msgr2=0x7fe2b8103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.596+0000 7fe2be851640 1 --2- 172.21.15.81:0/701900259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b8102d20 0x7fe2b8103100 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009900 tx=0x7fe2a802a480 comp rx=0 tx=0).stop 2024-09-12T01:36:36.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.596+0000 7fe2be851640 1 -- 172.21.15.81:0/701900259 shutdown_connections 2024-09-12T01:36:36.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.596+0000 7fe2be851640 1 --2- 172.21.15.81:0/701900259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b810c150 0x7fe2b810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.596+0000 7fe2be851640 1 --2- 172.21.15.81:0/701900259 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2b8103640 0x7fe2b810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.596+0000 7fe2be851640 1 --2- 172.21.15.81:0/701900259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b8102d20 0x7fe2b8103100 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.596+0000 7fe2be851640 1 -- 172.21.15.81:0/701900259 >> 172.21.15.81:0/701900259 conn(0x7fe2b80fc780 msgr2=0x7fe2b80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:36.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.596+0000 7fe2be851640 1 -- 172.21.15.81:0/701900259 shutdown_connections 2024-09-12T01:36:36.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.596+0000 7fe2be851640 1 -- 172.21.15.81:0/701900259 wait complete. 2024-09-12T01:36:36.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2be851640 1 Processor -- start 2024-09-12T01:36:36.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2be851640 1 -- start start 2024-09-12T01:36:36.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2be851640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2b8102d20 0x7fe2b8100980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2be851640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b8103640 0x7fe2b8100ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2be851640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b810c150 0x7fe2b8101400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2be851640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b8111f90 con 0x7fe2b810c150 2024-09-12T01:36:36.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2be851640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b8111e10 con 0x7fe2b8103640 2024-09-12T01:36:36.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2be851640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b8112110 con 0x7fe2b8102d20 2024-09-12T01:36:36.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2bcdee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b810c150 0x7fe2b8101400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2bcdee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b810c150 0x7fe2b8101400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56278/0 (socket says 172.21.15.81:56278) 2024-09-12T01:36:36.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2bcdee640 1 -- 172.21.15.81:0/83351852 learned_addr learned my addr 172.21.15.81:0/83351852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:36.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2affff640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b8103640 0x7fe2b8100ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2bcdee640 1 -- 172.21.15.81:0/83351852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2b8102d20 msgr2=0x7fe2b8100980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2bcdee640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2b8102d20 0x7fe2b8100980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2bcdee640 1 -- 172.21.15.81:0/83351852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b8103640 msgr2=0x7fe2b8100ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2bcdee640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b8103640 0x7fe2b8100ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2bcdee640 1 -- 172.21.15.81:0/83351852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b81a69a0 con 0x7fe2b810c150 2024-09-12T01:36:36.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2affff640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b8103640 0x7fe2b8100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:36.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.597+0000 7fe2bcdee640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b810c150 0x7fe2b8101400 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000cad0 tx=0x7fe2b000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:36.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.598+0000 7fe2b5ffb640 1 -- 172.21.15.81:0/83351852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000ae20 con 0x7fe2b810c150 2024-09-12T01:36:36.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.598+0000 7fe2be851640 1 -- 172.21.15.81:0/83351852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b81a6c90 con 0x7fe2b810c150 2024-09-12T01:36:36.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.598+0000 7fe2b5ffb640 1 -- 172.21.15.81:0/83351852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2b0005020 con 0x7fe2b810c150 2024-09-12T01:36:36.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.598+0000 7fe2b5ffb640 1 -- 172.21.15.81:0/83351852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000f6f0 con 0x7fe2b810c150 2024-09-12T01:36:36.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.598+0000 7fe2be851640 1 -- 172.21.15.81:0/83351852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b81a71d0 con 0x7fe2b810c150 2024-09-12T01:36:36.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.600+0000 7fe2b5ffb640 1 -- 172.21.15.81:0/83351852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fe2b00051d0 con 0x7fe2b810c150 2024-09-12T01:36:36.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.600+0000 7fe2c0c2a740 1 Processor -- start 2024-09-12T01:36:36.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.600+0000 7fe2c0c2a740 1 -- start start 2024-09-12T01:36:36.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.600+0000 7fe2c0c2a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378efb40 0x55dd378ee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.600+0000 7fe2c0c2a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 0x55dd378eea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.600+0000 7fe2c0c2a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 0x55dd378fb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.600+0000 7fe2c0c2a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dd378542f0 con 0x55dd378ee5d0 2024-09-12T01:36:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.600+0000 7fe2c0c2a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55dd377fbcf0 con 0x55dd378f9370 2024-09-12T01:36:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.600+0000 7fe2c0c2a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dd378502b0 con 0x55dd378efb40 2024-09-12T01:36:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2b5ffb640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe2a40a2cf0 0x7fe2a40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 0x55dd378eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 0x55dd378eea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56290/0 (socket says 172.21.15.81:56290) 2024-09-12T01:36:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2b7fff640 1 -- 172.21.15.81:0/821241212 learned_addr learned my addr 172.21.15.81:0/821241212 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2affff640 1 --2- 172.21.15.81:0/821241212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378efb40 0x55dd378ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2bcdee640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe2a40a2cf0 0x7fe2a40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2b5ffb640 1 -- 172.21.15.81:0/83351852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fe2b00cf5c0 con 0x7fe2b810c150 2024-09-12T01:36:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2affff640 1 --2- 172.21.15.81:0/821241212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 0x55dd378fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2b7fff640 1 -- 172.21.15.81:0/821241212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378efb40 msgr2=0x55dd378ee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:36.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2b7fff640 1 --2- 172.21.15.81:0/821241212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378efb40 0x55dd378ee090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2b7fff640 1 -- 172.21.15.81:0/821241212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 msgr2=0x55dd378fb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:36.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2b7fff640 1 --2- 172.21.15.81:0/821241212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 0x55dd378fb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2b7fff640 1 -- 172.21.15.81:0/821241212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd377e03a0 con 0x55dd378ee5d0 2024-09-12T01:36:36.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2b7fff640 1 --2- 172.21.15.81:0/821241212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 0x55dd378eea10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8005e80 tx=0x7fe2a8031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd9615d1dbb73 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:36.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2bcdee640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe2a40a2cf0 0x7fe2a40a51b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe2b009b7e0 tx=0x7fe2b0005960 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:36.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2ae7fc640 1 -- 172.21.15.81:0/821241212 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a803e030 con 0x55dd378ee5d0 2024-09-12T01:36:36.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2ae7fc640 1 -- 172.21.15.81:0/821241212 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2a8004050 con 0x55dd378ee5d0 2024-09-12T01:36:36.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.601+0000 7fe2ae7fc640 1 -- 172.21.15.81:0/821241212 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8035040 con 0x55dd378ee5d0 2024-09-12T01:36:36.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.602+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/821241212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 msgr2=0x55dd378eea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.602+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/821241212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 0x55dd378eea10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8005e80 tx=0x7fe2a8031510 comp rx=0 tx=0).stop 2024-09-12T01:36:36.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.602+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/821241212 shutdown_connections 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.602+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/821241212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 0x55dd378fb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.602+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/821241212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 0x55dd378eea10 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.602+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/821241212 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378efb40 0x55dd378ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.602+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/821241212 >> 172.21.15.81:0/821241212 conn(0x55dd378b7310 msgr2=0x55dd378eac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.602+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/821241212 shutdown_connections 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.602+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/821241212 wait complete. 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.602+0000 7fe2c0c2a740 1 -- start start 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2c0c2a740 1 Processor -- start 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2c0c2a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378ee5d0 0x55dd378f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2c0c2a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 0x55dd378f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2c0c2a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 0x55dd378f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2c0c2a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dd378fc010 con 0x55dd378efb40 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2c0c2a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55dd3780f060 con 0x55dd378f9370 2024-09-12T01:36:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2c0c2a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dd378fc190 con 0x55dd378ee5d0 2024-09-12T01:36:36.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2c0c2a740 10 client.0 _ll_register_callbacks cb 0x55dd375628c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:36.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 0x55dd378f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 0x55dd378f5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56302/0 (socket says 172.21.15.81:56302) 2024-09-12T01:36:36.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2b7fff640 1 -- 172.21.15.81:0/79556479 learned_addr learned my addr 172.21.15.81:0/79556479 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:36.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2affff640 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378ee5d0 0x55dd378f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2affff640 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 0x55dd378f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2b7fff640 1 -- 172.21.15.81:0/79556479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378ee5d0 msgr2=0x55dd378f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:36.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2b7fff640 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378ee5d0 0x55dd378f8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2b7fff640 1 -- 172.21.15.81:0/79556479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 msgr2=0x55dd378f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:36.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2b7fff640 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 0x55dd378f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2b7fff640 1 -- 172.21.15.81:0/79556479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd375c53c0 con 0x55dd378efb40 2024-09-12T01:36:36.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2affff640 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378ee5d0 0x55dd378f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2b7fff640 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 0x55dd378f5f80 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80044b0 tx=0x7fe2a8032f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e16ce1e5e227db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.603+0000 7fe2977fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2977fe640 1 -- 172.21.15.81:0/79556479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a803e040 con 0x55dd378efb40 2024-09-12T01:36:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2977fe640 1 -- 172.21.15.81:0/79556479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fe2a80317b0 con 0x55dd378efb40 2024-09-12T01:36:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/79556479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2a8004050 con 0x55dd378efb40 2024-09-12T01:36:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2977fe640 1 -- 172.21.15.81:0/79556479 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe2a8035040 con 0x55dd378efb40 2024-09-12T01:36:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2c0c2a740 10 client.17337 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/79556479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd37907a50 con 0x55dd378efb40 2024-09-12T01:36:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2977fe640 1 -- 172.21.15.81:0/79556479 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2a8004050 con 0x55dd378efb40 2024-09-12T01:36:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2977fe640 1 -- 172.21.15.81:0/79556479 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe2a8053610 con 0x55dd378efb40 2024-09-12T01:36:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2c0c2a740 10 client.17337 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2c0c2a740 10 client.17337 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:36:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2c0c2a740 20 client.17337 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55dd37908da0 0x55dd3790b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2c0c2a740 4 client.17337 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:36:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.604+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/79556479 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd37861860 con 0x55dd37908da0 2024-09-12T01:36:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.605+0000 7fe2affff640 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55dd37908da0 0x55dd3790b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.605+0000 7fe2977fe640 10 client.17337 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:36:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.605+0000 7fe2affff640 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55dd37908da0 0x55dd3790b190 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d86b3530eb38e1a5 server_cookie=8569e679418ede5e in_seq=0 out_seq=0 2024-09-12T01:36:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2977fe640 1 -- 172.21.15.81:0/79556479 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd37861860 con 0x55dd37908da0 2024-09-12T01:36:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2977fe640 10 client.17337 handle_command_reply: tid=0 2024-09-12T01:36:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2c0c2a740 1 client.17337 shutdown 2024-09-12T01:36:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/79556479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 msgr2=0x55dd378f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 0x55dd378f5f80 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80044b0 tx=0x7fe2a8032f10 comp rx=0 tx=0).stop 2024-09-12T01:36:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/79556479 shutdown_connections 2024-09-12T01:36:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 0x55dd378f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 0x55dd378f5f80 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55dd37908da0 0x55dd3790b190 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/79556479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378ee5d0 0x55dd378f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2977fe640 0 client.17337 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:36:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/79556479 >> 172.21.15.81:0/79556479 conn(0x55dd378b7310 msgr2=0x55dd378f0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/79556479 shutdown_connections 2024-09-12T01:36:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/79556479 wait complete. 2024-09-12T01:36:36.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.606+0000 7fe2c0c2a740 20 client.17337 trim_cache size 0 max 16384 2024-09-12T01:36:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.619+0000 7fe2c0c2a740 1 Processor -- start 2024-09-12T01:36:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.619+0000 7fe2c0c2a740 1 -- start start 2024-09-12T01:36:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.619+0000 7fe2c0c2a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 0x55dd378f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.619+0000 7fe2c0c2a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378efb40 0x55dd379052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.619+0000 7fe2c0c2a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378f9370 0x55dd378fa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.619+0000 7fe2c0c2a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b81afa90 con 0x55dd378ee5d0 2024-09-12T01:36:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.619+0000 7fe2c0c2a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b81b15d0 con 0x55dd378efb40 2024-09-12T01:36:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.619+0000 7fe2c0c2a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b81b0160 con 0x55dd378f9370 2024-09-12T01:36:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.619+0000 7fe2affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 0x55dd378f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.619+0000 7fe2affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 0x55dd378f5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56310/0 (socket says 172.21.15.81:56310) 2024-09-12T01:36:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.619+0000 7fe2affff640 1 -- 172.21.15.81:0/2939954271 learned_addr learned my addr 172.21.15.81:0/2939954271 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.620+0000 7fe2b7fff640 1 --2- 172.21.15.81:0/2939954271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378efb40 0x55dd379052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.620+0000 7fe2affff640 1 -- 172.21.15.81:0/2939954271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378f9370 msgr2=0x55dd378fa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.620+0000 7fe2affff640 1 --2- 172.21.15.81:0/2939954271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378f9370 0x55dd378fa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.620+0000 7fe2affff640 1 -- 172.21.15.81:0/2939954271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378efb40 msgr2=0x55dd379052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.620+0000 7fe2affff640 1 --2- 172.21.15.81:0/2939954271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378efb40 0x55dd379052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.620+0000 7fe2affff640 1 -- 172.21.15.81:0/2939954271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd378fbba0 con 0x55dd378ee5d0 2024-09-12T01:36:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.620+0000 7fe2b7fff640 1 --2- 172.21.15.81:0/2939954271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378efb40 0x55dd379052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.620+0000 7fe2affff640 1 --2- 172.21.15.81:0/2939954271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 0x55dd378f5f50 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x55dd378ef070 tx=0x7fe2a0018990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf76fa00da562c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.620+0000 7fe2adffb640 1 -- 172.21.15.81:0/2939954271 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a000f040 con 0x55dd378ee5d0 2024-09-12T01:36:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.620+0000 7fe2adffb640 1 -- 172.21.15.81:0/2939954271 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2a0019b90 con 0x55dd378ee5d0 2024-09-12T01:36:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.620+0000 7fe2adffb640 1 -- 172.21.15.81:0/2939954271 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0028c50 con 0x55dd378ee5d0 2024-09-12T01:36:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/2939954271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 msgr2=0x55dd378f5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/2939954271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 0x55dd378f5f50 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x55dd378ef070 tx=0x7fe2a0018990 comp rx=0 tx=0).stop 2024-09-12T01:36:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/2939954271 shutdown_connections 2024-09-12T01:36:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/2939954271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378f9370 0x55dd378fa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/2939954271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378efb40 0x55dd379052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/2939954271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378ee5d0 0x55dd378f5f50 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/2939954271 >> 172.21.15.81:0/2939954271 conn(0x55dd378b7310 msgr2=0x55dd378f5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/2939954271 shutdown_connections 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/2939954271 wait complete. 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 -- start start 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 Processor -- start 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378ee5d0 0x55dd37901950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 0x55dd3790fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 0x55dd37910390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b81b0f00 con 0x55dd378efb40 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b81b0830 con 0x55dd378f9370 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.621+0000 7fe2c0c2a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b81ada90 con 0x55dd378ee5d0 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2c0c2a740 10 client.0 _ll_register_callbacks cb 0x7fe2b806b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 0x55dd3790fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 0x55dd3790fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56314/0 (socket says 172.21.15.81:56314) 2024-09-12T01:36:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2b7fff640 1 -- 172.21.15.81:0/3568398620 learned_addr learned my addr 172.21.15.81:0/3568398620 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2affff640 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378ee5d0 0x55dd37901950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2affff640 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 0x55dd37910390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2b7fff640 1 -- 172.21.15.81:0/3568398620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378ee5d0 msgr2=0x55dd37901950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2b7fff640 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378ee5d0 0x55dd37901950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2b7fff640 1 -- 172.21.15.81:0/3568398620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 msgr2=0x55dd37910390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2b7fff640 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 0x55dd37910390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2b7fff640 1 -- 172.21.15.81:0/3568398620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd37910950 con 0x55dd378efb40 2024-09-12T01:36:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2affff640 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378ee5d0 0x55dd37901950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2b7fff640 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 0x55dd3790fe50 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80539e0 tx=0x7fe2a8032870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c98a3b87fe76de0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2977fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2977fe640 1 -- 172.21.15.81:0/3568398620 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a803e040 con 0x55dd378efb40 2024-09-12T01:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2977fe640 1 -- 172.21.15.81:0/3568398620 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fe2a8005270 con 0x55dd378efb40 2024-09-12T01:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/3568398620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2a0019b90 con 0x55dd378efb40 2024-09-12T01:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2977fe640 1 -- 172.21.15.81:0/3568398620 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe2a8062050 con 0x55dd378efb40 2024-09-12T01:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2c0c2a740 10 client.17343 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.622+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/3568398620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd37900120 con 0x55dd378efb40 2024-09-12T01:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.623+0000 7fe2977fe640 1 -- 172.21.15.81:0/3568398620 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2a0019b90 con 0x55dd378efb40 2024-09-12T01:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.623+0000 7fe2977fe640 1 -- 172.21.15.81:0/3568398620 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe2a805a020 con 0x55dd378efb40 2024-09-12T01:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.623+0000 7fe2c0c2a740 10 client.17343 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.623+0000 7fe2c0c2a740 10 client.17343 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.623+0000 7fe2c0c2a740 20 client.17343 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.623+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55dd3797c480 0x55dd3797e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.623+0000 7fe2c0c2a740 4 client.17343 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.623+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/3568398620 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dd3785bd70 con 0x55dd3797c480 2024-09-12T01:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.623+0000 7fe2affff640 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55dd3797c480 0x55dd3797e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.623+0000 7fe2977fe640 10 client.17343 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.623+0000 7fe2affff640 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55dd3797c480 0x55dd3797e8a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=88d30ad60b8efbc0 server_cookie=956e63f1af101ec7 in_seq=0 out_seq=0 2024-09-12T01:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2977fe640 1 -- 172.21.15.81:0/3568398620 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dd3785bd70 con 0x55dd3797c480 2024-09-12T01:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2977fe640 10 client.17343 handle_command_reply: tid=0 2024-09-12T01:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2c0c2a740 1 client.17343 shutdown 2024-09-12T01:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/3568398620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 msgr2=0x55dd3790fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 0x55dd3790fe50 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80539e0 tx=0x7fe2a8032870 comp rx=0 tx=0).stop 2024-09-12T01:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/3568398620 shutdown_connections 2024-09-12T01:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dd378f9370 0x55dd37910390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dd378efb40 0x55dd3790fe50 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55dd3797c480 0x55dd3797e8a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2977fe640 0 client.17343 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:36:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2c0c2a740 1 --2- 172.21.15.81:0/3568398620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd378ee5d0 0x55dd37901950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/3568398620 >> 172.21.15.81:0/3568398620 conn(0x55dd378b7310 msgr2=0x55dd378f5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/3568398620 shutdown_connections 2024-09-12T01:36:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2c0c2a740 1 -- 172.21.15.81:0/3568398620 wait complete. 2024-09-12T01:36:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.624+0000 7fe2c0c2a740 20 client.17343 trim_cache size 0 max 16384 2024-09-12T01:36:36.634 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:36:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.625+0000 7fe2be851640 1 -- 172.21.15.81:0/83351852 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe2a40a2cf0 msgr2=0x7fe2a40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.625+0000 7fe2be851640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe2a40a2cf0 0x7fe2a40a51b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe2b009b7e0 tx=0x7fe2b0005960 comp rx=0 tx=0).stop 2024-09-12T01:36:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.625+0000 7fe2be851640 1 -- 172.21.15.81:0/83351852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b810c150 msgr2=0x7fe2b8101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.625+0000 7fe2be851640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b810c150 0x7fe2b8101400 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000cad0 tx=0x7fe2b000cf90 comp rx=0 tx=0).stop 2024-09-12T01:36:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.625+0000 7fe2be851640 1 -- 172.21.15.81:0/83351852 shutdown_connections 2024-09-12T01:36:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.625+0000 7fe2be851640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fe2a40a2cf0 0x7fe2a40a51b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.625+0000 7fe2be851640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2b810c150 0x7fe2b8101400 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.625+0000 7fe2be851640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2b8103640 0x7fe2b8100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.625+0000 7fe2be851640 1 --2- 172.21.15.81:0/83351852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe2b8102d20 0x7fe2b8100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.625+0000 7fe2be851640 1 -- 172.21.15.81:0/83351852 >> 172.21.15.81:0/83351852 conn(0x7fe2b80fc780 msgr2=0x7fe2b80fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.625+0000 7fe2be851640 1 -- 172.21.15.81:0/83351852 shutdown_connections 2024-09-12T01:36:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:36.625+0000 7fe2be851640 1 -- 172.21.15.81:0/83351852 wait complete. 2024-09-12T01:36:37.345 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:36:37.594 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:36:37.714 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:37 smithi081 ceph-mon[30920]: pgmap v263: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:36:37.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:37 smithi100 ceph-mon[35275]: pgmap v263: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:36:37.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:37 smithi189 ceph-mon[35357]: pgmap v263: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:36:38.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.070+0000 7fc6b79a2640 1 -- 172.21.15.81:0/1750823664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b0101420 msgr2=0x7fc6b010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.070+0000 7fc6b79a2640 1 --2- 172.21.15.81:0/1750823664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b0101420 0x7fc6b010d950 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009cd0 tx=0x7fc6a802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.070+0000 7fc6b79a2640 1 -- 172.21.15.81:0/1750823664 shutdown_connections 2024-09-12T01:36:38.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.070+0000 7fc6b79a2640 1 --2- 172.21.15.81:0/1750823664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b0101420 0x7fc6b010d950 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.070+0000 7fc6b79a2640 1 --2- 172.21.15.81:0/1750823664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6b0100a80 0x7fc6b0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.070+0000 7fc6b79a2640 1 --2- 172.21.15.81:0/1750823664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6b0106a80 0x7fc6b0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.070+0000 7fc6b79a2640 1 -- 172.21.15.81:0/1750823664 >> 172.21.15.81:0/1750823664 conn(0x7fc6b00fc7a0 msgr2=0x7fc6b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:38.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.070+0000 7fc6b79a2640 1 -- 172.21.15.81:0/1750823664 shutdown_connections 2024-09-12T01:36:38.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.070+0000 7fc6b79a2640 1 -- 172.21.15.81:0/1750823664 wait complete. 2024-09-12T01:36:38.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.071+0000 7fc6b79a2640 1 Processor -- start 2024-09-12T01:36:38.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.071+0000 7fc6b79a2640 1 -- start start 2024-09-12T01:36:38.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.071+0000 7fc6b79a2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6b0100a80 0x7fc6b0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.071+0000 7fc6b79a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b0101420 0x7fc6b0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.071+0000 7fc6b79a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6b0106a80 0x7fc6b019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.071+0000 7fc6b79a2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b0111fa0 con 0x7fc6b0101420 2024-09-12T01:36:38.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.071+0000 7fc6b79a2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b0111e20 con 0x7fc6b0106a80 2024-09-12T01:36:38.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.071+0000 7fc6b79a2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b0112120 con 0x7fc6b0100a80 2024-09-12T01:36:38.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.071+0000 7fc6b4f3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b0101420 0x7fc6b0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6b4f3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b0101420 0x7fc6b0198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56338/0 (socket says 172.21.15.81:56338) 2024-09-12T01:36:38.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6b4f3d640 1 -- 172.21.15.81:0/3074659842 learned_addr learned my addr 172.21.15.81:0/3074659842 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:38.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6b573e640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6b0100a80 0x7fc6b0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6b5f3f640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6b0106a80 0x7fc6b019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6b4f3d640 1 -- 172.21.15.81:0/3074659842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6b0100a80 msgr2=0x7fc6b0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6b4f3d640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6b0100a80 0x7fc6b0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6b4f3d640 1 -- 172.21.15.81:0/3074659842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6b0106a80 msgr2=0x7fc6b019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6b4f3d640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6b0106a80 0x7fc6b019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6b4f3d640 1 -- 172.21.15.81:0/3074659842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b019d3e0 con 0x7fc6b0101420 2024-09-12T01:36:38.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6b5f3f640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6b0106a80 0x7fc6b019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:38.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6b4f3d640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b0101420 0x7fc6b0198970 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00d950 tx=0x7fc6ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:38.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6a27fc640 1 -- 172.21.15.81:0/3074659842 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac017030 con 0x7fc6b0101420 2024-09-12T01:36:38.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6a27fc640 1 -- 172.21.15.81:0/3074659842 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6ac004020 con 0x7fc6b0101420 2024-09-12T01:36:38.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6b79a2640 1 -- 172.21.15.81:0/3074659842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b019d6d0 con 0x7fc6b0101420 2024-09-12T01:36:38.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6a27fc640 1 -- 172.21.15.81:0/3074659842 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0047a0 con 0x7fc6b0101420 2024-09-12T01:36:38.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.072+0000 7fc6b79a2640 1 -- 172.21.15.81:0/3074659842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b01a4fb0 con 0x7fc6b0101420 2024-09-12T01:36:38.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.075+0000 7fc6a27fc640 1 -- 172.21.15.81:0/3074659842 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc6ac0041d0 con 0x7fc6b0101420 2024-09-12T01:36:38.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.075+0000 7fc6b9d7b740 1 Processor -- start 2024-09-12T01:36:38.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.075+0000 7fc6b9d7b740 1 -- start start 2024-09-12T01:36:38.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.075+0000 7fc6b9d7b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab65ab40 0x55abab659090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.075+0000 7fc6b9d7b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 0x55abab659a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.075+0000 7fc6b9d7b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab664370 0x55abab666760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.075+0000 7fc6b9d7b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55abab5bf2f0 con 0x55abab6595d0 2024-09-12T01:36:38.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.075+0000 7fc6b9d7b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55abab566cf0 con 0x55abab664370 2024-09-12T01:36:38.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.075+0000 7fc6b9d7b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55abab5bb2b0 con 0x55abab65ab40 2024-09-12T01:36:38.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.075+0000 7fc6a27fc640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc69c0a2d70 0x7fc69c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.075+0000 7fc6b573e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 0x55abab659a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.075+0000 7fc6b573e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 0x55abab659a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56350/0 (socket says 172.21.15.81:56350) 2024-09-12T01:36:38.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.075+0000 7fc6b573e640 1 -- 172.21.15.81:0/3119639882 learned_addr learned my addr 172.21.15.81:0/3119639882 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:38.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc6b5f3f640 1 --2- 172.21.15.81:0/3119639882 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab65ab40 0x55abab659090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc6b5f3f640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc69c0a2d70 0x7fc69c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc6b4f3d640 1 --2- 172.21.15.81:0/3119639882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab664370 0x55abab666760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc6a27fc640 1 -- 172.21.15.81:0/3074659842 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fc6ac0cedc0 con 0x7fc6b0101420 2024-09-12T01:36:38.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc6b573e640 1 -- 172.21.15.81:0/3119639882 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab65ab40 msgr2=0x55abab659090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:38.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc6b573e640 1 --2- 172.21.15.81:0/3119639882 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab65ab40 0x55abab659090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc6b573e640 1 -- 172.21.15.81:0/3119639882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab664370 msgr2=0x55abab666760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:38.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc6b573e640 1 --2- 172.21.15.81:0/3119639882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab664370 0x55abab666760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc6b573e640 1 -- 172.21.15.81:0/3119639882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abab54b3a0 con 0x55abab6595d0 2024-09-12T01:36:38.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc6b4f3d640 1 --2- 172.21.15.81:0/3119639882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab664370 0x55abab666760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:38.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc6b573e640 1 --2- 172.21.15.81:0/3119639882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 0x55abab659a10 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400ab90 tx=0x7fc6a400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348ba562a6023e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:38.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc6b5f3f640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc69c0a2d70 0x7fc69c0a5230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8006010 tx=0x7fc6a802a8e0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:38.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc69b7fe640 1 -- 172.21.15.81:0/3119639882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a401d070 con 0x55abab6595d0 2024-09-12T01:36:38.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc69b7fe640 1 -- 172.21.15.81:0/3119639882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6a4018b20 con 0x55abab6595d0 2024-09-12T01:36:38.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.076+0000 7fc69b7fe640 1 -- 172.21.15.81:0/3119639882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4010a80 con 0x55abab6595d0 2024-09-12T01:36:38.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.077+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/3119639882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 msgr2=0x55abab659a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.077+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/3119639882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 0x55abab659a10 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400ab90 tx=0x7fc6a400f790 comp rx=0 tx=0).stop 2024-09-12T01:36:38.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.077+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/3119639882 shutdown_connections 2024-09-12T01:36:38.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.077+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/3119639882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab664370 0x55abab666760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.077+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/3119639882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 0x55abab659a10 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.077+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/3119639882 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab65ab40 0x55abab659090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.077+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/3119639882 >> 172.21.15.81:0/3119639882 conn(0x55abab622310 msgr2=0x55abab655c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:38.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.077+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/3119639882 shutdown_connections 2024-09-12T01:36:38.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.077+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/3119639882 wait complete. 2024-09-12T01:36:38.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.077+0000 7fc6b9d7b740 1 -- start start 2024-09-12T01:36:38.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.077+0000 7fc6b9d7b740 1 Processor -- start 2024-09-12T01:36:38.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b9d7b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab6595d0 0x55abab663d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b9d7b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 0x55abab660ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b9d7b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 0x55abab6615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b9d7b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55abab667070 con 0x55abab65ab40 2024-09-12T01:36:38.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b9d7b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55abab57a060 con 0x55abab6595d0 2024-09-12T01:36:38.120 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:36:38.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b9d7b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55abab6671f0 con 0x55abab664370 2024-09-12T01:36:38.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b9d7b740 10 client.0 _ll_register_callbacks cb 0x55abab2cd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:38.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b4f3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 0x55abab660ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b4f3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 0x55abab660ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56358/0 (socket says 172.21.15.81:56358) 2024-09-12T01:36:38.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b4f3d640 1 -- 172.21.15.81:0/119537236 learned_addr learned my addr 172.21.15.81:0/119537236 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:38.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b5f3f640 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 0x55abab6615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b573e640 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab6595d0 0x55abab663d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b4f3d640 1 -- 172.21.15.81:0/119537236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 msgr2=0x55abab6615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:38.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b4f3d640 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 0x55abab6615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b4f3d640 1 -- 172.21.15.81:0/119537236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab6595d0 msgr2=0x55abab663d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:38.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b4f3d640 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab6595d0 0x55abab663d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b4f3d640 1 -- 172.21.15.81:0/119537236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abab3303c0 con 0x55abab65ab40 2024-09-12T01:36:38.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b5f3f640 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 0x55abab6615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:38.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b573e640 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab6595d0 0x55abab663d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:38.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc6b4f3d640 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 0x55abab660ff0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0cc5c0 tx=0x7fc6ac09af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d87c6d1043784e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:38.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.078+0000 7fc698ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:38.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc698ff9640 1 -- 172.21.15.81:0/119537236 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac09f690 con 0x55abab65ab40 2024-09-12T01:36:38.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc698ff9640 1 -- 172.21.15.81:0/119537236 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fc6ac09f170 con 0x55abab65ab40 2024-09-12T01:36:38.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/119537236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6a4018b20 con 0x55abab65ab40 2024-09-12T01:36:38.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc698ff9640 1 -- 172.21.15.81:0/119537236 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc6ac0a3f50 con 0x55abab65ab40 2024-09-12T01:36:38.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc6b9d7b740 10 client.17355 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:38.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/119537236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55abab672aa0 con 0x55abab65ab40 2024-09-12T01:36:38.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc698ff9640 1 -- 172.21.15.81:0/119537236 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6a4018b20 con 0x55abab65ab40 2024-09-12T01:36:38.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc698ff9640 1 -- 172.21.15.81:0/119537236 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc6ac0bb140 con 0x55abab65ab40 2024-09-12T01:36:38.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc6b9d7b740 10 client.17355 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:38.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc6b9d7b740 10 client.17355 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:36:38.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc6b9d7b740 20 client.17355 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:38.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55abab673eb0 0x55abab676300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc6b9d7b740 4 client.17355 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:36:38.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.079+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/119537236 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abab5cc860 con 0x55abab673eb0 2024-09-12T01:36:38.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.080+0000 7fc6b573e640 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55abab673eb0 0x55abab676300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.080+0000 7fc698ff9640 10 client.17355 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:36:38.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.080+0000 7fc6b573e640 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55abab673eb0 0x55abab676300 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e70def6eeb928dd server_cookie=9d386da1526d4bf in_seq=0 out_seq=0 2024-09-12T01:36:38.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc698ff9640 1 -- 172.21.15.81:0/119537236 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55abab5cc860 con 0x55abab673eb0 2024-09-12T01:36:38.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc698ff9640 10 client.17355 handle_command_reply: tid=0 2024-09-12T01:36:38.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc6b9d7b740 1 client.17355 shutdown 2024-09-12T01:36:38.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/119537236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 msgr2=0x55abab660ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 0x55abab660ff0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0cc5c0 tx=0x7fc6ac09af50 comp rx=0 tx=0).stop 2024-09-12T01:36:38.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/119537236 shutdown_connections 2024-09-12T01:36:38.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55abab673eb0 0x55abab676300 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 0x55abab6615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc698ff9640 0 client.17355 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:36:38.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 0x55abab660ff0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/119537236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab6595d0 0x55abab663d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/119537236 >> 172.21.15.81:0/119537236 conn(0x55abab622310 msgr2=0x55abab65b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:38.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/119537236 shutdown_connections 2024-09-12T01:36:38.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/119537236 wait complete. 2024-09-12T01:36:38.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.081+0000 7fc6b9d7b740 20 client.17355 trim_cache size 0 max 16384 2024-09-12T01:36:38.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b9d7b740 1 Processor -- start 2024-09-12T01:36:38.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b9d7b740 1 -- start start 2024-09-12T01:36:38.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b9d7b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 0x55abab670310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b9d7b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab65ab40 0x55abab65c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b9d7b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 0x55abab65c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b9d7b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b01ad930 con 0x55abab6595d0 2024-09-12T01:36:38.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b9d7b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b01af470 con 0x55abab65ab40 2024-09-12T01:36:38.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b9d7b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b01ae000 con 0x55abab664370 2024-09-12T01:36:38.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b573e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 0x55abab670310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b573e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 0x55abab670310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56362/0 (socket says 172.21.15.81:56362) 2024-09-12T01:36:38.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b573e640 1 -- 172.21.15.81:0/3854739762 learned_addr learned my addr 172.21.15.81:0/3854739762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:38.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b573e640 1 -- 172.21.15.81:0/3854739762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 msgr2=0x55abab65c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:38.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b573e640 1 --2- 172.21.15.81:0/3854739762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 0x55abab65c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b573e640 1 -- 172.21.15.81:0/3854739762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab65ab40 msgr2=0x55abab65c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:38.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b4f3d640 1 --2- 172.21.15.81:0/3854739762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab65ab40 0x55abab65c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b573e640 1 --2- 172.21.15.81:0/3854739762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab65ab40 0x55abab65c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b573e640 1 -- 172.21.15.81:0/3854739762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abab656af0 con 0x55abab6595d0 2024-09-12T01:36:38.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.094+0000 7fc6b4f3d640 1 --2- 172.21.15.81:0/3854739762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab65ab40 0x55abab65c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:38.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.095+0000 7fc6b573e640 1 --2- 172.21.15.81:0/3854739762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 0x55abab670310 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40106f0 tx=0x7fc6a40105e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfc5ed31b7ab688 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:38.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.095+0000 7fc69affd640 1 -- 172.21.15.81:0/3854739762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a401d040 con 0x55abab6595d0 2024-09-12T01:36:38.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.095+0000 7fc69affd640 1 -- 172.21.15.81:0/3854739762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6a4010430 con 0x55abab6595d0 2024-09-12T01:36:38.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.095+0000 7fc69affd640 1 -- 172.21.15.81:0/3854739762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40054a0 con 0x55abab6595d0 2024-09-12T01:36:38.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.095+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/3854739762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 msgr2=0x55abab670310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.095+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/3854739762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 0x55abab670310 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40106f0 tx=0x7fc6a40105e0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.095+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/3854739762 shutdown_connections 2024-09-12T01:36:38.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.095+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/3854739762 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 0x55abab65c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.095+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/3854739762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab65ab40 0x55abab65c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.095+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/3854739762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab6595d0 0x55abab670310 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.095+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/3854739762 >> 172.21.15.81:0/3854739762 conn(0x55abab622310 msgr2=0x55abab6600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:38.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.095+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/3854739762 shutdown_connections 2024-09-12T01:36:38.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.095+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/3854739762 wait complete. 2024-09-12T01:36:38.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.096+0000 7fc6b9d7b740 1 -- start start 2024-09-12T01:36:38.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.096+0000 7fc6b9d7b740 1 Processor -- start 2024-09-12T01:36:38.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.096+0000 7fc6b9d7b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab6595d0 0x55abab66ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.096+0000 7fc6b9d7b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 0x55abab667d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.096+0000 7fc6b9d7b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 0x55abab668290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.096+0000 7fc6b9d7b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b01aeda0 con 0x55abab65ab40 2024-09-12T01:36:38.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.096+0000 7fc6b9d7b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b01ae6d0 con 0x55abab6595d0 2024-09-12T01:36:38.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.096+0000 7fc6b9d7b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b01ab930 con 0x55abab664370 2024-09-12T01:36:38.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.096+0000 7fc6b9d7b740 10 client.0 _ll_register_callbacks cb 0x7fc6ac09b120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:38.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.096+0000 7fc6b4f3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 0x55abab667d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.096+0000 7fc6b4f3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 0x55abab667d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56368/0 (socket says 172.21.15.81:56368) 2024-09-12T01:36:38.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.096+0000 7fc6b4f3d640 1 -- 172.21.15.81:0/1716211218 learned_addr learned my addr 172.21.15.81:0/1716211218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:38.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc6b573e640 1 --2- 172.21.15.81:0/1716211218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab6595d0 0x55abab66ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc6b5f3f640 1 --2- 172.21.15.81:0/1716211218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 0x55abab668290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc6b4f3d640 1 -- 172.21.15.81:0/1716211218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 msgr2=0x55abab668290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:38.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc6b4f3d640 1 --2- 172.21.15.81:0/1716211218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 0x55abab668290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc6b4f3d640 1 -- 172.21.15.81:0/1716211218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab6595d0 msgr2=0x55abab66ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:38.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc6b4f3d640 1 --2- 172.21.15.81:0/1716211218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab6595d0 0x55abab66ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc6b4f3d640 1 -- 172.21.15.81:0/1716211218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abab6688d0 con 0x55abab65ab40 2024-09-12T01:36:38.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc6b4f3d640 1 --2- 172.21.15.81:0/1716211218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 0x55abab667d50 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac097cb0 tx=0x7fc6ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e992a84790f449 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:38.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc698ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:38.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc698ff9640 1 -- 172.21.15.81:0/1716211218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac09f690 con 0x55abab65ab40 2024-09-12T01:36:38.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc698ff9640 1 -- 172.21.15.81:0/1716211218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7fc6ac09a730 con 0x55abab65ab40 2024-09-12T01:36:38.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/1716211218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6a4010430 con 0x55abab65ab40 2024-09-12T01:36:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc698ff9640 1 -- 172.21.15.81:0/1716211218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc6ac0bb2c0 con 0x55abab65ab40 2024-09-12T01:36:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc6b9d7b740 10 client.17361 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/1716211218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55abab6de960 con 0x55abab65ab40 2024-09-12T01:36:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc698ff9640 1 -- 172.21.15.81:0/1716211218 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6a4010430 con 0x55abab65ab40 2024-09-12T01:36:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc698ff9640 1 -- 172.21.15.81:0/1716211218 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc6ac09a3a0 con 0x55abab65ab40 2024-09-12T01:36:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.097+0000 7fc6b9d7b740 10 client.17361 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.098+0000 7fc6b9d7b740 10 client.17361 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:36:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.098+0000 7fc6b9d7b740 20 client.17361 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.098+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/1716211218 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55abab6defd0 0x55abab6e13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.098+0000 7fc6b9d7b740 4 client.17361 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:36:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.098+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/1716211218 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55abab5c6d70 con 0x55abab6defd0 2024-09-12T01:36:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.098+0000 7fc6b573e640 1 --2- 172.21.15.81:0/1716211218 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55abab6defd0 0x55abab6e13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.098+0000 7fc6b573e640 1 --2- 172.21.15.81:0/1716211218 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55abab6defd0 0x55abab6e13f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9b8cbed6fc599a3f server_cookie=50865c0787efc9dd in_seq=0 out_seq=0 2024-09-12T01:36:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.098+0000 7fc698ff9640 10 client.17361 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:36:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc698ff9640 1 -- 172.21.15.81:0/1716211218 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55abab5c6d70 con 0x55abab6defd0 2024-09-12T01:36:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc698ff9640 10 client.17361 handle_command_reply: tid=0 2024-09-12T01:36:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc6b9d7b740 1 client.17361 shutdown 2024-09-12T01:36:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/1716211218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 msgr2=0x55abab667d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/1716211218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 0x55abab667d50 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac097cb0 tx=0x7fc6ac000bc0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/1716211218 shutdown_connections 2024-09-12T01:36:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/1716211218 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55abab6defd0 0x55abab6e13f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/1716211218 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55abab664370 0x55abab668290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/1716211218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abab65ab40 0x55abab667d50 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc698ff9640 0 client.17361 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:36:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc6b9d7b740 1 --2- 172.21.15.81:0/1716211218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55abab6595d0 0x55abab66ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/1716211218 >> 172.21.15.81:0/1716211218 conn(0x55abab622310 msgr2=0x55abab662850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/1716211218 shutdown_connections 2024-09-12T01:36:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc6b9d7b740 1 -- 172.21.15.81:0/1716211218 wait complete. 2024-09-12T01:36:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.099+0000 7fc6b9d7b740 20 client.17361 trim_cache size 0 max 16384 2024-09-12T01:36:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.100+0000 7fc6b79a2640 1 -- 172.21.15.81:0/3074659842 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc69c0a2d70 msgr2=0x7fc69c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.100+0000 7fc6b79a2640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc69c0a2d70 0x7fc69c0a5230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8006010 tx=0x7fc6a802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.100+0000 7fc6b79a2640 1 -- 172.21.15.81:0/3074659842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b0101420 msgr2=0x7fc6b0198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.100+0000 7fc6b79a2640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b0101420 0x7fc6b0198970 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00d950 tx=0x7fc6ac00de10 comp rx=0 tx=0).stop 2024-09-12T01:36:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.100+0000 7fc6b79a2640 1 -- 172.21.15.81:0/3074659842 shutdown_connections 2024-09-12T01:36:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.100+0000 7fc6b79a2640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc69c0a2d70 0x7fc69c0a5230 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.100+0000 7fc6b79a2640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6b0106a80 0x7fc6b019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.100+0000 7fc6b79a2640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b0101420 0x7fc6b0198970 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.100+0000 7fc6b79a2640 1 --2- 172.21.15.81:0/3074659842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc6b0100a80 0x7fc6b0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.100+0000 7fc6b79a2640 1 -- 172.21.15.81:0/3074659842 >> 172.21.15.81:0/3074659842 conn(0x7fc6b00fc7a0 msgr2=0x7fc6b00fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.100+0000 7fc6b79a2640 1 -- 172.21.15.81:0/3074659842 shutdown_connections 2024-09-12T01:36:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:38.100+0000 7fc6b79a2640 1 -- 172.21.15.81:0/3074659842 wait complete. 2024-09-12T01:36:38.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:36:39.192 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:36:39.601 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:39 smithi081 ceph-mon[30920]: pgmap v264: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.681+0000 7f0a63bd4640 1 -- 172.21.15.81:0/2403498315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a5c103660 msgr2=0x7f0a5c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.681+0000 7f0a63bd4640 1 --2- 172.21.15.81:0/2403498315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a5c103660 0x7f0a5c10bb50 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009900 tx=0x7f0a4c02a480 comp rx=0 tx=0).stop 2024-09-12T01:36:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.681+0000 7f0a63bd4640 1 -- 172.21.15.81:0/2403498315 shutdown_connections 2024-09-12T01:36:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.681+0000 7f0a63bd4640 1 --2- 172.21.15.81:0/2403498315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a5c10c170 0x7f0a5c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.681+0000 7f0a63bd4640 1 --2- 172.21.15.81:0/2403498315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a5c103660 0x7f0a5c10bb50 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.681+0000 7f0a63bd4640 1 --2- 172.21.15.81:0/2403498315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a5c102d40 0x7f0a5c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.681+0000 7f0a63bd4640 1 -- 172.21.15.81:0/2403498315 >> 172.21.15.81:0/2403498315 conn(0x7f0a5c0fc7a0 msgr2=0x7f0a5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.681+0000 7f0a63bd4640 1 -- 172.21.15.81:0/2403498315 shutdown_connections 2024-09-12T01:36:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.681+0000 7f0a63bd4640 1 -- 172.21.15.81:0/2403498315 wait complete. 2024-09-12T01:36:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a63bd4640 1 Processor -- start 2024-09-12T01:36:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a63bd4640 1 -- start start 2024-09-12T01:36:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a63bd4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a5c102d40 0x7f0a5c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a63bd4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a5c103660 0x7f0a5c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a63bd4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a5c10c170 0x7f0a5c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a63bd4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c111f70 con 0x7f0a5c102d40 2024-09-12T01:36:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a63bd4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c111df0 con 0x7f0a5c10c170 2024-09-12T01:36:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a63bd4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1120f0 con 0x7f0a5c103660 2024-09-12T01:36:39.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a61970640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a5c102d40 0x7f0a5c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a61970640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a5c102d40 0x7f0a5c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56386/0 (socket says 172.21.15.81:56386) 2024-09-12T01:36:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a61970640 1 -- 172.21.15.81:0/893020602 learned_addr learned my addr 172.21.15.81:0/893020602 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a62171640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a5c10c170 0x7f0a5c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a61970640 1 -- 172.21.15.81:0/893020602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a5c103660 msgr2=0x7f0a5c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a61970640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a5c103660 0x7f0a5c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a61970640 1 -- 172.21.15.81:0/893020602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a5c10c170 msgr2=0x7f0a5c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a61970640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a5c10c170 0x7f0a5c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a61970640 1 -- 172.21.15.81:0/893020602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5c1a68a0 con 0x7f0a5c102d40 2024-09-12T01:36:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.682+0000 7f0a62171640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a5c10c170 0x7f0a5c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.683+0000 7f0a61970640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a5c102d40 0x7f0a5c1009a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800d950 tx=0x7f0a5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.683+0000 7f0a52ffd640 1 -- 172.21.15.81:0/893020602 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a58017070 con 0x7f0a5c102d40 2024-09-12T01:36:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.683+0000 7f0a52ffd640 1 -- 172.21.15.81:0/893020602 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a58009c30 con 0x7f0a5c102d40 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.683+0000 7f0a52ffd640 1 -- 172.21.15.81:0/893020602 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800f6b0 con 0x7f0a5c102d40 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.683+0000 7f0a63bd4640 1 -- 172.21.15.81:0/893020602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5c1a6b90 con 0x7f0a5c102d40 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.683+0000 7f0a63bd4640 1 -- 172.21.15.81:0/893020602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a5c1a7120 con 0x7f0a5c102d40 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.686+0000 7f0a52ffd640 1 -- 172.21.15.81:0/893020602 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f0a580109d0 con 0x7f0a5c102d40 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.686+0000 7f0a65fad740 1 Processor -- start 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.686+0000 7f0a65fad740 1 -- start start 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.686+0000 7f0a65fad740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c8b40 0x5583909c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.686+0000 7f0a65fad740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c75d0 0x5583909c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.686+0000 7f0a65fad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 0x5583909d4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.686+0000 7f0a65fad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55839092d2f0 con 0x5583909d2370 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.686+0000 7f0a65fad740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5583908d4cf0 con 0x5583909c8b40 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.686+0000 7f0a65fad740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5583909292b0 con 0x5583909c75d0 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.686+0000 7f0a6116f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 0x5583909d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.686+0000 7f0a6116f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 0x5583909d4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56394/0 (socket says 172.21.15.81:56394) 2024-09-12T01:36:39.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.686+0000 7f0a6116f640 1 -- 172.21.15.81:0/3839981995 learned_addr learned my addr 172.21.15.81:0/3839981995 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:39.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.686+0000 7f0a61970640 1 --2- 172.21.15.81:0/3839981995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c75d0 0x5583909c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.687+0000 7f0a62171640 1 --2- 172.21.15.81:0/3839981995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c8b40 0x5583909c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.687+0000 7f0a6116f640 1 -- 172.21.15.81:0/3839981995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c75d0 msgr2=0x5583909c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:39.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.687+0000 7f0a6116f640 1 --2- 172.21.15.81:0/3839981995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c75d0 0x5583909c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.687+0000 7f0a6116f640 1 -- 172.21.15.81:0/3839981995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c8b40 msgr2=0x5583909c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:39.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.687+0000 7f0a6116f640 1 --2- 172.21.15.81:0/3839981995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c8b40 0x5583909c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.687+0000 7f0a6116f640 1 -- 172.21.15.81:0/3839981995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583908b93a0 con 0x5583909d2370 2024-09-12T01:36:39.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.687+0000 7f0a52ffd640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0a480a2d70 0x7f0a480a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.687+0000 7f0a62171640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0a480a2d70 0x7f0a480a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.687+0000 7f0a6116f640 1 --2- 172.21.15.81:0/3839981995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 0x5583909d4760 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009a20 tx=0x7f0a4c031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a0814f5894dc8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.687+0000 7f0a52ffd640 1 -- 172.21.15.81:0/893020602 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f0a580cf090 con 0x7f0a5c102d40 2024-09-12T01:36:39.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.687+0000 7f0a47fff640 1 -- 172.21.15.81:0/3839981995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c03e070 con 0x5583909d2370 2024-09-12T01:36:39.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.687+0000 7f0a47fff640 1 -- 172.21.15.81:0/3839981995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a4c031870 con 0x5583909d2370 2024-09-12T01:36:39.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.687+0000 7f0a47fff640 1 -- 172.21.15.81:0/3839981995 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c035040 con 0x5583909d2370 2024-09-12T01:36:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.688+0000 7f0a65fad740 1 -- 172.21.15.81:0/3839981995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 msgr2=0x5583909d4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.688+0000 7f0a65fad740 1 --2- 172.21.15.81:0/3839981995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 0x5583909d4760 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009a20 tx=0x7f0a4c031510 comp rx=0 tx=0).stop 2024-09-12T01:36:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.688+0000 7f0a62171640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0a480a2d70 0x7f0a480a5230 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a54005cc0 tx=0x7f0a540083f0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.688+0000 7f0a65fad740 1 -- 172.21.15.81:0/3839981995 shutdown_connections 2024-09-12T01:36:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.688+0000 7f0a65fad740 1 --2- 172.21.15.81:0/3839981995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 0x5583909d4760 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.688+0000 7f0a65fad740 1 --2- 172.21.15.81:0/3839981995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c75d0 0x5583909c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.688+0000 7f0a65fad740 1 --2- 172.21.15.81:0/3839981995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c8b40 0x5583909c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.688+0000 7f0a65fad740 1 -- 172.21.15.81:0/3839981995 >> 172.21.15.81:0/3839981995 conn(0x558390990310 msgr2=0x5583909c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.688+0000 7f0a65fad740 1 -- 172.21.15.81:0/3839981995 shutdown_connections 2024-09-12T01:36:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.688+0000 7f0a65fad740 1 -- 172.21.15.81:0/3839981995 wait complete. 2024-09-12T01:36:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.688+0000 7f0a65fad740 1 -- start start 2024-09-12T01:36:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.688+0000 7f0a65fad740 1 Processor -- start 2024-09-12T01:36:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a65fad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c75d0 0x5583909d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a65fad740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c8b40 0x5583909cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a65fad740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909d2370 0x5583909cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a65fad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5583909d5010 con 0x5583909c75d0 2024-09-12T01:36:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a65fad740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5583908e8060 con 0x5583909d2370 2024-09-12T01:36:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a65fad740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5583909d5190 con 0x5583909c8b40 2024-09-12T01:36:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a65fad740 10 client.0 _ll_register_callbacks cb 0x55839063b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a61970640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c75d0 0x5583909d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a61970640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c75d0 0x5583909d1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56396/0 (socket says 172.21.15.81:56396) 2024-09-12T01:36:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a61970640 1 -- 172.21.15.81:0/2718422705 learned_addr learned my addr 172.21.15.81:0/2718422705 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a62171640 1 --2- 172.21.15.81:0/2718422705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909d2370 0x5583909cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a61970640 1 -- 172.21.15.81:0/2718422705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c8b40 msgr2=0x5583909cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a61970640 1 --2- 172.21.15.81:0/2718422705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c8b40 0x5583909cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a61970640 1 -- 172.21.15.81:0/2718422705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909d2370 msgr2=0x5583909cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a61970640 1 --2- 172.21.15.81:0/2718422705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909d2370 0x5583909cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a61970640 1 -- 172.21.15.81:0/2718422705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55839069e3c0 con 0x5583909c75d0 2024-09-12T01:36:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a62171640 1 --2- 172.21.15.81:0/2718422705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909d2370 0x5583909cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a61970640 1 --2- 172.21.15.81:0/2718422705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c75d0 0x5583909d1d00 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009610 tx=0x7f0a58010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c2ba71efb292ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a457fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a457fa640 1 -- 172.21.15.81:0/2718422705 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a58020050 con 0x5583909c75d0 2024-09-12T01:36:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a457fa640 1 -- 172.21.15.81:0/2718422705 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f0a580d10d0 con 0x5583909c75d0 2024-09-12T01:36:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.689+0000 7f0a65fad740 1 -- 172.21.15.81:0/2718422705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a4c031870 con 0x5583909c75d0 2024-09-12T01:36:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.690+0000 7f0a457fa640 1 -- 172.21.15.81:0/2718422705 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0a5809b0f0 con 0x5583909c75d0 2024-09-12T01:36:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.690+0000 7f0a65fad740 10 client.17373 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.690+0000 7f0a65fad740 1 -- 172.21.15.81:0/2718422705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5583909e0ac0 con 0x5583909c75d0 2024-09-12T01:36:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.690+0000 7f0a457fa640 1 -- 172.21.15.81:0/2718422705 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a4c031870 con 0x5583909c75d0 2024-09-12T01:36:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.690+0000 7f0a457fa640 1 -- 172.21.15.81:0/2718422705 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0a5809aa00 con 0x5583909c75d0 2024-09-12T01:36:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.690+0000 7f0a65fad740 10 client.17373 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.690+0000 7f0a65fad740 10 client.17373 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:36:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.690+0000 7f0a65fad740 20 client.17373 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.690+0000 7f0a65fad740 1 --2- 172.21.15.81:0/2718422705 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5583909e1f20 0x5583909e4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.690+0000 7f0a65fad740 4 client.17373 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:36:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.690+0000 7f0a65fad740 1 -- 172.21.15.81:0/2718422705 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55839093a860 con 0x5583909e1f20 2024-09-12T01:36:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.690+0000 7f0a6116f640 1 --2- 172.21.15.81:0/2718422705 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5583909e1f20 0x5583909e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.691+0000 7f0a6116f640 1 --2- 172.21.15.81:0/2718422705 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5583909e1f20 0x5583909e4370 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d8eb906f3f06095 server_cookie=cf75e35d4b72c90 in_seq=0 out_seq=0 2024-09-12T01:36:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.691+0000 7f0a457fa640 10 client.17373 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:36:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.691+0000 7f0a457fa640 1 -- 172.21.15.81:0/2718422705 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55839093a860 con 0x5583909e1f20 2024-09-12T01:36:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.691+0000 7f0a457fa640 10 client.17373 handle_command_reply: tid=0 2024-09-12T01:36:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.691+0000 7f0a65fad740 1 client.17373 shutdown 2024-09-12T01:36:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.691+0000 7f0a65fad740 1 -- 172.21.15.81:0/2718422705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c75d0 msgr2=0x5583909d1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.691+0000 7f0a65fad740 1 --2- 172.21.15.81:0/2718422705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c75d0 0x5583909d1d00 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009610 tx=0x7f0a58010d70 comp rx=0 tx=0).stop 2024-09-12T01:36:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.692+0000 7f0a65fad740 1 -- 172.21.15.81:0/2718422705 shutdown_connections 2024-09-12T01:36:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.692+0000 7f0a65fad740 1 --2- 172.21.15.81:0/2718422705 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x5583909e1f20 0x5583909e4370 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.692+0000 7f0a65fad740 1 --2- 172.21.15.81:0/2718422705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909d2370 0x5583909cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.692+0000 7f0a65fad740 1 --2- 172.21.15.81:0/2718422705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c8b40 0x5583909cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.692+0000 7f0a457fa640 0 client.17373 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:36:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.692+0000 7f0a65fad740 1 --2- 172.21.15.81:0/2718422705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c75d0 0x5583909d1d00 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.692+0000 7f0a65fad740 1 -- 172.21.15.81:0/2718422705 >> 172.21.15.81:0/2718422705 conn(0x558390990310 msgr2=0x5583909c9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.692+0000 7f0a65fad740 1 -- 172.21.15.81:0/2718422705 shutdown_connections 2024-09-12T01:36:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.692+0000 7f0a65fad740 1 -- 172.21.15.81:0/2718422705 wait complete. 2024-09-12T01:36:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.692+0000 7f0a65fad740 20 client.17373 trim_cache size 0 max 16384 2024-09-12T01:36:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a65fad740 1 Processor -- start 2024-09-12T01:36:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a65fad740 1 -- start start 2024-09-12T01:36:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a65fad740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c75d0 0x5583909de2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a65fad740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c8b40 0x5583909d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a65fad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 0x5583909d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a65fad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1af9c0 con 0x5583909d2370 2024-09-12T01:36:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a65fad740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1b1500 con 0x5583909c75d0 2024-09-12T01:36:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a65fad740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1b0090 con 0x5583909c8b40 2024-09-12T01:36:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a62171640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 0x5583909d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a62171640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 0x5583909d3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56408/0 (socket says 172.21.15.81:56408) 2024-09-12T01:36:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a62171640 1 -- 172.21.15.81:0/1303528585 learned_addr learned my addr 172.21.15.81:0/1303528585 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a6116f640 1 --2- 172.21.15.81:0/1303528585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c8b40 0x5583909d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a61970640 1 --2- 172.21.15.81:0/1303528585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c75d0 0x5583909de2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a62171640 1 -- 172.21.15.81:0/1303528585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c8b40 msgr2=0x5583909d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a62171640 1 --2- 172.21.15.81:0/1303528585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c8b40 0x5583909d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a62171640 1 -- 172.21.15.81:0/1303528585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c75d0 msgr2=0x5583909de2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a62171640 1 --2- 172.21.15.81:0/1303528585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c75d0 0x5583909de2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.705+0000 7f0a62171640 1 -- 172.21.15.81:0/1303528585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583909c3ed0 con 0x5583909d2370 2024-09-12T01:36:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.706+0000 7f0a62171640 1 --2- 172.21.15.81:0/1303528585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 0x5583909d3ca0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f0a54010860 tx=0x7f0a54012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c44af2491b3bb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.706+0000 7f0a477fe640 1 -- 172.21.15.81:0/1303528585 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5401d940 con 0x5583909d2370 2024-09-12T01:36:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.706+0000 7f0a477fe640 1 -- 172.21.15.81:0/1303528585 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a5401e430 con 0x5583909d2370 2024-09-12T01:36:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.706+0000 7f0a477fe640 1 -- 172.21.15.81:0/1303528585 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54026630 con 0x5583909d2370 2024-09-12T01:36:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.706+0000 7f0a65fad740 1 -- 172.21.15.81:0/1303528585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 msgr2=0x5583909d3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.706+0000 7f0a65fad740 1 --2- 172.21.15.81:0/1303528585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 0x5583909d3ca0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f0a54010860 tx=0x7f0a54012000 comp rx=0 tx=0).stop 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.706+0000 7f0a65fad740 1 -- 172.21.15.81:0/1303528585 shutdown_connections 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.706+0000 7f0a65fad740 1 --2- 172.21.15.81:0/1303528585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909d2370 0x5583909d3ca0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.706+0000 7f0a65fad740 1 --2- 172.21.15.81:0/1303528585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909c8b40 0x5583909d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.706+0000 7f0a65fad740 1 --2- 172.21.15.81:0/1303528585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c75d0 0x5583909de2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.706+0000 7f0a65fad740 1 -- 172.21.15.81:0/1303528585 >> 172.21.15.81:0/1303528585 conn(0x558390990310 msgr2=0x5583909cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a65fad740 1 -- 172.21.15.81:0/1303528585 shutdown_connections 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a65fad740 1 -- 172.21.15.81:0/1303528585 wait complete. 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a65fad740 1 -- start start 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a65fad740 1 Processor -- start 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a65fad740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c75d0 0x5583909dad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a65fad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c8b40 0x5583909e9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a65fad740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909d2370 0x5583909e9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a65fad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1b0e30 con 0x5583909c8b40 2024-09-12T01:36:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a65fad740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1b0760 con 0x5583909c75d0 2024-09-12T01:36:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a65fad740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c1ad9c0 con 0x5583909d2370 2024-09-12T01:36:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a65fad740 10 client.0 _ll_register_callbacks cb 0x7f0a5800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a6116f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c8b40 0x5583909e9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a6116f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c8b40 0x5583909e9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56412/0 (socket says 172.21.15.81:56412) 2024-09-12T01:36:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.707+0000 7f0a6116f640 1 -- 172.21.15.81:0/4135471160 learned_addr learned my addr 172.21.15.81:0/4135471160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a61970640 1 --2- 172.21.15.81:0/4135471160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c75d0 0x5583909dad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a62171640 1 --2- 172.21.15.81:0/4135471160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909d2370 0x5583909e9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a6116f640 1 -- 172.21.15.81:0/4135471160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909d2370 msgr2=0x5583909e9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a6116f640 1 --2- 172.21.15.81:0/4135471160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909d2370 0x5583909e9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a6116f640 1 -- 172.21.15.81:0/4135471160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c75d0 msgr2=0x5583909dad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a6116f640 1 --2- 172.21.15.81:0/4135471160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c75d0 0x5583909dad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a6116f640 1 -- 172.21.15.81:0/4135471160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583909d8840 con 0x5583909c8b40 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a6116f640 1 --2- 172.21.15.81:0/4135471160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c8b40 0x5583909e9680 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009230 tx=0x7f0a4c0095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cbd49148b55da2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a457fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a457fa640 1 -- 172.21.15.81:0/4135471160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c035040 con 0x5583909c8b40 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a457fa640 1 -- 172.21.15.81:0/4135471160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f0a4c005050 con 0x5583909c8b40 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a65fad740 1 -- 172.21.15.81:0/4135471160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a5401e430 con 0x5583909c8b40 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a457fa640 1 -- 172.21.15.81:0/4135471160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0a4c05a050 con 0x5583909c8b40 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a65fad740 10 client.17379 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a65fad740 1 -- 172.21.15.81:0/4135471160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558390a4ce00 con 0x5583909c8b40 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.708+0000 7f0a457fa640 1 -- 172.21.15.81:0/4135471160 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a5401e430 con 0x5583909c8b40 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.709+0000 7f0a457fa640 1 -- 172.21.15.81:0/4135471160 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0a4c0047e0 con 0x5583909c8b40 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.709+0000 7f0a65fad740 10 client.17379 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.709+0000 7f0a65fad740 10 client.17379 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.709+0000 7f0a65fad740 20 client.17379 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.709+0000 7f0a65fad740 1 --2- 172.21.15.81:0/4135471160 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x558390a4d200 0x558390a4f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.709+0000 7f0a65fad740 4 client.17379 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:36:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.709+0000 7f0a65fad740 1 -- 172.21.15.81:0/4135471160 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558390934d70 con 0x558390a4d200 2024-09-12T01:36:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.709+0000 7f0a61970640 1 --2- 172.21.15.81:0/4135471160 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x558390a4d200 0x558390a4f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.709+0000 7f0a61970640 1 --2- 172.21.15.81:0/4135471160 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x558390a4d200 0x558390a4f5f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bc59ed89f68f1648 server_cookie=c3bd1c005a017144 in_seq=0 out_seq=0 2024-09-12T01:36:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.709+0000 7f0a457fa640 10 client.17379 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:36:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a457fa640 1 -- 172.21.15.81:0/4135471160 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558390934d70 con 0x558390a4d200 2024-09-12T01:36:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a457fa640 10 client.17379 handle_command_reply: tid=0 2024-09-12T01:36:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a65fad740 1 client.17379 shutdown 2024-09-12T01:36:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a65fad740 1 -- 172.21.15.81:0/4135471160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c8b40 msgr2=0x5583909e9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a65fad740 1 --2- 172.21.15.81:0/4135471160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c8b40 0x5583909e9680 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009230 tx=0x7f0a4c0095a0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a65fad740 1 -- 172.21.15.81:0/4135471160 shutdown_connections 2024-09-12T01:36:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a65fad740 1 --2- 172.21.15.81:0/4135471160 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x558390a4d200 0x558390a4f5f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a65fad740 1 --2- 172.21.15.81:0/4135471160 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583909d2370 0x5583909e9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a65fad740 1 --2- 172.21.15.81:0/4135471160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5583909c8b40 0x5583909e9680 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a457fa640 0 client.17379 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:36:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a65fad740 1 --2- 172.21.15.81:0/4135471160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583909c75d0 0x5583909dad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a65fad740 1 -- 172.21.15.81:0/4135471160 >> 172.21.15.81:0/4135471160 conn(0x558390990310 msgr2=0x5583909c2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a65fad740 1 -- 172.21.15.81:0/4135471160 shutdown_connections 2024-09-12T01:36:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a65fad740 1 -- 172.21.15.81:0/4135471160 wait complete. 2024-09-12T01:36:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.710+0000 7f0a65fad740 20 client.17379 trim_cache size 0 max 16384 2024-09-12T01:36:39.719 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:36:39.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.711+0000 7f0a63bd4640 1 -- 172.21.15.81:0/893020602 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0a480a2d70 msgr2=0x7f0a480a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.711+0000 7f0a63bd4640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0a480a2d70 0x7f0a480a5230 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a54005cc0 tx=0x7f0a540083f0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.711+0000 7f0a63bd4640 1 -- 172.21.15.81:0/893020602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a5c102d40 msgr2=0x7f0a5c1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.711+0000 7f0a63bd4640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a5c102d40 0x7f0a5c1009a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800d950 tx=0x7f0a5800de10 comp rx=0 tx=0).stop 2024-09-12T01:36:39.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.711+0000 7f0a63bd4640 1 -- 172.21.15.81:0/893020602 shutdown_connections 2024-09-12T01:36:39.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.711+0000 7f0a63bd4640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0a480a2d70 0x7f0a480a5230 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.711+0000 7f0a63bd4640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a5c10c170 0x7f0a5c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.711+0000 7f0a63bd4640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a5c103660 0x7f0a5c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.711+0000 7f0a63bd4640 1 --2- 172.21.15.81:0/893020602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a5c102d40 0x7f0a5c1009a0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.711+0000 7f0a63bd4640 1 -- 172.21.15.81:0/893020602 >> 172.21.15.81:0/893020602 conn(0x7f0a5c0fc7a0 msgr2=0x7f0a5c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:39.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.711+0000 7f0a63bd4640 1 -- 172.21.15.81:0/893020602 shutdown_connections 2024-09-12T01:36:39.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:39.711+0000 7f0a63bd4640 1 -- 172.21.15.81:0/893020602 wait complete. 2024-09-12T01:36:39.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:39 smithi100 ceph-mon[35275]: pgmap v264: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:39.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:39 smithi189 ceph-mon[35357]: pgmap v264: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:40.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:36:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:36:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.179+0000 7f9a6f311640 1 -- 172.21.15.81:0/3969548079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a68102780 msgr2=0x7f9a681067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.179+0000 7f9a6f311640 1 --2- 172.21.15.81:0/3969548079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a68102780 0x7f9a681067d0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009900 tx=0x7f9a6402a410 comp rx=0 tx=0).stop 2024-09-12T01:36:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.179+0000 7f9a6f311640 1 -- 172.21.15.81:0/3969548079 shutdown_connections 2024-09-12T01:36:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.179+0000 7f9a6f311640 1 --2- 172.21.15.81:0/3969548079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a68106f00 0x7f9a6810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.179+0000 7f9a6f311640 1 --2- 172.21.15.81:0/3969548079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a68102780 0x7f9a681067d0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.179+0000 7f9a6f311640 1 --2- 172.21.15.81:0/3969548079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a68101dd0 0x7f9a681021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.179+0000 7f9a6f311640 1 -- 172.21.15.81:0/3969548079 >> 172.21.15.81:0/3969548079 conn(0x7f9a680fd8b0 msgr2=0x7f9a680ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.179+0000 7f9a6f311640 1 -- 172.21.15.81:0/3969548079 shutdown_connections 2024-09-12T01:36:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.179+0000 7f9a6f311640 1 -- 172.21.15.81:0/3969548079 wait complete. 2024-09-12T01:36:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.179+0000 7f9a6f311640 1 Processor -- start 2024-09-12T01:36:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.179+0000 7f9a6f311640 1 -- start start 2024-09-12T01:36:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6f311640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a68101dd0 0x7f9a68198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6f311640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a68102780 0x7f9a681989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6f311640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a68106f00 0x7f9a6819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6f311640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a68111f80 con 0x7f9a68102780 2024-09-12T01:36:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6f311640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9a68111e00 con 0x7f9a68106f00 2024-09-12T01:36:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6f311640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9a68112100 con 0x7f9a68101dd0 2024-09-12T01:36:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6c8ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a68102780 0x7f9a681989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6c8ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a68102780 0x7f9a681989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56430/0 (socket says 172.21.15.81:56430) 2024-09-12T01:36:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6c8ac640 1 -- 172.21.15.81:0/2712016367 learned_addr learned my addr 172.21.15.81:0/2712016367 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6d0ad640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a68101dd0 0x7f9a68198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a68106f00 0x7f9a6819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6c8ac640 1 -- 172.21.15.81:0/2712016367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a68101dd0 msgr2=0x7f9a68198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6c8ac640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a68101dd0 0x7f9a68198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6c8ac640 1 -- 172.21.15.81:0/2712016367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a68106f00 msgr2=0x7f9a6819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6c8ac640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a68106f00 0x7f9a6819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6c8ac640 1 -- 172.21.15.81:0/2712016367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6819d440 con 0x7f9a68102780 2024-09-12T01:36:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6d0ad640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a68101dd0 0x7f9a68198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a68106f00 0x7f9a6819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6c8ac640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a68102780 0x7f9a681989d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f9a64006010 tx=0x7f9a640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a5e7fc640 1 -- 172.21.15.81:0/2712016367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6403f030 con 0x7f9a68102780 2024-09-12T01:36:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a6f311640 1 -- 172.21.15.81:0/2712016367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6819d6d0 con 0x7f9a68102780 2024-09-12T01:36:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a5e7fc640 1 -- 172.21.15.81:0/2712016367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a64003ce0 con 0x7f9a68102780 2024-09-12T01:36:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.180+0000 7f9a5e7fc640 1 -- 172.21.15.81:0/2712016367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a64035070 con 0x7f9a68102780 2024-09-12T01:36:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.181+0000 7f9a6f311640 1 -- 172.21.15.81:0/2712016367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a681a5010 con 0x7f9a68102780 2024-09-12T01:36:41.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.183+0000 7f9a5e7fc640 1 -- 172.21.15.81:0/2712016367 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9a64042030 con 0x7f9a68102780 2024-09-12T01:36:41.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.183+0000 7f9a716ea740 1 Processor -- start 2024-09-12T01:36:41.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.183+0000 7f9a716ea740 1 -- start start 2024-09-12T01:36:41.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.183+0000 7f9a716ea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 0x564f76d58090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.183+0000 7f9a716ea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d585d0 0x564f76d58a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.183+0000 7f9a716ea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d63370 0x564f76d65760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.183+0000 7f9a716ea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564f76cbe2f0 con 0x564f76d59b40 2024-09-12T01:36:41.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.183+0000 7f9a716ea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564f76c65cf0 con 0x564f76d63370 2024-09-12T01:36:41.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.183+0000 7f9a716ea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564f76cba2b0 con 0x564f76d585d0 2024-09-12T01:36:41.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a6d8ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 0x564f76d58090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a6d8ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 0x564f76d58090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56438/0 (socket says 172.21.15.81:56438) 2024-09-12T01:36:41.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a6d8ae640 1 -- 172.21.15.81:0/2098463691 learned_addr learned my addr 172.21.15.81:0/2098463691 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:41.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a6d0ad640 1 --2- 172.21.15.81:0/2098463691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d585d0 0x564f76d58a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a5e7fc640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9a540a2cf0 0x7f9a540a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a6c8ac640 1 --2- 172.21.15.81:0/2098463691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d63370 0x564f76d65760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a5e7fc640 1 -- 172.21.15.81:0/2712016367 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f9a640efb30 con 0x7f9a68102780 2024-09-12T01:36:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a6d8ae640 1 -- 172.21.15.81:0/2098463691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d585d0 msgr2=0x564f76d58a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/2098463691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d585d0 0x564f76d58a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a6d8ae640 1 -- 172.21.15.81:0/2098463691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d63370 msgr2=0x564f76d65760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/2098463691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d63370 0x564f76d65760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a6d8ae640 1 -- 172.21.15.81:0/2098463691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f76c4a3a0 con 0x564f76d59b40 2024-09-12T01:36:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9a540a2cf0 0x7f9a540a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/2098463691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 0x564f76d58090 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000e390 tx=0x7f9a6000e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5bc2c8c7339841 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a537fe640 1 -- 172.21.15.81:0/2098463691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60016070 con 0x564f76d59b40 2024-09-12T01:36:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a537fe640 1 -- 172.21.15.81:0/2098463691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a60010db0 con 0x564f76d59b40 2024-09-12T01:36:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.184+0000 7f9a537fe640 1 -- 172.21.15.81:0/2098463691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6001b8b0 con 0x564f76d59b40 2024-09-12T01:36:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.185+0000 7f9a716ea740 1 -- 172.21.15.81:0/2098463691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 msgr2=0x564f76d58090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.185+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9a540a2cf0 0x7f9a540a51b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a6001b000 tx=0x7f9a6001c000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.185+0000 7f9a716ea740 1 --2- 172.21.15.81:0/2098463691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 0x564f76d58090 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000e390 tx=0x7f9a6000e850 comp rx=0 tx=0).stop 2024-09-12T01:36:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.185+0000 7f9a716ea740 1 -- 172.21.15.81:0/2098463691 shutdown_connections 2024-09-12T01:36:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.185+0000 7f9a716ea740 1 --2- 172.21.15.81:0/2098463691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d63370 0x564f76d65760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.185+0000 7f9a716ea740 1 --2- 172.21.15.81:0/2098463691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d585d0 0x564f76d58a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.185+0000 7f9a716ea740 1 --2- 172.21.15.81:0/2098463691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 0x564f76d58090 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.185+0000 7f9a716ea740 1 -- 172.21.15.81:0/2098463691 >> 172.21.15.81:0/2098463691 conn(0x564f76d21310 msgr2=0x564f76d54c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.185+0000 7f9a716ea740 1 -- 172.21.15.81:0/2098463691 shutdown_connections 2024-09-12T01:36:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.185+0000 7f9a716ea740 1 -- 172.21.15.81:0/2098463691 wait complete. 2024-09-12T01:36:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a716ea740 1 -- start start 2024-09-12T01:36:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a716ea740 1 Processor -- start 2024-09-12T01:36:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a716ea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 0x564f76d62d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a716ea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d59b40 0x564f76d5ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a716ea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 0x564f76d60570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a716ea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564f76d66070 con 0x564f76d63370 2024-09-12T01:36:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a716ea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564f76c79060 con 0x564f76d585d0 2024-09-12T01:36:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a716ea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564f76d661f0 con 0x564f76d59b40 2024-09-12T01:36:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a716ea740 10 client.0 _ll_register_callbacks cb 0x564f769cc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a6d8ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 0x564f76d60570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a6d8ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 0x564f76d60570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56454/0 (socket says 172.21.15.81:56454) 2024-09-12T01:36:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a6d8ae640 1 -- 172.21.15.81:0/1806942154 learned_addr learned my addr 172.21.15.81:0/1806942154 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a6d0ad640 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 0x564f76d62d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.186+0000 7f9a6c8ac640 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d59b40 0x564f76d5ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a6d8ae640 1 -- 172.21.15.81:0/1806942154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d59b40 msgr2=0x564f76d5ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d59b40 0x564f76d5ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a6d8ae640 1 -- 172.21.15.81:0/1806942154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 msgr2=0x564f76d62d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 0x564f76d62d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a6d8ae640 1 -- 172.21.15.81:0/1806942154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f76a2f3c0 con 0x564f76d63370 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a6d0ad640 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 0x564f76d62d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 0x564f76d60570 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f9a60007e10 tx=0x7f9a6001bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a40dfe929574db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a50ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a50ff9640 1 -- 172.21.15.81:0/1806942154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60016070 con 0x564f76d63370 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a50ff9640 1 -- 172.21.15.81:0/1806942154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f9a6001b690 con 0x564f76d63370 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a716ea740 1 -- 172.21.15.81:0/1806942154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a60010db0 con 0x564f76d63370 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a50ff9640 1 -- 172.21.15.81:0/1806942154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9a6001b890 con 0x564f76d63370 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a716ea740 10 client.17391 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a716ea740 1 -- 172.21.15.81:0/1806942154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f76d71ac0 con 0x564f76d63370 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a50ff9640 1 -- 172.21.15.81:0/1806942154 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a60010db0 con 0x564f76d63370 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.187+0000 7f9a50ff9640 1 -- 172.21.15.81:0/1806942154 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9a600324e0 con 0x564f76d63370 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.188+0000 7f9a716ea740 10 client.17391 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.188+0000 7f9a716ea740 10 client.17391 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:36:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.188+0000 7f9a716ea740 20 client.17391 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.188+0000 7f9a716ea740 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x564f76d72e10 0x564f76d75200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.188+0000 7f9a716ea740 4 client.17391 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:36:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.188+0000 7f9a716ea740 1 -- 172.21.15.81:0/1806942154 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f76ccb860 con 0x564f76d72e10 2024-09-12T01:36:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.188+0000 7f9a6d0ad640 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x564f76d72e10 0x564f76d75200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.188+0000 7f9a50ff9640 10 client.17391 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:36:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.188+0000 7f9a6d0ad640 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x564f76d72e10 0x564f76d75200 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=88ba32154d7590dc server_cookie=fe5771b8447d268 in_seq=0 out_seq=0 2024-09-12T01:36:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.189+0000 7f9a50ff9640 1 -- 172.21.15.81:0/1806942154 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f76ccb860 con 0x564f76d72e10 2024-09-12T01:36:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.189+0000 7f9a50ff9640 10 client.17391 handle_command_reply: tid=0 2024-09-12T01:36:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.189+0000 7f9a716ea740 1 client.17391 shutdown 2024-09-12T01:36:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.189+0000 7f9a716ea740 1 -- 172.21.15.81:0/1806942154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 msgr2=0x564f76d60570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.189+0000 7f9a716ea740 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 0x564f76d60570 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f9a60007e10 tx=0x7f9a6001bb60 comp rx=0 tx=0).stop 2024-09-12T01:36:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.189+0000 7f9a716ea740 1 -- 172.21.15.81:0/1806942154 shutdown_connections 2024-09-12T01:36:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.189+0000 7f9a716ea740 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x564f76d72e10 0x564f76d75200 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.189+0000 7f9a716ea740 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 0x564f76d60570 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.189+0000 7f9a716ea740 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d59b40 0x564f76d5ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.189+0000 7f9a716ea740 1 --2- 172.21.15.81:0/1806942154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 0x564f76d62d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.189+0000 7f9a716ea740 1 -- 172.21.15.81:0/1806942154 >> 172.21.15.81:0/1806942154 conn(0x564f76d21310 msgr2=0x564f76d5a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.189+0000 7f9a50ff9640 0 client.17391 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:36:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.190+0000 7f9a716ea740 1 -- 172.21.15.81:0/1806942154 shutdown_connections 2024-09-12T01:36:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.190+0000 7f9a716ea740 1 -- 172.21.15.81:0/1806942154 wait complete. 2024-09-12T01:36:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.190+0000 7f9a716ea740 20 client.17391 trim_cache size 0 max 16384 2024-09-12T01:36:41.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.202+0000 7f9a716ea740 1 Processor -- start 2024-09-12T01:36:41.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.202+0000 7f9a716ea740 1 -- start start 2024-09-12T01:36:41.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a716ea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 0x564f76d6f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a716ea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 0x564f76d5b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a716ea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d63370 0x564f76d5b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a716ea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a681ad920 con 0x564f76d59b40 2024-09-12T01:36:41.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a716ea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9a681af460 con 0x564f76d585d0 2024-09-12T01:36:41.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a716ea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9a681adff0 con 0x564f76d63370 2024-09-12T01:36:41.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a6c8ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 0x564f76d5b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a6c8ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 0x564f76d5b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56464/0 (socket says 172.21.15.81:56464) 2024-09-12T01:36:41.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a6c8ac640 1 -- 172.21.15.81:0/4042601115 learned_addr learned my addr 172.21.15.81:0/4042601115 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:41.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a6d0ad640 1 --2- 172.21.15.81:0/4042601115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 0x564f76d6f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/4042601115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d63370 0x564f76d5b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a6c8ac640 1 -- 172.21.15.81:0/4042601115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d63370 msgr2=0x564f76d5b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:41.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a6c8ac640 1 --2- 172.21.15.81:0/4042601115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d63370 0x564f76d5b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a6c8ac640 1 -- 172.21.15.81:0/4042601115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 msgr2=0x564f76d6f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:41.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a6c8ac640 1 --2- 172.21.15.81:0/4042601115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 0x564f76d6f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a6c8ac640 1 -- 172.21.15.81:0/4042601115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f76d63090 con 0x564f76d59b40 2024-09-12T01:36:41.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a6c8ac640 1 --2- 172.21.15.81:0/4042601115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 0x564f76d5b120 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f9a640ed880 tx=0x7f9a640f2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47faf739bb0f338d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:41.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a52ffd640 1 -- 172.21.15.81:0/4042601115 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a64049030 con 0x564f76d59b40 2024-09-12T01:36:41.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a52ffd640 1 -- 172.21.15.81:0/4042601115 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a6403b580 con 0x564f76d59b40 2024-09-12T01:36:41.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.203+0000 7f9a52ffd640 1 -- 172.21.15.81:0/4042601115 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a640c04c0 con 0x564f76d59b40 2024-09-12T01:36:41.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.204+0000 7f9a716ea740 1 -- 172.21.15.81:0/4042601115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 msgr2=0x564f76d5b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.204+0000 7f9a716ea740 1 --2- 172.21.15.81:0/4042601115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 0x564f76d5b120 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f9a640ed880 tx=0x7f9a640f2040 comp rx=0 tx=0).stop 2024-09-12T01:36:41.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.204+0000 7f9a716ea740 1 -- 172.21.15.81:0/4042601115 shutdown_connections 2024-09-12T01:36:41.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.204+0000 7f9a716ea740 1 --2- 172.21.15.81:0/4042601115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d63370 0x564f76d5b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.204+0000 7f9a716ea740 1 --2- 172.21.15.81:0/4042601115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d59b40 0x564f76d5b120 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.204+0000 7f9a716ea740 1 --2- 172.21.15.81:0/4042601115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 0x564f76d6f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.204+0000 7f9a716ea740 1 -- 172.21.15.81:0/4042601115 >> 172.21.15.81:0/4042601115 conn(0x564f76d21310 msgr2=0x564f76d53d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:41.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.204+0000 7f9a716ea740 1 -- 172.21.15.81:0/4042601115 shutdown_connections 2024-09-12T01:36:41.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.204+0000 7f9a716ea740 1 -- 172.21.15.81:0/4042601115 wait complete. 2024-09-12T01:36:41.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.204+0000 7f9a716ea740 1 -- start start 2024-09-12T01:36:41.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a716ea740 1 Processor -- start 2024-09-12T01:36:41.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a716ea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 0x564f76d66c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a716ea740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d59b40 0x564f76d67160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a716ea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 0x564f76d6b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a716ea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a681aed90 con 0x564f76d63370 2024-09-12T01:36:41.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a716ea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9a681ae6c0 con 0x564f76d585d0 2024-09-12T01:36:41.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a716ea740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9a681ab920 con 0x564f76d59b40 2024-09-12T01:36:41.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a716ea740 10 client.0 _ll_register_callbacks cb 0x7f9a58009340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a6d8ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 0x564f76d6b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a6d8ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 0x564f76d6b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56476/0 (socket says 172.21.15.81:56476) 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a6d8ae640 1 -- 172.21.15.81:0/1538324826 learned_addr learned my addr 172.21.15.81:0/1538324826 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a6c8ac640 1 --2- 172.21.15.81:0/1538324826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d59b40 0x564f76d67160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a6d0ad640 1 --2- 172.21.15.81:0/1538324826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 0x564f76d66c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a6d8ae640 1 -- 172.21.15.81:0/1538324826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d59b40 msgr2=0x564f76d67160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/1538324826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d59b40 0x564f76d67160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a6d8ae640 1 -- 172.21.15.81:0/1538324826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 msgr2=0x564f76d66c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.205+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/1538324826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 0x564f76d66c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a6d8ae640 1 -- 172.21.15.81:0/1538324826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f76d6b990 con 0x564f76d63370 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a6d8ae640 1 --2- 172.21.15.81:0/1538324826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 0x564f76d6b2a0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000ee50 tx=0x7f9a600078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2eee1533679b5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a50ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a50ff9640 1 -- 172.21.15.81:0/1538324826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60016070 con 0x564f76d63370 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a50ff9640 1 -- 172.21.15.81:0/1538324826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f9a60032aa0 con 0x564f76d63370 2024-09-12T01:36:41.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a716ea740 1 -- 172.21.15.81:0/1538324826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564f76cc5d70 con 0x564f76d63370 2024-09-12T01:36:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a50ff9640 1 -- 172.21.15.81:0/1538324826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9a60046050 con 0x564f76d63370 2024-09-12T01:36:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a716ea740 10 client.17397 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a716ea740 1 -- 172.21.15.81:0/1538324826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f76ddd370 con 0x564f76d63370 2024-09-12T01:36:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a50ff9640 1 -- 172.21.15.81:0/1538324826 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564f76cc5d70 con 0x564f76d63370 2024-09-12T01:36:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a50ff9640 1 -- 172.21.15.81:0/1538324826 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9a60011460 con 0x564f76d63370 2024-09-12T01:36:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a716ea740 10 client.17397 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a716ea740 10 client.17397 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:36:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a716ea740 20 client.17397 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a716ea740 1 --2- 172.21.15.81:0/1538324826 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x564f76dddab0 0x564f76ddfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a716ea740 4 client.17397 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:36:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.206+0000 7f9a716ea740 1 -- 172.21.15.81:0/1538324826 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564f76c42170 con 0x564f76dddab0 2024-09-12T01:36:41.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.207+0000 7f9a6d0ad640 1 --2- 172.21.15.81:0/1538324826 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x564f76dddab0 0x564f76ddfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.207+0000 7f9a6d0ad640 1 --2- 172.21.15.81:0/1538324826 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x564f76dddab0 0x564f76ddfed0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d8a30d800f0dd5b4 server_cookie=168faf980c63e2bb in_seq=0 out_seq=0 2024-09-12T01:36:41.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.207+0000 7f9a50ff9640 10 client.17397 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:36:41.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.207+0000 7f9a50ff9640 1 -- 172.21.15.81:0/1538324826 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564f76c42170 con 0x564f76dddab0 2024-09-12T01:36:41.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.207+0000 7f9a50ff9640 10 client.17397 handle_command_reply: tid=0 2024-09-12T01:36:41.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.207+0000 7f9a716ea740 1 client.17397 shutdown 2024-09-12T01:36:41.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.207+0000 7f9a716ea740 1 -- 172.21.15.81:0/1538324826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 msgr2=0x564f76d6b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.207+0000 7f9a716ea740 1 --2- 172.21.15.81:0/1538324826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 0x564f76d6b2a0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000ee50 tx=0x7f9a600078c0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a716ea740 1 -- 172.21.15.81:0/1538324826 shutdown_connections 2024-09-12T01:36:41.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a716ea740 1 --2- 172.21.15.81:0/1538324826 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x564f76dddab0 0x564f76ddfed0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a716ea740 1 --2- 172.21.15.81:0/1538324826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f76d63370 0x564f76d6b2a0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a716ea740 1 --2- 172.21.15.81:0/1538324826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564f76d59b40 0x564f76d67160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a716ea740 1 --2- 172.21.15.81:0/1538324826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f76d585d0 0x564f76d66c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a716ea740 1 -- 172.21.15.81:0/1538324826 >> 172.21.15.81:0/1538324826 conn(0x564f76d21310 msgr2=0x564f76d61830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:41.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a50ff9640 0 client.17397 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:36:41.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a716ea740 1 -- 172.21.15.81:0/1538324826 shutdown_connections 2024-09-12T01:36:41.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a716ea740 1 -- 172.21.15.81:0/1538324826 wait complete. 2024-09-12T01:36:41.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a716ea740 20 client.17397 trim_cache size 0 max 16384 2024-09-12T01:36:41.213 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:36:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a6f311640 1 -- 172.21.15.81:0/2712016367 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9a540a2cf0 msgr2=0x7f9a540a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a6f311640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9a540a2cf0 0x7f9a540a51b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a6001b000 tx=0x7f9a6001c000 comp rx=0 tx=0).stop 2024-09-12T01:36:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a6f311640 1 -- 172.21.15.81:0/2712016367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a68102780 msgr2=0x7f9a681989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a6f311640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a68102780 0x7f9a681989d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f9a64006010 tx=0x7f9a640042f0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a6f311640 1 -- 172.21.15.81:0/2712016367 shutdown_connections 2024-09-12T01:36:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a6f311640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9a540a2cf0 0x7f9a540a51b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a6f311640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a68106f00 0x7f9a6819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a6f311640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a68102780 0x7f9a681989d0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a6f311640 1 --2- 172.21.15.81:0/2712016367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a68101dd0 0x7f9a68198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.208+0000 7f9a6f311640 1 -- 172.21.15.81:0/2712016367 >> 172.21.15.81:0/2712016367 conn(0x7f9a680fd8b0 msgr2=0x7f9a680fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.209+0000 7f9a6f311640 1 -- 172.21.15.81:0/2712016367 shutdown_connections 2024-09-12T01:36:41.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:41.209+0000 7f9a6f311640 1 -- 172.21.15.81:0/2712016367 wait complete. 2024-09-12T01:36:41.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:41 smithi081 ceph-mon[30920]: pgmap v265: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:36:41.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:41 smithi100 ceph-mon[35275]: pgmap v265: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:36:41.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:41 smithi189 ceph-mon[35357]: pgmap v265: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:36:41.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:36:42.133 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:36:42.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.605+0000 7f3b5146a640 1 -- 172.21.15.81:0/2454894829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4c10c170 msgr2=0x7f3b4c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:42.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.605+0000 7f3b5146a640 1 --2- 172.21.15.81:0/2454894829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4c10c170 0x7f3b4c10e610 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009900 tx=0x7f3b4402a480 comp rx=0 tx=0).stop 2024-09-12T01:36:42.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.605+0000 7f3b5146a640 1 -- 172.21.15.81:0/2454894829 shutdown_connections 2024-09-12T01:36:42.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.605+0000 7f3b5146a640 1 --2- 172.21.15.81:0/2454894829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4c10c170 0x7f3b4c10e610 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.605+0000 7f3b5146a640 1 --2- 172.21.15.81:0/2454894829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b4c103660 0x7f3b4c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.605+0000 7f3b5146a640 1 --2- 172.21.15.81:0/2454894829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b4c102d40 0x7f3b4c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.605+0000 7f3b5146a640 1 -- 172.21.15.81:0/2454894829 >> 172.21.15.81:0/2454894829 conn(0x7f3b4c0fc7a0 msgr2=0x7f3b4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:42.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.605+0000 7f3b5146a640 1 -- 172.21.15.81:0/2454894829 shutdown_connections 2024-09-12T01:36:42.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.605+0000 7f3b5146a640 1 -- 172.21.15.81:0/2454894829 wait complete. 2024-09-12T01:36:42.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.605+0000 7f3b5146a640 1 Processor -- start 2024-09-12T01:36:42.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.605+0000 7f3b5146a640 1 -- start start 2024-09-12T01:36:42.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b5146a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b4c102d40 0x7f3b4c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b5146a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4c103660 0x7f3b4c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b5146a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b4c10c170 0x7f3b4c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b5146a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c111fb0 con 0x7f3b4c103660 2024-09-12T01:36:42.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b5146a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c111e30 con 0x7f3b4c102d40 2024-09-12T01:36:42.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b5146a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c112130 con 0x7f3b4c10c170 2024-09-12T01:36:42.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b4a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4c103660 0x7f3b4c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b4a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4c103660 0x7f3b4c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60406/0 (socket says 172.21.15.81:60406) 2024-09-12T01:36:42.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b4a7fc640 1 -- 172.21.15.81:0/4101280286 learned_addr learned my addr 172.21.15.81:0/4101280286 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:42.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b4b7fe640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b4c10c170 0x7f3b4c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b4affd640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b4c102d40 0x7f3b4c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b4a7fc640 1 -- 172.21.15.81:0/4101280286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b4c10c170 msgr2=0x7f3b4c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:42.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b4a7fc640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b4c10c170 0x7f3b4c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b4a7fc640 1 -- 172.21.15.81:0/4101280286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b4c102d40 msgr2=0x7f3b4c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:42.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b4a7fc640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b4c102d40 0x7f3b4c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b4a7fc640 1 -- 172.21.15.81:0/4101280286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4c1a6890 con 0x7f3b4c103660 2024-09-12T01:36:42.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b4affd640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b4c102d40 0x7f3b4c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:42.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b4a7fc640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4c103660 0x7f3b4c100ee0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000c970 tx=0x7f3b4000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:42.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b33fff640 1 -- 172.21.15.81:0/4101280286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b40007bb0 con 0x7f3b4c103660 2024-09-12T01:36:42.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b33fff640 1 -- 172.21.15.81:0/4101280286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b40007d50 con 0x7f3b4c103660 2024-09-12T01:36:42.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b5146a640 1 -- 172.21.15.81:0/4101280286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4c1a6b80 con 0x7f3b4c103660 2024-09-12T01:36:42.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b33fff640 1 -- 172.21.15.81:0/4101280286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b40018820 con 0x7f3b4c103660 2024-09-12T01:36:42.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.606+0000 7f3b5146a640 1 -- 172.21.15.81:0/4101280286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b4c1a70c0 con 0x7f3b4c103660 2024-09-12T01:36:42.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.609+0000 7f3b33fff640 1 -- 172.21.15.81:0/4101280286 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f3b400189c0 con 0x7f3b4c103660 2024-09-12T01:36:42.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.609+0000 7f3b53843740 1 Processor -- start 2024-09-12T01:36:42.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.609+0000 7f3b53843740 1 -- start start 2024-09-12T01:36:42.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.609+0000 7f3b53843740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef1481b40 0x556ef1480090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.609+0000 7f3b53843740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 0x556ef1480a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.609+0000 7f3b53843740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef148b370 0x556ef148d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.609+0000 7f3b53843740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556ef13e62f0 con 0x556ef14805d0 2024-09-12T01:36:42.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.609+0000 7f3b53843740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556ef138dcf0 con 0x556ef1481b40 2024-09-12T01:36:42.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.609+0000 7f3b53843740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556ef13e22b0 con 0x556ef148b370 2024-09-12T01:36:42.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.609+0000 7f3b4affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 0x556ef1480a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.609+0000 7f3b4affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 0x556ef1480a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60422/0 (socket says 172.21.15.81:60422) 2024-09-12T01:36:42.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.609+0000 7f3b4affd640 1 -- 172.21.15.81:0/1770443326 learned_addr learned my addr 172.21.15.81:0/1770443326 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:42.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b4a7fc640 1 --2- 172.21.15.81:0/1770443326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef148b370 0x556ef148d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b4b7fe640 1 --2- 172.21.15.81:0/1770443326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef1481b40 0x556ef1480090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b33fff640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3b340a2cf0 0x7f3b340a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b4affd640 1 -- 172.21.15.81:0/1770443326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef148b370 msgr2=0x556ef148d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:42.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b4affd640 1 --2- 172.21.15.81:0/1770443326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef148b370 0x556ef148d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b4affd640 1 -- 172.21.15.81:0/1770443326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef1481b40 msgr2=0x556ef1480090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:42.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b4affd640 1 --2- 172.21.15.81:0/1770443326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef1481b40 0x556ef1480090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b4affd640 1 -- 172.21.15.81:0/1770443326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef13723a0 con 0x556ef14805d0 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b4b7fe640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3b340a2cf0 0x7f3b340a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b33fff640 1 -- 172.21.15.81:0/4101280286 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f3b400cf5b0 con 0x7f3b4c103660 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b4affd640 1 --2- 172.21.15.81:0/1770443326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 0x556ef1480a10 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c007fb0 tx=0x7f3b3c00c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884fcfc43e65b205 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b317fa640 1 -- 172.21.15.81:0/1770443326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c014070 con 0x556ef14805d0 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b317fa640 1 -- 172.21.15.81:0/1770443326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b3c00fd30 con 0x556ef14805d0 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.610+0000 7f3b317fa640 1 -- 172.21.15.81:0/1770443326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c00ed70 con 0x556ef14805d0 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.611+0000 7f3b53843740 1 -- 172.21.15.81:0/1770443326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 msgr2=0x556ef1480a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.611+0000 7f3b4b7fe640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3b340a2cf0 0x7f3b340a51b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3b44006010 tx=0x7f3b44009260 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.611+0000 7f3b53843740 1 --2- 172.21.15.81:0/1770443326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 0x556ef1480a10 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c007fb0 tx=0x7f3b3c00c750 comp rx=0 tx=0).stop 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.611+0000 7f3b53843740 1 -- 172.21.15.81:0/1770443326 shutdown_connections 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.611+0000 7f3b53843740 1 --2- 172.21.15.81:0/1770443326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef148b370 0x556ef148d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.611+0000 7f3b53843740 1 --2- 172.21.15.81:0/1770443326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 0x556ef1480a10 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.611+0000 7f3b53843740 1 --2- 172.21.15.81:0/1770443326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef1481b40 0x556ef1480090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.611+0000 7f3b53843740 1 -- 172.21.15.81:0/1770443326 >> 172.21.15.81:0/1770443326 conn(0x556ef1449310 msgr2=0x556ef147cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.611+0000 7f3b53843740 1 -- 172.21.15.81:0/1770443326 shutdown_connections 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.611+0000 7f3b53843740 1 -- 172.21.15.81:0/1770443326 wait complete. 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.611+0000 7f3b53843740 1 -- start start 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.611+0000 7f3b53843740 1 Processor -- start 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b53843740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef14805d0 0x556ef148ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b53843740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef1481b40 0x556ef1487f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b53843740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef148b370 0x556ef1488480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b53843740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556ef148e070 con 0x556ef148b370 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b53843740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556ef13a1060 con 0x556ef14805d0 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b53843740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556ef148e1f0 con 0x556ef1481b40 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b53843740 10 client.0 _ll_register_callbacks cb 0x556ef10f48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b4b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef148b370 0x556ef1488480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b4b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef148b370 0x556ef1488480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60436/0 (socket says 172.21.15.81:60436) 2024-09-12T01:36:42.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b4b7fe640 1 -- 172.21.15.81:0/460040457 learned_addr learned my addr 172.21.15.81:0/460040457 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:42.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b4a7fc640 1 --2- 172.21.15.81:0/460040457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef1481b40 0x556ef1487f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b4affd640 1 --2- 172.21.15.81:0/460040457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef14805d0 0x556ef148ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b4b7fe640 1 -- 172.21.15.81:0/460040457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef1481b40 msgr2=0x556ef1487f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:42.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b4b7fe640 1 --2- 172.21.15.81:0/460040457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef1481b40 0x556ef1487f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b4b7fe640 1 -- 172.21.15.81:0/460040457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef14805d0 msgr2=0x556ef148ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:42.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b4b7fe640 1 --2- 172.21.15.81:0/460040457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef14805d0 0x556ef148ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b4b7fe640 1 -- 172.21.15.81:0/460040457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ef11573c0 con 0x556ef148b370 2024-09-12T01:36:42.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b4b7fe640 1 --2- 172.21.15.81:0/460040457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef148b370 0x556ef1488480 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f3b4403c7a0 tx=0x7f3b4402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb23ab90d91d9810 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:42.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b2eff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:42.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.612+0000 7f3b2eff5640 1 -- 172.21.15.81:0/460040457 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4404b070 con 0x556ef148b370 2024-09-12T01:36:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b53843740 1 -- 172.21.15.81:0/460040457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b3c00fd30 con 0x556ef148b370 2024-09-12T01:36:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b2eff5640 1 -- 172.21.15.81:0/460040457 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f3b44004050 con 0x556ef148b370 2024-09-12T01:36:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b2eff5640 1 -- 172.21.15.81:0/460040457 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b44057050 con 0x556ef148b370 2024-09-12T01:36:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b53843740 10 client.17409 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b53843740 1 -- 172.21.15.81:0/460040457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556ef1499a30 con 0x556ef148b370 2024-09-12T01:36:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b2eff5640 1 -- 172.21.15.81:0/460040457 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b3c00fd30 con 0x556ef148b370 2024-09-12T01:36:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b2eff5640 1 -- 172.21.15.81:0/460040457 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3b44043070 con 0x556ef148b370 2024-09-12T01:36:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b53843740 10 client.17409 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b53843740 10 client.17409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:36:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b53843740 20 client.17409 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b53843740 1 --2- 172.21.15.81:0/460040457 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556ef149aeb0 0x556ef149d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b53843740 4 client.17409 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b53843740 1 -- 172.21.15.81:0/460040457 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ef13f3860 con 0x556ef149aeb0 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.613+0000 7f3b4affd640 1 --2- 172.21.15.81:0/460040457 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556ef149aeb0 0x556ef149d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.614+0000 7f3b4affd640 1 --2- 172.21.15.81:0/460040457 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556ef149aeb0 0x556ef149d350 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43cff908068e6078 server_cookie=a671bb604fc501ab in_seq=0 out_seq=0 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.614+0000 7f3b2eff5640 10 client.17409 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b2eff5640 1 -- 172.21.15.81:0/460040457 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ef13f3860 con 0x556ef149aeb0 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b2eff5640 10 client.17409 handle_command_reply: tid=0 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b53843740 1 client.17409 shutdown 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b53843740 1 -- 172.21.15.81:0/460040457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef148b370 msgr2=0x556ef1488480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b53843740 1 --2- 172.21.15.81:0/460040457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef148b370 0x556ef1488480 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f3b4403c7a0 tx=0x7f3b4402a480 comp rx=0 tx=0).stop 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b53843740 1 -- 172.21.15.81:0/460040457 shutdown_connections 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b53843740 1 --2- 172.21.15.81:0/460040457 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556ef149aeb0 0x556ef149d350 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b53843740 1 --2- 172.21.15.81:0/460040457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef148b370 0x556ef1488480 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b53843740 1 --2- 172.21.15.81:0/460040457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef1481b40 0x556ef1487f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b2eff5640 0 client.17409 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:42.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b53843740 1 --2- 172.21.15.81:0/460040457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef14805d0 0x556ef148ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b53843740 1 -- 172.21.15.81:0/460040457 >> 172.21.15.81:0/460040457 conn(0x556ef1449310 msgr2=0x556ef1482930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:42.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b53843740 1 -- 172.21.15.81:0/460040457 shutdown_connections 2024-09-12T01:36:42.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b53843740 1 -- 172.21.15.81:0/460040457 wait complete. 2024-09-12T01:36:42.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.615+0000 7f3b53843740 20 client.17409 trim_cache size 0 max 16384 2024-09-12T01:36:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.628+0000 7f3b53843740 1 Processor -- start 2024-09-12T01:36:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.628+0000 7f3b53843740 1 -- start start 2024-09-12T01:36:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.628+0000 7f3b53843740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 0x556ef1497310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.628+0000 7f3b53843740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef1481b40 0x556ef1489eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.628+0000 7f3b53843740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef148b370 0x556ef14a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.628+0000 7f3b53843740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c1afa40 con 0x556ef14805d0 2024-09-12T01:36:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.628+0000 7f3b53843740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c1b1580 con 0x556ef1481b40 2024-09-12T01:36:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.628+0000 7f3b53843740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c1b0110 con 0x556ef148b370 2024-09-12T01:36:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.628+0000 7f3b4affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 0x556ef1497310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b4affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 0x556ef1497310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60450/0 (socket says 172.21.15.81:60450) 2024-09-12T01:36:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b4affd640 1 -- 172.21.15.81:0/4104627534 learned_addr learned my addr 172.21.15.81:0/4104627534 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b4a7fc640 1 --2- 172.21.15.81:0/4104627534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef1481b40 0x556ef1489eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b4b7fe640 1 --2- 172.21.15.81:0/4104627534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef148b370 0x556ef14a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b4affd640 1 -- 172.21.15.81:0/4104627534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef148b370 msgr2=0x556ef14a2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b4affd640 1 --2- 172.21.15.81:0/4104627534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef148b370 0x556ef14a2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b4affd640 1 -- 172.21.15.81:0/4104627534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef1481b40 msgr2=0x556ef1489eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b4affd640 1 --2- 172.21.15.81:0/4104627534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef1481b40 0x556ef1489eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b4affd640 1 -- 172.21.15.81:0/4104627534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef148e0c0 con 0x556ef14805d0 2024-09-12T01:36:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b4a7fc640 1 --2- 172.21.15.81:0/4104627534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef1481b40 0x556ef1489eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b4affd640 1 --2- 172.21.15.81:0/4104627534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 0x556ef1497310 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00e920 tx=0x7f3b3c00e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a233ef9977ec10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b30ff9640 1 -- 172.21.15.81:0/4104627534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c014040 con 0x556ef14805d0 2024-09-12T01:36:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b30ff9640 1 -- 172.21.15.81:0/4104627534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b3c007bc0 con 0x556ef14805d0 2024-09-12T01:36:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.629+0000 7f3b30ff9640 1 -- 172.21.15.81:0/4104627534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0196b0 con 0x556ef14805d0 2024-09-12T01:36:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.630+0000 7f3b53843740 1 -- 172.21.15.81:0/4104627534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 msgr2=0x556ef1497310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.630+0000 7f3b53843740 1 --2- 172.21.15.81:0/4104627534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 0x556ef1497310 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00e920 tx=0x7f3b3c00e950 comp rx=0 tx=0).stop 2024-09-12T01:36:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.630+0000 7f3b53843740 1 -- 172.21.15.81:0/4104627534 shutdown_connections 2024-09-12T01:36:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.630+0000 7f3b53843740 1 --2- 172.21.15.81:0/4104627534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef148b370 0x556ef14a2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.630+0000 7f3b53843740 1 --2- 172.21.15.81:0/4104627534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef1481b40 0x556ef1489eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.630+0000 7f3b53843740 1 --2- 172.21.15.81:0/4104627534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef14805d0 0x556ef1497310 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.630+0000 7f3b53843740 1 -- 172.21.15.81:0/4104627534 >> 172.21.15.81:0/4104627534 conn(0x556ef1449310 msgr2=0x556ef14897a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.630+0000 7f3b53843740 1 -- 172.21.15.81:0/4104627534 shutdown_connections 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.630+0000 7f3b53843740 1 -- 172.21.15.81:0/4104627534 wait complete. 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.630+0000 7f3b53843740 1 -- start start 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.630+0000 7f3b53843740 1 Processor -- start 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b53843740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef14805d0 0x556ef14938c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b53843740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef1481b40 0x556ef1484930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b53843740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef148b370 0x556ef1484e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b53843740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c1b0eb0 con 0x556ef148b370 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b53843740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c1b07e0 con 0x556ef14805d0 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b53843740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c1ada40 con 0x556ef1481b40 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b53843740 10 client.0 _ll_register_callbacks cb 0x7f3b44009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b4affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef14805d0 0x556ef14938c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b4b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef148b370 0x556ef1484e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b4a7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef1481b40 0x556ef1484930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b4affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef14805d0 0x556ef14938c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:60326/0 (socket says 172.21.15.81:60326) 2024-09-12T01:36:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b4affd640 1 -- 172.21.15.81:0/2783683019 learned_addr learned my addr 172.21.15.81:0/2783683019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b4b7fe640 1 -- 172.21.15.81:0/2783683019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef1481b40 msgr2=0x556ef1484930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b4b7fe640 1 --2- 172.21.15.81:0/2783683019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef1481b40 0x556ef1484930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b4b7fe640 1 -- 172.21.15.81:0/2783683019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef14805d0 msgr2=0x556ef14938c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b4b7fe640 1 --2- 172.21.15.81:0/2783683019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef14805d0 0x556ef14938c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b4b7fe640 1 -- 172.21.15.81:0/2783683019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ef14853b0 con 0x556ef148b370 2024-09-12T01:36:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b4b7fe640 1 --2- 172.21.15.81:0/2783683019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef148b370 0x556ef1484e70 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009230 tx=0x7f3b440317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e72c177662d6a1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b2eff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.631+0000 7f3b2eff5640 1 -- 172.21.15.81:0/2783683019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4404b040 con 0x556ef148b370 2024-09-12T01:36:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b2eff5640 1 -- 172.21.15.81:0/2783683019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f3b44047d80 con 0x556ef148b370 2024-09-12T01:36:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b53843740 1 -- 172.21.15.81:0/2783683019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b3c007bc0 con 0x556ef148b370 2024-09-12T01:36:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b2eff5640 1 -- 172.21.15.81:0/2783683019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b44035040 con 0x556ef148b370 2024-09-12T01:36:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b53843740 10 client.17415 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b53843740 1 -- 172.21.15.81:0/2783683019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556ef1505830 con 0x556ef148b370 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b2eff5640 1 -- 172.21.15.81:0/2783683019 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b3c007bc0 con 0x556ef148b370 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b2eff5640 1 -- 172.21.15.81:0/2783683019 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3b44043070 con 0x556ef148b370 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b53843740 10 client.17415 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b53843740 10 client.17415 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b53843740 20 client.17415 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b53843740 1 --2- 172.21.15.81:0/2783683019 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556ef149aeb0 0x556ef1507f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b53843740 4 client.17415 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b53843740 1 -- 172.21.15.81:0/2783683019 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ef13edd70 con 0x556ef149aeb0 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.632+0000 7f3b4affd640 1 --2- 172.21.15.81:0/2783683019 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556ef149aeb0 0x556ef1507f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b4affd640 1 --2- 172.21.15.81:0/2783683019 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556ef149aeb0 0x556ef1507f40 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da7d16242a8084a8 server_cookie=f28f2ba560bc1948 in_seq=0 out_seq=0 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b2eff5640 10 client.17415 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b2eff5640 1 -- 172.21.15.81:0/2783683019 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ef13edd70 con 0x556ef149aeb0 2024-09-12T01:36:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b2eff5640 10 client.17415 handle_command_reply: tid=0 2024-09-12T01:36:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b53843740 1 client.17415 shutdown 2024-09-12T01:36:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b53843740 1 -- 172.21.15.81:0/2783683019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef148b370 msgr2=0x556ef1484e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b53843740 1 --2- 172.21.15.81:0/2783683019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef148b370 0x556ef1484e70 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009230 tx=0x7f3b440317c0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b53843740 1 -- 172.21.15.81:0/2783683019 shutdown_connections 2024-09-12T01:36:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b53843740 1 --2- 172.21.15.81:0/2783683019 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x556ef149aeb0 0x556ef1507f40 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b53843740 1 --2- 172.21.15.81:0/2783683019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556ef148b370 0x556ef1484e70 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b53843740 1 --2- 172.21.15.81:0/2783683019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ef1481b40 0x556ef1484930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b53843740 1 --2- 172.21.15.81:0/2783683019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556ef14805d0 0x556ef14938c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b53843740 1 -- 172.21.15.81:0/2783683019 >> 172.21.15.81:0/2783683019 conn(0x556ef1449310 msgr2=0x556ef1489fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b2eff5640 0 client.17415 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b53843740 1 -- 172.21.15.81:0/2783683019 shutdown_connections 2024-09-12T01:36:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b53843740 1 -- 172.21.15.81:0/2783683019 wait complete. 2024-09-12T01:36:42.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.633+0000 7f3b53843740 20 client.17415 trim_cache size 0 max 16384 2024-09-12T01:36:42.646 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:36:42.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.634+0000 7f3b5146a640 1 -- 172.21.15.81:0/4101280286 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3b340a2cf0 msgr2=0x7f3b340a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:42.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.634+0000 7f3b5146a640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3b340a2cf0 0x7f3b340a51b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3b44006010 tx=0x7f3b44009260 comp rx=0 tx=0).stop 2024-09-12T01:36:42.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.634+0000 7f3b5146a640 1 -- 172.21.15.81:0/4101280286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4c103660 msgr2=0x7f3b4c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:42.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.634+0000 7f3b5146a640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4c103660 0x7f3b4c100ee0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000c970 tx=0x7f3b4000ce30 comp rx=0 tx=0).stop 2024-09-12T01:36:42.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.634+0000 7f3b5146a640 1 -- 172.21.15.81:0/4101280286 shutdown_connections 2024-09-12T01:36:42.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.634+0000 7f3b5146a640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3b340a2cf0 0x7f3b340a51b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.634+0000 7f3b5146a640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b4c10c170 0x7f3b4c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.634+0000 7f3b5146a640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4c103660 0x7f3b4c100ee0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.634+0000 7f3b5146a640 1 --2- 172.21.15.81:0/4101280286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b4c102d40 0x7f3b4c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:42.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.634+0000 7f3b5146a640 1 -- 172.21.15.81:0/4101280286 >> 172.21.15.81:0/4101280286 conn(0x7f3b4c0fc7a0 msgr2=0x7f3b4c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:42.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.634+0000 7f3b5146a640 1 -- 172.21.15.81:0/4101280286 shutdown_connections 2024-09-12T01:36:42.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:42.634+0000 7f3b5146a640 1 -- 172.21.15.81:0/4101280286 wait complete. 2024-09-12T01:36:43.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:43 smithi081 ceph-mon[30920]: pgmap v266: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:43.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:43 smithi100 ceph-mon[35275]: pgmap v266: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:43.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:43 smithi189 ceph-mon[35357]: pgmap v266: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:44.412 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:36:44.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:36:44.668 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:36:45.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.158+0000 7f8fabc4b640 1 -- 172.21.15.81:0/3659371011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa410c170 msgr2=0x7f8fa410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.158+0000 7f8fabc4b640 1 --2- 172.21.15.81:0/3659371011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa410c170 0x7f8fa410e610 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009ca0 tx=0x7f8f9c02a950 comp rx=0 tx=0).stop 2024-09-12T01:36:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.158+0000 7f8fabc4b640 1 -- 172.21.15.81:0/3659371011 shutdown_connections 2024-09-12T01:36:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.158+0000 7f8fabc4b640 1 --2- 172.21.15.81:0/3659371011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa410c170 0x7f8fa410e610 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.158+0000 7f8fabc4b640 1 --2- 172.21.15.81:0/3659371011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fa4103660 0x7f8fa410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.158+0000 7f8fabc4b640 1 --2- 172.21.15.81:0/3659371011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fa4102d40 0x7f8fa4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.158+0000 7f8fabc4b640 1 -- 172.21.15.81:0/3659371011 >> 172.21.15.81:0/3659371011 conn(0x7f8fa40fc7a0 msgr2=0x7f8fa40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.158+0000 7f8fabc4b640 1 -- 172.21.15.81:0/3659371011 shutdown_connections 2024-09-12T01:36:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.158+0000 7f8fabc4b640 1 -- 172.21.15.81:0/3659371011 wait complete. 2024-09-12T01:36:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.158+0000 7f8fabc4b640 1 Processor -- start 2024-09-12T01:36:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.158+0000 7f8fabc4b640 1 -- start start 2024-09-12T01:36:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fabc4b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fa4102d40 0x7f8fa4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fabc4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa4103660 0x7f8fa41988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fabc4b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fa410c170 0x7f8fa419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fabc4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa4111f70 con 0x7f8fa4103660 2024-09-12T01:36:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fabc4b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa4111df0 con 0x7f8fa410c170 2024-09-12T01:36:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fabc4b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa41120f0 con 0x7f8fa4102d40 2024-09-12T01:36:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fa91e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa4103660 0x7f8fa41988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fa91e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa4103660 0x7f8fa41988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60482/0 (socket says 172.21.15.81:60482) 2024-09-12T01:36:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fa91e6640 1 -- 172.21.15.81:0/3191506309 learned_addr learned my addr 172.21.15.81:0/3191506309 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fa410c170 0x7f8fa419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fa99e7640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fa4102d40 0x7f8fa4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fa91e6640 1 -- 172.21.15.81:0/3191506309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fa4102d40 msgr2=0x7f8fa4198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fa91e6640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fa4102d40 0x7f8fa4198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fa91e6640 1 -- 172.21.15.81:0/3191506309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fa410c170 msgr2=0x7f8fa419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fa91e6640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fa410c170 0x7f8fa419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fa91e6640 1 -- 172.21.15.81:0/3191506309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa419d340 con 0x7f8fa4103660 2024-09-12T01:36:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fa99e7640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fa4102d40 0x7f8fa4198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.159+0000 7f8fa91e6640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa4103660 0x7f8fa41988d0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400c970 tx=0x7f8f9400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.160+0000 7f8f9affd640 1 -- 172.21.15.81:0/3191506309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94007bb0 con 0x7f8fa4103660 2024-09-12T01:36:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.160+0000 7f8fabc4b640 1 -- 172.21.15.81:0/3191506309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa419d630 con 0x7f8fa4103660 2024-09-12T01:36:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.160+0000 7f8f9affd640 1 -- 172.21.15.81:0/3191506309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f94007d50 con 0x7f8fa4103660 2024-09-12T01:36:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.160+0000 7f8f9affd640 1 -- 172.21.15.81:0/3191506309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94018820 con 0x7f8fa4103660 2024-09-12T01:36:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.160+0000 7f8fabc4b640 1 -- 172.21.15.81:0/3191506309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa41a4f10 con 0x7f8fa4103660 2024-09-12T01:36:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.162+0000 7f8f9affd640 1 -- 172.21.15.81:0/3191506309 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f8f940189c0 con 0x7f8fa4103660 2024-09-12T01:36:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.162+0000 7f8fae024740 1 Processor -- start 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.162+0000 7f8fae024740 1 -- start start 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.162+0000 7f8fae024740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 0x55e6b50ede20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.162+0000 7f8fae024740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50ee360 0x55e6b50fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.162+0000 7f8fae024740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50fd150 0x55e6b50ff540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.162+0000 7f8f9affd640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8f900a2cf0 0x7f8f900a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.162+0000 7f8fae024740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e6b5053280 con 0x55e6b50eda40 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8fae024740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e6b4ffab10 con 0x55e6b50ee360 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8fae024740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e6b504f240 con 0x55e6b50fd150 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8faa1e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 0x55e6b50ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8faa1e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 0x55e6b50ede20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60490/0 (socket says 172.21.15.81:60490) 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8faa1e8640 1 -- 172.21.15.81:0/1461257492 learned_addr learned my addr 172.21.15.81:0/1461257492 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8fa99e7640 1 --2- 172.21.15.81:0/1461257492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50ee360 0x55e6b50fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8fa91e6640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8f900a2cf0 0x7f8f900a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8f9affd640 1 -- 172.21.15.81:0/3191506309 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f8f940cf480 con 0x7f8fa4103660 2024-09-12T01:36:45.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/1461257492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50fd150 0x55e6b50ff540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8faa1e8640 1 -- 172.21.15.81:0/1461257492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50fd150 msgr2=0x55e6b50ff540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/1461257492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50fd150 0x55e6b50ff540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8faa1e8640 1 -- 172.21.15.81:0/1461257492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50ee360 msgr2=0x55e6b50fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/1461257492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50ee360 0x55e6b50fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8faa1e8640 1 -- 172.21.15.81:0/1461257492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b50071f0 con 0x55e6b50eda40 2024-09-12T01:36:45.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8fa99e7640 1 --2- 172.21.15.81:0/1461257492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50ee360 0x55e6b50fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:45.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/1461257492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 0x55e6b50ede20 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009ca0 tx=0x7f8f9c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef2ebbe60dd6136 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8fa91e6640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8f900a2cf0 0x7f8f900a51b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f9409b6a0 tx=0x7f8f94000bc0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8f8ffff640 1 -- 172.21.15.81:0/1461257492 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c034040 con 0x55e6b50eda40 2024-09-12T01:36:45.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8f8ffff640 1 -- 172.21.15.81:0/1461257492 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f9c003970 con 0x55e6b50eda40 2024-09-12T01:36:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.163+0000 7f8f8ffff640 1 -- 172.21.15.81:0/1461257492 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c004450 con 0x55e6b50eda40 2024-09-12T01:36:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.164+0000 7f8fae024740 1 -- 172.21.15.81:0/1461257492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 msgr2=0x55e6b50ede20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.164+0000 7f8fae024740 1 --2- 172.21.15.81:0/1461257492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 0x55e6b50ede20 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009ca0 tx=0x7f8f9c009900 comp rx=0 tx=0).stop 2024-09-12T01:36:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.164+0000 7f8fae024740 1 -- 172.21.15.81:0/1461257492 shutdown_connections 2024-09-12T01:36:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.164+0000 7f8fae024740 1 --2- 172.21.15.81:0/1461257492 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50fd150 0x55e6b50ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.164+0000 7f8fae024740 1 --2- 172.21.15.81:0/1461257492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50ee360 0x55e6b50fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.164+0000 7f8fae024740 1 --2- 172.21.15.81:0/1461257492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 0x55e6b50ede20 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.164+0000 7f8fae024740 1 -- 172.21.15.81:0/1461257492 >> 172.21.15.81:0/1461257492 conn(0x55e6b50ea0f0 msgr2=0x55e6b50ea4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.164+0000 7f8fae024740 1 -- 172.21.15.81:0/1461257492 shutdown_connections 2024-09-12T01:36:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.164+0000 7f8fae024740 1 -- 172.21.15.81:0/1461257492 wait complete. 2024-09-12T01:36:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fae024740 1 -- start start 2024-09-12T01:36:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fae024740 1 Processor -- start 2024-09-12T01:36:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fae024740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50eda40 0x55e6b50fa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fae024740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50ee360 0x55e6b50fa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fae024740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50fd150 0x55e6b50fab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fae024740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e6b50ffd20 con 0x55e6b50ee360 2024-09-12T01:36:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fae024740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e6b500df10 con 0x55e6b50eda40 2024-09-12T01:36:45.206 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:36:45.206 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:36:45.206 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "fb4c2586-6d88-4db9-b638-280baf9ad0d8", 2024-09-12T01:36:45.206 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:36:45.207 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:36:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fae024740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e6b50ffea0 con 0x55e6b50fd150 2024-09-12T01:36:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fae024740 10 client.0 _ll_register_callbacks cb 0x55e6b4fd6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fa99e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50ee360 0x55e6b50fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fa99e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50ee360 0x55e6b50fa5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60500/0 (socket says 172.21.15.81:60500) 2024-09-12T01:36:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fa99e7640 1 -- 172.21.15.81:0/3738570699 learned_addr learned my addr 172.21.15.81:0/3738570699 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50eda40 0x55e6b50fa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50fd150 0x55e6b50fab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fa99e7640 1 -- 172.21.15.81:0/3738570699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50fd150 msgr2=0x55e6b50fab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fa99e7640 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50fd150 0x55e6b50fab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fa99e7640 1 -- 172.21.15.81:0/3738570699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50eda40 msgr2=0x55e6b50fa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fa99e7640 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50eda40 0x55e6b50fa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8fa99e7640 1 -- 172.21.15.81:0/3738570699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6b4dc46a0 con 0x55e6b50ee360 2024-09-12T01:36:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.165+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50fd150 0x55e6b50fab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8fa99e7640 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50ee360 0x55e6b50fa5f0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0011850 tx=0x7f8fa0011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbfb885c0d95ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8f8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8f8d7fa640 1 -- 172.21.15.81:0/3738570699 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000fe70 con 0x55e6b50ee360 2024-09-12T01:36:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8f8d7fa640 1 -- 172.21.15.81:0/3738570699 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f8fa0004020 con 0x55e6b50ee360 2024-09-12T01:36:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8fae024740 1 -- 172.21.15.81:0/3738570699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f9c003970 con 0x55e6b50ee360 2024-09-12T01:36:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8f8d7fa640 1 -- 172.21.15.81:0/3738570699 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8fa0004220 con 0x55e6b50ee360 2024-09-12T01:36:45.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8fae024740 10 client.17427 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8fae024740 1 -- 172.21.15.81:0/3738570699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e6b510ba20 con 0x55e6b50ee360 2024-09-12T01:36:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8f8d7fa640 1 -- 172.21.15.81:0/3738570699 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f9c003970 con 0x55e6b50ee360 2024-09-12T01:36:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8f8d7fa640 1 -- 172.21.15.81:0/3738570699 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8fa0018030 con 0x55e6b50ee360 2024-09-12T01:36:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8fae024740 10 client.17427 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8fae024740 10 client.17427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:36:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8fae024740 20 client.17427 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8fae024740 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e6b510cee0 0x55e6b510f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8fae024740 4 client.17427 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:36:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.166+0000 7f8fae024740 1 -- 172.21.15.81:0/3738570699 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6b50607f0 con 0x55e6b510cee0 2024-09-12T01:36:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.167+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e6b510cee0 0x55e6b510f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.167+0000 7f8f8d7fa640 10 client.17427 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.167+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e6b510cee0 0x55e6b510f380 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e8b4239d7269cd0 server_cookie=5b3758edb082e2f6 in_seq=0 out_seq=0 2024-09-12T01:36:45.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8f8d7fa640 1 -- 172.21.15.81:0/3738570699 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6b50607f0 con 0x55e6b510cee0 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8f8d7fa640 10 client.17427 handle_command_reply: tid=0 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8fae024740 1 client.17427 shutdown 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8fae024740 1 -- 172.21.15.81:0/3738570699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50ee360 msgr2=0x55e6b50fa5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8fae024740 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50ee360 0x55e6b50fa5f0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0011850 tx=0x7f8fa0011d10 comp rx=0 tx=0).stop 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8fae024740 1 -- 172.21.15.81:0/3738570699 shutdown_connections 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8fae024740 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e6b510cee0 0x55e6b510f380 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8fae024740 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50fd150 0x55e6b50fab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8fae024740 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50ee360 0x55e6b50fa5f0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8fae024740 1 --2- 172.21.15.81:0/3738570699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50eda40 0x55e6b50fa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8f8d7fa640 0 client.17427 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8fae024740 1 -- 172.21.15.81:0/3738570699 >> 172.21.15.81:0/3738570699 conn(0x55e6b50ea0f0 msgr2=0x55e6b50efe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8fae024740 1 -- 172.21.15.81:0/3738570699 shutdown_connections 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8fae024740 1 -- 172.21.15.81:0/3738570699 wait complete. 2024-09-12T01:36:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.168+0000 7f8fae024740 20 client.17427 trim_cache size 0 max 16384 2024-09-12T01:36:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.185+0000 7f8fae024740 1 Processor -- start 2024-09-12T01:36:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.185+0000 7f8fae024740 1 -- start start 2024-09-12T01:36:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.185+0000 7f8fae024740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50eda40 0x55e6b5114c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.185+0000 7f8fae024740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50ee360 0x55e6b5115190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.185+0000 7f8fae024740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50fd150 0x55e6b50f7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.185+0000 7f8fae024740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa41ab5d0 con 0x55e6b50fd150 2024-09-12T01:36:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.185+0000 7f8fae024740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa41ad110 con 0x55e6b50eda40 2024-09-12T01:36:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8fae024740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa41abca0 con 0x55e6b50ee360 2024-09-12T01:36:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8faa1e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50fd150 0x55e6b50f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8faa1e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50fd150 0x55e6b50f7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60506/0 (socket says 172.21.15.81:60506) 2024-09-12T01:36:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8faa1e8640 1 -- 172.21.15.81:0/119389230 learned_addr learned my addr 172.21.15.81:0/119389230 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/119389230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50eda40 0x55e6b5114c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8fa99e7640 1 --2- 172.21.15.81:0/119389230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50ee360 0x55e6b5115190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8faa1e8640 1 -- 172.21.15.81:0/119389230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50ee360 msgr2=0x55e6b5115190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/119389230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50ee360 0x55e6b5115190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8faa1e8640 1 -- 172.21.15.81:0/119389230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50eda40 msgr2=0x55e6b5114c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/119389230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50eda40 0x55e6b5114c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8faa1e8640 1 -- 172.21.15.81:0/119389230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b50e9b90 con 0x55e6b50fd150 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/119389230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50fd150 0x55e6b50f7310 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c000f80 tx=0x7f8f9c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a53818f9771e959 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8f8f7fe640 1 -- 172.21.15.81:0/119389230 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c053020 con 0x55e6b50fd150 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8f8f7fe640 1 -- 172.21.15.81:0/119389230 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f9c009540 con 0x55e6b50fd150 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.186+0000 7f8f8f7fe640 1 -- 172.21.15.81:0/119389230 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c034040 con 0x55e6b50fd150 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.187+0000 7f8fae024740 1 -- 172.21.15.81:0/119389230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50fd150 msgr2=0x55e6b50f7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.187+0000 7f8fae024740 1 --2- 172.21.15.81:0/119389230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50fd150 0x55e6b50f7310 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c000f80 tx=0x7f8f9c009360 comp rx=0 tx=0).stop 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.187+0000 7f8fae024740 1 -- 172.21.15.81:0/119389230 shutdown_connections 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.187+0000 7f8fae024740 1 --2- 172.21.15.81:0/119389230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50fd150 0x55e6b50f7310 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.187+0000 7f8fae024740 1 --2- 172.21.15.81:0/119389230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50ee360 0x55e6b5115190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.187+0000 7f8fae024740 1 --2- 172.21.15.81:0/119389230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50eda40 0x55e6b5114c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.187+0000 7f8fae024740 1 -- 172.21.15.81:0/119389230 >> 172.21.15.81:0/119389230 conn(0x55e6b50ea0f0 msgr2=0x55e6b50fc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.187+0000 7f8fae024740 1 -- 172.21.15.81:0/119389230 shutdown_connections 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.187+0000 7f8fae024740 1 -- 172.21.15.81:0/119389230 wait complete. 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.187+0000 7f8fae024740 1 -- start start 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.187+0000 7f8fae024740 1 Processor -- start 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8fae024740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 0x55e6b51015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8fae024740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50ee360 0x55e6b5101b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8fae024740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50fd150 0x55e6b5176c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8fae024740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa41aca40 con 0x55e6b50eda40 2024-09-12T01:36:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8fae024740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa41ac370 con 0x55e6b50fd150 2024-09-12T01:36:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8fae024740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa41a95f0 con 0x55e6b50ee360 2024-09-12T01:36:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8fae024740 10 client.0 _ll_register_callbacks cb 0x7f8fa000c810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8faa1e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 0x55e6b51015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8faa1e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 0x55e6b51015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60514/0 (socket says 172.21.15.81:60514) 2024-09-12T01:36:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8faa1e8640 1 -- 172.21.15.81:0/1814970740 learned_addr learned my addr 172.21.15.81:0/1814970740 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8faa1e8640 1 -- 172.21.15.81:0/1814970740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50ee360 msgr2=0x55e6b5101b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/1814970740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50ee360 0x55e6b5101b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8faa1e8640 1 -- 172.21.15.81:0/1814970740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50fd150 msgr2=0x55e6b5176c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/1814970740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50fd150 0x55e6b5176c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8faa1e8640 1 -- 172.21.15.81:0/1814970740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6b5177160 con 0x55e6b50eda40 2024-09-12T01:36:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8faa1e8640 1 --2- 172.21.15.81:0/1814970740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 0x55e6b51015d0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c02a990 tx=0x7f8f9c005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cbcccaaab56dbe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8f8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8f8d7fa640 1 -- 172.21.15.81:0/1814970740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c05f060 con 0x55e6b50eda40 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8f8d7fa640 1 -- 172.21.15.81:0/1814970740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f8f9c02f5b0 con 0x55e6b50eda40 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.188+0000 7f8fae024740 1 -- 172.21.15.81:0/1814970740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f9c009540 con 0x55e6b50eda40 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.189+0000 7f8f8d7fa640 1 -- 172.21.15.81:0/1814970740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f9c053030 con 0x55e6b50eda40 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.189+0000 7f8fae024740 10 client.17433 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.189+0000 7f8fae024740 1 -- 172.21.15.81:0/1814970740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e6b5178440 con 0x55e6b50eda40 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.189+0000 7f8f8d7fa640 1 -- 172.21.15.81:0/1814970740 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f9c009540 con 0x55e6b50eda40 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.189+0000 7f8f8d7fa640 1 -- 172.21.15.81:0/1814970740 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f9c05a890 con 0x55e6b50eda40 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.189+0000 7f8fae024740 10 client.17433 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.189+0000 7f8fae024740 10 client.17433 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.189+0000 7f8fae024740 20 client.17433 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.189+0000 7f8fae024740 1 --2- 172.21.15.81:0/1814970740 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e6b51786c0 0x55e6b517aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.189+0000 7f8fae024740 4 client.17433 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:36:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.189+0000 7f8fae024740 1 -- 172.21.15.81:0/1814970740 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e6b505ad00 con 0x55e6b51786c0 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.189+0000 7f8fa99e7640 1 --2- 172.21.15.81:0/1814970740 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e6b51786c0 0x55e6b517aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.190+0000 7f8f8d7fa640 10 client.17433 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.190+0000 7f8fa99e7640 1 --2- 172.21.15.81:0/1814970740 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e6b51786c0 0x55e6b517aab0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0213341c6d70d78 server_cookie=5a280a700cebb773 in_seq=0 out_seq=0 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8f8d7fa640 1 -- 172.21.15.81:0/1814970740 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e6b505ad00 con 0x55e6b51786c0 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8f8d7fa640 10 client.17433 handle_command_reply: tid=0 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8fae024740 1 client.17433 shutdown 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8fae024740 1 -- 172.21.15.81:0/1814970740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 msgr2=0x55e6b51015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8fae024740 1 --2- 172.21.15.81:0/1814970740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 0x55e6b51015d0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c02a990 tx=0x7f8f9c005fa0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8fae024740 1 -- 172.21.15.81:0/1814970740 shutdown_connections 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8fae024740 1 --2- 172.21.15.81:0/1814970740 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55e6b51786c0 0x55e6b517aab0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8fae024740 1 --2- 172.21.15.81:0/1814970740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e6b50fd150 0x55e6b5176c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8fae024740 1 --2- 172.21.15.81:0/1814970740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e6b50ee360 0x55e6b5101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8f8d7fa640 0 client.17433 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8fae024740 1 --2- 172.21.15.81:0/1814970740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6b50eda40 0x55e6b51015d0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8fae024740 1 -- 172.21.15.81:0/1814970740 >> 172.21.15.81:0/1814970740 conn(0x55e6b50ea0f0 msgr2=0x55e6b50fb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8fae024740 1 -- 172.21.15.81:0/1814970740 shutdown_connections 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8fae024740 1 -- 172.21.15.81:0/1814970740 wait complete. 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.191+0000 7f8fae024740 20 client.17433 trim_cache size 0 max 16384 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.192+0000 7f8fabc4b640 1 -- 172.21.15.81:0/3191506309 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8f900a2cf0 msgr2=0x7f8f900a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.192+0000 7f8fabc4b640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8f900a2cf0 0x7f8f900a51b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f9409b6a0 tx=0x7f8f94000bc0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.192+0000 7f8fabc4b640 1 -- 172.21.15.81:0/3191506309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa4103660 msgr2=0x7f8fa41988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.192+0000 7f8fabc4b640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa4103660 0x7f8fa41988d0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400c970 tx=0x7f8f9400ce30 comp rx=0 tx=0).stop 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.192+0000 7f8fabc4b640 1 -- 172.21.15.81:0/3191506309 shutdown_connections 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.192+0000 7f8fabc4b640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8f900a2cf0 0x7f8f900a51b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.192+0000 7f8fabc4b640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fa410c170 0x7f8fa419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.192+0000 7f8fabc4b640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa4103660 0x7f8fa41988d0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.192+0000 7f8fabc4b640 1 --2- 172.21.15.81:0/3191506309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8fa4102d40 0x7f8fa4198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.192+0000 7f8fabc4b640 1 -- 172.21.15.81:0/3191506309 >> 172.21.15.81:0/3191506309 conn(0x7f8fa40fc7a0 msgr2=0x7f8fa40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:45.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.192+0000 7f8fabc4b640 1 -- 172.21.15.81:0/3191506309 shutdown_connections 2024-09-12T01:36:45.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:45.192+0000 7f8fabc4b640 1 -- 172.21.15.81:0/3191506309 wait complete. 2024-09-12T01:36:45.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:45 smithi081 ceph-mon[30920]: pgmap v267: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:45.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:45 smithi100 ceph-mon[35275]: pgmap v267: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:45.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:45 smithi189 ceph-mon[35357]: pgmap v267: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:45.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:36:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:36:46.542 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:46 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:36:46.542 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:46 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:36:46.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:46 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:36:46.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:46 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:36:46.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.623+0000 7f6c9deea640 1 -- 172.21.15.81:0/3989647389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c98102d40 msgr2=0x7f6c98103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.623+0000 7f6c9deea640 1 --2- 172.21.15.81:0/3989647389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c98102d40 0x7f6c98103120 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009ca0 tx=0x7f6c8802a950 comp rx=0 tx=0).stop 2024-09-12T01:36:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.623+0000 7f6c9deea640 1 -- 172.21.15.81:0/3989647389 shutdown_connections 2024-09-12T01:36:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.623+0000 7f6c9deea640 1 --2- 172.21.15.81:0/3989647389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c9810c170 0x7f6c9810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.623+0000 7f6c9deea640 1 --2- 172.21.15.81:0/3989647389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c98103660 0x7f6c9810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.623+0000 7f6c9deea640 1 --2- 172.21.15.81:0/3989647389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c98102d40 0x7f6c98103120 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.623+0000 7f6c9deea640 1 -- 172.21.15.81:0/3989647389 >> 172.21.15.81:0/3989647389 conn(0x7f6c980fc7a0 msgr2=0x7f6c980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.623+0000 7f6c9deea640 1 -- 172.21.15.81:0/3989647389 shutdown_connections 2024-09-12T01:36:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.623+0000 7f6c9deea640 1 -- 172.21.15.81:0/3989647389 wait complete. 2024-09-12T01:36:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.624+0000 7f6c9deea640 1 Processor -- start 2024-09-12T01:36:46.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.624+0000 7f6c9deea640 1 -- start start 2024-09-12T01:36:46.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.624+0000 7f6c9deea640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c98102d40 0x7f6c981009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.624+0000 7f6c9deea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c98103660 0x7f6c98100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.624+0000 7f6c9deea640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c9810c170 0x7f6c98101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.624+0000 7f6c9deea640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c98112030 con 0x7f6c98103660 2024-09-12T01:36:46.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.624+0000 7f6c9deea640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6c98111eb0 con 0x7f6c98102d40 2024-09-12T01:36:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.624+0000 7f6c9deea640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c981121b0 con 0x7f6c9810c170 2024-09-12T01:36:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.624+0000 7f6c96ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c98103660 0x7f6c98100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c96ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c98103660 0x7f6c98100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60530/0 (socket says 172.21.15.81:60530) 2024-09-12T01:36:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c96ffd640 1 -- 172.21.15.81:0/1118153523 learned_addr learned my addr 172.21.15.81:0/1118153523 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c97fff640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c9810c170 0x7f6c98101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c977fe640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c98102d40 0x7f6c981009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c96ffd640 1 -- 172.21.15.81:0/1118153523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c9810c170 msgr2=0x7f6c98101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c96ffd640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c9810c170 0x7f6c98101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c96ffd640 1 -- 172.21.15.81:0/1118153523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c98102d40 msgr2=0x7f6c981009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c96ffd640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c98102d40 0x7f6c981009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c96ffd640 1 -- 172.21.15.81:0/1118153523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c981a6b00 con 0x7f6c98103660 2024-09-12T01:36:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c96ffd640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c98103660 0x7f6c98100ee0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00b3f0 tx=0x7f6c8c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:46.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c94ff9640 1 -- 172.21.15.81:0/1118153523 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c015020 con 0x7f6c98103660 2024-09-12T01:36:46.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c94ff9640 1 -- 172.21.15.81:0/1118153523 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c8c011d10 con 0x7f6c98103660 2024-09-12T01:36:46.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c9deea640 1 -- 172.21.15.81:0/1118153523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c981a6df0 con 0x7f6c98103660 2024-09-12T01:36:46.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c94ff9640 1 -- 172.21.15.81:0/1118153523 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c00f2e0 con 0x7f6c98103660 2024-09-12T01:36:46.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.625+0000 7f6c9deea640 1 -- 172.21.15.81:0/1118153523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c981a7250 con 0x7f6c98103660 2024-09-12T01:36:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.627+0000 7f6c94ff9640 1 -- 172.21.15.81:0/1118153523 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6c8c018020 con 0x7f6c98103660 2024-09-12T01:36:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6ca02c3740 1 Processor -- start 2024-09-12T01:36:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6ca02c3740 1 -- start start 2024-09-12T01:36:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6c94ff9640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6c800a2cf0 0x7f6c800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6ca02c3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c44a0 0x5601ec5c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6ca02c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c4dc0 0x5601ec5cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6ca02c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5cf680 0x5601ec5d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6ca02c3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5601ec52a2e0 con 0x5601ec5c44a0 2024-09-12T01:36:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6ca02c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5601ec4d1ce0 con 0x5601ec5c4dc0 2024-09-12T01:36:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6ca02c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5601ec5262a0 con 0x5601ec5cf680 2024-09-12T01:36:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6c97fff640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6c800a2cf0 0x7f6c800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6c94ff9640 1 -- 172.21.15.81:0/1118153523 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f6c8c0cecd0 con 0x7f6c98103660 2024-09-12T01:36:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6c977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c44a0 0x5601ec5c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6c977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c44a0 0x5601ec5c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60536/0 (socket says 172.21.15.81:60536) 2024-09-12T01:36:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6c977fe640 1 -- 172.21.15.81:0/288547391 learned_addr learned my addr 172.21.15.81:0/288547391 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.628+0000 7f6c96ffd640 1 --2- 172.21.15.81:0/288547391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c4dc0 0x5601ec5cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.629+0000 7f6c97fff640 1 --2- 172.21.15.81:0/288547391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5cf680 0x5601ec5d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.629+0000 7f6c977fe640 1 -- 172.21.15.81:0/288547391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5cf680 msgr2=0x5601ec5d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.629+0000 7f6c977fe640 1 --2- 172.21.15.81:0/288547391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5cf680 0x5601ec5d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.629+0000 7f6c977fe640 1 -- 172.21.15.81:0/288547391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c4dc0 msgr2=0x5601ec5cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.629+0000 7f6c977fe640 1 --2- 172.21.15.81:0/288547391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c4dc0 0x5601ec5cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.629+0000 7f6c97fff640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6c800a2cf0 0x7f6c800a51b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c90006aa0 tx=0x7f6c90009dd0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.629+0000 7f6c977fe640 1 -- 172.21.15.81:0/288547391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601ec4b6440 con 0x5601ec5c44a0 2024-09-12T01:36:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.629+0000 7f6c977fe640 1 --2- 172.21.15.81:0/288547391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c44a0 0x5601ec5c4880 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f6c88030040 tx=0x7f6c880099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca4036dd52af8e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.629+0000 7f6c7dffb640 1 -- 172.21.15.81:0/288547391 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88034040 con 0x5601ec5c44a0 2024-09-12T01:36:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.629+0000 7f6c7dffb640 1 -- 172.21.15.81:0/288547391 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c88003970 con 0x5601ec5c44a0 2024-09-12T01:36:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.629+0000 7f6c7dffb640 1 -- 172.21.15.81:0/288547391 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88004620 con 0x5601ec5c44a0 2024-09-12T01:36:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.630+0000 7f6ca02c3740 1 -- 172.21.15.81:0/288547391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c44a0 msgr2=0x5601ec5c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.630+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/288547391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c44a0 0x5601ec5c4880 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f6c88030040 tx=0x7f6c880099b0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.630+0000 7f6ca02c3740 1 -- 172.21.15.81:0/288547391 shutdown_connections 2024-09-12T01:36:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.630+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/288547391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5cf680 0x5601ec5d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.630+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/288547391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c4dc0 0x5601ec5cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.630+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/288547391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c44a0 0x5601ec5c4880 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.630+0000 7f6ca02c3740 1 -- 172.21.15.81:0/288547391 >> 172.21.15.81:0/288547391 conn(0x5601ec5c0a30 msgr2=0x5601ec5c0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.630+0000 7f6ca02c3740 1 -- 172.21.15.81:0/288547391 shutdown_connections 2024-09-12T01:36:46.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.630+0000 7f6ca02c3740 1 -- 172.21.15.81:0/288547391 wait complete. 2024-09-12T01:36:46.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.630+0000 7f6ca02c3740 1 -- start start 2024-09-12T01:36:46.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6ca02c3740 1 Processor -- start 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6ca02c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c44a0 0x5601ec5ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6ca02c3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 0x5601ec5cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6ca02c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5cf680 0x5601ec5cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6ca02c3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5601ec5d2250 con 0x5601ec5c4dc0 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6ca02c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5601ec4e5050 con 0x5601ec5c44a0 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6ca02c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5601ec5d23d0 con 0x5601ec5cf680 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6ca02c3740 10 client.0 _ll_register_callbacks cb 0x5601ec525160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6c96ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 0x5601ec5cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6c96ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 0x5601ec5cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60544/0 (socket says 172.21.15.81:60544) 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6c96ffd640 1 -- 172.21.15.81:0/3793780524 learned_addr learned my addr 172.21.15.81:0/3793780524 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6c977fe640 1 --2- 172.21.15.81:0/3793780524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c44a0 0x5601ec5ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6c97fff640 1 --2- 172.21.15.81:0/3793780524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5cf680 0x5601ec5cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6c96ffd640 1 -- 172.21.15.81:0/3793780524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5cf680 msgr2=0x5601ec5cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6c96ffd640 1 --2- 172.21.15.81:0/3793780524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5cf680 0x5601ec5cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6c96ffd640 1 -- 172.21.15.81:0/3793780524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c44a0 msgr2=0x5601ec5ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6c96ffd640 1 --2- 172.21.15.81:0/3793780524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c44a0 0x5601ec5ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.631+0000 7f6c96ffd640 1 -- 172.21.15.81:0/3793780524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601ec29b3c0 con 0x5601ec5c4dc0 2024-09-12T01:36:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6c96ffd640 1 --2- 172.21.15.81:0/3793780524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 0x5601ec5cc150 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00bdb0 tx=0x7f6c8c0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b96b64158e9362 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6c76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6c76ffd640 1 -- 172.21.15.81:0/3793780524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c09b2a0 con 0x5601ec5c4dc0 2024-09-12T01:36:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6c76ffd640 1 -- 172.21.15.81:0/3793780524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f6c8c010510 con 0x5601ec5c4dc0 2024-09-12T01:36:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6ca02c3740 1 -- 172.21.15.81:0/3793780524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c88003970 con 0x5601ec5c4dc0 2024-09-12T01:36:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6c76ffd640 1 -- 172.21.15.81:0/3793780524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6c8c09f650 con 0x5601ec5c4dc0 2024-09-12T01:36:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6ca02c3740 10 client.17445 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6ca02c3740 1 -- 172.21.15.81:0/3793780524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5601ec5ddb60 con 0x5601ec5c4dc0 2024-09-12T01:36:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6c76ffd640 1 -- 172.21.15.81:0/3793780524 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c88003970 con 0x5601ec5c4dc0 2024-09-12T01:36:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6c76ffd640 1 -- 172.21.15.81:0/3793780524 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6c8c0cc6d0 con 0x5601ec5c4dc0 2024-09-12T01:36:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6ca02c3740 10 client.17445 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6ca02c3740 10 client.17445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:36:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6ca02c3740 20 client.17445 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/3793780524 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5601ec5def70 0x5601ec5e13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6ca02c3740 4 client.17445 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:36:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.632+0000 7f6ca02c3740 1 -- 172.21.15.81:0/3793780524 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601ec537850 con 0x5601ec5def70 2024-09-12T01:36:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.633+0000 7f6c977fe640 1 --2- 172.21.15.81:0/3793780524 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5601ec5def70 0x5601ec5e13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.633+0000 7f6c977fe640 1 --2- 172.21.15.81:0/3793780524 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5601ec5def70 0x5601ec5e13e0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d6f7970ed604a49 server_cookie=4e92d972dbba0b70 in_seq=0 out_seq=0 2024-09-12T01:36:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.633+0000 7f6c76ffd640 10 client.17445 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6c76ffd640 1 -- 172.21.15.81:0/3793780524 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601ec537850 con 0x5601ec5def70 2024-09-12T01:36:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6c76ffd640 10 client.17445 handle_command_reply: tid=0 2024-09-12T01:36:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6ca02c3740 1 client.17445 shutdown 2024-09-12T01:36:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6ca02c3740 1 -- 172.21.15.81:0/3793780524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 msgr2=0x5601ec5cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/3793780524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 0x5601ec5cc150 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00bdb0 tx=0x7f6c8c0092c0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6ca02c3740 1 -- 172.21.15.81:0/3793780524 shutdown_connections 2024-09-12T01:36:46.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/3793780524 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5601ec5def70 0x5601ec5e13e0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/3793780524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5cf680 0x5601ec5cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/3793780524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 0x5601ec5cc150 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/3793780524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c44a0 0x5601ec5ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6ca02c3740 1 -- 172.21.15.81:0/3793780524 >> 172.21.15.81:0/3793780524 conn(0x5601ec5c0a30 msgr2=0x5601ec5bfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:46.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6c76ffd640 0 client.17445 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:46.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6ca02c3740 1 -- 172.21.15.81:0/3793780524 shutdown_connections 2024-09-12T01:36:46.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6ca02c3740 1 -- 172.21.15.81:0/3793780524 wait complete. 2024-09-12T01:36:46.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.634+0000 7f6ca02c3740 20 client.17445 trim_cache size 0 max 16384 2024-09-12T01:36:46.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6ca02c3740 1 Processor -- start 2024-09-12T01:36:46.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6ca02c3740 1 -- start start 2024-09-12T01:36:46.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6ca02c3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c0a30 0x5601ec5e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6ca02c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c44a0 0x5601ec5e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6ca02c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5c4dc0 0x5601ec5c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6ca02c3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c981afaa0 con 0x5601ec5c0a30 2024-09-12T01:36:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6ca02c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6c981b15e0 con 0x5601ec5c44a0 2024-09-12T01:36:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6ca02c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c981b0170 con 0x5601ec5c4dc0 2024-09-12T01:36:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6c977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c0a30 0x5601ec5e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6c977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c0a30 0x5601ec5e6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60552/0 (socket says 172.21.15.81:60552) 2024-09-12T01:36:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6c977fe640 1 -- 172.21.15.81:0/1900576152 learned_addr learned my addr 172.21.15.81:0/1900576152 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6c96ffd640 1 --2- 172.21.15.81:0/1900576152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c44a0 0x5601ec5e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6c97fff640 1 --2- 172.21.15.81:0/1900576152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5c4dc0 0x5601ec5c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6c977fe640 1 -- 172.21.15.81:0/1900576152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5c4dc0 msgr2=0x5601ec5c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6c977fe640 1 --2- 172.21.15.81:0/1900576152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5c4dc0 0x5601ec5c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6c977fe640 1 -- 172.21.15.81:0/1900576152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c44a0 msgr2=0x5601ec5e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6c977fe640 1 --2- 172.21.15.81:0/1900576152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c44a0 0x5601ec5e71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6c977fe640 1 -- 172.21.15.81:0/1900576152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601ec5c04d0 con 0x5601ec5c0a30 2024-09-12T01:36:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.651+0000 7f6c977fe640 1 --2- 172.21.15.81:0/1900576152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c0a30 0x5601ec5e6c80 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f6c88004230 tx=0x7f6c88000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281a142a6fdc4038 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:46.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.652+0000 7f6c7d7fa640 1 -- 172.21.15.81:0/1900576152 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88049040 con 0x5601ec5c0a30 2024-09-12T01:36:46.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.652+0000 7f6c7d7fa640 1 -- 172.21.15.81:0/1900576152 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c88055020 con 0x5601ec5c0a30 2024-09-12T01:36:46.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.652+0000 7f6c7d7fa640 1 -- 172.21.15.81:0/1900576152 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88034040 con 0x5601ec5c0a30 2024-09-12T01:36:46.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.652+0000 7f6ca02c3740 1 -- 172.21.15.81:0/1900576152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c0a30 msgr2=0x5601ec5e6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.652+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/1900576152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c0a30 0x5601ec5e6c80 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f6c88004230 tx=0x7f6c88000f40 comp rx=0 tx=0).stop 2024-09-12T01:36:46.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.652+0000 7f6ca02c3740 1 -- 172.21.15.81:0/1900576152 shutdown_connections 2024-09-12T01:36:46.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.652+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/1900576152 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5c4dc0 0x5601ec5c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.652+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/1900576152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c44a0 0x5601ec5e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.652+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/1900576152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c0a30 0x5601ec5e6c80 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.652+0000 7f6ca02c3740 1 -- 172.21.15.81:0/1900576152 >> 172.21.15.81:0/1900576152 conn(0x5601ec5cc7f0 msgr2=0x5601ec5caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:46.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.652+0000 7f6ca02c3740 1 -- 172.21.15.81:0/1900576152 shutdown_connections 2024-09-12T01:36:46.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.652+0000 7f6ca02c3740 1 -- 172.21.15.81:0/1900576152 wait complete. 2024-09-12T01:36:46.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6ca02c3740 1 -- start start 2024-09-12T01:36:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6ca02c3740 1 Processor -- start 2024-09-12T01:36:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6ca02c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c0a30 0x5601ec5d3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6ca02c3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5c44a0 0x5601ec5d3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6ca02c3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 0x5601ec5d3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6ca02c3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c981b0f10 con 0x5601ec5c4dc0 2024-09-12T01:36:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6ca02c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6c981b0840 con 0x5601ec5c0a30 2024-09-12T01:36:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6ca02c3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6c981adaa0 con 0x5601ec5c44a0 2024-09-12T01:36:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6ca02c3740 10 client.0 _ll_register_callbacks cb 0x7f6c8c00b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6c97fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 0x5601ec5d3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6c97fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 0x5601ec5d3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60554/0 (socket says 172.21.15.81:60554) 2024-09-12T01:36:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6c97fff640 1 -- 172.21.15.81:0/2383023809 learned_addr learned my addr 172.21.15.81:0/2383023809 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:36:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6c977fe640 1 --2- 172.21.15.81:0/2383023809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c0a30 0x5601ec5d3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.653+0000 7f6c96ffd640 1 --2- 172.21.15.81:0/2383023809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5c44a0 0x5601ec5d3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6c97fff640 1 -- 172.21.15.81:0/2383023809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5c44a0 msgr2=0x5601ec5d3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6c97fff640 1 --2- 172.21.15.81:0/2383023809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5c44a0 0x5601ec5d3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6c97fff640 1 -- 172.21.15.81:0/2383023809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c0a30 msgr2=0x5601ec5d3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6c97fff640 1 --2- 172.21.15.81:0/2383023809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c0a30 0x5601ec5d3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6c97fff640 1 -- 172.21.15.81:0/2383023809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601ec651600 con 0x5601ec5c4dc0 2024-09-12T01:36:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6c97fff640 1 --2- 172.21.15.81:0/2383023809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 0x5601ec5d3fa0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009210 tx=0x7f6c900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b5e6d309b56408 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6c76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:36:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6c76ffd640 1 -- 172.21.15.81:0/2383023809 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90025070 con 0x5601ec5c4dc0 2024-09-12T01:36:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6c76ffd640 1 -- 172.21.15.81:0/2383023809 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8513+0+0 (secure 0 0 0) 0x7f6c90021800 con 0x5601ec5c4dc0 2024-09-12T01:36:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6ca02c3740 1 -- 172.21.15.81:0/2383023809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c88055020 con 0x5601ec5c4dc0 2024-09-12T01:36:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6c76ffd640 1 -- 172.21.15.81:0/2383023809 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6c90031050 con 0x5601ec5c4dc0 2024-09-12T01:36:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6ca02c3740 10 client.17451 fetch_fsmap learned FSMap version 28 2024-09-12T01:36:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6ca02c3740 1 -- 172.21.15.81:0/2383023809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5601ec652950 con 0x5601ec5c4dc0 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.654+0000 7f6c76ffd640 1 -- 172.21.15.81:0/2383023809 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c88055020 con 0x5601ec5c4dc0 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.655+0000 7f6c76ffd640 1 -- 172.21.15.81:0/2383023809 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6c90020070 con 0x5601ec5c4dc0 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.655+0000 7f6ca02c3740 10 client.17451 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.655+0000 7f6ca02c3740 10 client.17451 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.655+0000 7f6ca02c3740 20 client.17451 populate_metadata read hostname 'smithi081' 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.655+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/2383023809 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5601ec5cf680 0x5601ec655110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.655+0000 7f6ca02c3740 4 client.17451 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.655+0000 7f6ca02c3740 1 -- 172.21.15.81:0/2383023809 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5601ec531d60 con 0x5601ec5cf680 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.655+0000 7f6c977fe640 1 --2- 172.21.15.81:0/2383023809 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5601ec5cf680 0x5601ec655110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.655+0000 7f6c76ffd640 10 client.17451 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.655+0000 7f6c977fe640 1 --2- 172.21.15.81:0/2383023809 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5601ec5cf680 0x5601ec655110 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d59a7293c749c32 server_cookie=9296d34e0dbc6074 in_seq=0 out_seq=0 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.655+0000 7f6c76ffd640 1 -- 172.21.15.81:0/2383023809 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5601ec531d60 con 0x5601ec5cf680 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.655+0000 7f6c76ffd640 10 client.17451 handle_command_reply: tid=0 2024-09-12T01:36:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.655+0000 7f6ca02c3740 1 client.17451 shutdown 2024-09-12T01:36:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6ca02c3740 1 -- 172.21.15.81:0/2383023809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 msgr2=0x5601ec5d3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/2383023809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 0x5601ec5d3fa0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009210 tx=0x7f6c900046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6ca02c3740 1 -- 172.21.15.81:0/2383023809 shutdown_connections 2024-09-12T01:36:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/2383023809 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5601ec5cf680 0x5601ec655110 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/2383023809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5601ec5c4dc0 0x5601ec5d3fa0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/2383023809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5601ec5c44a0 0x5601ec5d3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6ca02c3740 1 --2- 172.21.15.81:0/2383023809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5601ec5c0a30 0x5601ec5d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6c76ffd640 0 client.17451 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:36:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6ca02c3740 1 -- 172.21.15.81:0/2383023809 >> 172.21.15.81:0/2383023809 conn(0x5601ec5cc7f0 msgr2=0x5601ec5bfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6ca02c3740 1 -- 172.21.15.81:0/2383023809 shutdown_connections 2024-09-12T01:36:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6ca02c3740 1 -- 172.21.15.81:0/2383023809 wait complete. 2024-09-12T01:36:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6ca02c3740 20 client.17451 trim_cache size 0 max 16384 2024-09-12T01:36:46.662 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:36:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:36:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-12T01:36:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "fb4c2586-6d88-4db9-b638-280baf9ad0d8": { 2024-09-12T01:36:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-09-12T01:36:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "fb4c2586-6d88-4db9-b638-280baf9ad0d8", 2024-09-12T01:36:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-12T01:36:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:36:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:36:46.662 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:36:46.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6c9deea640 1 -- 172.21.15.81:0/1118153523 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6c800a2cf0 msgr2=0x7f6c800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6c9deea640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6c800a2cf0 0x7f6c800a51b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c90006aa0 tx=0x7f6c90009dd0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6c9deea640 1 -- 172.21.15.81:0/1118153523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c98103660 msgr2=0x7f6c98100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6c9deea640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c98103660 0x7f6c98100ee0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00b3f0 tx=0x7f6c8c00b8b0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6c9deea640 1 -- 172.21.15.81:0/1118153523 shutdown_connections 2024-09-12T01:36:46.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6c9deea640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6c800a2cf0 0x7f6c800a51b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6c9deea640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6c9810c170 0x7f6c98101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6c9deea640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c98103660 0x7f6c98100ee0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6c9deea640 1 --2- 172.21.15.81:0/1118153523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c98102d40 0x7f6c981009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.656+0000 7f6c9deea640 1 -- 172.21.15.81:0/1118153523 >> 172.21.15.81:0/1118153523 conn(0x7f6c980fc7a0 msgr2=0x7f6c980fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:46.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.657+0000 7f6c9deea640 1 -- 172.21.15.81:0/1118153523 shutdown_connections 2024-09-12T01:36:46.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:36:46.657+0000 7f6c9deea640 1 -- 172.21.15.81:0/1118153523 wait complete. 2024-09-12T01:36:46.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:46 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:36:46.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:46 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:36:46.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:46 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:36:46.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:46 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:36:46.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:46 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:36:46.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:46 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:36:46.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:46 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:36:46.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:46 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:36:47.374 INFO:tasks.cephfs.filesystem:scrub status for tag:fb4c2586-6d88-4db9-b638-280baf9ad0d8 - {'path': '/', 'tag': 'fb4c2586-6d88-4db9-b638-280baf9ad0d8', 'options': 'recursive,force'} 2024-09-12T01:36:47.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:47 smithi081 ceph-mon[30920]: pgmap v268: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:36:47.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:47 smithi100 ceph-mon[35275]: pgmap v268: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:36:47.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:47 smithi189 ceph-mon[35357]: pgmap v268: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:36:49.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:49 smithi081 ceph-mon[30920]: pgmap v269: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:49.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:49 smithi100 ceph-mon[35275]: pgmap v269: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:49.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:49 smithi189 ceph-mon[35357]: pgmap v269: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:36:50.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:50 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:36:50.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:50 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:36:50.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:50 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:36:51.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:51 smithi081 ceph-mon[30920]: pgmap v270: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:36:51.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:51 smithi100 ceph-mon[35275]: pgmap v270: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:36:51.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:51 smithi189 ceph-mon[35357]: pgmap v270: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:36:53.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:53 smithi081 ceph-mon[30920]: pgmap v271: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:36:53.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:53 smithi100 ceph-mon[35275]: pgmap v271: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:36:53.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:53 smithi189 ceph-mon[35357]: pgmap v271: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:36:55.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:55 smithi081 ceph-mon[30920]: pgmap v272: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:36:55.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:55 smithi100 ceph-mon[35275]: pgmap v272: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:36:55.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:55 smithi189 ceph-mon[35357]: pgmap v272: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:36:57.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:57 smithi081 ceph-mon[30920]: pgmap v273: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:36:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:57 smithi100 ceph-mon[35275]: pgmap v273: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:36:57.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:57 smithi189 ceph-mon[35357]: pgmap v273: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:36:59.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:36:59 smithi081 ceph-mon[30920]: pgmap v274: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:36:59.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:36:59 smithi100 ceph-mon[35275]: pgmap v274: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:36:59.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:36:59 smithi189 ceph-mon[35357]: pgmap v274: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:37:01.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:01 smithi081 ceph-mon[30920]: pgmap v275: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:37:01.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:01 smithi100 ceph-mon[35275]: pgmap v275: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:37:01.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:01 smithi189 ceph-mon[35357]: pgmap v275: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:37:03.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:03 smithi081 ceph-mon[30920]: pgmap v276: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:03.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:03 smithi100 ceph-mon[35275]: pgmap v276: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:03.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:03 smithi189 ceph-mon[35357]: pgmap v276: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:05.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:05 smithi081 ceph-mon[30920]: pgmap v277: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:05.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:05 smithi100 ceph-mon[35275]: pgmap v277: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:05.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:05 smithi189 ceph-mon[35357]: pgmap v277: 97 pgs: 97 active+clean; 2.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:07.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:07 smithi081 ceph-mon[30920]: pgmap v278: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:37:07.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:07 smithi100 ceph-mon[35275]: pgmap v278: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:37:07.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:07 smithi189 ceph-mon[35357]: pgmap v278: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:37:09.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:09 smithi081 ceph-mon[30920]: pgmap v279: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T01:37:09.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:09 smithi100 ceph-mon[35275]: pgmap v279: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T01:37:09.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:09 smithi189 ceph-mon[35357]: pgmap v279: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T01:37:11.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:11 smithi100 ceph-mon[35275]: pgmap v280: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:37:11.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:11 smithi100 ceph-mon[35275]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T01:37:11.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:11 smithi189 ceph-mon[35357]: pgmap v280: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:37:11.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:11 smithi189 ceph-mon[35357]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T01:37:11.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:11 smithi081 ceph-mon[30920]: pgmap v280: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:37:11.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:11 smithi081 ceph-mon[30920]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T01:37:13.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:13 smithi100 ceph-mon[35275]: pgmap v282: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:37:13.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:13 smithi189 ceph-mon[35357]: pgmap v282: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:37:13.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:13 smithi081 ceph-mon[30920]: pgmap v282: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:37:15.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:15 smithi100 ceph-mon[35275]: pgmap v283: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:37:15.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:15 smithi189 ceph-mon[35357]: pgmap v283: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:37:15.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:15 smithi081 ceph-mon[30920]: pgmap v283: 97 pgs: 97 active+clean; 2.0 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:37:17.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:37:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:37:17.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:17 smithi081 ceph-mon[30920]: pgmap v284: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T01:37:17.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:17 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:37:17.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:17 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:17.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:17 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:37:17.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:17 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:37:17.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:17 smithi100 ceph-mon[35275]: pgmap v284: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T01:37:17.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:17 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:37:17.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:17 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:17.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:17 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:37:17.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:17 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:37:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:17 smithi189 ceph-mon[35357]: pgmap v284: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T01:37:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:17 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:37:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:17 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:17.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:17 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:37:17.783 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:17 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:37:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.067+0000 7f77628ff640 1 -- 172.21.15.81:0/2204167039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f775c102ef0 msgr2=0x7f775c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.067+0000 7f77628ff640 1 --2- 172.21.15.81:0/2204167039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f775c102ef0 0x7f775c10da40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7754009ca0 tx=0x7f775402a950 comp rx=0 tx=0).stop 2024-09-12T01:37:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.067+0000 7f77628ff640 1 -- 172.21.15.81:0/2204167039 shutdown_connections 2024-09-12T01:37:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.067+0000 7f77628ff640 1 --2- 172.21.15.81:0/2204167039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f775c102ef0 0x7f775c10da40 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.067+0000 7f77628ff640 1 --2- 172.21.15.81:0/2204167039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f775c102570 0x7f775c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.067+0000 7f77628ff640 1 --2- 172.21.15.81:0/2204167039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f775c100e20 0x7f775c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.067+0000 7f77628ff640 1 -- 172.21.15.81:0/2204167039 >> 172.21.15.81:0/2204167039 conn(0x7f775c0fc7d0 msgr2=0x7f775c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.067+0000 7f77628ff640 1 -- 172.21.15.81:0/2204167039 shutdown_connections 2024-09-12T01:37:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.067+0000 7f77628ff640 1 -- 172.21.15.81:0/2204167039 wait complete. 2024-09-12T01:37:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.068+0000 7f77628ff640 1 Processor -- start 2024-09-12T01:37:18.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.068+0000 7f77628ff640 1 -- start start 2024-09-12T01:37:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.068+0000 7f77628ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f775c100e20 0x7f775c1a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.068+0000 7f77628ff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f775c102570 0x7f775c1a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.068+0000 7f77628ff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f775c102ef0 0x7f775c19eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.068+0000 7f77628ff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f775c110fc0 con 0x7f775c100e20 2024-09-12T01:37:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.068+0000 7f77628ff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f775c110e40 con 0x7f775c102570 2024-09-12T01:37:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.068+0000 7f77628ff640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f775c111140 con 0x7f775c102ef0 2024-09-12T01:37:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.068+0000 7f775bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f775c100e20 0x7f775c1a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.068+0000 7f775bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f775c100e20 0x7f775c1a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60240/0 (socket says 172.21.15.81:60240) 2024-09-12T01:37:18.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.068+0000 7f775bfff640 1 -- 172.21.15.81:0/207861086 learned_addr learned my addr 172.21.15.81:0/207861086 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.068+0000 7f7760e9c640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f775c102ef0 0x7f775c19eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.069+0000 7f775b7fe640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f775c102570 0x7f775c1a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.069+0000 7f775bfff640 1 -- 172.21.15.81:0/207861086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f775c102ef0 msgr2=0x7f775c19eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.069+0000 7f775bfff640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f775c102ef0 0x7f775c19eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.069+0000 7f775bfff640 1 -- 172.21.15.81:0/207861086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f775c102570 msgr2=0x7f775c1a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.069+0000 7f775bfff640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f775c102570 0x7f775c1a4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.069+0000 7f775bfff640 1 -- 172.21.15.81:0/207861086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c19f3d0 con 0x7f775c100e20 2024-09-12T01:37:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.069+0000 7f775b7fe640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f775c102570 0x7f775c1a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.069+0000 7f775bfff640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f775c100e20 0x7f775c1a4770 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f774c00b4a0 tx=0x7f774c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.069+0000 7f77597fa640 1 -- 172.21.15.81:0/207861086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c014070 con 0x7f775c100e20 2024-09-12T01:37:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.069+0000 7f77628ff640 1 -- 172.21.15.81:0/207861086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c19f6c0 con 0x7f775c100e20 2024-09-12T01:37:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.069+0000 7f77597fa640 1 -- 172.21.15.81:0/207861086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f774c010af0 con 0x7f775c100e20 2024-09-12T01:37:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.069+0000 7f77597fa640 1 -- 172.21.15.81:0/207861086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c017d10 con 0x7f775c100e20 2024-09-12T01:37:18.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.069+0000 7f77628ff640 1 -- 172.21.15.81:0/207861086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c1ab6c0 con 0x7f775c100e20 2024-09-12T01:37:18.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.071+0000 7f77597fa640 1 -- 172.21.15.81:0/207861086 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f774c017070 con 0x7f775c100e20 2024-09-12T01:37:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.072+0000 7f77597fa640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f77480a2cf0 0x7f77480a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.072+0000 7f7764cd8740 1 Processor -- start 2024-09-12T01:37:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.072+0000 7f775b7fe640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f77480a2cf0 0x7f77480a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.072+0000 7f77597fa640 1 -- 172.21.15.81:0/207861086 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f774c0ce730 con 0x7f775c100e20 2024-09-12T01:37:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.072+0000 7f7764cd8740 1 -- start start 2024-09-12T01:37:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.072+0000 7f7764cd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42f4a0 0x5613ac42f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.072+0000 7f7764cd8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42fdc0 0x5613ac43a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.072+0000 7f7764cd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac43a680 0x5613ac43ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.072+0000 7f7764cd8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5613ac3952e0 con 0x5613ac42fdc0 2024-09-12T01:37:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.072+0000 7f7764cd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5613ac33cce0 con 0x5613ac43a680 2024-09-12T01:37:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.072+0000 7f7764cd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5613ac3912a0 con 0x5613ac42f4a0 2024-09-12T01:37:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f775b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42fdc0 0x5613ac43a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f775b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42fdc0 0x5613ac43a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60246/0 (socket says 172.21.15.81:60246) 2024-09-12T01:37:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f775b7fe640 1 -- 172.21.15.81:0/1719892538 learned_addr learned my addr 172.21.15.81:0/1719892538 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f775bfff640 1 --2- 172.21.15.81:0/1719892538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42f4a0 0x5613ac42f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f775b7fe640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f77480a2cf0 0x7f77480a51b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f77440058c0 tx=0x7f7744005850 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f7760e9c640 1 --2- 172.21.15.81:0/1719892538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac43a680 0x5613ac43ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f775b7fe640 1 -- 172.21.15.81:0/1719892538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42f4a0 msgr2=0x5613ac42f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f775b7fe640 1 --2- 172.21.15.81:0/1719892538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42f4a0 0x5613ac42f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f775b7fe640 1 -- 172.21.15.81:0/1719892538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac43a680 msgr2=0x5613ac43ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f775b7fe640 1 --2- 172.21.15.81:0/1719892538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac43a680 0x5613ac43ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f775b7fe640 1 -- 172.21.15.81:0/1719892538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ac321440 con 0x5613ac42fdc0 2024-09-12T01:37:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f775b7fe640 1 --2- 172.21.15.81:0/1719892538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42fdc0 0x5613ac43a140 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f774400bff0 tx=0x7f7744012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc7d57e5e03d244 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f77527fc640 1 -- 172.21.15.81:0/1719892538 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744022070 con 0x5613ac42fdc0 2024-09-12T01:37:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f77527fc640 1 -- 172.21.15.81:0/1719892538 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7744011e50 con 0x5613ac42fdc0 2024-09-12T01:37:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.073+0000 7f77527fc640 1 -- 172.21.15.81:0/1719892538 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774401dac0 con 0x5613ac42fdc0 2024-09-12T01:37:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.074+0000 7f7764cd8740 1 -- 172.21.15.81:0/1719892538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42fdc0 msgr2=0x5613ac43a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.074+0000 7f7764cd8740 1 --2- 172.21.15.81:0/1719892538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42fdc0 0x5613ac43a140 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f774400bff0 tx=0x7f7744012000 comp rx=0 tx=0).stop 2024-09-12T01:37:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.074+0000 7f7764cd8740 1 -- 172.21.15.81:0/1719892538 shutdown_connections 2024-09-12T01:37:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.074+0000 7f7764cd8740 1 --2- 172.21.15.81:0/1719892538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac43a680 0x5613ac43ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.074+0000 7f7764cd8740 1 --2- 172.21.15.81:0/1719892538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42fdc0 0x5613ac43a140 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.074+0000 7f7764cd8740 1 --2- 172.21.15.81:0/1719892538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42f4a0 0x5613ac42f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.074+0000 7f7764cd8740 1 -- 172.21.15.81:0/1719892538 >> 172.21.15.81:0/1719892538 conn(0x5613ac42ba30 msgr2=0x5613ac42be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.074+0000 7f7764cd8740 1 -- 172.21.15.81:0/1719892538 shutdown_connections 2024-09-12T01:37:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.074+0000 7f7764cd8740 1 -- 172.21.15.81:0/1719892538 wait complete. 2024-09-12T01:37:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.074+0000 7f7764cd8740 1 -- start start 2024-09-12T01:37:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7764cd8740 1 Processor -- start 2024-09-12T01:37:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7764cd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42f4a0 0x5613ac439f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7764cd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 0x5613ac4371b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7764cd8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac43a680 0x5613ac4376f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7764cd8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5613ac43d250 con 0x5613ac43a680 2024-09-12T01:37:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7764cd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5613ac350050 con 0x5613ac42fdc0 2024-09-12T01:37:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7764cd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5613ac43d3d0 con 0x5613ac42f4a0 2024-09-12T01:37:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7764cd8740 10 client.0 _ll_register_callbacks cb 0x5613ac390160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7760e9c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac43a680 0x5613ac4376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7760e9c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac43a680 0x5613ac4376f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60262/0 (socket says 172.21.15.81:60262) 2024-09-12T01:37:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7760e9c640 1 -- 172.21.15.81:0/3351616620 learned_addr learned my addr 172.21.15.81:0/3351616620 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f775b7fe640 1 --2- 172.21.15.81:0/3351616620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 0x5613ac4371b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f775bfff640 1 --2- 172.21.15.81:0/3351616620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42f4a0 0x5613ac439f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7760e9c640 1 -- 172.21.15.81:0/3351616620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42f4a0 msgr2=0x5613ac439f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7760e9c640 1 --2- 172.21.15.81:0/3351616620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42f4a0 0x5613ac439f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7760e9c640 1 -- 172.21.15.81:0/3351616620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 msgr2=0x5613ac4371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7760e9c640 1 --2- 172.21.15.81:0/3351616620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 0x5613ac4371b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.075+0000 7f7760e9c640 1 -- 172.21.15.81:0/3351616620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ac1063c0 con 0x5613ac43a680 2024-09-12T01:37:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f7760e9c640 1 --2- 172.21.15.81:0/3351616620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac43a680 0x5613ac4376f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f7754009ca0 tx=0x7f775402f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92dd6f56c3fe1657 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f773b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f773b7fe640 1 -- 172.21.15.81:0/3351616620 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754049060 con 0x5613ac43a680 2024-09-12T01:37:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f7764cd8740 1 -- 172.21.15.81:0/3351616620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7744011e50 con 0x5613ac43a680 2024-09-12T01:37:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f773b7fe640 1 -- 172.21.15.81:0/3351616620 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f7754003b70 con 0x5613ac43a680 2024-09-12T01:37:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f773b7fe640 1 -- 172.21.15.81:0/3351616620 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7754034040 con 0x5613ac43a680 2024-09-12T01:37:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f7764cd8740 10 client.17463 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f7764cd8740 1 -- 172.21.15.81:0/3351616620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5613ac448c10 con 0x5613ac43a680 2024-09-12T01:37:18.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f773b7fe640 1 -- 172.21.15.81:0/3351616620 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7744011e50 con 0x5613ac43a680 2024-09-12T01:37:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f773b7fe640 1 -- 172.21.15.81:0/3351616620 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7754030440 con 0x5613ac43a680 2024-09-12T01:37:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f7764cd8740 10 client.17463 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f7764cd8740 10 client.17463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:37:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f7764cd8740 20 client.17463 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f7764cd8740 1 --2- 172.21.15.81:0/3351616620 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5613ac44a020 0x5613ac44c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f7764cd8740 4 client.17463 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:37:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.076+0000 7f7764cd8740 1 -- 172.21.15.81:0/3351616620 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613ac3a2850 con 0x5613ac44a020 2024-09-12T01:37:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.077+0000 7f775bfff640 1 --2- 172.21.15.81:0/3351616620 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5613ac44a020 0x5613ac44c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.077+0000 7f773b7fe640 10 client.17463 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:18.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.077+0000 7f775bfff640 1 --2- 172.21.15.81:0/3351616620 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5613ac44a020 0x5613ac44c450 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0507ed3082e5a38 server_cookie=2859220b463024dd in_seq=0 out_seq=0 2024-09-12T01:37:18.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.078+0000 7f773b7fe640 1 -- 172.21.15.81:0/3351616620 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5613ac3a2850 con 0x5613ac44a020 2024-09-12T01:37:18.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.078+0000 7f773b7fe640 10 client.17463 handle_command_reply: tid=0 2024-09-12T01:37:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.078+0000 7f7764cd8740 1 client.17463 shutdown 2024-09-12T01:37:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.078+0000 7f7764cd8740 1 -- 172.21.15.81:0/3351616620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac43a680 msgr2=0x5613ac4376f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.078+0000 7f7764cd8740 1 --2- 172.21.15.81:0/3351616620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac43a680 0x5613ac4376f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f7754009ca0 tx=0x7f775402f3a0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.078+0000 7f7764cd8740 1 -- 172.21.15.81:0/3351616620 shutdown_connections 2024-09-12T01:37:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.078+0000 7f7764cd8740 1 --2- 172.21.15.81:0/3351616620 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5613ac44a020 0x5613ac44c450 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.078+0000 7f7764cd8740 1 --2- 172.21.15.81:0/3351616620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac43a680 0x5613ac4376f0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.078+0000 7f773b7fe640 0 client.17463 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.078+0000 7f7764cd8740 1 --2- 172.21.15.81:0/3351616620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 0x5613ac4371b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.078+0000 7f7764cd8740 1 --2- 172.21.15.81:0/3351616620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42f4a0 0x5613ac439f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.078+0000 7f7764cd8740 1 -- 172.21.15.81:0/3351616620 >> 172.21.15.81:0/3351616620 conn(0x5613ac42ba30 msgr2=0x5613ac431710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.079+0000 7f7764cd8740 1 -- 172.21.15.81:0/3351616620 shutdown_connections 2024-09-12T01:37:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.079+0000 7f7764cd8740 1 -- 172.21.15.81:0/3351616620 wait complete. 2024-09-12T01:37:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.079+0000 7f7764cd8740 20 client.17463 trim_cache size 0 max 16384 2024-09-12T01:37:18.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.095+0000 7f7764cd8740 1 Processor -- start 2024-09-12T01:37:18.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.095+0000 7f7764cd8740 1 -- start start 2024-09-12T01:37:18.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.095+0000 7f7764cd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42ba30 0x5613ac446510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.095+0000 7f7764cd8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 0x5613ac451d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.095+0000 7f7764cd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 0x5613ac452260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.095+0000 7f7764cd8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1b4000 con 0x5613ac42f4a0 2024-09-12T01:37:18.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.095+0000 7f7764cd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1b5b40 con 0x5613ac42fdc0 2024-09-12T01:37:18.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.095+0000 7f7764cd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1b46d0 con 0x5613ac42ba30 2024-09-12T01:37:18.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f775b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 0x5613ac451d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f775b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 0x5613ac451d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60266/0 (socket says 172.21.15.81:60266) 2024-09-12T01:37:18.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f775b7fe640 1 -- 172.21.15.81:0/1016350381 learned_addr learned my addr 172.21.15.81:0/1016350381 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:18.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f775bfff640 1 --2- 172.21.15.81:0/1016350381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42ba30 0x5613ac446510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f7760e9c640 1 --2- 172.21.15.81:0/1016350381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 0x5613ac452260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f775b7fe640 1 -- 172.21.15.81:0/1016350381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42ba30 msgr2=0x5613ac446510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:18.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f775b7fe640 1 --2- 172.21.15.81:0/1016350381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42ba30 0x5613ac446510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f775b7fe640 1 -- 172.21.15.81:0/1016350381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 msgr2=0x5613ac452260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:18.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f775b7fe640 1 --2- 172.21.15.81:0/1016350381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 0x5613ac452260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f775b7fe640 1 -- 172.21.15.81:0/1016350381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ac42c6c0 con 0x5613ac42f4a0 2024-09-12T01:37:18.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f775b7fe640 1 --2- 172.21.15.81:0/1016350381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 0x5613ac451d20 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f774401d770 tx=0x7f7744011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42dd3bc489c141f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:18.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f7751ffb640 1 -- 172.21.15.81:0/1016350381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744015070 con 0x5613ac42f4a0 2024-09-12T01:37:18.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f7751ffb640 1 -- 172.21.15.81:0/1016350381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f774401d7a0 con 0x5613ac42f4a0 2024-09-12T01:37:18.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.096+0000 7f7751ffb640 1 -- 172.21.15.81:0/1016350381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744022040 con 0x5613ac42f4a0 2024-09-12T01:37:18.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.097+0000 7f7764cd8740 1 -- 172.21.15.81:0/1016350381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 msgr2=0x5613ac451d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:18.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.097+0000 7f7764cd8740 1 --2- 172.21.15.81:0/1016350381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 0x5613ac451d20 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f774401d770 tx=0x7f7744011f00 comp rx=0 tx=0).stop 2024-09-12T01:37:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.097+0000 7f7764cd8740 1 -- 172.21.15.81:0/1016350381 shutdown_connections 2024-09-12T01:37:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.097+0000 7f7764cd8740 1 --2- 172.21.15.81:0/1016350381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 0x5613ac452260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.097+0000 7f7764cd8740 1 --2- 172.21.15.81:0/1016350381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 0x5613ac451d20 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.097+0000 7f7764cd8740 1 --2- 172.21.15.81:0/1016350381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42ba30 0x5613ac446510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.097+0000 7f7764cd8740 1 -- 172.21.15.81:0/1016350381 >> 172.21.15.81:0/1016350381 conn(0x5613ac437850 msgr2=0x5613ac435a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.097+0000 7f7764cd8740 1 -- 172.21.15.81:0/1016350381 shutdown_connections 2024-09-12T01:37:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.097+0000 7f7764cd8740 1 -- 172.21.15.81:0/1016350381 wait complete. 2024-09-12T01:37:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.097+0000 7f7764cd8740 1 -- start start 2024-09-12T01:37:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f7764cd8740 1 Processor -- start 2024-09-12T01:37:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f7764cd8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42ba30 0x5613ac43e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f7764cd8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 0x5613ac43e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f7764cd8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 0x5613ac43ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f7764cd8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1b5470 con 0x5613ac42f4a0 2024-09-12T01:37:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f7764cd8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1b4da0 con 0x5613ac42fdc0 2024-09-12T01:37:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f7764cd8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1b2000 con 0x5613ac42ba30 2024-09-12T01:37:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f7764cd8740 10 client.0 _ll_register_callbacks cb 0x7f775402fed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f775b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 0x5613ac43e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f775b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 0x5613ac43e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60278/0 (socket says 172.21.15.81:60278) 2024-09-12T01:37:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f775b7fe640 1 -- 172.21.15.81:0/3885469060 learned_addr learned my addr 172.21.15.81:0/3885469060 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f775b7fe640 1 -- 172.21.15.81:0/3885469060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42ba30 msgr2=0x5613ac43e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f775b7fe640 1 --2- 172.21.15.81:0/3885469060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42ba30 0x5613ac43e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f775b7fe640 1 -- 172.21.15.81:0/3885469060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 msgr2=0x5613ac43ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f7760e9c640 1 --2- 172.21.15.81:0/3885469060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 0x5613ac43ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f775b7fe640 1 --2- 172.21.15.81:0/3885469060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 0x5613ac43ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f775b7fe640 1 -- 172.21.15.81:0/3885469060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ac4b3cf0 con 0x5613ac42f4a0 2024-09-12T01:37:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f775b7fe640 1 --2- 172.21.15.81:0/3885469060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 0x5613ac43e8f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f774400fd30 tx=0x7f774401d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991e99496b4b545a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.098+0000 7f773b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f773b7fe640 1 -- 172.21.15.81:0/3885469060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744022070 con 0x5613ac42f4a0 2024-09-12T01:37:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f773b7fe640 1 -- 172.21.15.81:0/3885469060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8557+0+0 (secure 0 0 0) 0x7f7744005040 con 0x5613ac42f4a0 2024-09-12T01:37:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f7764cd8740 1 -- 172.21.15.81:0/3885469060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f774401d7a0 con 0x5613ac42f4a0 2024-09-12T01:37:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f773b7fe640 1 -- 172.21.15.81:0/3885469060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7744015040 con 0x5613ac42f4a0 2024-09-12T01:37:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f7764cd8740 10 client.17469 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f7764cd8740 1 -- 172.21.15.81:0/3885469060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5613ac4b4fb0 con 0x5613ac42f4a0 2024-09-12T01:37:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f773b7fe640 1 -- 172.21.15.81:0/3885469060 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f774401d7a0 con 0x5613ac42f4a0 2024-09-12T01:37:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f773b7fe640 1 -- 172.21.15.81:0/3885469060 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7744027450 con 0x5613ac42f4a0 2024-09-12T01:37:18.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f7764cd8740 10 client.17469 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f7764cd8740 10 client.17469 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:37:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f7764cd8740 20 client.17469 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f7764cd8740 1 --2- 172.21.15.81:0/3885469060 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5613ac43a680 0x5613ac4b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f7764cd8740 4 client.17469 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:37:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.099+0000 7f7764cd8740 1 -- 172.21.15.81:0/3885469060 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5613ac39cd60 con 0x5613ac43a680 2024-09-12T01:37:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.100+0000 7f775bfff640 1 --2- 172.21.15.81:0/3885469060 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5613ac43a680 0x5613ac4b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.100+0000 7f775bfff640 1 --2- 172.21.15.81:0/3885469060 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5613ac43a680 0x5613ac4b7490 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f456e0e3163add5 server_cookie=cb7eab99a4708818 in_seq=0 out_seq=0 2024-09-12T01:37:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.100+0000 7f773b7fe640 10 client.17469 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.100+0000 7f773b7fe640 1 -- 172.21.15.81:0/3885469060 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5613ac39cd60 con 0x5613ac43a680 2024-09-12T01:37:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.100+0000 7f773b7fe640 10 client.17469 handle_command_reply: tid=0 2024-09-12T01:37:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.100+0000 7f7764cd8740 1 client.17469 shutdown 2024-09-12T01:37:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.100+0000 7f7764cd8740 1 -- 172.21.15.81:0/3885469060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 msgr2=0x5613ac43e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.100+0000 7f7764cd8740 1 --2- 172.21.15.81:0/3885469060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 0x5613ac43e8f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f774400fd30 tx=0x7f774401d660 comp rx=0 tx=0).stop 2024-09-12T01:37:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.100+0000 7f7764cd8740 1 -- 172.21.15.81:0/3885469060 shutdown_connections 2024-09-12T01:37:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.100+0000 7f7764cd8740 1 --2- 172.21.15.81:0/3885469060 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x5613ac43a680 0x5613ac4b7490 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.100+0000 7f7764cd8740 1 --2- 172.21.15.81:0/3885469060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ac42fdc0 0x5613ac43ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.100+0000 7f7764cd8740 1 --2- 172.21.15.81:0/3885469060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613ac42f4a0 0x5613ac43e8f0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f7764cd8740 1 --2- 172.21.15.81:0/3885469060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5613ac42ba30 0x5613ac43e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f7764cd8740 1 -- 172.21.15.81:0/3885469060 >> 172.21.15.81:0/3885469060 conn(0x5613ac437850 msgr2=0x5613ac42a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f773b7fe640 0 client.17469 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f7764cd8740 1 -- 172.21.15.81:0/3885469060 shutdown_connections 2024-09-12T01:37:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f7764cd8740 1 -- 172.21.15.81:0/3885469060 wait complete. 2024-09-12T01:37:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f7764cd8740 20 client.17469 trim_cache size 0 max 16384 2024-09-12T01:37:18.108 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:37:18.108 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:37:18.108 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:37:18.108 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:37:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f77628ff640 1 -- 172.21.15.81:0/207861086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f77480a2cf0 msgr2=0x7f77480a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f77628ff640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f77480a2cf0 0x7f77480a51b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f77440058c0 tx=0x7f7744005850 comp rx=0 tx=0).stop 2024-09-12T01:37:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f77628ff640 1 -- 172.21.15.81:0/207861086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f775c100e20 msgr2=0x7f775c1a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f77628ff640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f775c100e20 0x7f775c1a4770 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f774c00b4a0 tx=0x7f774c00b960 comp rx=0 tx=0).stop 2024-09-12T01:37:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f77628ff640 1 -- 172.21.15.81:0/207861086 shutdown_connections 2024-09-12T01:37:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f77628ff640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f77480a2cf0 0x7f77480a51b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f77628ff640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f775c102ef0 0x7f775c19eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f77628ff640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f775c102570 0x7f775c1a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f77628ff640 1 --2- 172.21.15.81:0/207861086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f775c100e20 0x7f775c1a4770 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.101+0000 7f77628ff640 1 -- 172.21.15.81:0/207861086 >> 172.21.15.81:0/207861086 conn(0x7f775c0fc7d0 msgr2=0x7f775c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.102+0000 7f77628ff640 1 -- 172.21.15.81:0/207861086 shutdown_connections 2024-09-12T01:37:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:18.102+0000 7f77628ff640 1 -- 172.21.15.81:0/207861086 wait complete. 2024-09-12T01:37:19.010 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:37:19.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:37:19.267 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:37:19.712 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:19 smithi081 ceph-mon[30920]: pgmap v285: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T01:37:19.712 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:19 smithi081 ceph-mon[30920]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T01:37:19.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:19 smithi100 ceph-mon[35275]: pgmap v285: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T01:37:19.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:19 smithi100 ceph-mon[35275]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T01:37:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:19 smithi189 ceph-mon[35357]: pgmap v285: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T01:37:19.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:19 smithi189 ceph-mon[35357]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T01:37:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.793+0000 7fa8df315640 1 -- 172.21.15.81:0/887071953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d8102570 msgr2=0x7fa8d81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.793+0000 7fa8df315640 1 --2- 172.21.15.81:0/887071953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d8102570 0x7fa8d81029b0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009ca0 tx=0x7fa8cc02a950 comp rx=0 tx=0).stop 2024-09-12T01:37:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.793+0000 7fa8df315640 1 -- 172.21.15.81:0/887071953 shutdown_connections 2024-09-12T01:37:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.793+0000 7fa8df315640 1 --2- 172.21.15.81:0/887071953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d8102ef0 0x7fa8d810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.793+0000 7fa8df315640 1 --2- 172.21.15.81:0/887071953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d8102570 0x7fa8d81029b0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.793+0000 7fa8df315640 1 --2- 172.21.15.81:0/887071953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8d8100e20 0x7fa8d8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.793+0000 7fa8df315640 1 -- 172.21.15.81:0/887071953 >> 172.21.15.81:0/887071953 conn(0x7fa8d80fc7d0 msgr2=0x7fa8d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.793+0000 7fa8df315640 1 -- 172.21.15.81:0/887071953 shutdown_connections 2024-09-12T01:37:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.793+0000 7fa8df315640 1 -- 172.21.15.81:0/887071953 wait complete. 2024-09-12T01:37:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8df315640 1 Processor -- start 2024-09-12T01:37:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8df315640 1 -- start start 2024-09-12T01:37:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8df315640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8d8100e20 0x7fa8d8197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8df315640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d8102570 0x7fa8d8197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8df315640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d8102ef0 0x7fa8d819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8df315640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d8110fa0 con 0x7fa8d8102ef0 2024-09-12T01:37:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8df315640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d8110e20 con 0x7fa8d8100e20 2024-09-12T01:37:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8df315640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d8111120 con 0x7fa8d8102570 2024-09-12T01:37:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8dd8b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d8102ef0 0x7fa8d819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8dd8b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d8102ef0 0x7fa8d819bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60302/0 (socket says 172.21.15.81:60302) 2024-09-12T01:37:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8dd8b2640 1 -- 172.21.15.81:0/1170558620 learned_addr learned my addr 172.21.15.81:0/1170558620 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8dd0b1640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8d8100e20 0x7fa8d8197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8dc8b0640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d8102570 0x7fa8d8197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8dd8b2640 1 -- 172.21.15.81:0/1170558620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d8102570 msgr2=0x7fa8d8197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8dd8b2640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d8102570 0x7fa8d8197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8dd8b2640 1 -- 172.21.15.81:0/1170558620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8d8100e20 msgr2=0x7fa8d8197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8dd8b2640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8d8100e20 0x7fa8d8197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8dd8b2640 1 -- 172.21.15.81:0/1170558620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d819c3d0 con 0x7fa8d8102ef0 2024-09-12T01:37:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8dd0b1640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8d8100e20 0x7fa8d8197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.794+0000 7fa8dc8b0640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d8102570 0x7fa8d8197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.795+0000 7fa8dd8b2640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d8102ef0 0x7fa8d819bcf0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009fd0 tx=0x7fa8d000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.795+0000 7fa8d67fc640 1 -- 172.21.15.81:0/1170558620 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0011830 con 0x7fa8d8102ef0 2024-09-12T01:37:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.795+0000 7fa8d67fc640 1 -- 172.21.15.81:0/1170558620 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8d0016070 con 0x7fa8d8102ef0 2024-09-12T01:37:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.795+0000 7fa8d67fc640 1 -- 172.21.15.81:0/1170558620 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d000f2e0 con 0x7fa8d8102ef0 2024-09-12T01:37:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.795+0000 7fa8df315640 1 -- 172.21.15.81:0/1170558620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d819c6c0 con 0x7fa8d8102ef0 2024-09-12T01:37:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.795+0000 7fa8df315640 1 -- 172.21.15.81:0/1170558620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d81a3fa0 con 0x7fa8d8102ef0 2024-09-12T01:37:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.796+0000 7fa8df315640 1 -- 172.21.15.81:0/1170558620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d8101200 con 0x7fa8d8102ef0 2024-09-12T01:37:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.798+0000 7fa8d67fc640 1 -- 172.21.15.81:0/1170558620 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa8d00119d0 con 0x7fa8d8102ef0 2024-09-12T01:37:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.798+0000 7fa8d67fc640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8c00a2cf0 0x7fa8c00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.799+0000 7fa8d67fc640 1 -- 172.21.15.81:0/1170558620 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fa8d00cf140 con 0x7fa8d8102ef0 2024-09-12T01:37:19.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.799+0000 7fa8dd0b1640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8c00a2cf0 0x7fa8c00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.799+0000 7fa8dd0b1640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8c00a2cf0 0x7fa8c00a51b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80058c0 tx=0x7fa8c8005850 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:19.802+0000 7fa8d67fc640 1 -- 172.21.15.81:0/1170558620 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8d009be70 con 0x7fa8d8102ef0 2024-09-12T01:37:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.005+0000 7fa8df315640 1 -- 172.21.15.81:0/1170558620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8d8109090 con 0x7fa8d8102ef0 2024-09-12T01:37:20.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.006+0000 7fa8d67fc640 1 -- 172.21.15.81:0/1170558620 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fa8d009b770 con 0x7fa8d8102ef0 2024-09-12T01:37:20.005 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:37:20.006 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:37:20.006 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:37:20.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.008+0000 7fa8df315640 1 -- 172.21.15.81:0/1170558620 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8c00a2cf0 msgr2=0x7fa8c00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:20.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.008+0000 7fa8df315640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8c00a2cf0 0x7fa8c00a51b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80058c0 tx=0x7fa8c8005850 comp rx=0 tx=0).stop 2024-09-12T01:37:20.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.008+0000 7fa8df315640 1 -- 172.21.15.81:0/1170558620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d8102ef0 msgr2=0x7fa8d819bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:20.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.008+0000 7fa8df315640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d8102ef0 0x7fa8d819bcf0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009fd0 tx=0x7fa8d000b8e0 comp rx=0 tx=0).stop 2024-09-12T01:37:20.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.008+0000 7fa8df315640 1 -- 172.21.15.81:0/1170558620 shutdown_connections 2024-09-12T01:37:20.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.008+0000 7fa8df315640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fa8c00a2cf0 0x7fa8c00a51b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:20.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.008+0000 7fa8df315640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8d8102ef0 0x7fa8d819bcf0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:20.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.008+0000 7fa8df315640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d8102570 0x7fa8d8197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:20.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.008+0000 7fa8df315640 1 --2- 172.21.15.81:0/1170558620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8d8100e20 0x7fa8d8197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:20.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.008+0000 7fa8df315640 1 -- 172.21.15.81:0/1170558620 >> 172.21.15.81:0/1170558620 conn(0x7fa8d80fc7d0 msgr2=0x7fa8d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:20.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.008+0000 7fa8df315640 1 -- 172.21.15.81:0/1170558620 shutdown_connections 2024-09-12T01:37:20.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:20.008+0000 7fa8df315640 1 -- 172.21.15.81:0/1170558620 wait complete. 2024-09-12T01:37:20.717 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:20 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1170558620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:37:20.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:37:20.769 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:20 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1170558620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:37:20.826 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:20 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1170558620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:37:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:37:21.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.476+0000 7fc00f6c0640 1 -- 172.21.15.81:0/719124916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008100a60 msgr2=0x7fc008100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:21.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.476+0000 7fc00f6c0640 1 --2- 172.21.15.81:0/719124916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008100a60 0x7fc008100ec0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fc004009930 tx=0x7fc00402a420 comp rx=0 tx=0).stop 2024-09-12T01:37:21.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 -- 172.21.15.81:0/719124916 shutdown_connections 2024-09-12T01:37:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 --2- 172.21.15.81:0/719124916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc008101400 0x7fc00810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 --2- 172.21.15.81:0/719124916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008100a60 0x7fc008100ec0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 --2- 172.21.15.81:0/719124916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc008106a60 0x7fc008106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 -- 172.21.15.81:0/719124916 >> 172.21.15.81:0/719124916 conn(0x7fc0080fc780 msgr2=0x7fc0080feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 -- 172.21.15.81:0/719124916 shutdown_connections 2024-09-12T01:37:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 -- 172.21.15.81:0/719124916 wait complete. 2024-09-12T01:37:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 Processor -- start 2024-09-12T01:37:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 -- start start 2024-09-12T01:37:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc008100a60 0x7fc0081984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc008101400 0x7fc008198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008106a60 0x7fc00819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc008111f80 con 0x7fc008106a60 2024-09-12T01:37:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc008111e00 con 0x7fc008101400 2024-09-12T01:37:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.477+0000 7fc00f6c0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc008112100 con 0x7fc008100a60 2024-09-12T01:37:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00dc5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008106a60 0x7fc00819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00dc5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008106a60 0x7fc00819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60324/0 (socket says 172.21.15.81:60324) 2024-09-12T01:37:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00dc5d640 1 -- 172.21.15.81:0/588800716 learned_addr learned my addr 172.21.15.81:0/588800716 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc008101400 0x7fc008198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00d45c640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc008100a60 0x7fc0081984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00dc5d640 1 -- 172.21.15.81:0/588800716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc008100a60 msgr2=0x7fc0081984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00dc5d640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc008100a60 0x7fc0081984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00dc5d640 1 -- 172.21.15.81:0/588800716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc008101400 msgr2=0x7fc008198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:21.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00dc5d640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc008101400 0x7fc008198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00dc5d640 1 -- 172.21.15.81:0/588800716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00819d490 con 0x7fc008106a60 2024-09-12T01:37:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00d45c640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc008100a60 0x7fc0081984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00dc5d640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008106a60 0x7fc00819cdb0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fc00000b970 tx=0x7fc00000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fbffa7fc640 1 -- 172.21.15.81:0/588800716 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000019070 con 0x7fc008106a60 2024-09-12T01:37:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fbffa7fc640 1 -- 172.21.15.81:0/588800716 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc00000cb40 con 0x7fc008106a60 2024-09-12T01:37:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fbffa7fc640 1 -- 172.21.15.81:0/588800716 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000007650 con 0x7fc008106a60 2024-09-12T01:37:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00f6c0640 1 -- 172.21.15.81:0/588800716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00819d780 con 0x7fc008106a60 2024-09-12T01:37:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.478+0000 7fc00f6c0640 1 -- 172.21.15.81:0/588800716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0081a5060 con 0x7fc008106a60 2024-09-12T01:37:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.481+0000 7fbffa7fc640 1 -- 172.21.15.81:0/588800716 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc00001c070 con 0x7fc008106a60 2024-09-12T01:37:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.481+0000 7fc011a99740 1 Processor -- start 2024-09-12T01:37:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc011a99740 1 -- start start 2024-09-12T01:37:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc011a99740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 0x557987553090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc011a99740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 0x557987553a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc011a99740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x557987564b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc011a99740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5579874b92f0 con 0x557987562780 2024-09-12T01:37:21.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc011a99740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557987460cf0 con 0x557987554b40 2024-09-12T01:37:21.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc011a99740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5579874b52b0 con 0x5579875535d0 2024-09-12T01:37:21.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc00cc5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x557987564b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc00cc5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x557987564b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60332/0 (socket says 172.21.15.81:60332) 2024-09-12T01:37:21.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc00cc5b640 1 -- 172.21.15.81:0/542006946 learned_addr learned my addr 172.21.15.81:0/542006946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:21.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/542006946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 0x557987553090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc00d45c640 1 --2- 172.21.15.81:0/542006946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 0x557987553a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fbffa7fc640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbff40a2cf0 0x7fbff40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc00cc5b640 1 -- 172.21.15.81:0/542006946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 msgr2=0x557987553a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:21.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/542006946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 0x557987553a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc00cc5b640 1 -- 172.21.15.81:0/542006946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 msgr2=0x557987553090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/542006946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 0x557987553090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc00cc5b640 1 -- 172.21.15.81:0/542006946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579874453a0 con 0x557987562780 2024-09-12T01:37:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.482+0000 7fc00dc5d640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbff40a2cf0 0x7fbff40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.483+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/542006946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x557987564b70 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc0040096c0 tx=0x7fc00402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85120dda3450e30e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.483+0000 7fbffa7fc640 1 -- 172.21.15.81:0/588800716 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fc0000cea00 con 0x7fc008106a60 2024-09-12T01:37:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.483+0000 7fbff37fe640 1 -- 172.21.15.81:0/542006946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004035070 con 0x557987562780 2024-09-12T01:37:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.483+0000 7fbff37fe640 1 -- 172.21.15.81:0/542006946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc004005020 con 0x557987562780 2024-09-12T01:37:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.483+0000 7fbff37fe640 1 -- 172.21.15.81:0/542006946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004004a00 con 0x557987562780 2024-09-12T01:37:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.483+0000 7fc011a99740 1 -- 172.21.15.81:0/542006946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 msgr2=0x557987564b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.483+0000 7fc00dc5d640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbff40a2cf0 0x7fbff40a51b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc000097490 tx=0x7fc00006e0a0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.483+0000 7fc011a99740 1 --2- 172.21.15.81:0/542006946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x557987564b70 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc0040096c0 tx=0x7fc00402a420 comp rx=0 tx=0).stop 2024-09-12T01:37:21.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 -- 172.21.15.81:0/542006946 shutdown_connections 2024-09-12T01:37:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 --2- 172.21.15.81:0/542006946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x557987564b70 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 --2- 172.21.15.81:0/542006946 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 0x557987553a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 --2- 172.21.15.81:0/542006946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 0x557987553090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 -- 172.21.15.81:0/542006946 >> 172.21.15.81:0/542006946 conn(0x55798751c310 msgr2=0x55798754fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 -- 172.21.15.81:0/542006946 shutdown_connections 2024-09-12T01:37:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 -- 172.21.15.81:0/542006946 wait complete. 2024-09-12T01:37:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 -- start start 2024-09-12T01:37:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 Processor -- start 2024-09-12T01:37:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 0x5579875621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 0x55798755f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x55798755fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557987565420 con 0x557987562780 2024-09-12T01:37:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557987474060 con 0x557987554b40 2024-09-12T01:37:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5579875655a0 con 0x5579875535d0 2024-09-12T01:37:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.484+0000 7fc011a99740 10 client.0 _ll_register_callbacks cb 0x5579871c78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc00cc5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x55798755fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc00cc5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x55798755fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60334/0 (socket says 172.21.15.81:60334) 2024-09-12T01:37:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc00cc5b640 1 -- 172.21.15.81:0/1139549410 learned_addr learned my addr 172.21.15.81:0/1139549410 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc00d45c640 1 --2- 172.21.15.81:0/1139549410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 0x55798755f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/1139549410 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 0x5579875621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc00cc5b640 1 -- 172.21.15.81:0/1139549410 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 msgr2=0x5579875621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/1139549410 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 0x5579875621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc00cc5b640 1 -- 172.21.15.81:0/1139549410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 msgr2=0x55798755f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/1139549410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 0x55798755f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc00cc5b640 1 -- 172.21.15.81:0/1139549410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55798722a3c0 con 0x557987562780 2024-09-12T01:37:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/1139549410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x55798755fc00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc004032fd0 tx=0x7fc004032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e04945ce54574d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fbff0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fbff0ff9640 1 -- 172.21.15.81:0/1139549410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004035070 con 0x557987562780 2024-09-12T01:37:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fbff0ff9640 1 -- 172.21.15.81:0/1139549410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fc004004970 con 0x557987562780 2024-09-12T01:37:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc011a99740 1 -- 172.21.15.81:0/1139549410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc004005020 con 0x557987562780 2024-09-12T01:37:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fbff0ff9640 1 -- 172.21.15.81:0/1139549410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc00405c050 con 0x557987562780 2024-09-12T01:37:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc011a99740 10 client.17487 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.485+0000 7fc011a99740 1 -- 172.21.15.81:0/1139549410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557987570f10 con 0x557987562780 2024-09-12T01:37:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.486+0000 7fbff0ff9640 1 -- 172.21.15.81:0/1139549410 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc004005020 con 0x557987562780 2024-09-12T01:37:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.486+0000 7fbff0ff9640 1 -- 172.21.15.81:0/1139549410 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc00403c440 con 0x557987562780 2024-09-12T01:37:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.486+0000 7fc011a99740 10 client.17487 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.486+0000 7fc011a99740 10 client.17487 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:37:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.486+0000 7fc011a99740 20 client.17487 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.486+0000 7fc011a99740 1 --2- 172.21.15.81:0/1139549410 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x557987572260 0x557987574650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.486+0000 7fc011a99740 4 client.17487 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:37:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.486+0000 7fc011a99740 1 -- 172.21.15.81:0/1139549410 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579874c6860 con 0x557987572260 2024-09-12T01:37:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.486+0000 7fc00d45c640 1 --2- 172.21.15.81:0/1139549410 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x557987572260 0x557987574650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.487+0000 7fc00d45c640 1 --2- 172.21.15.81:0/1139549410 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x557987572260 0x557987574650 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7989130dc66170f5 server_cookie=cb2365a85543fd11 in_seq=0 out_seq=0 2024-09-12T01:37:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.487+0000 7fbff0ff9640 10 client.17487 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:37:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.487+0000 7fbff0ff9640 1 -- 172.21.15.81:0/1139549410 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5579874c6860 con 0x557987572260 2024-09-12T01:37:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.487+0000 7fbff0ff9640 10 client.17487 handle_command_reply: tid=0 2024-09-12T01:37:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.487+0000 7fc011a99740 1 client.17487 shutdown 2024-09-12T01:37:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.488+0000 7fc011a99740 1 -- 172.21.15.81:0/1139549410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 msgr2=0x55798755fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.488+0000 7fc011a99740 1 --2- 172.21.15.81:0/1139549410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x55798755fc00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc004032fd0 tx=0x7fc004032d50 comp rx=0 tx=0).stop 2024-09-12T01:37:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.488+0000 7fc011a99740 1 -- 172.21.15.81:0/1139549410 shutdown_connections 2024-09-12T01:37:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.488+0000 7fc011a99740 1 --2- 172.21.15.81:0/1139549410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x55798755fc00 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.488+0000 7fc011a99740 1 --2- 172.21.15.81:0/1139549410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 0x55798755f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.488+0000 7fc011a99740 1 --2- 172.21.15.81:0/1139549410 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x557987572260 0x557987574650 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.488+0000 7fc011a99740 1 --2- 172.21.15.81:0/1139549410 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 0x5579875621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.488+0000 7fc011a99740 1 -- 172.21.15.81:0/1139549410 >> 172.21.15.81:0/1139549410 conn(0x55798751c310 msgr2=0x557987555960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.488+0000 7fbff0ff9640 0 client.17487 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:37:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.488+0000 7fc011a99740 1 -- 172.21.15.81:0/1139549410 shutdown_connections 2024-09-12T01:37:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.488+0000 7fc011a99740 1 -- 172.21.15.81:0/1139549410 wait complete. 2024-09-12T01:37:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.488+0000 7fc011a99740 20 client.17487 trim_cache size 0 max 16384 2024-09-12T01:37:21.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.501+0000 7fc011a99740 1 Processor -- start 2024-09-12T01:37:21.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.501+0000 7fc011a99740 1 -- start start 2024-09-12T01:37:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.501+0000 7fc011a99740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579875535d0 0x55798755ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.501+0000 7fc011a99740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557987554b40 0x5579875613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.501+0000 7fc011a99740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987562780 0x557987577670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.501+0000 7fc011a99740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081ab740 con 0x5579875535d0 2024-09-12T01:37:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.501+0000 7fc011a99740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081ad280 con 0x557987562780 2024-09-12T01:37:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.501+0000 7fc011a99740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081abe10 con 0x557987554b40 2024-09-12T01:37:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.501+0000 7fc00cc5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579875535d0 0x55798755ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.502+0000 7fc00cc5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579875535d0 0x55798755ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60350/0 (socket says 172.21.15.81:60350) 2024-09-12T01:37:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.502+0000 7fc00cc5b640 1 -- 172.21.15.81:0/3364200836 learned_addr learned my addr 172.21.15.81:0/3364200836 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.502+0000 7fc00d45c640 1 --2- 172.21.15.81:0/3364200836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557987554b40 0x5579875613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.502+0000 7fc00cc5b640 1 -- 172.21.15.81:0/3364200836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557987554b40 msgr2=0x5579875613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:21.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.502+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/3364200836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557987554b40 0x5579875613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.502+0000 7fc00cc5b640 1 -- 172.21.15.81:0/3364200836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987562780 msgr2=0x557987577670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.502+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/3364200836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987562780 0x557987577670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.502+0000 7fc00cc5b640 1 -- 172.21.15.81:0/3364200836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579875560f0 con 0x5579875535d0 2024-09-12T01:37:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.502+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/3364200836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579875535d0 0x55798755ed30 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc004001eb0 tx=0x7fc004009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a258ba8dd51f091e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.502+0000 7fbff2ffd640 1 -- 172.21.15.81:0/3364200836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004035040 con 0x5579875535d0 2024-09-12T01:37:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.502+0000 7fbff2ffd640 1 -- 172.21.15.81:0/3364200836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc004053070 con 0x5579875535d0 2024-09-12T01:37:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.502+0000 7fbff2ffd640 1 -- 172.21.15.81:0/3364200836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004004c50 con 0x5579875535d0 2024-09-12T01:37:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.503+0000 7fc011a99740 1 -- 172.21.15.81:0/3364200836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579875535d0 msgr2=0x55798755ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.503+0000 7fc011a99740 1 --2- 172.21.15.81:0/3364200836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579875535d0 0x55798755ed30 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc004001eb0 tx=0x7fc004009640 comp rx=0 tx=0).stop 2024-09-12T01:37:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.503+0000 7fc011a99740 1 -- 172.21.15.81:0/3364200836 shutdown_connections 2024-09-12T01:37:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.503+0000 7fc011a99740 1 --2- 172.21.15.81:0/3364200836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987562780 0x557987577670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.503+0000 7fc011a99740 1 --2- 172.21.15.81:0/3364200836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557987554b40 0x5579875613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.503+0000 7fc011a99740 1 --2- 172.21.15.81:0/3364200836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5579875535d0 0x55798755ed30 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.503+0000 7fc011a99740 1 -- 172.21.15.81:0/3364200836 >> 172.21.15.81:0/3364200836 conn(0x55798751c310 msgr2=0x557987560cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.503+0000 7fc011a99740 1 -- 172.21.15.81:0/3364200836 shutdown_connections 2024-09-12T01:37:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.503+0000 7fc011a99740 1 -- 172.21.15.81:0/3364200836 wait complete. 2024-09-12T01:37:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.503+0000 7fc011a99740 1 -- start start 2024-09-12T01:37:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.503+0000 7fc011a99740 1 Processor -- start 2024-09-12T01:37:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc011a99740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 0x557987577be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc011a99740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 0x557987574f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc011a99740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x557987575470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc011a99740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081acbb0 con 0x557987562780 2024-09-12T01:37:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc011a99740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081ac4e0 con 0x557987554b40 2024-09-12T01:37:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc011a99740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081a9740 con 0x5579875535d0 2024-09-12T01:37:21.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc011a99740 10 client.0 _ll_register_callbacks cb 0x7fc004032e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc00cc5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x557987575470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc00cc5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x557987575470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60366/0 (socket says 172.21.15.81:60366) 2024-09-12T01:37:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc00cc5b640 1 -- 172.21.15.81:0/602369821 learned_addr learned my addr 172.21.15.81:0/602369821 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc00d45c640 1 --2- 172.21.15.81:0/602369821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 0x557987574f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/602369821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 0x557987577be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc00cc5b640 1 -- 172.21.15.81:0/602369821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 msgr2=0x557987577be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/602369821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 0x557987577be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc00cc5b640 1 -- 172.21.15.81:0/602369821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 msgr2=0x557987574f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/602369821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 0x557987574f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc00cc5b640 1 -- 172.21.15.81:0/602369821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557987575ab0 con 0x557987562780 2024-09-12T01:37:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fc00cc5b640 1 --2- 172.21.15.81:0/602369821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x557987575470 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fc004004720 tx=0x7fc004005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5126c31ecb0e9dcd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fbff0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:21.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.504+0000 7fbff0ff9640 1 -- 172.21.15.81:0/602369821 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004035070 con 0x557987562780 2024-09-12T01:37:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fbff0ff9640 1 -- 172.21.15.81:0/602369821 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fc00403c440 con 0x557987562780 2024-09-12T01:37:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fc011a99740 1 -- 172.21.15.81:0/602369821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc004053070 con 0x557987562780 2024-09-12T01:37:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fbff0ff9640 1 -- 172.21.15.81:0/602369821 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc00403cc90 con 0x557987562780 2024-09-12T01:37:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fc011a99740 10 client.17493 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fc011a99740 1 -- 172.21.15.81:0/602369821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5579875dc9b0 con 0x557987562780 2024-09-12T01:37:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fbff0ff9640 1 -- 172.21.15.81:0/602369821 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc004053070 con 0x557987562780 2024-09-12T01:37:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fbff0ff9640 1 -- 172.21.15.81:0/602369821 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc0040755a0 con 0x557987562780 2024-09-12T01:37:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fc011a99740 10 client.17493 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fc011a99740 10 client.17493 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:37:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fc011a99740 20 client.17493 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fc011a99740 1 --2- 172.21.15.81:0/602369821 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x5579875dcde0 0x5579875df1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fc011a99740 4 client.17493 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:37:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fc011a99740 1 -- 172.21.15.81:0/602369821 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5579874c0d70 con 0x5579875dcde0 2024-09-12T01:37:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.505+0000 7fc00d45c640 1 --2- 172.21.15.81:0/602369821 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x5579875dcde0 0x5579875df1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fc00d45c640 1 --2- 172.21.15.81:0/602369821 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x5579875dcde0 0x5579875df1d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aa0f3606f1107f3 server_cookie=d1d64d39517a26da in_seq=0 out_seq=0 2024-09-12T01:37:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fbff0ff9640 10 client.17493 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:37:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fbff0ff9640 1 -- 172.21.15.81:0/602369821 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5579874c0d70 con 0x5579875dcde0 2024-09-12T01:37:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fbff0ff9640 10 client.17493 handle_command_reply: tid=0 2024-09-12T01:37:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fc011a99740 1 client.17493 shutdown 2024-09-12T01:37:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fc011a99740 1 -- 172.21.15.81:0/602369821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 msgr2=0x557987575470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fc011a99740 1 --2- 172.21.15.81:0/602369821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x557987575470 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fc004004720 tx=0x7fc004005750 comp rx=0 tx=0).stop 2024-09-12T01:37:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fc011a99740 1 -- 172.21.15.81:0/602369821 shutdown_connections 2024-09-12T01:37:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fc011a99740 1 --2- 172.21.15.81:0/602369821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557987562780 0x557987575470 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fc011a99740 1 --2- 172.21.15.81:0/602369821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557987554b40 0x557987574f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fc011a99740 1 --2- 172.21.15.81:0/602369821 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x5579875dcde0 0x5579875df1d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fbff0ff9640 0 client.17493 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:37:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fc011a99740 1 --2- 172.21.15.81:0/602369821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579875535d0 0x557987577be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fc011a99740 1 -- 172.21.15.81:0/602369821 >> 172.21.15.81:0/602369821 conn(0x55798751c310 msgr2=0x55798756e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fc011a99740 1 -- 172.21.15.81:0/602369821 shutdown_connections 2024-09-12T01:37:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fc011a99740 1 -- 172.21.15.81:0/602369821 wait complete. 2024-09-12T01:37:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.506+0000 7fc011a99740 20 client.17493 trim_cache size 0 max 16384 2024-09-12T01:37:21.517 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:37:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.507+0000 7fc00f6c0640 1 -- 172.21.15.81:0/588800716 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbff40a2cf0 msgr2=0x7fbff40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.507+0000 7fc00f6c0640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbff40a2cf0 0x7fbff40a51b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc000097490 tx=0x7fc00006e0a0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.507+0000 7fc00f6c0640 1 -- 172.21.15.81:0/588800716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008106a60 msgr2=0x7fc00819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.507+0000 7fc00f6c0640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008106a60 0x7fc00819cdb0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fc00000b970 tx=0x7fc00000be30 comp rx=0 tx=0).stop 2024-09-12T01:37:21.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.507+0000 7fc00f6c0640 1 -- 172.21.15.81:0/588800716 shutdown_connections 2024-09-12T01:37:21.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.507+0000 7fc00f6c0640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbff40a2cf0 0x7fbff40a51b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.507+0000 7fc00f6c0640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008106a60 0x7fc00819cdb0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.507+0000 7fc00f6c0640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc008101400 0x7fc008198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.507+0000 7fc00f6c0640 1 --2- 172.21.15.81:0/588800716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc008100a60 0x7fc0081984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:21.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.507+0000 7fc00f6c0640 1 -- 172.21.15.81:0/588800716 >> 172.21.15.81:0/588800716 conn(0x7fc0080fc780 msgr2=0x7fc0080fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:21.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.507+0000 7fc00f6c0640 1 -- 172.21.15.81:0/588800716 shutdown_connections 2024-09-12T01:37:21.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:21.507+0000 7fc00f6c0640 1 -- 172.21.15.81:0/588800716 wait complete. 2024-09-12T01:37:21.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:21 smithi081 ceph-mon[30920]: pgmap v287: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 109 B/s wr, 10 op/s 2024-09-12T01:37:21.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:21 smithi100 ceph-mon[35275]: pgmap v287: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 109 B/s wr, 10 op/s 2024-09-12T01:37:21.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:21 smithi189 ceph-mon[35357]: pgmap v287: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 109 B/s wr, 10 op/s 2024-09-12T01:37:22.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:37:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:37:23.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.011+0000 7fd7d534f640 1 -- 172.21.15.81:0/1129119130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d0101de0 msgr2=0x7fd7d01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:23.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.011+0000 7fd7d534f640 1 --2- 172.21.15.81:0/1129119130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d0101de0 0x7fd7d01021c0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009900 tx=0x7fd7c002a410 comp rx=0 tx=0).stop 2024-09-12T01:37:23.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.011+0000 7fd7d534f640 1 -- 172.21.15.81:0/1129119130 shutdown_connections 2024-09-12T01:37:23.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.011+0000 7fd7d534f640 1 --2- 172.21.15.81:0/1129119130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7d0106f10 0x7fd7d010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.011+0000 7fd7d534f640 1 --2- 172.21.15.81:0/1129119130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0102790 0x7fd7d01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.011+0000 7fd7d534f640 1 --2- 172.21.15.81:0/1129119130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d0101de0 0x7fd7d01021c0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.011+0000 7fd7d534f640 1 -- 172.21.15.81:0/1129119130 >> 172.21.15.81:0/1129119130 conn(0x7fd7d00fd8c0 msgr2=0x7fd7d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:23.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.011+0000 7fd7d534f640 1 -- 172.21.15.81:0/1129119130 shutdown_connections 2024-09-12T01:37:23.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.011+0000 7fd7d534f640 1 -- 172.21.15.81:0/1129119130 wait complete. 2024-09-12T01:37:23.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7d534f640 1 Processor -- start 2024-09-12T01:37:23.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7d534f640 1 -- start start 2024-09-12T01:37:23.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7d534f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7d0101de0 0x7fd7d0198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7d534f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0102790 0x7fd7d0198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7d534f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d0106f10 0x7fd7d019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7d534f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d0111fe0 con 0x7fd7d0106f10 2024-09-12T01:37:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7d534f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d0111e60 con 0x7fd7d0102790 2024-09-12T01:37:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7d534f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d0112160 con 0x7fd7d0101de0 2024-09-12T01:37:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7cf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d0106f10 0x7fd7d019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7cf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d0106f10 0x7fd7d019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38198/0 (socket says 172.21.15.81:38198) 2024-09-12T01:37:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7cf7fe640 1 -- 172.21.15.81:0/3620970490 learned_addr learned my addr 172.21.15.81:0/3620970490 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7ce7fc640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0102790 0x7fd7d0198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7cf7fe640 1 -- 172.21.15.81:0/3620970490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7d0101de0 msgr2=0x7fd7d0198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7d0101de0 0x7fd7d0198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7cf7fe640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7d0101de0 0x7fd7d0198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7cf7fe640 1 -- 172.21.15.81:0/3620970490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0102790 msgr2=0x7fd7d0198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7cf7fe640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0102790 0x7fd7d0198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7cf7fe640 1 -- 172.21.15.81:0/3620970490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d019d4b0 con 0x7fd7d0106f10 2024-09-12T01:37:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7ce7fc640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0102790 0x7fd7d0198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.012+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7d0101de0 0x7fd7d0198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.013+0000 7fd7cf7fe640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d0106f10 0x7fd7d019cdd0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800b970 tx=0x7fd7c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.013+0000 7fd7c7fff640 1 -- 172.21.15.81:0/3620970490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8019070 con 0x7fd7d0106f10 2024-09-12T01:37:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.013+0000 7fd7d534f640 1 -- 172.21.15.81:0/3620970490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d019d7a0 con 0x7fd7d0106f10 2024-09-12T01:37:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.013+0000 7fd7c7fff640 1 -- 172.21.15.81:0/3620970490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7c800cb40 con 0x7fd7d0106f10 2024-09-12T01:37:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.013+0000 7fd7c7fff640 1 -- 172.21.15.81:0/3620970490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8007610 con 0x7fd7d0106f10 2024-09-12T01:37:23.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.013+0000 7fd7d534f640 1 -- 172.21.15.81:0/3620970490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d01a5080 con 0x7fd7d0106f10 2024-09-12T01:37:23.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.015+0000 7fd7c7fff640 1 -- 172.21.15.81:0/3620970490 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fd7c801c070 con 0x7fd7d0106f10 2024-09-12T01:37:23.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.015+0000 7fd7d7728740 1 Processor -- start 2024-09-12T01:37:23.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7d7728740 1 -- start start 2024-09-12T01:37:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7c7fff640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd7bc0a2cf0 0x7fd7bc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7d7728740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffdb40 0x55f78bffc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7d7728740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78bffc5d0 0x55f78bffca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7d7728740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78c007370 0x55f78c009760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7d7728740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f78bf622f0 con 0x55f78bffdb40 2024-09-12T01:37:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7d7728740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f78bf09cf0 con 0x55f78bffc5d0 2024-09-12T01:37:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7d7728740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f78bf5e2b0 con 0x55f78c007370 2024-09-12T01:37:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffdb40 0x55f78bffc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7ce7fc640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd7bc0a2cf0 0x7fd7bc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffdb40 0x55f78bffc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38208/0 (socket says 172.21.15.81:38208) 2024-09-12T01:37:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3458247627 learned_addr learned my addr 172.21.15.81:0/3458247627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:23.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7c7fff640 1 -- 172.21.15.81:0/3620970490 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fd7c80ce9a0 con 0x7fd7d0106f10 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3458247627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78c007370 msgr2=0x55f78c009760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/3458247627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78c007370 0x55f78c009760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3458247627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78bffc5d0 msgr2=0x55f78bffca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/3458247627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78bffc5d0 0x55f78bffca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.016+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3458247627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f78beee3a0 con 0x55f78bffdb40 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.017+0000 7fd7ce7fc640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd7bc0a2cf0 0x7fd7bc0a51b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd7d01087d0 tx=0x7fd7b8009f20 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.017+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/3458247627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffdb40 0x55f78bffc090 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0006010 tx=0x7fd7c0004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbcbc62e2f89087 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.017+0000 7fd7c57fa640 1 -- 172.21.15.81:0/3458247627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c003f070 con 0x55f78bffdb40 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.017+0000 7fd7c57fa640 1 -- 172.21.15.81:0/3458247627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7c0005520 con 0x55f78bffdb40 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.017+0000 7fd7c57fa640 1 -- 172.21.15.81:0/3458247627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0035030 con 0x55f78bffdb40 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 -- 172.21.15.81:0/3458247627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffdb40 msgr2=0x55f78bffc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3458247627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffdb40 0x55f78bffc090 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0006010 tx=0x7fd7c0004170 comp rx=0 tx=0).stop 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 -- 172.21.15.81:0/3458247627 shutdown_connections 2024-09-12T01:37:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3458247627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78c007370 0x55f78c009760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3458247627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78bffc5d0 0x55f78bffca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3458247627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffdb40 0x55f78bffc090 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 -- 172.21.15.81:0/3458247627 >> 172.21.15.81:0/3458247627 conn(0x55f78bfc5310 msgr2=0x55f78bff8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 -- 172.21.15.81:0/3458247627 shutdown_connections 2024-09-12T01:37:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 -- 172.21.15.81:0/3458247627 wait complete. 2024-09-12T01:37:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 -- start start 2024-09-12T01:37:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 Processor -- start 2024-09-12T01:37:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78bffc5d0 0x55f78c006d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 0x55f78c003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78c007370 0x55f78c0045e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f78c00a010 con 0x55f78c007370 2024-09-12T01:37:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f78bf1d060 con 0x55f78bffc5d0 2024-09-12T01:37:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f78c00a190 con 0x55f78bffdb40 2024-09-12T01:37:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.018+0000 7fd7d7728740 10 client.0 _ll_register_callbacks cb 0x55f78bc708c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7cf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78c007370 0x55f78c0045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7cf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78c007370 0x55f78c0045e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38210/0 (socket says 172.21.15.81:38210) 2024-09-12T01:37:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7cf7fe640 1 -- 172.21.15.81:0/3572425417 learned_addr learned my addr 172.21.15.81:0/3572425417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78bffc5d0 0x55f78c006d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7ce7fc640 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 0x55f78c003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7cf7fe640 1 -- 172.21.15.81:0/3572425417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 msgr2=0x55f78c003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7cf7fe640 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 0x55f78c003ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7cf7fe640 1 -- 172.21.15.81:0/3572425417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78bffc5d0 msgr2=0x55f78c006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7cf7fe640 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78bffc5d0 0x55f78c006d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7cf7fe640 1 -- 172.21.15.81:0/3572425417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f78bcd33c0 con 0x55f78c007370 2024-09-12T01:37:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78bffc5d0 0x55f78c006d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7cf7fe640 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78c007370 0x55f78c0045e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800b940 tx=0x7fd7c809b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67b71a1ead78733 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7b67fc640 1 -- 172.21.15.81:0/3572425417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c80cc510 con 0x55f78c007370 2024-09-12T01:37:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7b67fc640 1 -- 172.21.15.81:0/3572425417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fd7c80a3750 con 0x55f78c007370 2024-09-12T01:37:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7d7728740 1 -- 172.21.15.81:0/3572425417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7c0005520 con 0x55f78c007370 2024-09-12T01:37:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7b67fc640 1 -- 172.21.15.81:0/3572425417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd7c80a3be0 con 0x55f78c007370 2024-09-12T01:37:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7d7728740 10 client.17505 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7d7728740 1 -- 172.21.15.81:0/3572425417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f78c015a80 con 0x55f78c007370 2024-09-12T01:37:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.019+0000 7fd7b67fc640 1 -- 172.21.15.81:0/3572425417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7c0005520 con 0x55f78c007370 2024-09-12T01:37:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.020+0000 7fd7b67fc640 1 -- 172.21.15.81:0/3572425417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd7c809a3c0 con 0x55f78c007370 2024-09-12T01:37:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.020+0000 7fd7d7728740 10 client.17505 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:23.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.020+0000 7fd7d7728740 10 client.17505 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:37:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.020+0000 7fd7d7728740 20 client.17505 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.020+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55f78c016f40 0x55f78c019360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.020+0000 7fd7d7728740 4 client.17505 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:37:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.020+0000 7fd7d7728740 1 -- 172.21.15.81:0/3572425417 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f78bf6f860 con 0x55f78c016f40 2024-09-12T01:37:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.020+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55f78c016f40 0x55f78c019360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.021+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55f78c016f40 0x55f78c019360 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ffb3e158f6538726 server_cookie=5f5d37e6c48ec631 in_seq=0 out_seq=0 2024-09-12T01:37:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.021+0000 7fd7b67fc640 10 client.17505 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:37:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.021+0000 7fd7b67fc640 1 -- 172.21.15.81:0/3572425417 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f78bf6f860 con 0x55f78c016f40 2024-09-12T01:37:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.021+0000 7fd7b67fc640 10 client.17505 handle_command_reply: tid=0 2024-09-12T01:37:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.021+0000 7fd7d7728740 1 client.17505 shutdown 2024-09-12T01:37:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.021+0000 7fd7d7728740 1 -- 172.21.15.81:0/3572425417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78c007370 msgr2=0x55f78c0045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.021+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78c007370 0x55f78c0045e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800b940 tx=0x7fd7c809b7b0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.022+0000 7fd7d7728740 1 -- 172.21.15.81:0/3572425417 shutdown_connections 2024-09-12T01:37:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.022+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55f78c016f40 0x55f78c019360 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.022+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78c007370 0x55f78c0045e0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.022+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 0x55f78c003ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.022+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3572425417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78bffc5d0 0x55f78c006d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.022+0000 7fd7d7728740 1 -- 172.21.15.81:0/3572425417 >> 172.21.15.81:0/3572425417 conn(0x55f78bfc5310 msgr2=0x55f78bffe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.022+0000 7fd7b67fc640 0 client.17505 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:37:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.022+0000 7fd7d7728740 1 -- 172.21.15.81:0/3572425417 shutdown_connections 2024-09-12T01:37:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.022+0000 7fd7d7728740 1 -- 172.21.15.81:0/3572425417 wait complete. 2024-09-12T01:37:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.022+0000 7fd7d7728740 20 client.17505 trim_cache size 0 max 16384 2024-09-12T01:37:23.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.034+0000 7fd7d7728740 1 Processor -- start 2024-09-12T01:37:23.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.034+0000 7fd7d7728740 1 -- start start 2024-09-12T01:37:23.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7d7728740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 0x55f78c0132b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7d7728740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 0x55f78bff8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7d7728740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78c007370 0x55f78bff8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7d7728740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d01ad960 con 0x55f78bffc5d0 2024-09-12T01:37:23.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7d7728740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d01af4a0 con 0x55f78c007370 2024-09-12T01:37:23.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7d7728740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d01ae030 con 0x55f78bffdb40 2024-09-12T01:37:23.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 0x55f78c0132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 0x55f78c0132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38220/0 (socket says 172.21.15.81:38220) 2024-09-12T01:37:23.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3642946171 learned_addr learned my addr 172.21.15.81:0/3642946171 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7ce7fc640 1 --2- 172.21.15.81:0/3642946171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 0x55f78bff8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7cf7fe640 1 --2- 172.21.15.81:0/3642946171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78c007370 0x55f78bff8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3642946171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 msgr2=0x55f78bff8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/3642946171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 0x55f78bff8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3642946171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78c007370 msgr2=0x55f78bff8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/3642946171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78c007370 0x55f78bff8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3642946171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f78bff9180 con 0x55f78bffc5d0 2024-09-12T01:37:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7cf7fe640 1 --2- 172.21.15.81:0/3642946171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78c007370 0x55f78bff8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/3642946171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 0x55f78c0132b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0004b80 tx=0x7fd7c0004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd84d57061a1a752 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7c4ff9640 1 -- 172.21.15.81:0/3642946171 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c003f040 con 0x55f78bffc5d0 2024-09-12T01:37:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7c4ff9640 1 -- 172.21.15.81:0/3642946171 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7c0031c90 con 0x55f78bffc5d0 2024-09-12T01:37:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.035+0000 7fd7c4ff9640 1 -- 172.21.15.81:0/3642946171 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0035040 con 0x55f78bffc5d0 2024-09-12T01:37:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.036+0000 7fd7d7728740 1 -- 172.21.15.81:0/3642946171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 msgr2=0x55f78c0132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.036+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3642946171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 0x55f78c0132b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0004b80 tx=0x7fd7c0004b10 comp rx=0 tx=0).stop 2024-09-12T01:37:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.036+0000 7fd7d7728740 1 -- 172.21.15.81:0/3642946171 shutdown_connections 2024-09-12T01:37:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.036+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3642946171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78c007370 0x55f78bff8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.036+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3642946171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 0x55f78bff8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.036+0000 7fd7d7728740 1 --2- 172.21.15.81:0/3642946171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 0x55f78c0132b0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.036+0000 7fd7d7728740 1 -- 172.21.15.81:0/3642946171 >> 172.21.15.81:0/3642946171 conn(0x55f78bfc5310 msgr2=0x55f78c003fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.036+0000 7fd7d7728740 1 -- 172.21.15.81:0/3642946171 shutdown_connections 2024-09-12T01:37:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.036+0000 7fd7d7728740 1 -- 172.21.15.81:0/3642946171 wait complete. 2024-09-12T01:37:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.036+0000 7fd7d7728740 1 -- start start 2024-09-12T01:37:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7d7728740 1 Processor -- start 2024-09-12T01:37:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7d7728740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 0x55f78c00b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7d7728740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 0x55f78c00b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7d7728740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78c007370 0x55f78c00bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7d7728740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d01aedd0 con 0x55f78bffc5d0 2024-09-12T01:37:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7d7728740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d01ae700 con 0x55f78c007370 2024-09-12T01:37:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7d7728740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d01ab960 con 0x55f78bffdb40 2024-09-12T01:37:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7d7728740 10 client.0 _ll_register_callbacks cb 0x7fd7c8014b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 0x55f78c00b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 0x55f78c00b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38234/0 (socket says 172.21.15.81:38234) 2024-09-12T01:37:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7ceffd640 1 -- 172.21.15.81:0/2599214886 learned_addr learned my addr 172.21.15.81:0/2599214886 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7ce7fc640 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 0x55f78c00b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7cf7fe640 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78c007370 0x55f78c00bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7ceffd640 1 -- 172.21.15.81:0/2599214886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 msgr2=0x55f78c00b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 0x55f78c00b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7ceffd640 1 -- 172.21.15.81:0/2599214886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78c007370 msgr2=0x55f78c00bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78c007370 0x55f78c00bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7ceffd640 1 -- 172.21.15.81:0/2599214886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f78c080d80 con 0x55f78bffc5d0 2024-09-12T01:37:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7ce7fc640 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 0x55f78c00b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7cf7fe640 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78c007370 0x55f78c00bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 0x55f78c00b310 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd7c002a9d0 tx=0x7fd7c0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed6b31707b9eb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.037+0000 7fd7b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7b67fc640 1 -- 172.21.15.81:0/2599214886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c005d060 con 0x55f78bffc5d0 2024-09-12T01:37:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7b67fc640 1 -- 172.21.15.81:0/2599214886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fd7c00315b0 con 0x55f78bffc5d0 2024-09-12T01:37:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7d7728740 1 -- 172.21.15.81:0/2599214886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7c0031c90 con 0x55f78bffc5d0 2024-09-12T01:37:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7b67fc640 1 -- 172.21.15.81:0/2599214886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd7c0035070 con 0x55f78bffc5d0 2024-09-12T01:37:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7d7728740 10 client.17511 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7d7728740 1 -- 172.21.15.81:0/2599214886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f78c081fd0 con 0x55f78bffc5d0 2024-09-12T01:37:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7b67fc640 1 -- 172.21.15.81:0/2599214886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7c0031c90 con 0x55f78bffc5d0 2024-09-12T01:37:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7b67fc640 1 -- 172.21.15.81:0/2599214886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd7c0004bb0 con 0x55f78bffc5d0 2024-09-12T01:37:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7d7728740 10 client.17511 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7d7728740 10 client.17511 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:37:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7d7728740 20 client.17511 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7d7728740 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55f78c082250 0x55f78c084640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7d7728740 4 client.17511 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:37:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.038+0000 7fd7d7728740 1 -- 172.21.15.81:0/2599214886 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f78bf69d70 con 0x55f78c082250 2024-09-12T01:37:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7ce7fc640 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55f78c082250 0x55f78c084640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7b67fc640 10 client.17511 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:37:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7ce7fc640 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55f78c082250 0x55f78c084640 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ae4d0a86ceaae001 server_cookie=1ab5836c9ab9218f in_seq=0 out_seq=0 2024-09-12T01:37:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7b67fc640 1 -- 172.21.15.81:0/2599214886 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f78bf69d70 con 0x55f78c082250 2024-09-12T01:37:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7b67fc640 10 client.17511 handle_command_reply: tid=0 2024-09-12T01:37:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7d7728740 1 client.17511 shutdown 2024-09-12T01:37:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7d7728740 1 -- 172.21.15.81:0/2599214886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 msgr2=0x55f78c00b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7d7728740 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 0x55f78c00b310 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd7c002a9d0 tx=0x7fd7c0009260 comp rx=0 tx=0).stop 2024-09-12T01:37:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7d7728740 1 -- 172.21.15.81:0/2599214886 shutdown_connections 2024-09-12T01:37:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7d7728740 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x55f78c082250 0x55f78c084640 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7d7728740 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f78c007370 0x55f78c00bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7d7728740 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f78bffdb40 0x55f78c00b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7b67fc640 0 client.17511 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:37:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7d7728740 1 --2- 172.21.15.81:0/2599214886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f78bffc5d0 0x55f78c00b310 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.039+0000 7fd7d7728740 1 -- 172.21.15.81:0/2599214886 >> 172.21.15.81:0/2599214886 conn(0x55f78bfc5310 msgr2=0x55f78c002490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d7728740 1 -- 172.21.15.81:0/2599214886 shutdown_connections 2024-09-12T01:37:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d7728740 1 -- 172.21.15.81:0/2599214886 wait complete. 2024-09-12T01:37:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d7728740 20 client.17511 trim_cache size 0 max 16384 2024-09-12T01:37:23.046 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:37:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d534f640 1 -- 172.21.15.81:0/3620970490 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd7bc0a2cf0 msgr2=0x7fd7bc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d534f640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd7bc0a2cf0 0x7fd7bc0a51b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd7d01087d0 tx=0x7fd7b8009f20 comp rx=0 tx=0).stop 2024-09-12T01:37:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d534f640 1 -- 172.21.15.81:0/3620970490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d0106f10 msgr2=0x7fd7d019cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d534f640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d0106f10 0x7fd7d019cdd0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800b970 tx=0x7fd7c800be30 comp rx=0 tx=0).stop 2024-09-12T01:37:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d534f640 1 -- 172.21.15.81:0/3620970490 shutdown_connections 2024-09-12T01:37:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d534f640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd7bc0a2cf0 0x7fd7bc0a51b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d534f640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d0106f10 0x7fd7d019cdd0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d534f640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7d0102790 0x7fd7d0198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d534f640 1 --2- 172.21.15.81:0/3620970490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7d0101de0 0x7fd7d0198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d534f640 1 -- 172.21.15.81:0/3620970490 >> 172.21.15.81:0/3620970490 conn(0x7fd7d00fd8c0 msgr2=0x7fd7d00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d534f640 1 -- 172.21.15.81:0/3620970490 shutdown_connections 2024-09-12T01:37:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:23.040+0000 7fd7d534f640 1 -- 172.21.15.81:0/3620970490 wait complete. 2024-09-12T01:37:23.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:37:23.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:23 smithi189 ceph-mon[35357]: pgmap v288: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:37:23.965 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:37:23.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:23 smithi081 ceph-mon[30920]: pgmap v288: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:37:24.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:23 smithi100 ceph-mon[35275]: pgmap v288: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:37:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.461+0000 7efeac762640 1 -- 172.21.15.81:0/1194026379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea4102790 msgr2=0x7efea41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.461+0000 7efeac762640 1 --2- 172.21.15.81:0/1194026379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea4102790 0x7efea41067e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7efea0009900 tx=0x7efea002a410 comp rx=0 tx=0).stop 2024-09-12T01:37:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.461+0000 7efeac762640 1 -- 172.21.15.81:0/1194026379 shutdown_connections 2024-09-12T01:37:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.461+0000 7efeac762640 1 --2- 172.21.15.81:0/1194026379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efea4106f10 0x7efea410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.461+0000 7efeac762640 1 --2- 172.21.15.81:0/1194026379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea4102790 0x7efea41067e0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.461+0000 7efeac762640 1 --2- 172.21.15.81:0/1194026379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efea4101de0 0x7efea41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.461+0000 7efeac762640 1 -- 172.21.15.81:0/1194026379 >> 172.21.15.81:0/1194026379 conn(0x7efea40fd8c0 msgr2=0x7efea40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.461+0000 7efeac762640 1 -- 172.21.15.81:0/1194026379 shutdown_connections 2024-09-12T01:37:24.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.461+0000 7efeac762640 1 -- 172.21.15.81:0/1194026379 wait complete. 2024-09-12T01:37:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.462+0000 7efeac762640 1 Processor -- start 2024-09-12T01:37:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.462+0000 7efeac762640 1 -- start start 2024-09-12T01:37:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.462+0000 7efeac762640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efea4101de0 0x7efea4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.462+0000 7efeac762640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea4102790 0x7efea41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.462+0000 7efeac762640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efea4106f10 0x7efea419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.462+0000 7efeac762640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efea4111f90 con 0x7efea4102790 2024-09-12T01:37:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.462+0000 7efeac762640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efea4111e10 con 0x7efea4101de0 2024-09-12T01:37:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.462+0000 7efeac762640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efea4112110 con 0x7efea4106f10 2024-09-12T01:37:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.462+0000 7efea9cfd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea4102790 0x7efea41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.462+0000 7efea9cfd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea4102790 0x7efea41989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38254/0 (socket says 172.21.15.81:38254) 2024-09-12T01:37:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.462+0000 7efea9cfd640 1 -- 172.21.15.81:0/3177382501 learned_addr learned my addr 172.21.15.81:0/3177382501 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.462+0000 7efeaa4fe640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efea4101de0 0x7efea4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.463+0000 7efeaacff640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efea4106f10 0x7efea419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.463+0000 7efea9cfd640 1 -- 172.21.15.81:0/3177382501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efea4106f10 msgr2=0x7efea419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.463+0000 7efea9cfd640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efea4106f10 0x7efea419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.463+0000 7efea9cfd640 1 -- 172.21.15.81:0/3177382501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efea4101de0 msgr2=0x7efea4198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.463+0000 7efea9cfd640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efea4101de0 0x7efea4198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.463+0000 7efea9cfd640 1 -- 172.21.15.81:0/3177382501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea419d440 con 0x7efea4102790 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.463+0000 7efeaacff640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efea4106f10 0x7efea419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.463+0000 7efea9cfd640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea4102790 0x7efea41989d0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7efea0006010 tx=0x7efea00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.463+0000 7efe9b7fe640 1 -- 172.21.15.81:0/3177382501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea003f030 con 0x7efea4102790 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.463+0000 7efe9b7fe640 1 -- 172.21.15.81:0/3177382501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efea0003ce0 con 0x7efea4102790 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.463+0000 7efeac762640 1 -- 172.21.15.81:0/3177382501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea419d6d0 con 0x7efea4102790 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.463+0000 7efe9b7fe640 1 -- 172.21.15.81:0/3177382501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0035070 con 0x7efea4102790 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.463+0000 7efeac762640 1 -- 172.21.15.81:0/3177382501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea41a5010 con 0x7efea4102790 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.465+0000 7efe9b7fe640 1 -- 172.21.15.81:0/3177382501 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7efea0042030 con 0x7efea4102790 2024-09-12T01:37:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efeaeb3b740 1 Processor -- start 2024-09-12T01:37:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efeaeb3b740 1 -- start start 2024-09-12T01:37:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efeaeb3b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee5b40 0x56082aee4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efeaeb3b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 0x56082aee4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efeaeb3b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aef1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efeaeb3b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56082ae4a2f0 con 0x56082aee45d0 2024-09-12T01:37:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efeaeb3b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56082adf1cf0 con 0x56082aeef370 2024-09-12T01:37:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efeaeb3b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56082ae462b0 con 0x56082aee5b40 2024-09-12T01:37:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efeaa4fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 0x56082aee4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efe9b7fe640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efe900a2d70 0x7efe900a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efeaa4fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 0x56082aee4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38266/0 (socket says 172.21.15.81:38266) 2024-09-12T01:37:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efeaa4fe640 1 -- 172.21.15.81:0/1179682784 learned_addr learned my addr 172.21.15.81:0/1179682784 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:24.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efeaacff640 1 --2- 172.21.15.81:0/1179682784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee5b40 0x56082aee4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efeaacff640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efe900a2d70 0x7efe900a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.466+0000 7efea9cfd640 1 --2- 172.21.15.81:0/1179682784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aef1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.467+0000 7efe9b7fe640 1 -- 172.21.15.81:0/3177382501 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7efea00ef4c0 con 0x7efea4102790 2024-09-12T01:37:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.467+0000 7efeaa4fe640 1 -- 172.21.15.81:0/1179682784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee5b40 msgr2=0x56082aee4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.467+0000 7efeaa4fe640 1 --2- 172.21.15.81:0/1179682784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee5b40 0x56082aee4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.467+0000 7efeaa4fe640 1 -- 172.21.15.81:0/1179682784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 msgr2=0x56082aef1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.467+0000 7efeaa4fe640 1 --2- 172.21.15.81:0/1179682784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aef1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.467+0000 7efeaa4fe640 1 -- 172.21.15.81:0/1179682784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56082add63a0 con 0x56082aee45d0 2024-09-12T01:37:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.467+0000 7efea9cfd640 1 --2- 172.21.15.81:0/1179682784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aef1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.467+0000 7efeaa4fe640 1 --2- 172.21.15.81:0/1179682784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 0x56082aee4a10 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7efe94009a70 tx=0x7efe94009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83a73848a05f225 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.467+0000 7efeaacff640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efe900a2d70 0x7efe900a5230 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009fd0 tx=0x7efe9c0094a0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.467+0000 7efe98ff9640 1 -- 172.21.15.81:0/1179682784 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94017070 con 0x56082aee45d0 2024-09-12T01:37:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.467+0000 7efe98ff9640 1 -- 172.21.15.81:0/1179682784 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe94013470 con 0x56082aee45d0 2024-09-12T01:37:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.467+0000 7efe98ff9640 1 -- 172.21.15.81:0/1179682784 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe940125d0 con 0x56082aee45d0 2024-09-12T01:37:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.468+0000 7efeaeb3b740 1 -- 172.21.15.81:0/1179682784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 msgr2=0x56082aee4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.468+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/1179682784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 0x56082aee4a10 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7efe94009a70 tx=0x7efe94009f30 comp rx=0 tx=0).stop 2024-09-12T01:37:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.468+0000 7efeaeb3b740 1 -- 172.21.15.81:0/1179682784 shutdown_connections 2024-09-12T01:37:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.468+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/1179682784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aef1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.468+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/1179682784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 0x56082aee4a10 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.468+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/1179682784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee5b40 0x56082aee4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.468+0000 7efeaeb3b740 1 -- 172.21.15.81:0/1179682784 >> 172.21.15.81:0/1179682784 conn(0x56082aead310 msgr2=0x56082aee0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.468+0000 7efeaeb3b740 1 -- 172.21.15.81:0/1179682784 shutdown_connections 2024-09-12T01:37:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.468+0000 7efeaeb3b740 1 -- 172.21.15.81:0/1179682784 wait complete. 2024-09-12T01:37:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.468+0000 7efeaeb3b740 1 -- start start 2024-09-12T01:37:24.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.468+0000 7efeaeb3b740 1 Processor -- start 2024-09-12T01:37:24.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efeaeb3b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee45d0 0x56082aeeece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efeaeb3b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee5b40 0x56082aeebf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efeaeb3b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aeec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efeaeb3b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56082aef2070 con 0x56082aee5b40 2024-09-12T01:37:24.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efeaeb3b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56082ae05060 con 0x56082aeef370 2024-09-12T01:37:24.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efeaeb3b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56082aef21f0 con 0x56082aee45d0 2024-09-12T01:37:24.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efeaeb3b740 10 client.0 _ll_register_callbacks cb 0x56082ab588c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:24.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efea9cfd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee5b40 0x56082aeebf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efea9cfd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee5b40 0x56082aeebf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38272/0 (socket says 172.21.15.81:38272) 2024-09-12T01:37:24.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efea9cfd640 1 -- 172.21.15.81:0/3871948528 learned_addr learned my addr 172.21.15.81:0/3871948528 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:24.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efeaacff640 1 --2- 172.21.15.81:0/3871948528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aeec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efeaa4fe640 1 --2- 172.21.15.81:0/3871948528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee45d0 0x56082aeeece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efea9cfd640 1 -- 172.21.15.81:0/3871948528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee45d0 msgr2=0x56082aeeece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efea9cfd640 1 --2- 172.21.15.81:0/3871948528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee45d0 0x56082aeeece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efea9cfd640 1 -- 172.21.15.81:0/3871948528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 msgr2=0x56082aeec4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efea9cfd640 1 --2- 172.21.15.81:0/3871948528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aeec4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efea9cfd640 1 -- 172.21.15.81:0/3871948528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56082abbb3c0 con 0x56082aee5b40 2024-09-12T01:37:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efea9cfd640 1 --2- 172.21.15.81:0/3871948528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee5b40 0x56082aeebf90 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7efea00bb6e0 tx=0x7efea0044f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a9536e88a4535f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efe8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efe8dffb640 1 -- 172.21.15.81:0/3871948528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0049040 con 0x56082aee5b40 2024-09-12T01:37:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efe8dffb640 1 -- 172.21.15.81:0/3871948528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7efea003bc40 con 0x56082aee5b40 2024-09-12T01:37:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.469+0000 7efeaeb3b740 1 -- 172.21.15.81:0/3871948528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe94013470 con 0x56082aee5b40 2024-09-12T01:37:24.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.470+0000 7efe8dffb640 1 -- 172.21.15.81:0/3871948528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efea00bb340 con 0x56082aee5b40 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.470+0000 7efeaeb3b740 10 client.17523 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.470+0000 7efeaeb3b740 1 -- 172.21.15.81:0/3871948528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56082aefd9f0 con 0x56082aee5b40 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.470+0000 7efe8dffb640 1 -- 172.21.15.81:0/3871948528 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe94013470 con 0x56082aee5b40 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.470+0000 7efe8dffb640 1 -- 172.21.15.81:0/3871948528 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efea004c060 con 0x56082aee5b40 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.470+0000 7efeaeb3b740 10 client.17523 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.470+0000 7efeaeb3b740 10 client.17523 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.470+0000 7efeaeb3b740 20 client.17523 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.470+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/3871948528 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x56082aefed90 0x56082af01180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.470+0000 7efeaeb3b740 4 client.17523 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.470+0000 7efeaeb3b740 1 -- 172.21.15.81:0/3871948528 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56082ae57860 con 0x56082aefed90 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.470+0000 7efeaa4fe640 1 --2- 172.21.15.81:0/3871948528 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x56082aefed90 0x56082af01180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.471+0000 7efeaa4fe640 1 --2- 172.21.15.81:0/3871948528 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x56082aefed90 0x56082af01180 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8c274d3d1fe4e5f0 server_cookie=2e4d4b6feff2d12b in_seq=0 out_seq=0 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.471+0000 7efe8dffb640 10 client.17523 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:37:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.471+0000 7efe8dffb640 1 -- 172.21.15.81:0/3871948528 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56082ae57860 con 0x56082aefed90 2024-09-12T01:37:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.471+0000 7efe8dffb640 10 client.17523 handle_command_reply: tid=0 2024-09-12T01:37:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.471+0000 7efeaeb3b740 1 client.17523 shutdown 2024-09-12T01:37:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.472+0000 7efeaeb3b740 1 -- 172.21.15.81:0/3871948528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee5b40 msgr2=0x56082aeebf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.472+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/3871948528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee5b40 0x56082aeebf90 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7efea00bb6e0 tx=0x7efea0044f90 comp rx=0 tx=0).stop 2024-09-12T01:37:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.472+0000 7efeaeb3b740 1 -- 172.21.15.81:0/3871948528 shutdown_connections 2024-09-12T01:37:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.472+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/3871948528 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x56082aefed90 0x56082af01180 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.472+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/3871948528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aeec4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.472+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/3871948528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee5b40 0x56082aeebf90 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.472+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/3871948528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee45d0 0x56082aeeece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.472+0000 7efeaeb3b740 1 -- 172.21.15.81:0/3871948528 >> 172.21.15.81:0/3871948528 conn(0x56082aead310 msgr2=0x56082aee6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.472+0000 7efe8dffb640 0 client.17523 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:37:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.472+0000 7efeaeb3b740 1 -- 172.21.15.81:0/3871948528 shutdown_connections 2024-09-12T01:37:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.472+0000 7efeaeb3b740 1 -- 172.21.15.81:0/3871948528 wait complete. 2024-09-12T01:37:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.472+0000 7efeaeb3b740 20 client.17523 trim_cache size 0 max 16384 2024-09-12T01:37:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.484+0000 7efeaeb3b740 1 Processor -- start 2024-09-12T01:37:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efeaeb3b740 1 -- start start 2024-09-12T01:37:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efeaeb3b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aee45d0 0x56082aefb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efeaeb3b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aeef370 0x56082aee0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efeaeb3b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee0c40 0x56082af06a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efeaeb3b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efea41ad820 con 0x56082aeef370 2024-09-12T01:37:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efeaeb3b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efea41af360 con 0x56082aee45d0 2024-09-12T01:37:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efeaeb3b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efea41adef0 con 0x56082aee0c40 2024-09-12T01:37:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efea9cfd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aeef370 0x56082aee0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efea9cfd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aeef370 0x56082aee0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38288/0 (socket says 172.21.15.81:38288) 2024-09-12T01:37:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efea9cfd640 1 -- 172.21.15.81:0/2098482499 learned_addr learned my addr 172.21.15.81:0/2098482499 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efeaacff640 1 --2- 172.21.15.81:0/2098482499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee0c40 0x56082af06a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efeaa4fe640 1 --2- 172.21.15.81:0/2098482499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aee45d0 0x56082aefb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efea9cfd640 1 -- 172.21.15.81:0/2098482499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee0c40 msgr2=0x56082af06a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efea9cfd640 1 --2- 172.21.15.81:0/2098482499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee0c40 0x56082af06a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efea9cfd640 1 -- 172.21.15.81:0/2098482499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aee45d0 msgr2=0x56082aefb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efea9cfd640 1 --2- 172.21.15.81:0/2098482499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aee45d0 0x56082aefb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efea9cfd640 1 -- 172.21.15.81:0/2098482499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56082aee1730 con 0x56082aeef370 2024-09-12T01:37:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efea9cfd640 1 --2- 172.21.15.81:0/2098482499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aeef370 0x56082aee0700 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7efea00bb970 tx=0x7efea003b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3230a93569e09b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efe8ffff640 1 -- 172.21.15.81:0/2098482499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0049070 con 0x56082aeef370 2024-09-12T01:37:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efe8ffff640 1 -- 172.21.15.81:0/2098482499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efea00ed090 con 0x56082aeef370 2024-09-12T01:37:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.485+0000 7efe8ffff640 1 -- 172.21.15.81:0/2098482499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea00b7c80 con 0x56082aeef370 2024-09-12T01:37:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.486+0000 7efeaeb3b740 1 -- 172.21.15.81:0/2098482499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aeef370 msgr2=0x56082aee0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.486+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/2098482499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aeef370 0x56082aee0700 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7efea00bb970 tx=0x7efea003b460 comp rx=0 tx=0).stop 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.486+0000 7efeaeb3b740 1 -- 172.21.15.81:0/2098482499 shutdown_connections 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.486+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/2098482499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee0c40 0x56082af06a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.486+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/2098482499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aeef370 0x56082aee0700 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.486+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/2098482499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aee45d0 0x56082aefb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.486+0000 7efeaeb3b740 1 -- 172.21.15.81:0/2098482499 >> 172.21.15.81:0/2098482499 conn(0x56082aead310 msgr2=0x56082aeebf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.486+0000 7efeaeb3b740 1 -- 172.21.15.81:0/2098482499 shutdown_connections 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.486+0000 7efeaeb3b740 1 -- 172.21.15.81:0/2098482499 wait complete. 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.486+0000 7efeaeb3b740 1 -- start start 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.486+0000 7efeaeb3b740 1 Processor -- start 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efeaeb3b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee0c40 0x56082aef7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efeaeb3b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 0x56082aef79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efeaeb3b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aef4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efeaeb3b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efea41aec90 con 0x56082aee45d0 2024-09-12T01:37:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efeaeb3b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efea41ae5c0 con 0x56082aeef370 2024-09-12T01:37:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efeaeb3b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efea41ab820 con 0x56082aee0c40 2024-09-12T01:37:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efeaeb3b740 10 client.0 _ll_register_callbacks cb 0x7efea0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efea9cfd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 0x56082aef79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efea9cfd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 0x56082aef79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38292/0 (socket says 172.21.15.81:38292) 2024-09-12T01:37:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efea9cfd640 1 -- 172.21.15.81:0/952309483 learned_addr learned my addr 172.21.15.81:0/952309483 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efeaa4fe640 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee0c40 0x56082aef7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efeaacff640 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aef4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efea9cfd640 1 -- 172.21.15.81:0/952309483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee0c40 msgr2=0x56082aef7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efea9cfd640 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee0c40 0x56082aef7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efea9cfd640 1 -- 172.21.15.81:0/952309483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 msgr2=0x56082aef4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efea9cfd640 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aef4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efea9cfd640 1 -- 172.21.15.81:0/952309483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56082aef8060 con 0x56082aee45d0 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efeaacff640 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aef4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efea9cfd640 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 0x56082aef79c0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7efea00bb6e0 tx=0x7efea00c4470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c335d164f7dc75c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efe8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efe8dffb640 1 -- 172.21.15.81:0/952309483 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0049070 con 0x56082aee45d0 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efe8dffb640 1 -- 172.21.15.81:0/952309483 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7efea00b60d0 con 0x56082aee45d0 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efeaeb3b740 1 -- 172.21.15.81:0/952309483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efea00ed090 con 0x56082aee45d0 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.487+0000 7efe8dffb640 1 -- 172.21.15.81:0/952309483 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efea00044e0 con 0x56082aee45d0 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.488+0000 7efeaeb3b740 10 client.17529 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.488+0000 7efeaeb3b740 1 -- 172.21.15.81:0/952309483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56082aef8060 con 0x56082aee45d0 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.488+0000 7efe8dffb640 1 -- 172.21.15.81:0/952309483 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efea00ed090 con 0x56082aee45d0 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.488+0000 7efe8dffb640 1 -- 172.21.15.81:0/952309483 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efea00d4be0 con 0x56082aee45d0 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.488+0000 7efeaeb3b740 10 client.17529 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.488+0000 7efeaeb3b740 10 client.17529 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:37:24.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.488+0000 7efeaeb3b740 20 client.17529 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.488+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x56082af6a280 0x56082af6c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.488+0000 7efeaeb3b740 4 client.17529 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:37:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.488+0000 7efeaeb3b740 1 -- 172.21.15.81:0/952309483 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56082ae51d70 con 0x56082af6a280 2024-09-12T01:37:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.488+0000 7efeaa4fe640 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x56082af6a280 0x56082af6c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efeaa4fe640 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x56082af6a280 0x56082af6c670 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=958d9ba331960cb6 server_cookie=1ef8486580d13f42 in_seq=0 out_seq=0 2024-09-12T01:37:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efe8dffb640 10 client.17529 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:37:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efe8dffb640 1 -- 172.21.15.81:0/952309483 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56082ae51d70 con 0x56082af6a280 2024-09-12T01:37:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efe8dffb640 10 client.17529 handle_command_reply: tid=0 2024-09-12T01:37:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efeaeb3b740 1 client.17529 shutdown 2024-09-12T01:37:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efeaeb3b740 1 -- 172.21.15.81:0/952309483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 msgr2=0x56082aef79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 0x56082aef79c0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7efea00bb6e0 tx=0x7efea00c4470 comp rx=0 tx=0).stop 2024-09-12T01:37:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efeaeb3b740 1 -- 172.21.15.81:0/952309483 shutdown_connections 2024-09-12T01:37:24.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x56082af6a280 0x56082af6c670 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56082aeef370 0x56082aef4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efe8dffb640 0 client.17529 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:37:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56082aee45d0 0x56082aef79c0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efeaeb3b740 1 --2- 172.21.15.81:0/952309483 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082aee0c40 0x56082aef7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efeaeb3b740 1 -- 172.21.15.81:0/952309483 >> 172.21.15.81:0/952309483 conn(0x56082aead310 msgr2=0x56082aeed7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efeaeb3b740 1 -- 172.21.15.81:0/952309483 shutdown_connections 2024-09-12T01:37:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efeaeb3b740 1 -- 172.21.15.81:0/952309483 wait complete. 2024-09-12T01:37:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.489+0000 7efeaeb3b740 20 client.17529 trim_cache size 0 max 16384 2024-09-12T01:37:24.513 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:37:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.490+0000 7efeac762640 1 -- 172.21.15.81:0/3177382501 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efe900a2d70 msgr2=0x7efe900a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.490+0000 7efeac762640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efe900a2d70 0x7efe900a5230 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009fd0 tx=0x7efe9c0094a0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.490+0000 7efeac762640 1 -- 172.21.15.81:0/3177382501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea4102790 msgr2=0x7efea41989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.490+0000 7efeac762640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea4102790 0x7efea41989d0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7efea0006010 tx=0x7efea00042f0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.490+0000 7efeac762640 1 -- 172.21.15.81:0/3177382501 shutdown_connections 2024-09-12T01:37:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.490+0000 7efeac762640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efe900a2d70 0x7efe900a5230 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.490+0000 7efeac762640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efea4106f10 0x7efea419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.490+0000 7efeac762640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efea4102790 0x7efea41989d0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.490+0000 7efeac762640 1 --2- 172.21.15.81:0/3177382501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efea4101de0 0x7efea4198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.490+0000 7efeac762640 1 -- 172.21.15.81:0/3177382501 >> 172.21.15.81:0/3177382501 conn(0x7efea40fd8c0 msgr2=0x7efea40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.490+0000 7efeac762640 1 -- 172.21.15.81:0/3177382501 shutdown_connections 2024-09-12T01:37:24.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:24.490+0000 7efeac762640 1 -- 172.21.15.81:0/3177382501 wait complete. 2024-09-12T01:37:25.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:37:25.440 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:37:25.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:25 smithi189 ceph-mon[35357]: pgmap v289: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:37:25.821 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:25 smithi081 ceph-mon[30920]: pgmap v289: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:37:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.903+0000 7f30a3dbb640 1 -- 172.21.15.81:0/455674215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c103740 msgr2=0x7f309c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.903+0000 7f30a3dbb640 1 --2- 172.21.15.81:0/455674215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c103740 0x7f309c107b80 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f3090009930 tx=0x7f309002a420 comp rx=0 tx=0).stop 2024-09-12T01:37:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.903+0000 7f30a3dbb640 1 -- 172.21.15.81:0/455674215 shutdown_connections 2024-09-12T01:37:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.903+0000 7f30a3dbb640 1 --2- 172.21.15.81:0/455674215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f309c108290 0x7f309c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.903+0000 7f30a3dbb640 1 --2- 172.21.15.81:0/455674215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c103740 0x7f309c107b80 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.903+0000 7f30a3dbb640 1 --2- 172.21.15.81:0/455674215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f309c102d90 0x7f309c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.903+0000 7f30a3dbb640 1 -- 172.21.15.81:0/455674215 >> 172.21.15.81:0/455674215 conn(0x7f309c0fc7d0 msgr2=0x7f309c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.904+0000 7f30a3dbb640 1 -- 172.21.15.81:0/455674215 shutdown_connections 2024-09-12T01:37:25.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.904+0000 7f30a3dbb640 1 -- 172.21.15.81:0/455674215 wait complete. 2024-09-12T01:37:25.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.904+0000 7f30a3dbb640 1 Processor -- start 2024-09-12T01:37:25.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.904+0000 7f30a3dbb640 1 -- start start 2024-09-12T01:37:25.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.904+0000 7f30a3dbb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f309c102d90 0x7f309c1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.904+0000 7f30a3dbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c103740 0x7f309c100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.904+0000 7f30a3dbb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f309c108290 0x7f309c101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.904+0000 7f30a3dbb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1120b0 con 0x7f309c103740 2024-09-12T01:37:25.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.904+0000 7f30a3dbb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f309c111f30 con 0x7f309c102d90 2024-09-12T01:37:25.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.904+0000 7f30a3dbb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f309c112230 con 0x7f309c108290 2024-09-12T01:37:25.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a1356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c103740 0x7f309c100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a1356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c103740 0x7f309c100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38324/0 (socket says 172.21.15.81:38324) 2024-09-12T01:37:25.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a1356640 1 -- 172.21.15.81:0/3237142436 learned_addr learned my addr 172.21.15.81:0/3237142436 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:25.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a2358640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f309c108290 0x7f309c101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a1b57640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f309c102d90 0x7f309c1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a1356640 1 -- 172.21.15.81:0/3237142436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f309c108290 msgr2=0x7f309c101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:25.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a1356640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f309c108290 0x7f309c101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a1356640 1 -- 172.21.15.81:0/3237142436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f309c102d90 msgr2=0x7f309c1009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:25.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a1356640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f309c102d90 0x7f309c1009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a1356640 1 -- 172.21.15.81:0/3237142436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c1a6a70 con 0x7f309c103740 2024-09-12T01:37:25.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a2358640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f309c108290 0x7f309c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a1356640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c103740 0x7f309c100f30 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f3090009230 tx=0x7f30900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f309affd640 1 -- 172.21.15.81:0/3237142436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309003f030 con 0x7f309c103740 2024-09-12T01:37:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a3dbb640 1 -- 172.21.15.81:0/3237142436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f309c1a6d00 con 0x7f309c103740 2024-09-12T01:37:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f309affd640 1 -- 172.21.15.81:0/3237142436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3090003ce0 con 0x7f309c103740 2024-09-12T01:37:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f309affd640 1 -- 172.21.15.81:0/3237142436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090035070 con 0x7f309c103740 2024-09-12T01:37:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.905+0000 7f30a3dbb640 1 -- 172.21.15.81:0/3237142436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f309c1a7190 con 0x7f309c103740 2024-09-12T01:37:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.907+0000 7f309affd640 1 -- 172.21.15.81:0/3237142436 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f3090042030 con 0x7f309c103740 2024-09-12T01:37:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f30a6194740 1 Processor -- start 2024-09-12T01:37:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f30a6194740 1 -- start start 2024-09-12T01:37:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f30a6194740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b904b40 0x55c61b903090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f30a6194740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b9035d0 0x55c61b903a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f30a6194740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b90e370 0x55c61b910760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f30a6194740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c61b8692f0 con 0x55c61b90e370 2024-09-12T01:37:25.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f30a6194740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c61b810cf0 con 0x55c61b9035d0 2024-09-12T01:37:25.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f30a6194740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c61b8652b0 con 0x55c61b904b40 2024-09-12T01:37:25.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f309affd640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f30840a2cf0 0x7f30840a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f30a1356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b90e370 0x55c61b910760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f30a2358640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f30840a2cf0 0x7f30840a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f30a1356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b90e370 0x55c61b910760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38338/0 (socket says 172.21.15.81:38338) 2024-09-12T01:37:25.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f30a1356640 1 -- 172.21.15.81:0/200186073 learned_addr learned my addr 172.21.15.81:0/200186073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:25.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.908+0000 7f30a2358640 1 --2- 172.21.15.81:0/200186073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b904b40 0x55c61b903090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.909+0000 7f30a1b57640 1 --2- 172.21.15.81:0/200186073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b9035d0 0x55c61b903a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.909+0000 7f309affd640 1 -- 172.21.15.81:0/3237142436 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f30900efa70 con 0x7f309c103740 2024-09-12T01:37:25.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.909+0000 7f30a1356640 1 -- 172.21.15.81:0/200186073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b904b40 msgr2=0x55c61b903090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:25.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.909+0000 7f30a1356640 1 --2- 172.21.15.81:0/200186073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b904b40 0x55c61b903090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.909+0000 7f30a1356640 1 -- 172.21.15.81:0/200186073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b9035d0 msgr2=0x55c61b903a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:25.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.909+0000 7f30a1356640 1 --2- 172.21.15.81:0/200186073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b9035d0 0x55c61b903a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.909+0000 7f30a1356640 1 -- 172.21.15.81:0/200186073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c61b7f53a0 con 0x55c61b90e370 2024-09-12T01:37:25.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.909+0000 7f30a2358640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f30840a2cf0 0x7f30840a51b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f308c007fd0 tx=0x7f308c007d60 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:25.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.909+0000 7f30a1356640 1 --2- 172.21.15.81:0/200186073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b90e370 0x55c61b910760 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f30900ed130 tx=0x7f30900e6b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48883a16ad52c17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:25.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.909+0000 7f3083fff640 1 -- 172.21.15.81:0/200186073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090049070 con 0x55c61b90e370 2024-09-12T01:37:25.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.909+0000 7f3083fff640 1 -- 172.21.15.81:0/200186073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30900bc690 con 0x55c61b90e370 2024-09-12T01:37:25.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.909+0000 7f3083fff640 1 -- 172.21.15.81:0/200186073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30900c0340 con 0x55c61b90e370 2024-09-12T01:37:25.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.910+0000 7f30a6194740 1 -- 172.21.15.81:0/200186073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b90e370 msgr2=0x55c61b910760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:25.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.910+0000 7f30a6194740 1 --2- 172.21.15.81:0/200186073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b90e370 0x55c61b910760 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f30900ed130 tx=0x7f30900e6b20 comp rx=0 tx=0).stop 2024-09-12T01:37:25.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.910+0000 7f30a6194740 1 -- 172.21.15.81:0/200186073 shutdown_connections 2024-09-12T01:37:25.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.910+0000 7f30a6194740 1 --2- 172.21.15.81:0/200186073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b90e370 0x55c61b910760 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.910+0000 7f30a6194740 1 --2- 172.21.15.81:0/200186073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b9035d0 0x55c61b903a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.910+0000 7f30a6194740 1 --2- 172.21.15.81:0/200186073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b904b40 0x55c61b903090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.910+0000 7f30a6194740 1 -- 172.21.15.81:0/200186073 >> 172.21.15.81:0/200186073 conn(0x55c61b8cc310 msgr2=0x55c61b8ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:25.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.910+0000 7f30a6194740 1 -- 172.21.15.81:0/200186073 shutdown_connections 2024-09-12T01:37:25.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.910+0000 7f30a6194740 1 -- 172.21.15.81:0/200186073 wait complete. 2024-09-12T01:37:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.910+0000 7f30a6194740 1 -- start start 2024-09-12T01:37:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.910+0000 7f30a6194740 1 Processor -- start 2024-09-12T01:37:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a6194740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b9035d0 0x55c61b90dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a6194740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b904b40 0x55c61b90b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a6194740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b90e370 0x55c61b90b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a6194740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c61b910e30 con 0x55c61b904b40 2024-09-12T01:37:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a6194740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c61b824060 con 0x55c61b9035d0 2024-09-12T01:37:25.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a6194740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c61b910fb0 con 0x55c61b90e370 2024-09-12T01:37:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a6194740 10 client.0 _ll_register_callbacks cb 0x55c61b5778c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a1356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b904b40 0x55c61b90b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a1356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b904b40 0x55c61b90b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38350/0 (socket says 172.21.15.81:38350) 2024-09-12T01:37:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a1356640 1 -- 172.21.15.81:0/1405509822 learned_addr learned my addr 172.21.15.81:0/1405509822 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a2358640 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b90e370 0x55c61b90b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a1b57640 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b9035d0 0x55c61b90dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a1356640 1 -- 172.21.15.81:0/1405509822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b90e370 msgr2=0x55c61b90b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a1356640 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b90e370 0x55c61b90b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a1356640 1 -- 172.21.15.81:0/1405509822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b9035d0 msgr2=0x55c61b90dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a1356640 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b9035d0 0x55c61b90dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a1356640 1 -- 172.21.15.81:0/1405509822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c61b5da3c0 con 0x55c61b904b40 2024-09-12T01:37:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a2358640 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b90e370 0x55c61b90b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a1b57640 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b9035d0 0x55c61b90dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a1356640 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b904b40 0x55c61b90b050 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f30900bbf20 tx=0x7f30900bc090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3bce3fd9d907c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30817fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30817fa640 1 -- 172.21.15.81:0/1405509822 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090049070 con 0x55c61b904b40 2024-09-12T01:37:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30817fa640 1 -- 172.21.15.81:0/1405509822 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f30900ed440 con 0x55c61b904b40 2024-09-12T01:37:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.911+0000 7f30a6194740 1 -- 172.21.15.81:0/1405509822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30900bc690 con 0x55c61b904b40 2024-09-12T01:37:25.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.912+0000 7f30817fa640 1 -- 172.21.15.81:0/1405509822 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f30900c14d0 con 0x55c61b904b40 2024-09-12T01:37:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.912+0000 7f30a6194740 10 client.17541 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.912+0000 7f30a6194740 1 -- 172.21.15.81:0/1405509822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c61b910e30 con 0x55c61b904b40 2024-09-12T01:37:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.912+0000 7f30817fa640 1 -- 172.21.15.81:0/1405509822 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30900bc690 con 0x55c61b904b40 2024-09-12T01:37:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.912+0000 7f30817fa640 1 -- 172.21.15.81:0/1405509822 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f309003bc80 con 0x55c61b904b40 2024-09-12T01:37:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.912+0000 7f30a6194740 10 client.17541 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.912+0000 7f30a6194740 10 client.17541 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:37:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.912+0000 7f30a6194740 20 client.17541 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.912+0000 7f30a6194740 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c61b91da10 0x55c61b91fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.912+0000 7f30a6194740 4 client.17541 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:37:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.912+0000 7f30a6194740 1 -- 172.21.15.81:0/1405509822 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c61b876860 con 0x55c61b91da10 2024-09-12T01:37:25.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.912+0000 7f30a1b57640 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c61b91da10 0x55c61b91fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.913+0000 7f30817fa640 10 client.17541 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:37:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.913+0000 7f30a1b57640 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c61b91da10 0x55c61b91fe00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=58e41ce8ecbcf821 server_cookie=b0d5f1d6189b2c70 in_seq=0 out_seq=0 2024-09-12T01:37:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.913+0000 7f30817fa640 1 -- 172.21.15.81:0/1405509822 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c61b876860 con 0x55c61b91da10 2024-09-12T01:37:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.913+0000 7f30817fa640 10 client.17541 handle_command_reply: tid=0 2024-09-12T01:37:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.913+0000 7f30a6194740 1 client.17541 shutdown 2024-09-12T01:37:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.914+0000 7f30a6194740 1 -- 172.21.15.81:0/1405509822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b904b40 msgr2=0x55c61b90b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.914+0000 7f30a6194740 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b904b40 0x55c61b90b050 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f30900bbf20 tx=0x7f30900bc090 comp rx=0 tx=0).stop 2024-09-12T01:37:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.914+0000 7f30a6194740 1 -- 172.21.15.81:0/1405509822 shutdown_connections 2024-09-12T01:37:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.914+0000 7f30a6194740 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b90e370 0x55c61b90b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.914+0000 7f30a6194740 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c61b91da10 0x55c61b91fe00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.914+0000 7f30a6194740 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b904b40 0x55c61b90b050 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.914+0000 7f30a6194740 1 --2- 172.21.15.81:0/1405509822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b9035d0 0x55c61b90dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.914+0000 7f30817fa640 0 client.17541 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:37:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.914+0000 7f30a6194740 1 -- 172.21.15.81:0/1405509822 >> 172.21.15.81:0/1405509822 conn(0x55c61b8cc310 msgr2=0x55c61b905990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.914+0000 7f30a6194740 1 -- 172.21.15.81:0/1405509822 shutdown_connections 2024-09-12T01:37:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.914+0000 7f30a6194740 1 -- 172.21.15.81:0/1405509822 wait complete. 2024-09-12T01:37:25.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.914+0000 7f30a6194740 20 client.17541 trim_cache size 0 max 16384 2024-09-12T01:37:25.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.927+0000 7f30a6194740 1 Processor -- start 2024-09-12T01:37:25.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.927+0000 7f30a6194740 1 -- start start 2024-09-12T01:37:25.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.927+0000 7f30a6194740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b9035d0 0x55c61b906120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.927+0000 7f30a6194740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b904b40 0x55c61b906660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.927+0000 7f30a6194740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b90e370 0x55c61b925660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.927+0000 7f30a6194740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1afa60 con 0x55c61b904b40 2024-09-12T01:37:25.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.927+0000 7f30a6194740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1b15a0 con 0x55c61b90e370 2024-09-12T01:37:25.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.927+0000 7f30a6194740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1b0130 con 0x55c61b9035d0 2024-09-12T01:37:25.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.927+0000 7f30a2358640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b90e370 0x55c61b925660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.927+0000 7f30a1b57640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b9035d0 0x55c61b906120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.927+0000 7f30a2358640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b90e370 0x55c61b925660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:42162/0 (socket says 172.21.15.81:42162) 2024-09-12T01:37:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.927+0000 7f30a2358640 1 -- 172.21.15.81:0/739895264 learned_addr learned my addr 172.21.15.81:0/739895264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.927+0000 7f30a1356640 1 --2- 172.21.15.81:0/739895264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b904b40 0x55c61b906660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.928+0000 7f30a2358640 1 -- 172.21.15.81:0/739895264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b9035d0 msgr2=0x55c61b906120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.928+0000 7f30a2358640 1 --2- 172.21.15.81:0/739895264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b9035d0 0x55c61b906120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.928+0000 7f30a2358640 1 -- 172.21.15.81:0/739895264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b904b40 msgr2=0x55c61b906660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.928+0000 7f30a2358640 1 --2- 172.21.15.81:0/739895264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b904b40 0x55c61b906660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.928+0000 7f30a2358640 1 -- 172.21.15.81:0/739895264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c61b90d9c0 con 0x55c61b90e370 2024-09-12T01:37:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.928+0000 7f30a1b57640 1 --2- 172.21.15.81:0/739895264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b9035d0 0x55c61b906120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:37:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.928+0000 7f30a2358640 1 --2- 172.21.15.81:0/739895264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b90e370 0x55c61b925660 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f308c013680 tx=0x7f308c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5b5f7af245aed2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:25.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.928+0000 7f30837fe640 1 -- 172.21.15.81:0/739895264 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c024070 con 0x55c61b90e370 2024-09-12T01:37:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.928+0000 7f30837fe640 1 -- 172.21.15.81:0/739895264 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f308c011df0 con 0x55c61b90e370 2024-09-12T01:37:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.928+0000 7f30837fe640 1 -- 172.21.15.81:0/739895264 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c01f3c0 con 0x55c61b90e370 2024-09-12T01:37:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.929+0000 7f30a6194740 1 -- 172.21.15.81:0/739895264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b90e370 msgr2=0x55c61b925660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.929+0000 7f30a6194740 1 --2- 172.21.15.81:0/739895264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b90e370 0x55c61b925660 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f308c013680 tx=0x7f308c004ab0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.929+0000 7f30a6194740 1 -- 172.21.15.81:0/739895264 shutdown_connections 2024-09-12T01:37:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.929+0000 7f30a6194740 1 --2- 172.21.15.81:0/739895264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b90e370 0x55c61b925660 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.929+0000 7f30a6194740 1 --2- 172.21.15.81:0/739895264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b904b40 0x55c61b906660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.929+0000 7f30a6194740 1 --2- 172.21.15.81:0/739895264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b9035d0 0x55c61b906120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.929+0000 7f30a6194740 1 -- 172.21.15.81:0/739895264 >> 172.21.15.81:0/739895264 conn(0x55c61b8cc310 msgr2=0x55c61b90a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.929+0000 7f30a6194740 1 -- 172.21.15.81:0/739895264 shutdown_connections 2024-09-12T01:37:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.929+0000 7f30a6194740 1 -- 172.21.15.81:0/739895264 wait complete. 2024-09-12T01:37:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.929+0000 7f30a6194740 1 -- start start 2024-09-12T01:37:25.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.929+0000 7f30a6194740 1 Processor -- start 2024-09-12T01:37:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a6194740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b9035d0 0x55c61b9169a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a6194740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b904b40 0x55c61b911cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a6194740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b90e370 0x55c61b912210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a6194740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1b0ed0 con 0x55c61b9035d0 2024-09-12T01:37:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a6194740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1b0800 con 0x55c61b90e370 2024-09-12T01:37:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a6194740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1ada60 con 0x55c61b904b40 2024-09-12T01:37:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a6194740 10 client.0 _ll_register_callbacks cb 0x7f309400b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a1b57640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b9035d0 0x55c61b9169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a1b57640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b9035d0 0x55c61b9169a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38368/0 (socket says 172.21.15.81:38368) 2024-09-12T01:37:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a1b57640 1 -- 172.21.15.81:0/3390928658 learned_addr learned my addr 172.21.15.81:0/3390928658 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a2358640 1 --2- 172.21.15.81:0/3390928658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b90e370 0x55c61b912210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a1356640 1 --2- 172.21.15.81:0/3390928658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b904b40 0x55c61b911cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a1b57640 1 -- 172.21.15.81:0/3390928658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b904b40 msgr2=0x55c61b911cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a1b57640 1 --2- 172.21.15.81:0/3390928658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b904b40 0x55c61b911cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a1b57640 1 -- 172.21.15.81:0/3390928658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b90e370 msgr2=0x55c61b912210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a1b57640 1 --2- 172.21.15.81:0/3390928658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b90e370 0x55c61b912210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.930+0000 7f30a1b57640 1 -- 172.21.15.81:0/3390928658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c61b912a40 con 0x55c61b9035d0 2024-09-12T01:37:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.931+0000 7f30a1b57640 1 --2- 172.21.15.81:0/3390928658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b9035d0 0x55c61b9169a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f3094000c00 tx=0x7f30940157f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675dbd02d8d4267 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.931+0000 7f30817fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.931+0000 7f30817fa640 1 -- 172.21.15.81:0/3390928658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309400be90 con 0x55c61b9035d0 2024-09-12T01:37:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.931+0000 7f30817fa640 1 -- 172.21.15.81:0/3390928658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f30940233e0 con 0x55c61b9035d0 2024-09-12T01:37:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.931+0000 7f30a6194740 1 -- 172.21.15.81:0/3390928658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f308c011df0 con 0x55c61b9035d0 2024-09-12T01:37:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.931+0000 7f30817fa640 1 -- 172.21.15.81:0/3390928658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f30940235e0 con 0x55c61b9035d0 2024-09-12T01:37:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.931+0000 7f30a6194740 10 client.17547 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.931+0000 7f30a6194740 1 -- 172.21.15.81:0/3390928658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c61b9886f0 con 0x55c61b9035d0 2024-09-12T01:37:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.931+0000 7f30817fa640 1 -- 172.21.15.81:0/3390928658 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f308c011df0 con 0x55c61b9035d0 2024-09-12T01:37:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.931+0000 7f30817fa640 1 -- 172.21.15.81:0/3390928658 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3094022070 con 0x55c61b9035d0 2024-09-12T01:37:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.931+0000 7f30a6194740 10 client.17547 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.932+0000 7f30a6194740 10 client.17547 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:37:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.932+0000 7f30a6194740 20 client.17547 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.932+0000 7f30a6194740 1 --2- 172.21.15.81:0/3390928658 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c61b988e10 0x55c61b98b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.932+0000 7f30a6194740 4 client.17547 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:37:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.932+0000 7f30a6194740 1 -- 172.21.15.81:0/3390928658 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c61b870d70 con 0x55c61b988e10 2024-09-12T01:37:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.932+0000 7f30a1356640 1 --2- 172.21.15.81:0/3390928658 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c61b988e10 0x55c61b98b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.932+0000 7f30a1356640 1 --2- 172.21.15.81:0/3390928658 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c61b988e10 0x55c61b98b200 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=888f0220a771a3c server_cookie=4c4cafd74c272e02 in_seq=0 out_seq=0 2024-09-12T01:37:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.932+0000 7f30817fa640 10 client.17547 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:37:25.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.932+0000 7f30817fa640 1 -- 172.21.15.81:0/3390928658 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c61b870d70 con 0x55c61b988e10 2024-09-12T01:37:25.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.932+0000 7f30817fa640 10 client.17547 handle_command_reply: tid=0 2024-09-12T01:37:25.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.932+0000 7f30a6194740 1 client.17547 shutdown 2024-09-12T01:37:25.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a6194740 1 -- 172.21.15.81:0/3390928658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b9035d0 msgr2=0x55c61b9169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:25.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a6194740 1 --2- 172.21.15.81:0/3390928658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b9035d0 0x55c61b9169a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f3094000c00 tx=0x7f30940157f0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a6194740 1 -- 172.21.15.81:0/3390928658 shutdown_connections 2024-09-12T01:37:25.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a6194740 1 --2- 172.21.15.81:0/3390928658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c61b90e370 0x55c61b912210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a6194740 1 --2- 172.21.15.81:0/3390928658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c61b904b40 0x55c61b911cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a6194740 1 --2- 172.21.15.81:0/3390928658 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55c61b988e10 0x55c61b98b200 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a6194740 1 --2- 172.21.15.81:0/3390928658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c61b9035d0 0x55c61b9169a0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30817fa640 0 client.17547 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:37:25.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a6194740 1 -- 172.21.15.81:0/3390928658 >> 172.21.15.81:0/3390928658 conn(0x55c61b8cc310 msgr2=0x55c61b90c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:25.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a6194740 1 -- 172.21.15.81:0/3390928658 shutdown_connections 2024-09-12T01:37:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a6194740 1 -- 172.21.15.81:0/3390928658 wait complete. 2024-09-12T01:37:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a6194740 20 client.17547 trim_cache size 0 max 16384 2024-09-12T01:37:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:37:25.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a3dbb640 1 -- 172.21.15.81:0/3237142436 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f30840a2cf0 msgr2=0x7f30840a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:25.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a3dbb640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f30840a2cf0 0x7f30840a51b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f308c007fd0 tx=0x7f308c007d60 comp rx=0 tx=0).stop 2024-09-12T01:37:25.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a3dbb640 1 -- 172.21.15.81:0/3237142436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c103740 msgr2=0x7f309c100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:25.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a3dbb640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c103740 0x7f309c100f30 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f3090009230 tx=0x7f30900042f0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a3dbb640 1 -- 172.21.15.81:0/3237142436 shutdown_connections 2024-09-12T01:37:25.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a3dbb640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f30840a2cf0 0x7f30840a51b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a3dbb640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f309c108290 0x7f309c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a3dbb640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f309c103740 0x7f309c100f30 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a3dbb640 1 --2- 172.21.15.81:0/3237142436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f309c102d90 0x7f309c1009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:25.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.933+0000 7f30a3dbb640 1 -- 172.21.15.81:0/3237142436 >> 172.21.15.81:0/3237142436 conn(0x7f309c0fc7d0 msgr2=0x7f309c105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:25.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.934+0000 7f30a3dbb640 1 -- 172.21.15.81:0/3237142436 shutdown_connections 2024-09-12T01:37:25.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:25.934+0000 7f30a3dbb640 1 -- 172.21.15.81:0/3237142436 wait complete. 2024-09-12T01:37:26.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:25 smithi100 ceph-mon[35275]: pgmap v289: 97 pgs: 97 active+clean; 2.0 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T01:37:26.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:37:26.833 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:37:27.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.235+0000 7efd5cedd640 1 -- 172.21.15.81:0/1674603542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd58106f10 msgr2=0x7efd5810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:27.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.235+0000 7efd5cedd640 1 --2- 172.21.15.81:0/1674603542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd58106f10 0x7efd5810ea90 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7efd50009ca0 tx=0x7efd5002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.236+0000 7efd5cedd640 1 -- 172.21.15.81:0/1674603542 shutdown_connections 2024-09-12T01:37:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.236+0000 7efd5cedd640 1 --2- 172.21.15.81:0/1674603542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd58106f10 0x7efd5810ea90 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.236+0000 7efd5cedd640 1 --2- 172.21.15.81:0/1674603542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd58102790 0x7efd581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.236+0000 7efd5cedd640 1 --2- 172.21.15.81:0/1674603542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd58101de0 0x7efd581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.236+0000 7efd5cedd640 1 -- 172.21.15.81:0/1674603542 >> 172.21.15.81:0/1674603542 conn(0x7efd580fd8c0 msgr2=0x7efd580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.236+0000 7efd5cedd640 1 -- 172.21.15.81:0/1674603542 shutdown_connections 2024-09-12T01:37:27.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.236+0000 7efd5cedd640 1 -- 172.21.15.81:0/1674603542 wait complete. 2024-09-12T01:37:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.236+0000 7efd5cedd640 1 Processor -- start 2024-09-12T01:37:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.236+0000 7efd5cedd640 1 -- start start 2024-09-12T01:37:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd5cedd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd58101de0 0x7efd581983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd5cedd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd58102790 0x7efd58198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd5cedd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd58106f10 0x7efd5819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd5cedd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd58111f70 con 0x7efd58102790 2024-09-12T01:37:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd5cedd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efd58111df0 con 0x7efd58101de0 2024-09-12T01:37:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd5cedd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efd581120f0 con 0x7efd58106f10 2024-09-12T01:37:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd55d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd58102790 0x7efd58198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd55d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd58102790 0x7efd58198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38382/0 (socket says 172.21.15.81:38382) 2024-09-12T01:37:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd55d9b640 1 -- 172.21.15.81:0/1363733490 learned_addr learned my addr 172.21.15.81:0/1363733490 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd5659c640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd58101de0 0x7efd581983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd56d9d640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd58106f10 0x7efd5819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd55d9b640 1 -- 172.21.15.81:0/1363733490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd58106f10 msgr2=0x7efd5819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd55d9b640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd58106f10 0x7efd5819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd55d9b640 1 -- 172.21.15.81:0/1363733490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd58101de0 msgr2=0x7efd581983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd55d9b640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd58101de0 0x7efd581983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd55d9b640 1 -- 172.21.15.81:0/1363733490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5819d3a0 con 0x7efd58102790 2024-09-12T01:37:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd56d9d640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd58106f10 0x7efd5819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:27.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd5659c640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd58101de0 0x7efd581983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd55d9b640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd58102790 0x7efd58198930 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00d770 tx=0x7efd4c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.237+0000 7efd477fe640 1 -- 172.21.15.81:0/1363733490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c017070 con 0x7efd58102790 2024-09-12T01:37:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.238+0000 7efd477fe640 1 -- 172.21.15.81:0/1363733490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd4c005500 con 0x7efd58102790 2024-09-12T01:37:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.238+0000 7efd5cedd640 1 -- 172.21.15.81:0/1363733490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5819d690 con 0x7efd58102790 2024-09-12T01:37:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.238+0000 7efd477fe640 1 -- 172.21.15.81:0/1363733490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c004e00 con 0x7efd58102790 2024-09-12T01:37:27.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.238+0000 7efd5cedd640 1 -- 172.21.15.81:0/1363733490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd581a4f70 con 0x7efd58102790 2024-09-12T01:37:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.240+0000 7efd5f2b6740 1 Processor -- start 2024-09-12T01:37:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd5f2b6740 1 -- start start 2024-09-12T01:37:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd477fe640 1 -- 172.21.15.81:0/1363733490 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7efd4c004fa0 con 0x7efd58102790 2024-09-12T01:37:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd5f2b6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea62015b40 0x55ea62014090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd5f2b6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 0x55ea62014a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd5f2b6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea6201f370 0x55ea62021760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd5f2b6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea61f7a2f0 con 0x55ea620145d0 2024-09-12T01:37:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd5f2b6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ea61f21cf0 con 0x55ea62015b40 2024-09-12T01:37:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd5f2b6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ea61f762b0 con 0x55ea6201f370 2024-09-12T01:37:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd5659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 0x55ea62014a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd5659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 0x55ea62014a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38394/0 (socket says 172.21.15.81:38394) 2024-09-12T01:37:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd5659c640 1 -- 172.21.15.81:0/4228842173 learned_addr learned my addr 172.21.15.81:0/4228842173 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd56d9d640 1 --2- 172.21.15.81:0/4228842173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea62015b40 0x55ea62014090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd55d9b640 1 --2- 172.21.15.81:0/4228842173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea6201f370 0x55ea62021760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd5659c640 1 -- 172.21.15.81:0/4228842173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea6201f370 msgr2=0x55ea62021760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.241+0000 7efd5659c640 1 --2- 172.21.15.81:0/4228842173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea6201f370 0x55ea62021760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.242+0000 7efd5659c640 1 -- 172.21.15.81:0/4228842173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea62015b40 msgr2=0x55ea62014090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.242+0000 7efd5659c640 1 --2- 172.21.15.81:0/4228842173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea62015b40 0x55ea62014090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.242+0000 7efd5659c640 1 -- 172.21.15.81:0/4228842173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea61f063a0 con 0x55ea620145d0 2024-09-12T01:37:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.242+0000 7efd56d9d640 1 --2- 172.21.15.81:0/4228842173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea62015b40 0x55ea62014090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.242+0000 7efd5659c640 1 --2- 172.21.15.81:0/4228842173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 0x55ea62014a10 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7efd48009d50 tx=0x7efd480117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fc8e01cfafabc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.242+0000 7efd44ff9640 1 -- 172.21.15.81:0/4228842173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48012650 con 0x55ea620145d0 2024-09-12T01:37:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.242+0000 7efd477fe640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efd400a2cf0 0x7efd400a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.242+0000 7efd44ff9640 1 -- 172.21.15.81:0/4228842173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd48009e40 con 0x55ea620145d0 2024-09-12T01:37:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.242+0000 7efd44ff9640 1 -- 172.21.15.81:0/4228842173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4800fc60 con 0x55ea620145d0 2024-09-12T01:37:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.242+0000 7efd477fe640 1 -- 172.21.15.81:0/1363733490 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7efd4c0cef20 con 0x7efd58102790 2024-09-12T01:37:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.242+0000 7efd56d9d640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efd400a2cf0 0x7efd400a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.243+0000 7efd5f2b6740 1 -- 172.21.15.81:0/4228842173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 msgr2=0x55ea62014a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.243+0000 7efd56d9d640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efd400a2cf0 0x7efd400a51b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd50005cc0 tx=0x7efd50005c30 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.243+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/4228842173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 0x55ea62014a10 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7efd48009d50 tx=0x7efd480117b0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.243+0000 7efd5f2b6740 1 -- 172.21.15.81:0/4228842173 shutdown_connections 2024-09-12T01:37:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.243+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/4228842173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea6201f370 0x55ea62021760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.243+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/4228842173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 0x55ea62014a10 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.243+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/4228842173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea62015b40 0x55ea62014090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.243+0000 7efd5f2b6740 1 -- 172.21.15.81:0/4228842173 >> 172.21.15.81:0/4228842173 conn(0x55ea61fdd310 msgr2=0x55ea62010c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.243+0000 7efd5f2b6740 1 -- 172.21.15.81:0/4228842173 shutdown_connections 2024-09-12T01:37:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.243+0000 7efd5f2b6740 1 -- 172.21.15.81:0/4228842173 wait complete. 2024-09-12T01:37:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.243+0000 7efd5f2b6740 1 -- start start 2024-09-12T01:37:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.243+0000 7efd5f2b6740 1 Processor -- start 2024-09-12T01:37:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5f2b6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 0x55ea6201ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5f2b6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea62015b40 0x55ea6201bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5f2b6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea6201f370 0x55ea6201c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5f2b6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea62022070 con 0x55ea620145d0 2024-09-12T01:37:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5f2b6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ea61f35060 con 0x55ea6201f370 2024-09-12T01:37:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5f2b6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ea620221f0 con 0x55ea62015b40 2024-09-12T01:37:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5f2b6740 10 client.0 _ll_register_callbacks cb 0x55ea61c888c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 0x55ea6201ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 0x55ea6201ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38406/0 (socket says 172.21.15.81:38406) 2024-09-12T01:37:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5659c640 1 -- 172.21.15.81:0/3332732035 learned_addr learned my addr 172.21.15.81:0/3332732035 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd55d9b640 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea62015b40 0x55ea6201bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd56d9d640 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea6201f370 0x55ea6201c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5659c640 1 -- 172.21.15.81:0/3332732035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea62015b40 msgr2=0x55ea6201bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5659c640 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea62015b40 0x55ea6201bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5659c640 1 -- 172.21.15.81:0/3332732035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea6201f370 msgr2=0x55ea6201c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5659c640 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea6201f370 0x55ea6201c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5659c640 1 -- 172.21.15.81:0/3332732035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea61ceb3c0 con 0x55ea620145d0 2024-09-12T01:37:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd55d9b640 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea62015b40 0x55ea6201bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5659c640 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 0x55ea6201ed00 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7efd4800f880 tx=0x7efd48004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeee7fae1c4ab984 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd3dffb640 1 -- 172.21.15.81:0/3332732035 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48028020 con 0x55ea620145d0 2024-09-12T01:37:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd3dffb640 1 -- 172.21.15.81:0/3332732035 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7efd4800fbe0 con 0x55ea620145d0 2024-09-12T01:37:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.244+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3332732035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ea61f87860 con 0x55ea620145d0 2024-09-12T01:37:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.245+0000 7efd3dffb640 1 -- 172.21.15.81:0/3332732035 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd48033050 con 0x55ea620145d0 2024-09-12T01:37:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.245+0000 7efd5f2b6740 10 client.17559 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.245+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3332732035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ea6202daa0 con 0x55ea620145d0 2024-09-12T01:37:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.245+0000 7efd3dffb640 1 -- 172.21.15.81:0/3332732035 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ea61f87860 con 0x55ea620145d0 2024-09-12T01:37:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.245+0000 7efd3dffb640 1 -- 172.21.15.81:0/3332732035 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd480124e0 con 0x55ea620145d0 2024-09-12T01:37:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.245+0000 7efd5f2b6740 10 client.17559 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.245+0000 7efd5f2b6740 10 client.17559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:37:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.245+0000 7efd5f2b6740 20 client.17559 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.245+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ea6202ef00 0x55ea620312f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.245+0000 7efd5f2b6740 4 client.17559 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:37:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.245+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3332732035 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea61f81d70 con 0x55ea6202ef00 2024-09-12T01:37:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.245+0000 7efd55d9b640 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ea6202ef00 0x55ea620312f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.246+0000 7efd55d9b640 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ea6202ef00 0x55ea620312f0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c880afdbcf33861a server_cookie=c2c2495f37b82ab9 in_seq=0 out_seq=0 2024-09-12T01:37:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.246+0000 7efd3dffb640 10 client.17559 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.246+0000 7efd3dffb640 1 -- 172.21.15.81:0/3332732035 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea61f81d70 con 0x55ea6202ef00 2024-09-12T01:37:27.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.246+0000 7efd3dffb640 10 client.17559 handle_command_reply: tid=0 2024-09-12T01:37:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.247+0000 7efd5f2b6740 1 client.17559 shutdown 2024-09-12T01:37:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.247+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3332732035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 msgr2=0x55ea6201ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.247+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 0x55ea6201ed00 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7efd4800f880 tx=0x7efd48004270 comp rx=0 tx=0).stop 2024-09-12T01:37:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.247+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3332732035 shutdown_connections 2024-09-12T01:37:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.247+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ea6202ef00 0x55ea620312f0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.247+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea6201f370 0x55ea6201c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.247+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea62015b40 0x55ea6201bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.247+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/3332732035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea620145d0 0x55ea6201ed00 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.247+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3332732035 >> 172.21.15.81:0/3332732035 conn(0x55ea61fdd310 msgr2=0x55ea62016930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.247+0000 7efd3dffb640 0 client.17559 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.247+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3332732035 shutdown_connections 2024-09-12T01:37:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.247+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3332732035 wait complete. 2024-09-12T01:37:27.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.247+0000 7efd5f2b6740 20 client.17559 trim_cache size 0 max 16384 2024-09-12T01:37:27.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.259+0000 7efd5f2b6740 1 Processor -- start 2024-09-12T01:37:27.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.259+0000 7efd5f2b6740 1 -- start start 2024-09-12T01:37:27.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd5f2b6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea620145d0 0x55ea6202b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd5f2b6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea62015b40 0x55ea62027860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd5f2b6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 0x55ea62027da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd5f2b6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd581ad8d0 con 0x55ea6201f370 2024-09-12T01:37:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd5f2b6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efd581af410 con 0x55ea62015b40 2024-09-12T01:37:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd5f2b6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efd581adfa0 con 0x55ea620145d0 2024-09-12T01:37:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd56d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 0x55ea62027da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd56d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 0x55ea62027da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38418/0 (socket says 172.21.15.81:38418) 2024-09-12T01:37:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd56d9d640 1 -- 172.21.15.81:0/1272633597 learned_addr learned my addr 172.21.15.81:0/1272633597 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd5659c640 1 --2- 172.21.15.81:0/1272633597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea620145d0 0x55ea6202b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd55d9b640 1 --2- 172.21.15.81:0/1272633597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea62015b40 0x55ea62027860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd56d9d640 1 -- 172.21.15.81:0/1272633597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea620145d0 msgr2=0x55ea6202b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd56d9d640 1 --2- 172.21.15.81:0/1272633597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea620145d0 0x55ea6202b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd56d9d640 1 -- 172.21.15.81:0/1272633597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea62015b40 msgr2=0x55ea62027860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:27.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd56d9d640 1 --2- 172.21.15.81:0/1272633597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea62015b40 0x55ea62027860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd56d9d640 1 -- 172.21.15.81:0/1272633597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea62011960 con 0x55ea6201f370 2024-09-12T01:37:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd5659c640 1 --2- 172.21.15.81:0/1272633597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea620145d0 0x55ea6202b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd56d9d640 1 --2- 172.21.15.81:0/1272633597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 0x55ea62027da0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7efd50009ca0 tx=0x7efd50040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8626ce44a2f00b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd3ffff640 1 -- 172.21.15.81:0/1272633597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50031920 con 0x55ea6201f370 2024-09-12T01:37:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd3ffff640 1 -- 172.21.15.81:0/1272633597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd50036040 con 0x55ea6201f370 2024-09-12T01:37:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.260+0000 7efd3ffff640 1 -- 172.21.15.81:0/1272633597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5002fbb0 con 0x55ea6201f370 2024-09-12T01:37:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.261+0000 7efd5f2b6740 1 -- 172.21.15.81:0/1272633597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 msgr2=0x55ea62027da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.261+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/1272633597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 0x55ea62027da0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7efd50009ca0 tx=0x7efd50040000 comp rx=0 tx=0).stop 2024-09-12T01:37:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.261+0000 7efd5f2b6740 1 -- 172.21.15.81:0/1272633597 shutdown_connections 2024-09-12T01:37:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.261+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/1272633597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 0x55ea62027da0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.261+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/1272633597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea62015b40 0x55ea62027860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.261+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/1272633597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea620145d0 0x55ea6202b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.261+0000 7efd5f2b6740 1 -- 172.21.15.81:0/1272633597 >> 172.21.15.81:0/1272633597 conn(0x55ea61fdd310 msgr2=0x55ea6201b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:27.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.261+0000 7efd5f2b6740 1 -- 172.21.15.81:0/1272633597 shutdown_connections 2024-09-12T01:37:27.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.261+0000 7efd5f2b6740 1 -- 172.21.15.81:0/1272633597 wait complete. 2024-09-12T01:37:27.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.261+0000 7efd5f2b6740 1 -- start start 2024-09-12T01:37:27.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd5f2b6740 1 Processor -- start 2024-09-12T01:37:27.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd5f2b6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea620145d0 0x55ea62036610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd5f2b6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea62015b40 0x55ea62036b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd5f2b6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 0x55ea62094d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd5f2b6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd581aed40 con 0x55ea6201f370 2024-09-12T01:37:27.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd5f2b6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efd581ae670 con 0x55ea620145d0 2024-09-12T01:37:27.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd5f2b6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efd581ab8d0 con 0x55ea62015b40 2024-09-12T01:37:27.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd5f2b6740 10 client.0 _ll_register_callbacks cb 0x7efd48009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:27.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd56d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 0x55ea62094d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd56d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 0x55ea62094d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38428/0 (socket says 172.21.15.81:38428) 2024-09-12T01:37:27.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd56d9d640 1 -- 172.21.15.81:0/3406335186 learned_addr learned my addr 172.21.15.81:0/3406335186 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:27.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd55d9b640 1 --2- 172.21.15.81:0/3406335186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea62015b40 0x55ea62036b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd5659c640 1 --2- 172.21.15.81:0/3406335186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea620145d0 0x55ea62036610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd56d9d640 1 -- 172.21.15.81:0/3406335186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea62015b40 msgr2=0x55ea62036b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:27.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd56d9d640 1 --2- 172.21.15.81:0/3406335186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea62015b40 0x55ea62036b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd56d9d640 1 -- 172.21.15.81:0/3406335186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea620145d0 msgr2=0x55ea62036610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:27.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd56d9d640 1 --2- 172.21.15.81:0/3406335186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea620145d0 0x55ea62036610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd56d9d640 1 -- 172.21.15.81:0/3406335186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea62095420 con 0x55ea6201f370 2024-09-12T01:37:27.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd56d9d640 1 --2- 172.21.15.81:0/3406335186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 0x55ea62094d80 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7efd5002f650 tx=0x7efd5002f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476f2e808af08284 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.262+0000 7efd3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd3dffb640 1 -- 172.21.15.81:0/3406335186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5002faf0 con 0x55ea6201f370 2024-09-12T01:37:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd3dffb640 1 -- 172.21.15.81:0/3406335186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7efd5002fc90 con 0x55ea6201f370 2024-09-12T01:37:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3406335186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd50036040 con 0x55ea6201f370 2024-09-12T01:37:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd3dffb640 1 -- 172.21.15.81:0/3406335186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd5002fe90 con 0x55ea6201f370 2024-09-12T01:37:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd5f2b6740 10 client.17565 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3406335186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ea6209d8c0 con 0x55ea6201f370 2024-09-12T01:37:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd3dffb640 1 -- 172.21.15.81:0/3406335186 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd50036040 con 0x55ea6201f370 2024-09-12T01:37:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd3dffb640 1 -- 172.21.15.81:0/3406335186 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd50030b90 con 0x55ea6201f370 2024-09-12T01:37:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd5f2b6740 10 client.17565 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:27.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd5f2b6740 10 client.17565 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:37:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd5f2b6740 20 client.17565 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/3406335186 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ea6209df30 0x55ea620a0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd5f2b6740 4 client.17565 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:37:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3406335186 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea61efe170 con 0x55ea6209df30 2024-09-12T01:37:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.263+0000 7efd5659c640 1 --2- 172.21.15.81:0/3406335186 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ea6209df30 0x55ea620a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd3dffb640 10 client.17565 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd5659c640 1 --2- 172.21.15.81:0/3406335186 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ea6209df30 0x55ea620a0320 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d1148cb7f57455 server_cookie=69a49591421e2385 in_seq=0 out_seq=0 2024-09-12T01:37:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd3dffb640 1 -- 172.21.15.81:0/3406335186 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea61efe170 con 0x55ea6209df30 2024-09-12T01:37:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd3dffb640 10 client.17565 handle_command_reply: tid=0 2024-09-12T01:37:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd5f2b6740 1 client.17565 shutdown 2024-09-12T01:37:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3406335186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 msgr2=0x55ea62094d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/3406335186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 0x55ea62094d80 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7efd5002f650 tx=0x7efd5002f4c0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3406335186 shutdown_connections 2024-09-12T01:37:27.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/3406335186 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55ea6209df30 0x55ea620a0320 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/3406335186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea6201f370 0x55ea62094d80 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/3406335186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea62015b40 0x55ea62036b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd5f2b6740 1 --2- 172.21.15.81:0/3406335186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ea620145d0 0x55ea62036610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3406335186 >> 172.21.15.81:0/3406335186 conn(0x55ea61fdd310 msgr2=0x55ea6200f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:27.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd3dffb640 0 client.17565 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:27.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3406335186 shutdown_connections 2024-09-12T01:37:27.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd5f2b6740 1 -- 172.21.15.81:0/3406335186 wait complete. 2024-09-12T01:37:27.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.264+0000 7efd5f2b6740 20 client.17565 trim_cache size 0 max 16384 2024-09-12T01:37:27.271 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:37:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.265+0000 7efd5cedd640 1 -- 172.21.15.81:0/1363733490 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efd400a2cf0 msgr2=0x7efd400a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.265+0000 7efd5cedd640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efd400a2cf0 0x7efd400a51b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd50005cc0 tx=0x7efd50005c30 comp rx=0 tx=0).stop 2024-09-12T01:37:27.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.265+0000 7efd5cedd640 1 -- 172.21.15.81:0/1363733490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd58102790 msgr2=0x7efd58198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.265+0000 7efd5cedd640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd58102790 0x7efd58198930 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00d770 tx=0x7efd4c00dc30 comp rx=0 tx=0).stop 2024-09-12T01:37:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.265+0000 7efd5cedd640 1 -- 172.21.15.81:0/1363733490 shutdown_connections 2024-09-12T01:37:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.265+0000 7efd5cedd640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7efd400a2cf0 0x7efd400a51b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.265+0000 7efd5cedd640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efd58106f10 0x7efd5819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.265+0000 7efd5cedd640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd58102790 0x7efd58198930 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.265+0000 7efd5cedd640 1 --2- 172.21.15.81:0/1363733490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd58101de0 0x7efd581983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.265+0000 7efd5cedd640 1 -- 172.21.15.81:0/1363733490 >> 172.21.15.81:0/1363733490 conn(0x7efd580fd8c0 msgr2=0x7efd580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.265+0000 7efd5cedd640 1 -- 172.21.15.81:0/1363733490 shutdown_connections 2024-09-12T01:37:27.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:27.265+0000 7efd5cedd640 1 -- 172.21.15.81:0/1363733490 wait complete. 2024-09-12T01:37:27.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:27 smithi189 ceph-mon[35357]: pgmap v290: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-12T01:37:27.954 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:27 smithi081 ceph-mon[30920]: pgmap v290: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-12T01:37:28.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:27 smithi100 ceph-mon[35275]: pgmap v290: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-12T01:37:29.022 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:37:29.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:37:29.670 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:29 smithi081 ceph-mon[30920]: pgmap v291: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-12T01:37:29.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.753+0000 7fbe4bf66640 1 -- 172.21.15.81:0/833469159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44101420 msgr2=0x7fbe4410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.753+0000 7fbe4bf66640 1 --2- 172.21.15.81:0/833469159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44101420 0x7fbe4410d950 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c009930 tx=0x7fbe3c02a420 comp rx=0 tx=0).stop 2024-09-12T01:37:29.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.754+0000 7fbe4bf66640 1 -- 172.21.15.81:0/833469159 shutdown_connections 2024-09-12T01:37:29.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.754+0000 7fbe4bf66640 1 --2- 172.21.15.81:0/833469159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44101420 0x7fbe4410d950 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.754+0000 7fbe4bf66640 1 --2- 172.21.15.81:0/833469159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe44100a80 0x7fbe44100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.754+0000 7fbe4bf66640 1 --2- 172.21.15.81:0/833469159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe44106a80 0x7fbe44106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.754+0000 7fbe4bf66640 1 -- 172.21.15.81:0/833469159 >> 172.21.15.81:0/833469159 conn(0x7fbe440fc7a0 msgr2=0x7fbe440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:29.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.754+0000 7fbe4bf66640 1 -- 172.21.15.81:0/833469159 shutdown_connections 2024-09-12T01:37:29.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.754+0000 7fbe4bf66640 1 -- 172.21.15.81:0/833469159 wait complete. 2024-09-12T01:37:29.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.755+0000 7fbe4bf66640 1 Processor -- start 2024-09-12T01:37:29.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.755+0000 7fbe4bf66640 1 -- start start 2024-09-12T01:37:29.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.755+0000 7fbe4bf66640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe44100a80 0x7fbe4410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.755+0000 7fbe4bf66640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe44101420 0x7fbe4410e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.755+0000 7fbe4bf66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44106a80 0x7fbe4410ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.755+0000 7fbe4bf66640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe44111fa0 con 0x7fbe44106a80 2024-09-12T01:37:29.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.755+0000 7fbe4bf66640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbe44111e20 con 0x7fbe44101420 2024-09-12T01:37:29.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.755+0000 7fbe4bf66640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbe44112120 con 0x7fbe44100a80 2024-09-12T01:37:29.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.755+0000 7fbe4a503640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44106a80 0x7fbe4410ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.755+0000 7fbe4a503640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44106a80 0x7fbe4410ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38442/0 (socket says 172.21.15.81:38442) 2024-09-12T01:37:29.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.755+0000 7fbe4a503640 1 -- 172.21.15.81:0/1103310271 learned_addr learned my addr 172.21.15.81:0/1103310271 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:29.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.755+0000 7fbe49d02640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe44100a80 0x7fbe4410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.756+0000 7fbe49501640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe44101420 0x7fbe4410e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.756+0000 7fbe4a503640 1 -- 172.21.15.81:0/1103310271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe44100a80 msgr2=0x7fbe4410e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.756+0000 7fbe4a503640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe44100a80 0x7fbe4410e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.756+0000 7fbe4a503640 1 -- 172.21.15.81:0/1103310271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe44101420 msgr2=0x7fbe4410e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.756+0000 7fbe4a503640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe44101420 0x7fbe4410e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.756+0000 7fbe4a503640 1 -- 172.21.15.81:0/1103310271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe441a6960 con 0x7fbe44106a80 2024-09-12T01:37:29.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.756+0000 7fbe4a503640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44106a80 0x7fbe4410ee60 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c005ab0 tx=0x7fbe3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:29.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.756+0000 7fbe42ffd640 1 -- 172.21.15.81:0/1103310271 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c03f030 con 0x7fbe44106a80 2024-09-12T01:37:29.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.756+0000 7fbe42ffd640 1 -- 172.21.15.81:0/1103310271 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe3c003ce0 con 0x7fbe44106a80 2024-09-12T01:37:29.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.756+0000 7fbe4bf66640 1 -- 172.21.15.81:0/1103310271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe441a6bf0 con 0x7fbe44106a80 2024-09-12T01:37:29.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.756+0000 7fbe42ffd640 1 -- 172.21.15.81:0/1103310271 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c035070 con 0x7fbe44106a80 2024-09-12T01:37:29.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.756+0000 7fbe4bf66640 1 -- 172.21.15.81:0/1103310271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe441a70d0 con 0x7fbe44106a80 2024-09-12T01:37:29.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.758+0000 7fbe42ffd640 1 -- 172.21.15.81:0/1103310271 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fbe3c042030 con 0x7fbe44106a80 2024-09-12T01:37:29.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe4e33f740 1 Processor -- start 2024-09-12T01:37:29.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe4e33f740 1 -- start start 2024-09-12T01:37:29.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe4e33f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 0x55aa62595f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe4e33f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62596480 0x55aa625a0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe4e33f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa625a0d40 0x55aa625a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe4e33f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aa624fb280 con 0x55aa62595b60 2024-09-12T01:37:29.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe4e33f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aa624a2b10 con 0x55aa62596480 2024-09-12T01:37:29.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe4e33f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55aa624f7240 con 0x55aa625a0d40 2024-09-12T01:37:29.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe42ffd640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbe2c0a2cf0 0x7fbe2c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe49501640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 0x55aa62595f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe49501640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 0x55aa62595f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38444/0 (socket says 172.21.15.81:38444) 2024-09-12T01:37:29.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe49501640 1 -- 172.21.15.81:0/2875921455 learned_addr learned my addr 172.21.15.81:0/2875921455 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:29.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe49d02640 1 --2- 172.21.15.81:0/2875921455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62596480 0x55aa625a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe4a503640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbe2c0a2cf0 0x7fbe2c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.759+0000 7fbe49501640 1 --2- 172.21.15.81:0/2875921455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa625a0d40 0x55aa625a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.760+0000 7fbe42ffd640 1 -- 172.21.15.81:0/1103310271 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fbe3c0efbb0 con 0x7fbe44106a80 2024-09-12T01:37:29.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.760+0000 7fbe49501640 1 -- 172.21.15.81:0/2875921455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa625a0d40 msgr2=0x55aa625a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:29.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.760+0000 7fbe49501640 1 --2- 172.21.15.81:0/2875921455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa625a0d40 0x55aa625a3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.760+0000 7fbe49501640 1 -- 172.21.15.81:0/2875921455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62596480 msgr2=0x55aa625a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:29.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.760+0000 7fbe49501640 1 --2- 172.21.15.81:0/2875921455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62596480 0x55aa625a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.760+0000 7fbe49501640 1 -- 172.21.15.81:0/2875921455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa624af1f0 con 0x55aa62595b60 2024-09-12T01:37:29.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.760+0000 7fbe49d02640 1 --2- 172.21.15.81:0/2875921455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62596480 0x55aa625a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:37:29.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.760+0000 7fbe49501640 1 --2- 172.21.15.81:0/2875921455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 0x55aa62595f40 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006aa0 tx=0x7fbe380094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ab120ecbb35de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:29.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.760+0000 7fbe4a503640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbe2c0a2cf0 0x7fbe2c0a51b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0ed3b0 tx=0x7fbe3c086d00 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:29.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.760+0000 7fbe2bfff640 1 -- 172.21.15.81:0/2875921455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe38017610 con 0x55aa62595b60 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.760+0000 7fbe2bfff640 1 -- 172.21.15.81:0/2875921455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe3801c070 con 0x55aa62595b60 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.760+0000 7fbe2bfff640 1 -- 172.21.15.81:0/2875921455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe38015980 con 0x55aa62595b60 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.761+0000 7fbe4e33f740 1 -- 172.21.15.81:0/2875921455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 msgr2=0x55aa62595f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.761+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/2875921455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 0x55aa62595f40 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006aa0 tx=0x7fbe380094c0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.761+0000 7fbe4e33f740 1 -- 172.21.15.81:0/2875921455 shutdown_connections 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.761+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/2875921455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa625a0d40 0x55aa625a3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.761+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/2875921455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62596480 0x55aa625a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.761+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/2875921455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 0x55aa62595f40 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.761+0000 7fbe4e33f740 1 -- 172.21.15.81:0/2875921455 >> 172.21.15.81:0/2875921455 conn(0x55aa625920f0 msgr2=0x55aa625924d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.761+0000 7fbe4e33f740 1 -- 172.21.15.81:0/2875921455 shutdown_connections 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.761+0000 7fbe4e33f740 1 -- 172.21.15.81:0/2875921455 wait complete. 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.761+0000 7fbe4e33f740 1 -- start start 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe4e33f740 1 Processor -- start 2024-09-12T01:37:29.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe4e33f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa62595b60 0x55aa6259dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe4e33f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 0x55aa6259e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe4e33f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa625a0d40 0x55aa6259e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe4e33f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aa625a3910 con 0x55aa62596480 2024-09-12T01:37:29.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe4e33f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aa624b5f10 con 0x55aa625a0d40 2024-09-12T01:37:29.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe4e33f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55aa625a3a90 con 0x55aa62595b60 2024-09-12T01:37:29.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe4e33f740 10 client.0 _ll_register_callbacks cb 0x55aa6247ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:29.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe49d02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 0x55aa6259e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe49d02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 0x55aa6259e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38460/0 (socket says 172.21.15.81:38460) 2024-09-12T01:37:29.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe49d02640 1 -- 172.21.15.81:0/2842509222 learned_addr learned my addr 172.21.15.81:0/2842509222 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:29.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe49501640 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa62595b60 0x55aa6259dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe49501640 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa625a0d40 0x55aa6259e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe49d02640 1 -- 172.21.15.81:0/2842509222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa62595b60 msgr2=0x55aa6259dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:29.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe49d02640 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa62595b60 0x55aa6259dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe49d02640 1 -- 172.21.15.81:0/2842509222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa625a0d40 msgr2=0x55aa6259e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:29.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe49d02640 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa625a0d40 0x55aa6259e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe49d02640 1 -- 172.21.15.81:0/2842509222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa6226c6a0 con 0x55aa62596480 2024-09-12T01:37:29.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.762+0000 7fbe49501640 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa62595b60 0x55aa6259dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:29.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe49d02640 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 0x55aa6259e1a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fbe340040a0 tx=0x7fbe34004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1907c5a437b3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:29.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe297fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:29.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe297fa640 1 -- 172.21.15.81:0/2842509222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe34004d20 con 0x55aa62596480 2024-09-12T01:37:29.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe297fa640 1 -- 172.21.15.81:0/2842509222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fbe34013a40 con 0x55aa62596480 2024-09-12T01:37:29.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe4e33f740 1 -- 172.21.15.81:0/2842509222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe3801c070 con 0x55aa62596480 2024-09-12T01:37:29.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe297fa640 1 -- 172.21.15.81:0/2842509222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe34013c40 con 0x55aa62596480 2024-09-12T01:37:29.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe4e33f740 10 client.17577 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:29.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe4e33f740 1 -- 172.21.15.81:0/2842509222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55aa625af610 con 0x55aa62596480 2024-09-12T01:37:29.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe297fa640 1 -- 172.21.15.81:0/2842509222 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe3801c070 con 0x55aa62596480 2024-09-12T01:37:29.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe297fa640 1 -- 172.21.15.81:0/2842509222 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbe3401a030 con 0x55aa62596480 2024-09-12T01:37:29.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe4e33f740 10 client.17577 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:29.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe4e33f740 10 client.17577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:37:29.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe4e33f740 20 client.17577 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:29.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55aa625b0b20 0x55aa625b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe4e33f740 4 client.17577 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:37:29.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.763+0000 7fbe4e33f740 1 -- 172.21.15.81:0/2842509222 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa625087f0 con 0x55aa625b0b20 2024-09-12T01:37:29.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.764+0000 7fbe49501640 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55aa625b0b20 0x55aa625b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.764+0000 7fbe49501640 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55aa625b0b20 0x55aa625b2f40 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83d29590dd6a8007 server_cookie=6d456c299c6c38d3 in_seq=0 out_seq=0 2024-09-12T01:37:29.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.764+0000 7fbe297fa640 10 client.17577 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:29.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe297fa640 1 -- 172.21.15.81:0/2842509222 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa625087f0 con 0x55aa625b0b20 2024-09-12T01:37:29.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe297fa640 10 client.17577 handle_command_reply: tid=0 2024-09-12T01:37:29.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe4e33f740 1 client.17577 shutdown 2024-09-12T01:37:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe4e33f740 1 -- 172.21.15.81:0/2842509222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 msgr2=0x55aa6259e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 0x55aa6259e1a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fbe340040a0 tx=0x7fbe34004560 comp rx=0 tx=0).stop 2024-09-12T01:37:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe4e33f740 1 -- 172.21.15.81:0/2842509222 shutdown_connections 2024-09-12T01:37:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55aa625b0b20 0x55aa625b2f40 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa625a0d40 0x55aa6259e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 0x55aa6259e1a0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/2842509222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa62595b60 0x55aa6259dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe297fa640 0 client.17577 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe4e33f740 1 -- 172.21.15.81:0/2842509222 >> 172.21.15.81:0/2842509222 conn(0x55aa625920f0 msgr2=0x55aa62597e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe4e33f740 1 -- 172.21.15.81:0/2842509222 shutdown_connections 2024-09-12T01:37:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe4e33f740 1 -- 172.21.15.81:0/2842509222 wait complete. 2024-09-12T01:37:29.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.765+0000 7fbe4e33f740 20 client.17577 trim_cache size 0 max 16384 2024-09-12T01:37:29.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe4e33f740 1 Processor -- start 2024-09-12T01:37:29.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe4e33f740 1 -- start start 2024-09-12T01:37:29.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe4e33f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62595b60 0x55aa6259e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe4e33f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 0x55aa625b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe4e33f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa625a0d40 0x55aa625b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe4e33f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe441afb10 con 0x55aa62596480 2024-09-12T01:37:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe4e33f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbe441b1650 con 0x55aa62595b60 2024-09-12T01:37:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe4e33f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbe441b01e0 con 0x55aa625a0d40 2024-09-12T01:37:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe49d02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 0x55aa625b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe49d02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 0x55aa625b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38462/0 (socket says 172.21.15.81:38462) 2024-09-12T01:37:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe49d02640 1 -- 172.21.15.81:0/3290043445 learned_addr learned my addr 172.21.15.81:0/3290043445 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe49d02640 1 -- 172.21.15.81:0/3290043445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa625a0d40 msgr2=0x55aa625b8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe49501640 1 --2- 172.21.15.81:0/3290043445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62595b60 0x55aa6259e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe49d02640 1 --2- 172.21.15.81:0/3290043445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa625a0d40 0x55aa625b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe49d02640 1 -- 172.21.15.81:0/3290043445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62595b60 msgr2=0x55aa6259e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe49d02640 1 --2- 172.21.15.81:0/3290043445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62595b60 0x55aa6259e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe49d02640 1 -- 172.21.15.81:0/3290043445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa625a0530 con 0x55aa62596480 2024-09-12T01:37:29.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.783+0000 7fbe49501640 1 --2- 172.21.15.81:0/3290043445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62595b60 0x55aa6259e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:29.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.784+0000 7fbe49d02640 1 --2- 172.21.15.81:0/3290043445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 0x55aa625b87f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fbe340236e0 tx=0x7fbe34013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cd516aec066f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:29.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.784+0000 7fbe2b7fe640 1 -- 172.21.15.81:0/3290043445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe34028070 con 0x55aa62596480 2024-09-12T01:37:29.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.784+0000 7fbe2b7fe640 1 -- 172.21.15.81:0/3290043445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe340096f0 con 0x55aa62596480 2024-09-12T01:37:29.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.784+0000 7fbe2b7fe640 1 -- 172.21.15.81:0/3290043445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3402da20 con 0x55aa62596480 2024-09-12T01:37:29.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.785+0000 7fbe4e33f740 1 -- 172.21.15.81:0/3290043445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 msgr2=0x55aa625b87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.785+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/3290043445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 0x55aa625b87f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fbe340236e0 tx=0x7fbe34013830 comp rx=0 tx=0).stop 2024-09-12T01:37:29.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.785+0000 7fbe4e33f740 1 -- 172.21.15.81:0/3290043445 shutdown_connections 2024-09-12T01:37:29.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.785+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/3290043445 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa625a0d40 0x55aa625b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.785+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/3290043445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62596480 0x55aa625b87f0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.785+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/3290043445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62595b60 0x55aa6259e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.785+0000 7fbe4e33f740 1 -- 172.21.15.81:0/3290043445 >> 172.21.15.81:0/3290043445 conn(0x55aa625920f0 msgr2=0x55aa6259fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:29.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.785+0000 7fbe4e33f740 1 -- 172.21.15.81:0/3290043445 shutdown_connections 2024-09-12T01:37:29.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.785+0000 7fbe4e33f740 1 -- 172.21.15.81:0/3290043445 wait complete. 2024-09-12T01:37:29.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.785+0000 7fbe4e33f740 1 -- start start 2024-09-12T01:37:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.785+0000 7fbe4e33f740 1 Processor -- start 2024-09-12T01:37:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe4e33f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 0x55aa625a9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe4e33f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62596480 0x55aa625a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe4e33f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa625a0d40 0x55aa625a6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe4e33f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe441b0f80 con 0x55aa62595b60 2024-09-12T01:37:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe4e33f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbe441b08b0 con 0x55aa62596480 2024-09-12T01:37:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe4e33f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbe441adb10 con 0x55aa625a0d40 2024-09-12T01:37:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe4e33f740 10 client.0 _ll_register_callbacks cb 0x7fbe34009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe49501640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 0x55aa625a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe49501640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 0x55aa625a9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38470/0 (socket says 172.21.15.81:38470) 2024-09-12T01:37:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe49501640 1 -- 172.21.15.81:0/12122172 learned_addr learned my addr 172.21.15.81:0/12122172 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe49d02640 1 --2- 172.21.15.81:0/12122172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62596480 0x55aa625a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe49501640 1 -- 172.21.15.81:0/12122172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa625a0d40 msgr2=0x55aa625a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe49501640 1 --2- 172.21.15.81:0/12122172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa625a0d40 0x55aa625a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe49501640 1 -- 172.21.15.81:0/12122172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62596480 msgr2=0x55aa625a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe49501640 1 --2- 172.21.15.81:0/12122172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62596480 0x55aa625a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe49501640 1 -- 172.21.15.81:0/12122172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa625a6840 con 0x55aa62595b60 2024-09-12T01:37:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe49d02640 1 --2- 172.21.15.81:0/12122172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62596480 0x55aa625a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe49501640 1 --2- 172.21.15.81:0/12122172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 0x55aa625a9280 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006a50 tx=0x7fbe38012cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3a03816c93bc5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe297fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe297fa640 1 -- 172.21.15.81:0/12122172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe38015860 con 0x55aa62595b60 2024-09-12T01:37:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe297fa640 1 -- 172.21.15.81:0/12122172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fbe38015a00 con 0x55aa62595b60 2024-09-12T01:37:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe4e33f740 1 -- 172.21.15.81:0/12122172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe340096f0 con 0x55aa62595b60 2024-09-12T01:37:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.786+0000 7fbe297fa640 1 -- 172.21.15.81:0/12122172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe38015c00 con 0x55aa62595b60 2024-09-12T01:37:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.787+0000 7fbe4e33f740 10 client.17583 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.787+0000 7fbe4e33f740 1 -- 172.21.15.81:0/12122172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55aa6261c580 con 0x55aa62595b60 2024-09-12T01:37:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.787+0000 7fbe297fa640 1 -- 172.21.15.81:0/12122172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe340096f0 con 0x55aa62595b60 2024-09-12T01:37:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.787+0000 7fbe297fa640 1 -- 172.21.15.81:0/12122172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbe38017410 con 0x55aa62595b60 2024-09-12T01:37:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.787+0000 7fbe4e33f740 10 client.17583 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.787+0000 7fbe4e33f740 10 client.17583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:37:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.787+0000 7fbe4e33f740 20 client.17583 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.787+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/12122172 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55aa6261c980 0x55aa6261eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.787+0000 7fbe4e33f740 4 client.17583 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:37:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.787+0000 7fbe4e33f740 1 -- 172.21.15.81:0/12122172 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55aa62502d00 con 0x55aa6261c980 2024-09-12T01:37:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.787+0000 7fbe49d02640 1 --2- 172.21.15.81:0/12122172 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55aa6261c980 0x55aa6261eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.788+0000 7fbe49d02640 1 --2- 172.21.15.81:0/12122172 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55aa6261c980 0x55aa6261eda0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34e68bfd4447e957 server_cookie=6a8b1f397d3328a7 in_seq=0 out_seq=0 2024-09-12T01:37:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.788+0000 7fbe297fa640 10 client.17583 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe297fa640 1 -- 172.21.15.81:0/12122172 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55aa62502d00 con 0x55aa6261c980 2024-09-12T01:37:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe297fa640 10 client.17583 handle_command_reply: tid=0 2024-09-12T01:37:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe4e33f740 1 client.17583 shutdown 2024-09-12T01:37:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe4e33f740 1 -- 172.21.15.81:0/12122172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 msgr2=0x55aa625a9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/12122172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 0x55aa625a9280 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006a50 tx=0x7fbe38012cc0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe4e33f740 1 -- 172.21.15.81:0/12122172 shutdown_connections 2024-09-12T01:37:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/12122172 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55aa6261c980 0x55aa6261eda0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/12122172 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa625a0d40 0x55aa625a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/12122172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa62596480 0x55aa625a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe4e33f740 1 --2- 172.21.15.81:0/12122172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa62595b60 0x55aa625a9280 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe4e33f740 1 -- 172.21.15.81:0/12122172 >> 172.21.15.81:0/12122172 conn(0x55aa625920f0 msgr2=0x55aa625975b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe297fa640 0 client.17583 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe4e33f740 1 -- 172.21.15.81:0/12122172 shutdown_connections 2024-09-12T01:37:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe4e33f740 1 -- 172.21.15.81:0/12122172 wait complete. 2024-09-12T01:37:29.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.789+0000 7fbe4e33f740 20 client.17583 trim_cache size 0 max 16384 2024-09-12T01:37:29.794 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:37:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:37:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "20fd8c2d-f3d6-44a7-bdf2-ab59d448d349", 2024-09-12T01:37:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:37:29.794 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:37:29.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.790+0000 7fbe4bf66640 1 -- 172.21.15.81:0/1103310271 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbe2c0a2cf0 msgr2=0x7fbe2c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.790+0000 7fbe4bf66640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbe2c0a2cf0 0x7fbe2c0a51b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0ed3b0 tx=0x7fbe3c086d00 comp rx=0 tx=0).stop 2024-09-12T01:37:29.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.790+0000 7fbe4bf66640 1 -- 172.21.15.81:0/1103310271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44106a80 msgr2=0x7fbe4410ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.790+0000 7fbe4bf66640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44106a80 0x7fbe4410ee60 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c005ab0 tx=0x7fbe3c0042f0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.790+0000 7fbe4bf66640 1 -- 172.21.15.81:0/1103310271 shutdown_connections 2024-09-12T01:37:29.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.790+0000 7fbe4bf66640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbe2c0a2cf0 0x7fbe2c0a51b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.790+0000 7fbe4bf66640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44106a80 0x7fbe4410ee60 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.790+0000 7fbe4bf66640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe44101420 0x7fbe4410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.790+0000 7fbe4bf66640 1 --2- 172.21.15.81:0/1103310271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe44100a80 0x7fbe4410e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.790+0000 7fbe4bf66640 1 -- 172.21.15.81:0/1103310271 >> 172.21.15.81:0/1103310271 conn(0x7fbe440fc7a0 msgr2=0x7fbe440fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:29.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.790+0000 7fbe4bf66640 1 -- 172.21.15.81:0/1103310271 shutdown_connections 2024-09-12T01:37:29.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:29.790+0000 7fbe4bf66640 1 -- 172.21.15.81:0/1103310271 wait complete. 2024-09-12T01:37:30.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:29 smithi100 ceph-mon[35275]: pgmap v291: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-12T01:37:30.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:29 smithi189 ceph-mon[35357]: pgmap v291: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-12T01:37:30.450 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:37:30.695 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:37:31.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.208+0000 7f2b0aeb1640 1 -- 172.21.15.81:0/1483954335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b04106a80 msgr2=0x7f2b04106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.208+0000 7f2b0aeb1640 1 --2- 172.21.15.81:0/1483954335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b04106a80 0x7f2b04106e60 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009930 tx=0x7f2afc02a420 comp rx=0 tx=0).stop 2024-09-12T01:37:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.208+0000 7f2b0aeb1640 1 -- 172.21.15.81:0/1483954335 shutdown_connections 2024-09-12T01:37:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.208+0000 7f2b0aeb1640 1 --2- 172.21.15.81:0/1483954335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b04101420 0x7f2b0410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.208+0000 7f2b0aeb1640 1 --2- 172.21.15.81:0/1483954335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b04100a80 0x7f2b04100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.208+0000 7f2b0aeb1640 1 --2- 172.21.15.81:0/1483954335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b04106a80 0x7f2b04106e60 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.208+0000 7f2b0aeb1640 1 -- 172.21.15.81:0/1483954335 >> 172.21.15.81:0/1483954335 conn(0x7f2b040fc7a0 msgr2=0x7f2b040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.208+0000 7f2b0aeb1640 1 -- 172.21.15.81:0/1483954335 shutdown_connections 2024-09-12T01:37:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.208+0000 7f2b0aeb1640 1 -- 172.21.15.81:0/1483954335 wait complete. 2024-09-12T01:37:31.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0aeb1640 1 Processor -- start 2024-09-12T01:37:31.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0aeb1640 1 -- start start 2024-09-12T01:37:31.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0aeb1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b04100a80 0x7f2b04197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0aeb1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b04101420 0x7f2b041975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0aeb1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b04106a80 0x7f2b04197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0aeb1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04110e40 con 0x7f2b04106a80 2024-09-12T01:37:31.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0aeb1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04110cc0 con 0x7f2b04101420 2024-09-12T01:37:31.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0aeb1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04110fc0 con 0x7f2b04100a80 2024-09-12T01:37:31.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0944e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b04106a80 0x7f2b04197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0944e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b04106a80 0x7f2b04197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38492/0 (socket says 172.21.15.81:38492) 2024-09-12T01:37:31.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0944e640 1 -- 172.21.15.81:0/4051784831 learned_addr learned my addr 172.21.15.81:0/4051784831 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:31.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b03fff640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b04101420 0x7f2b041975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b08c4d640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b04100a80 0x7f2b04197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0944e640 1 -- 172.21.15.81:0/4051784831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b04100a80 msgr2=0x7f2b04197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0944e640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b04100a80 0x7f2b04197070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0944e640 1 -- 172.21.15.81:0/4051784831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b04101420 msgr2=0x7f2b041975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0944e640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b04101420 0x7f2b041975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.209+0000 7f2b0944e640 1 -- 172.21.15.81:0/4051784831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b041a68e0 con 0x7f2b04106a80 2024-09-12T01:37:31.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.210+0000 7f2b0944e640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b04106a80 0x7f2b04197af0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00c970 tx=0x7f2aec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:31.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.210+0000 7f2b01ffb640 1 -- 172.21.15.81:0/4051784831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec007bb0 con 0x7f2b04106a80 2024-09-12T01:37:31.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.210+0000 7f2b01ffb640 1 -- 172.21.15.81:0/4051784831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2aec007d50 con 0x7f2b04106a80 2024-09-12T01:37:31.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.210+0000 7f2b0aeb1640 1 -- 172.21.15.81:0/4051784831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b041a6bd0 con 0x7f2b04106a80 2024-09-12T01:37:31.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.210+0000 7f2b01ffb640 1 -- 172.21.15.81:0/4051784831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00f450 con 0x7f2b04106a80 2024-09-12T01:37:31.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.210+0000 7f2b0aeb1640 1 -- 172.21.15.81:0/4051784831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b041a70c0 con 0x7f2b04106a80 2024-09-12T01:37:31.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.212+0000 7f2b01ffb640 1 -- 172.21.15.81:0/4051784831 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f2aec004f60 con 0x7f2b04106a80 2024-09-12T01:37:31.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.212+0000 7f2b0d28a740 1 Processor -- start 2024-09-12T01:37:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b0d28a740 1 -- start start 2024-09-12T01:37:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b0d28a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a64a0 0x56289b6a6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b0d28a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6b1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b0d28a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6b1680 0x56289b6b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b0d28a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56289b60c2e0 con 0x56289b6a6dc0 2024-09-12T01:37:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b0d28a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56289b5b3ce0 con 0x56289b6a64a0 2024-09-12T01:37:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b0d28a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56289b6082a0 con 0x56289b6b1680 2024-09-12T01:37:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b01ffb640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2af00a2cf0 0x7f2af00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b03fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a64a0 0x56289b6a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b03fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a64a0 0x56289b6a6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:42316/0 (socket says 172.21.15.81:42316) 2024-09-12T01:37:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b08c4d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b03fff640 1 -- 172.21.15.81:0/2223264556 learned_addr learned my addr 172.21.15.81:0/2223264556 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b0944e640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2af00a2cf0 0x7f2af00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b03fff640 1 --2- 172.21.15.81:0/2223264556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6b1680 0x56289b6b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b01ffb640 1 -- 172.21.15.81:0/4051784831 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f2aec0cf110 con 0x7f2b04106a80 2024-09-12T01:37:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b03fff640 1 -- 172.21.15.81:0/2223264556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6b1680 msgr2=0x56289b6b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b03fff640 1 --2- 172.21.15.81:0/2223264556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6b1680 0x56289b6b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b03fff640 1 -- 172.21.15.81:0/2223264556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 msgr2=0x56289b6b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b03fff640 1 --2- 172.21.15.81:0/2223264556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b03fff640 1 -- 172.21.15.81:0/2223264556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56289b598440 con 0x56289b6a64a0 2024-09-12T01:37:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.213+0000 7f2b08c4d640 1 --2- 172.21.15.81:0/2223264556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:37:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.214+0000 7f2b0944e640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2af00a2cf0 0x7f2af00a51b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0cc9b0 tx=0x7f2aec004940 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.214+0000 7f2b03fff640 1 --2- 172.21.15.81:0/2223264556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a64a0 0x56289b6a6880 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2af4007fd0 tx=0x7f2af40078c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=338b9d0f57bee5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.214+0000 7f2afaffd640 1 -- 172.21.15.81:0/2223264556 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4018030 con 0x56289b6a64a0 2024-09-12T01:37:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.214+0000 7f2afaffd640 1 -- 172.21.15.81:0/2223264556 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af4010e30 con 0x56289b6a64a0 2024-09-12T01:37:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.214+0000 7f2afaffd640 1 -- 172.21.15.81:0/2223264556 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af401c3c0 con 0x56289b6a64a0 2024-09-12T01:37:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 -- 172.21.15.81:0/2223264556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a64a0 msgr2=0x56289b6a6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/2223264556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a64a0 0x56289b6a6880 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2af4007fd0 tx=0x7f2af40078c0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 -- 172.21.15.81:0/2223264556 shutdown_connections 2024-09-12T01:37:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/2223264556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6b1680 0x56289b6b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/2223264556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/2223264556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a64a0 0x56289b6a6880 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 -- 172.21.15.81:0/2223264556 >> 172.21.15.81:0/2223264556 conn(0x56289b6a2a30 msgr2=0x56289b6a2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 -- 172.21.15.81:0/2223264556 shutdown_connections 2024-09-12T01:37:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 -- 172.21.15.81:0/2223264556 wait complete. 2024-09-12T01:37:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 -- start start 2024-09-12T01:37:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 Processor -- start 2024-09-12T01:37:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6a64a0 0x56289b6b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6b1680 0x56289b6ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.215+0000 7f2b0d28a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56289b6b4250 con 0x56289b6a6dc0 2024-09-12T01:37:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b0d28a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56289b5c7050 con 0x56289b6b1680 2024-09-12T01:37:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b0d28a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56289b6b43d0 con 0x56289b6a64a0 2024-09-12T01:37:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b0d28a740 10 client.0 _ll_register_callbacks cb 0x56289b607160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b08c4d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b08c4d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38508/0 (socket says 172.21.15.81:38508) 2024-09-12T01:37:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b08c4d640 1 -- 172.21.15.81:0/3971811710 learned_addr learned my addr 172.21.15.81:0/3971811710 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b03fff640 1 --2- 172.21.15.81:0/3971811710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6b1680 0x56289b6ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b03fff640 1 --2- 172.21.15.81:0/3971811710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6a64a0 0x56289b6b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b08c4d640 1 -- 172.21.15.81:0/3971811710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6a64a0 msgr2=0x56289b6b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b08c4d640 1 --2- 172.21.15.81:0/3971811710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6a64a0 0x56289b6b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b08c4d640 1 -- 172.21.15.81:0/3971811710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6b1680 msgr2=0x56289b6ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b08c4d640 1 --2- 172.21.15.81:0/3971811710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6b1680 0x56289b6ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b08c4d640 1 -- 172.21.15.81:0/3971811710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56289b37d3c0 con 0x56289b6a6dc0 2024-09-12T01:37:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b08c4d640 1 --2- 172.21.15.81:0/3971811710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6ae1a0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009930 tx=0x7f2afc0317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972a9f5201db6a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2ae3fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2ae3fff640 1 -- 172.21.15.81:0/3971811710 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc040070 con 0x56289b6a6dc0 2024-09-12T01:37:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2ae3fff640 1 -- 172.21.15.81:0/3971811710 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f2afc004250 con 0x56289b6a6dc0 2024-09-12T01:37:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b0d28a740 1 -- 172.21.15.81:0/3971811710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2af4010e30 con 0x56289b6a6dc0 2024-09-12T01:37:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2ae3fff640 1 -- 172.21.15.81:0/3971811710 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2afc035040 con 0x56289b6a6dc0 2024-09-12T01:37:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.216+0000 7f2b0d28a740 10 client.17595 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.217+0000 7f2b0d28a740 1 -- 172.21.15.81:0/3971811710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56289b6bfb50 con 0x56289b6a6dc0 2024-09-12T01:37:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.217+0000 7f2ae3fff640 1 -- 172.21.15.81:0/3971811710 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af4010e30 con 0x56289b6a6dc0 2024-09-12T01:37:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.217+0000 7f2ae3fff640 1 -- 172.21.15.81:0/3971811710 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2afc004a20 con 0x56289b6a6dc0 2024-09-12T01:37:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.217+0000 7f2b0d28a740 10 client.17595 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.217+0000 7f2b0d28a740 10 client.17595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:37:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.217+0000 7f2b0d28a740 20 client.17595 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.217+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/3971811710 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56289b6c1010 0x56289b6c3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.217+0000 7f2b0d28a740 4 client.17595 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:37:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.217+0000 7f2b0d28a740 1 -- 172.21.15.81:0/3971811710 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56289b619850 con 0x56289b6c1010 2024-09-12T01:37:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.217+0000 7f2b03fff640 1 --2- 172.21.15.81:0/3971811710 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56289b6c1010 0x56289b6c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.218+0000 7f2b03fff640 1 --2- 172.21.15.81:0/3971811710 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56289b6c1010 0x56289b6c3450 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d82b277591adf6b0 server_cookie=b1390b0beb271872 in_seq=0 out_seq=0 2024-09-12T01:37:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.218+0000 7f2ae3fff640 10 client.17595 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.218+0000 7f2ae3fff640 1 -- 172.21.15.81:0/3971811710 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56289b619850 con 0x56289b6c1010 2024-09-12T01:37:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.218+0000 7f2ae3fff640 10 client.17595 handle_command_reply: tid=0 2024-09-12T01:37:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.218+0000 7f2b0d28a740 1 client.17595 shutdown 2024-09-12T01:37:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.218+0000 7f2b0d28a740 1 -- 172.21.15.81:0/3971811710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 msgr2=0x56289b6ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.218+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/3971811710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6ae1a0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009930 tx=0x7f2afc0317e0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.219+0000 7f2b0d28a740 1 -- 172.21.15.81:0/3971811710 shutdown_connections 2024-09-12T01:37:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.219+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/3971811710 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56289b6c1010 0x56289b6c3450 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.219+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/3971811710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6b1680 0x56289b6ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.219+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/3971811710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6ae1a0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.219+0000 7f2ae3fff640 0 client.17595 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.219+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/3971811710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6a64a0 0x56289b6b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.219+0000 7f2b0d28a740 1 -- 172.21.15.81:0/3971811710 >> 172.21.15.81:0/3971811710 conn(0x56289b6a2a30 msgr2=0x56289b6a1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.219+0000 7f2b0d28a740 1 -- 172.21.15.81:0/3971811710 shutdown_connections 2024-09-12T01:37:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.219+0000 7f2b0d28a740 1 -- 172.21.15.81:0/3971811710 wait complete. 2024-09-12T01:37:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.219+0000 7f2b0d28a740 20 client.17595 trim_cache size 0 max 16384 2024-09-12T01:37:31.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.235+0000 7f2b0d28a740 1 Processor -- start 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b0d28a740 1 -- start start 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b0d28a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6a64a0 0x56289b6c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b0d28a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a6dc0 0x56289b6c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b0d28a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6b1680 0x56289b6ab420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b0d28a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041afb10 con 0x56289b6b1680 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b0d28a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041b1650 con 0x56289b6a6dc0 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b0d28a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041b01e0 con 0x56289b6a64a0 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b03fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6b1680 0x56289b6ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b03fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6b1680 0x56289b6ab420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38510/0 (socket says 172.21.15.81:38510) 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b03fff640 1 -- 172.21.15.81:0/1643452078 learned_addr learned my addr 172.21.15.81:0/1643452078 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b08c4d640 1 --2- 172.21.15.81:0/1643452078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a6dc0 0x56289b6c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b03fff640 1 -- 172.21.15.81:0/1643452078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6a64a0 msgr2=0x56289b6c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b03fff640 1 --2- 172.21.15.81:0/1643452078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6a64a0 0x56289b6c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b03fff640 1 -- 172.21.15.81:0/1643452078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a6dc0 msgr2=0x56289b6c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b03fff640 1 --2- 172.21.15.81:0/1643452078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a6dc0 0x56289b6c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b03fff640 1 -- 172.21.15.81:0/1643452078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56289b6a24d0 con 0x56289b6b1680 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2b03fff640 1 --2- 172.21.15.81:0/1643452078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6b1680 0x56289b6ab420 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f2af40125b0 tx=0x7f2af400e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3892cd0f799a2f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2afa7fc640 1 -- 172.21.15.81:0/1643452078 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4018040 con 0x56289b6b1680 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2afa7fc640 1 -- 172.21.15.81:0/1643452078 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af402f070 con 0x56289b6b1680 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.236+0000 7f2afa7fc640 1 -- 172.21.15.81:0/1643452078 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4004d30 con 0x56289b6b1680 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.237+0000 7f2b0d28a740 1 -- 172.21.15.81:0/1643452078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6b1680 msgr2=0x56289b6ab420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.237+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/1643452078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6b1680 0x56289b6ab420 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f2af40125b0 tx=0x7f2af400e9c0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.237+0000 7f2b0d28a740 1 -- 172.21.15.81:0/1643452078 shutdown_connections 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.237+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/1643452078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6b1680 0x56289b6ab420 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.237+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/1643452078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a6dc0 0x56289b6c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.237+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/1643452078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6a64a0 0x56289b6c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.237+0000 7f2b0d28a740 1 -- 172.21.15.81:0/1643452078 >> 172.21.15.81:0/1643452078 conn(0x56289b6a2a30 msgr2=0x56289b6b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.237+0000 7f2b0d28a740 1 -- 172.21.15.81:0/1643452078 shutdown_connections 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.237+0000 7f2b0d28a740 1 -- 172.21.15.81:0/1643452078 wait complete. 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.237+0000 7f2b0d28a740 1 -- start start 2024-09-12T01:37:31.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.237+0000 7f2b0d28a740 1 Processor -- start 2024-09-12T01:37:31.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b0d28a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a64a0 0x56289b6ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b0d28a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6ab670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b0d28a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6b1680 0x56289b6abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b0d28a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041b0f80 con 0x56289b6a6dc0 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b0d28a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041b08b0 con 0x56289b6a64a0 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b0d28a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041adb10 con 0x56289b6b1680 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b0d28a740 10 client.0 _ll_register_callbacks cb 0x7f2afc009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b08c4d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b08c4d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6ab670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38522/0 (socket says 172.21.15.81:38522) 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b08c4d640 1 -- 172.21.15.81:0/1379695779 learned_addr learned my addr 172.21.15.81:0/1379695779 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b03fff640 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6b1680 0x56289b6abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b03fff640 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a64a0 0x56289b6ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b08c4d640 1 -- 172.21.15.81:0/1379695779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6b1680 msgr2=0x56289b6abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b08c4d640 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6b1680 0x56289b6abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b08c4d640 1 -- 172.21.15.81:0/1379695779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a64a0 msgr2=0x56289b6ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b08c4d640 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a64a0 0x56289b6ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b08c4d640 1 -- 172.21.15.81:0/1379695779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56289b72acf0 con 0x56289b6a6dc0 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b03fff640 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6b1680 0x56289b6abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2b08c4d640 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6ab670 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f2afc006010 tx=0x7f2afc004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c15b50639e905d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.238+0000 7f2ae3fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2ae3fff640 1 -- 172.21.15.81:0/1379695779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc051070 con 0x56289b6a6dc0 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2ae3fff640 1 -- 172.21.15.81:0/1379695779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f2afc0046c0 con 0x56289b6a6dc0 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2b0d28a740 1 -- 172.21.15.81:0/1379695779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2af402f070 con 0x56289b6a6dc0 2024-09-12T01:37:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2ae3fff640 1 -- 172.21.15.81:0/1379695779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2afc040040 con 0x56289b6a6dc0 2024-09-12T01:37:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2b0d28a740 10 client.17601 fetch_fsmap learned FSMap version 28 2024-09-12T01:37:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2b0d28a740 1 -- 172.21.15.81:0/1379695779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56289b72bf40 con 0x56289b6a6dc0 2024-09-12T01:37:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2ae3fff640 1 -- 172.21.15.81:0/1379695779 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af402f070 con 0x56289b6a6dc0 2024-09-12T01:37:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2ae3fff640 1 -- 172.21.15.81:0/1379695779 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2afc004fe0 con 0x56289b6a6dc0 2024-09-12T01:37:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2b0d28a740 10 client.17601 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:37:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2b0d28a740 10 client.17601 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:37:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2b0d28a740 20 client.17601 populate_metadata read hostname 'smithi081' 2024-09-12T01:37:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56289b72c6b0 0x56289b72ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2b0d28a740 4 client.17601 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:37:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.239+0000 7f2b0d28a740 1 -- 172.21.15.81:0/1379695779 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56289b613d60 con 0x56289b72c6b0 2024-09-12T01:37:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b03fff640 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56289b72c6b0 0x56289b72ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b03fff640 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56289b72c6b0 0x56289b72ead0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32aa02d3a497c2e7 server_cookie=bb2237b61a694b66 in_seq=0 out_seq=0 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2ae3fff640 10 client.17601 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2ae3fff640 1 -- 172.21.15.81:0/1379695779 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56289b613d60 con 0x56289b72c6b0 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2ae3fff640 10 client.17601 handle_command_reply: tid=0 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b0d28a740 1 client.17601 shutdown 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b0d28a740 1 -- 172.21.15.81:0/1379695779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 msgr2=0x56289b6ab670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6ab670 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f2afc006010 tx=0x7f2afc004480 comp rx=0 tx=0).stop 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b0d28a740 1 -- 172.21.15.81:0/1379695779 shutdown_connections 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x56289b72c6b0 0x56289b72ead0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56289b6b1680 0x56289b6abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56289b6a6dc0 0x56289b6ab670 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b0d28a740 1 --2- 172.21.15.81:0/1379695779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56289b6a64a0 0x56289b6ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b0d28a740 1 -- 172.21.15.81:0/1379695779 >> 172.21.15.81:0/1379695779 conn(0x56289b6a2a30 msgr2=0x56289b6a1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2ae3fff640 0 client.17601 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:37:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b0d28a740 1 -- 172.21.15.81:0/1379695779 shutdown_connections 2024-09-12T01:37:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b0d28a740 1 -- 172.21.15.81:0/1379695779 wait complete. 2024-09-12T01:37:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.240+0000 7f2b0d28a740 20 client.17601 trim_cache size 0 max 16384 2024-09-12T01:37:31.247 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:37:31.247 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:37:31.247 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-12T01:37:31.247 INFO:teuthology.orchestra.run.smithi081.stdout: "20fd8c2d-f3d6-44a7-bdf2-ab59d448d349": { 2024-09-12T01:37:31.247 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-09-12T01:37:31.247 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "20fd8c2d-f3d6-44a7-bdf2-ab59d448d349", 2024-09-12T01:37:31.248 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-12T01:37:31.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:37:31.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:37:31.248 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:37:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.241+0000 7f2b0aeb1640 1 -- 172.21.15.81:0/4051784831 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2af00a2cf0 msgr2=0x7f2af00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.241+0000 7f2b0aeb1640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2af00a2cf0 0x7f2af00a51b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0cc9b0 tx=0x7f2aec004940 comp rx=0 tx=0).stop 2024-09-12T01:37:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.241+0000 7f2b0aeb1640 1 -- 172.21.15.81:0/4051784831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b04106a80 msgr2=0x7f2b04197af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.241+0000 7f2b0aeb1640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b04106a80 0x7f2b04197af0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00c970 tx=0x7f2aec00ce30 comp rx=0 tx=0).stop 2024-09-12T01:37:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.241+0000 7f2b0aeb1640 1 -- 172.21.15.81:0/4051784831 shutdown_connections 2024-09-12T01:37:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.241+0000 7f2b0aeb1640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2af00a2cf0 0x7f2af00a51b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.241+0000 7f2b0aeb1640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b04106a80 0x7f2b04197af0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.241+0000 7f2b0aeb1640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b04101420 0x7f2b041975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.241+0000 7f2b0aeb1640 1 --2- 172.21.15.81:0/4051784831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b04100a80 0x7f2b04197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.241+0000 7f2b0aeb1640 1 -- 172.21.15.81:0/4051784831 >> 172.21.15.81:0/4051784831 conn(0x7f2b040fc7a0 msgr2=0x7f2b040fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:31.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.241+0000 7f2b0aeb1640 1 -- 172.21.15.81:0/4051784831 shutdown_connections 2024-09-12T01:37:31.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:37:31.241+0000 7f2b0aeb1640 1 -- 172.21.15.81:0/4051784831 wait complete. 2024-09-12T01:37:31.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:31 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:37:31.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:31 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:37:31.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:31 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:37:31.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:31 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:37:31.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:31 smithi081 ceph-mon[30920]: pgmap v292: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 op/s 2024-09-12T01:37:31.918 INFO:tasks.cephfs.filesystem:scrub status for tag:20fd8c2d-f3d6-44a7-bdf2-ab59d448d349 - {'path': '/', 'tag': '20fd8c2d-f3d6-44a7-bdf2-ab59d448d349', 'options': 'recursive,force'} 2024-09-12T01:37:32.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:31 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:37:32.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:31 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:37:32.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:31 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:37:32.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:31 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:37:32.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:31 smithi100 ceph-mon[35275]: pgmap v292: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 op/s 2024-09-12T01:37:32.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:31 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:37:32.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:31 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:37:32.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:31 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:37:32.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:31 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:37:32.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:31 smithi189 ceph-mon[35357]: pgmap v292: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 op/s 2024-09-12T01:37:33.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:33 smithi081 ceph-mon[30920]: pgmap v293: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:34.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:33 smithi100 ceph-mon[35275]: pgmap v293: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:34.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:33 smithi189 ceph-mon[35357]: pgmap v293: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:35.821 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:35 smithi100 ceph-mon[35275]: pgmap v294: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:35.821 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:35 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:37:35.834 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:35 smithi189 ceph-mon[35357]: pgmap v294: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:35.834 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:35 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:37:35.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:35 smithi081 ceph-mon[30920]: pgmap v294: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:35.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:35 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:37:37.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:37 smithi081 ceph-mon[30920]: pgmap v295: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:37:38.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:37 smithi100 ceph-mon[35275]: pgmap v295: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:37:38.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:37 smithi189 ceph-mon[35357]: pgmap v295: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:37:39.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:39 smithi081 ceph-mon[30920]: pgmap v296: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:37:40.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:39 smithi100 ceph-mon[35275]: pgmap v296: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:37:40.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:39 smithi189 ceph-mon[35357]: pgmap v296: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:37:41.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:41 smithi081 ceph-mon[30920]: pgmap v297: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:37:42.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:41 smithi100 ceph-mon[35275]: pgmap v297: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:37:42.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:41 smithi189 ceph-mon[35357]: pgmap v297: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T01:37:43.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:43 smithi081 ceph-mon[30920]: pgmap v298: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:44.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:43 smithi100 ceph-mon[35275]: pgmap v298: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:44.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:43 smithi189 ceph-mon[35357]: pgmap v298: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:45.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:45 smithi081 ceph-mon[30920]: pgmap v299: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:46.021 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:45 smithi100 ceph-mon[35275]: pgmap v299: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:46.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:45 smithi189 ceph-mon[35357]: pgmap v299: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:47.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:47 smithi081 ceph-mon[30920]: pgmap v300: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:37:48.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:47 smithi100 ceph-mon[35275]: pgmap v300: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:37:48.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:47 smithi189 ceph-mon[35357]: pgmap v300: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T01:37:49.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:49 smithi081 ceph-mon[30920]: pgmap v301: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:50.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:49 smithi100 ceph-mon[35275]: pgmap v301: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:50.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:49 smithi189 ceph-mon[35357]: pgmap v301: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:51.997 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:51 smithi081 ceph-mon[30920]: pgmap v302: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:37:52.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:51 smithi100 ceph-mon[35275]: pgmap v302: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:37:52.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:51 smithi189 ceph-mon[35357]: pgmap v302: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:37:53.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:53 smithi081 ceph-mon[30920]: pgmap v303: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:54.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:53 smithi100 ceph-mon[35275]: pgmap v303: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:54.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:53 smithi189 ceph-mon[35357]: pgmap v303: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:55.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:55 smithi081 ceph-mon[30920]: pgmap v304: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:56.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:55 smithi100 ceph-mon[35275]: pgmap v304: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:55 smithi189 ceph-mon[35357]: pgmap v304: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:37:57.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:57 smithi081 ceph-mon[30920]: pgmap v305: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:37:58.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:57 smithi100 ceph-mon[35275]: pgmap v305: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:37:58.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:57 smithi189 ceph-mon[35357]: pgmap v305: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:37:59.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:37:59 smithi081 ceph-mon[30920]: pgmap v306: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:00.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:37:59 smithi100 ceph-mon[35275]: pgmap v306: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:37:59 smithi189 ceph-mon[35357]: pgmap v306: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:01.920 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:38:01.949 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:01 smithi081 ceph-mon[30920]: pgmap v307: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:02.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:01 smithi100 ceph-mon[35275]: pgmap v307: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:02.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:01 smithi189 ceph-mon[35357]: pgmap v307: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:02.183 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.664+0000 7fbd508b6640 1 -- 172.21.15.81:0/2983844195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c1036e0 msgr2=0x7fbd4c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.664+0000 7fbd508b6640 1 --2- 172.21.15.81:0/2983844195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c1036e0 0x7fbd4c107b90 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009930 tx=0x7fbd4002a420 comp rx=0 tx=0).stop 2024-09-12T01:38:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.665+0000 7fbd508b6640 1 -- 172.21.15.81:0/2983844195 shutdown_connections 2024-09-12T01:38:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.665+0000 7fbd508b6640 1 --2- 172.21.15.81:0/2983844195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd4c1082a0 0x7fbd4c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.665+0000 7fbd508b6640 1 --2- 172.21.15.81:0/2983844195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c1036e0 0x7fbd4c107b90 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.665+0000 7fbd508b6640 1 --2- 172.21.15.81:0/2983844195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd4c102d30 0x7fbd4c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.665+0000 7fbd508b6640 1 -- 172.21.15.81:0/2983844195 >> 172.21.15.81:0/2983844195 conn(0x7fbd4c0fc7d0 msgr2=0x7fbd4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.665+0000 7fbd508b6640 1 -- 172.21.15.81:0/2983844195 shutdown_connections 2024-09-12T01:38:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.665+0000 7fbd508b6640 1 -- 172.21.15.81:0/2983844195 wait complete. 2024-09-12T01:38:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.665+0000 7fbd508b6640 1 Processor -- start 2024-09-12T01:38:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.665+0000 7fbd508b6640 1 -- start start 2024-09-12T01:38:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd508b6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd4c102d30 0x7fbd4c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd508b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c1036e0 0x7fbd4c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd508b6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd4c1082a0 0x7fbd4c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd508b6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c1120a0 con 0x7fbd4c1036e0 2024-09-12T01:38:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd508b6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c111f20 con 0x7fbd4c1082a0 2024-09-12T01:38:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd508b6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c112220 con 0x7fbd4c102d30 2024-09-12T01:38:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd49d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c1036e0 0x7fbd4c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd49d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c1036e0 0x7fbd4c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55040/0 (socket says 172.21.15.81:55040) 2024-09-12T01:38:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd49d9b640 1 -- 172.21.15.81:0/2262411179 learned_addr learned my addr 172.21.15.81:0/2262411179 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd4ad9d640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd4c1082a0 0x7fbd4c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd4a59c640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd4c102d30 0x7fbd4c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd49d9b640 1 -- 172.21.15.81:0/2262411179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd4c102d30 msgr2=0x7fbd4c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd49d9b640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd4c102d30 0x7fbd4c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd49d9b640 1 -- 172.21.15.81:0/2262411179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd4c1082a0 msgr2=0x7fbd4c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd49d9b640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd4c1082a0 0x7fbd4c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd49d9b640 1 -- 172.21.15.81:0/2262411179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4c1a6a10 con 0x7fbd4c1036e0 2024-09-12T01:38:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd49d9b640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c1036e0 0x7fbd4c100ed0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fbd40005940 tx=0x7fbd400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd3b7fe640 1 -- 172.21.15.81:0/2262411179 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4003f030 con 0x7fbd4c1036e0 2024-09-12T01:38:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd3b7fe640 1 -- 172.21.15.81:0/2262411179 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd40003ce0 con 0x7fbd4c1036e0 2024-09-12T01:38:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.666+0000 7fbd3b7fe640 1 -- 172.21.15.81:0/2262411179 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40035070 con 0x7fbd4c1036e0 2024-09-12T01:38:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.667+0000 7fbd508b6640 1 -- 172.21.15.81:0/2262411179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4c1a6ca0 con 0x7fbd4c1036e0 2024-09-12T01:38:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.667+0000 7fbd508b6640 1 -- 172.21.15.81:0/2262411179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd4c1a7130 con 0x7fbd4c1036e0 2024-09-12T01:38:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.669+0000 7fbd3b7fe640 1 -- 172.21.15.81:0/2262411179 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fbd40042030 con 0x7fbd4c1036e0 2024-09-12T01:38:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.669+0000 7fbd3b7fe640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbd340a2cf0 0x7fbd340a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.669+0000 7fbd4a59c640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbd340a2cf0 0x7fbd340a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.670+0000 7fbd3b7fe640 1 -- 172.21.15.81:0/2262411179 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fbd400ef850 con 0x7fbd4c1036e0 2024-09-12T01:38:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.670+0000 7fbd4a59c640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbd340a2cf0 0x7fbd340a51b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00bbe0 tx=0x7fbd3c00b390 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.670+0000 7fbd52c8f740 1 Processor -- start 2024-09-12T01:38:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.670+0000 7fbd52c8f740 1 -- start start 2024-09-12T01:38:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd52c8f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 0x55f721fca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd52c8f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 0x55f721fd5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd52c8f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 0x55f721fd7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd52c8f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f721f302e0 con 0x55f721fd5680 2024-09-12T01:38:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd52c8f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f721ed7ce0 con 0x55f721fcadc0 2024-09-12T01:38:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd52c8f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f721f2c2a0 con 0x55f721fca4a0 2024-09-12T01:38:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd4ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 0x55f721fd7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd4ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 0x55f721fd7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55046/0 (socket says 172.21.15.81:55046) 2024-09-12T01:38:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd4ad9d640 1 -- 172.21.15.81:0/588611605 learned_addr learned my addr 172.21.15.81:0/588611605 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd49d9b640 1 --2- 172.21.15.81:0/588611605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 0x55f721fd5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd4a59c640 1 --2- 172.21.15.81:0/588611605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 0x55f721fca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd4ad9d640 1 -- 172.21.15.81:0/588611605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 msgr2=0x55f721fca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd4ad9d640 1 --2- 172.21.15.81:0/588611605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 0x55f721fca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd4ad9d640 1 -- 172.21.15.81:0/588611605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 msgr2=0x55f721fd5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd4ad9d640 1 --2- 172.21.15.81:0/588611605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 0x55f721fd5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd4ad9d640 1 -- 172.21.15.81:0/588611605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f721ebc440 con 0x55f721fd5680 2024-09-12T01:38:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd4a59c640 1 --2- 172.21.15.81:0/588611605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 0x55f721fca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd4ad9d640 1 --2- 172.21.15.81:0/588611605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 0x55f721fd7a70 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fbd44007ec0 tx=0x7fbd4400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93881bffcbae7ae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.671+0000 7fbd38ff9640 1 -- 172.21.15.81:0/588611605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44010840 con 0x55f721fd5680 2024-09-12T01:38:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.672+0000 7fbd38ff9640 1 -- 172.21.15.81:0/588611605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd440183f0 con 0x55f721fd5680 2024-09-12T01:38:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.672+0000 7fbd38ff9640 1 -- 172.21.15.81:0/588611605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44017600 con 0x55f721fd5680 2024-09-12T01:38:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.672+0000 7fbd52c8f740 1 -- 172.21.15.81:0/588611605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 msgr2=0x55f721fd7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.672+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/588611605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 0x55f721fd7a70 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fbd44007ec0 tx=0x7fbd4400f790 comp rx=0 tx=0).stop 2024-09-12T01:38:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.672+0000 7fbd52c8f740 1 -- 172.21.15.81:0/588611605 shutdown_connections 2024-09-12T01:38:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.672+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/588611605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 0x55f721fd7a70 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.672+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/588611605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 0x55f721fd5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.672+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/588611605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 0x55f721fca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.672+0000 7fbd52c8f740 1 -- 172.21.15.81:0/588611605 >> 172.21.15.81:0/588611605 conn(0x55f721fc6a30 msgr2=0x55f721fc6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.672+0000 7fbd52c8f740 1 -- 172.21.15.81:0/588611605 shutdown_connections 2024-09-12T01:38:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.672+0000 7fbd52c8f740 1 -- 172.21.15.81:0/588611605 wait complete. 2024-09-12T01:38:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd52c8f740 1 -- start start 2024-09-12T01:38:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd52c8f740 1 Processor -- start 2024-09-12T01:38:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd52c8f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 0x55f721fd4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd52c8f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 0x55f721fd2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd52c8f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 0x55f721fd2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd52c8f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f721fd8250 con 0x55f721fd5680 2024-09-12T01:38:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd52c8f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f721eeb050 con 0x55f721fcadc0 2024-09-12T01:38:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd52c8f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f721fd83d0 con 0x55f721fca4a0 2024-09-12T01:38:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd52c8f740 10 client.0 _ll_register_callbacks cb 0x55f721f2b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd4ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 0x55f721fd2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd4ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 0x55f721fd2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55052/0 (socket says 172.21.15.81:55052) 2024-09-12T01:38:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd4ad9d640 1 -- 172.21.15.81:0/2002635856 learned_addr learned my addr 172.21.15.81:0/2002635856 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd49d9b640 1 --2- 172.21.15.81:0/2002635856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 0x55f721fd2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd4a59c640 1 --2- 172.21.15.81:0/2002635856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 0x55f721fd4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd4ad9d640 1 -- 172.21.15.81:0/2002635856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 msgr2=0x55f721fd4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd4ad9d640 1 --2- 172.21.15.81:0/2002635856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 0x55f721fd4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd4ad9d640 1 -- 172.21.15.81:0/2002635856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 msgr2=0x55f721fd2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd4ad9d640 1 --2- 172.21.15.81:0/2002635856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 0x55f721fd2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.673+0000 7fbd4ad9d640 1 -- 172.21.15.81:0/2002635856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f721ca13c0 con 0x55f721fd5680 2024-09-12T01:38:02.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd4ad9d640 1 --2- 172.21.15.81:0/2002635856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 0x55f721fd2740 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fbd44000f80 tx=0x7fbd44018ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54938a65f27990d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd31ffb640 1 -- 172.21.15.81:0/2002635856 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44026020 con 0x55f721fd5680 2024-09-12T01:38:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd31ffb640 1 -- 172.21.15.81:0/2002635856 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fbd44003b80 con 0x55f721fd5680 2024-09-12T01:38:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd52c8f740 1 -- 172.21.15.81:0/2002635856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd440183f0 con 0x55f721fd5680 2024-09-12T01:38:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd31ffb640 1 -- 172.21.15.81:0/2002635856 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbd44031050 con 0x55f721fd5680 2024-09-12T01:38:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd52c8f740 10 client.17613 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd52c8f740 1 -- 172.21.15.81:0/2002635856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f721fe3b10 con 0x55f721fd5680 2024-09-12T01:38:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd31ffb640 1 -- 172.21.15.81:0/2002635856 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd440183f0 con 0x55f721fd5680 2024-09-12T01:38:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd31ffb640 1 -- 172.21.15.81:0/2002635856 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbd44004160 con 0x55f721fd5680 2024-09-12T01:38:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd52c8f740 10 client.17613 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd52c8f740 10 client.17613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:38:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd52c8f740 20 client.17613 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/2002635856 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f721fe4f70 0x55f721fe7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.674+0000 7fbd52c8f740 4 client.17613 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.675+0000 7fbd52c8f740 1 -- 172.21.15.81:0/2002635856 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f721f3d850 con 0x55f721fe4f70 2024-09-12T01:38:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.675+0000 7fbd4a59c640 1 --2- 172.21.15.81:0/2002635856 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f721fe4f70 0x55f721fe7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.675+0000 7fbd31ffb640 10 client.17613 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.675+0000 7fbd4a59c640 1 --2- 172.21.15.81:0/2002635856 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f721fe4f70 0x55f721fe7360 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f239a62f84c0dae server_cookie=312a3c80d32c3605 in_seq=0 out_seq=0 2024-09-12T01:38:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd31ffb640 1 -- 172.21.15.81:0/2002635856 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f721f3d850 con 0x55f721fe4f70 2024-09-12T01:38:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd31ffb640 10 client.17613 handle_command_reply: tid=0 2024-09-12T01:38:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd52c8f740 1 client.17613 shutdown 2024-09-12T01:38:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd52c8f740 1 -- 172.21.15.81:0/2002635856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 msgr2=0x55f721fd2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/2002635856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 0x55f721fd2740 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fbd44000f80 tx=0x7fbd44018ed0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd52c8f740 1 -- 172.21.15.81:0/2002635856 shutdown_connections 2024-09-12T01:38:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/2002635856 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f721fe4f70 0x55f721fe7360 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd31ffb640 0 client.17613 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/2002635856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fd5680 0x55f721fd2740 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/2002635856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 0x55f721fd2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/2002635856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 0x55f721fd4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd52c8f740 1 -- 172.21.15.81:0/2002635856 >> 172.21.15.81:0/2002635856 conn(0x55f721fc6a30 msgr2=0x55f721fcc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd52c8f740 1 -- 172.21.15.81:0/2002635856 shutdown_connections 2024-09-12T01:38:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd52c8f740 1 -- 172.21.15.81:0/2002635856 wait complete. 2024-09-12T01:38:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.676+0000 7fbd52c8f740 20 client.17613 trim_cache size 0 max 16384 2024-09-12T01:38:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.693+0000 7fbd52c8f740 1 Processor -- start 2024-09-12T01:38:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.693+0000 7fbd52c8f740 1 -- start start 2024-09-12T01:38:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.693+0000 7fbd52c8f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 0x55f721fe14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.693+0000 7fbd52c8f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fcadc0 0x55f721fcd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.693+0000 7fbd52c8f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fd5680 0x55f721fd4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.693+0000 7fbd52c8f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c1afad0 con 0x55f721fcadc0 2024-09-12T01:38:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.693+0000 7fbd52c8f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c1b1610 con 0x55f721fd5680 2024-09-12T01:38:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.693+0000 7fbd52c8f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c1b01a0 con 0x55f721fca4a0 2024-09-12T01:38:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd49d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fcadc0 0x55f721fcd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd49d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fcadc0 0x55f721fcd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55054/0 (socket says 172.21.15.81:55054) 2024-09-12T01:38:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd49d9b640 1 -- 172.21.15.81:0/3556561376 learned_addr learned my addr 172.21.15.81:0/3556561376 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd4a59c640 1 --2- 172.21.15.81:0/3556561376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 0x55f721fe14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd4ad9d640 1 --2- 172.21.15.81:0/3556561376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fd5680 0x55f721fd4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd49d9b640 1 -- 172.21.15.81:0/3556561376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 msgr2=0x55f721fe14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd49d9b640 1 --2- 172.21.15.81:0/3556561376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 0x55f721fe14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd49d9b640 1 -- 172.21.15.81:0/3556561376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fd5680 msgr2=0x55f721fd4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd49d9b640 1 --2- 172.21.15.81:0/3556561376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fd5680 0x55f721fd4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd49d9b640 1 -- 172.21.15.81:0/3556561376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f721fd0750 con 0x55f721fcadc0 2024-09-12T01:38:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd4ad9d640 1 --2- 172.21.15.81:0/3556561376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fd5680 0x55f721fd4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd49d9b640 1 --2- 172.21.15.81:0/3556561376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fcadc0 0x55f721fcd050 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009900 tx=0x7fbd400bbd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e09c84b1054a3eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd33fff640 1 -- 172.21.15.81:0/3556561376 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40049070 con 0x55f721fcadc0 2024-09-12T01:38:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd33fff640 1 -- 172.21.15.81:0/3556561376 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd400c0120 con 0x55f721fcadc0 2024-09-12T01:38:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.694+0000 7fbd33fff640 1 -- 172.21.15.81:0/3556561376 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd400bc080 con 0x55f721fcadc0 2024-09-12T01:38:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.695+0000 7fbd52c8f740 1 -- 172.21.15.81:0/3556561376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fcadc0 msgr2=0x55f721fcd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.695+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/3556561376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fcadc0 0x55f721fcd050 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009900 tx=0x7fbd400bbd10 comp rx=0 tx=0).stop 2024-09-12T01:38:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.695+0000 7fbd52c8f740 1 -- 172.21.15.81:0/3556561376 shutdown_connections 2024-09-12T01:38:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.695+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/3556561376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fd5680 0x55f721fd4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.695+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/3556561376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fcadc0 0x55f721fcd050 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.695+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/3556561376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fca4a0 0x55f721fe14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.695+0000 7fbd52c8f740 1 -- 172.21.15.81:0/3556561376 >> 172.21.15.81:0/3556561376 conn(0x55f721fc6a30 msgr2=0x55f721fd3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.695+0000 7fbd52c8f740 1 -- 172.21.15.81:0/3556561376 shutdown_connections 2024-09-12T01:38:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.695+0000 7fbd52c8f740 1 -- 172.21.15.81:0/3556561376 wait complete. 2024-09-12T01:38:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.695+0000 7fbd52c8f740 1 -- start start 2024-09-12T01:38:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.695+0000 7fbd52c8f740 1 Processor -- start 2024-09-12T01:38:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd52c8f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fca4a0 0x55f721fdd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd52c8f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 0x55f721fddb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd52c8f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fd5680 0x55f721fda5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd52c8f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c1b0f40 con 0x55f721fca4a0 2024-09-12T01:38:02.719 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:38:02.719 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:38:02.719 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:38:02.719 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:38:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd52c8f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c1b0870 con 0x55f721fcadc0 2024-09-12T01:38:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd52c8f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c1adad0 con 0x55f721fd5680 2024-09-12T01:38:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd52c8f740 10 client.0 _ll_register_callbacks cb 0x7fbd44007d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd4a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fca4a0 0x55f721fdd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd4a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fca4a0 0x55f721fdd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55068/0 (socket says 172.21.15.81:55068) 2024-09-12T01:38:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd4a59c640 1 -- 172.21.15.81:0/755112914 learned_addr learned my addr 172.21.15.81:0/755112914 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd49d9b640 1 --2- 172.21.15.81:0/755112914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 0x55f721fddb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd4ad9d640 1 --2- 172.21.15.81:0/755112914 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fd5680 0x55f721fda5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd4a59c640 1 -- 172.21.15.81:0/755112914 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fd5680 msgr2=0x55f721fda5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd4a59c640 1 --2- 172.21.15.81:0/755112914 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fd5680 0x55f721fda5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd4a59c640 1 -- 172.21.15.81:0/755112914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 msgr2=0x55f721fddb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd4a59c640 1 --2- 172.21.15.81:0/755112914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 0x55f721fddb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd4a59c640 1 -- 172.21.15.81:0/755112914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f721fdab30 con 0x55f721fca4a0 2024-09-12T01:38:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd4a59c640 1 --2- 172.21.15.81:0/755112914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fca4a0 0x55f721fdd620 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x55f721fe7900 tx=0x7fbd3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f79a4cdd87f6f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.696+0000 7fbd31ffb640 1 -- 172.21.15.81:0/755112914 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c02f670 con 0x55f721fca4a0 2024-09-12T01:38:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd31ffb640 1 -- 172.21.15.81:0/755112914 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7fbd3c02f810 con 0x55f721fca4a0 2024-09-12T01:38:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd52c8f740 1 -- 172.21.15.81:0/755112914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd400c0120 con 0x55f721fca4a0 2024-09-12T01:38:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd31ffb640 1 -- 172.21.15.81:0/755112914 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbd3c02fa10 con 0x55f721fca4a0 2024-09-12T01:38:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd52c8f740 10 client.17619 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd52c8f740 1 -- 172.21.15.81:0/755112914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f72204ffb0 con 0x55f721fca4a0 2024-09-12T01:38:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd31ffb640 1 -- 172.21.15.81:0/755112914 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd400c0120 con 0x55f721fca4a0 2024-09-12T01:38:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd31ffb640 1 -- 172.21.15.81:0/755112914 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbd3c01c400 con 0x55f721fca4a0 2024-09-12T01:38:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd52c8f740 10 client.17619 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd52c8f740 10 client.17619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:38:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd52c8f740 20 client.17619 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/755112914 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f721fe4f70 0x55f722052720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd52c8f740 4 client.17619 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:38:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd52c8f740 1 -- 172.21.15.81:0/755112914 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f721f37d60 con 0x55f721fe4f70 2024-09-12T01:38:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.697+0000 7fbd49d9b640 1 --2- 172.21.15.81:0/755112914 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f721fe4f70 0x55f722052720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd31ffb640 10 client.17619 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd49d9b640 1 --2- 172.21.15.81:0/755112914 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f721fe4f70 0x55f722052720 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b328155bcc87058e server_cookie=7388dc56ee51f4e7 in_seq=0 out_seq=0 2024-09-12T01:38:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd31ffb640 1 -- 172.21.15.81:0/755112914 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f721f37d60 con 0x55f721fe4f70 2024-09-12T01:38:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd31ffb640 10 client.17619 handle_command_reply: tid=0 2024-09-12T01:38:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd52c8f740 1 client.17619 shutdown 2024-09-12T01:38:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd52c8f740 1 -- 172.21.15.81:0/755112914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fca4a0 msgr2=0x55f721fdd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/755112914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fca4a0 0x55f721fdd620 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x55f721fe7900 tx=0x7fbd3c004730 comp rx=0 tx=0).stop 2024-09-12T01:38:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd52c8f740 1 -- 172.21.15.81:0/755112914 shutdown_connections 2024-09-12T01:38:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/755112914 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55f721fe4f70 0x55f722052720 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/755112914 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f721fd5680 0x55f721fda5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/755112914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f721fcadc0 0x55f721fddb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd52c8f740 1 --2- 172.21.15.81:0/755112914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f721fca4a0 0x55f721fdd620 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd31ffb640 0 client.17619 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd52c8f740 1 -- 172.21.15.81:0/755112914 >> 172.21.15.81:0/755112914 conn(0x55f721fc6a30 msgr2=0x55f721fd4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd52c8f740 1 -- 172.21.15.81:0/755112914 shutdown_connections 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd52c8f740 1 -- 172.21.15.81:0/755112914 wait complete. 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.698+0000 7fbd52c8f740 20 client.17619 trim_cache size 0 max 16384 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.699+0000 7fbd508b6640 1 -- 172.21.15.81:0/2262411179 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbd340a2cf0 msgr2=0x7fbd340a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.699+0000 7fbd508b6640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbd340a2cf0 0x7fbd340a51b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00bbe0 tx=0x7fbd3c00b390 comp rx=0 tx=0).stop 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.699+0000 7fbd508b6640 1 -- 172.21.15.81:0/2262411179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c1036e0 msgr2=0x7fbd4c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.699+0000 7fbd508b6640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c1036e0 0x7fbd4c100ed0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fbd40005940 tx=0x7fbd400042f0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.699+0000 7fbd508b6640 1 -- 172.21.15.81:0/2262411179 shutdown_connections 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.699+0000 7fbd508b6640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbd340a2cf0 0x7fbd340a51b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.699+0000 7fbd508b6640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd4c1082a0 0x7fbd4c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.699+0000 7fbd508b6640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c1036e0 0x7fbd4c100ed0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.699+0000 7fbd508b6640 1 --2- 172.21.15.81:0/2262411179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbd4c102d30 0x7fbd4c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.699+0000 7fbd508b6640 1 -- 172.21.15.81:0/2262411179 >> 172.21.15.81:0/2262411179 conn(0x7fbd4c0fc7d0 msgr2=0x7fbd4c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.699+0000 7fbd508b6640 1 -- 172.21.15.81:0/2262411179 shutdown_connections 2024-09-12T01:38:02.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:02.699+0000 7fbd508b6640 1 -- 172.21.15.81:0/2262411179 wait complete. 2024-09-12T01:38:03.453 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:38:03.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:38:03.746 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:03.867 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:03 smithi081 ceph-mon[30920]: pgmap v308: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:04.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:03 smithi100 ceph-mon[35275]: pgmap v308: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:04.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:03 smithi189 ceph-mon[35357]: pgmap v308: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:04.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.225+0000 7f518f3ec640 1 -- 172.21.15.81:0/2787535876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5188100b30 msgr2=0x7f5188100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:04.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.225+0000 7f518f3ec640 1 --2- 172.21.15.81:0/2787535876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5188100b30 0x7f5188100f10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5184009900 tx=0x7f518402a470 comp rx=0 tx=0).stop 2024-09-12T01:38:04.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.226+0000 7f518f3ec640 1 -- 172.21.15.81:0/2787535876 shutdown_connections 2024-09-12T01:38:04.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.226+0000 7f518f3ec640 1 --2- 172.21.15.81:0/2787535876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188105f40 0x7f51881063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.226+0000 7f518f3ec640 1 --2- 172.21.15.81:0/2787535876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188101450 0x7f5188105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.226+0000 7f518f3ec640 1 --2- 172.21.15.81:0/2787535876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5188100b30 0x7f5188100f10 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.226+0000 7f518f3ec640 1 -- 172.21.15.81:0/2787535876 >> 172.21.15.81:0/2787535876 conn(0x7f51880fc7a0 msgr2=0x7f51880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.226+0000 7f518f3ec640 1 -- 172.21.15.81:0/2787535876 shutdown_connections 2024-09-12T01:38:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.226+0000 7f518f3ec640 1 -- 172.21.15.81:0/2787535876 wait complete. 2024-09-12T01:38:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.226+0000 7f518f3ec640 1 Processor -- start 2024-09-12T01:38:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.226+0000 7f518f3ec640 1 -- start start 2024-09-12T01:38:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.226+0000 7f518f3ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5188100b30 0x7f51881a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518f3ec640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188101450 0x7f51881a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518f3ec640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188105f40 0x7f518819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518f3ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5188118570 con 0x7f5188100b30 2024-09-12T01:38:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518f3ec640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f51881183f0 con 0x7f5188101450 2024-09-12T01:38:04.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518f3ec640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f51881186f0 con 0x7f5188105f40 2024-09-12T01:38:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518d188640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5188100b30 0x7f51881a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518d188640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5188100b30 0x7f51881a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55090/0 (socket says 172.21.15.81:55090) 2024-09-12T01:38:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518d188640 1 -- 172.21.15.81:0/1343270430 learned_addr learned my addr 172.21.15.81:0/1343270430 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518d989640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188105f40 0x7f518819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518c987640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188101450 0x7f51881a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518d188640 1 -- 172.21.15.81:0/1343270430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188105f40 msgr2=0x7f518819e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518d188640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188105f40 0x7f518819e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518d188640 1 -- 172.21.15.81:0/1343270430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188101450 msgr2=0x7f51881a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518d188640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188101450 0x7f51881a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518d188640 1 -- 172.21.15.81:0/1343270430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518819efd0 con 0x7f5188100b30 2024-09-12T01:38:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518c987640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188101450 0x7f51881a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518d188640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5188100b30 0x7f51881a46e0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f5184005ab0 tx=0x7f51840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:04.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f517e7fc640 1 -- 172.21.15.81:0/1343270430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518403f030 con 0x7f5188100b30 2024-09-12T01:38:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f517e7fc640 1 -- 172.21.15.81:0/1343270430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5184003ce0 con 0x7f5188100b30 2024-09-12T01:38:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518f3ec640 1 -- 172.21.15.81:0/1343270430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518819f260 con 0x7f5188100b30 2024-09-12T01:38:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f517e7fc640 1 -- 172.21.15.81:0/1343270430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5184035070 con 0x7f5188100b30 2024-09-12T01:38:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.227+0000 7f518f3ec640 1 -- 172.21.15.81:0/1343270430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51881ab5b0 con 0x7f5188100b30 2024-09-12T01:38:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.228+0000 7f518f3ec640 1 -- 172.21.15.81:0/1343270430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5188105920 con 0x7f5188100b30 2024-09-12T01:38:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.229+0000 7f517e7fc640 1 -- 172.21.15.81:0/1343270430 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5184042030 con 0x7f5188100b30 2024-09-12T01:38:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.230+0000 7f517e7fc640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f51740a2cf0 0x7f51740a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.230+0000 7f518c987640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f51740a2cf0 0x7f51740a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.230+0000 7f517e7fc640 1 -- 172.21.15.81:0/1343270430 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f51840efdf0 con 0x7f5188100b30 2024-09-12T01:38:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.230+0000 7f518c987640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f51740a2cf0 0x7f51740a51b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f51880ffe00 tx=0x7f5178005dd0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:04.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.234+0000 7f517e7fc640 1 -- 172.21.15.81:0/1343270430 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51840bca10 con 0x7f5188100b30 2024-09-12T01:38:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.436+0000 7f518f3ec640 1 -- 172.21.15.81:0/1343270430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51881ab830 con 0x7f5188100b30 2024-09-12T01:38:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.437+0000 7f517e7fc640 1 -- 172.21.15.81:0/1343270430 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f51840bc310 con 0x7f5188100b30 2024-09-12T01:38:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:38:04.437 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:38:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:38:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.439+0000 7f518f3ec640 1 -- 172.21.15.81:0/1343270430 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f51740a2cf0 msgr2=0x7f51740a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.439+0000 7f518f3ec640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f51740a2cf0 0x7f51740a51b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f51880ffe00 tx=0x7f5178005dd0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.439+0000 7f518f3ec640 1 -- 172.21.15.81:0/1343270430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5188100b30 msgr2=0x7f51881a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.439+0000 7f518f3ec640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5188100b30 0x7f51881a46e0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f5184005ab0 tx=0x7f51840042f0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.439+0000 7f518f3ec640 1 -- 172.21.15.81:0/1343270430 shutdown_connections 2024-09-12T01:38:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.439+0000 7f518f3ec640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f51740a2cf0 0x7f51740a51b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.439+0000 7f518f3ec640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188105f40 0x7f518819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.439+0000 7f518f3ec640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5188101450 0x7f51881a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.439+0000 7f518f3ec640 1 --2- 172.21.15.81:0/1343270430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5188100b30 0x7f51881a46e0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.439+0000 7f518f3ec640 1 -- 172.21.15.81:0/1343270430 >> 172.21.15.81:0/1343270430 conn(0x7f51880fc7a0 msgr2=0x7f518810f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.439+0000 7f518f3ec640 1 -- 172.21.15.81:0/1343270430 shutdown_connections 2024-09-12T01:38:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:04.439+0000 7f518f3ec640 1 -- 172.21.15.81:0/1343270430 wait complete. 2024-09-12T01:38:04.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:04 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1343270430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:38:05.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:04 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1343270430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:38:05.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:04 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1343270430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:38:05.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:38:05.295 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:05.696 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:05 smithi081 ceph-mon[30920]: pgmap v309: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:05.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.778+0000 7f2457c97640 1 -- 172.21.15.81:0/4001267935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f245010c170 msgr2=0x7f245010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.778+0000 7f2457c97640 1 --2- 172.21.15.81:0/4001267935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f245010c170 0x7f245010e610 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f2448009ca0 tx=0x7f244802a950 comp rx=0 tx=0).stop 2024-09-12T01:38:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.778+0000 7f2457c97640 1 -- 172.21.15.81:0/4001267935 shutdown_connections 2024-09-12T01:38:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.778+0000 7f2457c97640 1 --2- 172.21.15.81:0/4001267935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f245010c170 0x7f245010e610 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.778+0000 7f2457c97640 1 --2- 172.21.15.81:0/4001267935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2450103660 0x7f245010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.778+0000 7f2457c97640 1 --2- 172.21.15.81:0/4001267935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450102d40 0x7f2450103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.778+0000 7f2457c97640 1 -- 172.21.15.81:0/4001267935 >> 172.21.15.81:0/4001267935 conn(0x7f24500fc7a0 msgr2=0x7f24500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.778+0000 7f2457c97640 1 -- 172.21.15.81:0/4001267935 shutdown_connections 2024-09-12T01:38:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.778+0000 7f2457c97640 1 -- 172.21.15.81:0/4001267935 wait complete. 2024-09-12T01:38:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2457c97640 1 Processor -- start 2024-09-12T01:38:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2457c97640 1 -- start start 2024-09-12T01:38:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2457c97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450102d40 0x7f2450198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2457c97640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450103660 0x7f2450198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2457c97640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f245010c170 0x7f245019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2457c97640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2450111fb0 con 0x7f2450102d40 2024-09-12T01:38:05.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2457c97640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2450111e30 con 0x7f2450103660 2024-09-12T01:38:05.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2457c97640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2450112130 con 0x7f245010c170 2024-09-12T01:38:05.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2455a33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450102d40 0x7f2450198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2455a33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450102d40 0x7f2450198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55112/0 (socket says 172.21.15.81:55112) 2024-09-12T01:38:05.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2455a33640 1 -- 172.21.15.81:0/3657421545 learned_addr learned my addr 172.21.15.81:0/3657421545 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:05.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2455a33640 1 -- 172.21.15.81:0/3657421545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f245010c170 msgr2=0x7f245019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2455a33640 1 --2- 172.21.15.81:0/3657421545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f245010c170 0x7f245019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2455a33640 1 -- 172.21.15.81:0/3657421545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450103660 msgr2=0x7f2450198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2455232640 1 --2- 172.21.15.81:0/3657421545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450103660 0x7f2450198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2455a33640 1 --2- 172.21.15.81:0/3657421545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450103660 0x7f2450198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2455a33640 1 -- 172.21.15.81:0/3657421545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245019d3e0 con 0x7f2450102d40 2024-09-12T01:38:05.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.779+0000 7f2455a33640 1 --2- 172.21.15.81:0/3657421545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450102d40 0x7f2450198430 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f244c00c890 tx=0x7f244c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:05.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.780+0000 7f2446ffd640 1 -- 172.21.15.81:0/3657421545 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c004220 con 0x7f2450102d40 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.780+0000 7f2457c97640 1 -- 172.21.15.81:0/3657421545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245019d6d0 con 0x7f2450102d40 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.780+0000 7f2446ffd640 1 -- 172.21.15.81:0/3657421545 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f244c0043c0 con 0x7f2450102d40 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.780+0000 7f2446ffd640 1 -- 172.21.15.81:0/3657421545 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c0049e0 con 0x7f2450102d40 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.780+0000 7f2457c97640 1 -- 172.21.15.81:0/3657421545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24501a4fb0 con 0x7f2450102d40 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.782+0000 7f2446ffd640 1 -- 172.21.15.81:0/3657421545 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f244c0079b0 con 0x7f2450102d40 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.782+0000 7f245a070740 1 Processor -- start 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.782+0000 7f245a070740 1 -- start start 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.783+0000 7f245a070740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc458b40 0x55bcbc457090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.783+0000 7f2446ffd640 1 --2- 172.21.15.81:0/3657421545 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f243c0a2cf0 0x7f243c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.783+0000 7f245a070740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 0x55bcbc457a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.783+0000 7f245a070740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc466780 0x55bcbc468b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.783+0000 7f245a070740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bcbc3bd2f0 con 0x55bcbc458b40 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.783+0000 7f245a070740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55bcbc364cf0 con 0x55bcbc466780 2024-09-12T01:38:05.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.783+0000 7f245a070740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bcbc3b92b0 con 0x55bcbc4575d0 2024-09-12T01:38:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.783+0000 7f2456234640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc458b40 0x55bcbc457090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.783+0000 7f2446ffd640 1 -- 172.21.15.81:0/3657421545 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f244c0cf560 con 0x7f2450102d40 2024-09-12T01:38:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.783+0000 7f2456234640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc458b40 0x55bcbc457090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55120/0 (socket says 172.21.15.81:55120) 2024-09-12T01:38:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.783+0000 7f2455a33640 1 --2- 172.21.15.81:0/3657421545 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f243c0a2cf0 0x7f243c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.783+0000 7f2456234640 1 -- 172.21.15.81:0/3919491404 learned_addr learned my addr 172.21.15.81:0/3919491404 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.783+0000 7f2455232640 1 --2- 172.21.15.81:0/3919491404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 0x55bcbc457a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.784+0000 7f2455a33640 1 --2- 172.21.15.81:0/3657421545 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f243c0a2cf0 0x7f243c0a51b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f244c0058c0 tx=0x7f244c0054a0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.784+0000 7f2456234640 1 --2- 172.21.15.81:0/3919491404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc466780 0x55bcbc468b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.784+0000 7f2456234640 1 -- 172.21.15.81:0/3919491404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 msgr2=0x55bcbc457a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.784+0000 7f2456234640 1 --2- 172.21.15.81:0/3919491404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 0x55bcbc457a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.784+0000 7f2456234640 1 -- 172.21.15.81:0/3919491404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc466780 msgr2=0x55bcbc468b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.784+0000 7f2456234640 1 --2- 172.21.15.81:0/3919491404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc466780 0x55bcbc468b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.784+0000 7f2456234640 1 -- 172.21.15.81:0/3919491404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbc3493a0 con 0x55bcbc458b40 2024-09-12T01:38:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.784+0000 7f2456234640 1 --2- 172.21.15.81:0/3919491404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc458b40 0x55bcbc457090 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x55bcbc458070 tx=0x7f2448005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce927ebcad3bdf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.784+0000 7f243bfff640 1 -- 172.21.15.81:0/3919491404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448034040 con 0x55bcbc458b40 2024-09-12T01:38:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.784+0000 7f243bfff640 1 -- 172.21.15.81:0/3919491404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2448003970 con 0x55bcbc458b40 2024-09-12T01:38:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.784+0000 7f243bfff640 1 -- 172.21.15.81:0/3919491404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24480042a0 con 0x55bcbc458b40 2024-09-12T01:38:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.785+0000 7f245a070740 1 -- 172.21.15.81:0/3919491404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc458b40 msgr2=0x55bcbc457090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.785+0000 7f245a070740 1 --2- 172.21.15.81:0/3919491404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc458b40 0x55bcbc457090 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x55bcbc458070 tx=0x7f2448005ef0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.785+0000 7f245a070740 1 -- 172.21.15.81:0/3919491404 shutdown_connections 2024-09-12T01:38:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.785+0000 7f245a070740 1 --2- 172.21.15.81:0/3919491404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc466780 0x55bcbc468b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.785+0000 7f245a070740 1 --2- 172.21.15.81:0/3919491404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 0x55bcbc457a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.785+0000 7f245a070740 1 --2- 172.21.15.81:0/3919491404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc458b40 0x55bcbc457090 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.785+0000 7f245a070740 1 -- 172.21.15.81:0/3919491404 >> 172.21.15.81:0/3919491404 conn(0x55bcbc420310 msgr2=0x55bcbc453c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:05.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.785+0000 7f245a070740 1 -- 172.21.15.81:0/3919491404 shutdown_connections 2024-09-12T01:38:05.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.785+0000 7f245a070740 1 -- 172.21.15.81:0/3919491404 wait complete. 2024-09-12T01:38:05.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.786+0000 7f245a070740 1 -- start start 2024-09-12T01:38:05.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.786+0000 7f245a070740 1 Processor -- start 2024-09-12T01:38:05.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.786+0000 7f245a070740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 0x55bcbc466160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.786+0000 7f245a070740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 0x55bcbc463410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.786+0000 7f245a070740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 0x55bcbc4639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.786+0000 7f245a070740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bcbc469420 con 0x55bcbc466780 2024-09-12T01:38:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.786+0000 7f245a070740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55bcbc378060 con 0x55bcbc458b40 2024-09-12T01:38:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.786+0000 7f245a070740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bcbc4695a0 con 0x55bcbc4575d0 2024-09-12T01:38:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.786+0000 7f245a070740 10 client.0 _ll_register_callbacks cb 0x55bcbc0cb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.786+0000 7f2456234640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 0x55bcbc4639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.786+0000 7f2456234640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 0x55bcbc4639e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55130/0 (socket says 172.21.15.81:55130) 2024-09-12T01:38:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.786+0000 7f2456234640 1 -- 172.21.15.81:0/1821977967 learned_addr learned my addr 172.21.15.81:0/1821977967 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.786+0000 7f2455232640 1 --2- 172.21.15.81:0/1821977967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 0x55bcbc463410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f2456234640 1 --2- 172.21.15.81:0/1821977967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 0x55bcbc466160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f2456234640 1 -- 172.21.15.81:0/1821977967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 msgr2=0x55bcbc466160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f2456234640 1 --2- 172.21.15.81:0/1821977967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 0x55bcbc466160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f2456234640 1 -- 172.21.15.81:0/1821977967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 msgr2=0x55bcbc463410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f2456234640 1 --2- 172.21.15.81:0/1821977967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 0x55bcbc463410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f2456234640 1 -- 172.21.15.81:0/1821977967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcbc12e3c0 con 0x55bcbc466780 2024-09-12T01:38:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f2456234640 1 --2- 172.21.15.81:0/1821977967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 0x55bcbc4639e0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f2448000f80 tx=0x7f244802fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3986fe2f3518868a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f24397fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f24397fa640 1 -- 172.21.15.81:0/1821977967 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448034070 con 0x55bcbc466780 2024-09-12T01:38:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f245a070740 1 -- 172.21.15.81:0/1821977967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2448003970 con 0x55bcbc466780 2024-09-12T01:38:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f24397fa640 1 -- 172.21.15.81:0/1821977967 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f2448004040 con 0x55bcbc466780 2024-09-12T01:38:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f24397fa640 1 -- 172.21.15.81:0/1821977967 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2448004240 con 0x55bcbc466780 2024-09-12T01:38:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f245a070740 10 client.17637 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.787+0000 7f245a070740 1 -- 172.21.15.81:0/1821977967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bcbc474ea0 con 0x55bcbc466780 2024-09-12T01:38:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.788+0000 7f24397fa640 1 -- 172.21.15.81:0/1821977967 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2448003970 con 0x55bcbc466780 2024-09-12T01:38:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.788+0000 7f24397fa640 1 -- 172.21.15.81:0/1821977967 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2448059a80 con 0x55bcbc466780 2024-09-12T01:38:05.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.788+0000 7f245a070740 10 client.17637 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.788+0000 7f245a070740 10 client.17637 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.788+0000 7f245a070740 20 client.17637 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.788+0000 7f245a070740 1 --2- 172.21.15.81:0/1821977967 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55bcbc4761f0 0x55bcbc4785e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.788+0000 7f245a070740 4 client.17637 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.788+0000 7f245a070740 1 -- 172.21.15.81:0/1821977967 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcbc3ca860 con 0x55bcbc4761f0 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.788+0000 7f2455232640 1 --2- 172.21.15.81:0/1821977967 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55bcbc4761f0 0x55bcbc4785e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.789+0000 7f24397fa640 10 client.17637 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.789+0000 7f2455232640 1 --2- 172.21.15.81:0/1821977967 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55bcbc4761f0 0x55bcbc4785e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7b3cd171bec3a79c server_cookie=e0c8cda1bb48cde4 in_seq=0 out_seq=0 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.789+0000 7f24397fa640 1 -- 172.21.15.81:0/1821977967 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bcbc3ca860 con 0x55bcbc4761f0 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.789+0000 7f24397fa640 10 client.17637 handle_command_reply: tid=0 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.789+0000 7f245a070740 1 client.17637 shutdown 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.790+0000 7f245a070740 1 -- 172.21.15.81:0/1821977967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 msgr2=0x55bcbc4639e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.790+0000 7f245a070740 1 --2- 172.21.15.81:0/1821977967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 0x55bcbc4639e0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f2448000f80 tx=0x7f244802fc40 comp rx=0 tx=0).stop 2024-09-12T01:38:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.790+0000 7f245a070740 1 -- 172.21.15.81:0/1821977967 shutdown_connections 2024-09-12T01:38:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.790+0000 7f245a070740 1 --2- 172.21.15.81:0/1821977967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 0x55bcbc4639e0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.790+0000 7f245a070740 1 --2- 172.21.15.81:0/1821977967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 0x55bcbc463410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.790+0000 7f245a070740 1 --2- 172.21.15.81:0/1821977967 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55bcbc4761f0 0x55bcbc4785e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.790+0000 7f245a070740 1 --2- 172.21.15.81:0/1821977967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 0x55bcbc466160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.790+0000 7f24397fa640 0 client.17637 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:38:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.790+0000 7f245a070740 1 -- 172.21.15.81:0/1821977967 >> 172.21.15.81:0/1821977967 conn(0x55bcbc420310 msgr2=0x55bcbc459960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:05.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.790+0000 7f245a070740 1 -- 172.21.15.81:0/1821977967 shutdown_connections 2024-09-12T01:38:05.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.790+0000 7f245a070740 1 -- 172.21.15.81:0/1821977967 wait complete. 2024-09-12T01:38:05.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.790+0000 7f245a070740 20 client.17637 trim_cache size 0 max 16384 2024-09-12T01:38:05.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.813+0000 7f245a070740 1 Processor -- start 2024-09-12T01:38:05.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.813+0000 7f245a070740 1 -- start start 2024-09-12T01:38:05.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.813+0000 7f245a070740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 0x55bcbc465380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.813+0000 7f245a070740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 0x55bcbc453510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.813+0000 7f245a070740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 0x55bcbc453a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.813+0000 7f245a070740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24501ab750 con 0x55bcbc466780 2024-09-12T01:38:05.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.813+0000 7f245a070740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f24501ad290 con 0x55bcbc458b40 2024-09-12T01:38:05.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.813+0000 7f245a070740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f24501abe20 con 0x55bcbc4575d0 2024-09-12T01:38:05.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.813+0000 7f2456234640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 0x55bcbc453a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.813+0000 7f2456234640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 0x55bcbc453a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55144/0 (socket says 172.21.15.81:55144) 2024-09-12T01:38:05.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.813+0000 7f2456234640 1 -- 172.21.15.81:0/2644053584 learned_addr learned my addr 172.21.15.81:0/2644053584 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:05.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.813+0000 7f2456234640 1 --2- 172.21.15.81:0/2644053584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 0x55bcbc465380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.813+0000 7f2455232640 1 --2- 172.21.15.81:0/2644053584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 0x55bcbc453510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.814+0000 7f2456234640 1 -- 172.21.15.81:0/2644053584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 msgr2=0x55bcbc465380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:05.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.814+0000 7f2456234640 1 --2- 172.21.15.81:0/2644053584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 0x55bcbc465380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.814+0000 7f2456234640 1 -- 172.21.15.81:0/2644053584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 msgr2=0x55bcbc453510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:05.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.814+0000 7f2456234640 1 --2- 172.21.15.81:0/2644053584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 0x55bcbc453510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.814+0000 7f2456234640 1 -- 172.21.15.81:0/2644053584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbc45a120 con 0x55bcbc466780 2024-09-12T01:38:05.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.814+0000 7f2456234640 1 --2- 172.21.15.81:0/2644053584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 0x55bcbc453a50 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f244803c650 tx=0x7f24480095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911cec79bf6129a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:05.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.814+0000 7f243b7fe640 1 -- 172.21.15.81:0/2644053584 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448034070 con 0x55bcbc466780 2024-09-12T01:38:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.814+0000 7f243b7fe640 1 -- 172.21.15.81:0/2644053584 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2448004040 con 0x55bcbc466780 2024-09-12T01:38:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.814+0000 7f243b7fe640 1 -- 172.21.15.81:0/2644053584 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448059580 con 0x55bcbc466780 2024-09-12T01:38:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.815+0000 7f245a070740 1 -- 172.21.15.81:0/2644053584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 msgr2=0x55bcbc453a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.815+0000 7f245a070740 1 --2- 172.21.15.81:0/2644053584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 0x55bcbc453a50 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f244803c650 tx=0x7f24480095c0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.815+0000 7f245a070740 1 -- 172.21.15.81:0/2644053584 shutdown_connections 2024-09-12T01:38:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.815+0000 7f245a070740 1 --2- 172.21.15.81:0/2644053584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc466780 0x55bcbc453a50 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.815+0000 7f245a070740 1 --2- 172.21.15.81:0/2644053584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 0x55bcbc453510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.815+0000 7f245a070740 1 --2- 172.21.15.81:0/2644053584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc4575d0 0x55bcbc465380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.815+0000 7f245a070740 1 -- 172.21.15.81:0/2644053584 >> 172.21.15.81:0/2644053584 conn(0x55bcbc420310 msgr2=0x55bcbc464c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.815+0000 7f245a070740 1 -- 172.21.15.81:0/2644053584 shutdown_connections 2024-09-12T01:38:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.815+0000 7f245a070740 1 -- 172.21.15.81:0/2644053584 wait complete. 2024-09-12T01:38:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.815+0000 7f245a070740 1 -- start start 2024-09-12T01:38:05.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.815+0000 7f245a070740 1 Processor -- start 2024-09-12T01:38:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.815+0000 7f245a070740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc4575d0 0x55bcbc47bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.815+0000 7f245a070740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 0x55bcbc479090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f245a070740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc466780 0x55bcbc4795d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f245a070740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24501acbc0 con 0x55bcbc4575d0 2024-09-12T01:38:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f245a070740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f24501ac4f0 con 0x55bcbc458b40 2024-09-12T01:38:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f245a070740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f24501a9770 con 0x55bcbc466780 2024-09-12T01:38:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f245a070740 10 client.0 _ll_register_callbacks cb 0x7f245006b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f2456234640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc4575d0 0x55bcbc47bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f2456234640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc4575d0 0x55bcbc47bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55148/0 (socket says 172.21.15.81:55148) 2024-09-12T01:38:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f2456234640 1 -- 172.21.15.81:0/4235774888 learned_addr learned my addr 172.21.15.81:0/4235774888 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f2455232640 1 --2- 172.21.15.81:0/4235774888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 0x55bcbc479090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f2456234640 1 -- 172.21.15.81:0/4235774888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc466780 msgr2=0x55bcbc4795d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f2456234640 1 --2- 172.21.15.81:0/4235774888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc466780 0x55bcbc4795d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f2456234640 1 -- 172.21.15.81:0/4235774888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 msgr2=0x55bcbc479090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f2456234640 1 --2- 172.21.15.81:0/4235774888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 0x55bcbc479090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f2456234640 1 -- 172.21.15.81:0/4235774888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcbc479e00 con 0x55bcbc4575d0 2024-09-12T01:38:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f2456234640 1 --2- 172.21.15.81:0/4235774888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc4575d0 0x55bcbc47bcf0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2448004210 tx=0x7f244802f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b2ba2990edb570 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f24397fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f24397fa640 1 -- 172.21.15.81:0/4235774888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244805f060 con 0x55bcbc4575d0 2024-09-12T01:38:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f24397fa640 1 -- 172.21.15.81:0/4235774888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f2448053040 con 0x55bcbc4575d0 2024-09-12T01:38:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.816+0000 7f245a070740 1 -- 172.21.15.81:0/4235774888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2448004040 con 0x55bcbc4575d0 2024-09-12T01:38:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.817+0000 7f24397fa640 1 -- 172.21.15.81:0/4235774888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2448040030 con 0x55bcbc4575d0 2024-09-12T01:38:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.817+0000 7f245a070740 10 client.17643 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.817+0000 7f245a070740 1 -- 172.21.15.81:0/4235774888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bcbc4e0a30 con 0x55bcbc4575d0 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.817+0000 7f24397fa640 1 -- 172.21.15.81:0/4235774888 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2448004040 con 0x55bcbc4575d0 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.817+0000 7f24397fa640 1 -- 172.21.15.81:0/4235774888 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f24480595f0 con 0x55bcbc4575d0 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.817+0000 7f245a070740 10 client.17643 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.817+0000 7f245a070740 10 client.17643 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.817+0000 7f245a070740 20 client.17643 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.817+0000 7f245a070740 1 --2- 172.21.15.81:0/4235774888 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55bcbc4e1040 0x55bcbc4e3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.817+0000 7f245a070740 4 client.17643 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.817+0000 7f245a070740 1 -- 172.21.15.81:0/4235774888 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bcbc3c4d70 con 0x55bcbc4e1040 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.817+0000 7f2455232640 1 --2- 172.21.15.81:0/4235774888 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55bcbc4e1040 0x55bcbc4e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f24397fa640 10 client.17643 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f2455232640 1 --2- 172.21.15.81:0/4235774888 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55bcbc4e1040 0x55bcbc4e3460 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=443f92b742755a80 server_cookie=409caf6c5b104217 in_seq=0 out_seq=0 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f24397fa640 1 -- 172.21.15.81:0/4235774888 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bcbc3c4d70 con 0x55bcbc4e1040 2024-09-12T01:38:05.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f24397fa640 10 client.17643 handle_command_reply: tid=0 2024-09-12T01:38:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f245a070740 1 client.17643 shutdown 2024-09-12T01:38:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f245a070740 1 -- 172.21.15.81:0/4235774888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc4575d0 msgr2=0x55bcbc47bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f245a070740 1 --2- 172.21.15.81:0/4235774888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc4575d0 0x55bcbc47bcf0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2448004210 tx=0x7f244802f8a0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f245a070740 1 -- 172.21.15.81:0/4235774888 shutdown_connections 2024-09-12T01:38:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f245a070740 1 --2- 172.21.15.81:0/4235774888 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x55bcbc4e1040 0x55bcbc4e3460 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f245a070740 1 --2- 172.21.15.81:0/4235774888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bcbc466780 0x55bcbc4795d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f245a070740 1 --2- 172.21.15.81:0/4235774888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bcbc458b40 0x55bcbc479090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f24397fa640 0 client.17643 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:38:05.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f245a070740 1 --2- 172.21.15.81:0/4235774888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcbc4575d0 0x55bcbc47bcf0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f245a070740 1 -- 172.21.15.81:0/4235774888 >> 172.21.15.81:0/4235774888 conn(0x55bcbc420310 msgr2=0x55bcbc465490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:05.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f245a070740 1 -- 172.21.15.81:0/4235774888 shutdown_connections 2024-09-12T01:38:05.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f245a070740 1 -- 172.21.15.81:0/4235774888 wait complete. 2024-09-12T01:38:05.840 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:38:05.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.818+0000 7f245a070740 20 client.17643 trim_cache size 0 max 16384 2024-09-12T01:38:05.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.819+0000 7f2457c97640 1 -- 172.21.15.81:0/3657421545 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f243c0a2cf0 msgr2=0x7f243c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.819+0000 7f2457c97640 1 --2- 172.21.15.81:0/3657421545 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f243c0a2cf0 0x7f243c0a51b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f244c0058c0 tx=0x7f244c0054a0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.819+0000 7f2457c97640 1 -- 172.21.15.81:0/3657421545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450102d40 msgr2=0x7f2450198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.819+0000 7f2457c97640 1 --2- 172.21.15.81:0/3657421545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450102d40 0x7f2450198430 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f244c00c890 tx=0x7f244c00cd50 comp rx=0 tx=0).stop 2024-09-12T01:38:05.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.819+0000 7f2457c97640 1 -- 172.21.15.81:0/3657421545 shutdown_connections 2024-09-12T01:38:05.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.819+0000 7f2457c97640 1 --2- 172.21.15.81:0/3657421545 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f243c0a2cf0 0x7f243c0a51b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.819+0000 7f2457c97640 1 --2- 172.21.15.81:0/3657421545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f245010c170 0x7f245019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.819+0000 7f2457c97640 1 --2- 172.21.15.81:0/3657421545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450103660 0x7f2450198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.819+0000 7f2457c97640 1 --2- 172.21.15.81:0/3657421545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450102d40 0x7f2450198430 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.819+0000 7f2457c97640 1 -- 172.21.15.81:0/3657421545 >> 172.21.15.81:0/3657421545 conn(0x7f24500fc7a0 msgr2=0x7f24500fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:05.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.819+0000 7f2457c97640 1 -- 172.21.15.81:0/3657421545 shutdown_connections 2024-09-12T01:38:05.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:05.819+0000 7f2457c97640 1 -- 172.21.15.81:0/3657421545 wait complete. 2024-09-12T01:38:05.920 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:05 smithi100 ceph-mon[35275]: pgmap v309: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:05.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:05 smithi189 ceph-mon[35357]: pgmap v309: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:06.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:38:06.718 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.153+0000 7f0d4cc9d640 1 -- 172.21.15.81:0/2601652777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d48101420 msgr2=0x7f0d4810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.153+0000 7f0d4cc9d640 1 --2- 172.21.15.81:0/2601652777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d48101420 0x7f0d4810d950 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009930 tx=0x7f0d3802a420 comp rx=0 tx=0).stop 2024-09-12T01:38:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.153+0000 7f0d4cc9d640 1 -- 172.21.15.81:0/2601652777 shutdown_connections 2024-09-12T01:38:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.153+0000 7f0d4cc9d640 1 --2- 172.21.15.81:0/2601652777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d48101420 0x7f0d4810d950 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.153+0000 7f0d4cc9d640 1 --2- 172.21.15.81:0/2601652777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d48100a80 0x7f0d48100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.153+0000 7f0d4cc9d640 1 --2- 172.21.15.81:0/2601652777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d48106a80 0x7f0d48106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.153+0000 7f0d4cc9d640 1 -- 172.21.15.81:0/2601652777 >> 172.21.15.81:0/2601652777 conn(0x7f0d480fc7a0 msgr2=0x7f0d480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.153+0000 7f0d4cc9d640 1 -- 172.21.15.81:0/2601652777 shutdown_connections 2024-09-12T01:38:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.153+0000 7f0d4cc9d640 1 -- 172.21.15.81:0/2601652777 wait complete. 2024-09-12T01:38:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.154+0000 7f0d4cc9d640 1 Processor -- start 2024-09-12T01:38:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.154+0000 7f0d4cc9d640 1 -- start start 2024-09-12T01:38:07.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.154+0000 7f0d4cc9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d48100a80 0x7f0d4819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.154+0000 7f0d4cc9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d48101420 0x7f0d4819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.154+0000 7f0d4cc9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d48106a80 0x7f0d4819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.154+0000 7f0d4cc9d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d48110ea0 con 0x7f0d48106a80 2024-09-12T01:38:07.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.154+0000 7f0d4cc9d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0d48110d20 con 0x7f0d48101420 2024-09-12T01:38:07.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.154+0000 7f0d4cc9d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0d48111020 con 0x7f0d48100a80 2024-09-12T01:38:07.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.154+0000 7f0d46d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d48106a80 0x7f0d4819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.154+0000 7f0d46d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d48106a80 0x7f0d4819eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55164/0 (socket says 172.21.15.81:55164) 2024-09-12T01:38:07.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.154+0000 7f0d46d9d640 1 -- 172.21.15.81:0/3302554901 learned_addr learned my addr 172.21.15.81:0/3302554901 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:07.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d4659c640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d48100a80 0x7f0d4819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d48101420 0x7f0d4819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d46d9d640 1 -- 172.21.15.81:0/3302554901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d48100a80 msgr2=0x7f0d4819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d46d9d640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d48100a80 0x7f0d4819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d46d9d640 1 -- 172.21.15.81:0/3302554901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d48101420 msgr2=0x7f0d4819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d46d9d640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d48101420 0x7f0d4819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d46d9d640 1 -- 172.21.15.81:0/3302554901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4819f5c0 con 0x7f0d48106a80 2024-09-12T01:38:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d48101420 0x7f0d4819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d46d9d640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d48106a80 0x7f0d4819eee0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0d38005ab0 tx=0x7f0d380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d3f7fe640 1 -- 172.21.15.81:0/3302554901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3803f030 con 0x7f0d48106a80 2024-09-12T01:38:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d4cc9d640 1 -- 172.21.15.81:0/3302554901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d4819f850 con 0x7f0d48106a80 2024-09-12T01:38:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d3f7fe640 1 -- 172.21.15.81:0/3302554901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d38003ce0 con 0x7f0d48106a80 2024-09-12T01:38:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d3f7fe640 1 -- 172.21.15.81:0/3302554901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38035070 con 0x7f0d48106a80 2024-09-12T01:38:07.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.155+0000 7f0d4cc9d640 1 -- 172.21.15.81:0/3302554901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d481a7190 con 0x7f0d48106a80 2024-09-12T01:38:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.157+0000 7f0d3f7fe640 1 -- 172.21.15.81:0/3302554901 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f0d38042030 con 0x7f0d48106a80 2024-09-12T01:38:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d4f076740 1 Processor -- start 2024-09-12T01:38:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d4f076740 1 -- start start 2024-09-12T01:38:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d4f076740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91fb40 0x56388f91e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d4f076740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f91ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d4f076740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f929370 0x56388f92b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d4f076740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56388f8842f0 con 0x56388f91e5d0 2024-09-12T01:38:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d4f076740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56388f82bcf0 con 0x56388f91fb40 2024-09-12T01:38:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d4f076740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56388f8802b0 con 0x56388f929370 2024-09-12T01:38:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d4659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f91ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d4659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f91ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55166/0 (socket says 172.21.15.81:55166) 2024-09-12T01:38:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d4659c640 1 -- 172.21.15.81:0/3387722687 learned_addr learned my addr 172.21.15.81:0/3387722687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/3387722687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91fb40 0x56388f91e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d3f7fe640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0d340a2cf0 0x7f0d340a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d4659c640 1 -- 172.21.15.81:0/3387722687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f929370 msgr2=0x56388f92b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/3387722687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f929370 0x56388f92b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d46d9d640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0d340a2cf0 0x7f0d340a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.158+0000 7f0d4659c640 1 --2- 172.21.15.81:0/3387722687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f929370 0x56388f92b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.159+0000 7f0d4659c640 1 -- 172.21.15.81:0/3387722687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91fb40 msgr2=0x56388f91e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.159+0000 7f0d4659c640 1 --2- 172.21.15.81:0/3387722687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91fb40 0x56388f91e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.159+0000 7f0d4659c640 1 -- 172.21.15.81:0/3387722687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388f8103a0 con 0x56388f91e5d0 2024-09-12T01:38:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.159+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/3387722687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f929370 0x56388f92b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.159+0000 7f0d3f7fe640 1 -- 172.21.15.81:0/3302554901 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f0d380efaa0 con 0x7f0d48106a80 2024-09-12T01:38:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.159+0000 7f0d4659c640 1 --2- 172.21.15.81:0/3387722687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f91ea10 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009fa0 tx=0x7f0d4000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef54d013951d168 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.159+0000 7f0d46d9d640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0d340a2cf0 0x7f0d340a51b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0d380ed2a0 tx=0x7f0d380a6af0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.159+0000 7f0d3cff9640 1 -- 172.21.15.81:0/3387722687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4001a070 con 0x56388f91e5d0 2024-09-12T01:38:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.159+0000 7f0d3cff9640 1 -- 172.21.15.81:0/3387722687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d400158f0 con 0x56388f91e5d0 2024-09-12T01:38:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.159+0000 7f0d3cff9640 1 -- 172.21.15.81:0/3387722687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000a9e0 con 0x56388f91e5d0 2024-09-12T01:38:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 -- 172.21.15.81:0/3387722687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 msgr2=0x56388f91ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 --2- 172.21.15.81:0/3387722687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f91ea10 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009fa0 tx=0x7f0d4000c8b0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 -- 172.21.15.81:0/3387722687 shutdown_connections 2024-09-12T01:38:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 --2- 172.21.15.81:0/3387722687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f929370 0x56388f92b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 --2- 172.21.15.81:0/3387722687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f91ea10 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 --2- 172.21.15.81:0/3387722687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91fb40 0x56388f91e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 -- 172.21.15.81:0/3387722687 >> 172.21.15.81:0/3387722687 conn(0x56388f8e7310 msgr2=0x56388f91ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 -- 172.21.15.81:0/3387722687 shutdown_connections 2024-09-12T01:38:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 -- 172.21.15.81:0/3387722687 wait complete. 2024-09-12T01:38:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 -- start start 2024-09-12T01:38:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 Processor -- start 2024-09-12T01:38:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91e5d0 0x56388f928d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f91fb40 0x56388f925ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f929370 0x56388f9265e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56388f92c070 con 0x56388f929370 2024-09-12T01:38:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56388f83f060 con 0x56388f91e5d0 2024-09-12T01:38:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.160+0000 7f0d4f076740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56388f92c1f0 con 0x56388f91fb40 2024-09-12T01:38:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d4f076740 10 client.0 _ll_register_callbacks cb 0x56388f5928c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d45d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f929370 0x56388f9265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d45d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f929370 0x56388f9265e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55170/0 (socket says 172.21.15.81:55170) 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d45d9b640 1 -- 172.21.15.81:0/276641960 learned_addr learned my addr 172.21.15.81:0/276641960 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d4659c640 1 --2- 172.21.15.81:0/276641960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f91fb40 0x56388f925ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/276641960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91e5d0 0x56388f928d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d45d9b640 1 -- 172.21.15.81:0/276641960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f91fb40 msgr2=0x56388f925ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/276641960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f91fb40 0x56388f925ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d45d9b640 1 -- 172.21.15.81:0/276641960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91e5d0 msgr2=0x56388f928d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/276641960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91e5d0 0x56388f928d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d45d9b640 1 -- 172.21.15.81:0/276641960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388f5f53c0 con 0x56388f929370 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/276641960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f929370 0x56388f9265e0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000df90 tx=0x7f0d30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20ad244c0bd7ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d2dffb640 1 -- 172.21.15.81:0/276641960 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3000f5c0 con 0x56388f929370 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d2dffb640 1 -- 172.21.15.81:0/276641960 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f0d3000f760 con 0x56388f929370 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d4f076740 1 -- 172.21.15.81:0/276641960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d400158f0 con 0x56388f929370 2024-09-12T01:38:07.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d2dffb640 1 -- 172.21.15.81:0/276641960 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0d30025050 con 0x56388f929370 2024-09-12T01:38:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d4f076740 10 client.17655 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.161+0000 7f0d4f076740 1 -- 172.21.15.81:0/276641960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56388f937ab0 con 0x56388f929370 2024-09-12T01:38:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.162+0000 7f0d2dffb640 1 -- 172.21.15.81:0/276641960 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d400158f0 con 0x56388f929370 2024-09-12T01:38:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.162+0000 7f0d2dffb640 1 -- 172.21.15.81:0/276641960 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0d3001dbb0 con 0x56388f929370 2024-09-12T01:38:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.162+0000 7f0d4f076740 10 client.17655 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.162+0000 7f0d4f076740 10 client.17655 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:38:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.162+0000 7f0d4f076740 20 client.17655 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.162+0000 7f0d4f076740 1 --2- 172.21.15.81:0/276641960 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x56388f938ec0 0x56388f93b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.162+0000 7f0d4f076740 4 client.17655 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.162+0000 7f0d4f076740 1 -- 172.21.15.81:0/276641960 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56388f891860 con 0x56388f938ec0 2024-09-12T01:38:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.162+0000 7f0d4659c640 1 --2- 172.21.15.81:0/276641960 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x56388f938ec0 0x56388f93b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d2dffb640 10 client.17655 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:38:07.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d4659c640 1 --2- 172.21.15.81:0/276641960 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x56388f938ec0 0x56388f93b2b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ad1e087369044aa7 server_cookie=dd5051ad1306d828 in_seq=0 out_seq=0 2024-09-12T01:38:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d2dffb640 1 -- 172.21.15.81:0/276641960 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56388f891860 con 0x56388f938ec0 2024-09-12T01:38:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d2dffb640 10 client.17655 handle_command_reply: tid=0 2024-09-12T01:38:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d4f076740 1 client.17655 shutdown 2024-09-12T01:38:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d4f076740 1 -- 172.21.15.81:0/276641960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f929370 msgr2=0x56388f9265e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d4f076740 1 --2- 172.21.15.81:0/276641960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f929370 0x56388f9265e0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000df90 tx=0x7f0d30004730 comp rx=0 tx=0).stop 2024-09-12T01:38:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d4f076740 1 -- 172.21.15.81:0/276641960 shutdown_connections 2024-09-12T01:38:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d4f076740 1 --2- 172.21.15.81:0/276641960 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x56388f938ec0 0x56388f93b2b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d4f076740 1 --2- 172.21.15.81:0/276641960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f929370 0x56388f9265e0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d4f076740 1 --2- 172.21.15.81:0/276641960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f91fb40 0x56388f925ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d4f076740 1 --2- 172.21.15.81:0/276641960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91e5d0 0x56388f928d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d2dffb640 0 client.17655 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:38:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.163+0000 7f0d4f076740 1 -- 172.21.15.81:0/276641960 >> 172.21.15.81:0/276641960 conn(0x56388f8e7310 msgr2=0x56388f920930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.164+0000 7f0d4f076740 1 -- 172.21.15.81:0/276641960 shutdown_connections 2024-09-12T01:38:07.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.164+0000 7f0d4f076740 1 -- 172.21.15.81:0/276641960 wait complete. 2024-09-12T01:38:07.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.164+0000 7f0d4f076740 20 client.17655 trim_cache size 0 max 16384 2024-09-12T01:38:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.176+0000 7f0d4f076740 1 Processor -- start 2024-09-12T01:38:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.176+0000 7f0d4f076740 1 -- start start 2024-09-12T01:38:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.176+0000 7f0d4f076740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f927f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.176+0000 7f0d4f076740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91fb40 0x56388f921120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.176+0000 7f0d4f076740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f929370 0x56388f921660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d4f076740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d481afa60 con 0x56388f91e5d0 2024-09-12T01:38:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d4f076740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0d481b15a0 con 0x56388f91fb40 2024-09-12T01:38:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d4f076740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0d481b0130 con 0x56388f929370 2024-09-12T01:38:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d45d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f927f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d45d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f927f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55178/0 (socket says 172.21.15.81:55178) 2024-09-12T01:38:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d45d9b640 1 -- 172.21.15.81:0/1112434327 learned_addr learned my addr 172.21.15.81:0/1112434327 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d4659c640 1 --2- 172.21.15.81:0/1112434327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91fb40 0x56388f921120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d45d9b640 1 -- 172.21.15.81:0/1112434327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f929370 msgr2=0x56388f921660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/1112434327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f929370 0x56388f921660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d45d9b640 1 -- 172.21.15.81:0/1112434327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91fb40 msgr2=0x56388f921120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/1112434327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91fb40 0x56388f921120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d45d9b640 1 -- 172.21.15.81:0/1112434327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388f926be0 con 0x56388f91e5d0 2024-09-12T01:38:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d4659c640 1 --2- 172.21.15.81:0/1112434327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91fb40 0x56388f921120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/1112434327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f927f60 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000d460 tx=0x7f0d30005c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eea5c743d1073ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d2ffff640 1 -- 172.21.15.81:0/1112434327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3002e070 con 0x56388f91e5d0 2024-09-12T01:38:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d2ffff640 1 -- 172.21.15.81:0/1112434327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d3000d7e0 con 0x56388f91e5d0 2024-09-12T01:38:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.177+0000 7f0d2ffff640 1 -- 172.21.15.81:0/1112434327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3000f620 con 0x56388f91e5d0 2024-09-12T01:38:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.178+0000 7f0d4f076740 1 -- 172.21.15.81:0/1112434327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 msgr2=0x56388f927f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.178+0000 7f0d4f076740 1 --2- 172.21.15.81:0/1112434327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f927f60 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000d460 tx=0x7f0d30005c20 comp rx=0 tx=0).stop 2024-09-12T01:38:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.178+0000 7f0d4f076740 1 -- 172.21.15.81:0/1112434327 shutdown_connections 2024-09-12T01:38:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.178+0000 7f0d4f076740 1 --2- 172.21.15.81:0/1112434327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f929370 0x56388f921660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.178+0000 7f0d4f076740 1 --2- 172.21.15.81:0/1112434327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f91fb40 0x56388f921120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.178+0000 7f0d4f076740 1 --2- 172.21.15.81:0/1112434327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f927f60 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.178+0000 7f0d4f076740 1 -- 172.21.15.81:0/1112434327 >> 172.21.15.81:0/1112434327 conn(0x56388f8e7310 msgr2=0x56388f927850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.178+0000 7f0d4f076740 1 -- 172.21.15.81:0/1112434327 shutdown_connections 2024-09-12T01:38:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.178+0000 7f0d4f076740 1 -- 172.21.15.81:0/1112434327 wait complete. 2024-09-12T01:38:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.178+0000 7f0d4f076740 1 -- start start 2024-09-12T01:38:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.178+0000 7f0d4f076740 1 Processor -- start 2024-09-12T01:38:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d4f076740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f922fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d4f076740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f91fb40 0x56388f923500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d4f076740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f929370 0x56388f923a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d4f076740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d481b0ed0 con 0x56388f91e5d0 2024-09-12T01:38:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d4f076740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0d481b0800 con 0x56388f929370 2024-09-12T01:38:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d4f076740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0d481ada60 con 0x56388f91fb40 2024-09-12T01:38:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d4f076740 10 client.0 _ll_register_callbacks cb 0x7f0d3000d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:07.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d45d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f922fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d45d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f922fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55182/0 (socket says 172.21.15.81:55182) 2024-09-12T01:38:07.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d45d9b640 1 -- 172.21.15.81:0/1588095007 learned_addr learned my addr 172.21.15.81:0/1588095007 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:07.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d45d9b640 1 -- 172.21.15.81:0/1588095007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f91fb40 msgr2=0x56388f923500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:07.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/1588095007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f91fb40 0x56388f923500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d45d9b640 1 -- 172.21.15.81:0/1588095007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f929370 msgr2=0x56388f923a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:07.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/1588095007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f929370 0x56388f923a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d45d9b640 1 -- 172.21.15.81:0/1588095007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388f9a2b00 con 0x56388f91e5d0 2024-09-12T01:38:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d45d9b640 1 --2- 172.21.15.81:0/1588095007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f922fc0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f0d30010d30 tx=0x7f0d3000d610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a43c1c543e0ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d2dffb640 1 -- 172.21.15.81:0/1588095007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3002e040 con 0x56388f91e5d0 2024-09-12T01:38:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d2dffb640 1 -- 172.21.15.81:0/1588095007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f0d3000f3c0 con 0x56388f91e5d0 2024-09-12T01:38:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d4f076740 1 -- 172.21.15.81:0/1588095007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d3000d7e0 con 0x56388f91e5d0 2024-09-12T01:38:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d2dffb640 1 -- 172.21.15.81:0/1588095007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0d3000fe90 con 0x56388f91e5d0 2024-09-12T01:38:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d4f076740 10 client.17661 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.179+0000 7f0d4f076740 1 -- 172.21.15.81:0/1588095007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56388f9a3d20 con 0x56388f91e5d0 2024-09-12T01:38:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.180+0000 7f0d2dffb640 1 -- 172.21.15.81:0/1588095007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d3000d7e0 con 0x56388f91e5d0 2024-09-12T01:38:07.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.180+0000 7f0d2dffb640 1 -- 172.21.15.81:0/1588095007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0d30005200 con 0x56388f91e5d0 2024-09-12T01:38:07.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.180+0000 7f0d4f076740 10 client.17661 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:07.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.180+0000 7f0d4f076740 10 client.17661 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:38:07.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.180+0000 7f0d4f076740 20 client.17661 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:07.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.180+0000 7f0d4f076740 1 --2- 172.21.15.81:0/1588095007 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x56388f9a4320 0x56388f9a6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.180+0000 7f0d4f076740 4 client.17661 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:38:07.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.180+0000 7f0d4f076740 1 -- 172.21.15.81:0/1588095007 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56388f88bd70 con 0x56388f9a4320 2024-09-12T01:38:07.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.180+0000 7f0d4659c640 1 --2- 172.21.15.81:0/1588095007 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x56388f9a4320 0x56388f9a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d2dffb640 10 client.17661 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:38:07.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d4659c640 1 --2- 172.21.15.81:0/1588095007 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x56388f9a4320 0x56388f9a6710 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cc60e855aaea4b58 server_cookie=8dcc7f41223d68c8 in_seq=0 out_seq=0 2024-09-12T01:38:07.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d2dffb640 1 -- 172.21.15.81:0/1588095007 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56388f88bd70 con 0x56388f9a4320 2024-09-12T01:38:07.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d2dffb640 10 client.17661 handle_command_reply: tid=0 2024-09-12T01:38:07.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d4f076740 1 client.17661 shutdown 2024-09-12T01:38:07.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d4f076740 1 -- 172.21.15.81:0/1588095007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 msgr2=0x56388f922fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d4f076740 1 --2- 172.21.15.81:0/1588095007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f922fc0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f0d30010d30 tx=0x7f0d3000d610 comp rx=0 tx=0).stop 2024-09-12T01:38:07.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d4f076740 1 -- 172.21.15.81:0/1588095007 shutdown_connections 2024-09-12T01:38:07.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d4f076740 1 --2- 172.21.15.81:0/1588095007 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x56388f9a4320 0x56388f9a6710 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d4f076740 1 --2- 172.21.15.81:0/1588095007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56388f929370 0x56388f923a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d2dffb640 0 client.17661 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:38:07.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d4f076740 1 --2- 172.21.15.81:0/1588095007 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56388f91fb40 0x56388f923500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d4f076740 1 --2- 172.21.15.81:0/1588095007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56388f91e5d0 0x56388f922fc0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d4f076740 1 -- 172.21.15.81:0/1588095007 >> 172.21.15.81:0/1588095007 conn(0x56388f8e7310 msgr2=0x56388f928070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:07.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d4f076740 1 -- 172.21.15.81:0/1588095007 shutdown_connections 2024-09-12T01:38:07.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d4f076740 1 -- 172.21.15.81:0/1588095007 wait complete. 2024-09-12T01:38:07.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.181+0000 7f0d4f076740 20 client.17661 trim_cache size 0 max 16384 2024-09-12T01:38:07.198 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:38:07.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.182+0000 7f0d4cc9d640 1 -- 172.21.15.81:0/3302554901 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0d340a2cf0 msgr2=0x7f0d340a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.182+0000 7f0d4cc9d640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0d340a2cf0 0x7f0d340a51b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0d380ed2a0 tx=0x7f0d380a6af0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.182+0000 7f0d4cc9d640 1 -- 172.21.15.81:0/3302554901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d48106a80 msgr2=0x7f0d4819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.182+0000 7f0d4cc9d640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d48106a80 0x7f0d4819eee0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0d38005ab0 tx=0x7f0d380042f0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.182+0000 7f0d4cc9d640 1 -- 172.21.15.81:0/3302554901 shutdown_connections 2024-09-12T01:38:07.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.182+0000 7f0d4cc9d640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0d340a2cf0 0x7f0d340a51b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.182+0000 7f0d4cc9d640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d48106a80 0x7f0d4819eee0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.182+0000 7f0d4cc9d640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d48101420 0x7f0d4819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.182+0000 7f0d4cc9d640 1 --2- 172.21.15.81:0/3302554901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d48100a80 0x7f0d4819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.182+0000 7f0d4cc9d640 1 -- 172.21.15.81:0/3302554901 >> 172.21.15.81:0/3302554901 conn(0x7f0d480fc7a0 msgr2=0x7f0d4806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:07.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.182+0000 7f0d4cc9d640 1 -- 172.21.15.81:0/3302554901 shutdown_connections 2024-09-12T01:38:07.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:07.182+0000 7f0d4cc9d640 1 -- 172.21.15.81:0/3302554901 wait complete. 2024-09-12T01:38:07.878 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:07 smithi081 ceph-mon[30920]: pgmap v310: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:38:07.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:38:08.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:07 smithi100 ceph-mon[35275]: pgmap v310: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:38:08.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:07 smithi189 ceph-mon[35357]: pgmap v310: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T01:38:08.148 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.603+0000 7f0a76a24640 1 -- 172.21.15.81:0/3992273651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70106f10 msgr2=0x7f0a7010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.603+0000 7f0a76a24640 1 --2- 172.21.15.81:0/3992273651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70106f10 0x7f0a7010ea90 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009ca0 tx=0x7f0a6802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.603+0000 7f0a76a24640 1 -- 172.21.15.81:0/3992273651 shutdown_connections 2024-09-12T01:38:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.603+0000 7f0a76a24640 1 --2- 172.21.15.81:0/3992273651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70106f10 0x7f0a7010ea90 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.603+0000 7f0a76a24640 1 --2- 172.21.15.81:0/3992273651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a70102790 0x7f0a701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.603+0000 7f0a76a24640 1 --2- 172.21.15.81:0/3992273651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a70101de0 0x7f0a701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.603+0000 7f0a76a24640 1 -- 172.21.15.81:0/3992273651 >> 172.21.15.81:0/3992273651 conn(0x7f0a700fd8c0 msgr2=0x7f0a700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.603+0000 7f0a76a24640 1 -- 172.21.15.81:0/3992273651 shutdown_connections 2024-09-12T01:38:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.603+0000 7f0a76a24640 1 -- 172.21.15.81:0/3992273651 wait complete. 2024-09-12T01:38:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a76a24640 1 Processor -- start 2024-09-12T01:38:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a76a24640 1 -- start start 2024-09-12T01:38:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a76a24640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a70101de0 0x7f0a701985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a76a24640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70102790 0x7f0a70198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a76a24640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a70106f10 0x7f0a7019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a76a24640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a70112010 con 0x7f0a70102790 2024-09-12T01:38:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a76a24640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0a70111e90 con 0x7f0a70101de0 2024-09-12T01:38:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a76a24640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0a70112190 con 0x7f0a70106f10 2024-09-12T01:38:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70102790 0x7f0a70198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70102790 0x7f0a70198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55200/0 (socket says 172.21.15.81:55200) 2024-09-12T01:38:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a67fff640 1 -- 172.21.15.81:0/2764526078 learned_addr learned my addr 172.21.15.81:0/2764526078 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a70101de0 0x7f0a701985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a74fc1640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a70106f10 0x7f0a7019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a67fff640 1 -- 172.21.15.81:0/2764526078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a70106f10 msgr2=0x7f0a7019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a67fff640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a70106f10 0x7f0a7019cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a67fff640 1 -- 172.21.15.81:0/2764526078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a70101de0 msgr2=0x7f0a701985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a67fff640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a70101de0 0x7f0a701985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a67fff640 1 -- 172.21.15.81:0/2764526078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7019d5a0 con 0x7f0a70102790 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.604+0000 7f0a74fc1640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a70106f10 0x7f0a7019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.605+0000 7f0a67fff640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70102790 0x7f0a70198b30 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800b4a0 tx=0x7f0a5800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.605+0000 7f0a6dffb640 1 -- 172.21.15.81:0/2764526078 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a58015020 con 0x7f0a70102790 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.605+0000 7f0a76a24640 1 -- 172.21.15.81:0/2764526078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7019d890 con 0x7f0a70102790 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.605+0000 7f0a6dffb640 1 -- 172.21.15.81:0/2764526078 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a58011d10 con 0x7f0a70102790 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.605+0000 7f0a6dffb640 1 -- 172.21.15.81:0/2764526078 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800f2e0 con 0x7f0a70102790 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.605+0000 7f0a76a24640 1 -- 172.21.15.81:0/2764526078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a701a5170 con 0x7f0a70102790 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a6dffb640 1 -- 172.21.15.81:0/2764526078 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f0a58018020 con 0x7f0a70102790 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a78dfd740 1 Processor -- start 2024-09-12T01:38:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a78dfd740 1 -- start start 2024-09-12T01:38:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a78dfd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb2656090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a78dfd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 0x55beb2656a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a78dfd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2665780 0x55beb2667b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a78dfd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55beb25bc2f0 con 0x55beb2665780 2024-09-12T01:38:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a78dfd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55beb2563cf0 con 0x55beb2657b40 2024-09-12T01:38:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a78dfd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55beb25b82b0 con 0x55beb26565d0 2024-09-12T01:38:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a74fc1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb2656090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2665780 0x55beb2667b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a74fc1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb2656090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.81:33266/0 (socket says 172.21.15.81:33266) 2024-09-12T01:38:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a74fc1640 1 -- 172.21.15.81:0/3800260804 learned_addr learned my addr 172.21.15.81:0/3800260804 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.608+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/3800260804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 0x55beb2656a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.609+0000 7f0a74fc1640 1 -- 172.21.15.81:0/3800260804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 msgr2=0x55beb2656a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.609+0000 7f0a74fc1640 1 --2- 172.21.15.81:0/3800260804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 0x55beb2656a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.609+0000 7f0a74fc1640 1 -- 172.21.15.81:0/3800260804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2665780 msgr2=0x55beb2667b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.609+0000 7f0a74fc1640 1 --2- 172.21.15.81:0/3800260804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2665780 0x55beb2667b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.609+0000 7f0a74fc1640 1 -- 172.21.15.81:0/3800260804 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beb25483a0 con 0x55beb2657b40 2024-09-12T01:38:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.609+0000 7f0a67fff640 1 --2- 172.21.15.81:0/3800260804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2665780 0x55beb2667b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.609+0000 7f0a6dffb640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0a5c0a2cf0 0x7f0a5c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.609+0000 7f0a74fc1640 1 --2- 172.21.15.81:0/3800260804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb2656090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009dc0 tx=0x7f0a680099c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b52f421d8e95c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.609+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0a5c0a2cf0 0x7f0a5c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.609+0000 7f0a6dffb640 1 -- 172.21.15.81:0/2764526078 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f0a580cec10 con 0x7f0a70102790 2024-09-12T01:38:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.609+0000 7f0a667fc640 1 -- 172.21.15.81:0/3800260804 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68003b70 con 0x55beb2657b40 2024-09-12T01:38:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.609+0000 7f0a667fc640 1 -- 172.21.15.81:0/3800260804 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a68036070 con 0x55beb2657b40 2024-09-12T01:38:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.609+0000 7f0a667fc640 1 -- 172.21.15.81:0/3800260804 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68004450 con 0x55beb2657b40 2024-09-12T01:38:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.610+0000 7f0a78dfd740 1 -- 172.21.15.81:0/3800260804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 msgr2=0x55beb2656090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.610+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0a5c0a2cf0 0x7f0a5c0a51b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55beb2653ac0 tx=0x7f0a60008040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.610+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/3800260804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb2656090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009dc0 tx=0x7f0a680099c0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.610+0000 7f0a78dfd740 1 -- 172.21.15.81:0/3800260804 shutdown_connections 2024-09-12T01:38:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.610+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/3800260804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2665780 0x55beb2667b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.610+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/3800260804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 0x55beb2656a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.610+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/3800260804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb2656090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.610+0000 7f0a78dfd740 1 -- 172.21.15.81:0/3800260804 >> 172.21.15.81:0/3800260804 conn(0x55beb261f310 msgr2=0x55beb2652c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.610+0000 7f0a78dfd740 1 -- 172.21.15.81:0/3800260804 shutdown_connections 2024-09-12T01:38:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.610+0000 7f0a78dfd740 1 -- 172.21.15.81:0/3800260804 wait complete. 2024-09-12T01:38:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.610+0000 7f0a78dfd740 1 -- start start 2024-09-12T01:38:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a78dfd740 1 Processor -- start 2024-09-12T01:38:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a78dfd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 0x55beb2665120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a78dfd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2657b40 0x55beb26623d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a78dfd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2665780 0x55beb2662970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a78dfd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55beb2668420 con 0x55beb2657b40 2024-09-12T01:38:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a78dfd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55beb2577060 con 0x55beb2665780 2024-09-12T01:38:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a78dfd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55beb26685a0 con 0x55beb26565d0 2024-09-12T01:38:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a78dfd740 10 client.0 _ll_register_callbacks cb 0x55beb22ca8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2657b40 0x55beb26623d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2657b40 0x55beb26623d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55208/0 (socket says 172.21.15.81:55208) 2024-09-12T01:38:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a67fff640 1 -- 172.21.15.81:0/2023657095 learned_addr learned my addr 172.21.15.81:0/2023657095 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a74fc1640 1 --2- 172.21.15.81:0/2023657095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2665780 0x55beb2662970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/2023657095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 0x55beb2665120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a67fff640 1 -- 172.21.15.81:0/2023657095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 msgr2=0x55beb2665120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a67fff640 1 --2- 172.21.15.81:0/2023657095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 0x55beb2665120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a67fff640 1 -- 172.21.15.81:0/2023657095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2665780 msgr2=0x55beb2662970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a67fff640 1 --2- 172.21.15.81:0/2023657095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2665780 0x55beb2662970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a67fff640 1 -- 172.21.15.81:0/2023657095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beb232d3c0 con 0x55beb2657b40 2024-09-12T01:38:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a67fff640 1 --2- 172.21.15.81:0/2023657095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2657b40 0x55beb26623d0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0a58000c00 tx=0x7f0a580974e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e90e4295abda94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.611+0000 7f0a4f7fe640 1 -- 172.21.15.81:0/2023657095 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5809aba0 con 0x55beb2657b40 2024-09-12T01:38:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.612+0000 7f0a78dfd740 1 -- 172.21.15.81:0/2023657095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a68036070 con 0x55beb2657b40 2024-09-12T01:38:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.612+0000 7f0a4f7fe640 1 -- 172.21.15.81:0/2023657095 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f0a580cc5e0 con 0x55beb2657b40 2024-09-12T01:38:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.612+0000 7f0a4f7fe640 1 -- 172.21.15.81:0/2023657095 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0a5809b940 con 0x55beb2657b40 2024-09-12T01:38:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.612+0000 7f0a78dfd740 10 client.17673 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.612+0000 7f0a78dfd740 1 -- 172.21.15.81:0/2023657095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55beb2673e70 con 0x55beb2657b40 2024-09-12T01:38:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.612+0000 7f0a4f7fe640 1 -- 172.21.15.81:0/2023657095 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a68036070 con 0x55beb2657b40 2024-09-12T01:38:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.612+0000 7f0a4f7fe640 1 -- 172.21.15.81:0/2023657095 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0a580978b0 con 0x55beb2657b40 2024-09-12T01:38:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.612+0000 7f0a78dfd740 10 client.17673 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.612+0000 7f0a78dfd740 10 client.17673 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:38:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.612+0000 7f0a78dfd740 20 client.17673 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.612+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/2023657095 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55beb2675280 0x55beb26776b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.612+0000 7f0a78dfd740 4 client.17673 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.612+0000 7f0a78dfd740 1 -- 172.21.15.81:0/2023657095 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55beb25c9860 con 0x55beb2675280 2024-09-12T01:38:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.613+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/2023657095 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55beb2675280 0x55beb26776b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.613+0000 7f0a4f7fe640 10 client.17673 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:38:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.613+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/2023657095 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55beb2675280 0x55beb26776b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=588aea93ae32ec34 server_cookie=696a8d88ff3bb8fa in_seq=0 out_seq=0 2024-09-12T01:38:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a4f7fe640 1 -- 172.21.15.81:0/2023657095 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55beb25c9860 con 0x55beb2675280 2024-09-12T01:38:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a4f7fe640 10 client.17673 handle_command_reply: tid=0 2024-09-12T01:38:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a78dfd740 1 client.17673 shutdown 2024-09-12T01:38:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a78dfd740 1 -- 172.21.15.81:0/2023657095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2657b40 msgr2=0x55beb26623d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/2023657095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2657b40 0x55beb26623d0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0a58000c00 tx=0x7f0a580974e0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a78dfd740 1 -- 172.21.15.81:0/2023657095 shutdown_connections 2024-09-12T01:38:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/2023657095 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55beb2675280 0x55beb26776b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/2023657095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2665780 0x55beb2662970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/2023657095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2657b40 0x55beb26623d0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a4f7fe640 0 client.17673 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:38:08.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/2023657095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 0x55beb2665120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a78dfd740 1 -- 172.21.15.81:0/2023657095 >> 172.21.15.81:0/2023657095 conn(0x55beb261f310 msgr2=0x55beb2658960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:08.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a78dfd740 1 -- 172.21.15.81:0/2023657095 shutdown_connections 2024-09-12T01:38:08.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a78dfd740 1 -- 172.21.15.81:0/2023657095 wait complete. 2024-09-12T01:38:08.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.614+0000 7f0a78dfd740 20 client.17673 trim_cache size 0 max 16384 2024-09-12T01:38:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.628+0000 7f0a78dfd740 1 Processor -- start 2024-09-12T01:38:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.628+0000 7f0a78dfd740 1 -- start start 2024-09-12T01:38:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.628+0000 7f0a78dfd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb26565d0 0x55beb26716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.628+0000 7f0a78dfd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb2651bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.628+0000 7f0a78dfd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb2665780 0x55beb267cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.628+0000 7f0a78dfd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701ab7f0 con 0x55beb26565d0 2024-09-12T01:38:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.628+0000 7f0a78dfd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701ad330 con 0x55beb2657b40 2024-09-12T01:38:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.628+0000 7f0a78dfd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701abec0 con 0x55beb2665780 2024-09-12T01:38:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.628+0000 7f0a6ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb26565d0 0x55beb26716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.628+0000 7f0a6ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb26565d0 0x55beb26716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55220/0 (socket says 172.21.15.81:55220) 2024-09-12T01:38:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.628+0000 7f0a6ffff640 1 -- 172.21.15.81:0/2030789669 learned_addr learned my addr 172.21.15.81:0/2030789669 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.628+0000 7f0a74fc1640 1 --2- 172.21.15.81:0/2030789669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb2665780 0x55beb267cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.629+0000 7f0a67fff640 1 --2- 172.21.15.81:0/2030789669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb2651bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.629+0000 7f0a6ffff640 1 -- 172.21.15.81:0/2030789669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb2665780 msgr2=0x55beb267cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.629+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/2030789669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb2665780 0x55beb267cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.629+0000 7f0a6ffff640 1 -- 172.21.15.81:0/2030789669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 msgr2=0x55beb2651bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.629+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/2030789669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb2651bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.629+0000 7f0a6ffff640 1 -- 172.21.15.81:0/2030789669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beb2664d40 con 0x55beb26565d0 2024-09-12T01:38:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.629+0000 7f0a67fff640 1 --2- 172.21.15.81:0/2030789669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb2651bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.629+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/2030789669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb26565d0 0x55beb26716c0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x55beb2677ef0 tx=0x7f0a60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33222537412723b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.629+0000 7f0a65ffb640 1 -- 172.21.15.81:0/2030789669 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60015da0 con 0x55beb26565d0 2024-09-12T01:38:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.629+0000 7f0a65ffb640 1 -- 172.21.15.81:0/2030789669 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a6002e070 con 0x55beb26565d0 2024-09-12T01:38:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.629+0000 7f0a65ffb640 1 -- 172.21.15.81:0/2030789669 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a600227b0 con 0x55beb26565d0 2024-09-12T01:38:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.630+0000 7f0a78dfd740 1 -- 172.21.15.81:0/2030789669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb26565d0 msgr2=0x55beb26716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.630+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/2030789669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb26565d0 0x55beb26716c0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x55beb2677ef0 tx=0x7f0a60017000 comp rx=0 tx=0).stop 2024-09-12T01:38:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.630+0000 7f0a78dfd740 1 -- 172.21.15.81:0/2030789669 shutdown_connections 2024-09-12T01:38:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.630+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/2030789669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb2665780 0x55beb267cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.630+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/2030789669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb2651bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.630+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/2030789669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb26565d0 0x55beb26716c0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.630+0000 7f0a78dfd740 1 -- 172.21.15.81:0/2030789669 >> 172.21.15.81:0/2030789669 conn(0x55beb261f310 msgr2=0x55beb26514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.630+0000 7f0a78dfd740 1 -- 172.21.15.81:0/2030789669 shutdown_connections 2024-09-12T01:38:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.630+0000 7f0a78dfd740 1 -- 172.21.15.81:0/2030789669 wait complete. 2024-09-12T01:38:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.630+0000 7f0a78dfd740 1 -- start start 2024-09-12T01:38:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a78dfd740 1 Processor -- start 2024-09-12T01:38:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a78dfd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 0x55beb266db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a78dfd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb266e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a78dfd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2665780 0x55beb266a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a78dfd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701acc60 con 0x55beb2665780 2024-09-12T01:38:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a78dfd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701ac590 con 0x55beb2657b40 2024-09-12T01:38:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a78dfd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701a97f0 con 0x55beb26565d0 2024-09-12T01:38:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a78dfd740 10 client.0 _ll_register_callbacks cb 0x7f0a5800bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a74fc1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2665780 0x55beb266a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a74fc1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2665780 0x55beb266a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55234/0 (socket says 172.21.15.81:55234) 2024-09-12T01:38:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a74fc1640 1 -- 172.21.15.81:0/3549294568 learned_addr learned my addr 172.21.15.81:0/3549294568 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 0x55beb266db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a67fff640 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb266e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a74fc1640 1 -- 172.21.15.81:0/3549294568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 msgr2=0x55beb266db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a74fc1640 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 0x55beb266db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a74fc1640 1 -- 172.21.15.81:0/3549294568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 msgr2=0x55beb266e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a74fc1640 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb266e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a74fc1640 1 -- 172.21.15.81:0/3549294568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beb266b140 con 0x55beb2665780 2024-09-12T01:38:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a67fff640 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb266e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 0x55beb266db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a74fc1640 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2665780 0x55beb266a940 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009d90 tx=0x7f0a6802f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bdbea721694bb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.631+0000 7f0a4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a4f7fe640 1 -- 172.21.15.81:0/3549294568 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68003a30 con 0x55beb2665780 2024-09-12T01:38:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a4f7fe640 1 -- 172.21.15.81:0/3549294568 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8513+0+0 (secure 0 0 0) 0x7f0a68049040 con 0x55beb2665780 2024-09-12T01:38:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a78dfd740 1 -- 172.21.15.81:0/3549294568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a6002e070 con 0x55beb2665780 2024-09-12T01:38:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a4f7fe640 1 -- 172.21.15.81:0/3549294568 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0a6805a050 con 0x55beb2665780 2024-09-12T01:38:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a78dfd740 10 client.17679 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a78dfd740 1 -- 172.21.15.81:0/3549294568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55beb26e0ba0 con 0x55beb2665780 2024-09-12T01:38:08.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a4f7fe640 1 -- 172.21.15.81:0/3549294568 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a6002e070 con 0x55beb2665780 2024-09-12T01:38:08.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a4f7fe640 1 -- 172.21.15.81:0/3549294568 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0a68004340 con 0x55beb2665780 2024-09-12T01:38:08.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a78dfd740 10 client.17679 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:08.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a78dfd740 10 client.17679 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:38:08.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a78dfd740 20 client.17679 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:08.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55beb26e0f00 0x55beb26e32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a78dfd740 4 client.17679 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:38:08.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.632+0000 7f0a78dfd740 1 -- 172.21.15.81:0/3549294568 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55beb25c3d70 con 0x55beb26e0f00 2024-09-12T01:38:08.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55beb26e0f00 0x55beb26e32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a6ffff640 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55beb26e0f00 0x55beb26e32f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8e9d2847a50c98ff server_cookie=d127a66e3fa40e79 in_seq=0 out_seq=0 2024-09-12T01:38:08.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a4f7fe640 10 client.17679 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:38:08.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a4f7fe640 1 -- 172.21.15.81:0/3549294568 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55beb25c3d70 con 0x55beb26e0f00 2024-09-12T01:38:08.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a4f7fe640 10 client.17679 handle_command_reply: tid=0 2024-09-12T01:38:08.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a78dfd740 1 client.17679 shutdown 2024-09-12T01:38:08.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a78dfd740 1 -- 172.21.15.81:0/3549294568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2665780 msgr2=0x55beb266a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2665780 0x55beb266a940 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009d90 tx=0x7f0a6802f310 comp rx=0 tx=0).stop 2024-09-12T01:38:08.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a78dfd740 1 -- 172.21.15.81:0/3549294568 shutdown_connections 2024-09-12T01:38:08.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x55beb26e0f00 0x55beb26e32f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55beb2665780 0x55beb266a940 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55beb2657b40 0x55beb266e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a4f7fe640 0 client.17679 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:38:08.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a78dfd740 1 --2- 172.21.15.81:0/3549294568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55beb26565d0 0x55beb266db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a78dfd740 1 -- 172.21.15.81:0/3549294568 >> 172.21.15.81:0/3549294568 conn(0x55beb261f310 msgr2=0x55beb2661390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:08.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a78dfd740 1 -- 172.21.15.81:0/3549294568 shutdown_connections 2024-09-12T01:38:08.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.633+0000 7f0a78dfd740 1 -- 172.21.15.81:0/3549294568 wait complete. 2024-09-12T01:38:08.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.634+0000 7f0a78dfd740 20 client.17679 trim_cache size 0 max 16384 2024-09-12T01:38:08.650 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:38:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.634+0000 7f0a76a24640 1 -- 172.21.15.81:0/2764526078 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0a5c0a2cf0 msgr2=0x7f0a5c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.634+0000 7f0a76a24640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0a5c0a2cf0 0x7f0a5c0a51b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55beb2653ac0 tx=0x7f0a60008040 comp rx=0 tx=0).stop 2024-09-12T01:38:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.634+0000 7f0a76a24640 1 -- 172.21.15.81:0/2764526078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70102790 msgr2=0x7f0a70198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.634+0000 7f0a76a24640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70102790 0x7f0a70198b30 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800b4a0 tx=0x7f0a5800b8a0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.634+0000 7f0a76a24640 1 -- 172.21.15.81:0/2764526078 shutdown_connections 2024-09-12T01:38:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.634+0000 7f0a76a24640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f0a5c0a2cf0 0x7f0a5c0a51b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.634+0000 7f0a76a24640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0a70106f10 0x7f0a7019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.634+0000 7f0a76a24640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a70102790 0x7f0a70198b30 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.634+0000 7f0a76a24640 1 --2- 172.21.15.81:0/2764526078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a70101de0 0x7f0a701985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.634+0000 7f0a76a24640 1 -- 172.21.15.81:0/2764526078 >> 172.21.15.81:0/2764526078 conn(0x7f0a700fd8c0 msgr2=0x7f0a700fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.634+0000 7f0a76a24640 1 -- 172.21.15.81:0/2764526078 shutdown_connections 2024-09-12T01:38:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:08.634+0000 7f0a76a24640 1 -- 172.21.15.81:0/2764526078 wait complete. 2024-09-12T01:38:09.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:38:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:09.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:09 smithi081 ceph-mon[30920]: pgmap v311: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T01:38:10.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.972+0000 7f135bf1f640 1 -- 172.21.15.81:0/3862507324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1354102d30 msgr2=0x7f1354103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.972+0000 7f135bf1f640 1 --2- 172.21.15.81:0/3862507324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1354102d30 0x7f1354103110 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f1344009cd0 tx=0x7f134402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.972+0000 7f135bf1f640 1 -- 172.21.15.81:0/3862507324 shutdown_connections 2024-09-12T01:38:10.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.972+0000 7f135bf1f640 1 --2- 172.21.15.81:0/3862507324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13541082a0 0x7f135410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.972+0000 7f135bf1f640 1 --2- 172.21.15.81:0/3862507324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13541036e0 0x7f1354107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.972+0000 7f135bf1f640 1 --2- 172.21.15.81:0/3862507324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1354102d30 0x7f1354103110 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.972+0000 7f135bf1f640 1 -- 172.21.15.81:0/3862507324 >> 172.21.15.81:0/3862507324 conn(0x7f13540fc7d0 msgr2=0x7f13540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.972+0000 7f135bf1f640 1 -- 172.21.15.81:0/3862507324 shutdown_connections 2024-09-12T01:38:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.973+0000 7f135bf1f640 1 -- 172.21.15.81:0/3862507324 wait complete. 2024-09-12T01:38:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.973+0000 7f135bf1f640 1 Processor -- start 2024-09-12T01:38:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.973+0000 7f135bf1f640 1 -- start start 2024-09-12T01:38:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.973+0000 7f135bf1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1354102d30 0x7f13541985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.973+0000 7f135bf1f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13541036e0 0x7f1354198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.973+0000 7f135bf1f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13541082a0 0x7f135419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.973+0000 7f135bf1f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13541120a0 con 0x7f1354102d30 2024-09-12T01:38:10.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.973+0000 7f135bf1f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1354111f20 con 0x7f13541082a0 2024-09-12T01:38:10.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.973+0000 7f135bf1f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1354112220 con 0x7f13541036e0 2024-09-12T01:38:10.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.973+0000 7f1359cbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1354102d30 0x7f13541985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.973+0000 7f1359cbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1354102d30 0x7f13541985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55250/0 (socket says 172.21.15.81:55250) 2024-09-12T01:38:10.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.973+0000 7f1359cbb640 1 -- 172.21.15.81:0/1074261228 learned_addr learned my addr 172.21.15.81:0/1074261228 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:10.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f135a4bc640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13541082a0 0x7f135419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f1359cbb640 1 -- 172.21.15.81:0/1074261228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13541036e0 msgr2=0x7f1354198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f13594ba640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13541036e0 0x7f1354198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f1359cbb640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13541036e0 0x7f1354198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f1359cbb640 1 -- 172.21.15.81:0/1074261228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13541082a0 msgr2=0x7f135419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f1359cbb640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13541082a0 0x7f135419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f1359cbb640 1 -- 172.21.15.81:0/1074261228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135419d570 con 0x7f1354102d30 2024-09-12T01:38:10.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f135a4bc640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13541082a0 0x7f135419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f1359cbb640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1354102d30 0x7f13541985c0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f134402ae00 tx=0x7f1344003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f1352ffd640 1 -- 172.21.15.81:0/1074261228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1344004240 con 0x7f1354102d30 2024-09-12T01:38:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f135bf1f640 1 -- 172.21.15.81:0/1074261228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135419d800 con 0x7f1354102d30 2024-09-12T01:38:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f1352ffd640 1 -- 172.21.15.81:0/1074261228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13440305a0 con 0x7f1354102d30 2024-09-12T01:38:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f1352ffd640 1 -- 172.21.15.81:0/1074261228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134403a660 con 0x7f1354102d30 2024-09-12T01:38:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.974+0000 7f135bf1f640 1 -- 172.21.15.81:0/1074261228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13541a5140 con 0x7f1354102d30 2024-09-12T01:38:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.976+0000 7f1352ffd640 1 -- 172.21.15.81:0/1074261228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f1344030ac0 con 0x7f1354102d30 2024-09-12T01:38:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f135e2f8740 1 Processor -- start 2024-09-12T01:38:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f135e2f8740 1 -- start start 2024-09-12T01:38:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f135e2f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddff1b40 0x5625ddff0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f135e2f8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff05d0 0x5625ddff0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f135e2f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 0x5625ddffd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f135e2f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5625ddf562f0 con 0x5625ddffb370 2024-09-12T01:38:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f135e2f8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5625ddefdcf0 con 0x5625ddff05d0 2024-09-12T01:38:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f135e2f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5625ddf522b0 con 0x5625ddff1b40 2024-09-12T01:38:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f13594ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 0x5625ddffd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f13594ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 0x5625ddffd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55260/0 (socket says 172.21.15.81:55260) 2024-09-12T01:38:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f13594ba640 1 -- 172.21.15.81:0/1275909554 learned_addr learned my addr 172.21.15.81:0/1275909554 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f1352ffd640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f133c0a2cf0 0x7f133c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f1359cbb640 1 --2- 172.21.15.81:0/1275909554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff05d0 0x5625ddff0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.977+0000 7f135a4bc640 1 --2- 172.21.15.81:0/1275909554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddff1b40 0x5625ddff0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.978+0000 7f13594ba640 1 -- 172.21.15.81:0/1275909554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddff1b40 msgr2=0x5625ddff0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.978+0000 7f13594ba640 1 --2- 172.21.15.81:0/1275909554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddff1b40 0x5625ddff0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.978+0000 7f135a4bc640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f133c0a2cf0 0x7f133c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.978+0000 7f13594ba640 1 -- 172.21.15.81:0/1275909554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff05d0 msgr2=0x5625ddff0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.978+0000 7f13594ba640 1 --2- 172.21.15.81:0/1275909554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff05d0 0x5625ddff0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.978+0000 7f13594ba640 1 -- 172.21.15.81:0/1275909554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625ddee23a0 con 0x5625ddffb370 2024-09-12T01:38:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.978+0000 7f1352ffd640 1 -- 172.21.15.81:0/1074261228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f134402e030 con 0x7f1354102d30 2024-09-12T01:38:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.978+0000 7f13594ba640 1 --2- 172.21.15.81:0/1275909554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 0x5625ddffd760 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f134800ba10 tx=0x7f134800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b954b0cbe97162 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.978+0000 7f133bfff640 1 -- 172.21.15.81:0/1275909554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134800de50 con 0x5625ddffb370 2024-09-12T01:38:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.978+0000 7f135a4bc640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f133c0a2cf0 0x7f133c0a51b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f134c00fd20 tx=0x7f134c005900 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.978+0000 7f133bfff640 1 -- 172.21.15.81:0/1275909554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1348017900 con 0x5625ddffb370 2024-09-12T01:38:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.978+0000 7f133bfff640 1 -- 172.21.15.81:0/1275909554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134800fa70 con 0x5625ddffb370 2024-09-12T01:38:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.979+0000 7f135e2f8740 1 -- 172.21.15.81:0/1275909554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 msgr2=0x5625ddffd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.979+0000 7f135e2f8740 1 --2- 172.21.15.81:0/1275909554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 0x5625ddffd760 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f134800ba10 tx=0x7f134800bed0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.979+0000 7f135e2f8740 1 -- 172.21.15.81:0/1275909554 shutdown_connections 2024-09-12T01:38:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.979+0000 7f135e2f8740 1 --2- 172.21.15.81:0/1275909554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 0x5625ddffd760 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.979+0000 7f135e2f8740 1 --2- 172.21.15.81:0/1275909554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff05d0 0x5625ddff0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.979+0000 7f135e2f8740 1 --2- 172.21.15.81:0/1275909554 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddff1b40 0x5625ddff0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.979+0000 7f135e2f8740 1 -- 172.21.15.81:0/1275909554 >> 172.21.15.81:0/1275909554 conn(0x5625ddfb9310 msgr2=0x5625ddfecc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.979+0000 7f135e2f8740 1 -- 172.21.15.81:0/1275909554 shutdown_connections 2024-09-12T01:38:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.979+0000 7f135e2f8740 1 -- 172.21.15.81:0/1275909554 wait complete. 2024-09-12T01:38:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.979+0000 7f135e2f8740 1 -- start start 2024-09-12T01:38:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.979+0000 7f135e2f8740 1 Processor -- start 2024-09-12T01:38:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f135e2f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff05d0 0x5625ddffacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f135e2f8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff1b40 0x5625ddff7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f135e2f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddffb370 0x5625ddff84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f135e2f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5625ddffe070 con 0x5625ddff05d0 2024-09-12T01:38:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f135e2f8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5625ddf11060 con 0x5625ddff1b40 2024-09-12T01:38:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f135e2f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5625ddffe1f0 con 0x5625ddffb370 2024-09-12T01:38:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f135e2f8740 10 client.0 _ll_register_callbacks cb 0x5625ddc648c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f1359cbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff05d0 0x5625ddffacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f1359cbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff05d0 0x5625ddffacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55266/0 (socket says 172.21.15.81:55266) 2024-09-12T01:38:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f1359cbb640 1 -- 172.21.15.81:0/2428117898 learned_addr learned my addr 172.21.15.81:0/2428117898 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f135a4bc640 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddffb370 0x5625ddff84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f13594ba640 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff1b40 0x5625ddff7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f1359cbb640 1 -- 172.21.15.81:0/2428117898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddffb370 msgr2=0x5625ddff84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f1359cbb640 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddffb370 0x5625ddff84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f1359cbb640 1 -- 172.21.15.81:0/2428117898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff1b40 msgr2=0x5625ddff7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f1359cbb640 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff1b40 0x5625ddff7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f1359cbb640 1 -- 172.21.15.81:0/2428117898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625ddcc73c0 con 0x5625ddff05d0 2024-09-12T01:38:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f13594ba640 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff1b40 0x5625ddff7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f1359cbb640 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff05d0 0x5625ddffacd0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f13440b9120 tx=0x7f13440bd500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4258bc68998f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f13397fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f13397fa640 1 -- 172.21.15.81:0/2428117898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13440c1070 con 0x5625ddff05d0 2024-09-12T01:38:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f13397fa640 1 -- 172.21.15.81:0/2428117898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f13440b9330 con 0x5625ddff05d0 2024-09-12T01:38:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.980+0000 7f135e2f8740 1 -- 172.21.15.81:0/2428117898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1348017900 con 0x5625ddff05d0 2024-09-12T01:38:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.981+0000 7f13397fa640 1 -- 172.21.15.81:0/2428117898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f13440c5930 con 0x5625ddff05d0 2024-09-12T01:38:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.981+0000 7f135e2f8740 10 client.17691 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.981+0000 7f135e2f8740 1 -- 172.21.15.81:0/2428117898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5625de009a80 con 0x5625ddff05d0 2024-09-12T01:38:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.981+0000 7f13397fa640 1 -- 172.21.15.81:0/2428117898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1348017900 con 0x5625ddff05d0 2024-09-12T01:38:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.981+0000 7f13397fa640 1 -- 172.21.15.81:0/2428117898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f134404d020 con 0x5625ddff05d0 2024-09-12T01:38:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.981+0000 7f135e2f8740 10 client.17691 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.981+0000 7f135e2f8740 10 client.17691 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:38:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.981+0000 7f135e2f8740 20 client.17691 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.981+0000 7f135e2f8740 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5625de00ae20 0x5625de00d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.981+0000 7f135e2f8740 4 client.17691 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.981+0000 7f135e2f8740 1 -- 172.21.15.81:0/2428117898 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625ddf63860 con 0x5625de00ae20 2024-09-12T01:38:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.981+0000 7f13594ba640 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5625de00ae20 0x5625de00d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.982+0000 7f13594ba640 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5625de00ae20 0x5625de00d2b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7b5b867afe479755 server_cookie=40ecdb7df8c9f3f8 in_seq=0 out_seq=0 2024-09-12T01:38:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.982+0000 7f13397fa640 10 client.17691 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:38:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.982+0000 7f13397fa640 1 -- 172.21.15.81:0/2428117898 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625ddf63860 con 0x5625de00ae20 2024-09-12T01:38:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.982+0000 7f13397fa640 10 client.17691 handle_command_reply: tid=0 2024-09-12T01:38:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.982+0000 7f135e2f8740 1 client.17691 shutdown 2024-09-12T01:38:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.982+0000 7f135e2f8740 1 -- 172.21.15.81:0/2428117898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff05d0 msgr2=0x5625ddffacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.982+0000 7f135e2f8740 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff05d0 0x5625ddffacd0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f13440b9120 tx=0x7f13440bd500 comp rx=0 tx=0).stop 2024-09-12T01:38:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.983+0000 7f135e2f8740 1 -- 172.21.15.81:0/2428117898 shutdown_connections 2024-09-12T01:38:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.983+0000 7f135e2f8740 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddffb370 0x5625ddff84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.983+0000 7f135e2f8740 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff1b40 0x5625ddff7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.983+0000 7f135e2f8740 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5625de00ae20 0x5625de00d2b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.983+0000 7f135e2f8740 1 --2- 172.21.15.81:0/2428117898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff05d0 0x5625ddffacd0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.983+0000 7f13397fa640 0 client.17691 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:38:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.983+0000 7f135e2f8740 1 -- 172.21.15.81:0/2428117898 >> 172.21.15.81:0/2428117898 conn(0x5625ddfb9310 msgr2=0x5625ddff2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.983+0000 7f135e2f8740 1 -- 172.21.15.81:0/2428117898 shutdown_connections 2024-09-12T01:38:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.983+0000 7f135e2f8740 1 -- 172.21.15.81:0/2428117898 wait complete. 2024-09-12T01:38:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.983+0000 7f135e2f8740 20 client.17691 trim_cache size 0 max 16384 2024-09-12T01:38:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.995+0000 7f135e2f8740 1 Processor -- start 2024-09-12T01:38:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.995+0000 7f135e2f8740 1 -- start start 2024-09-12T01:38:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135e2f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddff05d0 0x5625de007310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135e2f8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff1b40 0x5625de003860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135e2f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 0x5625de003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135e2f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13541ad890 con 0x5625ddffb370 2024-09-12T01:38:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135e2f8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13541af3d0 con 0x5625ddff1b40 2024-09-12T01:38:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135e2f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f13541adf60 con 0x5625ddff05d0 2024-09-12T01:38:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135a4bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 0x5625de003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135a4bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 0x5625de003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55272/0 (socket says 172.21.15.81:55272) 2024-09-12T01:38:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135a4bc640 1 -- 172.21.15.81:0/2865083102 learned_addr learned my addr 172.21.15.81:0/2865083102 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135a4bc640 1 -- 172.21.15.81:0/2865083102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddff05d0 msgr2=0x5625de007310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f1359cbb640 1 --2- 172.21.15.81:0/2865083102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddff05d0 0x5625de007310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135a4bc640 1 --2- 172.21.15.81:0/2865083102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddff05d0 0x5625de007310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135a4bc640 1 -- 172.21.15.81:0/2865083102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff1b40 msgr2=0x5625de003860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135a4bc640 1 --2- 172.21.15.81:0/2865083102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff1b40 0x5625de003860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135a4bc640 1 -- 172.21.15.81:0/2865083102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625ddff1760 con 0x5625ddffb370 2024-09-12T01:38:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f135a4bc640 1 --2- 172.21.15.81:0/2865083102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 0x5625de003da0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f134c00d530 tx=0x7f134c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70c5c721ce3c77e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f133b7fe640 1 -- 172.21.15.81:0/2865083102 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c023070 con 0x5625ddffb370 2024-09-12T01:38:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f133b7fe640 1 -- 172.21.15.81:0/2865083102 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f134c018040 con 0x5625ddffb370 2024-09-12T01:38:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.996+0000 7f133b7fe640 1 -- 172.21.15.81:0/2865083102 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c01ec00 con 0x5625ddffb370 2024-09-12T01:38:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.997+0000 7f135e2f8740 1 -- 172.21.15.81:0/2865083102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 msgr2=0x5625de003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.997+0000 7f135e2f8740 1 --2- 172.21.15.81:0/2865083102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 0x5625de003da0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f134c00d530 tx=0x7f134c005f30 comp rx=0 tx=0).stop 2024-09-12T01:38:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.997+0000 7f135e2f8740 1 -- 172.21.15.81:0/2865083102 shutdown_connections 2024-09-12T01:38:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.997+0000 7f135e2f8740 1 --2- 172.21.15.81:0/2865083102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddffb370 0x5625de003da0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.997+0000 7f135e2f8740 1 --2- 172.21.15.81:0/2865083102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff1b40 0x5625de003860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.997+0000 7f135e2f8740 1 --2- 172.21.15.81:0/2865083102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddff05d0 0x5625de007310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.997+0000 7f135e2f8740 1 -- 172.21.15.81:0/2865083102 >> 172.21.15.81:0/2865083102 conn(0x5625ddfb9310 msgr2=0x5625ddfec700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.997+0000 7f135e2f8740 1 -- 172.21.15.81:0/2865083102 shutdown_connections 2024-09-12T01:38:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.997+0000 7f135e2f8740 1 -- 172.21.15.81:0/2865083102 wait complete. 2024-09-12T01:38:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.997+0000 7f135e2f8740 1 -- start start 2024-09-12T01:38:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.997+0000 7f135e2f8740 1 Processor -- start 2024-09-12T01:38:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f135e2f8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff05d0 0x5625de011d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f135e2f8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff1b40 0x5625de0122d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f135e2f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddffb370 0x5625de012870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f135e2f8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13541aed00 con 0x5625ddff1b40 2024-09-12T01:38:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f135e2f8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13541ae630 con 0x5625ddff05d0 2024-09-12T01:38:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f135e2f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f13541ab890 con 0x5625ddffb370 2024-09-12T01:38:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f135e2f8740 10 client.0 _ll_register_callbacks cb 0x7f13440bc620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f13594ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff1b40 0x5625de0122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f13594ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff1b40 0x5625de0122d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55276/0 (socket says 172.21.15.81:55276) 2024-09-12T01:38:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f13594ba640 1 -- 172.21.15.81:0/1817205026 learned_addr learned my addr 172.21.15.81:0/1817205026 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f13594ba640 1 -- 172.21.15.81:0/1817205026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddffb370 msgr2=0x5625de012870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f13594ba640 1 --2- 172.21.15.81:0/1817205026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddffb370 0x5625de012870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f1359cbb640 1 --2- 172.21.15.81:0/1817205026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff05d0 0x5625de011d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f13594ba640 1 -- 172.21.15.81:0/1817205026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff05d0 msgr2=0x5625de011d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f13594ba640 1 --2- 172.21.15.81:0/1817205026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff05d0 0x5625de011d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f13594ba640 1 -- 172.21.15.81:0/1817205026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625de0130a0 con 0x5625ddff1b40 2024-09-12T01:38:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f13594ba640 1 --2- 172.21.15.81:0/1817205026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff1b40 0x5625de0122d0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f134800d710 tx=0x7f134800b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfb9194323a3281 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f13397fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f13397fa640 1 -- 172.21.15.81:0/1817205026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348031060 con 0x5625ddff1b40 2024-09-12T01:38:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f13397fa640 1 -- 172.21.15.81:0/1817205026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f1348005240 con 0x5625ddff1b40 2024-09-12T01:38:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.998+0000 7f135e2f8740 1 -- 172.21.15.81:0/1817205026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f134c018040 con 0x5625ddff1b40 2024-09-12T01:38:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.999+0000 7f13397fa640 1 -- 172.21.15.81:0/1817205026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1348005440 con 0x5625ddff1b40 2024-09-12T01:38:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.999+0000 7f135e2f8740 10 client.17697 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.999+0000 7f135e2f8740 1 -- 172.21.15.81:0/1817205026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5625de07a5d0 con 0x5625ddff1b40 2024-09-12T01:38:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.999+0000 7f13397fa640 1 -- 172.21.15.81:0/1817205026 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f134c018040 con 0x5625ddff1b40 2024-09-12T01:38:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.999+0000 7f13397fa640 1 -- 172.21.15.81:0/1817205026 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f134802b030 con 0x5625ddff1b40 2024-09-12T01:38:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.999+0000 7f135e2f8740 10 client.17697 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.999+0000 7f135e2f8740 10 client.17697 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:38:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.999+0000 7f135e2f8740 20 client.17697 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.999+0000 7f135e2f8740 1 --2- 172.21.15.81:0/1817205026 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5625de07aa70 0x5625de07ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.999+0000 7f135e2f8740 4 client.17697 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:38:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.999+0000 7f135e2f8740 1 -- 172.21.15.81:0/1817205026 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5625ddf5dd70 con 0x5625de07aa70 2024-09-12T01:38:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:09.999+0000 7f1359cbb640 1 --2- 172.21.15.81:0/1817205026 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5625de07aa70 0x5625de07ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.028 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:38:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f13397fa640 10 client.17697 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:38:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f1359cbb640 1 --2- 172.21.15.81:0/1817205026 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5625de07aa70 0x5625de07ce60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a20e14810c92a3b5 server_cookie=1573080110592af1 in_seq=0 out_seq=0 2024-09-12T01:38:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f13397fa640 1 -- 172.21.15.81:0/1817205026 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5625ddf5dd70 con 0x5625de07aa70 2024-09-12T01:38:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f13397fa640 10 client.17697 handle_command_reply: tid=0 2024-09-12T01:38:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f135e2f8740 1 client.17697 shutdown 2024-09-12T01:38:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f135e2f8740 1 -- 172.21.15.81:0/1817205026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff1b40 msgr2=0x5625de0122d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f135e2f8740 1 --2- 172.21.15.81:0/1817205026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff1b40 0x5625de0122d0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f134800d710 tx=0x7f134800b5d0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f135e2f8740 1 -- 172.21.15.81:0/1817205026 shutdown_connections 2024-09-12T01:38:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f135e2f8740 1 --2- 172.21.15.81:0/1817205026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625ddffb370 0x5625de012870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f135e2f8740 1 --2- 172.21.15.81:0/1817205026 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x5625de07aa70 0x5625de07ce60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f135e2f8740 1 --2- 172.21.15.81:0/1817205026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5625ddff1b40 0x5625de0122d0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f135e2f8740 1 --2- 172.21.15.81:0/1817205026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625ddff05d0 0x5625de011d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f13397fa640 0 client.17697 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:38:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f135e2f8740 1 -- 172.21.15.81:0/1817205026 >> 172.21.15.81:0/1817205026 conn(0x5625ddfb9310 msgr2=0x5625ddff97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f135e2f8740 1 -- 172.21.15.81:0/1817205026 shutdown_connections 2024-09-12T01:38:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f135e2f8740 1 -- 172.21.15.81:0/1817205026 wait complete. 2024-09-12T01:38:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.000+0000 7f135e2f8740 20 client.17697 trim_cache size 0 max 16384 2024-09-12T01:38:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.001+0000 7f135bf1f640 1 -- 172.21.15.81:0/1074261228 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f133c0a2cf0 msgr2=0x7f133c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.001+0000 7f135bf1f640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f133c0a2cf0 0x7f133c0a51b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f134c00fd20 tx=0x7f134c005900 comp rx=0 tx=0).stop 2024-09-12T01:38:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.001+0000 7f135bf1f640 1 -- 172.21.15.81:0/1074261228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1354102d30 msgr2=0x7f13541985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.001+0000 7f135bf1f640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1354102d30 0x7f13541985c0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f134402ae00 tx=0x7f1344003ba0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.001+0000 7f135bf1f640 1 -- 172.21.15.81:0/1074261228 shutdown_connections 2024-09-12T01:38:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.001+0000 7f135bf1f640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f133c0a2cf0 0x7f133c0a51b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.001+0000 7f135bf1f640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13541082a0 0x7f135419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.001+0000 7f135bf1f640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f13541036e0 0x7f1354198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.001+0000 7f135bf1f640 1 --2- 172.21.15.81:0/1074261228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1354102d30 0x7f13541985c0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.001+0000 7f135bf1f640 1 -- 172.21.15.81:0/1074261228 >> 172.21.15.81:0/1074261228 conn(0x7f13540fc7d0 msgr2=0x7f1354105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:10.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.001+0000 7f135bf1f640 1 -- 172.21.15.81:0/1074261228 shutdown_connections 2024-09-12T01:38:10.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:10.001+0000 7f135bf1f640 1 -- 172.21.15.81:0/1074261228 wait complete. 2024-09-12T01:38:10.031 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:09 smithi100 ceph-mon[35275]: pgmap v311: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T01:38:10.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:09 smithi189 ceph-mon[35357]: pgmap v311: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T01:38:10.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:38:10.905 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:10.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:10 smithi081 ceph-mon[30920]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T01:38:11.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:10 smithi100 ceph-mon[35275]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T01:38:11.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:10 smithi189 ceph-mon[35357]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T01:38:11.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.322+0000 7fca75aec640 1 -- 172.21.15.81:0/199055973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca70102790 msgr2=0x7fca701067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.322+0000 7fca75aec640 1 --2- 172.21.15.81:0/199055973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca70102790 0x7fca701067e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fca64009900 tx=0x7fca6402a410 comp rx=0 tx=0).stop 2024-09-12T01:38:11.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.322+0000 7fca75aec640 1 -- 172.21.15.81:0/199055973 shutdown_connections 2024-09-12T01:38:11.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.322+0000 7fca75aec640 1 --2- 172.21.15.81:0/199055973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70106f10 0x7fca7010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.322+0000 7fca75aec640 1 --2- 172.21.15.81:0/199055973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca70102790 0x7fca701067e0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.322+0000 7fca75aec640 1 --2- 172.21.15.81:0/199055973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca70101de0 0x7fca701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.322+0000 7fca75aec640 1 -- 172.21.15.81:0/199055973 >> 172.21.15.81:0/199055973 conn(0x7fca700fd8c0 msgr2=0x7fca700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:11.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.323+0000 7fca75aec640 1 -- 172.21.15.81:0/199055973 shutdown_connections 2024-09-12T01:38:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.323+0000 7fca75aec640 1 -- 172.21.15.81:0/199055973 wait complete. 2024-09-12T01:38:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.323+0000 7fca75aec640 1 Processor -- start 2024-09-12T01:38:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca75aec640 1 -- start start 2024-09-12T01:38:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca75aec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca70101de0 0x7fca701984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca75aec640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca70102790 0x7fca701989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca75aec640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70106f10 0x7fca7019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca75aec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca70111f70 con 0x7fca70101de0 2024-09-12T01:38:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca75aec640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca70111df0 con 0x7fca70106f10 2024-09-12T01:38:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca75aec640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fca701120f0 con 0x7fca70102790 2024-09-12T01:38:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca70101de0 0x7fca701984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca70101de0 0x7fca701984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55288/0 (socket says 172.21.15.81:55288) 2024-09-12T01:38:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca6f7fe640 1 -- 172.21.15.81:0/3845373660 learned_addr learned my addr 172.21.15.81:0/3845373660 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:11.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca6effd640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca70102790 0x7fca701989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca6ffff640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70106f10 0x7fca7019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca6f7fe640 1 -- 172.21.15.81:0/3845373660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca70102790 msgr2=0x7fca701989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca6f7fe640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca70102790 0x7fca701989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca6f7fe640 1 -- 172.21.15.81:0/3845373660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70106f10 msgr2=0x7fca7019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca6f7fe640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70106f10 0x7fca7019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca6f7fe640 1 -- 172.21.15.81:0/3845373660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7019d460 con 0x7fca70101de0 2024-09-12T01:38:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.324+0000 7fca6effd640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca70102790 0x7fca701989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.325+0000 7fca6f7fe640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca70101de0 0x7fca701984b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fca6000d770 tx=0x7fca6000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.325+0000 7fca6cff9640 1 -- 172.21.15.81:0/3845373660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60017070 con 0x7fca70101de0 2024-09-12T01:38:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.325+0000 7fca75aec640 1 -- 172.21.15.81:0/3845373660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7019d750 con 0x7fca70101de0 2024-09-12T01:38:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.325+0000 7fca6cff9640 1 -- 172.21.15.81:0/3845373660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca60005500 con 0x7fca70101de0 2024-09-12T01:38:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.325+0000 7fca6cff9640 1 -- 172.21.15.81:0/3845373660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60004e00 con 0x7fca70101de0 2024-09-12T01:38:11.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.325+0000 7fca75aec640 1 -- 172.21.15.81:0/3845373660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca701a5030 con 0x7fca70101de0 2024-09-12T01:38:11.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.327+0000 7fca6cff9640 1 -- 172.21.15.81:0/3845373660 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fca60004fa0 con 0x7fca70101de0 2024-09-12T01:38:11.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca77ec5740 1 Processor -- start 2024-09-12T01:38:11.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca77ec5740 1 -- start start 2024-09-12T01:38:11.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca77ec5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013ffb40 0x55c0013fe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca77ec5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013fe5d0 0x55c0013fea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca77ec5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c001409370 0x55c00140b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca77ec5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c0013642f0 con 0x55c0013fe5d0 2024-09-12T01:38:11.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca77ec5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c00130bcf0 con 0x55c0013ffb40 2024-09-12T01:38:11.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca77ec5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c0013602b0 con 0x55c001409370 2024-09-12T01:38:11.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013fe5d0 0x55c0013fea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013fe5d0 0x55c0013fea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55290/0 (socket says 172.21.15.81:55290) 2024-09-12T01:38:11.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca6f7fe640 1 -- 172.21.15.81:0/1279592589 learned_addr learned my addr 172.21.15.81:0/1279592589 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:11.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca6ffff640 1 --2- 172.21.15.81:0/1279592589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013ffb40 0x55c0013fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca6effd640 1 --2- 172.21.15.81:0/1279592589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c001409370 0x55c00140b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.328+0000 7fca6cff9640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fca580a2cf0 0x7fca580a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.329+0000 7fca6cff9640 1 -- 172.21.15.81:0/3845373660 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fca600ceff0 con 0x7fca70101de0 2024-09-12T01:38:11.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.329+0000 7fca6f7fe640 1 -- 172.21.15.81:0/1279592589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c001409370 msgr2=0x55c00140b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:11.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.329+0000 7fca6f7fe640 1 --2- 172.21.15.81:0/1279592589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c001409370 0x55c00140b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.329+0000 7fca6f7fe640 1 -- 172.21.15.81:0/1279592589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013ffb40 msgr2=0x55c0013fe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:11.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.329+0000 7fca6f7fe640 1 --2- 172.21.15.81:0/1279592589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013ffb40 0x55c0013fe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.329+0000 7fca6f7fe640 1 -- 172.21.15.81:0/1279592589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0012f03a0 con 0x55c0013fe5d0 2024-09-12T01:38:11.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.329+0000 7fca6ffff640 1 --2- 172.21.15.81:0/1279592589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013ffb40 0x55c0013fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:11.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.329+0000 7fca6ffff640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fca580a2cf0 0x7fca580a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.329+0000 7fca6f7fe640 1 --2- 172.21.15.81:0/1279592589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013fe5d0 0x55c0013fea10 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fca600cc620 tx=0x7fca60009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2589c0b257a246e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:11.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.329+0000 7fca55ffb640 1 -- 172.21.15.81:0/1279592589 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60020030 con 0x55c0013fe5d0 2024-09-12T01:38:11.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.329+0000 7fca55ffb640 1 -- 172.21.15.81:0/1279592589 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca600046c0 con 0x55c0013fe5d0 2024-09-12T01:38:11.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.329+0000 7fca55ffb640 1 -- 172.21.15.81:0/1279592589 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60009cc0 con 0x55c0013fe5d0 2024-09-12T01:38:11.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.330+0000 7fca77ec5740 1 -- 172.21.15.81:0/1279592589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013fe5d0 msgr2=0x55c0013fea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.330+0000 7fca6ffff640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fca580a2cf0 0x7fca580a51b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca68005fd0 tx=0x7fca68004a40 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:11.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.330+0000 7fca77ec5740 1 --2- 172.21.15.81:0/1279592589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013fe5d0 0x55c0013fea10 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fca600cc620 tx=0x7fca60009c30 comp rx=0 tx=0).stop 2024-09-12T01:38:11.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.330+0000 7fca77ec5740 1 -- 172.21.15.81:0/1279592589 shutdown_connections 2024-09-12T01:38:11.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.330+0000 7fca77ec5740 1 --2- 172.21.15.81:0/1279592589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c001409370 0x55c00140b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.330+0000 7fca77ec5740 1 --2- 172.21.15.81:0/1279592589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013fe5d0 0x55c0013fea10 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.330+0000 7fca77ec5740 1 --2- 172.21.15.81:0/1279592589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013ffb40 0x55c0013fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.330+0000 7fca77ec5740 1 -- 172.21.15.81:0/1279592589 >> 172.21.15.81:0/1279592589 conn(0x55c0013c7310 msgr2=0x55c0013fac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:11.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.330+0000 7fca77ec5740 1 -- 172.21.15.81:0/1279592589 shutdown_connections 2024-09-12T01:38:11.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.330+0000 7fca77ec5740 1 -- 172.21.15.81:0/1279592589 wait complete. 2024-09-12T01:38:11.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.330+0000 7fca77ec5740 1 -- start start 2024-09-12T01:38:11.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca77ec5740 1 Processor -- start 2024-09-12T01:38:11.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca77ec5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013fe5d0 0x55c001408de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca77ec5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013ffb40 0x55c001406090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca77ec5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c001409370 0x55c0014067d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca77ec5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c00140c010 con 0x55c0013ffb40 2024-09-12T01:38:11.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca77ec5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c00131f060 con 0x55c001409370 2024-09-12T01:38:11.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca77ec5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c00140c190 con 0x55c0013fe5d0 2024-09-12T01:38:11.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca77ec5740 10 client.0 _ll_register_callbacks cb 0x55c0010728c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:11.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca6effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013ffb40 0x55c001406090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca6effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013ffb40 0x55c001406090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55304/0 (socket says 172.21.15.81:55304) 2024-09-12T01:38:11.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca6effd640 1 -- 172.21.15.81:0/4248820214 learned_addr learned my addr 172.21.15.81:0/4248820214 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:11.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca6f7fe640 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013fe5d0 0x55c001408de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca6ffff640 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c001409370 0x55c0014067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca6effd640 1 -- 172.21.15.81:0/4248820214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013fe5d0 msgr2=0x55c001408de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:11.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca6effd640 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013fe5d0 0x55c001408de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca6effd640 1 -- 172.21.15.81:0/4248820214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c001409370 msgr2=0x55c0014067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:11.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca6effd640 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c001409370 0x55c0014067d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca6effd640 1 -- 172.21.15.81:0/4248820214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0010d53c0 con 0x55c0013ffb40 2024-09-12T01:38:11.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca6ffff640 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c001409370 0x55c0014067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:11.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca6effd640 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013ffb40 0x55c001406090 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fca64009900 tx=0x7fca640318d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86937f01e0a2d084 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:11.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.331+0000 7fca4effd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:11.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca4effd640 1 -- 172.21.15.81:0/4248820214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64035040 con 0x55c0013ffb40 2024-09-12T01:38:11.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca4effd640 1 -- 172.21.15.81:0/4248820214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fca64004240 con 0x55c0013ffb40 2024-09-12T01:38:11.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca77ec5740 1 -- 172.21.15.81:0/4248820214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c001371860 con 0x55c0013ffb40 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca4effd640 1 -- 172.21.15.81:0/4248820214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca64004440 con 0x55c0013ffb40 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca77ec5740 10 client.17709 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca77ec5740 1 -- 172.21.15.81:0/4248820214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c001417b40 con 0x55c0013ffb40 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca4effd640 1 -- 172.21.15.81:0/4248820214 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c001371860 con 0x55c0013ffb40 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca4effd640 1 -- 172.21.15.81:0/4248820214 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca64004bf0 con 0x55c0013ffb40 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca77ec5740 10 client.17709 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca77ec5740 10 client.17709 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca77ec5740 20 client.17709 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca77ec5740 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c001419050 0x55c00141b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca77ec5740 4 client.17709 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.332+0000 7fca77ec5740 1 -- 172.21.15.81:0/4248820214 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c00136bd70 con 0x55c001419050 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.333+0000 7fca6f7fe640 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c001419050 0x55c00141b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.333+0000 7fca6f7fe640 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c001419050 0x55c00141b470 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a8353abddc89729 server_cookie=8e55d8cb92c32ade in_seq=0 out_seq=0 2024-09-12T01:38:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.333+0000 7fca4effd640 10 client.17709 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:11.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca4effd640 1 -- 172.21.15.81:0/4248820214 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c00136bd70 con 0x55c001419050 2024-09-12T01:38:11.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca4effd640 10 client.17709 handle_command_reply: tid=0 2024-09-12T01:38:11.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca77ec5740 1 client.17709 shutdown 2024-09-12T01:38:11.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca77ec5740 1 -- 172.21.15.81:0/4248820214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013ffb40 msgr2=0x55c001406090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca77ec5740 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013ffb40 0x55c001406090 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fca64009900 tx=0x7fca640318d0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca77ec5740 1 -- 172.21.15.81:0/4248820214 shutdown_connections 2024-09-12T01:38:11.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca77ec5740 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c001419050 0x55c00141b470 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca77ec5740 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c001409370 0x55c0014067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca77ec5740 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0013ffb40 0x55c001406090 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca77ec5740 1 --2- 172.21.15.81:0/4248820214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013fe5d0 0x55c001408de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca77ec5740 1 -- 172.21.15.81:0/4248820214 >> 172.21.15.81:0/4248820214 conn(0x55c0013c7310 msgr2=0x55c001400990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:11.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca4effd640 0 client.17709 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:11.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca77ec5740 1 -- 172.21.15.81:0/4248820214 shutdown_connections 2024-09-12T01:38:11.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca77ec5740 1 -- 172.21.15.81:0/4248820214 wait complete. 2024-09-12T01:38:11.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.334+0000 7fca77ec5740 20 client.17709 trim_cache size 0 max 16384 2024-09-12T01:38:11.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca77ec5740 1 Processor -- start 2024-09-12T01:38:11.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca77ec5740 1 -- start start 2024-09-12T01:38:11.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca77ec5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013fe5d0 0x55c001406060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca77ec5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013ffb40 0x55c0014152b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca77ec5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 0x55c001420d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca77ec5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca701ad9f0 con 0x55c001409370 2024-09-12T01:38:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca77ec5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca701af530 con 0x55c0013fe5d0 2024-09-12T01:38:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca77ec5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fca701ae0c0 con 0x55c0013ffb40 2024-09-12T01:38:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca6ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 0x55c001420d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca6ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 0x55c001420d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55308/0 (socket says 172.21.15.81:55308) 2024-09-12T01:38:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca6ffff640 1 -- 172.21.15.81:0/1462385180 learned_addr learned my addr 172.21.15.81:0/1462385180 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca6f7fe640 1 --2- 172.21.15.81:0/1462385180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013fe5d0 0x55c001406060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca6effd640 1 --2- 172.21.15.81:0/1462385180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013ffb40 0x55c0014152b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca6ffff640 1 -- 172.21.15.81:0/1462385180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013ffb40 msgr2=0x55c0014152b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca6ffff640 1 --2- 172.21.15.81:0/1462385180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013ffb40 0x55c0014152b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca6ffff640 1 -- 172.21.15.81:0/1462385180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013fe5d0 msgr2=0x55c001406060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:11.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca6ffff640 1 --2- 172.21.15.81:0/1462385180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013fe5d0 0x55c001406060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca6ffff640 1 -- 172.21.15.81:0/1462385180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0014157f0 con 0x55c001409370 2024-09-12T01:38:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.347+0000 7fca6effd640 1 --2- 172.21.15.81:0/1462385180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013ffb40 0x55c0014152b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.348+0000 7fca6ffff640 1 --2- 172.21.15.81:0/1462385180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 0x55c001420d40 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fca68013840 tx=0x7fca68015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32748c14b95ff420 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.348+0000 7fca557fa640 1 -- 172.21.15.81:0/1462385180 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6801f9d0 con 0x55c001409370 2024-09-12T01:38:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.348+0000 7fca557fa640 1 -- 172.21.15.81:0/1462385180 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca68017070 con 0x55c001409370 2024-09-12T01:38:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.348+0000 7fca557fa640 1 -- 172.21.15.81:0/1462385180 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca680273e0 con 0x55c001409370 2024-09-12T01:38:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.348+0000 7fca77ec5740 1 -- 172.21.15.81:0/1462385180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 msgr2=0x55c001420d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.348+0000 7fca77ec5740 1 --2- 172.21.15.81:0/1462385180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 0x55c001420d40 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fca68013840 tx=0x7fca68015000 comp rx=0 tx=0).stop 2024-09-12T01:38:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.348+0000 7fca77ec5740 1 -- 172.21.15.81:0/1462385180 shutdown_connections 2024-09-12T01:38:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.348+0000 7fca77ec5740 1 --2- 172.21.15.81:0/1462385180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 0x55c001420d40 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.348+0000 7fca77ec5740 1 --2- 172.21.15.81:0/1462385180 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013ffb40 0x55c0014152b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.348+0000 7fca77ec5740 1 --2- 172.21.15.81:0/1462385180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013fe5d0 0x55c001406060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.348+0000 7fca77ec5740 1 -- 172.21.15.81:0/1462385180 >> 172.21.15.81:0/1462385180 conn(0x55c0013c7310 msgr2=0x55c001405950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.348+0000 7fca77ec5740 1 -- 172.21.15.81:0/1462385180 shutdown_connections 2024-09-12T01:38:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.348+0000 7fca77ec5740 1 -- 172.21.15.81:0/1462385180 wait complete. 2024-09-12T01:38:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.349+0000 7fca77ec5740 1 -- start start 2024-09-12T01:38:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.349+0000 7fca77ec5740 1 Processor -- start 2024-09-12T01:38:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.349+0000 7fca77ec5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013fe5d0 0x55c00140cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.349+0000 7fca77ec5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013ffb40 0x55c00140d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.349+0000 7fca77ec5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 0x55c00147bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.349+0000 7fca77ec5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca701aee60 con 0x55c001409370 2024-09-12T01:38:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.349+0000 7fca77ec5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca701ae790 con 0x55c0013ffb40 2024-09-12T01:38:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.349+0000 7fca77ec5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fca701ab9f0 con 0x55c0013fe5d0 2024-09-12T01:38:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.349+0000 7fca77ec5740 10 client.0 _ll_register_callbacks cb 0x7fca64005e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.349+0000 7fca6ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 0x55c00147bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.349+0000 7fca6ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 0x55c00147bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55312/0 (socket says 172.21.15.81:55312) 2024-09-12T01:38:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.349+0000 7fca6ffff640 1 -- 172.21.15.81:0/3124854428 learned_addr learned my addr 172.21.15.81:0/3124854428 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca6f7fe640 1 --2- 172.21.15.81:0/3124854428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013fe5d0 0x55c00140cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca6effd640 1 --2- 172.21.15.81:0/3124854428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013ffb40 0x55c00140d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca6ffff640 1 -- 172.21.15.81:0/3124854428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013fe5d0 msgr2=0x55c00140cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca6ffff640 1 --2- 172.21.15.81:0/3124854428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013fe5d0 0x55c00140cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca6ffff640 1 -- 172.21.15.81:0/3124854428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013ffb40 msgr2=0x55c00140d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca6ffff640 1 --2- 172.21.15.81:0/3124854428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013ffb40 0x55c00140d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca6ffff640 1 -- 172.21.15.81:0/3124854428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c00147c3e0 con 0x55c001409370 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca6ffff640 1 --2- 172.21.15.81:0/3124854428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 0x55c00147bd40 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fca6801df00 tx=0x7fca6801df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e85f81de0e9de5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca4effd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca4effd640 1 -- 172.21.15.81:0/3124854428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6801c620 con 0x55c001409370 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca4effd640 1 -- 172.21.15.81:0/3124854428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fca6801c7c0 con 0x55c001409370 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca77ec5740 1 -- 172.21.15.81:0/3124854428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca68017070 con 0x55c001409370 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca4effd640 1 -- 172.21.15.81:0/3124854428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca6801f9d0 con 0x55c001409370 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca77ec5740 10 client.17715 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.350+0000 7fca77ec5740 1 -- 172.21.15.81:0/3124854428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c0014836e0 con 0x55c001409370 2024-09-12T01:38:11.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.351+0000 7fca4effd640 1 -- 172.21.15.81:0/3124854428 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca68017070 con 0x55c001409370 2024-09-12T01:38:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.351+0000 7fca4effd640 1 -- 172.21.15.81:0/3124854428 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca68039030 con 0x55c001409370 2024-09-12T01:38:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.351+0000 7fca77ec5740 10 client.17715 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.351+0000 7fca77ec5740 10 client.17715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:38:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.351+0000 7fca77ec5740 20 client.17715 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.351+0000 7fca77ec5740 1 --2- 172.21.15.81:0/3124854428 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c001483dc0 0x55c0014861e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.351+0000 7fca77ec5740 4 client.17715 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:38:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.351+0000 7fca77ec5740 1 -- 172.21.15.81:0/3124854428 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c0012e8170 con 0x55c001483dc0 2024-09-12T01:38:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.351+0000 7fca6f7fe640 1 --2- 172.21.15.81:0/3124854428 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c001483dc0 0x55c0014861e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.351+0000 7fca6f7fe640 1 --2- 172.21.15.81:0/3124854428 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c001483dc0 0x55c0014861e0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b513739d4bdf89f server_cookie=dbf57cfcb3ef0a3f in_seq=0 out_seq=0 2024-09-12T01:38:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.351+0000 7fca4effd640 10 client.17715 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca4effd640 1 -- 172.21.15.81:0/3124854428 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c0012e8170 con 0x55c001483dc0 2024-09-12T01:38:11.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca4effd640 10 client.17715 handle_command_reply: tid=0 2024-09-12T01:38:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca77ec5740 1 client.17715 shutdown 2024-09-12T01:38:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca77ec5740 1 -- 172.21.15.81:0/3124854428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 msgr2=0x55c00147bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca77ec5740 1 --2- 172.21.15.81:0/3124854428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 0x55c00147bd40 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fca6801df00 tx=0x7fca6801df30 comp rx=0 tx=0).stop 2024-09-12T01:38:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca77ec5740 1 -- 172.21.15.81:0/3124854428 shutdown_connections 2024-09-12T01:38:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca77ec5740 1 --2- 172.21.15.81:0/3124854428 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55c001483dc0 0x55c0014861e0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca77ec5740 1 --2- 172.21.15.81:0/3124854428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c001409370 0x55c00147bd40 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca77ec5740 1 --2- 172.21.15.81:0/3124854428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c0013ffb40 0x55c00140d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca77ec5740 1 --2- 172.21.15.81:0/3124854428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c0013fe5d0 0x55c00140cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca77ec5740 1 -- 172.21.15.81:0/3124854428 >> 172.21.15.81:0/3124854428 conn(0x55c0013c7310 msgr2=0x55c0014078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca4effd640 0 client.17715 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca77ec5740 1 -- 172.21.15.81:0/3124854428 shutdown_connections 2024-09-12T01:38:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca77ec5740 1 -- 172.21.15.81:0/3124854428 wait complete. 2024-09-12T01:38:11.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca77ec5740 20 client.17715 trim_cache size 0 max 16384 2024-09-12T01:38:11.358 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:38:11.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.352+0000 7fca75aec640 1 -- 172.21.15.81:0/3845373660 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fca580a2cf0 msgr2=0x7fca580a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.353+0000 7fca75aec640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fca580a2cf0 0x7fca580a51b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca68005fd0 tx=0x7fca68004a40 comp rx=0 tx=0).stop 2024-09-12T01:38:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.353+0000 7fca75aec640 1 -- 172.21.15.81:0/3845373660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca70101de0 msgr2=0x7fca701984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.353+0000 7fca75aec640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca70101de0 0x7fca701984b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fca6000d770 tx=0x7fca6000dc30 comp rx=0 tx=0).stop 2024-09-12T01:38:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.353+0000 7fca75aec640 1 -- 172.21.15.81:0/3845373660 shutdown_connections 2024-09-12T01:38:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.353+0000 7fca75aec640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fca580a2cf0 0x7fca580a51b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.353+0000 7fca75aec640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca70106f10 0x7fca7019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.353+0000 7fca75aec640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca70102790 0x7fca701989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.353+0000 7fca75aec640 1 --2- 172.21.15.81:0/3845373660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca70101de0 0x7fca701984b0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.353+0000 7fca75aec640 1 -- 172.21.15.81:0/3845373660 >> 172.21.15.81:0/3845373660 conn(0x7fca700fd8c0 msgr2=0x7fca700fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.353+0000 7fca75aec640 1 -- 172.21.15.81:0/3845373660 shutdown_connections 2024-09-12T01:38:11.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:11.353+0000 7fca75aec640 1 -- 172.21.15.81:0/3845373660 wait complete. 2024-09-12T01:38:11.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:11 smithi081 ceph-mon[30920]: pgmap v313: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:38:12.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:11 smithi100 ceph-mon[35275]: pgmap v313: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:38:12.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:11 smithi189 ceph-mon[35357]: pgmap v313: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:38:13.068 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:38:13.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:38:13.327 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:13.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T01:38:13.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.687+0000 7f2bdb342640 1 -- 172.21.15.81:0/4202658450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bd4101ad0 msgr2=0x7f2bd4101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.687+0000 7f2bdb342640 1 --2- 172.21.15.81:0/4202658450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bd4101ad0 0x7f2bd4101f30 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009930 tx=0x7f2bd002a420 comp rx=0 tx=0).stop 2024-09-12T01:38:13.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.687+0000 7f2bdb342640 1 -- 172.21.15.81:0/4202658450 shutdown_connections 2024-09-12T01:38:13.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.687+0000 7f2bdb342640 1 --2- 172.21.15.81:0/4202658450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bd4102470 0x7f2bd410e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.687+0000 7f2bdb342640 1 --2- 172.21.15.81:0/4202658450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bd4101ad0 0x7f2bd4101f30 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.687+0000 7f2bdb342640 1 --2- 172.21.15.81:0/4202658450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bd4107b70 0x7f2bd4107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.687+0000 7f2bdb342640 1 -- 172.21.15.81:0/4202658450 >> 172.21.15.81:0/4202658450 conn(0x7f2bd40fd7d0 msgr2=0x7f2bd40ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.687+0000 7f2bdb342640 1 -- 172.21.15.81:0/4202658450 shutdown_connections 2024-09-12T01:38:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.687+0000 7f2bdb342640 1 -- 172.21.15.81:0/4202658450 wait complete. 2024-09-12T01:38:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.688+0000 7f2bdb342640 1 Processor -- start 2024-09-12T01:38:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.688+0000 7f2bdb342640 1 -- start start 2024-09-12T01:38:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.688+0000 7f2bdb342640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bd4101ad0 0x7f2bd4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.688+0000 7f2bdb342640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bd4102470 0x7f2bd4198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.688+0000 7f2bdb342640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bd4107b70 0x7f2bd419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.688+0000 7f2bdb342640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4111f20 con 0x7f2bd4107b70 2024-09-12T01:38:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.688+0000 7f2bdb342640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4111da0 con 0x7f2bd4102470 2024-09-12T01:38:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.688+0000 7f2bdb342640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41120a0 con 0x7f2bd4101ad0 2024-09-12T01:38:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.688+0000 7f2bd98df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bd4107b70 0x7f2bd419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.688+0000 7f2bd98df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bd4107b70 0x7f2bd419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51184/0 (socket says 172.21.15.81:51184) 2024-09-12T01:38:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.688+0000 7f2bd98df640 1 -- 172.21.15.81:0/3981110657 learned_addr learned my addr 172.21.15.81:0/3981110657 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.688+0000 7f2bd90de640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bd4101ad0 0x7f2bd4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.688+0000 7f2bd88dd640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bd4102470 0x7f2bd4198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.689+0000 7f2bd98df640 1 -- 172.21.15.81:0/3981110657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bd4101ad0 msgr2=0x7f2bd4198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.689+0000 7f2bd98df640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bd4101ad0 0x7f2bd4198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.689+0000 7f2bd98df640 1 -- 172.21.15.81:0/3981110657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bd4102470 msgr2=0x7f2bd4198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.689+0000 7f2bd98df640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bd4102470 0x7f2bd4198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.689+0000 7f2bd98df640 1 -- 172.21.15.81:0/3981110657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd419d400 con 0x7f2bd4107b70 2024-09-12T01:38:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.689+0000 7f2bd98df640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bd4107b70 0x7f2bd419ccd0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00b970 tx=0x7f2bcc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.689+0000 7f2bc67fc640 1 -- 172.21.15.81:0/3981110657 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc019070 con 0x7f2bd4107b70 2024-09-12T01:38:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.689+0000 7f2bc67fc640 1 -- 172.21.15.81:0/3981110657 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bcc00cb40 con 0x7f2bd4107b70 2024-09-12T01:38:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.689+0000 7f2bdb342640 1 -- 172.21.15.81:0/3981110657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd419d6f0 con 0x7f2bd4107b70 2024-09-12T01:38:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.689+0000 7f2bc67fc640 1 -- 172.21.15.81:0/3981110657 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc007650 con 0x7f2bd4107b70 2024-09-12T01:38:13.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.689+0000 7f2bdb342640 1 -- 172.21.15.81:0/3981110657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd41a4f80 con 0x7f2bd4107b70 2024-09-12T01:38:13.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.690+0000 7f2bdb342640 1 -- 172.21.15.81:0/3981110657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd4101f30 con 0x7f2bd4107b70 2024-09-12T01:38:13.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.691+0000 7f2bc67fc640 1 -- 172.21.15.81:0/3981110657 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f2bcc01c070 con 0x7f2bd4107b70 2024-09-12T01:38:13.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.692+0000 7f2bc67fc640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2bc00a2e20 0x7f2bc00a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.692+0000 7f2bc67fc640 1 -- 172.21.15.81:0/3981110657 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f2bcc0ce870 con 0x7f2bd4107b70 2024-09-12T01:38:13.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.692+0000 7f2bd90de640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2bc00a2e20 0x7f2bc00a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.692+0000 7f2bd90de640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2bc00a2e20 0x7f2bc00a52e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8005d00 tx=0x7f2bc800b410 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:13.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.696+0000 7f2bc67fc640 1 -- 172.21.15.81:0/3981110657 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2bcc09af30 con 0x7f2bd4107b70 2024-09-12T01:38:13.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:13 smithi081 ceph-mon[30920]: pgmap v314: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:38:13.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.793+0000 7f25d59a9640 1 -- 172.21.15.81:0/2467331206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d010c170 msgr2=0x7f25d010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.793+0000 7f25d59a9640 1 --2- 172.21.15.81:0/2467331206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d010c170 0x7f25d010e610 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009ca0 tx=0x7f25c802a950 comp rx=0 tx=0).stop 2024-09-12T01:38:13.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.793+0000 7f25d59a9640 1 -- 172.21.15.81:0/2467331206 shutdown_connections 2024-09-12T01:38:13.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.793+0000 7f25d59a9640 1 --2- 172.21.15.81:0/2467331206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d010c170 0x7f25d010e610 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.793+0000 7f25d59a9640 1 --2- 172.21.15.81:0/2467331206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d0103660 0x7f25d010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.793+0000 7f25d59a9640 1 --2- 172.21.15.81:0/2467331206 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d0102d40 0x7f25d0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.793+0000 7f25d59a9640 1 -- 172.21.15.81:0/2467331206 >> 172.21.15.81:0/2467331206 conn(0x7f25d00fc7a0 msgr2=0x7f25d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.793+0000 7f25d59a9640 1 -- 172.21.15.81:0/2467331206 shutdown_connections 2024-09-12T01:38:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.794+0000 7f25d59a9640 1 -- 172.21.15.81:0/2467331206 wait complete. 2024-09-12T01:38:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.794+0000 7f25d59a9640 1 Processor -- start 2024-09-12T01:38:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.794+0000 7f25d59a9640 1 -- start start 2024-09-12T01:38:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25d59a9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d0102d40 0x7f25d01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25d59a9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d0103660 0x7f25d0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25d59a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d010c170 0x7f25d0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25d59a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25d0111f70 con 0x7f25d010c170 2024-09-12T01:38:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25d59a9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f25d0111df0 con 0x7f25d0103660 2024-09-12T01:38:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25d59a9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f25d01120f0 con 0x7f25d0102d40 2024-09-12T01:38:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25cf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d010c170 0x7f25d0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25cf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d010c170 0x7f25d0101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51200/0 (socket says 172.21.15.81:51200) 2024-09-12T01:38:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25cf7fe640 1 -- 172.21.15.81:0/3397861695 learned_addr learned my addr 172.21.15.81:0/3397861695 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25ceffd640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d0102d40 0x7f25d01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d0103660 0x7f25d0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25cf7fe640 1 -- 172.21.15.81:0/3397861695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d0102d40 msgr2=0x7f25d01009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d0102d40 0x7f25d01009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25cf7fe640 1 -- 172.21.15.81:0/3397861695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d0103660 msgr2=0x7f25d0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d0103660 0x7f25d0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25cf7fe640 1 -- 172.21.15.81:0/3397861695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d01a68d0 con 0x7f25d010c170 2024-09-12T01:38:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d0103660 0x7f25d0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.795+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d010c170 0x7f25d0101420 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f25c802ae70 tx=0x7f25c802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.796+0000 7f25d49a7640 1 -- 172.21.15.81:0/3397861695 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8034040 con 0x7f25d010c170 2024-09-12T01:38:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.796+0000 7f25d49a7640 1 -- 172.21.15.81:0/3397861695 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25c8030920 con 0x7f25d010c170 2024-09-12T01:38:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.796+0000 7f25d59a9640 1 -- 172.21.15.81:0/3397861695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d01a6b60 con 0x7f25d010c170 2024-09-12T01:38:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.796+0000 7f25d49a7640 1 -- 172.21.15.81:0/3397861695 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8045480 con 0x7f25d010c170 2024-09-12T01:38:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.796+0000 7f25d59a9640 1 -- 172.21.15.81:0/3397861695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d01a7090 con 0x7f25d010c170 2024-09-12T01:38:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.798+0000 7f25d49a7640 1 -- 172.21.15.81:0/3397861695 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f25c8037020 con 0x7f25d010c170 2024-09-12T01:38:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.798+0000 7f25d7d82740 1 Processor -- start 2024-09-12T01:38:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.798+0000 7f25d7d82740 1 -- start start 2024-09-12T01:38:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.798+0000 7f25d7d82740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c02b60 0x55bce2c02f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.798+0000 7f25d7d82740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c03480 0x55bce2c0d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.798+0000 7f25d7d82740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c0dd40 0x55bce2c10130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.798+0000 7f25d7d82740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bce2b68280 con 0x55bce2c03480 2024-09-12T01:38:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.798+0000 7f25d7d82740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55bce2b0fb10 con 0x55bce2c0dd40 2024-09-12T01:38:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.798+0000 7f25d7d82740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bce2b64240 con 0x55bce2c02b60 2024-09-12T01:38:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c03480 0x55bce2c0d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c03480 0x55bce2c0d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51210/0 (socket says 172.21.15.81:51210) 2024-09-12T01:38:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25ceffd640 1 -- 172.21.15.81:0/1567398321 learned_addr learned my addr 172.21.15.81:0/1567398321 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/1567398321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c02b60 0x55bce2c02f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/1567398321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c0dd40 0x55bce2c10130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25ceffd640 1 -- 172.21.15.81:0/1567398321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c02b60 msgr2=0x55bce2c02f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25ceffd640 1 --2- 172.21.15.81:0/1567398321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c02b60 0x55bce2c02f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25ceffd640 1 -- 172.21.15.81:0/1567398321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c0dd40 msgr2=0x55bce2c10130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25ceffd640 1 --2- 172.21.15.81:0/1567398321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c0dd40 0x55bce2c10130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25ceffd640 1 -- 172.21.15.81:0/1567398321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce2b1c1f0 con 0x55bce2c03480 2024-09-12T01:38:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/1567398321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c0dd40 0x55bce2c10130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25d49a7640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f25b80a2d70 0x7f25b80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f25b80a2d70 0x7f25b80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25ceffd640 1 --2- 172.21.15.81:0/1567398321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c03480 0x55bce2c0d800 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f25c000ac10 tx=0x7f25c000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5cbbe6daf94c69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25d49a7640 1 -- 172.21.15.81:0/3397861695 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f25c80f0110 con 0x7f25d010c170 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25b5ffb640 1 -- 172.21.15.81:0/1567398321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c001d070 con 0x55bce2c03480 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25b5ffb640 1 -- 172.21.15.81:0/1567398321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25c0018b20 con 0x55bce2c03480 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.799+0000 7f25b5ffb640 1 -- 172.21.15.81:0/1567398321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0010b50 con 0x55bce2c03480 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.800+0000 7f25d7d82740 1 -- 172.21.15.81:0/1567398321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c03480 msgr2=0x55bce2c0d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.800+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f25b80a2d70 0x7f25b80a5230 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55bce2c00470 tx=0x7f25c400b360 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.800+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1567398321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c03480 0x55bce2c0d800 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f25c000ac10 tx=0x7f25c000f790 comp rx=0 tx=0).stop 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.800+0000 7f25d7d82740 1 -- 172.21.15.81:0/1567398321 shutdown_connections 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.800+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1567398321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c0dd40 0x55bce2c10130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.800+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1567398321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c03480 0x55bce2c0d800 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.800+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1567398321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c02b60 0x55bce2c02f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.800+0000 7f25d7d82740 1 -- 172.21.15.81:0/1567398321 >> 172.21.15.81:0/1567398321 conn(0x55bce2bff0f0 msgr2=0x55bce2bff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.800+0000 7f25d7d82740 1 -- 172.21.15.81:0/1567398321 shutdown_connections 2024-09-12T01:38:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.800+0000 7f25d7d82740 1 -- 172.21.15.81:0/1567398321 wait complete. 2024-09-12T01:38:13.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.801+0000 7f25d7d82740 1 -- start start 2024-09-12T01:38:13.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.801+0000 7f25d7d82740 1 Processor -- start 2024-09-12T01:38:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.801+0000 7f25d7d82740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c02b60 0x55bce2c0aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.801+0000 7f25d7d82740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c03480 0x55bce2c0b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.801+0000 7f25d7d82740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c0dd40 0x55bce2c0b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.801+0000 7f25d7d82740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bce2c10910 con 0x55bce2c02b60 2024-09-12T01:38:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.801+0000 7f25d7d82740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55bce2b22f10 con 0x55bce2c03480 2024-09-12T01:38:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.801+0000 7f25d7d82740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bce2c10a90 con 0x55bce2c0dd40 2024-09-12T01:38:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.801+0000 7f25d7d82740 10 client.0 _ll_register_callbacks cb 0x55bce2aeba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c02b60 0x55bce2c0aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25ceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c02b60 0x55bce2c0aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51226/0 (socket says 172.21.15.81:51226) 2024-09-12T01:38:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25ceffd640 1 -- 172.21.15.81:0/1698886977 learned_addr learned my addr 172.21.15.81:0/1698886977 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c03480 0x55bce2c0b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c0dd40 0x55bce2c0b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25ceffd640 1 -- 172.21.15.81:0/1698886977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c0dd40 msgr2=0x55bce2c0b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25ceffd640 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c0dd40 0x55bce2c0b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25ceffd640 1 -- 172.21.15.81:0/1698886977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c03480 msgr2=0x55bce2c0b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25ceffd640 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c03480 0x55bce2c0b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25ceffd640 1 -- 172.21.15.81:0/1698886977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce28d96a0 con 0x55bce2c02b60 2024-09-12T01:38:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c0dd40 0x55bce2c0b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c03480 0x55bce2c0b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25ceffd640 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c02b60 0x55bce2c0aba0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f25c0010470 tx=0x7f25c0005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa36429df7c8d775 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:13.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25aeffd640 1 -- 172.21.15.81:0/1698886977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c001d050 con 0x55bce2c02b60 2024-09-12T01:38:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25aeffd640 1 -- 172.21.15.81:0/1698886977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f25c0018810 con 0x55bce2c02b60 2024-09-12T01:38:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25d7d82740 1 -- 172.21.15.81:0/1698886977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25c0018b20 con 0x55bce2c02b60 2024-09-12T01:38:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25aeffd640 1 -- 172.21.15.81:0/1698886977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f25c0031050 con 0x55bce2c02b60 2024-09-12T01:38:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25d7d82740 10 client.17733 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.802+0000 7f25d7d82740 1 -- 172.21.15.81:0/1698886977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bce2c1c4d0 con 0x55bce2c02b60 2024-09-12T01:38:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.803+0000 7f25aeffd640 1 -- 172.21.15.81:0/1698886977 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25c0018b20 con 0x55bce2c02b60 2024-09-12T01:38:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.803+0000 7f25aeffd640 1 -- 172.21.15.81:0/1698886977 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f25c00046c0 con 0x55bce2c02b60 2024-09-12T01:38:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.803+0000 7f25d7d82740 10 client.17733 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.803+0000 7f25d7d82740 10 client.17733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:38:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.803+0000 7f25d7d82740 20 client.17733 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.803+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bce2c1d930 0x55bce2c1fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.803+0000 7f25d7d82740 4 client.17733 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.803+0000 7f25d7d82740 1 -- 172.21.15.81:0/1698886977 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bce2b757f0 con 0x55bce2c1d930 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.803+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bce2c1d930 0x55bce2c1fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.804+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bce2c1d930 0x55bce2c1fd20 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7891fa378d73d56 server_cookie=e5b60e6d1005b045 in_seq=0 out_seq=0 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.804+0000 7f25aeffd640 10 client.17733 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.804+0000 7f25aeffd640 1 -- 172.21.15.81:0/1698886977 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bce2b757f0 con 0x55bce2c1d930 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.804+0000 7f25aeffd640 10 client.17733 handle_command_reply: tid=0 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.805+0000 7f25d7d82740 1 client.17733 shutdown 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.805+0000 7f25d7d82740 1 -- 172.21.15.81:0/1698886977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c02b60 msgr2=0x55bce2c0aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.805+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c02b60 0x55bce2c0aba0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f25c0010470 tx=0x7f25c0005e30 comp rx=0 tx=0).stop 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.805+0000 7f25d7d82740 1 -- 172.21.15.81:0/1698886977 shutdown_connections 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.805+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bce2c1d930 0x55bce2c1fd20 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.805+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c0dd40 0x55bce2c0b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.805+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c03480 0x55bce2c0b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.805+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1698886977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c02b60 0x55bce2c0aba0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.805+0000 7f25d7d82740 1 -- 172.21.15.81:0/1698886977 >> 172.21.15.81:0/1698886977 conn(0x55bce2bff0f0 msgr2=0x55bce2c04dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.805+0000 7f25aeffd640 0 client.17733 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.805+0000 7f25d7d82740 1 -- 172.21.15.81:0/1698886977 shutdown_connections 2024-09-12T01:38:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.805+0000 7f25d7d82740 1 -- 172.21.15.81:0/1698886977 wait complete. 2024-09-12T01:38:13.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.805+0000 7f25d7d82740 20 client.17733 trim_cache size 0 max 16384 2024-09-12T01:38:13.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.838+0000 7f25d7d82740 1 Processor -- start 2024-09-12T01:38:13.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.838+0000 7f25d7d82740 1 -- start start 2024-09-12T01:38:13.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.838+0000 7f25d7d82740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c02b60 0x55bce2bfe160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.838+0000 7f25d7d82740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c03480 0x55bce2c25380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.838+0000 7f25d7d82740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 0x55bce2c258c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.838+0000 7f25d7d82740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25d01afa90 con 0x55bce2c0dd40 2024-09-12T01:38:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.838+0000 7f25d7d82740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f25d01b15d0 con 0x55bce2c02b60 2024-09-12T01:38:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.838+0000 7f25d7d82740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f25d01b0160 con 0x55bce2c03480 2024-09-12T01:38:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25cf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 0x55bce2c258c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25cf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 0x55bce2c258c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51236/0 (socket says 172.21.15.81:51236) 2024-09-12T01:38:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25cf7fe640 1 -- 172.21.15.81:0/1779368668 learned_addr learned my addr 172.21.15.81:0/1779368668 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25ceffd640 1 --2- 172.21.15.81:0/1779368668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c02b60 0x55bce2bfe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25cf7fe640 1 -- 172.21.15.81:0/1779368668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c03480 msgr2=0x55bce2c25380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/1779368668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c03480 0x55bce2c25380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/1779368668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c03480 0x55bce2c25380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25cf7fe640 1 -- 172.21.15.81:0/1779368668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c02b60 msgr2=0x55bce2bfe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/1779368668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c02b60 0x55bce2bfe160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25cf7fe640 1 -- 172.21.15.81:0/1779368668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce2bfef20 con 0x55bce2c0dd40 2024-09-12T01:38:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/1779368668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c03480 0x55bce2c25380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/1779368668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 0x55bce2c258c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f25c80eda50 tx=0x7f25c8004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d20e3a5603dbb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25b57fa640 1 -- 172.21.15.81:0/1779368668 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c802c040 con 0x55bce2c0dd40 2024-09-12T01:38:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25b57fa640 1 -- 172.21.15.81:0/1779368668 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25c80098d0 con 0x55bce2c0dd40 2024-09-12T01:38:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.839+0000 7f25b57fa640 1 -- 172.21.15.81:0/1779368668 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c80edb60 con 0x55bce2c0dd40 2024-09-12T01:38:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.840+0000 7f25d7d82740 1 -- 172.21.15.81:0/1779368668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 msgr2=0x55bce2c258c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.840+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1779368668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 0x55bce2c258c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f25c80eda50 tx=0x7f25c8004360 comp rx=0 tx=0).stop 2024-09-12T01:38:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.840+0000 7f25d7d82740 1 -- 172.21.15.81:0/1779368668 shutdown_connections 2024-09-12T01:38:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.840+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1779368668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 0x55bce2c258c0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.840+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1779368668 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c03480 0x55bce2c25380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.840+0000 7f25d7d82740 1 --2- 172.21.15.81:0/1779368668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c02b60 0x55bce2bfe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.840+0000 7f25d7d82740 1 -- 172.21.15.81:0/1779368668 >> 172.21.15.81:0/1779368668 conn(0x55bce2bff0f0 msgr2=0x55bce2bfda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.840+0000 7f25d7d82740 1 -- 172.21.15.81:0/1779368668 shutdown_connections 2024-09-12T01:38:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.840+0000 7f25d7d82740 1 -- 172.21.15.81:0/1779368668 wait complete. 2024-09-12T01:38:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.840+0000 7f25d7d82740 1 -- start start 2024-09-12T01:38:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.841+0000 7f25d7d82740 1 Processor -- start 2024-09-12T01:38:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.841+0000 7f25d7d82740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c02b60 0x55bce2c0ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.841+0000 7f25d7d82740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c03480 0x55bce2c0f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.841+0000 7f25d7d82740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 0x55bce2c0f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.841+0000 7f25d7d82740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25d01b0f00 con 0x55bce2c0dd40 2024-09-12T01:38:13.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.841+0000 7f25d7d82740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f25d01b0830 con 0x55bce2c02b60 2024-09-12T01:38:13.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.841+0000 7f25d7d82740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f25d01ada90 con 0x55bce2c03480 2024-09-12T01:38:13.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.841+0000 7f25d7d82740 10 client.0 _ll_register_callbacks cb 0x7f25c001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:13.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.841+0000 7f25cf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 0x55bce2c0f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.841+0000 7f25ceffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c02b60 0x55bce2c0ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.841+0000 7f25cf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 0x55bce2c0f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51250/0 (socket says 172.21.15.81:51250) 2024-09-12T01:38:13.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.841+0000 7f25cf7fe640 1 -- 172.21.15.81:0/2526893478 learned_addr learned my addr 172.21.15.81:0/2526893478 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:13.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.841+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/2526893478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c03480 0x55bce2c0f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25cf7fe640 1 -- 172.21.15.81:0/2526893478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c03480 msgr2=0x55bce2c0f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:13.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/2526893478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c03480 0x55bce2c0f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25cf7fe640 1 -- 172.21.15.81:0/2526893478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c02b60 msgr2=0x55bce2c0ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:13.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/2526893478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c02b60 0x55bce2c0ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25cf7fe640 1 -- 172.21.15.81:0/2526893478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce2c141e0 con 0x55bce2c0dd40 2024-09-12T01:38:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25ce7fc640 1 --2- 172.21.15.81:0/2526893478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c03480 0x55bce2c0f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/2526893478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 0x55bce2c0f900 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f25c8006010 tx=0x7f25c80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db92c22f91e63e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25aeffd640 1 -- 172.21.15.81:0/2526893478 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c80d4070 con 0x55bce2c0dd40 2024-09-12T01:38:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25aeffd640 1 -- 172.21.15.81:0/2526893478 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f25c80c4fa0 con 0x55bce2c0dd40 2024-09-12T01:38:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25d7d82740 1 -- 172.21.15.81:0/2526893478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bce2b6fd00 con 0x55bce2c0dd40 2024-09-12T01:38:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25aeffd640 1 -- 172.21.15.81:0/2526893478 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f25c802c040 con 0x55bce2c0dd40 2024-09-12T01:38:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25d7d82740 10 client.17739 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25d7d82740 1 -- 172.21.15.81:0/2526893478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bce2c885c0 con 0x55bce2c0dd40 2024-09-12T01:38:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.842+0000 7f25aeffd640 1 -- 172.21.15.81:0/2526893478 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55bce2b6fd00 con 0x55bce2c0dd40 2024-09-12T01:38:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.843+0000 7f25aeffd640 1 -- 172.21.15.81:0/2526893478 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f25c80d0ce0 con 0x55bce2c0dd40 2024-09-12T01:38:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.843+0000 7f25d7d82740 10 client.17739 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.843+0000 7f25d7d82740 10 client.17739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.843+0000 7f25d7d82740 20 client.17739 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.843+0000 7f25d7d82740 1 --2- 172.21.15.81:0/2526893478 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bce2c88a60 0x55bce2c8ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.843+0000 7f25d7d82740 4 client.17739 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.843+0000 7f25d7d82740 1 -- 172.21.15.81:0/2526893478 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bce2aec110 con 0x55bce2c88a60 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.843+0000 7f25ceffd640 1 --2- 172.21.15.81:0/2526893478 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bce2c88a60 0x55bce2c8ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.843+0000 7f25ceffd640 1 --2- 172.21.15.81:0/2526893478 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bce2c88a60 0x55bce2c8ae50 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21d5050649262bbc server_cookie=7a72d85ca9ebe7bb in_seq=0 out_seq=0 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.843+0000 7f25aeffd640 10 client.17739 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.844+0000 7f25aeffd640 1 -- 172.21.15.81:0/2526893478 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bce2aec110 con 0x55bce2c88a60 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.844+0000 7f25aeffd640 10 client.17739 handle_command_reply: tid=0 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.844+0000 7f25d7d82740 1 client.17739 shutdown 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.845+0000 7f25d7d82740 1 -- 172.21.15.81:0/2526893478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 msgr2=0x55bce2c0f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.845+0000 7f25d7d82740 1 --2- 172.21.15.81:0/2526893478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 0x55bce2c0f900 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f25c8006010 tx=0x7f25c80095c0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.845+0000 7f25d7d82740 1 -- 172.21.15.81:0/2526893478 shutdown_connections 2024-09-12T01:38:13.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.845+0000 7f25d7d82740 1 --2- 172.21.15.81:0/2526893478 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x55bce2c88a60 0x55bce2c8ae50 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.845+0000 7f25d7d82740 1 --2- 172.21.15.81:0/2526893478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bce2c0dd40 0x55bce2c0f900 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.845+0000 7f25d7d82740 1 --2- 172.21.15.81:0/2526893478 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bce2c03480 0x55bce2c0f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.845+0000 7f25aeffd640 0 client.17739 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:13.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.845+0000 7f25d7d82740 1 --2- 172.21.15.81:0/2526893478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bce2c02b60 0x55bce2c0ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.845+0000 7f25d7d82740 1 -- 172.21.15.81:0/2526893478 >> 172.21.15.81:0/2526893478 conn(0x55bce2bff0f0 msgr2=0x55bce2bfe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:13.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.845+0000 7f25d7d82740 1 -- 172.21.15.81:0/2526893478 shutdown_connections 2024-09-12T01:38:13.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.845+0000 7f25d7d82740 1 -- 172.21.15.81:0/2526893478 wait complete. 2024-09-12T01:38:13.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.845+0000 7f25d7d82740 20 client.17739 trim_cache size 0 max 16384 2024-09-12T01:38:13.851 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:38:13.852 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-12T01:38:13.852 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "b13c0fe8-2a35-4d46-a989-560689e0335a", 2024-09-12T01:38:13.852 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-12T01:38:13.852 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:38:13.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.846+0000 7f25d59a9640 1 -- 172.21.15.81:0/3397861695 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f25b80a2d70 msgr2=0x7f25b80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.846+0000 7f25d59a9640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f25b80a2d70 0x7f25b80a5230 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55bce2c00470 tx=0x7f25c400b360 comp rx=0 tx=0).stop 2024-09-12T01:38:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.846+0000 7f25d59a9640 1 -- 172.21.15.81:0/3397861695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d010c170 msgr2=0x7f25d0101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.846+0000 7f25d59a9640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d010c170 0x7f25d0101420 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f25c802ae70 tx=0x7f25c802f5b0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.846+0000 7f25d59a9640 1 -- 172.21.15.81:0/3397861695 shutdown_connections 2024-09-12T01:38:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.846+0000 7f25d59a9640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f25b80a2d70 0x7f25b80a5230 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.846+0000 7f25d59a9640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d010c170 0x7f25d0101420 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.846+0000 7f25d59a9640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25d0103660 0x7f25d0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.846+0000 7f25d59a9640 1 --2- 172.21.15.81:0/3397861695 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f25d0102d40 0x7f25d01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.846+0000 7f25d59a9640 1 -- 172.21.15.81:0/3397861695 >> 172.21.15.81:0/3397861695 conn(0x7f25d00fc7a0 msgr2=0x7f25d00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.846+0000 7f25d59a9640 1 -- 172.21.15.81:0/3397861695 shutdown_connections 2024-09-12T01:38:13.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.846+0000 7f25d59a9640 1 -- 172.21.15.81:0/3397861695 wait complete. 2024-09-12T01:38:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.918+0000 7f2bdb342640 1 -- 172.21.15.81:0/3981110657 --> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f2bd40fe400 con 0x7f2bc00a2e20 2024-09-12T01:38:13.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.925+0000 7f2bc67fc640 1 -- 172.21.15.81:0/3981110657 <== mgr.15222 v2:172.21.15.81:6800/1379528564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f2bd40fe400 con 0x7f2bc00a2e20 2024-09-12T01:38:13.925 INFO:teuthology.orchestra.run.smithi081.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T01:28:12", "first": "2024-09-12T01:29:00", "last": "2024-09-12T01:38:00", "last_pruned": "2024-09-12T01:38:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-12T01:38:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.928+0000 7f2bdb342640 1 -- 172.21.15.81:0/3981110657 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2bc00a2e20 msgr2=0x7f2bc00a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.928+0000 7f2bdb342640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2bc00a2e20 0x7f2bc00a52e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8005d00 tx=0x7f2bc800b410 comp rx=0 tx=0).stop 2024-09-12T01:38:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.928+0000 7f2bdb342640 1 -- 172.21.15.81:0/3981110657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bd4107b70 msgr2=0x7f2bd419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.928+0000 7f2bdb342640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bd4107b70 0x7f2bd419ccd0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00b970 tx=0x7f2bcc00be30 comp rx=0 tx=0).stop 2024-09-12T01:38:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.928+0000 7f2bdb342640 1 -- 172.21.15.81:0/3981110657 shutdown_connections 2024-09-12T01:38:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.928+0000 7f2bdb342640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f2bc00a2e20 0x7f2bc00a52e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.928+0000 7f2bdb342640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bd4107b70 0x7f2bd419ccd0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.928+0000 7f2bdb342640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bd4102470 0x7f2bd4198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.928+0000 7f2bdb342640 1 --2- 172.21.15.81:0/3981110657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2bd4101ad0 0x7f2bd4198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.928+0000 7f2bdb342640 1 -- 172.21.15.81:0/3981110657 >> 172.21.15.81:0/3981110657 conn(0x7f2bd40fd7d0 msgr2=0x7f2bd40fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.928+0000 7f2bdb342640 1 -- 172.21.15.81:0/3981110657 shutdown_connections 2024-09-12T01:38:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:13.928+0000 7f2bdb342640 1 -- 172.21.15.81:0/3981110657 wait complete. 2024-09-12T01:38:13.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T01:38:14.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:13 smithi100 ceph-mon[35275]: pgmap v314: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:38:14.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:13 smithi189 ceph-mon[35357]: pgmap v314: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:38:14.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.041+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1063434450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd01069e0 msgr2=0x7f9fd0106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:14.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.041+0000 7f9fd4d6d640 1 --2- 172.21.15.81:0/1063434450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd01069e0 0x7f9fd0106dc0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009930 tx=0x7f9fc402a420 comp rx=0 tx=0).stop 2024-09-12T01:38:14.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.041+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1063434450 shutdown_connections 2024-09-12T01:38:14.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.041+0000 7f9fd4d6d640 1 --2- 172.21.15.81:0/1063434450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd0101370 0x7f9fd010d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.041+0000 7f9fd4d6d640 1 --2- 172.21.15.81:0/1063434450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fd01009d0 0x7f9fd0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.041+0000 7f9fd4d6d640 1 --2- 172.21.15.81:0/1063434450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd01069e0 0x7f9fd0106dc0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.041+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1063434450 >> 172.21.15.81:0/1063434450 conn(0x7f9fd00fc6f0 msgr2=0x7f9fd00feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:14.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.041+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1063434450 shutdown_connections 2024-09-12T01:38:14.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.041+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1063434450 wait complete. 2024-09-12T01:38:14.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.042+0000 7f9fd4d6d640 1 Processor -- start 2024-09-12T01:38:14.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.042+0000 7f9fd4d6d640 1 -- start start 2024-09-12T01:38:14.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.042+0000 7f9fd4d6d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fd01009d0 0x7f9fd01982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:14.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.042+0000 7f9fd4d6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd0101370 0x7f9fd01987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:14.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.042+0000 7f9fd4d6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd01069e0 0x7f9fd019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.042+0000 7f9fd4d6d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0110de0 con 0x7f9fd01069e0 2024-09-12T01:38:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.042+0000 7f9fd4d6d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0110c60 con 0x7f9fd0101370 2024-09-12T01:38:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.042+0000 7f9fd4d6d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0110f60 con 0x7f9fd01009d0 2024-09-12T01:38:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.042+0000 7f9fced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd01069e0 0x7f9fd019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.042+0000 7f9fced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd01069e0 0x7f9fd019cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51264/0 (socket says 172.21.15.81:51264) 2024-09-12T01:38:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.042+0000 7f9fced9d640 1 -- 172.21.15.81:0/1534027698 learned_addr learned my addr 172.21.15.81:0/1534027698 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.042+0000 7f9fcdd9b640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd0101370 0x7f9fd01987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.042+0000 7f9fce59c640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fd01009d0 0x7f9fd01982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.043+0000 7f9fced9d640 1 -- 172.21.15.81:0/1534027698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fd01009d0 msgr2=0x7f9fd01982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.043+0000 7f9fced9d640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fd01009d0 0x7f9fd01982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.043+0000 7f9fced9d640 1 -- 172.21.15.81:0/1534027698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd0101370 msgr2=0x7f9fd01987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.043+0000 7f9fced9d640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd0101370 0x7f9fd01987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.043+0000 7f9fced9d640 1 -- 172.21.15.81:0/1534027698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd019d2a0 con 0x7f9fd01069e0 2024-09-12T01:38:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.043+0000 7f9fced9d640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd01069e0 0x7f9fd019cb70 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800eaa0 tx=0x7f9fc800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.043+0000 7f9fbf7fe640 1 -- 172.21.15.81:0/1534027698 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8004d20 con 0x7f9fd01069e0 2024-09-12T01:38:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.043+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1534027698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd019d590 con 0x7f9fd01069e0 2024-09-12T01:38:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.043+0000 7f9fbf7fe640 1 -- 172.21.15.81:0/1534027698 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fc8005020 con 0x7f9fd01069e0 2024-09-12T01:38:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.043+0000 7f9fbf7fe640 1 -- 172.21.15.81:0/1534027698 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80116d0 con 0x7f9fd01069e0 2024-09-12T01:38:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.043+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1534027698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd01a4e20 con 0x7f9fd01069e0 2024-09-12T01:38:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.044+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1534027698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd0100e30 con 0x7f9fd01069e0 2024-09-12T01:38:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.045+0000 7f9fbf7fe640 1 -- 172.21.15.81:0/1534027698 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9fc80051d0 con 0x7f9fd01069e0 2024-09-12T01:38:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.046+0000 7f9fbf7fe640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9fb80a2da0 0x7f9fb80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.046+0000 7f9fce59c640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9fb80a2da0 0x7f9fb80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.046+0000 7f9fbf7fe640 1 -- 172.21.15.81:0/1534027698 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f9fc80cf580 con 0x7f9fd01069e0 2024-09-12T01:38:14.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.046+0000 7f9fce59c640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9fb80a2da0 0x7f9fb80a5260 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009900 tx=0x7f9fc40058d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:14.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.050+0000 7f9fbf7fe640 1 -- 172.21.15.81:0/1534027698 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9fc8016030 con 0x7f9fd01069e0 2024-09-12T01:38:14.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.239+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1534027698 --> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f9fd0062630 con 0x7f9fb80a2da0 2024-09-12T01:38:14.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.246+0000 7f9fbf7fe640 1 -- 172.21.15.81:0/1534027698 <== mgr.15222 v2:172.21.15.81:6800/1379528564 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f9fd0062630 con 0x7f9fb80a2da0 2024-09-12T01:38:14.246 INFO:teuthology.orchestra.run.smithi081.stdout:/ 1m 6m3h 2024-09-12T01:38:14.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.248+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1534027698 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9fb80a2da0 msgr2=0x7f9fb80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:14.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.248+0000 7f9fd4d6d640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9fb80a2da0 0x7f9fb80a5260 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009900 tx=0x7f9fc40058d0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.248+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1534027698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd01069e0 msgr2=0x7f9fd019cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:14.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.248+0000 7f9fd4d6d640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd01069e0 0x7f9fd019cb70 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800eaa0 tx=0x7f9fc800eea0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.248+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1534027698 shutdown_connections 2024-09-12T01:38:14.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.248+0000 7f9fd4d6d640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f9fb80a2da0 0x7f9fb80a5260 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.248+0000 7f9fd4d6d640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fd01069e0 0x7f9fd019cb70 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.248+0000 7f9fd4d6d640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fd0101370 0x7f9fd01987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.248+0000 7f9fd4d6d640 1 --2- 172.21.15.81:0/1534027698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fd01009d0 0x7f9fd01982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.248+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1534027698 >> 172.21.15.81:0/1534027698 conn(0x7f9fd00fc6f0 msgr2=0x7f9fd006a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:14.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.248+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1534027698 shutdown_connections 2024-09-12T01:38:14.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:14.248+0000 7f9fd4d6d640 1 -- 172.21.15.81:0/1534027698 wait complete. 2024-09-12T01:38:14.259 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-12T01:38:15.363 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-12T01:38:15.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:38:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:15.976 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:15 smithi081 ceph-mon[30920]: scrub queued for path: / 2024-09-12T01:38:15.976 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:15 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:38:15.976 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:15 smithi081 ceph-mon[30920]: scrub summary: active paths [/] 2024-09-12T01:38:15.976 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:15 smithi081 ceph-mon[30920]: scrub summary: idle+waiting paths [/] 2024-09-12T01:38:15.976 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:15 smithi081 ceph-mon[30920]: pgmap v315: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:38:15.976 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:15 smithi081 ceph-mon[30920]: from='client.17721 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:38:15.977 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:15 smithi081 ceph-mon[30920]: from='client.17745 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:38:15.977 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:15 smithi081 ceph-mon[30920]: scrub summary: idle 2024-09-12T01:38:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:15 smithi100 ceph-mon[35275]: scrub queued for path: / 2024-09-12T01:38:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:15 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:38:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:15 smithi100 ceph-mon[35275]: scrub summary: active paths [/] 2024-09-12T01:38:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:15 smithi100 ceph-mon[35275]: scrub summary: idle+waiting paths [/] 2024-09-12T01:38:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:15 smithi100 ceph-mon[35275]: pgmap v315: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:38:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:15 smithi100 ceph-mon[35275]: from='client.17721 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:38:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:15 smithi100 ceph-mon[35275]: from='client.17745 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:38:16.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:15 smithi100 ceph-mon[35275]: scrub summary: idle 2024-09-12T01:38:16.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:15 smithi189 ceph-mon[35357]: scrub queued for path: / 2024-09-12T01:38:16.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:15 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:38:16.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:15 smithi189 ceph-mon[35357]: scrub summary: active paths [/] 2024-09-12T01:38:16.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:15 smithi189 ceph-mon[35357]: scrub summary: idle+waiting paths [/] 2024-09-12T01:38:16.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:15 smithi189 ceph-mon[35357]: pgmap v315: 97 pgs: 97 active+clean; 2.0 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T01:38:16.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:15 smithi189 ceph-mon[35357]: from='client.17721 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:38:16.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:15 smithi189 ceph-mon[35357]: from='client.17745 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:38:16.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:15 smithi189 ceph-mon[35357]: scrub summary: idle 2024-09-12T01:38:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.057+0000 7f99b52c5640 1 -- 172.21.15.81:0/4166751144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0101de0 msgr2=0x7f99b01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.057+0000 7f99b52c5640 1 --2- 172.21.15.81:0/4166751144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0101de0 0x7f99b01021c0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009900 tx=0x7f99a402a410 comp rx=0 tx=0).stop 2024-09-12T01:38:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.057+0000 7f99b52c5640 1 -- 172.21.15.81:0/4166751144 shutdown_connections 2024-09-12T01:38:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.057+0000 7f99b52c5640 1 --2- 172.21.15.81:0/4166751144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99b0106f10 0x7f99b010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.057+0000 7f99b52c5640 1 --2- 172.21.15.81:0/4166751144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99b0102790 0x7f99b01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.057+0000 7f99b52c5640 1 --2- 172.21.15.81:0/4166751144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0101de0 0x7f99b01021c0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.057+0000 7f99b52c5640 1 -- 172.21.15.81:0/4166751144 >> 172.21.15.81:0/4166751144 conn(0x7f99b00fd8c0 msgr2=0x7f99b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.057+0000 7f99b52c5640 1 -- 172.21.15.81:0/4166751144 shutdown_connections 2024-09-12T01:38:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.057+0000 7f99b52c5640 1 -- 172.21.15.81:0/4166751144 wait complete. 2024-09-12T01:38:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.057+0000 7f99b52c5640 1 Processor -- start 2024-09-12T01:38:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.057+0000 7f99b52c5640 1 -- start start 2024-09-12T01:38:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99b52c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0101de0 0x7f99b01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99b52c5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99b0102790 0x7f99b0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99b52c5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99b0106f10 0x7f99b019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99b52c5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f99b0112010 con 0x7f99b0101de0 2024-09-12T01:38:16.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99b52c5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f99b0111e90 con 0x7f99b0106f10 2024-09-12T01:38:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99b52c5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99b0112190 con 0x7f99b0102790 2024-09-12T01:38:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99aeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0101de0 0x7f99b01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99aeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0101de0 0x7f99b01985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51276/0 (socket says 172.21.15.81:51276) 2024-09-12T01:38:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99aeffd640 1 -- 172.21.15.81:0/1243303142 learned_addr learned my addr 172.21.15.81:0/1243303142 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99ae7fc640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99b0102790 0x7f99b0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99af7fe640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99b0106f10 0x7f99b019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99aeffd640 1 -- 172.21.15.81:0/1243303142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99b0102790 msgr2=0x7f99b0198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99aeffd640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99b0102790 0x7f99b0198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99aeffd640 1 -- 172.21.15.81:0/1243303142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99b0106f10 msgr2=0x7f99b019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99aeffd640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99b0106f10 0x7f99b019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99aeffd640 1 -- 172.21.15.81:0/1243303142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b019d560 con 0x7f99b0101de0 2024-09-12T01:38:16.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99ae7fc640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99b0102790 0x7f99b0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:16.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99aeffd640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0101de0 0x7f99b01985b0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f99a4005ab0 tx=0x7f99a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:16.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f9997fff640 1 -- 172.21.15.81:0/1243303142 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a403f030 con 0x7f99b0101de0 2024-09-12T01:38:16.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f9997fff640 1 -- 172.21.15.81:0/1243303142 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99a4003ce0 con 0x7f99b0101de0 2024-09-12T01:38:16.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.058+0000 7f99b52c5640 1 -- 172.21.15.81:0/1243303142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b019d7f0 con 0x7f99b0101de0 2024-09-12T01:38:16.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.059+0000 7f9997fff640 1 -- 172.21.15.81:0/1243303142 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4035070 con 0x7f99b0101de0 2024-09-12T01:38:16.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.059+0000 7f99b52c5640 1 -- 172.21.15.81:0/1243303142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b01a5130 con 0x7f99b0101de0 2024-09-12T01:38:16.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.061+0000 7f9997fff640 1 -- 172.21.15.81:0/1243303142 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f99a4042030 con 0x7f99b0101de0 2024-09-12T01:38:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.061+0000 7f99b769e740 1 Processor -- start 2024-09-12T01:38:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.061+0000 7f99b769e740 1 -- start start 2024-09-12T01:38:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.061+0000 7f99b769e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e438760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.061+0000 7f99b769e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e447550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.061+0000 7f9997fff640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f99980a2cf0 0x7f99980a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.061+0000 7f99b769e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e447a90 0x563c8e449e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.061+0000 7f99b769e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c8e39e2e0 con 0x563c8e438380 2024-09-12T01:38:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.061+0000 7f99b769e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563c8e345ce0 con 0x563c8e447a90 2024-09-12T01:38:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.061+0000 7f99b769e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563c8e39a2a0 con 0x563c8e438ca0 2024-09-12T01:38:16.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e438760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e438760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51288/0 (socket says 172.21.15.81:51288) 2024-09-12T01:38:16.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99af7fe640 1 -- 172.21.15.81:0/2790934722 learned_addr learned my addr 172.21.15.81:0/2790934722 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:16.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99aeffd640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f99980a2cf0 0x7f99980a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f9997fff640 1 -- 172.21.15.81:0/1243303142 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f99a40efe70 con 0x7f99b0101de0 2024-09-12T01:38:16.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99ae7fc640 1 --2- 172.21.15.81:0/2790934722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e447550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99af7fe640 1 --2- 172.21.15.81:0/2790934722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e447a90 0x563c8e449e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99af7fe640 1 -- 172.21.15.81:0/2790934722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 msgr2=0x563c8e447550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99af7fe640 1 --2- 172.21.15.81:0/2790934722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e447550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99af7fe640 1 -- 172.21.15.81:0/2790934722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e447a90 msgr2=0x563c8e449e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99af7fe640 1 --2- 172.21.15.81:0/2790934722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e447a90 0x563c8e449e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99af7fe640 1 -- 172.21.15.81:0/2790934722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c8e32a440 con 0x563c8e438380 2024-09-12T01:38:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99af7fe640 1 --2- 172.21.15.81:0/2790934722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e438760 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f99a8006aa0 tx=0x7f99a800b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9406b58e3c93b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99aeffd640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f99980a2cf0 0x7f99980a51b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f99a40bc2a0 tx=0x7f99a40b17a0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99957fa640 1 -- 172.21.15.81:0/2790934722 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a80173f0 con 0x563c8e438380 2024-09-12T01:38:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99957fa640 1 -- 172.21.15.81:0/2790934722 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99a8010040 con 0x563c8e438380 2024-09-12T01:38:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.062+0000 7f99957fa640 1 -- 172.21.15.81:0/2790934722 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a8016870 con 0x563c8e438380 2024-09-12T01:38:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.063+0000 7f99b769e740 1 -- 172.21.15.81:0/2790934722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 msgr2=0x563c8e438760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.063+0000 7f99b769e740 1 --2- 172.21.15.81:0/2790934722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e438760 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f99a8006aa0 tx=0x7f99a800b3e0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.063+0000 7f99b769e740 1 -- 172.21.15.81:0/2790934722 shutdown_connections 2024-09-12T01:38:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.063+0000 7f99b769e740 1 --2- 172.21.15.81:0/2790934722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e447a90 0x563c8e449e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.063+0000 7f99b769e740 1 --2- 172.21.15.81:0/2790934722 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e447550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.063+0000 7f99b769e740 1 --2- 172.21.15.81:0/2790934722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e438760 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.063+0000 7f99b769e740 1 -- 172.21.15.81:0/2790934722 >> 172.21.15.81:0/2790934722 conn(0x563c8e434a30 msgr2=0x563c8e434e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.063+0000 7f99b769e740 1 -- 172.21.15.81:0/2790934722 shutdown_connections 2024-09-12T01:38:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.063+0000 7f99b769e740 1 -- 172.21.15.81:0/2790934722 wait complete. 2024-09-12T01:38:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.063+0000 7f99b769e740 1 -- start start 2024-09-12T01:38:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.063+0000 7f99b769e740 1 Processor -- start 2024-09-12T01:38:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99b769e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e438380 0x563c8e4473d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99b769e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e444680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99b769e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e447a90 0x563c8e444bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99b769e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c8e44a660 con 0x563c8e447a90 2024-09-12T01:38:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99b769e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563c8e359050 con 0x563c8e438380 2024-09-12T01:38:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99b769e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563c8e44a7e0 con 0x563c8e438ca0 2024-09-12T01:38:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99b769e740 10 client.0 _ll_register_callbacks cb 0x563c8e399160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e447a90 0x563c8e444bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e447a90 0x563c8e444bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51302/0 (socket says 172.21.15.81:51302) 2024-09-12T01:38:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99af7fe640 1 -- 172.21.15.81:0/3238481915 learned_addr learned my addr 172.21.15.81:0/3238481915 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99af7fe640 1 --2- 172.21.15.81:0/3238481915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e438380 0x563c8e4473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99ae7fc640 1 --2- 172.21.15.81:0/3238481915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e444680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99af7fe640 1 -- 172.21.15.81:0/3238481915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 msgr2=0x563c8e444680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99af7fe640 1 --2- 172.21.15.81:0/3238481915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e444680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99af7fe640 1 -- 172.21.15.81:0/3238481915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e438380 msgr2=0x563c8e4473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99af7fe640 1 --2- 172.21.15.81:0/3238481915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e438380 0x563c8e4473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99af7fe640 1 -- 172.21.15.81:0/3238481915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c8e10f3c0 con 0x563c8e447a90 2024-09-12T01:38:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f99af7fe640 1 --2- 172.21.15.81:0/3238481915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e447a90 0x563c8e444bc0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f99a8006a70 tx=0x7f99a80164b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d43812d20d6bc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:16.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f9992ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:16.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.064+0000 7f9992ff5640 1 -- 172.21.15.81:0/3238481915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a802a020 con 0x563c8e447a90 2024-09-12T01:38:16.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f9992ff5640 1 -- 172.21.15.81:0/3238481915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f99a80175f0 con 0x563c8e447a90 2024-09-12T01:38:16.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f99b769e740 1 -- 172.21.15.81:0/3238481915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99a8010040 con 0x563c8e447a90 2024-09-12T01:38:16.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f9992ff5640 1 -- 172.21.15.81:0/3238481915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f99a8035050 con 0x563c8e447a90 2024-09-12T01:38:16.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f99b769e740 10 client.17757 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:16.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f99b769e740 1 -- 172.21.15.81:0/3238481915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c8e456050 con 0x563c8e447a90 2024-09-12T01:38:16.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f9992ff5640 1 -- 172.21.15.81:0/3238481915 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99a8010040 con 0x563c8e447a90 2024-09-12T01:38:16.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f9992ff5640 1 -- 172.21.15.81:0/3238481915 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f99a8026900 con 0x563c8e447a90 2024-09-12T01:38:16.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f99b769e740 10 client.17757 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:16.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f99b769e740 10 client.17757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:38:16.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f99b769e740 20 client.17757 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:16.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f99b769e740 1 --2- 172.21.15.81:0/3238481915 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8e4574b0 0x563c8e4598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f99b769e740 4 client.17757 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:16.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f99b769e740 1 -- 172.21.15.81:0/3238481915 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c8e3ab850 con 0x563c8e4574b0 2024-09-12T01:38:16.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.065+0000 7f99ae7fc640 1 --2- 172.21.15.81:0/3238481915 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8e4574b0 0x563c8e4598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.066+0000 7f99ae7fc640 1 --2- 172.21.15.81:0/3238481915 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8e4574b0 0x563c8e4598a0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1276f147b3d9a9c2 server_cookie=cd83eac06945c071 in_seq=0 out_seq=0 2024-09-12T01:38:16.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.066+0000 7f9992ff5640 10 client.17757 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:16.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.066+0000 7f9992ff5640 1 -- 172.21.15.81:0/3238481915 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c8e3ab850 con 0x563c8e4574b0 2024-09-12T01:38:16.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.066+0000 7f9992ff5640 10 client.17757 handle_command_reply: tid=0 2024-09-12T01:38:16.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.067+0000 7f99b769e740 1 client.17757 shutdown 2024-09-12T01:38:16.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.067+0000 7f99b769e740 1 -- 172.21.15.81:0/3238481915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e447a90 msgr2=0x563c8e444bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.067+0000 7f99b769e740 1 --2- 172.21.15.81:0/3238481915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e447a90 0x563c8e444bc0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f99a8006a70 tx=0x7f99a80164b0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.067+0000 7f99b769e740 1 -- 172.21.15.81:0/3238481915 shutdown_connections 2024-09-12T01:38:16.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.067+0000 7f99b769e740 1 --2- 172.21.15.81:0/3238481915 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8e4574b0 0x563c8e4598a0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.067+0000 7f99b769e740 1 --2- 172.21.15.81:0/3238481915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e447a90 0x563c8e444bc0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.067+0000 7f9992ff5640 0 client.17757 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.067+0000 7f99b769e740 1 --2- 172.21.15.81:0/3238481915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e444680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.067+0000 7f99b769e740 1 --2- 172.21.15.81:0/3238481915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e438380 0x563c8e4473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.067+0000 7f99b769e740 1 -- 172.21.15.81:0/3238481915 >> 172.21.15.81:0/3238481915 conn(0x563c8e434a30 msgr2=0x563c8e43a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.067+0000 7f99b769e740 1 -- 172.21.15.81:0/3238481915 shutdown_connections 2024-09-12T01:38:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.067+0000 7f99b769e740 1 -- 172.21.15.81:0/3238481915 wait complete. 2024-09-12T01:38:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.067+0000 7f99b769e740 20 client.17757 trim_cache size 0 max 16384 2024-09-12T01:38:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.083+0000 7f99b769e740 1 Processor -- start 2024-09-12T01:38:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99b769e740 1 -- start start 2024-09-12T01:38:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99b769e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e453900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99b769e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e443660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99b769e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e447a90 0x563c8e45f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99b769e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f99b01ab800 con 0x563c8e438380 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99b769e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f99b01ad340 con 0x563c8e447a90 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99b769e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99b01abed0 con 0x563c8e438ca0 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e453900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e453900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51308/0 (socket says 172.21.15.81:51308) 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99af7fe640 1 -- 172.21.15.81:0/3306152533 learned_addr learned my addr 172.21.15.81:0/3306152533 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99af7fe640 1 -- 172.21.15.81:0/3306152533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 msgr2=0x563c8e443660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99af7fe640 1 --2- 172.21.15.81:0/3306152533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e443660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99af7fe640 1 -- 172.21.15.81:0/3306152533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e447a90 msgr2=0x563c8e45f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99af7fe640 1 --2- 172.21.15.81:0/3306152533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e447a90 0x563c8e45f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99af7fe640 1 -- 172.21.15.81:0/3306152533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c8e4344d0 con 0x563c8e438380 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f99af7fe640 1 --2- 172.21.15.81:0/3306152533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e453900 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f99a800b1f0 tx=0x7f99a8004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ab0b8118550b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:16.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f9994ff9640 1 -- 172.21.15.81:0/3306152533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a802a050 con 0x563c8e438380 2024-09-12T01:38:16.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f9994ff9640 1 -- 172.21.15.81:0/3306152533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99a800a020 con 0x563c8e438380 2024-09-12T01:38:16.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.084+0000 7f9994ff9640 1 -- 172.21.15.81:0/3306152533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a8025980 con 0x563c8e438380 2024-09-12T01:38:16.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.085+0000 7f99b769e740 1 -- 172.21.15.81:0/3306152533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 msgr2=0x563c8e453900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.085+0000 7f99b769e740 1 --2- 172.21.15.81:0/3306152533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e453900 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f99a800b1f0 tx=0x7f99a8004640 comp rx=0 tx=0).stop 2024-09-12T01:38:16.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.085+0000 7f99b769e740 1 -- 172.21.15.81:0/3306152533 shutdown_connections 2024-09-12T01:38:16.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.085+0000 7f99b769e740 1 --2- 172.21.15.81:0/3306152533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e447a90 0x563c8e45f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.085+0000 7f99b769e740 1 --2- 172.21.15.81:0/3306152533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e443660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.085+0000 7f99b769e740 1 --2- 172.21.15.81:0/3306152533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e453900 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.085+0000 7f99b769e740 1 -- 172.21.15.81:0/3306152533 >> 172.21.15.81:0/3306152533 conn(0x563c8e434a30 msgr2=0x563c8e442f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:16.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.085+0000 7f99b769e740 1 -- 172.21.15.81:0/3306152533 shutdown_connections 2024-09-12T01:38:16.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.085+0000 7f99b769e740 1 -- 172.21.15.81:0/3306152533 wait complete. 2024-09-12T01:38:16.108 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:38:16.108 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-12T01:38:16.108 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-12T01:38:16.108 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:38:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.085+0000 7f99b769e740 1 -- start start 2024-09-12T01:38:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.085+0000 7f99b769e740 1 Processor -- start 2024-09-12T01:38:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99b769e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e4500f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99b769e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e44b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99b769e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e447a90 0x563c8e44b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99b769e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f99b01acc70 con 0x563c8e438380 2024-09-12T01:38:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99b769e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f99b01ac5a0 con 0x563c8e447a90 2024-09-12T01:38:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99b769e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99b01a9800 con 0x563c8e438ca0 2024-09-12T01:38:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99b769e740 10 client.0 _ll_register_callbacks cb 0x7f99a800bd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e4500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e4500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51320/0 (socket says 172.21.15.81:51320) 2024-09-12T01:38:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99af7fe640 1 -- 172.21.15.81:0/836999559 learned_addr learned my addr 172.21.15.81:0/836999559 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99ae7fc640 1 --2- 172.21.15.81:0/836999559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e44b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99af7fe640 1 -- 172.21.15.81:0/836999559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 msgr2=0x563c8e44b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99af7fe640 1 --2- 172.21.15.81:0/836999559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e44b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99af7fe640 1 -- 172.21.15.81:0/836999559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e447a90 msgr2=0x563c8e44b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99af7fe640 1 --2- 172.21.15.81:0/836999559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e447a90 0x563c8e44b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99af7fe640 1 -- 172.21.15.81:0/836999559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c8e44c190 con 0x563c8e438380 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99af7fe640 1 --2- 172.21.15.81:0/836999559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e4500f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f99a8026c80 tx=0x7f99a8016ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7521b7451c890956 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f9992ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f9992ff5640 1 -- 172.21.15.81:0/836999559 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a802a070 con 0x563c8e438380 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f9992ff5640 1 -- 172.21.15.81:0/836999559 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7f99a80059c0 con 0x563c8e438380 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.086+0000 7f99b769e740 1 -- 172.21.15.81:0/836999559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99a800a020 con 0x563c8e438380 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.087+0000 7f9992ff5640 1 -- 172.21.15.81:0/836999559 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f99a8005be0 con 0x563c8e438380 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.087+0000 7f99b769e740 10 client.17763 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.087+0000 7f99b769e740 1 -- 172.21.15.81:0/836999559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c8e4c1f50 con 0x563c8e438380 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.087+0000 7f9992ff5640 1 -- 172.21.15.81:0/836999559 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99a800a020 con 0x563c8e438380 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.087+0000 7f9992ff5640 1 -- 172.21.15.81:0/836999559 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f99a80259f0 con 0x563c8e438380 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.087+0000 7f99b769e740 10 client.17763 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.087+0000 7f99b769e740 10 client.17763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.087+0000 7f99b769e740 20 client.17763 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:16.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.087+0000 7f99b769e740 1 --2- 172.21.15.81:0/836999559 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8e4c2550 0x563c8e4c4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.087+0000 7f99b769e740 4 client.17763 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:38:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.087+0000 7f99b769e740 1 -- 172.21.15.81:0/836999559 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563c8e3a5d60 con 0x563c8e4c2550 2024-09-12T01:38:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.087+0000 7f99ae7fc640 1 --2- 172.21.15.81:0/836999559 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8e4c2550 0x563c8e4c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f9992ff5640 10 client.17763 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f99ae7fc640 1 --2- 172.21.15.81:0/836999559 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8e4c2550 0x563c8e4c4940 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4edeff6ae95db3e server_cookie=55070b9b2efb4b44 in_seq=0 out_seq=0 2024-09-12T01:38:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f9992ff5640 1 -- 172.21.15.81:0/836999559 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563c8e3a5d60 con 0x563c8e4c2550 2024-09-12T01:38:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f9992ff5640 10 client.17763 handle_command_reply: tid=0 2024-09-12T01:38:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f99b769e740 1 client.17763 shutdown 2024-09-12T01:38:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f99b769e740 1 -- 172.21.15.81:0/836999559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 msgr2=0x563c8e4500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f99b769e740 1 --2- 172.21.15.81:0/836999559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e4500f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f99a8026c80 tx=0x7f99a8016ec0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f99b769e740 1 -- 172.21.15.81:0/836999559 shutdown_connections 2024-09-12T01:38:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f99b769e740 1 --2- 172.21.15.81:0/836999559 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x563c8e4c2550 0x563c8e4c4940 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f99b769e740 1 --2- 172.21.15.81:0/836999559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c8e447a90 0x563c8e44b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f99b769e740 1 --2- 172.21.15.81:0/836999559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563c8e438ca0 0x563c8e44b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f9992ff5640 0 client.17763 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f99b769e740 1 --2- 172.21.15.81:0/836999559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c8e438380 0x563c8e4500f0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f99b769e740 1 -- 172.21.15.81:0/836999559 >> 172.21.15.81:0/836999559 conn(0x563c8e434a30 msgr2=0x563c8e443770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f99b769e740 1 -- 172.21.15.81:0/836999559 shutdown_connections 2024-09-12T01:38:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f99b769e740 1 -- 172.21.15.81:0/836999559 wait complete. 2024-09-12T01:38:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.088+0000 7f99b769e740 20 client.17763 trim_cache size 0 max 16384 2024-09-12T01:38:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.089+0000 7f99b52c5640 1 -- 172.21.15.81:0/1243303142 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f99980a2cf0 msgr2=0x7f99980a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.089+0000 7f99b52c5640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f99980a2cf0 0x7f99980a51b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f99a40bc2a0 tx=0x7f99a40b17a0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.089+0000 7f99b52c5640 1 -- 172.21.15.81:0/1243303142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0101de0 msgr2=0x7f99b01985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.089+0000 7f99b52c5640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0101de0 0x7f99b01985b0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f99a4005ab0 tx=0x7f99a40042f0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.089+0000 7f99b52c5640 1 -- 172.21.15.81:0/1243303142 shutdown_connections 2024-09-12T01:38:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.089+0000 7f99b52c5640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f99980a2cf0 0x7f99980a51b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.089+0000 7f99b52c5640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99b0106f10 0x7f99b019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.089+0000 7f99b52c5640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99b0102790 0x7f99b0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.089+0000 7f99b52c5640 1 --2- 172.21.15.81:0/1243303142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0101de0 0x7f99b01985b0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.089+0000 7f99b52c5640 1 -- 172.21.15.81:0/1243303142 >> 172.21.15.81:0/1243303142 conn(0x7f99b00fd8c0 msgr2=0x7f99b00fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.089+0000 7f99b52c5640 1 -- 172.21.15.81:0/1243303142 shutdown_connections 2024-09-12T01:38:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:16.089+0000 7f99b52c5640 1 -- 172.21.15.81:0/1243303142 wait complete. 2024-09-12T01:38:16.779 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:38:16.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:38:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.468+0000 7fc24bf9f640 1 -- 172.21.15.81:0/360461039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2441082a0 msgr2=0x7fc24410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.468+0000 7fc24bf9f640 1 --2- 172.21.15.81:0/360461039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2441082a0 0x7fc24410ec40 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fc23c009cd0 tx=0x7fc23c02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.468+0000 7fc24bf9f640 1 -- 172.21.15.81:0/360461039 shutdown_connections 2024-09-12T01:38:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.468+0000 7fc24bf9f640 1 --2- 172.21.15.81:0/360461039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2441082a0 0x7fc24410ec40 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.468+0000 7fc24bf9f640 1 --2- 172.21.15.81:0/360461039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2441036e0 0x7fc244107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.468+0000 7fc24bf9f640 1 --2- 172.21.15.81:0/360461039 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc244102d30 0x7fc244103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.468+0000 7fc24bf9f640 1 -- 172.21.15.81:0/360461039 >> 172.21.15.81:0/360461039 conn(0x7fc2440fc7d0 msgr2=0x7fc2440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.469+0000 7fc24bf9f640 1 -- 172.21.15.81:0/360461039 shutdown_connections 2024-09-12T01:38:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.469+0000 7fc24bf9f640 1 -- 172.21.15.81:0/360461039 wait complete. 2024-09-12T01:38:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.469+0000 7fc24bf9f640 1 Processor -- start 2024-09-12T01:38:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.469+0000 7fc24bf9f640 1 -- start start 2024-09-12T01:38:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24bf9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc244102d30 0x7fc2441a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24bf9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2441036e0 0x7fc2441a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24bf9f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2441082a0 0x7fc24419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24bf9f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441120a0 con 0x7fc2441036e0 2024-09-12T01:38:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24bf9f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc244111f20 con 0x7fc244102d30 2024-09-12T01:38:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24bf9f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc244112220 con 0x7fc2441082a0 2024-09-12T01:38:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24953a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2441036e0 0x7fc2441a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24953a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2441036e0 0x7fc2441a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51346/0 (socket says 172.21.15.81:51346) 2024-09-12T01:38:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24953a640 1 -- 172.21.15.81:0/1576950571 learned_addr learned my addr 172.21.15.81:0/1576950571 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc249d3b640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc244102d30 0x7fc2441a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24a53c640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2441082a0 0x7fc24419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24953a640 1 -- 172.21.15.81:0/1576950571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2441082a0 msgr2=0x7fc24419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24953a640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2441082a0 0x7fc24419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24953a640 1 -- 172.21.15.81:0/1576950571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc244102d30 msgr2=0x7fc2441a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24953a640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc244102d30 0x7fc2441a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24953a640 1 -- 172.21.15.81:0/1576950571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24419acd0 con 0x7fc2441036e0 2024-09-12T01:38:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc249d3b640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc244102d30 0x7fc2441a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc24953a640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2441036e0 0x7fc2441a0920 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fc23400e9f0 tx=0x7fc23400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc23affd640 1 -- 172.21.15.81:0/1576950571 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23400ccc0 con 0x7fc2441036e0 2024-09-12T01:38:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.470+0000 7fc23affd640 1 -- 172.21.15.81:0/1576950571 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc234010910 con 0x7fc2441036e0 2024-09-12T01:38:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.471+0000 7fc24bf9f640 1 -- 172.21.15.81:0/1576950571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24419afc0 con 0x7fc2441036e0 2024-09-12T01:38:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.471+0000 7fc23affd640 1 -- 172.21.15.81:0/1576950571 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234018920 con 0x7fc2441036e0 2024-09-12T01:38:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.471+0000 7fc24bf9f640 1 -- 172.21.15.81:0/1576950571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2441a72b0 con 0x7fc2441036e0 2024-09-12T01:38:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.472+0000 7fc24bf9f640 1 -- 172.21.15.81:0/1576950571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc244103110 con 0x7fc2441036e0 2024-09-12T01:38:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.473+0000 7fc23affd640 1 -- 172.21.15.81:0/1576950571 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc234010ac0 con 0x7fc2441036e0 2024-09-12T01:38:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.474+0000 7fc23affd640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc2300a2d70 0x7fc2300a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.474+0000 7fc249d3b640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc2300a2d70 0x7fc2300a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.474+0000 7fc23affd640 1 -- 172.21.15.81:0/1576950571 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8557+0+0 (secure 0 0 0) 0x7fc2340cfb10 con 0x7fc2441036e0 2024-09-12T01:38:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.474+0000 7fc249d3b640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc2300a2d70 0x7fc2300a5230 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc240009fc0 tx=0x7fc240005f90 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.477+0000 7fc23affd640 1 -- 172.21.15.81:0/1576950571 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc23409c060 con 0x7fc2441036e0 2024-09-12T01:38:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.692+0000 7fc24bf9f640 1 -- 172.21.15.81:0/1576950571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc24419bad0 con 0x7fc2441036e0 2024-09-12T01:38:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.693+0000 7fc23affd640 1 -- 172.21.15.81:0/1576950571 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fc2340a0360 con 0x7fc2441036e0 2024-09-12T01:38:17.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:38:17.694 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:38:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:38:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.695+0000 7fc24bf9f640 1 -- 172.21.15.81:0/1576950571 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc2300a2d70 msgr2=0x7fc2300a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.695+0000 7fc24bf9f640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc2300a2d70 0x7fc2300a5230 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc240009fc0 tx=0x7fc240005f90 comp rx=0 tx=0).stop 2024-09-12T01:38:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.695+0000 7fc24bf9f640 1 -- 172.21.15.81:0/1576950571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2441036e0 msgr2=0x7fc2441a0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.695+0000 7fc24bf9f640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2441036e0 0x7fc2441a0920 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fc23400e9f0 tx=0x7fc23400eeb0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.695+0000 7fc24bf9f640 1 -- 172.21.15.81:0/1576950571 shutdown_connections 2024-09-12T01:38:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.695+0000 7fc24bf9f640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fc2300a2d70 0x7fc2300a5230 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.695+0000 7fc24bf9f640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2441082a0 0x7fc24419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.695+0000 7fc24bf9f640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2441036e0 0x7fc2441a0920 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.695+0000 7fc24bf9f640 1 --2- 172.21.15.81:0/1576950571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc244102d30 0x7fc2441a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.695+0000 7fc24bf9f640 1 -- 172.21.15.81:0/1576950571 >> 172.21.15.81:0/1576950571 conn(0x7fc2440fc7d0 msgr2=0x7fc2441012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.695+0000 7fc24bf9f640 1 -- 172.21.15.81:0/1576950571 shutdown_connections 2024-09-12T01:38:17.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:17.695+0000 7fc24bf9f640 1 -- 172.21.15.81:0/1576950571 wait complete. 2024-09-12T01:38:17.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:17 smithi081 ceph-mon[30920]: pgmap v316: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 204 B/s wr, 13 op/s 2024-09-12T01:38:17.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:17 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:38:17.971 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:17 smithi100 ceph-mon[35275]: pgmap v316: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 204 B/s wr, 13 op/s 2024-09-12T01:38:17.971 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:17 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:38:17.984 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:17 smithi189 ceph-mon[35357]: pgmap v316: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 204 B/s wr, 13 op/s 2024-09-12T01:38:17.985 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:17 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:38:18.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:38:18.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:18 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1576950571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:38:19.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:18 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1576950571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:38:19.022 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:19.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:18 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1576950571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:38:19.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.465+0000 7fbeaca3e640 1 -- 172.21.15.81:0/4018972448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea8100a80 msgr2=0x7fbea8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.465+0000 7fbeaca3e640 1 --2- 172.21.15.81:0/4018972448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea8100a80 0x7fbea8100ee0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009930 tx=0x7fbe9002a420 comp rx=0 tx=0).stop 2024-09-12T01:38:19.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.465+0000 7fbeaca3e640 1 -- 172.21.15.81:0/4018972448 shutdown_connections 2024-09-12T01:38:19.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.465+0000 7fbeaca3e640 1 --2- 172.21.15.81:0/4018972448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbea8101420 0x7fbea810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.465+0000 7fbeaca3e640 1 --2- 172.21.15.81:0/4018972448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea8100a80 0x7fbea8100ee0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.465+0000 7fbeaca3e640 1 --2- 172.21.15.81:0/4018972448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea8106a80 0x7fbea8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.466+0000 7fbeaca3e640 1 -- 172.21.15.81:0/4018972448 >> 172.21.15.81:0/4018972448 conn(0x7fbea80fc7a0 msgr2=0x7fbea80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.466+0000 7fbeaca3e640 1 -- 172.21.15.81:0/4018972448 shutdown_connections 2024-09-12T01:38:19.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.466+0000 7fbeaca3e640 1 -- 172.21.15.81:0/4018972448 wait complete. 2024-09-12T01:38:19.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.466+0000 7fbeaca3e640 1 Processor -- start 2024-09-12T01:38:19.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.466+0000 7fbeaca3e640 1 -- start start 2024-09-12T01:38:19.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbeaca3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea8100a80 0x7fbea8197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbeaca3e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea8101420 0x7fbea8197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbeaca3e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbea8106a80 0x7fbea819bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbeaca3e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbea8110e80 con 0x7fbea8100a80 2024-09-12T01:38:19.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbeaca3e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbea8110d00 con 0x7fbea8101420 2024-09-12T01:38:19.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbeaca3e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbea8111000 con 0x7fbea8106a80 2024-09-12T01:38:19.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbea659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea8100a80 0x7fbea8197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbea659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea8100a80 0x7fbea8197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51378/0 (socket says 172.21.15.81:51378) 2024-09-12T01:38:19.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbea659c640 1 -- 172.21.15.81:0/2426488139 learned_addr learned my addr 172.21.15.81:0/2426488139 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:19.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbe9ffff640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea8101420 0x7fbea8197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbea6d9d640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbea8106a80 0x7fbea819bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbea659c640 1 -- 172.21.15.81:0/2426488139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbea8106a80 msgr2=0x7fbea819bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbea659c640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbea8106a80 0x7fbea819bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbea659c640 1 -- 172.21.15.81:0/2426488139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea8101420 msgr2=0x7fbea8197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbea659c640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea8101420 0x7fbea8197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbea659c640 1 -- 172.21.15.81:0/2426488139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea819c2e0 con 0x7fbea8100a80 2024-09-12T01:38:19.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbea659c640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea8100a80 0x7fbea8197330 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800d950 tx=0x7fbe9800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbe9f7fe640 1 -- 172.21.15.81:0/2426488139 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98017030 con 0x7fbea8100a80 2024-09-12T01:38:19.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbe9f7fe640 1 -- 172.21.15.81:0/2426488139 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe98004020 con 0x7fbea8100a80 2024-09-12T01:38:19.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbe9f7fe640 1 -- 172.21.15.81:0/2426488139 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe980047a0 con 0x7fbea8100a80 2024-09-12T01:38:19.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.467+0000 7fbeaca3e640 1 -- 172.21.15.81:0/2426488139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea819c5d0 con 0x7fbea8100a80 2024-09-12T01:38:19.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.468+0000 7fbeaca3e640 1 -- 172.21.15.81:0/2426488139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea806a790 con 0x7fbea8100a80 2024-09-12T01:38:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbe9f7fe640 1 -- 172.21.15.81:0/2426488139 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fbe980041d0 con 0x7fbea8100a80 2024-09-12T01:38:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbeaee17740 1 Processor -- start 2024-09-12T01:38:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbeaee17740 1 -- start start 2024-09-12T01:38:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbeaee17740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c40b40 0x564313c3f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbeaee17740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c3f5d0 0x564313c3fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbeaee17740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c4a370 0x564313c4c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbeaee17740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564313ba52f0 con 0x564313c4a370 2024-09-12T01:38:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbeaee17740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564313b4ccf0 con 0x564313c3f5d0 2024-09-12T01:38:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbeaee17740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564313ba12b0 con 0x564313c40b40 2024-09-12T01:38:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbe9ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c4a370 0x564313c4c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbe9ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c4a370 0x564313c4c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51392/0 (socket says 172.21.15.81:51392) 2024-09-12T01:38:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbe9ffff640 1 -- 172.21.15.81:0/3987363342 learned_addr learned my addr 172.21.15.81:0/3987363342 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbea6d9d640 1 --2- 172.21.15.81:0/3987363342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c40b40 0x564313c3f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.471+0000 7fbea659c640 1 --2- 172.21.15.81:0/3987363342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c3f5d0 0x564313c3fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.472+0000 7fbe9ffff640 1 -- 172.21.15.81:0/3987363342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c40b40 msgr2=0x564313c3f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.472+0000 7fbe9ffff640 1 --2- 172.21.15.81:0/3987363342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c40b40 0x564313c3f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.472+0000 7fbe9ffff640 1 -- 172.21.15.81:0/3987363342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c3f5d0 msgr2=0x564313c3fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.472+0000 7fbe9ffff640 1 --2- 172.21.15.81:0/3987363342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c3f5d0 0x564313c3fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.472+0000 7fbe9ffff640 1 -- 172.21.15.81:0/3987363342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564313b313a0 con 0x564313c4a370 2024-09-12T01:38:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.472+0000 7fbe9f7fe640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbe940a2cf0 0x7fbe940a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.472+0000 7fbea6d9d640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbe940a2cf0 0x7fbe940a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.472+0000 7fbe9ffff640 1 --2- 172.21.15.81:0/3987363342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c4a370 0x564313c4c760 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbe9002a940 tx=0x7fbe90005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec8e45cd2ee4d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.472+0000 7fbe9f7fe640 1 -- 172.21.15.81:0/2426488139 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fbe980ced20 con 0x7fbea8100a80 2024-09-12T01:38:19.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.472+0000 7fbe9cff9640 1 -- 172.21.15.81:0/3987363342 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90040070 con 0x564313c4a370 2024-09-12T01:38:19.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.472+0000 7fbe9cff9640 1 -- 172.21.15.81:0/3987363342 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe900318f0 con 0x564313c4a370 2024-09-12T01:38:19.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.472+0000 7fbe9cff9640 1 -- 172.21.15.81:0/3987363342 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90035040 con 0x564313c4a370 2024-09-12T01:38:19.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.473+0000 7fbeaee17740 1 -- 172.21.15.81:0/3987363342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c4a370 msgr2=0x564313c4c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.473+0000 7fbea6d9d640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbe940a2cf0 0x7fbe940a51b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbea0005fd0 tx=0x7fbea0009500 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.473+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3987363342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c4a370 0x564313c4c760 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbe9002a940 tx=0x7fbe90005c00 comp rx=0 tx=0).stop 2024-09-12T01:38:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.473+0000 7fbeaee17740 1 -- 172.21.15.81:0/3987363342 shutdown_connections 2024-09-12T01:38:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.473+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3987363342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c4a370 0x564313c4c760 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.473+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3987363342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c3f5d0 0x564313c3fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.473+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3987363342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c40b40 0x564313c3f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.473+0000 7fbeaee17740 1 -- 172.21.15.81:0/3987363342 >> 172.21.15.81:0/3987363342 conn(0x564313c08310 msgr2=0x564313c3bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.473+0000 7fbeaee17740 1 -- 172.21.15.81:0/3987363342 shutdown_connections 2024-09-12T01:38:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.473+0000 7fbeaee17740 1 -- 172.21.15.81:0/3987363342 wait complete. 2024-09-12T01:38:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.473+0000 7fbeaee17740 1 -- start start 2024-09-12T01:38:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbeaee17740 1 Processor -- start 2024-09-12T01:38:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbeaee17740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c3f5d0 0x564313c49ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbeaee17740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c40b40 0x564313c46f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbeaee17740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c4a370 0x564313c474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbeaee17740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564313c4d010 con 0x564313c4a370 2024-09-12T01:38:19.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbeaee17740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564313b60060 con 0x564313c3f5d0 2024-09-12T01:38:19.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbeaee17740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564313c4d190 con 0x564313c40b40 2024-09-12T01:38:19.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbeaee17740 10 client.0 _ll_register_callbacks cb 0x5643138b38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:19.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbe9ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c40b40 0x564313c46f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbea6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c4a370 0x564313c474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbe9ffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c40b40 0x564313c46f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.81:48166/0 (socket says 172.21.15.81:48166) 2024-09-12T01:38:19.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbe9ffff640 1 -- 172.21.15.81:0/3116722937 learned_addr learned my addr 172.21.15.81:0/3116722937 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:19.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbea659c640 1 --2- 172.21.15.81:0/3116722937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c3f5d0 0x564313c49ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbea6d9d640 1 -- 172.21.15.81:0/3116722937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c40b40 msgr2=0x564313c46f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbea6d9d640 1 --2- 172.21.15.81:0/3116722937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c40b40 0x564313c46f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbea6d9d640 1 -- 172.21.15.81:0/3116722937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c3f5d0 msgr2=0x564313c49ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbea6d9d640 1 --2- 172.21.15.81:0/3116722937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c3f5d0 0x564313c49ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.474+0000 7fbea6d9d640 1 -- 172.21.15.81:0/3116722937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643139163c0 con 0x564313c4a370 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbea6d9d640 1 --2- 172.21.15.81:0/3116722937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c4a370 0x564313c474f0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fbea0011e90 tx=0x7fbea0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7bbfd7c4f46e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbe8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbe8dffb640 1 -- 172.21.15.81:0/3116722937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea000f870 con 0x564313c4a370 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbe8dffb640 1 -- 172.21.15.81:0/3116722937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fbea000fa10 con 0x564313c4a370 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbeaee17740 1 -- 172.21.15.81:0/3116722937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe900318f0 con 0x564313c4a370 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbe8dffb640 1 -- 172.21.15.81:0/3116722937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbea000fc10 con 0x564313c4a370 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbeaee17740 10 client.17781 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbeaee17740 1 -- 172.21.15.81:0/3116722937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564313c58a80 con 0x564313c4a370 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbe8dffb640 1 -- 172.21.15.81:0/3116722937 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe900318f0 con 0x564313c4a370 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbe8dffb640 1 -- 172.21.15.81:0/3116722937 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbea0026070 con 0x564313c4a370 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbeaee17740 10 client.17781 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbeaee17740 10 client.17781 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:38:19.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbeaee17740 20 client.17781 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3116722937 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x564313c59f30 0x564313c5c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbeaee17740 4 client.17781 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.475+0000 7fbeaee17740 1 -- 172.21.15.81:0/3116722937 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564313bb2860 con 0x564313c59f30 2024-09-12T01:38:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.476+0000 7fbea659c640 1 --2- 172.21.15.81:0/3116722937 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x564313c59f30 0x564313c5c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.476+0000 7fbe8dffb640 10 client.17781 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:38:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.476+0000 7fbea659c640 1 --2- 172.21.15.81:0/3116722937 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x564313c59f30 0x564313c5c3b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d879d66cebf5310c server_cookie=a322d70e7c214a38 in_seq=0 out_seq=0 2024-09-12T01:38:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbe8dffb640 1 -- 172.21.15.81:0/3116722937 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564313bb2860 con 0x564313c59f30 2024-09-12T01:38:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbe8dffb640 10 client.17781 handle_command_reply: tid=0 2024-09-12T01:38:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbeaee17740 1 client.17781 shutdown 2024-09-12T01:38:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbeaee17740 1 -- 172.21.15.81:0/3116722937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c4a370 msgr2=0x564313c474f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3116722937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c4a370 0x564313c474f0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fbea0011e90 tx=0x7fbea0004ab0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbeaee17740 1 -- 172.21.15.81:0/3116722937 shutdown_connections 2024-09-12T01:38:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3116722937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c4a370 0x564313c474f0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3116722937 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x564313c59f30 0x564313c5c3b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3116722937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c40b40 0x564313c46f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbe8dffb640 0 client.17781 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:38:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3116722937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c3f5d0 0x564313c49ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbeaee17740 1 -- 172.21.15.81:0/3116722937 >> 172.21.15.81:0/3116722937 conn(0x564313c08310 msgr2=0x564313c41960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbeaee17740 1 -- 172.21.15.81:0/3116722937 shutdown_connections 2024-09-12T01:38:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbeaee17740 1 -- 172.21.15.81:0/3116722937 wait complete. 2024-09-12T01:38:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.477+0000 7fbeaee17740 20 client.17781 trim_cache size 0 max 16384 2024-09-12T01:38:19.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbeaee17740 1 Processor -- start 2024-09-12T01:38:19.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbeaee17740 1 -- start start 2024-09-12T01:38:19.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbeaee17740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c3f5d0 0x564313c562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbeaee17740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c40b40 0x564313c42120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbeaee17740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c4a370 0x564313c42660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbeaee17740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbea81afaf0 con 0x564313c3f5d0 2024-09-12T01:38:19.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbeaee17740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbea81b1630 con 0x564313c40b40 2024-09-12T01:38:19.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbeaee17740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbea81b01c0 con 0x564313c4a370 2024-09-12T01:38:19.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbea659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c3f5d0 0x564313c562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbea659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c3f5d0 0x564313c562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51414/0 (socket says 172.21.15.81:51414) 2024-09-12T01:38:19.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbea659c640 1 -- 172.21.15.81:0/1000493336 learned_addr learned my addr 172.21.15.81:0/1000493336 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:19.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbe9ffff640 1 --2- 172.21.15.81:0/1000493336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c40b40 0x564313c42120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbea6d9d640 1 --2- 172.21.15.81:0/1000493336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c4a370 0x564313c42660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbea659c640 1 -- 172.21.15.81:0/1000493336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c4a370 msgr2=0x564313c42660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbea659c640 1 --2- 172.21.15.81:0/1000493336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c4a370 0x564313c42660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbea659c640 1 -- 172.21.15.81:0/1000493336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c40b40 msgr2=0x564313c42120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbea659c640 1 --2- 172.21.15.81:0/1000493336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c40b40 0x564313c42120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbea659c640 1 -- 172.21.15.81:0/1000493336 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564313c42ba0 con 0x564313c3f5d0 2024-09-12T01:38:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.490+0000 7fbea6d9d640 1 --2- 172.21.15.81:0/1000493336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c4a370 0x564313c42660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.491+0000 7fbea659c640 1 --2- 172.21.15.81:0/1000493336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c3f5d0 0x564313c562b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fbe980976a0 tx=0x7fbe980bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddedbae8cd7226a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.491+0000 7fbe8ffff640 1 -- 172.21.15.81:0/1000493336 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9809aba0 con 0x564313c3f5d0 2024-09-12T01:38:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.491+0000 7fbe8ffff640 1 -- 172.21.15.81:0/1000493336 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe9809b940 con 0x564313c3f5d0 2024-09-12T01:38:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.491+0000 7fbe8ffff640 1 -- 172.21.15.81:0/1000493336 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe980995d0 con 0x564313c3f5d0 2024-09-12T01:38:19.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.492+0000 7fbeaee17740 1 -- 172.21.15.81:0/1000493336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c3f5d0 msgr2=0x564313c562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.492+0000 7fbeaee17740 1 --2- 172.21.15.81:0/1000493336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c3f5d0 0x564313c562b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fbe980976a0 tx=0x7fbe980bb040 comp rx=0 tx=0).stop 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.492+0000 7fbeaee17740 1 -- 172.21.15.81:0/1000493336 shutdown_connections 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.492+0000 7fbeaee17740 1 --2- 172.21.15.81:0/1000493336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c4a370 0x564313c42660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.492+0000 7fbeaee17740 1 --2- 172.21.15.81:0/1000493336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c40b40 0x564313c42120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.492+0000 7fbeaee17740 1 --2- 172.21.15.81:0/1000493336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c3f5d0 0x564313c562b0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.492+0000 7fbeaee17740 1 -- 172.21.15.81:0/1000493336 >> 172.21.15.81:0/1000493336 conn(0x564313c08310 msgr2=0x564313c46f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.492+0000 7fbeaee17740 1 -- 172.21.15.81:0/1000493336 shutdown_connections 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.492+0000 7fbeaee17740 1 -- 172.21.15.81:0/1000493336 wait complete. 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.492+0000 7fbeaee17740 1 -- start start 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.492+0000 7fbeaee17740 1 Processor -- start 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbeaee17740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c3f5d0 0x564313c52ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbeaee17740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c40b40 0x564313c43de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbeaee17740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c4a370 0x564313c443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbeaee17740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbea81b0f60 con 0x564313c40b40 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbeaee17740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbea81b0890 con 0x564313c4a370 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbeaee17740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbea81adaf0 con 0x564313c3f5d0 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbeaee17740 10 client.0 _ll_register_callbacks cb 0x7fbea0009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbe9ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c40b40 0x564313c43de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbe9ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c40b40 0x564313c43de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51418/0 (socket says 172.21.15.81:51418) 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbe9ffff640 1 -- 172.21.15.81:0/3606472115 learned_addr learned my addr 172.21.15.81:0/3606472115 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbea6d9d640 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c4a370 0x564313c443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbea659c640 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c3f5d0 0x564313c52ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbe9ffff640 1 -- 172.21.15.81:0/3606472115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c3f5d0 msgr2=0x564313c52ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbe9ffff640 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c3f5d0 0x564313c52ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbe9ffff640 1 -- 172.21.15.81:0/3606472115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c4a370 msgr2=0x564313c443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbe9ffff640 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c4a370 0x564313c443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbe9ffff640 1 -- 172.21.15.81:0/3606472115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564313c44c20 con 0x564313c40b40 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbea659c640 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c3f5d0 0x564313c52ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbe9ffff640 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c40b40 0x564313c43de0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009a20 tx=0x7fbe9002a9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d5b18a1fa0affa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.493+0000 7fbe8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbe8dffb640 1 -- 172.21.15.81:0/3606472115 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90040050 con 0x564313c40b40 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbe8dffb640 1 -- 172.21.15.81:0/3606472115 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fbe900319c0 con 0x564313c40b40 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbeaee17740 1 -- 172.21.15.81:0/3606472115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe9809b940 con 0x564313c40b40 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbe8dffb640 1 -- 172.21.15.81:0/3606472115 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe90035040 con 0x564313c40b40 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbeaee17740 10 client.17787 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbeaee17740 1 -- 172.21.15.81:0/3606472115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564313cc4d20 con 0x564313c40b40 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbe8dffb640 1 -- 172.21.15.81:0/3606472115 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe9809b940 con 0x564313c40b40 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbe8dffb640 1 -- 172.21.15.81:0/3606472115 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbe9003c440 con 0x564313c40b40 2024-09-12T01:38:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbeaee17740 10 client.17787 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbeaee17740 10 client.17787 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-12T01:38:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbeaee17740 20 client.17787 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x564313c59f30 0x564313cc7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbeaee17740 4 client.17787 mds_command: new command op to 24391 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:38:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbeaee17740 1 -- 172.21.15.81:0/3606472115 --> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564313bacd70 con 0x564313c59f30 2024-09-12T01:38:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.494+0000 7fbea659c640 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x564313c59f30 0x564313cc7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbea659c640 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x564313c59f30 0x564313cc7180 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=338531258ca71d7c server_cookie=eae3d057f97b0483 in_seq=0 out_seq=0 2024-09-12T01:38:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbe8dffb640 10 client.17787 ms_handle_connect on v2:172.21.15.189:6832/2998951094 2024-09-12T01:38:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbe8dffb640 1 -- 172.21.15.81:0/3606472115 <== mds.4 v2:172.21.15.189:6832/2998951094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564313bacd70 con 0x564313c59f30 2024-09-12T01:38:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbe8dffb640 10 client.17787 handle_command_reply: tid=0 2024-09-12T01:38:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbeaee17740 1 client.17787 shutdown 2024-09-12T01:38:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbeaee17740 1 -- 172.21.15.81:0/3606472115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c40b40 msgr2=0x564313c43de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c40b40 0x564313c43de0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009a20 tx=0x7fbe9002a9c0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbeaee17740 1 -- 172.21.15.81:0/3606472115 shutdown_connections 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564313c4a370 0x564313c443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564313c40b40 0x564313c43de0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.189:6832/2998951094,v1:172.21.15.189:6833/2998951094] conn(0x564313c59f30 0x564313cc7180 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbeaee17740 1 --2- 172.21.15.81:0/3606472115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564313c3f5d0 0x564313c52ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbe8dffb640 0 client.17787 ms_handle_reset on v2:172.21.15.189:6832/2998951094 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbeaee17740 1 -- 172.21.15.81:0/3606472115 >> 172.21.15.81:0/3606472115 conn(0x564313c08310 msgr2=0x564313c487f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbeaee17740 1 -- 172.21.15.81:0/3606472115 shutdown_connections 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbeaee17740 1 -- 172.21.15.81:0/3606472115 wait complete. 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.495+0000 7fbeaee17740 20 client.17787 trim_cache size 0 max 16384 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.496+0000 7fbeaca3e640 1 -- 172.21.15.81:0/2426488139 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbe940a2cf0 msgr2=0x7fbe940a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.496+0000 7fbeaca3e640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbe940a2cf0 0x7fbe940a51b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbea0005fd0 tx=0x7fbea0009500 comp rx=0 tx=0).stop 2024-09-12T01:38:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.496+0000 7fbeaca3e640 1 -- 172.21.15.81:0/2426488139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea8100a80 msgr2=0x7fbea8197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.496+0000 7fbeaca3e640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea8100a80 0x7fbea8197330 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800d950 tx=0x7fbe9800de10 comp rx=0 tx=0).stop 2024-09-12T01:38:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.496+0000 7fbeaca3e640 1 -- 172.21.15.81:0/2426488139 shutdown_connections 2024-09-12T01:38:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.496+0000 7fbeaca3e640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fbe940a2cf0 0x7fbe940a51b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.496+0000 7fbeaca3e640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbea8106a80 0x7fbea819bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.496+0000 7fbeaca3e640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea8101420 0x7fbea8197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.496+0000 7fbeaca3e640 1 --2- 172.21.15.81:0/2426488139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbea8100a80 0x7fbea8197330 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.496+0000 7fbeaca3e640 1 -- 172.21.15.81:0/2426488139 >> 172.21.15.81:0/2426488139 conn(0x7fbea80fc7a0 msgr2=0x7fbea80fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.496+0000 7fbeaca3e640 1 -- 172.21.15.81:0/2426488139 shutdown_connections 2024-09-12T01:38:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:19.496+0000 7fbeaca3e640 1 -- 172.21.15.81:0/2426488139 wait complete. 2024-09-12T01:38:19.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: pgmap v317: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 204 B/s wr, 13 op/s 2024-09-12T01:38:19.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:19.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:19.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:19.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:19.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:19.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:19.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:19.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:19.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:19.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:19.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:19.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:19.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:19 smithi081 ceph-mon[30920]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T01:38:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: pgmap v317: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 204 B/s wr, 13 op/s 2024-09-12T01:38:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.020 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:19 smithi100 ceph-mon[35275]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T01:38:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: pgmap v317: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 204 B/s wr, 13 op/s 2024-09-12T01:38:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:20.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:19 smithi189 ceph-mon[35357]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T01:38:20.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:38:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:20.888 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:20 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-12T01:38:20.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:20 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-12T01:38:20.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:20 smithi081 ceph-mon[30920]: Unable to set osd_memory_target on smithi189 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-12T01:38:20.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:20 smithi081 ceph-mon[30920]: Unable to set osd_memory_target on smithi100 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-12T01:38:20.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:20 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:20.889 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:20 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.973+0000 7f5894825640 1 -- 172.21.15.81:0/2972939203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5890103740 msgr2=0x7f5890107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.973+0000 7f5894825640 1 --2- 172.21.15.81:0/2972939203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5890103740 0x7f5890107b80 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5884009930 tx=0x7f588402a420 comp rx=0 tx=0).stop 2024-09-12T01:38:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.973+0000 7f5894825640 1 -- 172.21.15.81:0/2972939203 shutdown_connections 2024-09-12T01:38:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.973+0000 7f5894825640 1 --2- 172.21.15.81:0/2972939203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5890108290 0x7f589010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.973+0000 7f5894825640 1 --2- 172.21.15.81:0/2972939203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5890103740 0x7f5890107b80 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.973+0000 7f5894825640 1 --2- 172.21.15.81:0/2972939203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5890102d90 0x7f5890103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.973+0000 7f5894825640 1 -- 172.21.15.81:0/2972939203 >> 172.21.15.81:0/2972939203 conn(0x7f58900fc7d0 msgr2=0x7f58900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.973+0000 7f5894825640 1 -- 172.21.15.81:0/2972939203 shutdown_connections 2024-09-12T01:38:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.973+0000 7f5894825640 1 -- 172.21.15.81:0/2972939203 wait complete. 2024-09-12T01:38:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.974+0000 7f5894825640 1 Processor -- start 2024-09-12T01:38:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.974+0000 7f5894825640 1 -- start start 2024-09-12T01:38:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f5894825640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5890102d90 0x7f5890198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f5894825640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5890103740 0x7f5890198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f5894825640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5890108290 0x7f589019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f5894825640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5890112100 con 0x7f5890103740 2024-09-12T01:38:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f5894825640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5890111f80 con 0x7f5890108290 2024-09-12T01:38:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f5894825640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5890112280 con 0x7f5890102d90 2024-09-12T01:38:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f588dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5890103740 0x7f5890198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f588dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5890103740 0x7f5890198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51430/0 (socket says 172.21.15.81:51430) 2024-09-12T01:38:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f588dd9b640 1 -- 172.21.15.81:0/128469004 learned_addr learned my addr 172.21.15.81:0/128469004 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f588ed9d640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5890108290 0x7f589019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f588e59c640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5890102d90 0x7f5890198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f588dd9b640 1 -- 172.21.15.81:0/128469004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5890102d90 msgr2=0x7f5890198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f588dd9b640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5890102d90 0x7f5890198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f588dd9b640 1 -- 172.21.15.81:0/128469004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5890108290 msgr2=0x7f589019cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f588dd9b640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5890108290 0x7f589019cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f588dd9b640 1 -- 172.21.15.81:0/128469004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589019d5e0 con 0x7f5890103740 2024-09-12T01:38:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f588dd9b640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5890103740 0x7f5890198b70 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f588402a940 tx=0x7f5884003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.975+0000 7f587f7fe640 1 -- 172.21.15.81:0/128469004 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588403f070 con 0x7f5890103740 2024-09-12T01:38:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.976+0000 7f587f7fe640 1 -- 172.21.15.81:0/128469004 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5884031c90 con 0x7f5890103740 2024-09-12T01:38:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.976+0000 7f587f7fe640 1 -- 172.21.15.81:0/128469004 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884035030 con 0x7f5890103740 2024-09-12T01:38:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.976+0000 7f5894825640 1 -- 172.21.15.81:0/128469004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f589019d870 con 0x7f5890103740 2024-09-12T01:38:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.976+0000 7f5894825640 1 -- 172.21.15.81:0/128469004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58901a51b0 con 0x7f5890103740 2024-09-12T01:38:20.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.978+0000 7f587f7fe640 1 -- 172.21.15.81:0/128469004 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5884042070 con 0x7f5890103740 2024-09-12T01:38:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.978+0000 7f5896bfe740 1 Processor -- start 2024-09-12T01:38:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.978+0000 7f5896bfe740 1 -- start start 2024-09-12T01:38:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.978+0000 7f5896bfe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 0x561f04fd6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f5896bfe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fd65d0 0x561f04fd6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f5896bfe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fe1370 0x561f04fe3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f5896bfe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561f04f3c2f0 con 0x561f04fd7b40 2024-09-12T01:38:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f5896bfe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561f04ee3cf0 con 0x561f04fd65d0 2024-09-12T01:38:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f5896bfe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561f04f382b0 con 0x561f04fe1370 2024-09-12T01:38:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f588ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 0x561f04fd6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f588ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 0x561f04fd6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51444/0 (socket says 172.21.15.81:51444) 2024-09-12T01:38:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f588ed9d640 1 -- 172.21.15.81:0/2123565017 learned_addr learned my addr 172.21.15.81:0/2123565017 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f587f7fe640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f58780a2cf0 0x7f58780a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f588dd9b640 1 --2- 172.21.15.81:0/2123565017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fe1370 0x561f04fe3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f588e59c640 1 --2- 172.21.15.81:0/2123565017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fd65d0 0x561f04fd6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f588ed9d640 1 -- 172.21.15.81:0/2123565017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fe1370 msgr2=0x561f04fe3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:20.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f588ed9d640 1 --2- 172.21.15.81:0/2123565017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fe1370 0x561f04fe3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f588ed9d640 1 -- 172.21.15.81:0/2123565017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fd65d0 msgr2=0x561f04fd6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:20.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f588ed9d640 1 --2- 172.21.15.81:0/2123565017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fd65d0 0x561f04fd6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f588ed9d640 1 -- 172.21.15.81:0/2123565017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f04ec83a0 con 0x561f04fd7b40 2024-09-12T01:38:20.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f588dd9b640 1 --2- 172.21.15.81:0/2123565017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fe1370 0x561f04fe3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:20.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f587f7fe640 1 -- 172.21.15.81:0/128469004 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f58840efbf0 con 0x7f5890103740 2024-09-12T01:38:20.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f588ed9d640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f58780a2cf0 0x7f58780a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.979+0000 7f588ed9d640 1 --2- 172.21.15.81:0/2123565017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 0x561f04fd6090 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f588800afd0 tx=0x7f588800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28505052c0521bff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:20.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.980+0000 7f587cff9640 1 -- 172.21.15.81:0/2123565017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888024430 con 0x561f04fd7b40 2024-09-12T01:38:20.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.980+0000 7f587cff9640 1 -- 172.21.15.81:0/2123565017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5888019850 con 0x561f04fd7b40 2024-09-12T01:38:20.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.980+0000 7f588ed9d640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f58780a2cf0 0x7f58780a51b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5888020000 tx=0x7f588801c030 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:20.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.980+0000 7f587cff9640 1 -- 172.21.15.81:0/2123565017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588800d540 con 0x561f04fd7b40 2024-09-12T01:38:20.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.980+0000 7f5896bfe740 1 -- 172.21.15.81:0/2123565017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 msgr2=0x561f04fd6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:20.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.980+0000 7f5896bfe740 1 --2- 172.21.15.81:0/2123565017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 0x561f04fd6090 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f588800afd0 tx=0x7f588800f850 comp rx=0 tx=0).stop 2024-09-12T01:38:20.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.980+0000 7f5896bfe740 1 -- 172.21.15.81:0/2123565017 shutdown_connections 2024-09-12T01:38:20.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.980+0000 7f5896bfe740 1 --2- 172.21.15.81:0/2123565017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fe1370 0x561f04fe3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.980+0000 7f5896bfe740 1 --2- 172.21.15.81:0/2123565017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fd65d0 0x561f04fd6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.980+0000 7f5896bfe740 1 --2- 172.21.15.81:0/2123565017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 0x561f04fd6090 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.980+0000 7f5896bfe740 1 -- 172.21.15.81:0/2123565017 >> 172.21.15.81:0/2123565017 conn(0x561f04f9f310 msgr2=0x561f04fd2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:20.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.980+0000 7f5896bfe740 1 -- 172.21.15.81:0/2123565017 shutdown_connections 2024-09-12T01:38:20.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f5896bfe740 1 -- 172.21.15.81:0/2123565017 wait complete. 2024-09-12T01:38:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f5896bfe740 1 -- start start 2024-09-12T01:38:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f5896bfe740 1 Processor -- start 2024-09-12T01:38:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f5896bfe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 0x561f04fe0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f5896bfe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fd7b40 0x561f04fde020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f5896bfe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fe1370 0x561f04fde610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f5896bfe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561f04fe4070 con 0x561f04fd65d0 2024-09-12T01:38:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f5896bfe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561f04ef7060 con 0x561f04fe1370 2024-09-12T01:38:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f5896bfe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561f04fe41f0 con 0x561f04fd7b40 2024-09-12T01:38:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f5896bfe740 10 client.0 _ll_register_callbacks cb 0x561f04c4a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:20.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f588e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 0x561f04fe0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f588e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 0x561f04fe0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51450/0 (socket says 172.21.15.81:51450) 2024-09-12T01:38:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f588e59c640 1 -- 172.21.15.81:0/679319925 learned_addr learned my addr 172.21.15.81:0/679319925 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.981+0000 7f588dd9b640 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fd7b40 0x561f04fde020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f588ed9d640 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fe1370 0x561f04fde610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f588e59c640 1 -- 172.21.15.81:0/679319925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fd7b40 msgr2=0x561f04fde020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f588e59c640 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fd7b40 0x561f04fde020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f588e59c640 1 -- 172.21.15.81:0/679319925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fe1370 msgr2=0x561f04fde610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f588e59c640 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fe1370 0x561f04fde610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f588e59c640 1 -- 172.21.15.81:0/679319925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f04cad3c0 con 0x561f04fd65d0 2024-09-12T01:38:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f588dd9b640 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fd7b40 0x561f04fde020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:20.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f588ed9d640 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fe1370 0x561f04fde610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:20.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f588e59c640 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 0x561f04fe0d70 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f5880011540 tx=0x7f5880011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac92dc1d8919773c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:20.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f5875ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:20.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f5875ffb640 1 -- 172.21.15.81:0/679319925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588000f6d0 con 0x561f04fd65d0 2024-09-12T01:38:20.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f5875ffb640 1 -- 172.21.15.81:0/679319925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f588000f870 con 0x561f04fd65d0 2024-09-12T01:38:20.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f5896bfe740 1 -- 172.21.15.81:0/679319925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5888019850 con 0x561f04fd65d0 2024-09-12T01:38:20.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f5875ffb640 1 -- 172.21.15.81:0/679319925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f588000fab0 con 0x561f04fd65d0 2024-09-12T01:38:20.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f5896bfe740 10 client.17799 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:20.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f5896bfe740 1 -- 172.21.15.81:0/679319925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f04fefb70 con 0x561f04fd65d0 2024-09-12T01:38:20.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f5875ffb640 1 -- 172.21.15.81:0/679319925 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5888019850 con 0x561f04fd65d0 2024-09-12T01:38:20.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f5875ffb640 1 -- 172.21.15.81:0/679319925 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f588001d400 con 0x561f04fd65d0 2024-09-12T01:38:20.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.982+0000 7f5896bfe740 10 client.17799 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:20.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.983+0000 7f5896bfe740 10 client.17799 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:38:20.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.983+0000 7f5896bfe740 20 client.17799 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:20.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.983+0000 7f5896bfe740 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561f04ff1030 0x561f04ff3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.983+0000 7f5896bfe740 4 client.17799 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:20.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.983+0000 7f5896bfe740 1 -- 172.21.15.81:0/679319925 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f04f49860 con 0x561f04ff1030 2024-09-12T01:38:20.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.983+0000 7f588dd9b640 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561f04ff1030 0x561f04ff3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.983+0000 7f588dd9b640 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561f04ff1030 0x561f04ff3420 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=12f9f17fe2d4a41e server_cookie=6cf6405a821ea1ac in_seq=0 out_seq=0 2024-09-12T01:38:20.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.983+0000 7f5875ffb640 10 client.17799 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:38:20.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5875ffb640 1 -- 172.21.15.81:0/679319925 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f04f49860 con 0x561f04ff1030 2024-09-12T01:38:20.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5875ffb640 10 client.17799 handle_command_reply: tid=0 2024-09-12T01:38:20.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5896bfe740 1 client.17799 shutdown 2024-09-12T01:38:20.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5896bfe740 1 -- 172.21.15.81:0/679319925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 msgr2=0x561f04fe0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:20.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5896bfe740 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 0x561f04fe0d70 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f5880011540 tx=0x7f5880011a00 comp rx=0 tx=0).stop 2024-09-12T01:38:20.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5896bfe740 1 -- 172.21.15.81:0/679319925 shutdown_connections 2024-09-12T01:38:20.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5896bfe740 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561f04ff1030 0x561f04ff3420 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5896bfe740 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fe1370 0x561f04fde610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5896bfe740 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fd7b40 0x561f04fde020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5896bfe740 1 --2- 172.21.15.81:0/679319925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 0x561f04fe0d70 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5875ffb640 0 client.17799 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:38:20.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5896bfe740 1 -- 172.21.15.81:0/679319925 >> 172.21.15.81:0/679319925 conn(0x561f04f9f310 msgr2=0x561f04fd8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:20.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5896bfe740 1 -- 172.21.15.81:0/679319925 shutdown_connections 2024-09-12T01:38:20.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5896bfe740 1 -- 172.21.15.81:0/679319925 wait complete. 2024-09-12T01:38:20.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.984+0000 7f5896bfe740 20 client.17799 trim_cache size 0 max 16384 2024-09-12T01:38:21.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.997+0000 7f5896bfe740 1 Processor -- start 2024-09-12T01:38:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.997+0000 7f5896bfe740 1 -- start start 2024-09-12T01:38:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.997+0000 7f5896bfe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 0x561f04fd2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.997+0000 7f5896bfe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fd7b40 0x561f04fed310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.997+0000 7f5896bfe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fe1370 0x561f04fd9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.997+0000 7f5896bfe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f58901ad8a0 con 0x561f04fd65d0 2024-09-12T01:38:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.997+0000 7f5896bfe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f58901af3e0 con 0x561f04fe1370 2024-09-12T01:38:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.997+0000 7f5896bfe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f58901adf70 con 0x561f04fd7b40 2024-09-12T01:38:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.997+0000 7f588e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 0x561f04fd2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.997+0000 7f588e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 0x561f04fd2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51466/0 (socket says 172.21.15.81:51466) 2024-09-12T01:38:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.997+0000 7f588e59c640 1 -- 172.21.15.81:0/102060207 learned_addr learned my addr 172.21.15.81:0/102060207 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.998+0000 7f588ed9d640 1 --2- 172.21.15.81:0/102060207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fe1370 0x561f04fd9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.998+0000 7f588dd9b640 1 --2- 172.21.15.81:0/102060207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fd7b40 0x561f04fed310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.998+0000 7f588e59c640 1 -- 172.21.15.81:0/102060207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fd7b40 msgr2=0x561f04fed310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.998+0000 7f588e59c640 1 --2- 172.21.15.81:0/102060207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fd7b40 0x561f04fed310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.998+0000 7f588e59c640 1 -- 172.21.15.81:0/102060207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fe1370 msgr2=0x561f04fd9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.998+0000 7f588e59c640 1 --2- 172.21.15.81:0/102060207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fe1370 0x561f04fd9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.998+0000 7f588e59c640 1 -- 172.21.15.81:0/102060207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f04fd1310 con 0x561f04fd65d0 2024-09-12T01:38:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.998+0000 7f588ed9d640 1 --2- 172.21.15.81:0/102060207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fe1370 0x561f04fd9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.998+0000 7f588e59c640 1 --2- 172.21.15.81:0/102060207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 0x561f04fd2e10 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f588001d820 tx=0x7f5880009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac2df2cf488e71c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.998+0000 7f5877fff640 1 -- 172.21.15.81:0/102060207 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880033070 con 0x561f04fd65d0 2024-09-12T01:38:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.998+0000 7f5877fff640 1 -- 172.21.15.81:0/102060207 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f588000f040 con 0x561f04fd65d0 2024-09-12T01:38:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.998+0000 7f5877fff640 1 -- 172.21.15.81:0/102060207 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588002a030 con 0x561f04fd65d0 2024-09-12T01:38:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 -- 172.21.15.81:0/102060207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 msgr2=0x561f04fd2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 --2- 172.21.15.81:0/102060207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 0x561f04fd2e10 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f588001d820 tx=0x7f5880009520 comp rx=0 tx=0).stop 2024-09-12T01:38:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 -- 172.21.15.81:0/102060207 shutdown_connections 2024-09-12T01:38:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 --2- 172.21.15.81:0/102060207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fe1370 0x561f04fd9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 --2- 172.21.15.81:0/102060207 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fd7b40 0x561f04fed310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 --2- 172.21.15.81:0/102060207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd65d0 0x561f04fd2e10 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 -- 172.21.15.81:0/102060207 >> 172.21.15.81:0/102060207 conn(0x561f04f9f310 msgr2=0x561f04fd2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 -- 172.21.15.81:0/102060207 shutdown_connections 2024-09-12T01:38:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 -- 172.21.15.81:0/102060207 wait complete. 2024-09-12T01:38:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 -- start start 2024-09-12T01:38:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 Processor -- start 2024-09-12T01:38:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fd65d0 0x561f04fe9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:21.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 0x561f04fe4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:21.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fe1370 0x561f04fe5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:21.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f58901aed10 con 0x561f04fd7b40 2024-09-12T01:38:21.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f58901ae640 con 0x561f04fd65d0 2024-09-12T01:38:21.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f58901ab8a0 con 0x561f04fe1370 2024-09-12T01:38:21.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:20.999+0000 7f5896bfe740 10 client.0 _ll_register_callbacks cb 0x7f5880009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:21.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f588dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 0x561f04fe4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f588e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fd65d0 0x561f04fe9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f588dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 0x561f04fe4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51480/0 (socket says 172.21.15.81:51480) 2024-09-12T01:38:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f588dd9b640 1 -- 172.21.15.81:0/1866738710 learned_addr learned my addr 172.21.15.81:0/1866738710 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f588ed9d640 1 --2- 172.21.15.81:0/1866738710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fe1370 0x561f04fe5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f588dd9b640 1 -- 172.21.15.81:0/1866738710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fe1370 msgr2=0x561f04fe5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:21.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f588dd9b640 1 --2- 172.21.15.81:0/1866738710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fe1370 0x561f04fe5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f588dd9b640 1 -- 172.21.15.81:0/1866738710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fd65d0 msgr2=0x561f04fe9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:21.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f588dd9b640 1 --2- 172.21.15.81:0/1866738710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fd65d0 0x561f04fe9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f588dd9b640 1 -- 172.21.15.81:0/1866738710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f04fe5da0 con 0x561f04fd7b40 2024-09-12T01:38:21.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f588dd9b640 1 --2- 172.21.15.81:0/1866738710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 0x561f04fe4fd0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f58840bc0a0 tx=0x7f5884005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4f84e1a9fe7c3c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:21.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f5875ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:21.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f5875ffb640 1 -- 172.21.15.81:0/1866738710 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884049040 con 0x561f04fd7b40 2024-09-12T01:38:21.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f5875ffb640 1 -- 172.21.15.81:0/1866738710 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f58840dc0b0 con 0x561f04fd7b40 2024-09-12T01:38:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f5896bfe740 1 -- 172.21.15.81:0/1866738710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f588000f040 con 0x561f04fd7b40 2024-09-12T01:38:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f5875ffb640 1 -- 172.21.15.81:0/1866738710 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f58840bc810 con 0x561f04fd7b40 2024-09-12T01:38:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f5896bfe740 10 client.17805 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.000+0000 7f5896bfe740 1 -- 172.21.15.81:0/1866738710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f0505bdd0 con 0x561f04fd7b40 2024-09-12T01:38:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.001+0000 7f5875ffb640 1 -- 172.21.15.81:0/1866738710 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f588000f040 con 0x561f04fd7b40 2024-09-12T01:38:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.001+0000 7f5875ffb640 1 -- 172.21.15.81:0/1866738710 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f58840ed5c0 con 0x561f04fd7b40 2024-09-12T01:38:21.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.001+0000 7f5896bfe740 10 client.17805 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:21.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.001+0000 7f5896bfe740 10 client.17805 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-09-12T01:38:21.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.001+0000 7f5896bfe740 20 client.17805 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:21.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.001+0000 7f5896bfe740 1 --2- 172.21.15.81:0/1866738710 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561f0505c460 0x561f0505e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:21.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.001+0000 7f5896bfe740 4 client.17805 mds_command: new command op to 24401 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:38:21.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.001+0000 7f5896bfe740 1 -- 172.21.15.81:0/1866738710 --> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f04f43d70 con 0x561f0505c460 2024-09-12T01:38:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.001+0000 7f588e59c640 1 --2- 172.21.15.81:0/1866738710 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561f0505c460 0x561f0505e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.001+0000 7f588e59c640 1 --2- 172.21.15.81:0/1866738710 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561f0505c460 0x561f0505e880 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=15382a3d5fda05b2 server_cookie=4cb164ecf1ee4c2 in_seq=0 out_seq=0 2024-09-12T01:38:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.001+0000 7f5875ffb640 10 client.17805 ms_handle_connect on v2:172.21.15.100:6832/2684949307 2024-09-12T01:38:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.001+0000 7f5875ffb640 1 -- 172.21.15.81:0/1866738710 <== mds.3 v2:172.21.15.100:6832/2684949307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f04f43d70 con 0x561f0505c460 2024-09-12T01:38:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5875ffb640 10 client.17805 handle_command_reply: tid=0 2024-09-12T01:38:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5896bfe740 1 client.17805 shutdown 2024-09-12T01:38:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5896bfe740 1 -- 172.21.15.81:0/1866738710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 msgr2=0x561f04fe4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5896bfe740 1 --2- 172.21.15.81:0/1866738710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 0x561f04fe4fd0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f58840bc0a0 tx=0x7f5884005d50 comp rx=0 tx=0).stop 2024-09-12T01:38:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5896bfe740 1 -- 172.21.15.81:0/1866738710 shutdown_connections 2024-09-12T01:38:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5896bfe740 1 --2- 172.21.15.81:0/1866738710 >> [v2:172.21.15.100:6832/2684949307,v1:172.21.15.100:6833/2684949307] conn(0x561f0505c460 0x561f0505e880 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5896bfe740 1 --2- 172.21.15.81:0/1866738710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f04fe1370 0x561f04fe5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5896bfe740 1 --2- 172.21.15.81:0/1866738710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f04fd7b40 0x561f04fe4fd0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5875ffb640 0 client.17805 ms_handle_reset on v2:172.21.15.100:6832/2684949307 2024-09-12T01:38:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5896bfe740 1 --2- 172.21.15.81:0/1866738710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f04fd65d0 0x561f04fe9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5896bfe740 1 -- 172.21.15.81:0/1866738710 >> 172.21.15.81:0/1866738710 conn(0x561f04f9f310 msgr2=0x561f04fd14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5896bfe740 1 -- 172.21.15.81:0/1866738710 shutdown_connections 2024-09-12T01:38:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5896bfe740 1 -- 172.21.15.81:0/1866738710 wait complete. 2024-09-12T01:38:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5896bfe740 20 client.17805 trim_cache size 0 max 16384 2024-09-12T01:38:21.015 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:38:21.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5894825640 1 -- 172.21.15.81:0/128469004 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f58780a2cf0 msgr2=0x7f58780a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:21.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5894825640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f58780a2cf0 0x7f58780a51b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5888020000 tx=0x7f588801c030 comp rx=0 tx=0).stop 2024-09-12T01:38:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5894825640 1 -- 172.21.15.81:0/128469004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5890103740 msgr2=0x7f5890198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5894825640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5890103740 0x7f5890198b70 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f588402a940 tx=0x7f5884003c00 comp rx=0 tx=0).stop 2024-09-12T01:38:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5894825640 1 -- 172.21.15.81:0/128469004 shutdown_connections 2024-09-12T01:38:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5894825640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f58780a2cf0 0x7f58780a51b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5894825640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5890108290 0x7f589019cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5894825640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5890103740 0x7f5890198b70 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5894825640 1 --2- 172.21.15.81:0/128469004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5890102d90 0x7f5890198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.002+0000 7f5894825640 1 -- 172.21.15.81:0/128469004 >> 172.21.15.81:0/128469004 conn(0x7f58900fc7d0 msgr2=0x7f5890105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.003+0000 7f5894825640 1 -- 172.21.15.81:0/128469004 shutdown_connections 2024-09-12T01:38:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:21.003+0000 7f5894825640 1 -- 172.21.15.81:0/128469004 wait complete. 2024-09-12T01:38:21.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:20 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-12T01:38:21.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:20 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-12T01:38:21.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:20 smithi100 ceph-mon[35275]: Unable to set osd_memory_target on smithi189 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-12T01:38:21.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:20 smithi100 ceph-mon[35275]: Unable to set osd_memory_target on smithi100 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-12T01:38:21.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:20 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:21.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:20 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:21.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:20 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi189 to 176.0M 2024-09-12T01:38:21.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:20 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-12T01:38:21.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:20 smithi189 ceph-mon[35357]: Unable to set osd_memory_target on smithi189 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-12T01:38:21.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:20 smithi189 ceph-mon[35357]: Unable to set osd_memory_target on smithi100 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-12T01:38:21.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:20 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:21.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:20 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:21.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:38:21.920 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:21.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:21 smithi081 ceph-mon[30920]: pgmap v319: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-12T01:38:21.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:21 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:21.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:21 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:21.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:21 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:21.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:21 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:21.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:21 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:21.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:21 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:38:21.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:21 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:22.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:21 smithi100 ceph-mon[35275]: pgmap v319: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-12T01:38:22.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:21 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:22.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:21 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:22.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:21 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:22.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:21 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:22.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:21 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:22.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:21 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:38:22.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:21 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:22.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:21 smithi189 ceph-mon[35357]: pgmap v319: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-12T01:38:22.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:21 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:22.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:21 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:22.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:21 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:22.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:21 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:22.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:21 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:22.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:21 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:38:22.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:21 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' 2024-09-12T01:38:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.353+0000 7fde5400e640 1 -- 172.21.15.81:0/536698634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c100a80 msgr2=0x7fde4c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.353+0000 7fde5400e640 1 --2- 172.21.15.81:0/536698634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c100a80 0x7fde4c100ee0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009930 tx=0x7fde3c02a420 comp rx=0 tx=0).stop 2024-09-12T01:38:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 -- 172.21.15.81:0/536698634 shutdown_connections 2024-09-12T01:38:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 --2- 172.21.15.81:0/536698634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde4c101420 0x7fde4c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 --2- 172.21.15.81:0/536698634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c100a80 0x7fde4c100ee0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 --2- 172.21.15.81:0/536698634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde4c106a80 0x7fde4c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 -- 172.21.15.81:0/536698634 >> 172.21.15.81:0/536698634 conn(0x7fde4c0fc7a0 msgr2=0x7fde4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 -- 172.21.15.81:0/536698634 shutdown_connections 2024-09-12T01:38:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 -- 172.21.15.81:0/536698634 wait complete. 2024-09-12T01:38:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 Processor -- start 2024-09-12T01:38:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 -- start start 2024-09-12T01:38:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde4c100a80 0x7fde4c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c101420 0x7fde4c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde4c106a80 0x7fde4c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c110e80 con 0x7fde4c101420 2024-09-12T01:38:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c110d00 con 0x7fde4c100a80 2024-09-12T01:38:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.354+0000 7fde5400e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c111000 con 0x7fde4c106a80 2024-09-12T01:38:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde515a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c101420 0x7fde4c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde515a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c101420 0x7fde4c1989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51212/0 (socket says 172.21.15.81:51212) 2024-09-12T01:38:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde515a9640 1 -- 172.21.15.81:0/1094355290 learned_addr learned my addr 172.21.15.81:0/1094355290 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde525ab640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde4c106a80 0x7fde4c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde51daa640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde4c100a80 0x7fde4c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde515a9640 1 -- 172.21.15.81:0/1094355290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde4c106a80 msgr2=0x7fde4c19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde515a9640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde4c106a80 0x7fde4c19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde515a9640 1 -- 172.21.15.81:0/1094355290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde4c100a80 msgr2=0x7fde4c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde515a9640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde4c100a80 0x7fde4c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde515a9640 1 -- 172.21.15.81:0/1094355290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4c19d450 con 0x7fde4c101420 2024-09-12T01:38:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde515a9640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c101420 0x7fde4c1989e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009230 tx=0x7fde3c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde42ffd640 1 -- 172.21.15.81:0/1094355290 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c03f030 con 0x7fde4c101420 2024-09-12T01:38:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde42ffd640 1 -- 172.21.15.81:0/1094355290 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde3c004440 con 0x7fde4c101420 2024-09-12T01:38:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde5400e640 1 -- 172.21.15.81:0/1094355290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4c19d6e0 con 0x7fde4c101420 2024-09-12T01:38:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde42ffd640 1 -- 172.21.15.81:0/1094355290 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c035070 con 0x7fde4c101420 2024-09-12T01:38:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.355+0000 7fde5400e640 1 -- 172.21.15.81:0/1094355290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde4c1a5020 con 0x7fde4c101420 2024-09-12T01:38:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.357+0000 7fde42ffd640 1 -- 172.21.15.81:0/1094355290 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fde3c042030 con 0x7fde4c101420 2024-09-12T01:38:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde563e7740 1 Processor -- start 2024-09-12T01:38:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde563e7740 1 -- start start 2024-09-12T01:38:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde563e7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf47bfb40 0x556bf47be090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde563e7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 0x556bf47bea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde563e7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47c9370 0x556bf47cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde563e7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556bf47242f0 con 0x556bf47be5d0 2024-09-12T01:38:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde563e7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556bf46cbcf0 con 0x556bf47bfb40 2024-09-12T01:38:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde563e7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556bf47202b0 con 0x556bf47c9370 2024-09-12T01:38:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde42ffd640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fde380a2cf0 0x7fde380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde51daa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 0x556bf47bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde51daa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 0x556bf47bea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51224/0 (socket says 172.21.15.81:51224) 2024-09-12T01:38:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde51daa640 1 -- 172.21.15.81:0/73348985 learned_addr learned my addr 172.21.15.81:0/73348985 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde525ab640 1 --2- 172.21.15.81:0/73348985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf47bfb40 0x556bf47be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde515a9640 1 --2- 172.21.15.81:0/73348985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47c9370 0x556bf47cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.358+0000 7fde525ab640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fde380a2cf0 0x7fde380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.359+0000 7fde42ffd640 1 -- 172.21.15.81:0/1094355290 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fde3c0ef890 con 0x7fde4c101420 2024-09-12T01:38:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.359+0000 7fde51daa640 1 -- 172.21.15.81:0/73348985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47c9370 msgr2=0x556bf47cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.359+0000 7fde51daa640 1 --2- 172.21.15.81:0/73348985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47c9370 0x556bf47cb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.359+0000 7fde51daa640 1 -- 172.21.15.81:0/73348985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf47bfb40 msgr2=0x556bf47be090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.359+0000 7fde51daa640 1 --2- 172.21.15.81:0/73348985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf47bfb40 0x556bf47be090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.359+0000 7fde51daa640 1 -- 172.21.15.81:0/73348985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bf46b03a0 con 0x556bf47be5d0 2024-09-12T01:38:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.359+0000 7fde51daa640 1 --2- 172.21.15.81:0/73348985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 0x556bf47bea10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fde48009c00 tx=0x7fde480117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a0136f803b6961 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.359+0000 7fde525ab640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fde380a2cf0 0x7fde380a51b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fde44005c40 tx=0x7fde44009500 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.359+0000 7fde37fff640 1 -- 172.21.15.81:0/73348985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48012450 con 0x556bf47be5d0 2024-09-12T01:38:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.359+0000 7fde37fff640 1 -- 172.21.15.81:0/73348985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde48012ad0 con 0x556bf47be5d0 2024-09-12T01:38:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.359+0000 7fde37fff640 1 -- 172.21.15.81:0/73348985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4800fab0 con 0x556bf47be5d0 2024-09-12T01:38:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.360+0000 7fde563e7740 1 -- 172.21.15.81:0/73348985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 msgr2=0x556bf47bea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.360+0000 7fde563e7740 1 --2- 172.21.15.81:0/73348985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 0x556bf47bea10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fde48009c00 tx=0x7fde480117b0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.360+0000 7fde563e7740 1 -- 172.21.15.81:0/73348985 shutdown_connections 2024-09-12T01:38:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.360+0000 7fde563e7740 1 --2- 172.21.15.81:0/73348985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47c9370 0x556bf47cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.360+0000 7fde563e7740 1 --2- 172.21.15.81:0/73348985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 0x556bf47bea10 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.360+0000 7fde563e7740 1 --2- 172.21.15.81:0/73348985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf47bfb40 0x556bf47be090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.360+0000 7fde563e7740 1 -- 172.21.15.81:0/73348985 >> 172.21.15.81:0/73348985 conn(0x556bf4787310 msgr2=0x556bf47bac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.360+0000 7fde563e7740 1 -- 172.21.15.81:0/73348985 shutdown_connections 2024-09-12T01:38:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.360+0000 7fde563e7740 1 -- 172.21.15.81:0/73348985 wait complete. 2024-09-12T01:38:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.360+0000 7fde563e7740 1 -- start start 2024-09-12T01:38:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.360+0000 7fde563e7740 1 Processor -- start 2024-09-12T01:38:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde563e7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 0x556bf47c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde563e7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf47bfb40 0x556bf47c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde563e7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47c9370 0x556bf47c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde563e7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556bf47cc070 con 0x556bf47be5d0 2024-09-12T01:38:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde563e7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556bf46df060 con 0x556bf47bfb40 2024-09-12T01:38:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde563e7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556bf47cc1f0 con 0x556bf47c9370 2024-09-12T01:38:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde563e7740 10 client.0 _ll_register_callbacks cb 0x556bf44328c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde51daa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 0x556bf47c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde51daa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 0x556bf47c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51238/0 (socket says 172.21.15.81:51238) 2024-09-12T01:38:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde51daa640 1 -- 172.21.15.81:0/1429315842 learned_addr learned my addr 172.21.15.81:0/1429315842 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde515a9640 1 --2- 172.21.15.81:0/1429315842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf47bfb40 0x556bf47c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde525ab640 1 --2- 172.21.15.81:0/1429315842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47c9370 0x556bf47c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde51daa640 1 -- 172.21.15.81:0/1429315842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47c9370 msgr2=0x556bf47c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde51daa640 1 --2- 172.21.15.81:0/1429315842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47c9370 0x556bf47c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde51daa640 1 -- 172.21.15.81:0/1429315842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf47bfb40 msgr2=0x556bf47c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde51daa640 1 --2- 172.21.15.81:0/1429315842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf47bfb40 0x556bf47c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde51daa640 1 -- 172.21.15.81:0/1429315842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bf44953c0 con 0x556bf47be5d0 2024-09-12T01:38:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde51daa640 1 --2- 172.21.15.81:0/1429315842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 0x556bf47c8cb0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fde48000c00 tx=0x7fde48009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606e17edb6131e4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde357fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde357fa640 1 -- 172.21.15.81:0/1429315842 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48029020 con 0x556bf47be5d0 2024-09-12T01:38:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde357fa640 1 -- 172.21.15.81:0/1429315842 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fde48012660 con 0x556bf47be5d0 2024-09-12T01:38:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.361+0000 7fde563e7740 1 -- 172.21.15.81:0/1429315842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde48012ad0 con 0x556bf47be5d0 2024-09-12T01:38:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.362+0000 7fde357fa640 1 -- 172.21.15.81:0/1429315842 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fde48034050 con 0x556bf47be5d0 2024-09-12T01:38:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.362+0000 7fde563e7740 10 client.17817 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.362+0000 7fde563e7740 1 -- 172.21.15.81:0/1429315842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556bf47d7a60 con 0x556bf47be5d0 2024-09-12T01:38:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.362+0000 7fde357fa640 1 -- 172.21.15.81:0/1429315842 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde48012ad0 con 0x556bf47be5d0 2024-09-12T01:38:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.362+0000 7fde357fa640 1 -- 172.21.15.81:0/1429315842 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fde480035f0 con 0x556bf47be5d0 2024-09-12T01:38:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.362+0000 7fde563e7740 10 client.17817 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.362+0000 7fde563e7740 10 client.17817 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:38:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.362+0000 7fde563e7740 20 client.17817 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.362+0000 7fde563e7740 1 --2- 172.21.15.81:0/1429315842 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x556bf47d8f20 0x556bf47db310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.362+0000 7fde563e7740 4 client.17817 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.362+0000 7fde563e7740 1 -- 172.21.15.81:0/1429315842 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bf4731860 con 0x556bf47d8f20 2024-09-12T01:38:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.362+0000 7fde515a9640 1 --2- 172.21.15.81:0/1429315842 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x556bf47d8f20 0x556bf47db310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.363+0000 7fde357fa640 10 client.17817 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:38:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.363+0000 7fde515a9640 1 --2- 172.21.15.81:0/1429315842 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x556bf47d8f20 0x556bf47db310 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ece0f3e595d8b5f4 server_cookie=990c0fda699bcd31 in_seq=0 out_seq=0 2024-09-12T01:38:22.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.363+0000 7fde357fa640 1 -- 172.21.15.81:0/1429315842 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556bf4731860 con 0x556bf47d8f20 2024-09-12T01:38:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.363+0000 7fde357fa640 10 client.17817 handle_command_reply: tid=0 2024-09-12T01:38:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.364+0000 7fde563e7740 1 client.17817 shutdown 2024-09-12T01:38:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.364+0000 7fde563e7740 1 -- 172.21.15.81:0/1429315842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 msgr2=0x556bf47c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.364+0000 7fde563e7740 1 --2- 172.21.15.81:0/1429315842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 0x556bf47c8cb0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fde48000c00 tx=0x7fde48009f20 comp rx=0 tx=0).stop 2024-09-12T01:38:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.364+0000 7fde563e7740 1 -- 172.21.15.81:0/1429315842 shutdown_connections 2024-09-12T01:38:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.364+0000 7fde563e7740 1 --2- 172.21.15.81:0/1429315842 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x556bf47d8f20 0x556bf47db310 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.364+0000 7fde563e7740 1 --2- 172.21.15.81:0/1429315842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47c9370 0x556bf47c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.364+0000 7fde563e7740 1 --2- 172.21.15.81:0/1429315842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf47bfb40 0x556bf47c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.364+0000 7fde357fa640 0 client.17817 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:38:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.364+0000 7fde563e7740 1 --2- 172.21.15.81:0/1429315842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47be5d0 0x556bf47c8cb0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.364+0000 7fde563e7740 1 -- 172.21.15.81:0/1429315842 >> 172.21.15.81:0/1429315842 conn(0x556bf4787310 msgr2=0x556bf47c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:22.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.364+0000 7fde563e7740 1 -- 172.21.15.81:0/1429315842 shutdown_connections 2024-09-12T01:38:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.364+0000 7fde563e7740 1 -- 172.21.15.81:0/1429315842 wait complete. 2024-09-12T01:38:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.364+0000 7fde563e7740 20 client.17817 trim_cache size 0 max 16384 2024-09-12T01:38:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde563e7740 1 Processor -- start 2024-09-12T01:38:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde563e7740 1 -- start start 2024-09-12T01:38:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde563e7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf4787310 0x556bf47d5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde563e7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47be5d0 0x556bf47b9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde563e7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 0x556bf47e09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde563e7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1ad8c0 con 0x556bf47bfb40 2024-09-12T01:38:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde563e7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1af400 con 0x556bf4787310 2024-09-12T01:38:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde563e7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1adf90 con 0x556bf47be5d0 2024-09-12T01:38:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde525ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 0x556bf47e09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde525ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 0x556bf47e09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51244/0 (socket says 172.21.15.81:51244) 2024-09-12T01:38:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde525ab640 1 -- 172.21.15.81:0/2101947059 learned_addr learned my addr 172.21.15.81:0/2101947059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde51daa640 1 --2- 172.21.15.81:0/2101947059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf4787310 0x556bf47d5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde515a9640 1 --2- 172.21.15.81:0/2101947059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47be5d0 0x556bf47b9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde525ab640 1 -- 172.21.15.81:0/2101947059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47be5d0 msgr2=0x556bf47b9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde525ab640 1 --2- 172.21.15.81:0/2101947059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47be5d0 0x556bf47b9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde525ab640 1 -- 172.21.15.81:0/2101947059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf4787310 msgr2=0x556bf47d5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde525ab640 1 --2- 172.21.15.81:0/2101947059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf4787310 0x556bf47d5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde525ab640 1 -- 172.21.15.81:0/2101947059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bf47c44b0 con 0x556bf47bfb40 2024-09-12T01:38:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde51daa640 1 --2- 172.21.15.81:0/2101947059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf4787310 0x556bf47d5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde515a9640 1 --2- 172.21.15.81:0/2101947059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47be5d0 0x556bf47b9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde525ab640 1 --2- 172.21.15.81:0/2101947059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 0x556bf47e09a0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fde44012920 tx=0x7fde44009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a389a3cb349cee9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde377fe640 1 -- 172.21.15.81:0/2101947059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44003e00 con 0x556bf47bfb40 2024-09-12T01:38:22.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde377fe640 1 -- 172.21.15.81:0/2101947059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde44012d30 con 0x556bf47bfb40 2024-09-12T01:38:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.377+0000 7fde377fe640 1 -- 172.21.15.81:0/2101947059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44005280 con 0x556bf47bfb40 2024-09-12T01:38:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.378+0000 7fde563e7740 1 -- 172.21.15.81:0/2101947059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 msgr2=0x556bf47e09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.378+0000 7fde563e7740 1 --2- 172.21.15.81:0/2101947059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 0x556bf47e09a0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fde44012920 tx=0x7fde44009a00 comp rx=0 tx=0).stop 2024-09-12T01:38:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.378+0000 7fde563e7740 1 -- 172.21.15.81:0/2101947059 shutdown_connections 2024-09-12T01:38:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.378+0000 7fde563e7740 1 --2- 172.21.15.81:0/2101947059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 0x556bf47e09a0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.378+0000 7fde563e7740 1 --2- 172.21.15.81:0/2101947059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47be5d0 0x556bf47b9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.378+0000 7fde563e7740 1 --2- 172.21.15.81:0/2101947059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf4787310 0x556bf47d5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.378+0000 7fde563e7740 1 -- 172.21.15.81:0/2101947059 >> 172.21.15.81:0/2101947059 conn(0x556bf47c6600 msgr2=0x556bf47b94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.378+0000 7fde563e7740 1 -- 172.21.15.81:0/2101947059 shutdown_connections 2024-09-12T01:38:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.378+0000 7fde563e7740 1 -- 172.21.15.81:0/2101947059 wait complete. 2024-09-12T01:38:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.378+0000 7fde563e7740 1 -- start start 2024-09-12T01:38:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.378+0000 7fde563e7740 1 Processor -- start 2024-09-12T01:38:22.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde563e7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf4787310 0x556bf47d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde563e7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47be5d0 0x556bf47ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde563e7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 0x556bf47cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde563e7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1aed30 con 0x556bf47bfb40 2024-09-12T01:38:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde563e7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1ae660 con 0x556bf4787310 2024-09-12T01:38:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde563e7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1ab8c0 con 0x556bf47be5d0 2024-09-12T01:38:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde563e7740 10 client.0 _ll_register_callbacks cb 0x7fde44009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde525ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 0x556bf47cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde525ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 0x556bf47cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51246/0 (socket says 172.21.15.81:51246) 2024-09-12T01:38:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde525ab640 1 -- 172.21.15.81:0/3334374190 learned_addr learned my addr 172.21.15.81:0/3334374190 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde515a9640 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47be5d0 0x556bf47ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde525ab640 1 -- 172.21.15.81:0/3334374190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47be5d0 msgr2=0x556bf47ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde51daa640 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf4787310 0x556bf47d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde525ab640 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47be5d0 0x556bf47ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde525ab640 1 -- 172.21.15.81:0/3334374190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf4787310 msgr2=0x556bf47d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde525ab640 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf4787310 0x556bf47d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde525ab640 1 -- 172.21.15.81:0/3334374190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bf47cdd20 con 0x556bf47bfb40 2024-09-12T01:38:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde51daa640 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf4787310 0x556bf47d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde525ab640 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 0x556bf47cd4f0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fde44012f90 tx=0x7fde44009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97af1d8274bab65b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.379+0000 7fde357fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde357fa640 1 -- 172.21.15.81:0/3334374190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4401b040 con 0x556bf47bfb40 2024-09-12T01:38:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde357fa640 1 -- 172.21.15.81:0/3334374190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fde4400f450 con 0x556bf47bfb40 2024-09-12T01:38:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde563e7740 1 -- 172.21.15.81:0/3334374190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde44012d30 con 0x556bf47bfb40 2024-09-12T01:38:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde357fa640 1 -- 172.21.15.81:0/3334374190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fde4400f650 con 0x556bf47bfb40 2024-09-12T01:38:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde563e7740 10 client.17823 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde563e7740 1 -- 172.21.15.81:0/3334374190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556bf4843970 con 0x556bf47bfb40 2024-09-12T01:38:22.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde357fa640 1 -- 172.21.15.81:0/3334374190 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde44012d30 con 0x556bf47bfb40 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde357fa640 1 -- 172.21.15.81:0/3334374190 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fde44029030 con 0x556bf47bfb40 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde563e7740 10 client.17823 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde563e7740 10 client.17823 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde563e7740 20 client.17823 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde563e7740 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x556bf47c9370 0x556bf4846020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde563e7740 4 client.17823 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.380+0000 7fde563e7740 1 -- 172.21.15.81:0/3334374190 --> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556bf472bd70 con 0x556bf47c9370 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde51daa640 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x556bf47c9370 0x556bf4846020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde357fa640 10 client.17823 ms_handle_connect on v2:172.21.15.100:6836/2276544763 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde51daa640 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x556bf47c9370 0x556bf4846020 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ad47c017ce0fa1b server_cookie=213944fee8dcd271 in_seq=0 out_seq=0 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde357fa640 1 -- 172.21.15.81:0/3334374190 <== mds.2 v2:172.21.15.100:6836/2276544763 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556bf472bd70 con 0x556bf47c9370 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde357fa640 10 client.17823 handle_command_reply: tid=0 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde563e7740 1 client.17823 shutdown 2024-09-12T01:38:22.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde563e7740 1 -- 172.21.15.81:0/3334374190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 msgr2=0x556bf47cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde563e7740 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 0x556bf47cd4f0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fde44012f90 tx=0x7fde44009970 comp rx=0 tx=0).stop 2024-09-12T01:38:22.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde563e7740 1 -- 172.21.15.81:0/3334374190 shutdown_connections 2024-09-12T01:38:22.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde563e7740 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.100:6836/2276544763,v1:172.21.15.100:6837/2276544763] conn(0x556bf47c9370 0x556bf4846020 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde563e7740 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bf47bfb40 0x556bf47cd4f0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde563e7740 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556bf47be5d0 0x556bf47ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde357fa640 0 client.17823 ms_handle_reset on v2:172.21.15.100:6836/2276544763 2024-09-12T01:38:22.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde563e7740 1 --2- 172.21.15.81:0/3334374190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556bf4787310 0x556bf47d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.381+0000 7fde563e7740 1 -- 172.21.15.81:0/3334374190 >> 172.21.15.81:0/3334374190 conn(0x556bf47c6600 msgr2=0x556bf47b9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:22.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.382+0000 7fde563e7740 1 -- 172.21.15.81:0/3334374190 shutdown_connections 2024-09-12T01:38:22.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.382+0000 7fde563e7740 1 -- 172.21.15.81:0/3334374190 wait complete. 2024-09-12T01:38:22.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.382+0000 7fde563e7740 20 client.17823 trim_cache size 0 max 16384 2024-09-12T01:38:22.399 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:38:22.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.382+0000 7fde5400e640 1 -- 172.21.15.81:0/1094355290 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fde380a2cf0 msgr2=0x7fde380a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.382+0000 7fde5400e640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fde380a2cf0 0x7fde380a51b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fde44005c40 tx=0x7fde44009500 comp rx=0 tx=0).stop 2024-09-12T01:38:22.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.382+0000 7fde5400e640 1 -- 172.21.15.81:0/1094355290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c101420 msgr2=0x7fde4c1989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.382+0000 7fde5400e640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c101420 0x7fde4c1989e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009230 tx=0x7fde3c004040 comp rx=0 tx=0).stop 2024-09-12T01:38:22.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.382+0000 7fde5400e640 1 -- 172.21.15.81:0/1094355290 shutdown_connections 2024-09-12T01:38:22.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.382+0000 7fde5400e640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fde380a2cf0 0x7fde380a51b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.382+0000 7fde5400e640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde4c106a80 0x7fde4c19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.382+0000 7fde5400e640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4c101420 0x7fde4c1989e0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.382+0000 7fde5400e640 1 --2- 172.21.15.81:0/1094355290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde4c100a80 0x7fde4c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.382+0000 7fde5400e640 1 -- 172.21.15.81:0/1094355290 >> 172.21.15.81:0/1094355290 conn(0x7fde4c0fc7a0 msgr2=0x7fde4c06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:22.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.383+0000 7fde5400e640 1 -- 172.21.15.81:0/1094355290 shutdown_connections 2024-09-12T01:38:22.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:22.383+0000 7fde5400e640 1 -- 172.21.15.81:0/1094355290 wait complete. 2024-09-12T01:38:22.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:22 smithi081 ceph-mon[30920]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-12T01:38:22.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:22 smithi081 ceph-mon[30920]: Unable to set osd_memory_target on smithi081 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-12T01:38:23.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:22 smithi100 ceph-mon[35275]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-12T01:38:23.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:22 smithi100 ceph-mon[35275]: Unable to set osd_memory_target on smithi081 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-12T01:38:23.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:22 smithi189 ceph-mon[35357]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-12T01:38:23.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:22 smithi189 ceph-mon[35357]: Unable to set osd_memory_target on smithi081 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-12T01:38:23.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:38:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:23.772 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:23 smithi081 ceph-mon[30920]: pgmap v320: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-12T01:38:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.854+0000 7f3b3dcef640 1 -- 172.21.15.81:0/681183326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38106f40 msgr2=0x7f3b3810eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.854+0000 7f3b3dcef640 1 --2- 172.21.15.81:0/681183326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38106f40 0x7f3b3810eac0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009ca0 tx=0x7f3b3002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.854+0000 7f3b3dcef640 1 -- 172.21.15.81:0/681183326 shutdown_connections 2024-09-12T01:38:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.854+0000 7f3b3dcef640 1 --2- 172.21.15.81:0/681183326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38106f40 0x7f3b3810eac0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.854+0000 7f3b3dcef640 1 --2- 172.21.15.81:0/681183326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b381027c0 0x7f3b38106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.854+0000 7f3b3dcef640 1 --2- 172.21.15.81:0/681183326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38101e10 0x7f3b381021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.854+0000 7f3b3dcef640 1 -- 172.21.15.81:0/681183326 >> 172.21.15.81:0/681183326 conn(0x7f3b380fd8d0 msgr2=0x7f3b380ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.854+0000 7f3b3dcef640 1 -- 172.21.15.81:0/681183326 shutdown_connections 2024-09-12T01:38:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.854+0000 7f3b3dcef640 1 -- 172.21.15.81:0/681183326 wait complete. 2024-09-12T01:38:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.854+0000 7f3b3dcef640 1 Processor -- start 2024-09-12T01:38:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.854+0000 7f3b3dcef640 1 -- start start 2024-09-12T01:38:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b3dcef640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b38101e10 0x7f3b381983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b3dcef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b381027c0 0x7f3b38198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b3dcef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38106f40 0x7f3b3819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b3dcef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b38111fa0 con 0x7f3b38106f40 2024-09-12T01:38:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b3dcef640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b38111e20 con 0x7f3b381027c0 2024-09-12T01:38:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b3dcef640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b38112120 con 0x7f3b38101e10 2024-09-12T01:38:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b37fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38106f40 0x7f3b3819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b37fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38106f40 0x7f3b3819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51254/0 (socket says 172.21.15.81:51254) 2024-09-12T01:38:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b37fff640 1 -- 172.21.15.81:0/4161049886 learned_addr learned my addr 172.21.15.81:0/4161049886 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b381027c0 0x7f3b38198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b377fe640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b38101e10 0x7f3b381983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b37fff640 1 -- 172.21.15.81:0/4161049886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b38101e10 msgr2=0x7f3b381983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b37fff640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b38101e10 0x7f3b381983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b37fff640 1 -- 172.21.15.81:0/4161049886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b381027c0 msgr2=0x7f3b38198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b37fff640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b381027c0 0x7f3b38198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b37fff640 1 -- 172.21.15.81:0/4161049886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3819d390 con 0x7f3b38106f40 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b37fff640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38106f40 0x7f3b3819ccb0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f3b30031a20 tx=0x7f3b30031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b34ff9640 1 -- 172.21.15.81:0/4161049886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30003b70 con 0x7f3b38106f40 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b34ff9640 1 -- 172.21.15.81:0/4161049886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b30003d10 con 0x7f3b38106f40 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b3dcef640 1 -- 172.21.15.81:0/4161049886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3819d620 con 0x7f3b38106f40 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.855+0000 7f3b34ff9640 1 -- 172.21.15.81:0/4161049886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3002fc40 con 0x7f3b38106f40 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.856+0000 7f3b3dcef640 1 -- 172.21.15.81:0/4161049886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b381a4f60 con 0x7f3b38106f40 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.858+0000 7f3b34ff9640 1 -- 172.21.15.81:0/4161049886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f3b30004050 con 0x7f3b38106f40 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.858+0000 7f3b400c8740 1 Processor -- start 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.858+0000 7f3b400c8740 1 -- start start 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b400c8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bdb40 0x55b2584bc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b400c8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bc5d0 0x55b2584bca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b400c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b400c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b2584222f0 con 0x55b2584c7370 2024-09-12T01:38:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b400c8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b2583c9cf0 con 0x55b2584bc5d0 2024-09-12T01:38:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b400c8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b25841e2b0 con 0x55b2584bdb40 2024-09-12T01:38:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b36ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b36ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51262/0 (socket says 172.21.15.81:51262) 2024-09-12T01:38:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b36ffd640 1 -- 172.21.15.81:0/2056266994 learned_addr learned my addr 172.21.15.81:0/2056266994 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b377fe640 1 --2- 172.21.15.81:0/2056266994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bc5d0 0x55b2584bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b34ff9640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3b200a2d70 0x7f3b200a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/2056266994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bdb40 0x55b2584bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b37fff640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3b200a2d70 0x7f3b200a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b36ffd640 1 -- 172.21.15.81:0/2056266994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bdb40 msgr2=0x55b2584bc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/2056266994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bdb40 0x55b2584bc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b36ffd640 1 -- 172.21.15.81:0/2056266994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bc5d0 msgr2=0x55b2584bca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/2056266994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bc5d0 0x55b2584bca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b34ff9640 1 -- 172.21.15.81:0/4161049886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f3b300f0430 con 0x7f3b38106f40 2024-09-12T01:38:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b36ffd640 1 -- 172.21.15.81:0/2056266994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2583ae3a0 con 0x55b2584c7370 2024-09-12T01:38:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.859+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/2056266994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584c9760 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0058c0 tx=0x7f3b2c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8617f8670aed85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.860+0000 7f3b1dffb640 1 -- 172.21.15.81:0/2056266994 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00f7c0 con 0x55b2584c7370 2024-09-12T01:38:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.860+0000 7f3b37fff640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3b200a2d70 0x7f3b200a5230 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3b300edd40 tx=0x7f3b300b20a0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.860+0000 7f3b1dffb640 1 -- 172.21.15.81:0/2056266994 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b2c00fe40 con 0x55b2584c7370 2024-09-12T01:38:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.860+0000 7f3b1dffb640 1 -- 172.21.15.81:0/2056266994 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00eda0 con 0x55b2584c7370 2024-09-12T01:38:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.860+0000 7f3b400c8740 1 -- 172.21.15.81:0/2056266994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 msgr2=0x55b2584c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.860+0000 7f3b400c8740 1 --2- 172.21.15.81:0/2056266994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584c9760 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0058c0 tx=0x7f3b2c005850 comp rx=0 tx=0).stop 2024-09-12T01:38:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.860+0000 7f3b400c8740 1 -- 172.21.15.81:0/2056266994 shutdown_connections 2024-09-12T01:38:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.860+0000 7f3b400c8740 1 --2- 172.21.15.81:0/2056266994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584c9760 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.860+0000 7f3b400c8740 1 --2- 172.21.15.81:0/2056266994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bc5d0 0x55b2584bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.860+0000 7f3b400c8740 1 --2- 172.21.15.81:0/2056266994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bdb40 0x55b2584bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.860+0000 7f3b400c8740 1 -- 172.21.15.81:0/2056266994 >> 172.21.15.81:0/2056266994 conn(0x55b258485310 msgr2=0x55b2584b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.860+0000 7f3b400c8740 1 -- 172.21.15.81:0/2056266994 shutdown_connections 2024-09-12T01:38:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.860+0000 7f3b400c8740 1 -- 172.21.15.81:0/2056266994 wait complete. 2024-09-12T01:38:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.861+0000 7f3b400c8740 1 -- start start 2024-09-12T01:38:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.861+0000 7f3b400c8740 1 Processor -- start 2024-09-12T01:38:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.861+0000 7f3b400c8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bc5d0 0x55b2584c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.861+0000 7f3b400c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584bdb40 0x55b2584c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.861+0000 7f3b400c8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584c7370 0x55b2584c4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.861+0000 7f3b400c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b2584ca070 con 0x55b2584bdb40 2024-09-12T01:38:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.861+0000 7f3b400c8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b2583dd060 con 0x55b2584bc5d0 2024-09-12T01:38:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.861+0000 7f3b400c8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b2584ca1f0 con 0x55b2584c7370 2024-09-12T01:38:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.861+0000 7f3b400c8740 10 client.0 _ll_register_callbacks cb 0x55b2581308c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.861+0000 7f3b377fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584bdb40 0x55b2584c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.861+0000 7f3b377fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584bdb40 0x55b2584c40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51278/0 (socket says 172.21.15.81:51278) 2024-09-12T01:38:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.861+0000 7f3b377fe640 1 -- 172.21.15.81:0/1524007019 learned_addr learned my addr 172.21.15.81:0/1524007019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.861+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bc5d0 0x55b2584c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584c7370 0x55b2584c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b377fe640 1 -- 172.21.15.81:0/1524007019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584c7370 msgr2=0x55b2584c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b377fe640 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584c7370 0x55b2584c4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b377fe640 1 -- 172.21.15.81:0/1524007019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bc5d0 msgr2=0x55b2584c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b377fe640 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bc5d0 0x55b2584c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b377fe640 1 -- 172.21.15.81:0/1524007019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2581933c0 con 0x55b2584bdb40 2024-09-12T01:38:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bc5d0 0x55b2584c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b377fe640 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584bdb40 0x55b2584c40b0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f3b28013710 tx=0x7f3b28013bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682eb7c1058a93e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b16ffd640 1 -- 172.21.15.81:0/1524007019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28011dd0 con 0x55b2584bdb40 2024-09-12T01:38:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b400c8740 1 -- 172.21.15.81:0/1524007019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b2c00fe40 con 0x55b2584bdb40 2024-09-12T01:38:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b16ffd640 1 -- 172.21.15.81:0/1524007019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f3b28004020 con 0x55b2584bdb40 2024-09-12T01:38:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b16ffd640 1 -- 172.21.15.81:0/1524007019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b28004220 con 0x55b2584bdb40 2024-09-12T01:38:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b400c8740 10 client.17835 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b400c8740 1 -- 172.21.15.81:0/1524007019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b2584d5c20 con 0x55b2584bdb40 2024-09-12T01:38:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b16ffd640 1 -- 172.21.15.81:0/1524007019 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b2c00fe40 con 0x55b2584bdb40 2024-09-12T01:38:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b16ffd640 1 -- 172.21.15.81:0/1524007019 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3b2801a070 con 0x55b2584bdb40 2024-09-12T01:38:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b400c8740 10 client.17835 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.862+0000 7f3b400c8740 10 client.17835 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:38:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.863+0000 7f3b400c8740 20 client.17835 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.863+0000 7f3b400c8740 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b2584d70e0 0x55b2584d9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.863+0000 7f3b400c8740 4 client.17835 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.863+0000 7f3b400c8740 1 -- 172.21.15.81:0/1524007019 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b25842f860 con 0x55b2584d70e0 2024-09-12T01:38:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.863+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b2584d70e0 0x55b2584d9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.863+0000 7f3b16ffd640 10 client.17835 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:38:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.863+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b2584d70e0 0x55b2584d9510 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a4eb5c591c4cf315 server_cookie=512a58b0a1a14e5f in_seq=0 out_seq=0 2024-09-12T01:38:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b16ffd640 1 -- 172.21.15.81:0/1524007019 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b25842f860 con 0x55b2584d70e0 2024-09-12T01:38:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b16ffd640 10 client.17835 handle_command_reply: tid=0 2024-09-12T01:38:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b400c8740 1 client.17835 shutdown 2024-09-12T01:38:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b400c8740 1 -- 172.21.15.81:0/1524007019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584bdb40 msgr2=0x55b2584c40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b400c8740 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584bdb40 0x55b2584c40b0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f3b28013710 tx=0x7f3b28013bd0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b400c8740 1 -- 172.21.15.81:0/1524007019 shutdown_connections 2024-09-12T01:38:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b400c8740 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584c7370 0x55b2584c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b400c8740 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b2584d70e0 0x55b2584d9510 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b400c8740 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584bdb40 0x55b2584c40b0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b400c8740 1 --2- 172.21.15.81:0/1524007019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bc5d0 0x55b2584c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b400c8740 1 -- 172.21.15.81:0/1524007019 >> 172.21.15.81:0/1524007019 conn(0x55b258485310 msgr2=0x55b2584be960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b16ffd640 0 client.17835 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:38:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b400c8740 1 -- 172.21.15.81:0/1524007019 shutdown_connections 2024-09-12T01:38:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b400c8740 1 -- 172.21.15.81:0/1524007019 wait complete. 2024-09-12T01:38:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.864+0000 7f3b400c8740 20 client.17835 trim_cache size 0 max 16384 2024-09-12T01:38:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.877+0000 7f3b400c8740 1 Processor -- start 2024-09-12T01:38:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.877+0000 7f3b400c8740 1 -- start start 2024-09-12T01:38:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.877+0000 7f3b400c8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bc5d0 0x55b2584c3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.877+0000 7f3b400c8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bdb40 0x55b2584dee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.877+0000 7f3b400c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584df360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.877+0000 7f3b400c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381ad820 con 0x55b2584c7370 2024-09-12T01:38:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.877+0000 7f3b400c8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381af360 con 0x55b2584bdb40 2024-09-12T01:38:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.877+0000 7f3b400c8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381adef0 con 0x55b2584bc5d0 2024-09-12T01:38:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.877+0000 7f3b36ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584df360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.877+0000 7f3b36ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584df360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51280/0 (socket says 172.21.15.81:51280) 2024-09-12T01:38:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.877+0000 7f3b36ffd640 1 -- 172.21.15.81:0/708132463 learned_addr learned my addr 172.21.15.81:0/708132463 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.878+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/708132463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bc5d0 0x55b2584c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.878+0000 7f3b377fe640 1 --2- 172.21.15.81:0/708132463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bdb40 0x55b2584dee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.878+0000 7f3b36ffd640 1 -- 172.21.15.81:0/708132463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bc5d0 msgr2=0x55b2584c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.878+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/708132463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bc5d0 0x55b2584c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.878+0000 7f3b36ffd640 1 -- 172.21.15.81:0/708132463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bdb40 msgr2=0x55b2584dee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.878+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/708132463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bdb40 0x55b2584dee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.878+0000 7f3b36ffd640 1 -- 172.21.15.81:0/708132463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2584b8de0 con 0x55b2584c7370 2024-09-12T01:38:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.878+0000 7f3b377fe640 1 --2- 172.21.15.81:0/708132463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bdb40 0x55b2584dee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.878+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/708132463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584df360 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0058c0 tx=0x7f3b2c005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fab6b8ddfb8bb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.878+0000 7f3b1d7fa640 1 -- 172.21.15.81:0/708132463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c005030 con 0x55b2584c7370 2024-09-12T01:38:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.878+0000 7f3b1d7fa640 1 -- 172.21.15.81:0/708132463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b2c00e840 con 0x55b2584c7370 2024-09-12T01:38:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.878+0000 7f3b1d7fa640 1 -- 172.21.15.81:0/708132463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00f790 con 0x55b2584c7370 2024-09-12T01:38:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 -- 172.21.15.81:0/708132463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 msgr2=0x55b2584df360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 --2- 172.21.15.81:0/708132463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584df360 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0058c0 tx=0x7f3b2c005fb0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 -- 172.21.15.81:0/708132463 shutdown_connections 2024-09-12T01:38:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 --2- 172.21.15.81:0/708132463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584df360 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 --2- 172.21.15.81:0/708132463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bdb40 0x55b2584dee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 --2- 172.21.15.81:0/708132463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bc5d0 0x55b2584c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 -- 172.21.15.81:0/708132463 >> 172.21.15.81:0/708132463 conn(0x55b258485310 msgr2=0x55b2584c31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 -- 172.21.15.81:0/708132463 shutdown_connections 2024-09-12T01:38:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 -- 172.21.15.81:0/708132463 wait complete. 2024-09-12T01:38:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 -- start start 2024-09-12T01:38:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 Processor -- start 2024-09-12T01:38:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bc5d0 0x55b2584cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bdb40 0x55b2584cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.879+0000 7f3b400c8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381aec90 con 0x55b2584c7370 2024-09-12T01:38:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b400c8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381ae5c0 con 0x55b2584bdb40 2024-09-12T01:38:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b400c8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381ab820 con 0x55b2584bc5d0 2024-09-12T01:38:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b400c8740 10 client.0 _ll_register_callbacks cb 0x7f3b28009d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b36ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b36ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51284/0 (socket says 172.21.15.81:51284) 2024-09-12T01:38:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b36ffd640 1 -- 172.21.15.81:0/3179151188 learned_addr learned my addr 172.21.15.81:0/3179151188 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b377fe640 1 --2- 172.21.15.81:0/3179151188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bdb40 0x55b2584cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/3179151188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bc5d0 0x55b2584cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b36ffd640 1 -- 172.21.15.81:0/3179151188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bc5d0 msgr2=0x55b2584cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/3179151188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bc5d0 0x55b2584cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b36ffd640 1 -- 172.21.15.81:0/3179151188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bdb40 msgr2=0x55b2584cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/3179151188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bdb40 0x55b2584cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b36ffd640 1 -- 172.21.15.81:0/3179151188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2584c4bb0 con 0x55b2584c7370 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b36ffd640 1 --2- 172.21.15.81:0/3179151188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584cc450 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c001eb0 tx=0x7f3b2c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31318a0691f3ef23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b16ffd640 1 -- 172.21.15.81:0/3179151188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00eb70 con 0x55b2584c7370 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b16ffd640 1 -- 172.21.15.81:0/3179151188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f3b2c00ed10 con 0x55b2584c7370 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b400c8740 1 -- 172.21.15.81:0/3179151188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b2c00e840 con 0x55b2584c7370 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b16ffd640 1 -- 172.21.15.81:0/3179151188 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b2c0050b0 con 0x55b2584c7370 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b400c8740 10 client.17841 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.880+0000 7f3b400c8740 1 -- 172.21.15.81:0/3179151188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b25854aaf0 con 0x55b2584c7370 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.881+0000 7f3b16ffd640 1 -- 172.21.15.81:0/3179151188 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b2c00e840 con 0x55b2584c7370 2024-09-12T01:38:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.881+0000 7f3b16ffd640 1 -- 172.21.15.81:0/3179151188 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3b2c01d020 con 0x55b2584c7370 2024-09-12T01:38:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.881+0000 7f3b400c8740 10 client.17841 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.881+0000 7f3b400c8740 10 client.17841 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:38:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.881+0000 7f3b400c8740 20 client.17841 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.881+0000 7f3b400c8740 1 --2- 172.21.15.81:0/3179151188 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b25854af90 0x55b25854d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.881+0000 7f3b400c8740 4 client.17841 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:38:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.881+0000 7f3b400c8740 1 -- 172.21.15.81:0/3179151188 --> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b258429d70 con 0x55b25854af90 2024-09-12T01:38:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.881+0000 7f3b377fe640 1 --2- 172.21.15.81:0/3179151188 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b25854af90 0x55b25854d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b377fe640 1 --2- 172.21.15.81:0/3179151188 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b25854af90 0x55b25854d3b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b460d82c32a00894 server_cookie=556ad7f75d677242 in_seq=0 out_seq=0 2024-09-12T01:38:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b16ffd640 10 client.17841 ms_handle_connect on v2:172.21.15.189:6838/1856874876 2024-09-12T01:38:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b16ffd640 1 -- 172.21.15.81:0/3179151188 <== mds.1 v2:172.21.15.189:6838/1856874876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b258429d70 con 0x55b25854af90 2024-09-12T01:38:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b16ffd640 10 client.17841 handle_command_reply: tid=0 2024-09-12T01:38:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b400c8740 1 client.17841 shutdown 2024-09-12T01:38:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b400c8740 1 -- 172.21.15.81:0/3179151188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 msgr2=0x55b2584cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b400c8740 1 --2- 172.21.15.81:0/3179151188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584cc450 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c001eb0 tx=0x7f3b2c005040 comp rx=0 tx=0).stop 2024-09-12T01:38:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b400c8740 1 -- 172.21.15.81:0/3179151188 shutdown_connections 2024-09-12T01:38:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b400c8740 1 --2- 172.21.15.81:0/3179151188 >> [v2:172.21.15.189:6838/1856874876,v1:172.21.15.189:6839/1856874876] conn(0x55b25854af90 0x55b25854d3b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b400c8740 1 --2- 172.21.15.81:0/3179151188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2584c7370 0x55b2584cc450 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b16ffd640 0 client.17841 ms_handle_reset on v2:172.21.15.189:6838/1856874876 2024-09-12T01:38:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b400c8740 1 --2- 172.21.15.81:0/3179151188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2584bdb40 0x55b2584cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b400c8740 1 --2- 172.21.15.81:0/3179151188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2584bc5d0 0x55b2584cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b400c8740 1 -- 172.21.15.81:0/3179151188 >> 172.21.15.81:0/3179151188 conn(0x55b258485310 msgr2=0x55b2584b74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b400c8740 1 -- 172.21.15.81:0/3179151188 shutdown_connections 2024-09-12T01:38:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b400c8740 1 -- 172.21.15.81:0/3179151188 wait complete. 2024-09-12T01:38:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.882+0000 7f3b400c8740 20 client.17841 trim_cache size 0 max 16384 2024-09-12T01:38:23.900 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:38:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.883+0000 7f3b3dcef640 1 -- 172.21.15.81:0/4161049886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3b200a2d70 msgr2=0x7f3b200a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.883+0000 7f3b3dcef640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3b200a2d70 0x7f3b200a5230 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3b300edd40 tx=0x7f3b300b20a0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.883+0000 7f3b3dcef640 1 -- 172.21.15.81:0/4161049886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38106f40 msgr2=0x7f3b3819ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.883+0000 7f3b3dcef640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38106f40 0x7f3b3819ccb0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f3b30031a20 tx=0x7f3b30031a50 comp rx=0 tx=0).stop 2024-09-12T01:38:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.883+0000 7f3b3dcef640 1 -- 172.21.15.81:0/4161049886 shutdown_connections 2024-09-12T01:38:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.883+0000 7f3b3dcef640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3b200a2d70 0x7f3b200a5230 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.883+0000 7f3b3dcef640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b38106f40 0x7f3b3819ccb0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.883+0000 7f3b3dcef640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b381027c0 0x7f3b38198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.883+0000 7f3b3dcef640 1 --2- 172.21.15.81:0/4161049886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b38101e10 0x7f3b381983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.883+0000 7f3b3dcef640 1 -- 172.21.15.81:0/4161049886 >> 172.21.15.81:0/4161049886 conn(0x7f3b380fd8d0 msgr2=0x7f3b380fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.883+0000 7f3b3dcef640 1 -- 172.21.15.81:0/4161049886 shutdown_connections 2024-09-12T01:38:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:23.883+0000 7f3b3dcef640 1 -- 172.21.15.81:0/4161049886 wait complete. 2024-09-12T01:38:24.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:23 smithi100 ceph-mon[35275]: pgmap v320: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-12T01:38:24.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:23 smithi189 ceph-mon[35357]: pgmap v320: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-12T01:38:24.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:38:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.321+0000 7fd572b28640 1 -- 172.21.15.81:0/1158165442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd56c101420 msgr2=0x7fd56c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.321+0000 7fd572b28640 1 --2- 172.21.15.81:0/1158165442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd56c101420 0x7fd56c10d950 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fd564009cd0 tx=0x7fd56402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.321+0000 7fd572b28640 1 -- 172.21.15.81:0/1158165442 shutdown_connections 2024-09-12T01:38:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.321+0000 7fd572b28640 1 --2- 172.21.15.81:0/1158165442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd56c101420 0x7fd56c10d950 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.321+0000 7fd572b28640 1 --2- 172.21.15.81:0/1158165442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd56c100a80 0x7fd56c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.321+0000 7fd572b28640 1 --2- 172.21.15.81:0/1158165442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd56c106a80 0x7fd56c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.321+0000 7fd572b28640 1 -- 172.21.15.81:0/1158165442 >> 172.21.15.81:0/1158165442 conn(0x7fd56c0fc7a0 msgr2=0x7fd56c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.321+0000 7fd572b28640 1 -- 172.21.15.81:0/1158165442 shutdown_connections 2024-09-12T01:38:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.321+0000 7fd572b28640 1 -- 172.21.15.81:0/1158165442 wait complete. 2024-09-12T01:38:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.321+0000 7fd572b28640 1 Processor -- start 2024-09-12T01:38:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.321+0000 7fd572b28640 1 -- start start 2024-09-12T01:38:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd572b28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd56c100a80 0x7fd56c102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd572b28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd56c101420 0x7fd56c102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd572b28640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd56c106a80 0x7fd56c1030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd572b28640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c110e80 con 0x7fd56c101420 2024-09-12T01:38:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd572b28640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c110d00 con 0x7fd56c100a80 2024-09-12T01:38:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd572b28640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c111000 con 0x7fd56c106a80 2024-09-12T01:38:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd56bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd56c101420 0x7fd56c102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd56bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd56c101420 0x7fd56c102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51300/0 (socket says 172.21.15.81:51300) 2024-09-12T01:38:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd56bfff640 1 -- 172.21.15.81:0/3630851754 learned_addr learned my addr 172.21.15.81:0/3630851754 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd5708c4640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd56c100a80 0x7fd56c102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd5710c5640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd56c106a80 0x7fd56c1030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd56bfff640 1 -- 172.21.15.81:0/3630851754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd56c106a80 msgr2=0x7fd56c1030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd56bfff640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd56c106a80 0x7fd56c1030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd56bfff640 1 -- 172.21.15.81:0/3630851754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd56c100a80 msgr2=0x7fd56c102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd56bfff640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd56c100a80 0x7fd56c102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd56bfff640 1 -- 172.21.15.81:0/3630851754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd56c1a6860 con 0x7fd56c101420 2024-09-12T01:38:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd56bfff640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd56c101420 0x7fd56c102b90 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fd55800e9f0 tx=0x7fd55800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:25.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd569ffb640 1 -- 172.21.15.81:0/3630851754 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55800cd80 con 0x7fd56c101420 2024-09-12T01:38:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd572b28640 1 -- 172.21.15.81:0/3630851754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd56c1a6b50 con 0x7fd56c101420 2024-09-12T01:38:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd569ffb640 1 -- 172.21.15.81:0/3630851754 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd558010910 con 0x7fd56c101420 2024-09-12T01:38:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.322+0000 7fd569ffb640 1 -- 172.21.15.81:0/3630851754 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5580188f0 con 0x7fd56c101420 2024-09-12T01:38:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.323+0000 7fd572b28640 1 -- 172.21.15.81:0/3630851754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd56c1a70e0 con 0x7fd56c101420 2024-09-12T01:38:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.325+0000 7fd569ffb640 1 -- 172.21.15.81:0/3630851754 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fd558010ac0 con 0x7fd56c101420 2024-09-12T01:38:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.325+0000 7fd574f01740 1 Processor -- start 2024-09-12T01:38:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.325+0000 7fd574f01740 1 -- start start 2024-09-12T01:38:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.325+0000 7fd574f01740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.325+0000 7fd574f01740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 0x562b470cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.325+0000 7fd574f01740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470d9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.325+0000 7fd574f01740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562b470322f0 con 0x562b470cdb40 2024-09-12T01:38:25.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.325+0000 7fd574f01740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562b46fd9cf0 con 0x562b470d7370 2024-09-12T01:38:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.325+0000 7fd574f01740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562b4702e2b0 con 0x562b470cc5d0 2024-09-12T01:38:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd5710c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd5710c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51310/0 (socket says 172.21.15.81:51310) 2024-09-12T01:38:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd5710c5640 1 -- 172.21.15.81:0/48246520 learned_addr learned my addr 172.21.15.81:0/48246520 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd569ffb640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd55c0a2cf0 0x7fd55c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd5708c4640 1 --2- 172.21.15.81:0/48246520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 0x562b470cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd56bfff640 1 --2- 172.21.15.81:0/48246520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470d9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd5710c5640 1 -- 172.21.15.81:0/48246520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 msgr2=0x562b470cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd5710c5640 1 --2- 172.21.15.81:0/48246520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 0x562b470cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd5710c5640 1 -- 172.21.15.81:0/48246520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 msgr2=0x562b470d9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd5710c5640 1 --2- 172.21.15.81:0/48246520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470d9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd5710c5640 1 -- 172.21.15.81:0/48246520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b46fbe3a0 con 0x562b470cdb40 2024-09-12T01:38:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd56bfff640 1 --2- 172.21.15.81:0/48246520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470d9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd569ffb640 1 -- 172.21.15.81:0/3630851754 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fd5580cf9c0 con 0x7fd56c101420 2024-09-12T01:38:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd5710c5640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd55c0a2cf0 0x7fd55c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd5710c5640 1 --2- 172.21.15.81:0/48246520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470cc090 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fd564005cc0 tx=0x7fd564031580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f6faab5badb473 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd556ffd640 1 -- 172.21.15.81:0/48246520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd564031ba0 con 0x562b470cdb40 2024-09-12T01:38:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd556ffd640 1 -- 172.21.15.81:0/48246520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd564036040 con 0x562b470cdb40 2024-09-12T01:38:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.326+0000 7fd556ffd640 1 -- 172.21.15.81:0/48246520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5640307a0 con 0x562b470cdb40 2024-09-12T01:38:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.327+0000 7fd574f01740 1 -- 172.21.15.81:0/48246520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 msgr2=0x562b470cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.327+0000 7fd5710c5640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd55c0a2cf0 0x7fd55c0a51b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd56404b000 tx=0x7fd564048000 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.327+0000 7fd574f01740 1 --2- 172.21.15.81:0/48246520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470cc090 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fd564005cc0 tx=0x7fd564031580 comp rx=0 tx=0).stop 2024-09-12T01:38:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.327+0000 7fd574f01740 1 -- 172.21.15.81:0/48246520 shutdown_connections 2024-09-12T01:38:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.327+0000 7fd574f01740 1 --2- 172.21.15.81:0/48246520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470d9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.327+0000 7fd574f01740 1 --2- 172.21.15.81:0/48246520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 0x562b470cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.327+0000 7fd574f01740 1 --2- 172.21.15.81:0/48246520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470cc090 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.327+0000 7fd574f01740 1 -- 172.21.15.81:0/48246520 >> 172.21.15.81:0/48246520 conn(0x562b47095310 msgr2=0x562b470c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.327+0000 7fd574f01740 1 -- 172.21.15.81:0/48246520 shutdown_connections 2024-09-12T01:38:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.327+0000 7fd574f01740 1 -- 172.21.15.81:0/48246520 wait complete. 2024-09-12T01:38:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd574f01740 1 -- start start 2024-09-12T01:38:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd574f01740 1 Processor -- start 2024-09-12T01:38:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd574f01740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cc5d0 0x562b470d6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd574f01740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470cdb40 0x562b470d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd574f01740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470d7370 0x562b470d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd574f01740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562b470da070 con 0x562b470cc5d0 2024-09-12T01:38:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd574f01740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562b46fed060 con 0x562b470cdb40 2024-09-12T01:38:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd574f01740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562b470da1f0 con 0x562b470d7370 2024-09-12T01:38:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd574f01740 10 client.0 _ll_register_callbacks cb 0x562b46d408c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd5708c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cc5d0 0x562b470d6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd5708c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cc5d0 0x562b470d6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51326/0 (socket says 172.21.15.81:51326) 2024-09-12T01:38:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd5708c4640 1 -- 172.21.15.81:0/3674161140 learned_addr learned my addr 172.21.15.81:0/3674161140 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd56bfff640 1 --2- 172.21.15.81:0/3674161140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470cdb40 0x562b470d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd5710c5640 1 --2- 172.21.15.81:0/3674161140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470d7370 0x562b470d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd5708c4640 1 -- 172.21.15.81:0/3674161140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470d7370 msgr2=0x562b470d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd5708c4640 1 --2- 172.21.15.81:0/3674161140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470d7370 0x562b470d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd5708c4640 1 -- 172.21.15.81:0/3674161140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470cdb40 msgr2=0x562b470d3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd5708c4640 1 --2- 172.21.15.81:0/3674161140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470cdb40 0x562b470d3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.328+0000 7fd5708c4640 1 -- 172.21.15.81:0/3674161140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b46da33c0 con 0x562b470cc5d0 2024-09-12T01:38:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd5708c4640 1 --2- 172.21.15.81:0/3674161140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cc5d0 0x562b470d6d10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fd56000ce10 tx=0x7fd5600039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb440e1ff4e94287 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd54bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd54bfff640 1 -- 172.21.15.81:0/3674161140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd560011970 con 0x562b470cc5d0 2024-09-12T01:38:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd54bfff640 1 -- 172.21.15.81:0/3674161140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fd560011b10 con 0x562b470cc5d0 2024-09-12T01:38:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd574f01740 1 -- 172.21.15.81:0/3674161140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd564036040 con 0x562b470cc5d0 2024-09-12T01:38:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd54bfff640 1 -- 172.21.15.81:0/3674161140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd560011d10 con 0x562b470cc5d0 2024-09-12T01:38:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd574f01740 10 client.17853 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd574f01740 1 -- 172.21.15.81:0/3674161140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562b470e5b50 con 0x562b470cc5d0 2024-09-12T01:38:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd54bfff640 1 -- 172.21.15.81:0/3674161140 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd564036040 con 0x562b470cc5d0 2024-09-12T01:38:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd54bfff640 1 -- 172.21.15.81:0/3674161140 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd560018070 con 0x562b470cc5d0 2024-09-12T01:38:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd574f01740 10 client.17853 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd574f01740 10 client.17853 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:38:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd574f01740 20 client.17853 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd574f01740 1 --2- 172.21.15.81:0/3674161140 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562b470e7010 0x562b470e9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd574f01740 4 client.17853 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.329+0000 7fd574f01740 1 -- 172.21.15.81:0/3674161140 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b4703f860 con 0x562b470e7010 2024-09-12T01:38:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.330+0000 7fd56bfff640 1 --2- 172.21.15.81:0/3674161140 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562b470e7010 0x562b470e9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.330+0000 7fd54bfff640 10 client.17853 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.330+0000 7fd56bfff640 1 --2- 172.21.15.81:0/3674161140 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562b470e7010 0x562b470e9490 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc5a51eb6a0aa317 server_cookie=7353c13cb2198f87 in_seq=0 out_seq=0 2024-09-12T01:38:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd54bfff640 1 -- 172.21.15.81:0/3674161140 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b4703f860 con 0x562b470e7010 2024-09-12T01:38:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd54bfff640 10 client.17853 handle_command_reply: tid=0 2024-09-12T01:38:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd574f01740 1 client.17853 shutdown 2024-09-12T01:38:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd574f01740 1 -- 172.21.15.81:0/3674161140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cc5d0 msgr2=0x562b470d6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd574f01740 1 --2- 172.21.15.81:0/3674161140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cc5d0 0x562b470d6d10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fd56000ce10 tx=0x7fd5600039c0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd574f01740 1 -- 172.21.15.81:0/3674161140 shutdown_connections 2024-09-12T01:38:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd574f01740 1 --2- 172.21.15.81:0/3674161140 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562b470e7010 0x562b470e9490 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd574f01740 1 --2- 172.21.15.81:0/3674161140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470d7370 0x562b470d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd574f01740 1 --2- 172.21.15.81:0/3674161140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470cdb40 0x562b470d3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd574f01740 1 --2- 172.21.15.81:0/3674161140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cc5d0 0x562b470d6d10 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd574f01740 1 -- 172.21.15.81:0/3674161140 >> 172.21.15.81:0/3674161140 conn(0x562b47095310 msgr2=0x562b470ce930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd54bfff640 0 client.17853 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd574f01740 1 -- 172.21.15.81:0/3674161140 shutdown_connections 2024-09-12T01:38:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd574f01740 1 -- 172.21.15.81:0/3674161140 wait complete. 2024-09-12T01:38:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.331+0000 7fd574f01740 20 client.17853 trim_cache size 0 max 16384 2024-09-12T01:38:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd574f01740 1 Processor -- start 2024-09-12T01:38:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd574f01740 1 -- start start 2024-09-12T01:38:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd574f01740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 0x562b470c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd574f01740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd574f01740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd574f01740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c1afa70 con 0x562b470cdb40 2024-09-12T01:38:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd574f01740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c1b15b0 con 0x562b470d7370 2024-09-12T01:38:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd574f01740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c1b0140 con 0x562b470cc5d0 2024-09-12T01:38:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd56bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd56bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51340/0 (socket says 172.21.15.81:51340) 2024-09-12T01:38:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd56bfff640 1 -- 172.21.15.81:0/3644136586 learned_addr learned my addr 172.21.15.81:0/3644136586 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd5708c4640 1 --2- 172.21.15.81:0/3644136586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 0x562b470c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd56bfff640 1 -- 172.21.15.81:0/3644136586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 msgr2=0x562b470c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd56bfff640 1 --2- 172.21.15.81:0/3644136586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 0x562b470c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.344+0000 7fd5710c5640 1 --2- 172.21.15.81:0/3644136586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd56bfff640 1 -- 172.21.15.81:0/3644136586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 msgr2=0x562b470cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd56bfff640 1 --2- 172.21.15.81:0/3644136586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd56bfff640 1 -- 172.21.15.81:0/3644136586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b470c9730 con 0x562b470cdb40 2024-09-12T01:38:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd56bfff640 1 --2- 172.21.15.81:0/3644136586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470c8130 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fd5580982e0 tx=0x7fd558098120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b383af6646deecc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd5567fc640 1 -- 172.21.15.81:0/3644136586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5580a4af0 con 0x562b470cdb40 2024-09-12T01:38:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd5567fc640 1 -- 172.21.15.81:0/3644136586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd558099f20 con 0x562b470cdb40 2024-09-12T01:38:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd5567fc640 1 -- 172.21.15.81:0/3644136586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55809b530 con 0x562b470cdb40 2024-09-12T01:38:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd574f01740 1 -- 172.21.15.81:0/3644136586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 msgr2=0x562b470c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd574f01740 1 --2- 172.21.15.81:0/3644136586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470c8130 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fd5580982e0 tx=0x7fd558098120 comp rx=0 tx=0).stop 2024-09-12T01:38:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd574f01740 1 -- 172.21.15.81:0/3644136586 shutdown_connections 2024-09-12T01:38:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd574f01740 1 --2- 172.21.15.81:0/3644136586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd574f01740 1 --2- 172.21.15.81:0/3644136586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470c8130 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd574f01740 1 --2- 172.21.15.81:0/3644136586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 0x562b470c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd574f01740 1 -- 172.21.15.81:0/3644136586 >> 172.21.15.81:0/3644136586 conn(0x562b47095310 msgr2=0x562b470c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.345+0000 7fd574f01740 1 -- 172.21.15.81:0/3644136586 shutdown_connections 2024-09-12T01:38:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd574f01740 1 -- 172.21.15.81:0/3644136586 wait complete. 2024-09-12T01:38:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd574f01740 1 -- start start 2024-09-12T01:38:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd574f01740 1 Processor -- start 2024-09-12T01:38:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd574f01740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 0x562b470df4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd574f01740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470df9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd574f01740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470dc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd574f01740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c1b0ee0 con 0x562b470cdb40 2024-09-12T01:38:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd574f01740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c1b0810 con 0x562b470d7370 2024-09-12T01:38:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd574f01740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd56c1ada70 con 0x562b470cc5d0 2024-09-12T01:38:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd574f01740 10 client.0 _ll_register_callbacks cb 0x7fd5600040c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd56bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470df9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd56bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470df9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51350/0 (socket says 172.21.15.81:51350) 2024-09-12T01:38:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd56bfff640 1 -- 172.21.15.81:0/2405127033 learned_addr learned my addr 172.21.15.81:0/2405127033 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.346+0000 7fd5708c4640 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 0x562b470df4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd5710c5640 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470dc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd56bfff640 1 -- 172.21.15.81:0/2405127033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 msgr2=0x562b470df4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd56bfff640 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 0x562b470df4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd56bfff640 1 -- 172.21.15.81:0/2405127033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 msgr2=0x562b470dc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd56bfff640 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470dc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd56bfff640 1 -- 172.21.15.81:0/2405127033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b470dc9c0 con 0x562b470cdb40 2024-09-12T01:38:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd5708c4640 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 0x562b470df4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd5710c5640 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470dc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd56bfff640 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470df9f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fd5580d1010 tx=0x7fd5580cd020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e94d1621e6495a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd54bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T01:38:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd54bfff640 1 -- 172.21.15.81:0/2405127033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5580b8060 con 0x562b470cdb40 2024-09-12T01:38:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd54bfff640 1 -- 172.21.15.81:0/2405127033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fd5580cd330 con 0x562b470cdb40 2024-09-12T01:38:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd574f01740 1 -- 172.21.15.81:0/2405127033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd558099f20 con 0x562b470cdb40 2024-09-12T01:38:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd54bfff640 1 -- 172.21.15.81:0/2405127033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd558066050 con 0x562b470cdb40 2024-09-12T01:38:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd574f01740 10 client.17859 fetch_fsmap learned FSMap version 28 2024-09-12T01:38:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd574f01740 1 -- 172.21.15.81:0/2405127033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562b47152420 con 0x562b470cdb40 2024-09-12T01:38:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd54bfff640 1 -- 172.21.15.81:0/2405127033 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd558099f20 con 0x562b470cdb40 2024-09-12T01:38:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd54bfff640 1 -- 172.21.15.81:0/2405127033 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd558097dd0 con 0x562b470cdb40 2024-09-12T01:38:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd574f01740 10 client.17859 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:38:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd574f01740 10 client.17859 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:38:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd574f01740 20 client.17859 populate_metadata read hostname 'smithi081' 2024-09-12T01:38:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.347+0000 7fd574f01740 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562b47152a90 0x562b47154e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.348+0000 7fd574f01740 4 client.17859 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:38:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.348+0000 7fd574f01740 1 -- 172.21.15.81:0/2405127033 --> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562b47039d70 con 0x562b47152a90 2024-09-12T01:38:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.348+0000 7fd5708c4640 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562b47152a90 0x562b47154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.348+0000 7fd54bfff640 10 client.17859 ms_handle_connect on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.348+0000 7fd5708c4640 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562b47152a90 0x562b47154e80 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f6bef4850a7b387 server_cookie=630270ce5e6fb359 in_seq=0 out_seq=0 2024-09-12T01:38:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.348+0000 7fd54bfff640 1 -- 172.21.15.81:0/2405127033 <== mds.0 v2:172.21.15.100:6838/3435943351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562b47039d70 con 0x562b47152a90 2024-09-12T01:38:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.348+0000 7fd54bfff640 10 client.17859 handle_command_reply: tid=0 2024-09-12T01:38:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.348+0000 7fd574f01740 1 client.17859 shutdown 2024-09-12T01:38:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd574f01740 1 -- 172.21.15.81:0/2405127033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 msgr2=0x562b470df9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd574f01740 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470df9f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fd5580d1010 tx=0x7fd5580cd020 comp rx=0 tx=0).stop 2024-09-12T01:38:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd574f01740 1 -- 172.21.15.81:0/2405127033 shutdown_connections 2024-09-12T01:38:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd574f01740 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.100:6838/3435943351,v1:172.21.15.100:6839/3435943351] conn(0x562b47152a90 0x562b47154e80 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd574f01740 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b470d7370 0x562b470dc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd574f01740 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b470cdb40 0x562b470df9f0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd54bfff640 0 client.17859 ms_handle_reset on v2:172.21.15.100:6838/3435943351 2024-09-12T01:38:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd574f01740 1 --2- 172.21.15.81:0/2405127033 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562b470cc5d0 0x562b470df4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd574f01740 1 -- 172.21.15.81:0/2405127033 >> 172.21.15.81:0/2405127033 conn(0x562b47095310 msgr2=0x562b470c7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd574f01740 1 -- 172.21.15.81:0/2405127033 shutdown_connections 2024-09-12T01:38:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd574f01740 1 -- 172.21.15.81:0/2405127033 wait complete. 2024-09-12T01:38:25.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd574f01740 20 client.17859 trim_cache size 0 max 16384 2024-09-12T01:38:25.368 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-12T01:38:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd572b28640 1 -- 172.21.15.81:0/3630851754 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd55c0a2cf0 msgr2=0x7fd55c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd572b28640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd55c0a2cf0 0x7fd55c0a51b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd56404b000 tx=0x7fd564048000 comp rx=0 tx=0).stop 2024-09-12T01:38:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd572b28640 1 -- 172.21.15.81:0/3630851754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd56c101420 msgr2=0x7fd56c102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.349+0000 7fd572b28640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd56c101420 0x7fd56c102b90 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fd55800e9f0 tx=0x7fd55800eeb0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.350+0000 7fd572b28640 1 -- 172.21.15.81:0/3630851754 shutdown_connections 2024-09-12T01:38:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.350+0000 7fd572b28640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd55c0a2cf0 0x7fd55c0a51b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.350+0000 7fd572b28640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd56c106a80 0x7fd56c1030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.350+0000 7fd572b28640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd56c101420 0x7fd56c102b90 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.350+0000 7fd572b28640 1 --2- 172.21.15.81:0/3630851754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd56c100a80 0x7fd56c102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.350+0000 7fd572b28640 1 -- 172.21.15.81:0/3630851754 >> 172.21.15.81:0/3630851754 conn(0x7fd56c0fc7a0 msgr2=0x7fd56c06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.350+0000 7fd572b28640 1 -- 172.21.15.81:0/3630851754 shutdown_connections 2024-09-12T01:38:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:25.350+0000 7fd572b28640 1 -- 172.21.15.81:0/3630851754 wait complete. 2024-09-12T01:38:25.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:25 smithi081 ceph-mon[30920]: pgmap v321: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-12T01:38:26.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:25 smithi100 ceph-mon[35275]: pgmap v321: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-12T01:38:26.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:25 smithi189 ceph-mon[35357]: pgmap v321: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 102 B/s wr, 13 op/s 2024-09-12T01:38:26.048 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-12T01:38:26.048 INFO:tasks.fwd_scrub:done joining 2024-09-12T01:38:26.049 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T01:38:26.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.164+0000 7f422750a640 1 -- 172.21.15.81:0/806807619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4220101320 msgr2=0x7f422010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.164+0000 7f422750a640 1 --2- 172.21.15.81:0/806807619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4220101320 0x7f422010d850 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f4218009cd0 tx=0x7f421802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.164+0000 7f422750a640 1 -- 172.21.15.81:0/806807619 shutdown_connections 2024-09-12T01:38:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.164+0000 7f422750a640 1 --2- 172.21.15.81:0/806807619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4220101320 0x7f422010d850 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.164+0000 7f422750a640 1 --2- 172.21.15.81:0/806807619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4220100980 0x7f4220100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.164+0000 7f422750a640 1 --2- 172.21.15.81:0/806807619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220106990 0x7f4220106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.164+0000 7f422750a640 1 -- 172.21.15.81:0/806807619 >> 172.21.15.81:0/806807619 conn(0x7f4220077a10 msgr2=0x7f42200fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.164+0000 7f422750a640 1 -- 172.21.15.81:0/806807619 shutdown_connections 2024-09-12T01:38:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.164+0000 7f422750a640 1 -- 172.21.15.81:0/806807619 wait complete. 2024-09-12T01:38:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f422750a640 1 Processor -- start 2024-09-12T01:38:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f422750a640 1 -- start start 2024-09-12T01:38:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f422750a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4220100980 0x7f4220199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f422750a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220101320 0x7f42201997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f422750a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4220106990 0x7f42201a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f422750a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4220110e20 con 0x7f4220100980 2024-09-12T01:38:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f422750a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4220110ca0 con 0x7f4220101320 2024-09-12T01:38:26.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f422750a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4220110fa0 con 0x7f4220106990 2024-09-12T01:38:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f42252a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4220100980 0x7f4220199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f42252a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4220100980 0x7f4220199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51380/0 (socket says 172.21.15.81:51380) 2024-09-12T01:38:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f42252a6640 1 -- 172.21.15.81:0/747000886 learned_addr learned my addr 172.21.15.81:0/747000886 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f4224aa5640 1 --2- 172.21.15.81:0/747000886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220101320 0x7f42201997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f42252a6640 1 -- 172.21.15.81:0/747000886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4220106990 msgr2=0x7f42201a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f42252a6640 1 --2- 172.21.15.81:0/747000886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4220106990 0x7f42201a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f42252a6640 1 -- 172.21.15.81:0/747000886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220101320 msgr2=0x7f42201997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f42252a6640 1 --2- 172.21.15.81:0/747000886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220101320 0x7f42201997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f42252a6640 1 -- 172.21.15.81:0/747000886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42201a4830 con 0x7f4220100980 2024-09-12T01:38:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f42252a6640 1 --2- 172.21.15.81:0/747000886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4220100980 0x7f4220199270 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f421c00c890 tx=0x7f421c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f42167fc640 1 -- 172.21.15.81:0/747000886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c004220 con 0x7f4220100980 2024-09-12T01:38:26.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f42167fc640 1 -- 172.21.15.81:0/747000886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f421c0043c0 con 0x7f4220100980 2024-09-12T01:38:26.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f422750a640 1 -- 172.21.15.81:0/747000886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42201a4a00 con 0x7f4220100980 2024-09-12T01:38:26.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.165+0000 7f42167fc640 1 -- 172.21.15.81:0/747000886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c0049e0 con 0x7f4220100980 2024-09-12T01:38:26.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.166+0000 7f422750a640 1 -- 172.21.15.81:0/747000886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42201a4f20 con 0x7f4220100980 2024-09-12T01:38:26.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.166+0000 7f422750a640 1 -- 172.21.15.81:0/747000886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4220100de0 con 0x7f4220100980 2024-09-12T01:38:26.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.167+0000 7f42167fc640 1 -- 172.21.15.81:0/747000886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f421c0079b0 con 0x7f4220100980 2024-09-12T01:38:26.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.168+0000 7f42167fc640 1 --2- 172.21.15.81:0/747000886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f420c0a2d00 0x7f420c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.169+0000 7f4224aa5640 1 --2- 172.21.15.81:0/747000886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f420c0a2d00 0x7f420c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.169+0000 7f42167fc640 1 -- 172.21.15.81:0/747000886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f421c0cf730 con 0x7f4220100980 2024-09-12T01:38:26.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.169+0000 7f4224aa5640 1 --2- 172.21.15.81:0/747000886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f420c0a2d00 0x7f420c0a51c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4220069ed0 tx=0x7f4210008040 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:26.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.172+0000 7f42167fc640 1 -- 172.21.15.81:0/747000886 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f421c014030 con 0x7f4220100980 2024-09-12T01:38:26.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.341+0000 7f422750a640 1 -- 172.21.15.81:0/747000886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4220108f10 con 0x7f4220100980 2024-09-12T01:38:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.343+0000 7f42167fc640 1 -- 172.21.15.81:0/747000886 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+23181 (secure 0 0 0) 0x7f421c09c2f0 con 0x7f4220100980 2024-09-12T01:38:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:38:26.343 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":91,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","created":"2024-09-12T01:18:28.404285+0000","modified":"2024-09-12T01:38:19.417893+0000","last_up_change":"2024-09-12T01:25:26.326110+0000","last_in_change":"2024-09-12T01:25:02.138698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:21:40.649584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:26:10.753723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:26:13.254837+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":90,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc857dd4-eedc-4c48-89a0-4e69662e8e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6803","nonce":3870994528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6805","nonce":3870994528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6809","nonce":3870994528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6807","nonce":3870994528}]},"public_addr":"172.21.15.81:6803/3870994528","cluster_addr":"172.21.15.81:6805/3870994528","heartbeat_back_addr":"172.21.15.81:6809/3870994528","heartbeat_front_addr":"172.21.15.81:6807/3870994528","state":["exists","up"]},{"osd":1,"uuid":"04b8111b-d677-4fc8-8285-90683621ccf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6801","nonce":2098299652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6803","nonce":2098299652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6807","nonce":2098299652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6805","nonce":2098299652}]},"public_addr":"172.21.15.100:6801/2098299652","cluster_addr":"172.21.15.100:6803/2098299652","heartbeat_back_addr":"172.21.15.100:6807/2098299652","heartbeat_front_addr":"172.21.15.100:6805/2098299652","state":["exists","up"]},{"osd":2,"uuid":"763e357e-5a04-45ff-95e8-bc1abfeac056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6801","nonce":1353548110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6803","nonce":1353548110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6807","nonce":1353548110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6805","nonce":1353548110}]},"public_addr":"172.21.15.189:6801/1353548110","cluster_addr":"172.21.15.189:6803/1353548110","heartbeat_back_addr":"172.21.15.189:6807/1353548110","heartbeat_front_addr":"172.21.15.189:6805/1353548110","state":["exists","up"]},{"osd":3,"uuid":"99843578-1b9e-4ee0-91f1-ba419d07897e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6811","nonce":1064869637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6813","nonce":1064869637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6817","nonce":1064869637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6815","nonce":1064869637}]},"public_addr":"172.21.15.81:6811/1064869637","cluster_addr":"172.21.15.81:6813/1064869637","heartbeat_back_addr":"172.21.15.81:6817/1064869637","heartbeat_front_addr":"172.21.15.81:6815/1064869637","state":["exists","up"]},{"osd":4,"uuid":"a5787415-0905-420e-9ce8-eb6902727561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6809","nonce":1687792282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6811","nonce":1687792282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6815","nonce":1687792282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6813","nonce":1687792282}]},"public_addr":"172.21.15.100:6809/1687792282","cluster_addr":"172.21.15.100:6811/1687792282","heartbeat_back_addr":"172.21.15.100:6815/1687792282","heartbeat_front_addr":"172.21.15.100:6813/1687792282","state":["exists","up"]},{"osd":5,"uuid":"879548b5-5516-407c-8517-bbdbf356c0e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6809","nonce":823474396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6811","nonce":823474396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6815","nonce":823474396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6813","nonce":823474396}]},"public_addr":"172.21.15.189:6809/823474396","cluster_addr":"172.21.15.189:6811/823474396","heartbeat_back_addr":"172.21.15.189:6815/823474396","heartbeat_front_addr":"172.21.15.189:6813/823474396","state":["exists","up"]},{"osd":6,"uuid":"b665b97c-a9d3-475f-93f3-8a920cbb37d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6819","nonce":1522854005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6821","nonce":1522854005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6825","nonce":1522854005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6823","nonce":1522854005}]},"public_addr":"172.21.15.81:6819/1522854005","cluster_addr":"172.21.15.81:6821/1522854005","heartbeat_back_addr":"172.21.15.81:6825/1522854005","heartbeat_front_addr":"172.21.15.81:6823/1522854005","state":["exists","up"]},{"osd":7,"uuid":"46e082c8-d071-471a-8c86-ce5b5700cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6817","nonce":41478541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6819","nonce":41478541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6823","nonce":41478541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6821","nonce":41478541}]},"public_addr":"172.21.15.100:6817/41478541","cluster_addr":"172.21.15.100:6819/41478541","heartbeat_back_addr":"172.21.15.100:6823/41478541","heartbeat_front_addr":"172.21.15.100:6821/41478541","state":["exists","up"]},{"osd":8,"uuid":"fb9b93ef-5a33-4ffc-926e-a78c101bbbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6817","nonce":180766860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6819","nonce":180766860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6823","nonce":180766860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6821","nonce":180766860}]},"public_addr":"172.21.15.189:6817/180766860","cluster_addr":"172.21.15.189:6819/180766860","heartbeat_back_addr":"172.21.15.189:6823/180766860","heartbeat_front_addr":"172.21.15.189:6821/180766860","state":["exists","up"]},{"osd":9,"uuid":"0b7ec1a1-5ab9-4075-acfb-e0d82f018656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6827","nonce":1651232782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6829","nonce":1651232782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6833","nonce":1651232782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6831","nonce":1651232782}]},"public_addr":"172.21.15.81:6827/1651232782","cluster_addr":"172.21.15.81:6829/1651232782","heartbeat_back_addr":"172.21.15.81:6833/1651232782","heartbeat_front_addr":"172.21.15.81:6831/1651232782","state":["exists","up"]},{"osd":10,"uuid":"996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6825","nonce":3295868568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6827","nonce":3295868568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6831","nonce":3295868568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6829","nonce":3295868568}]},"public_addr":"172.21.15.100:6825/3295868568","cluster_addr":"172.21.15.100:6827/3295868568","heartbeat_back_addr":"172.21.15.100:6831/3295868568","heartbeat_front_addr":"172.21.15.100:6829/3295868568","state":["exists","up"]},{"osd":11,"uuid":"f051e2b2-fc58-489a-ab7c-8c1ff5448553","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6825","nonce":3852230978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6827","nonce":3852230978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6831","nonce":3852230978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6829","nonce":3852230978}]},"public_addr":"172.21.15.189:6825/3852230978","cluster_addr":"172.21.15.189:6827/3852230978","heartbeat_back_addr":"172.21.15.189:6831/3852230978","heartbeat_front_addr":"172.21.15.189:6829/3852230978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:20:47.371696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:12.762376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:37.936648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:03.950352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:28.922754+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:54.252149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:18.421479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:43.989505+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:08.789671+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:34.336367+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:59.089601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:25:23.761934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/1193015276":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/3474474725":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/682685112":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/4219073331":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/2162789959":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6800/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2577694203":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6800/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/4128337402":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2393807982":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6801/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6800/2591597081":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/1460332159":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6801/2591597081":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/1806419627":"2024-09-13T01:28:03.711343+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.345+0000 7f422750a640 1 -- 172.21.15.81:0/747000886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f420c0a2d00 msgr2=0x7f420c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.345+0000 7f422750a640 1 --2- 172.21.15.81:0/747000886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f420c0a2d00 0x7f420c0a51c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4220069ed0 tx=0x7f4210008040 comp rx=0 tx=0).stop 2024-09-12T01:38:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.345+0000 7f422750a640 1 -- 172.21.15.81:0/747000886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4220100980 msgr2=0x7f4220199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.345+0000 7f422750a640 1 --2- 172.21.15.81:0/747000886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4220100980 0x7f4220199270 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f421c00c890 tx=0x7f421c00cd50 comp rx=0 tx=0).stop 2024-09-12T01:38:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.345+0000 7f422750a640 1 -- 172.21.15.81:0/747000886 shutdown_connections 2024-09-12T01:38:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.345+0000 7f422750a640 1 --2- 172.21.15.81:0/747000886 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f420c0a2d00 0x7f420c0a51c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.345+0000 7f422750a640 1 --2- 172.21.15.81:0/747000886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4220106990 0x7f42201a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.345+0000 7f422750a640 1 --2- 172.21.15.81:0/747000886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4220101320 0x7f42201997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.345+0000 7f422750a640 1 --2- 172.21.15.81:0/747000886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4220100980 0x7f4220199270 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.345+0000 7f422750a640 1 -- 172.21.15.81:0/747000886 >> 172.21.15.81:0/747000886 conn(0x7f4220077a10 msgr2=0x7f4220103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:26.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.345+0000 7f422750a640 1 -- 172.21.15.81:0/747000886 shutdown_connections 2024-09-12T01:38:26.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.345+0000 7f422750a640 1 -- 172.21.15.81:0/747000886 wait complete. 2024-09-12T01:38:26.357 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:21:40.649584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T01:26:10.753723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T01:26:13.254837+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 90, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:38:26.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:38:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.460+0000 7f8b487c4640 1 -- 172.21.15.81:0/2904398591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b40102cf0 msgr2=0x7f8b401030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.460+0000 7f8b487c4640 1 --2- 172.21.15.81:0/2904398591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b40102cf0 0x7f8b401030d0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009ca0 tx=0x7f8b3c02a950 comp rx=0 tx=0).stop 2024-09-12T01:38:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.460+0000 7f8b487c4640 1 -- 172.21.15.81:0/2904398591 shutdown_connections 2024-09-12T01:38:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.460+0000 7f8b487c4640 1 --2- 172.21.15.81:0/2904398591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b4010c0c0 0x7f8b4010e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.460+0000 7f8b487c4640 1 --2- 172.21.15.81:0/2904398591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b40103610 0x7f8b4010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.460+0000 7f8b487c4640 1 --2- 172.21.15.81:0/2904398591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b40102cf0 0x7f8b401030d0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.460+0000 7f8b487c4640 1 -- 172.21.15.81:0/2904398591 >> 172.21.15.81:0/2904398591 conn(0x7f8b400779d0 msgr2=0x7f8b400fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.460+0000 7f8b487c4640 1 -- 172.21.15.81:0/2904398591 shutdown_connections 2024-09-12T01:38:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.460+0000 7f8b487c4640 1 -- 172.21.15.81:0/2904398591 wait complete. 2024-09-12T01:38:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.460+0000 7f8b487c4640 1 Processor -- start 2024-09-12T01:38:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b487c4640 1 -- start start 2024-09-12T01:38:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b487c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b40102cf0 0x7f8b4019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b487c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b40103610 0x7f8b4019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b487c4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b4010c0c0 0x7f8b4019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b487c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8b40111ed0 con 0x7f8b40103610 2024-09-12T01:38:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b487c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8b40111d50 con 0x7f8b40102cf0 2024-09-12T01:38:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b487c4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8b40112050 con 0x7f8b4010c0c0 2024-09-12T01:38:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b45d5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b40103610 0x7f8b4019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b45d5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b40103610 0x7f8b4019ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51398/0 (socket says 172.21.15.81:51398) 2024-09-12T01:38:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b45d5f640 1 -- 172.21.15.81:0/3887862733 learned_addr learned my addr 172.21.15.81:0/3887862733 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b46560640 1 --2- 172.21.15.81:0/3887862733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b40102cf0 0x7f8b4019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b45d5f640 1 -- 172.21.15.81:0/3887862733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b4010c0c0 msgr2=0x7f8b4019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b45d5f640 1 --2- 172.21.15.81:0/3887862733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b4010c0c0 0x7f8b4019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b45d5f640 1 -- 172.21.15.81:0/3887862733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b40102cf0 msgr2=0x7f8b4019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b45d5f640 1 --2- 172.21.15.81:0/3887862733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b40102cf0 0x7f8b4019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b45d5f640 1 -- 172.21.15.81:0/3887862733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4019f620 con 0x7f8b40103610 2024-09-12T01:38:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b45d5f640 1 --2- 172.21.15.81:0/3887862733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b40103610 0x7f8b4019ab70 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000d950 tx=0x7f8b3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b377fe640 1 -- 172.21.15.81:0/3887862733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b30017070 con 0x7f8b40103610 2024-09-12T01:38:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b487c4640 1 -- 172.21.15.81:0/3887862733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b4019f910 con 0x7f8b40103610 2024-09-12T01:38:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.461+0000 7f8b377fe640 1 -- 172.21.15.81:0/3887862733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b30009c30 con 0x7f8b40103610 2024-09-12T01:38:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.462+0000 7f8b377fe640 1 -- 172.21.15.81:0/3887862733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3000f6b0 con 0x7f8b40103610 2024-09-12T01:38:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.462+0000 7f8b487c4640 1 -- 172.21.15.81:0/3887862733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b401a71a0 con 0x7f8b40103610 2024-09-12T01:38:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.463+0000 7f8b487c4640 1 -- 172.21.15.81:0/3887862733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b401030d0 con 0x7f8b40103610 2024-09-12T01:38:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.464+0000 7f8b377fe640 1 -- 172.21.15.81:0/3887862733 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f8b300109d0 con 0x7f8b40103610 2024-09-12T01:38:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.464+0000 7f8b377fe640 1 --2- 172.21.15.81:0/3887862733 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8b2c0a2d00 0x7f8b2c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.464+0000 7f8b46560640 1 --2- 172.21.15.81:0/3887862733 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8b2c0a2d00 0x7f8b2c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.464+0000 7f8b377fe640 1 -- 172.21.15.81:0/3887862733 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f8b300cf0a0 con 0x7f8b40103610 2024-09-12T01:38:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.465+0000 7f8b46560640 1 --2- 172.21.15.81:0/3887862733 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8b2c0a2d00 0x7f8b2c0a51c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c004ad0 tx=0x7f8b3c004a60 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:26.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.468+0000 7f8b377fe640 1 -- 172.21.15.81:0/3887862733 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b30009de0 con 0x7f8b40103610 2024-09-12T01:38:26.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.635+0000 7f8b487c4640 1 -- 172.21.15.81:0/3887862733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8b401a7510 con 0x7f8b40103610 2024-09-12T01:38:26.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.635+0000 7f8b377fe640 1 -- 172.21.15.81:0/3887862733 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f8b3009bcc0 con 0x7f8b40103610 2024-09-12T01:38:26.635 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-12T01:38:26.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.637+0000 7f8b487c4640 1 -- 172.21.15.81:0/3887862733 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8b2c0a2d00 msgr2=0x7f8b2c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.637+0000 7f8b487c4640 1 --2- 172.21.15.81:0/3887862733 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8b2c0a2d00 0x7f8b2c0a51c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c004ad0 tx=0x7f8b3c004a60 comp rx=0 tx=0).stop 2024-09-12T01:38:26.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.637+0000 7f8b487c4640 1 -- 172.21.15.81:0/3887862733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b40103610 msgr2=0x7f8b4019ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.637+0000 7f8b487c4640 1 --2- 172.21.15.81:0/3887862733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b40103610 0x7f8b4019ab70 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000d950 tx=0x7f8b3000de10 comp rx=0 tx=0).stop 2024-09-12T01:38:26.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.637+0000 7f8b487c4640 1 -- 172.21.15.81:0/3887862733 shutdown_connections 2024-09-12T01:38:26.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.637+0000 7f8b487c4640 1 --2- 172.21.15.81:0/3887862733 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f8b2c0a2d00 0x7f8b2c0a51c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.637+0000 7f8b487c4640 1 --2- 172.21.15.81:0/3887862733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8b4010c0c0 0x7f8b4019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.637+0000 7f8b487c4640 1 --2- 172.21.15.81:0/3887862733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b40103610 0x7f8b4019ab70 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.637+0000 7f8b487c4640 1 --2- 172.21.15.81:0/3887862733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b40102cf0 0x7f8b4019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.637+0000 7f8b487c4640 1 -- 172.21.15.81:0/3887862733 >> 172.21.15.81:0/3887862733 conn(0x7f8b400779d0 msgr2=0x7f8b40100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:26.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.638+0000 7f8b487c4640 1 -- 172.21.15.81:0/3887862733 shutdown_connections 2024-09-12T01:38:26.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.638+0000 7f8b487c4640 1 -- 172.21.15.81:0/3887862733 wait complete. 2024-09-12T01:38:26.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T01:38:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.753+0000 7f6cbc60e640 1 -- 172.21.15.81:0/1596856368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4108130 msgr2=0x7f6cb410ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.753+0000 7f6cbc60e640 1 --2- 172.21.15.81:0/1596856368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4108130 0x7f6cb410ea80 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009cd0 tx=0x7f6cac02a970 comp rx=0 tx=0).stop 2024-09-12T01:38:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.753+0000 7f6cbc60e640 1 -- 172.21.15.81:0/1596856368 shutdown_connections 2024-09-12T01:38:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.753+0000 7f6cbc60e640 1 --2- 172.21.15.81:0/1596856368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4108130 0x7f6cb410ea80 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.753+0000 7f6cbc60e640 1 --2- 172.21.15.81:0/1596856368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6cb4101200 0x7f6cb41079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.753+0000 7f6cbc60e640 1 --2- 172.21.15.81:0/1596856368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cb41008e0 0x7f6cb4100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.753+0000 7f6cbc60e640 1 -- 172.21.15.81:0/1596856368 >> 172.21.15.81:0/1596856368 conn(0x7f6cb4075ea0 msgr2=0x7f6cb40762b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.753+0000 7f6cbc60e640 1 -- 172.21.15.81:0/1596856368 shutdown_connections 2024-09-12T01:38:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.753+0000 7f6cbc60e640 1 -- 172.21.15.81:0/1596856368 wait complete. 2024-09-12T01:38:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbc60e640 1 Processor -- start 2024-09-12T01:38:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbc60e640 1 -- start start 2024-09-12T01:38:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbc60e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cb41008e0 0x7f6cb4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbc60e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6cb4101200 0x7f6cb41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbc60e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4108130 0x7f6cb419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbc60e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb4111f60 con 0x7f6cb4108130 2024-09-12T01:38:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbc60e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb4111de0 con 0x7f6cb41008e0 2024-09-12T01:38:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbc60e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb41120e0 con 0x7f6cb4101200 2024-09-12T01:38:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbabab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4108130 0x7f6cb419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbabab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4108130 0x7f6cb419cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51422/0 (socket says 172.21.15.81:51422) 2024-09-12T01:38:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbabab640 1 -- 172.21.15.81:0/327691603 learned_addr learned my addr 172.21.15.81:0/327691603 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cba3aa640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cb41008e0 0x7f6cb4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cb9ba9640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6cb4101200 0x7f6cb41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbabab640 1 -- 172.21.15.81:0/327691603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6cb4101200 msgr2=0x7f6cb41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbabab640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6cb4101200 0x7f6cb41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbabab640 1 -- 172.21.15.81:0/327691603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cb41008e0 msgr2=0x7f6cb4198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbabab640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cb41008e0 0x7f6cb4198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbabab640 1 -- 172.21.15.81:0/327691603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb419d450 con 0x7f6cb4108130 2024-09-12T01:38:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cbabab640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4108130 0x7f6cb419cd20 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f6cac005cc0 tx=0x7f6cac003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.754+0000 7f6cab7fe640 1 -- 172.21.15.81:0/327691603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac047070 con 0x7f6cb4108130 2024-09-12T01:38:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.755+0000 7f6cab7fe640 1 -- 172.21.15.81:0/327691603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cac02fe80 con 0x7f6cb4108130 2024-09-12T01:38:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.755+0000 7f6cbc60e640 1 -- 172.21.15.81:0/327691603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb419d6e0 con 0x7f6cb4108130 2024-09-12T01:38:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.755+0000 7f6cab7fe640 1 -- 172.21.15.81:0/327691603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac034070 con 0x7f6cb4108130 2024-09-12T01:38:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.755+0000 7f6cbc60e640 1 -- 172.21.15.81:0/327691603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb41a4fd0 con 0x7f6cb4108130 2024-09-12T01:38:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.755+0000 7f6cbc60e640 1 -- 172.21.15.81:0/327691603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb4069ce0 con 0x7f6cb4108130 2024-09-12T01:38:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.757+0000 7f6cab7fe640 1 -- 172.21.15.81:0/327691603 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6cac04a070 con 0x7f6cb4108130 2024-09-12T01:38:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.757+0000 7f6cab7fe640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6ca00a2d00 0x7f6ca00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.757+0000 7f6cab7fe640 1 -- 172.21.15.81:0/327691603 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f6cac0f00d0 con 0x7f6cb4108130 2024-09-12T01:38:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.757+0000 7f6cba3aa640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6ca00a2d00 0x7f6ca00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.758+0000 7f6cba3aa640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6ca00a2d00 0x7f6ca00a51c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4005d00 tx=0x7f6ca400b410 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.760+0000 7f6cab7fe640 1 -- 172.21.15.81:0/327691603 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6cac051020 con 0x7f6cb4108130 2024-09-12T01:38:26.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.927+0000 7f6cbc60e640 1 -- 172.21.15.81:0/327691603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6cb41997e0 con 0x7f6cb4108130 2024-09-12T01:38:26.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.927+0000 7f6cab7fe640 1 -- 172.21.15.81:0/327691603 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7f6cb41997e0 con 0x7f6cb4108130 2024-09-12T01:38:26.927 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-12T01:38:26.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.929+0000 7f6cbc60e640 1 -- 172.21.15.81:0/327691603 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6ca00a2d00 msgr2=0x7f6ca00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.929+0000 7f6cbc60e640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6ca00a2d00 0x7f6ca00a51c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4005d00 tx=0x7f6ca400b410 comp rx=0 tx=0).stop 2024-09-12T01:38:26.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.929+0000 7f6cbc60e640 1 -- 172.21.15.81:0/327691603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4108130 msgr2=0x7f6cb419cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.929+0000 7f6cbc60e640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4108130 0x7f6cb419cd20 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f6cac005cc0 tx=0x7f6cac003c20 comp rx=0 tx=0).stop 2024-09-12T01:38:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.929+0000 7f6cbc60e640 1 -- 172.21.15.81:0/327691603 shutdown_connections 2024-09-12T01:38:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.929+0000 7f6cbc60e640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f6ca00a2d00 0x7f6ca00a51c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.929+0000 7f6cbc60e640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cb4108130 0x7f6cb419cd20 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.929+0000 7f6cbc60e640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6cb4101200 0x7f6cb41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.929+0000 7f6cbc60e640 1 --2- 172.21.15.81:0/327691603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cb41008e0 0x7f6cb4198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.929+0000 7f6cbc60e640 1 -- 172.21.15.81:0/327691603 >> 172.21.15.81:0/327691603 conn(0x7f6cb4075ea0 msgr2=0x7f6cb4105c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.929+0000 7f6cbc60e640 1 -- 172.21.15.81:0/327691603 shutdown_connections 2024-09-12T01:38:26.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:26.930+0000 7f6cbc60e640 1 -- 172.21.15.81:0/327691603 wait complete. 2024-09-12T01:38:26.939 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:26 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/747000886' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:38:26.939 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:26 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3887862733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:38:26.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T01:38:27.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:26 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/747000886' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:38:27.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:26 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3887862733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:38:27.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:26 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/747000886' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:38:27.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:26 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3887862733' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:38:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.043+0000 7fd3b8911640 1 -- 172.21.15.81:0/1010861081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b41069a0 msgr2=0x7fd3b4106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.043+0000 7fd3b8911640 1 --2- 172.21.15.81:0/1010861081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b41069a0 0x7fd3b4106d80 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fd39c009930 tx=0x7fd39c02a420 comp rx=0 tx=0).stop 2024-09-12T01:38:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.043+0000 7fd3b8911640 1 -- 172.21.15.81:0/1010861081 shutdown_connections 2024-09-12T01:38:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.043+0000 7fd3b8911640 1 --2- 172.21.15.81:0/1010861081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b4101330 0x7fd3b410d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.043+0000 7fd3b8911640 1 --2- 172.21.15.81:0/1010861081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3b4100990 0x7fd3b4100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.043+0000 7fd3b8911640 1 --2- 172.21.15.81:0/1010861081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b41069a0 0x7fd3b4106d80 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.043+0000 7fd3b8911640 1 -- 172.21.15.81:0/1010861081 >> 172.21.15.81:0/1010861081 conn(0x7fd3b40fc6b0 msgr2=0x7fd3b40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.043+0000 7fd3b8911640 1 -- 172.21.15.81:0/1010861081 shutdown_connections 2024-09-12T01:38:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.043+0000 7fd3b8911640 1 -- 172.21.15.81:0/1010861081 wait complete. 2024-09-12T01:38:27.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b8911640 1 Processor -- start 2024-09-12T01:38:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b8911640 1 -- start start 2024-09-12T01:38:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b8911640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3b4100990 0x7fd3b40fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b8911640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b4101330 0x7fd3b40fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b8911640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b41069a0 0x7fd3b40fd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b8911640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b4110de0 con 0x7fd3b41069a0 2024-09-12T01:38:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b8911640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b4110c60 con 0x7fd3b4101330 2024-09-12T01:38:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b8911640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b4110f60 con 0x7fd3b4100990 2024-09-12T01:38:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b41069a0 0x7fd3b40fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b41069a0 0x7fd3b40fd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51446/0 (socket says 172.21.15.81:51446) 2024-09-12T01:38:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b2d9d640 1 -- 172.21.15.81:0/2153876024 learned_addr learned my addr 172.21.15.81:0/2153876024 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b259c640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3b4100990 0x7fd3b40fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b1d9b640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b4101330 0x7fd3b40fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b2d9d640 1 -- 172.21.15.81:0/2153876024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3b4100990 msgr2=0x7fd3b40fcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b2d9d640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3b4100990 0x7fd3b40fcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b2d9d640 1 -- 172.21.15.81:0/2153876024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b4101330 msgr2=0x7fd3b40fd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b2d9d640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b4101330 0x7fd3b40fd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b2d9d640 1 -- 172.21.15.81:0/2153876024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b41a6900 con 0x7fd3b41069a0 2024-09-12T01:38:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.044+0000 7fd3b1d9b640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b4101330 0x7fd3b40fd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.045+0000 7fd3b2d9d640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b41069a0 0x7fd3b40fd780 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00b970 tx=0x7fd3ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.045+0000 7fd3ab7fe640 1 -- 172.21.15.81:0/2153876024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac019070 con 0x7fd3b41069a0 2024-09-12T01:38:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.045+0000 7fd3b8911640 1 -- 172.21.15.81:0/2153876024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b41a6bf0 con 0x7fd3b41069a0 2024-09-12T01:38:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.045+0000 7fd3ab7fe640 1 -- 172.21.15.81:0/2153876024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3ac00cb40 con 0x7fd3b41069a0 2024-09-12T01:38:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.045+0000 7fd3ab7fe640 1 -- 172.21.15.81:0/2153876024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac007650 con 0x7fd3b41069a0 2024-09-12T01:38:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.045+0000 7fd3b8911640 1 -- 172.21.15.81:0/2153876024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b41a7140 con 0x7fd3b41069a0 2024-09-12T01:38:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.046+0000 7fd3b8911640 1 -- 172.21.15.81:0/2153876024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3b4100df0 con 0x7fd3b41069a0 2024-09-12T01:38:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.047+0000 7fd3ab7fe640 1 -- 172.21.15.81:0/2153876024 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fd3ac01c070 con 0x7fd3b41069a0 2024-09-12T01:38:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.047+0000 7fd3ab7fe640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3a00a2d00 0x7fd3a00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.048+0000 7fd3ab7fe640 1 -- 172.21.15.81:0/2153876024 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7fd3ac0ce920 con 0x7fd3b41069a0 2024-09-12T01:38:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.048+0000 7fd3b259c640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3a00a2d00 0x7fd3a00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.048+0000 7fd3b259c640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3a00a2d00 0x7fd3a00a51c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd39c009900 tx=0x7fd39c0058d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.052+0000 7fd3ab7fe640 1 -- 172.21.15.81:0/2153876024 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3ac09b000 con 0x7fd3b41069a0 2024-09-12T01:38:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.215+0000 7fd3b8911640 1 -- 172.21.15.81:0/2153876024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd3b402d7c0 con 0x7fd3b41069a0 2024-09-12T01:38:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.216+0000 7fd3ab7fe640 1 -- 172.21.15.81:0/2153876024 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7fd3ac09f300 con 0x7fd3b41069a0 2024-09-12T01:38:27.216 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-12T01:38:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.218+0000 7fd3b8911640 1 -- 172.21.15.81:0/2153876024 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3a00a2d00 msgr2=0x7fd3a00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.218+0000 7fd3b8911640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3a00a2d00 0x7fd3a00a51c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd39c009900 tx=0x7fd39c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.218+0000 7fd3b8911640 1 -- 172.21.15.81:0/2153876024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b41069a0 msgr2=0x7fd3b40fd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.218+0000 7fd3b8911640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b41069a0 0x7fd3b40fd780 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00b970 tx=0x7fd3ac00be30 comp rx=0 tx=0).stop 2024-09-12T01:38:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.218+0000 7fd3b8911640 1 -- 172.21.15.81:0/2153876024 shutdown_connections 2024-09-12T01:38:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.218+0000 7fd3b8911640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7fd3a00a2d00 0x7fd3a00a51c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.218+0000 7fd3b8911640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b41069a0 0x7fd3b40fd780 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.218+0000 7fd3b8911640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b4101330 0x7fd3b40fd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.218+0000 7fd3b8911640 1 --2- 172.21.15.81:0/2153876024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd3b4100990 0x7fd3b40fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.218+0000 7fd3b8911640 1 -- 172.21.15.81:0/2153876024 >> 172.21.15.81:0/2153876024 conn(0x7fd3b40fc6b0 msgr2=0x7fd3b406a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:27.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.218+0000 7fd3b8911640 1 -- 172.21.15.81:0/2153876024 shutdown_connections 2024-09-12T01:38:27.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.218+0000 7fd3b8911640 1 -- 172.21.15.81:0/2153876024 wait complete. 2024-09-12T01:38:27.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T01:38:27.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.328+0000 7ff08da74640 1 -- 172.21.15.81:0/3456658655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff088102cf0 msgr2=0x7ff0881030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.328+0000 7ff08da74640 1 --2- 172.21.15.81:0/3456658655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff088102cf0 0x7ff0881030d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7ff078009900 tx=0x7ff07802a480 comp rx=0 tx=0).stop 2024-09-12T01:38:27.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.328+0000 7ff08da74640 1 -- 172.21.15.81:0/3456658655 shutdown_connections 2024-09-12T01:38:27.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.328+0000 7ff08da74640 1 --2- 172.21.15.81:0/3456658655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff08810c0c0 0x7ff08810e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.328+0000 7ff08da74640 1 --2- 172.21.15.81:0/3456658655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff088103610 0x7ff08810baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.328+0000 7ff08da74640 1 --2- 172.21.15.81:0/3456658655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff088102cf0 0x7ff0881030d0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.328+0000 7ff08da74640 1 -- 172.21.15.81:0/3456658655 >> 172.21.15.81:0/3456658655 conn(0x7ff088077a10 msgr2=0x7ff0880fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.328+0000 7ff08da74640 1 -- 172.21.15.81:0/3456658655 shutdown_connections 2024-09-12T01:38:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.328+0000 7ff08da74640 1 -- 172.21.15.81:0/3456658655 wait complete. 2024-09-12T01:38:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff08da74640 1 Processor -- start 2024-09-12T01:38:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff08da74640 1 -- start start 2024-09-12T01:38:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff08da74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff088102cf0 0x7ff088100940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff08da74640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff088103610 0x7ff088100e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff08da74640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff08810c0c0 0x7ff0881013c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff08da74640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff088111e90 con 0x7ff088102cf0 2024-09-12T01:38:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff08da74640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff088111d10 con 0x7ff08810c0c0 2024-09-12T01:38:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff08da74640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff088112010 con 0x7ff088103610 2024-09-12T01:38:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff0877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff088102cf0 0x7ff088100940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:27.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff0877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff088102cf0 0x7ff088100940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51456/0 (socket says 172.21.15.81:51456) 2024-09-12T01:38:27.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff0877fe640 1 -- 172.21.15.81:0/2996696114 learned_addr learned my addr 172.21.15.81:0/2996696114 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:27.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff0877fe640 1 -- 172.21.15.81:0/2996696114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff088103610 msgr2=0x7ff088100e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff0877fe640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff088103610 0x7ff088100e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff0877fe640 1 -- 172.21.15.81:0/2996696114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff08810c0c0 msgr2=0x7ff0881013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff087fff640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff08810c0c0 0x7ff0881013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:27.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff0877fe640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff08810c0c0 0x7ff0881013c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff0877fe640 1 -- 172.21.15.81:0/2996696114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0881a6920 con 0x7ff088102cf0 2024-09-12T01:38:27.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff087fff640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff08810c0c0 0x7ff0881013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:27.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff0877fe640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff088102cf0 0x7ff088100940 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7ff078005ab0 tx=0x7ff078004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:27.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff0857fa640 1 -- 172.21.15.81:0/2996696114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07803f030 con 0x7ff088102cf0 2024-09-12T01:38:27.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.329+0000 7ff0857fa640 1 -- 172.21.15.81:0/2996696114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff078003ce0 con 0x7ff088102cf0 2024-09-12T01:38:27.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.330+0000 7ff08da74640 1 -- 172.21.15.81:0/2996696114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0881a6bb0 con 0x7ff088102cf0 2024-09-12T01:38:27.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.330+0000 7ff0857fa640 1 -- 172.21.15.81:0/2996696114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078035070 con 0x7ff088102cf0 2024-09-12T01:38:27.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.330+0000 7ff08da74640 1 -- 172.21.15.81:0/2996696114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0881a70a0 con 0x7ff088102cf0 2024-09-12T01:38:27.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.330+0000 7ff08da74640 1 -- 172.21.15.81:0/2996696114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0881030d0 con 0x7ff088102cf0 2024-09-12T01:38:27.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.332+0000 7ff0857fa640 1 -- 172.21.15.81:0/2996696114 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff078042030 con 0x7ff088102cf0 2024-09-12T01:38:27.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.333+0000 7ff0857fa640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff0740a2d00 0x7ff0740a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.333+0000 7ff07ffff640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff0740a2d00 0x7ff0740a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.333+0000 7ff0857fa640 1 -- 172.21.15.81:0/2996696114 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7ff0780f0030 con 0x7ff088102cf0 2024-09-12T01:38:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.333+0000 7ff07ffff640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff0740a2d00 0x7ff0740a51c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff0881023d0 tx=0x7ff070005bf0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.336+0000 7ff0857fa640 1 -- 172.21.15.81:0/2996696114 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0780bcc50 con 0x7ff088102cf0 2024-09-12T01:38:27.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.548+0000 7ff08da74640 1 -- 172.21.15.81:0/2996696114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7ff08802d7c0 con 0x7ff088102cf0 2024-09-12T01:38:27.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.555+0000 7ff0857fa640 1 -- 172.21.15.81:0/2996696114 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+740902 (secure 0 0 0) 0x7ff0780bc550 con 0x7ff088102cf0 2024-09-12T01:38:27.568 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:38:27.568 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:38:27.568 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 26, 2024-09-12T01:38:27.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.568 INFO:teuthology.orchestra.run.smithi081.stdout: "active_gid": 15222, 2024-09-12T01:38:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: "active_name": "x", 2024-09-12T01:38:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: "active_addrs": { 2024-09-12T01:38:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T01:38:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T01:38:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-09-12T01:38:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1379528564 2024-09-12T01:38:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-12T01:38:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-09-12T01:38:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1379528564 2024-09-12T01:38:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.570 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T01:38:27.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.570 INFO:teuthology.orchestra.run.smithi081.stdout: "active_addr": "172.21.15.81:6801/1379528564", 2024-09-12T01:38:27.570 INFO:teuthology.orchestra.run.smithi081.stdout: "active_change": "2024-09-12T01:28:03.711549+0000", 2024-09-12T01:38:27.570 INFO:teuthology.orchestra.run.smithi081.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T01:38:27.570 INFO:teuthology.orchestra.run.smithi081.stdout: "available": true, 2024-09-12T01:38:27.570 INFO:teuthology.orchestra.run.smithi081.stdout: "standbys": [ 2024-09-12T01:38:27.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.570 INFO:teuthology.orchestra.run.smithi081.stdout: "gid": 24754, 2024-09-12T01:38:27.570 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "z", 2024-09-12T01:38:27.570 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_features": 4540701547738038271, 2024-09-12T01:38:27.570 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-09-12T01:38:27.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.571 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-09-12T01:38:27.571 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.571 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.571 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.571 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:27.571 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:27.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.571 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.571 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:27.571 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.571 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.571 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T01:38:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.572 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.573 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.573 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.573 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.573 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.573 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.573 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.573 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.573 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.573 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.573 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.573 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.573 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.574 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.574 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.574 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.574 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.574 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.574 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.574 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.574 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.574 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.574 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.576 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.576 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.576 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.576 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.576 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.576 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.576 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.576 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.576 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.576 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.577 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to", 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.578 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.579 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.579 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-09-12T01:38:27.579 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.579 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.579 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.579 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-09-12T01:38:27.579 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.579 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.579 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-09-12T01:38:27.579 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-09-12T01:38:27.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.580 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.580 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.580 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.580 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.580 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.580 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-09-12T01:38:27.580 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.580 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.580 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-09-12T01:38:27.580 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-09-12T01:38:27.581 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-09-12T01:38:27.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.583 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.583 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.583 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.583 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.583 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.583 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.583 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-09-12T01:38:27.583 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.583 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.583 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.583 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.584 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.586 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-09-12T01:38:27.586 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.586 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.586 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.586 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-09-12T01:38:27.586 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-09-12T01:38:27.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.586 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.586 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.586 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-09-12T01:38:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.588 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.588 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.588 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T01:38:27.588 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:38:27.588 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.588 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.588 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-09-12T01:38:27.588 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-09-12T01:38:27.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:27.588 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.588 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.589 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-09-12T01:38:27.590 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T01:38:27.590 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-09-12T01:38:27.590 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.590 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T01:38:27.590 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.590 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.590 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.590 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-09-12T01:38:27.590 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-09-12T01:38:27.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.590 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.590 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-12T01:38:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-12T01:38:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T01:38:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:38:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.596 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.596 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.596 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.596 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.596 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.596 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.596 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.596 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.596 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.596 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.597 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-09-12T01:38:27.599 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-12T01:38:27.600 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: "read", 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap", 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap-read" 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.601 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-09-12T01:38:27.602 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.602 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.602 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-09-12T01:38:27.602 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-09-12T01:38:27.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.602 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.602 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.602 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.602 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.602 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.603 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.604 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T01:38:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T01:38:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-09-12T01:38:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-09-12T01:38:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.605 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.606 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.607 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.608 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-09-12T01:38:27.609 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-09-12T01:38:27.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.609 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.609 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-09-12T01:38:27.609 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.609 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.609 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.609 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T01:38:27.609 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.609 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.610 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-09-12T01:38:27.610 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-09-12T01:38:27.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.610 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.610 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.610 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.610 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.610 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.610 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.610 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T01:38:27.610 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T01:38:27.610 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.611 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.611 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-09-12T01:38:27.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-09-12T01:38:27.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.611 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.611 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.611 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:27.611 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-09-12T01:38:27.612 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.613 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.613 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.613 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T01:38:27.613 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.613 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.613 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm_log_destination": { 2024-09-12T01:38:27.613 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm_log_destination", 2024-09-12T01:38:27.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.613 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.613 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "file", 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "file,syslog", 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "syslog" 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-09-12T01:38:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-09-12T01:38:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T01:38:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-09-12T01:38:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-09-12T01:38:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T01:38:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-09-12T01:38:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-09-12T01:38:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T01:38:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T01:38:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-09-12T01:38:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-09-12T01:38:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T01:38:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-09-12T01:38:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-09-12T01:38:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-09-12T01:38:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T01:38:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-09-12T01:38:27.621 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.621 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.621 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-09-12T01:38:27.621 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-09-12T01:38:27.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.621 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.621 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T01:38:27.621 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.621 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.621 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T01:38:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-09-12T01:38:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-09-12T01:38:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T01:38:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.623 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.623 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-09-12T01:38:27.623 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.623 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.623 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-09-12T01:38:27.623 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-09-12T01:38:27.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.623 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.623 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.623 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T01:38:27.623 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T01:38:27.624 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-09-12T01:38:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-09-12T01:38:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-09-12T01:38:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T01:38:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-09-12T01:38:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-09-12T01:38:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-09-12T01:38:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T01:38:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T01:38:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-09-12T01:38:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-09-12T01:38:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T01:38:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T01:38:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-09-12T01:38:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-09-12T01:38:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba": { 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba", 2024-09-12T01:38:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T01:38:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB container image", 2024-09-12T01:38:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-09-12T01:38:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-09-12T01:38:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T01:38:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-09-12T01:38:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-09-12T01:38:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-09-12T01:38:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T01:38:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-09-12T01:38:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-09-12T01:38:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T01:38:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-09-12T01:38:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T01:38:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-09-12T01:38:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T01:38:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-09-12T01:38:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-09-12T01:38:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-09-12T01:38:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-09-12T01:38:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-09-12T01:38:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-09-12T01:38:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T01:38:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-09-12T01:38:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-09-12T01:38:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "grafana_dashboards_path": { 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "grafana_dashboards_path", 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T01:38:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T01:38:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-09-12T01:38:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-09-12T01:38:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-09-12T01:38:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-09-12T01:38:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-09-12T01:38:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T01:38:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-09-12T01:38:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-09-12T01:38:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T01:38:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-09-12T01:38:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-09-12T01:38:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T01:38:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T01:38:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T01:38:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T01:38:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-09-12T01:38:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T01:38:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-09-12T01:38:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-09-12T01:38:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-09-12T01:38:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T01:38:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T01:38:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-09-12T01:38:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-09-12T01:38:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T01:38:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-09-12T01:38:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-09-12T01:38:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T01:38:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-09-12T01:38:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-09-12T01:38:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-09-12T01:38:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-09-12T01:38:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T01:38:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-09-12T01:38:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-09-12T01:38:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T01:38:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-09-12T01:38:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-09-12T01:38:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T01:38:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-09-12T01:38:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-09-12T01:38:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-09-12T01:38:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-09-12T01:38:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-09-12T01:38:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T01:38:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T01:38:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T01:38:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T01:38:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T01:38:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T01:38:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T01:38:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T01:38:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T01:38:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T01:38:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T01:38:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T01:38:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T01:38:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T01:38:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T01:38:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-09-12T01:38:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T01:38:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T01:38:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T01:38:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T01:38:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T01:38:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T01:38:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.711 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T01:38:27.711 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T01:38:27.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.711 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.711 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.711 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.711 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.711 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.711 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.711 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.711 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.711 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.711 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.712 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.713 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.714 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.715 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T01:38:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T01:38:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.717 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.718 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.719 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.719 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T01:38:27.719 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T01:38:27.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.719 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.719 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T01:38:27.719 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.719 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.719 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.719 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.720 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.720 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.720 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.720 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T01:38:27.720 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T01:38:27.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.720 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.720 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.720 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:27.720 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.720 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.720 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T01:38:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T01:38:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-09-12T01:38:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.722 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.722 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.722 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.722 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.722 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T01:38:27.722 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T01:38:27.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.722 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.722 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-09-12T01:38:27.722 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.723 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.724 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.724 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.724 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.724 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.724 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.724 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.724 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T01:38:27.724 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T01:38:27.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.724 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.724 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T01:38:27.725 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.725 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.725 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.725 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.725 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.725 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.725 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.725 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T01:38:27.725 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T01:38:27.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.725 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.725 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.728 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.730 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.731 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.732 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.732 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.732 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.732 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.732 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.732 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.732 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.732 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-09-12T01:38:27.732 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-09-12T01:38:27.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.732 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.733 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.734 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.735 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.735 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.735 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.735 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.735 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.735 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.735 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.735 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.735 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.736 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.737 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.738 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-09-12T01:38:27.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T01:38:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T01:38:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T01:38:27.743 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-12T01:38:27.744 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-12T01:38:27.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.745 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.745 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.745 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.745 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.745 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.745 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.745 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.745 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.745 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.745 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.745 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-09-12T01:38:27.746 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-09-12T01:38:27.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.746 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.746 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-09-12T01:38:27.746 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.746 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.746 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.746 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.746 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.746 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-12T01:38:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-12T01:38:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-09-12T01:38:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-09-12T01:38:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.747 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.748 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.749 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.749 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.749 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.749 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-09-12T01:38:27.749 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-09-12T01:38:27.749 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.749 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.749 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.749 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.749 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.749 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.749 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-09-12T01:38:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.752 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.753 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.753 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.753 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.753 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.753 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.753 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.753 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.753 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.753 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.753 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.753 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.754 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.755 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.756 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-09-12T01:38:27.757 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-09-12T01:38:27.757 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.757 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.757 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.757 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-09-12T01:38:27.757 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.757 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.757 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.757 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T01:38:27.757 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.757 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.758 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.759 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.760 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-09-12T01:38:27.760 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-09-12T01:38:27.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.760 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.760 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-12T01:38:27.760 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.760 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.760 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.760 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T01:38:27.760 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.761 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.762 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.762 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:27.762 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:27.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.762 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.762 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:27.762 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.762 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.762 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.762 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T01:38:27.762 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T01:38:27.763 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.764 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.765 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.766 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.766 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.766 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.766 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.766 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.766 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.766 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.766 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.766 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.766 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.767 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-09-12T01:38:27.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-09-12T01:38:27.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:27.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.773 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T01:38:27.774 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.774 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.774 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-09-12T01:38:27.774 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-09-12T01:38:27.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.774 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.774 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.774 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-09-12T01:38:27.774 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.774 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.776 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.776 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-09-12T01:38:27.776 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.776 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.776 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:27.776 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:27.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.776 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.776 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.776 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-09-12T01:38:27.776 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.777 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.778 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.778 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.778 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.778 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.778 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.778 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.778 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.778 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.778 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.778 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.778 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.778 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.779 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.780 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.782 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.782 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.782 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.782 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.782 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.782 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.782 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.782 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-09-12T01:38:27.782 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-09-12T01:38:27.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.782 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.783 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.784 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-09-12T01:38:27.784 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.784 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.784 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.784 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-09-12T01:38:27.784 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.784 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.784 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.784 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-12T01:38:27.784 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-12T01:38:27.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.785 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.786 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.787 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.787 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.787 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.787 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.787 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-09-12T01:38:27.787 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.787 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.787 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.787 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-09-12T01:38:27.787 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-09-12T01:38:27.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.788 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.788 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-09-12T01:38:27.788 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.788 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.788 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.788 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:38:27.788 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.788 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.789 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.790 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.792 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.792 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.792 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.792 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.792 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.792 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.792 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.792 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.792 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.792 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.792 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.793 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.794 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.795 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.796 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.796 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.796 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.796 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.796 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.796 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.796 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.796 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.796 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.796 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.796 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.799 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.799 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.799 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.799 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.799 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.799 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.799 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.799 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.799 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.799 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.799 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.799 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "k8sevents", 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_event_retention_days": { 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ceph_event_retention_days", 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.800 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: "config_check_secs": { 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_check_secs", 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.801 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:27.802 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "10", 2024-09-12T01:38:27.802 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.802 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.802 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T01:38:27.802 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.802 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.802 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.802 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.802 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.802 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.802 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-09-12T01:38:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-09-12T01:38:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-09-12T01:38:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-09-12T01:38:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-09-12T01:38:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T01:38:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-09-12T01:38:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-09-12T01:38:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-12T01:38:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-09-12T01:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-09-12T01:38:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-12T01:38:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-09-12T01:38:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-09-12T01:38:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-09-12T01:38:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-09-12T01:38:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T01:38:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-09-12T01:38:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-12T01:38:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-12T01:38:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T01:38:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-09-12T01:38:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-09-12T01:38:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-09-12T01:38:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-09-12T01:38:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-09-12T01:38:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T01:38:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T01:38:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-12T01:38:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T01:38:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-09-12T01:38:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-09-12T01:38:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-09-12T01:38:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-12T01:38:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-12T01:38:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-09-12T01:38:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-09-12T01:38:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-09-12T01:38:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-12T01:38:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-12T01:38:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-09-12T01:38:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T01:38:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.904 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.904 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.904 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.904 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.904 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.904 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.904 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.904 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.904 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.904 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.904 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.904 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.905 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.906 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.907 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.908 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.908 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.908 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-09-12T01:38:27.908 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.908 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.908 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.908 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.908 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.909 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.911 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.912 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.914 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.915 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.915 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.915 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.915 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.915 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.915 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.915 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.915 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.915 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.915 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.915 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.915 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.916 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.916 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.916 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.916 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.916 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.916 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.916 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.916 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.916 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.916 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.917 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.917 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.917 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.917 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.917 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.917 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.917 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.917 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.917 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.917 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.917 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.918 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-09-12T01:38:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T01:38:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-09-12T01:38:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.921 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.923 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.923 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.923 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.923 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.923 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.923 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.923 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.923 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.923 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.923 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.923 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.924 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.925 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.926 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.927 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-09-12T01:38:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-09-12T01:38:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.928 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.929 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.929 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.929 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.929 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-09-12T01:38:27.929 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-09-12T01:38:27.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.929 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.929 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.929 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.929 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.929 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.930 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.930 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.930 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.930 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.930 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-09-12T01:38:27.930 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-09-12T01:38:27.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:27.930 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.930 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.930 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.930 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.930 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.931 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.932 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.932 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.932 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.932 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.932 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.932 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-09-12T01:38:27.932 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-09-12T01:38:27.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.932 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.932 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.932 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.932 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.933 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-09-12T01:38:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-09-12T01:38:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.934 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.935 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-09-12T01:38:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-09-12T01:38:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.937 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-12T01:38:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-09-12T01:38:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-09-12T01:38:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T01:38:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-09-12T01:38:27.940 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.941 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.942 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.942 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.942 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.942 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.942 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.942 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.942 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.942 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.942 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.942 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.942 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.943 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.943 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.943 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.943 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.943 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.943 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.943 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.943 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.943 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.943 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.944 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.944 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.944 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.944 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.944 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.944 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.944 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.945 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.945 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.945 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.945 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.945 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.945 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.945 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.945 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.945 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.945 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.945 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.946 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.946 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.946 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.946 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.946 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.946 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.946 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.946 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.947 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.948 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.948 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.948 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.948 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.948 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.948 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.948 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.948 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.948 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.948 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.948 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.948 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.950 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.951 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.952 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.952 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.952 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.952 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.952 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.952 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.952 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.952 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.952 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.952 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.953 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.956 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.957 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.958 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.959 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-09-12T01:38:27.959 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-09-12T01:38:27.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.959 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.959 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.959 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T01:38:27.959 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.959 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.959 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.959 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.959 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.959 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.960 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.961 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.961 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.961 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.961 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.961 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.961 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.961 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.961 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.961 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.961 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.961 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.962 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.962 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.962 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.962 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.962 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.962 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.962 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.962 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.962 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.962 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.963 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.963 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.963 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.963 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.963 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.963 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.963 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.963 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.963 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.963 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.963 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.963 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.964 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.964 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.964 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.964 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.964 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.964 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.964 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.964 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.964 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.964 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.964 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.964 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.965 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.966 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-09-12T01:38:27.967 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-09-12T01:38:27.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.967 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.967 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.967 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.967 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.967 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.967 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.967 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T01:38:27.967 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.967 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.967 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-09-12T01:38:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-09-12T01:38:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T01:38:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.968 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.969 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-09-12T01:38:27.969 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-09-12T01:38:27.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.969 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.969 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.969 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:27.969 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.969 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.969 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.969 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T01:38:27.969 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.969 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.970 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.971 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.972 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.973 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.973 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-09-12T01:38:27.973 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-09-12T01:38:27.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.973 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.973 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.973 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.973 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.973 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.973 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.973 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.973 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.975 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.975 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.975 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-12T01:38:27.975 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-12T01:38:27.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.975 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.975 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.975 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.975 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.975 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.975 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.976 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.976 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.976 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.976 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.976 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:27.976 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:27.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.976 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.976 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.976 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-09-12T01:38:27.976 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-09-12T01:38:27.976 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-09-12T01:38:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-09-12T01:38:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-09-12T01:38:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.978 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.979 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.979 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.979 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.979 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.979 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.979 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.979 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-09-12T01:38:27.979 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-09-12T01:38:27.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.979 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.980 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.981 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.981 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.981 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.981 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.981 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.981 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.981 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.981 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.981 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.981 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.981 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.981 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.981 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.982 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.983 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.984 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.984 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.984 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.984 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.984 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.984 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.984 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.984 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.984 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.984 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.984 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-09-12T01:38:27.985 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-09-12T01:38:27.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.987 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.987 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.987 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.987 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.987 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.987 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.987 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.987 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.987 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.987 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.987 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.990 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.990 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.990 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.990 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.990 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.990 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.990 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.990 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.990 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.990 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.990 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.990 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.990 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.992 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.992 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.992 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.992 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.992 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.992 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.992 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.992 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.992 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.992 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.992 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.993 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.993 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.993 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.993 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.993 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.993 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.993 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.993 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.993 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.993 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.993 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:27.994 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.995 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.996 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.996 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.996 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.996 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.996 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.996 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.996 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.996 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.996 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.996 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:27.996 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:27.996 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:27.999 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.000 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T01:38:28.001 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.001 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.001 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.001 INFO:teuthology.orchestra.run.smithi081.stdout: "periodic_async_work": { 2024-09-12T01:38:28.001 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "periodic_async_work", 2024-09-12T01:38:28.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.001 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.001 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.001 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.001 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.001 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.001 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.002 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Periodically check for async work", 2024-09-12T01:38:28.002 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.002 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.002 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.002 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-09-12T01:38:28.002 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-09-12T01:38:28.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.002 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.002 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.002 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:28.002 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.002 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.003 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T01:38:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-09-12T01:38:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.004 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.006 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-09-12T01:38:28.006 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-09-12T01:38:28.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.006 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.006 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.006 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.006 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.006 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.006 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.006 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.006 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.006 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.007 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:28.007 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:28.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.007 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.007 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.007 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:28.007 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.007 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.007 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.007 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.007 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.007 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.008 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.008 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.008 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.008 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.008 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.008 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.008 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.008 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.008 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.008 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.008 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.009 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.009 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.009 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.009 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.009 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.009 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.009 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.009 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.009 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.009 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.009 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.010 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.011 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.012 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.013 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.014 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.014 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.014 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.014 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.014 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-09-12T01:38:28.014 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-09-12T01:38:28.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.014 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.014 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.014 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-09-12T01:38:28.014 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.014 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.015 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.015 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.015 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.015 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.015 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.015 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-09-12T01:38:28.015 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-09-12T01:38:28.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.015 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.015 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.015 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T01:38:28.015 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T01:38:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.016 INFO:teuthology.orchestra.run.smithi081.stdout: "gid": 24791, 2024-09-12T01:38:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "y", 2024-09-12T01:38:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_features": 4540701547738038271, 2024-09-12T01:38:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-09-12T01:38:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-09-12T01:38:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.017 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.018 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.019 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.020 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-09-12T01:38:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to", 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-09-12T01:38:28.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-09-12T01:38:28.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-09-12T01:38:28.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-09-12T01:38:28.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-09-12T01:38:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-09-12T01:38:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T01:38:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-09-12T01:38:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-09-12T01:38:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-09-12T01:38:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.033 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.034 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-12T01:38:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-12T01:38:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T01:38:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:38:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-09-12T01:38:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-09-12T01:38:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.037 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-09-12T01:38:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-09-12T01:38:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-09-12T01:38:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-09-12T01:38:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T01:38:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-09-12T01:38:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-09-12T01:38:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.038 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:28.039 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.040 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.041 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.043 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-09-12T01:38:28.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-12T01:38:28.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-09-12T01:38:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-09-12T01:38:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-09-12T01:38:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "read", 2024-09-12T01:38:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap", 2024-09-12T01:38:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap-read" 2024-09-12T01:38:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.047 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.048 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T01:38:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.049 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.050 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.051 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T01:38:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-09-12T01:38:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.052 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.053 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.054 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-09-12T01:38:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-09-12T01:38:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-09-12T01:38:28.055 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.056 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.056 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T01:38:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-09-12T01:38:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-09-12T01:38:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T01:38:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T01:38:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-09-12T01:38:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-09-12T01:38:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.058 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T01:38:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-09-12T01:38:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T01:38:28.059 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-09-12T01:38:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T01:38:28.060 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm_log_destination": { 2024-09-12T01:38:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm_log_destination", 2024-09-12T01:38:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "file", 2024-09-12T01:38:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "file,syslog", 2024-09-12T01:38:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: "syslog" 2024-09-12T01:38:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T01:38:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-09-12T01:38:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-09-12T01:38:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.063 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T01:38:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-09-12T01:38:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-09-12T01:38:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.064 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.065 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T01:38:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-09-12T01:38:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-09-12T01:38:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-09-12T01:38:28.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T01:38:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-09-12T01:38:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.068 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-09-12T01:38:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-09-12T01:38:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T01:38:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-09-12T01:38:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-09-12T01:38:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-09-12T01:38:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T01:38:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T01:38:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.070 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-09-12T01:38:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-09-12T01:38:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T01:38:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-09-12T01:38:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-09-12T01:38:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-09-12T01:38:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T01:38:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.072 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-09-12T01:38:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-09-12T01:38:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-09-12T01:38:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T01:38:28.073 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-09-12T01:38:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-09-12T01:38:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-09-12T01:38:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T01:38:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-09-12T01:38:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-09-12T01:38:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-09-12T01:38:28.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T01:38:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-09-12T01:38:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-09-12T01:38:28.076 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-09-12T01:38:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T01:38:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-09-12T01:38:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.077 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.079 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-09-12T01:38:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-09-12T01:38:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T01:38:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T01:38:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-09-12T01:38:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-09-12T01:38:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T01:38:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-09-12T01:38:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.081 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba": { 2024-09-12T01:38:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba", 2024-09-12T01:38:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T01:38:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB container image", 2024-09-12T01:38:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-09-12T01:38:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-09-12T01:38:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T01:38:28.084 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-09-12T01:38:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-09-12T01:38:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.085 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T01:38:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-09-12T01:38:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T01:38:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-09-12T01:38:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.086 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T01:38:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-09-12T01:38:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-09-12T01:38:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-09-12T01:38:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T01:38:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-09-12T01:38:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-09-12T01:38:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-09-12T01:38:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-09-12T01:38:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-09-12T01:38:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-09-12T01:38:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T01:38:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-09-12T01:38:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-09-12T01:38:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.090 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-09-12T01:38:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "grafana_dashboards_path": { 2024-09-12T01:38:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "grafana_dashboards_path", 2024-09-12T01:38:28.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T01:38:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T01:38:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-09-12T01:38:28.092 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-09-12T01:38:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-09-12T01:38:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.093 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-09-12T01:38:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-09-12T01:38:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T01:38:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-09-12T01:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-09-12T01:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T01:38:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T01:38:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.099 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.102 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T01:38:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T01:38:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T01:38:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.103 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-09-12T01:38:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T01:38:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.104 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-09-12T01:38:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-09-12T01:38:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-09-12T01:38:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.105 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-09-12T01:38:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-09-12T01:38:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T01:38:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.106 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-09-12T01:38:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-09-12T01:38:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-09-12T01:38:28.107 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-09-12T01:38:28.108 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-09-12T01:38:28.109 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.109 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T01:38:28.109 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.109 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.109 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.109 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-09-12T01:38:28.109 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-09-12T01:38:28.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.109 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.109 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.109 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-09-12T01:38:28.109 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.110 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.110 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.110 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T01:38:28.110 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.110 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.110 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.110 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-09-12T01:38:28.110 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-09-12T01:38:28.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.110 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.110 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.110 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T01:38:28.111 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.111 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.111 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.111 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T01:38:28.111 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.111 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.111 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-09-12T01:38:28.111 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-09-12T01:38:28.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.111 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.111 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.112 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.112 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.112 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.112 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.112 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T01:38:28.112 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.112 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.112 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.112 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-09-12T01:38:28.112 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-09-12T01:38:28.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-09-12T01:38:28.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.114 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.114 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.114 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.114 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.114 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.114 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.114 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T01:38:28.114 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.114 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.114 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.114 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-09-12T01:38:28.114 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-09-12T01:38:28.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.115 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.115 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.115 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.115 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.115 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.115 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.115 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T01:38:28.115 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.115 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.115 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.115 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-09-12T01:38:28.116 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-09-12T01:38:28.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.116 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.116 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.116 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.116 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.116 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.116 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.116 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T01:38:28.116 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.116 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.117 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-09-12T01:38:28.117 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-09-12T01:38:28.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.117 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.117 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.117 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-09-12T01:38:28.117 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.117 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.117 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.117 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-09-12T01:38:28.117 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.117 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.119 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.119 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-09-12T01:38:28.119 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-09-12T01:38:28.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.119 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.119 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.119 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.119 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.119 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.119 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.119 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T01:38:28.119 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.120 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.120 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.120 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-09-12T01:38:28.120 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-09-12T01:38:28.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.120 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.120 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.120 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.120 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.120 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.120 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.120 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T01:38:28.121 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.121 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.121 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.121 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-09-12T01:38:28.121 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-09-12T01:38:28.121 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.121 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.121 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.121 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.121 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.121 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T01:38:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-09-12T01:38:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-09-12T01:38:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.122 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.123 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.123 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.123 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T01:38:28.123 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.123 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.123 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.123 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-09-12T01:38:28.123 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-09-12T01:38:28.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.123 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.123 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.123 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.124 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.124 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.124 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.124 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T01:38:28.124 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.124 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.124 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.124 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-09-12T01:38:28.125 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.125 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.125 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.125 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.125 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.125 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.125 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.125 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.125 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.125 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.125 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.126 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.126 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.126 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.126 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.126 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.126 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.126 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.126 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.126 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.126 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.126 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.127 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.127 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.127 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.127 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.127 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.127 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.127 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.127 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.127 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.127 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.127 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.127 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.127 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.128 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.128 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.128 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.128 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.128 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.128 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.128 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.128 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.128 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.128 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.129 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.129 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.129 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.129 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.129 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.129 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.129 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.129 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.129 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.129 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.129 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.129 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.130 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.131 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.131 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-09-12T01:38:28.131 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.131 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.131 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.131 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T01:38:28.131 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.131 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.131 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.131 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-09-12T01:38:28.131 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-09-12T01:38:28.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.132 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.132 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.132 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-09-12T01:38:28.132 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.132 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.132 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.132 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T01:38:28.132 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.132 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.132 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.133 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-09-12T01:38:28.133 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.133 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.133 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.133 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T01:38:28.133 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T01:38:28.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.133 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.133 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.133 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.133 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.134 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.135 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.136 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.136 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.136 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.136 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.136 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.136 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.136 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-09-12T01:38:28.136 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T01:38:28.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.136 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.136 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.136 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T01:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T01:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.138 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.139 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.139 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.139 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.139 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.139 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.139 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.139 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.139 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.139 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T01:38:28.139 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T01:38:28.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.139 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.140 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.140 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.140 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.140 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.140 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.140 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.140 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.140 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.140 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T01:38:28.140 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T01:38:28.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.141 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.141 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.141 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.141 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.141 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.141 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.141 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.141 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.141 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.142 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T01:38:28.142 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T01:38:28.142 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.142 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.142 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.142 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.142 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.142 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.142 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.142 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.142 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.142 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.142 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.143 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T01:38:28.143 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T01:38:28.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.143 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.143 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.143 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.143 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.143 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.143 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.143 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.143 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.143 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T01:38:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T01:38:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T01:38:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T01:38:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.146 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.146 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.146 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.146 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T01:38:28.146 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T01:38:28.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.146 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.146 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.146 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.146 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.146 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.146 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.147 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.147 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.147 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.147 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.147 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T01:38:28.147 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T01:38:28.147 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.147 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.147 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.147 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.147 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.147 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.148 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.148 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.148 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.148 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.148 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.148 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T01:38:28.148 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T01:38:28.148 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.148 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.148 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.148 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T01:38:28.148 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.149 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.149 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.149 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.149 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.149 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.149 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.149 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T01:38:28.149 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T01:38:28.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.149 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.149 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.149 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.150 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.150 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.150 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.150 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.150 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.150 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.150 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.150 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-09-12T01:38:28.150 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-09-12T01:38:28.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.150 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.150 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.151 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.151 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.151 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.151 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.151 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.151 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.151 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.151 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.151 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T01:38:28.151 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T01:38:28.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.151 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.152 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.152 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T01:38:28.152 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.152 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.152 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.152 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.152 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.152 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.152 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.152 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T01:38:28.152 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T01:38:28.152 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.153 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.153 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.153 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.153 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.153 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.153 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.153 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.153 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.153 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.153 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.153 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T01:38:28.153 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T01:38:28.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.154 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.154 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.154 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.154 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.154 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.154 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.154 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.154 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.154 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.154 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.154 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T01:38:28.155 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T01:38:28.155 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.155 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.155 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.155 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.155 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.155 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.155 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.155 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T01:38:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T01:38:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.156 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T01:38:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T01:38:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.157 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.158 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.158 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.158 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.158 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.158 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.158 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.158 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.158 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T01:38:28.158 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T01:38:28.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.163 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.169 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T01:38:28.169 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.169 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.169 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.169 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.169 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.169 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.169 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.172 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T01:38:28.172 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T01:38:28.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.173 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.173 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.173 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.173 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.173 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.173 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.173 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.173 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.173 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.173 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.173 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T01:38:28.173 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T01:38:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-09-12T01:38:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T01:38:28.175 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T01:38:28.175 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.175 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.175 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.175 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-09-12T01:38:28.175 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.175 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.175 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.175 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.175 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.175 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.175 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.176 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T01:38:28.176 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T01:38:28.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.176 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.176 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.176 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.176 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.176 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.176 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.176 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T01:38:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T01:38:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T01:38:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.177 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.178 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.178 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.178 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.178 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T01:38:28.178 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T01:38:28.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.178 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.178 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.178 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.178 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.178 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.179 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.180 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.180 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.180 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.180 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.180 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T01:38:28.180 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T01:38:28.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.180 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.180 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.180 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:28.180 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.180 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.181 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.181 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.181 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.181 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.181 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T01:38:28.181 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T01:38:28.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.181 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.181 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.181 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.182 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T01:38:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-09-12T01:38:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-09-12T01:38:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.183 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-09-12T01:38:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-09-12T01:38:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.184 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-09-12T01:38:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-09-12T01:38:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.186 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.186 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.186 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.186 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.186 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.186 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.186 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-09-12T01:38:28.186 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.186 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.186 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.186 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-09-12T01:38:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-09-12T01:38:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-09-12T01:38:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-12T01:38:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-12T01:38:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.189 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.189 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.189 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.189 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.189 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.189 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.189 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.189 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.189 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.189 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.191 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.191 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.191 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.191 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.191 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.191 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.191 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.191 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.191 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.191 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.191 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.192 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.192 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.192 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.192 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.192 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.192 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.192 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.192 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.192 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.192 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.192 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.192 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.193 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.193 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.193 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.193 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.193 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.193 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.193 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.193 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.193 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.193 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.193 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.194 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.194 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.194 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.194 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.194 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.194 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.194 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.194 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-09-12T01:38:28.194 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-09-12T01:38:28.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.194 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.194 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.195 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.195 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.195 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.195 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.195 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-09-12T01:38:28.195 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.195 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.195 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.195 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-09-12T01:38:28.195 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T01:38:28.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.195 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T01:38:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T01:38:28.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T01:38:28.197 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-12T01:38:28.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-09-12T01:38:28.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.200 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.200 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.200 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-09-12T01:38:28.200 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.200 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.200 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.200 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.200 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.200 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.200 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.200 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-12T01:38:28.200 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-12T01:38:28.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.201 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.201 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.201 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-09-12T01:38:28.201 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.201 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.201 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.201 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.201 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-09-12T01:38:28.201 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.201 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.201 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.201 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.202 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.202 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-12T01:38:28.202 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-12T01:38:28.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.202 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.202 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.202 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-12T01:38:28.202 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-12T01:38:28.202 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-12T01:38:28.202 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.202 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.203 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.203 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.203 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.203 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-09-12T01:38:28.203 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-09-12T01:38:28.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.203 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.203 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.203 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.203 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.203 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.203 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-09-12T01:38:28.204 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-09-12T01:38:28.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.205 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.205 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.205 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.205 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.205 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.205 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-09-12T01:38:28.205 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.205 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.205 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.205 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.206 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.206 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.206 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.206 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.206 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.206 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.206 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.206 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.206 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.206 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.206 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.206 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.208 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.210 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.211 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.211 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-09-12T01:38:28.211 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-09-12T01:38:28.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.211 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.211 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.211 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-09-12T01:38:28.211 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.211 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.211 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.211 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T01:38:28.211 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.212 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.212 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.212 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-09-12T01:38:28.212 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-09-12T01:38:28.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.212 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.212 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.212 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-09-12T01:38:28.212 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.212 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.212 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.212 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-09-12T01:38:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-09-12T01:38:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-09-12T01:38:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-12T01:38:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.215 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T01:38:28.215 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.215 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.215 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.215 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-09-12T01:38:28.215 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-09-12T01:38:28.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.215 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.215 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.215 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.215 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.216 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.216 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.216 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T01:38:28.216 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.216 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.216 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.216 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:28.216 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:28.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.216 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.216 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.217 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:28.217 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.217 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.217 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.217 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T01:38:28.217 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.217 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.217 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.217 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-09-12T01:38:28.217 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-09-12T01:38:28.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.217 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.218 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-09-12T01:38:28.219 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.219 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.219 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.219 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.219 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.219 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.219 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.219 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.219 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.219 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.219 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.219 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.219 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.220 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.220 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.220 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.220 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.220 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.220 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.220 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.220 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.220 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.220 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.220 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.221 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.222 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.222 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.222 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.222 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.222 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.222 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.222 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.222 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.222 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.222 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.222 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-12T01:38:28.224 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.225 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.225 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.225 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.225 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.225 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.225 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.225 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-09-12T01:38:28.225 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-09-12T01:38:28.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.225 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.225 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.225 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-09-12T01:38:28.226 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.226 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.226 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.226 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.226 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.226 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.226 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.226 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:28.226 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:28.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.226 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.226 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-09-12T01:38:28.227 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-09-12T01:38:28.228 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-09-12T01:38:28.228 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.228 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-09-12T01:38:28.228 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-09-12T01:38:28.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.228 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.228 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.228 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-09-12T01:38:28.228 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.228 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.228 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.228 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T01:38:28.228 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-09-12T01:38:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-09-12T01:38:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-09-12T01:38:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.230 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-09-12T01:38:28.231 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.231 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.231 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.231 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:28.231 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:28.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.231 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.231 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.231 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-09-12T01:38:28.231 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.233 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.233 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.233 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.233 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.233 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.233 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.233 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.233 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.233 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.233 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.233 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.233 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.233 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.234 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.235 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.236 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.236 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.236 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.236 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.236 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.236 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.236 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.236 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.236 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.236 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.236 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.237 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.237 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.237 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.237 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.237 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.237 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.237 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.237 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.237 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-09-12T01:38:28.237 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-09-12T01:38:28.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.237 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.238 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.238 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.238 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.238 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.238 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.238 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-09-12T01:38:28.238 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.238 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.238 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.238 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-09-12T01:38:28.238 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-09-12T01:38:28.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-12T01:38:28.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-09-12T01:38:28.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-09-12T01:38:28.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-09-12T01:38:28.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.243 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.243 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.243 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-09-12T01:38:28.243 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.243 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.243 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.243 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:38:28.243 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.243 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.243 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.244 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.245 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.245 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.245 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.245 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.245 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.245 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.245 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.245 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.245 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.245 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.245 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.245 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.247 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.247 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.247 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.247 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.247 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.247 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.247 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.247 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.247 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.247 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.247 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.247 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.248 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.248 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.248 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.248 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.248 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.248 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.248 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.248 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.248 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.248 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.248 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.249 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.249 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.249 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.249 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.249 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.249 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.249 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.249 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.250 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-09-12T01:38:28.250 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.250 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.250 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.250 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.250 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.250 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.250 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.250 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.250 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.250 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.250 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.251 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.253 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.253 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.253 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.253 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.253 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.253 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.253 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.253 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.253 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.253 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.253 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.253 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.254 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.255 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.255 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.255 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.255 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.255 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.255 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.255 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "k8sevents", 2024-09-12T01:38:28.255 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.255 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.256 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.256 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_event_retention_days": { 2024-09-12T01:38:28.256 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ceph_event_retention_days", 2024-09-12T01:38:28.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.256 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.256 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.256 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-12T01:38:28.256 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.256 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.256 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.256 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T01:38:28.256 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.256 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: "config_check_secs": { 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_check_secs", 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "10", 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.257 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.258 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.258 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.258 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.258 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.258 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.258 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.258 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.258 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.258 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.258 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.259 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.259 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.259 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.259 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.259 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.259 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.259 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.259 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.259 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.259 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.259 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.259 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.260 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.260 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.260 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.260 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.260 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.260 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.260 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.260 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.260 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.260 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.261 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.262 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.262 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.262 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.262 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.262 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.262 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.262 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.262 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.262 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.262 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-09-12T01:38:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-09-12T01:38:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-09-12T01:38:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-09-12T01:38:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.264 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.265 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.266 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.266 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.266 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.266 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.266 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.266 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.266 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.266 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.266 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.266 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.266 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.266 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.268 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.268 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.268 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.268 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.268 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.268 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.268 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.268 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.268 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.268 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.268 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.268 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.269 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.269 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.269 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.269 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.269 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.269 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.269 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.269 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.269 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.269 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.269 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.270 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.270 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.270 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.270 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.270 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.270 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.270 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-09-12T01:38:28.270 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-09-12T01:38:28.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.270 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.270 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.270 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.271 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-12T01:38:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-09-12T01:38:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-09-12T01:38:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-09-12T01:38:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.272 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-09-12T01:38:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T01:38:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.273 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-09-12T01:38:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-09-12T01:38:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-09-12T01:38:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-09-12T01:38:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.277 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.278 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.279 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.282 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.283 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.284 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.285 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.286 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.287 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-09-12T01:38:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.288 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.290 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.291 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.293 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-12T01:38:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-09-12T01:38:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-09-12T01:38:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.294 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.296 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-09-12T01:38:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-12T01:38:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-09-12T01:38:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-09-12T01:38:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-09-12T01:38:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.314 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.315 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.316 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.317 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.318 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.319 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-09-12T01:38:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-09-12T01:38:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-12T01:38:28.320 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-09-12T01:38:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-09-12T01:38:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T01:38:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-09-12T01:38:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.321 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-09-12T01:38:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-09-12T01:38:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T01:38:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.323 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.324 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.327 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.328 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-09-12T01:38:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-09-12T01:38:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-09-12T01:38:28.329 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T01:38:28.330 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-09-12T01:38:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-09-12T01:38:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.332 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-09-12T01:38:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-09-12T01:38:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T01:38:28.333 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T01:38:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.334 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.335 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.336 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.337 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-09-12T01:38:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-09-12T01:38:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.339 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.340 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-09-12T01:38:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-09-12T01:38:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-09-12T01:38:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.341 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.342 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-09-12T01:38:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T01:38:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-09-12T01:38:28.344 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-09-12T01:38:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-09-12T01:38:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.345 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-12T01:38:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-12T01:38:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-12T01:38:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-12T01:38:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-12T01:38:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.347 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-12T01:38:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.348 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.349 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.350 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.351 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.354 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.355 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-09-12T01:38:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-09-12T01:38:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.357 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.358 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.359 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.361 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.362 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.363 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T01:38:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T01:38:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T01:38:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T01:38:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.366 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-09-12T01:38:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.368 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.369 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.370 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.371 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.373 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.375 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.375 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.375 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.375 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.375 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.375 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.375 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.375 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.375 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.375 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.376 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.377 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.377 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.377 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.377 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.377 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.377 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.377 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.377 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.377 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.377 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.377 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.377 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.378 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.379 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.379 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-09-12T01:38:28.379 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.379 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.379 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.379 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T01:38:28.379 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.379 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.379 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-09-12T01:38:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.380 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.381 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.381 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.381 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.381 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.381 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.381 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.381 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.381 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.381 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.381 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.381 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.381 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.383 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.384 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.384 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.384 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.384 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.384 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.384 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.384 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.384 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.384 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.384 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.385 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-09-12T01:38:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-09-12T01:38:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.387 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-09-12T01:38:28.387 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.387 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.387 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.387 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.387 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.387 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.387 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.387 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-09-12T01:38:28.387 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-09-12T01:38:28.387 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.387 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.388 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.388 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.388 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.388 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.388 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.388 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.388 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.388 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.388 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.388 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-09-12T01:38:28.388 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-09-12T01:38:28.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.389 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.389 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.389 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.389 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.389 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.389 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.389 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.389 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.389 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.389 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.389 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-09-12T01:38:28.390 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-09-12T01:38:28.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.390 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.390 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.390 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.390 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.390 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.390 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.390 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.390 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.390 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.390 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.391 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-09-12T01:38:28.391 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-09-12T01:38:28.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.391 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.391 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.391 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.391 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.391 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.391 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.391 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.391 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.391 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.391 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-09-12T01:38:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-09-12T01:38:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.393 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.393 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-09-12T01:38:28.393 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-09-12T01:38:28.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.393 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.393 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.393 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.393 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.393 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.393 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.393 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.394 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-09-12T01:38:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-09-12T01:38:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.396 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.396 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.396 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.396 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.396 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-09-12T01:38:28.396 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-09-12T01:38:28.396 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.396 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.396 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.396 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.396 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.396 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.397 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.397 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.397 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.397 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.397 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.397 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-09-12T01:38:28.397 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-09-12T01:38:28.397 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.397 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.397 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.397 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.397 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-09-12T01:38:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-09-12T01:38:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-09-12T01:38:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-09-12T01:38:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-09-12T01:38:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-09-12T01:38:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-09-12T01:38:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-09-12T01:38:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T01:38:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-09-12T01:38:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-09-12T01:38:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T01:38:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-09-12T01:38:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-09-12T01:38:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T01:38:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-09-12T01:38:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-09-12T01:38:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T01:38:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-09-12T01:38:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-09-12T01:38:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T01:38:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-09-12T01:38:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-09-12T01:38:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-09-12T01:38:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-09-12T01:38:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-09-12T01:38:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-12T01:38:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-09-12T01:38:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-09-12T01:38:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-09-12T01:38:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-09-12T01:38:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-09-12T01:38:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-09-12T01:38:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-09-12T01:38:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-09-12T01:38:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-09-12T01:38:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-09-12T01:38:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-09-12T01:38:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-09-12T01:38:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-09-12T01:38:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-09-12T01:38:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-09-12T01:38:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T01:38:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-09-12T01:38:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-12T01:38:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "periodic_async_work": { 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "periodic_async_work", 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Periodically check for async work", 2024-09-12T01:38:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-09-12T01:38:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-09-12T01:38:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T01:38:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-09-12T01:38:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T01:38:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-09-12T01:38:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-09-12T01:38:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-09-12T01:38:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-09-12T01:38:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-09-12T01:38:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T01:38:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T01:38:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "modules": [ 2024-09-12T01:38:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-12T01:38:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "dashboard", 2024-09-12T01:38:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "iostat", 2024-09-12T01:38:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "nfs", 2024-09-12T01:38:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "restful", 2024-09-12T01:38:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_schedule" 2024-09-12T01:38:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-09-12T01:38:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-09-12T01:38:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T01:38:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-09-12T01:38:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-09-12T01:38:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to", 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-09-12T01:38:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-09-12T01:38:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-09-12T01:38:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-09-12T01:38:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-09-12T01:38:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-09-12T01:38:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-09-12T01:38:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-09-12T01:38:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-09-12T01:38:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-09-12T01:38:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-09-12T01:38:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-09-12T01:38:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-09-12T01:38:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-09-12T01:38:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-09-12T01:38:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-09-12T01:38:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T01:38:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-09-12T01:38:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-09-12T01:38:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-09-12T01:38:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T01:38:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:38:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-09-12T01:38:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-09-12T01:38:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-12T01:38:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-12T01:38:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T01:38:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:38:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-09-12T01:38:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-09-12T01:38:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-09-12T01:38:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T01:38:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-09-12T01:38:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T01:38:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-09-12T01:38:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-09-12T01:38:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T01:38:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T01:38:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T01:38:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-09-12T01:38:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-09-12T01:38:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-09-12T01:38:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-09-12T01:38:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-09-12T01:38:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-09-12T01:38:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T01:38:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-09-12T01:38:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-09-12T01:38:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-09-12T01:38:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T01:38:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:38:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-09-12T01:38:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-09-12T01:38:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-09-12T01:38:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T01:38:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-12T01:38:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-12T01:38:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-09-12T01:38:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-09-12T01:38:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "read", 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap", 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap-read" 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T01:38:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-09-12T01:38:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-09-12T01:38:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T01:38:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T01:38:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T01:38:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T01:38:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-09-12T01:38:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-09-12T01:38:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-09-12T01:38:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-09-12T01:38:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-09-12T01:38:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-12T01:38:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T01:38:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-09-12T01:38:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-09-12T01:38:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-09-12T01:38:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T01:38:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-09-12T01:38:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-09-12T01:38:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-09-12T01:38:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T01:38:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-09-12T01:38:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-09-12T01:38:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T01:38:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T01:38:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-09-12T01:38:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-09-12T01:38:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T01:38:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-09-12T01:38:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T01:38:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-09-12T01:38:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T01:38:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm_log_destination": { 2024-09-12T01:38:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm_log_destination", 2024-09-12T01:38:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "file", 2024-09-12T01:38:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "file,syslog", 2024-09-12T01:38:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "syslog" 2024-09-12T01:38:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T01:38:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-09-12T01:38:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-09-12T01:38:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T01:38:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-09-12T01:38:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-09-12T01:38:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T01:38:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-09-12T01:38:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-09-12T01:38:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T01:38:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-09-12T01:38:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-09-12T01:38:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T01:38:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-09-12T01:38:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-09-12T01:38:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-09-12T01:38:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T01:38:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-09-12T01:38:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-09-12T01:38:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-09-12T01:38:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T01:38:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T01:38:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-09-12T01:38:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-09-12T01:38:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T01:38:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-09-12T01:38:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-09-12T01:38:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-09-12T01:38:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T01:38:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-09-12T01:38:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-09-12T01:38:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-09-12T01:38:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T01:38:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-09-12T01:38:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-09-12T01:38:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-09-12T01:38:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T01:38:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-09-12T01:38:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-09-12T01:38:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-09-12T01:38:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T01:38:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T01:38:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-09-12T01:38:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-09-12T01:38:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T01:38:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba": { 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba", 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB container image", 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-09-12T01:38:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-09-12T01:38:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-09-12T01:38:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T01:38:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-09-12T01:38:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T01:38:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-09-12T01:38:28.546 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T01:38:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-09-12T01:38:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-09-12T01:38:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.547 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-09-12T01:38:28.548 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.548 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.548 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.548 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T01:38:28.548 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.548 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.548 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.548 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-09-12T01:38:28.548 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-09-12T01:38:28.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.548 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.549 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-09-12T01:38:28.549 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.549 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.549 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.549 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-09-12T01:38:28.549 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.549 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.549 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-09-12T01:38:28.549 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-09-12T01:38:28.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.550 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.550 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.550 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.550 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.550 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.550 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T01:38:28.550 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.550 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.550 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.550 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-09-12T01:38:28.550 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: "grafana_dashboards_path": { 2024-09-12T01:38:28.551 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "grafana_dashboards_path", 2024-09-12T01:38:28.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.552 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.552 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.552 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T01:38:28.552 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.552 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.552 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.552 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T01:38:28.552 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.552 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.552 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.553 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-09-12T01:38:28.554 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-09-12T01:38:28.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.554 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.554 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.554 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.554 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.554 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.554 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.554 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T01:38:28.554 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.554 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.554 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.555 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-09-12T01:38:28.555 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-09-12T01:38:28.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.555 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.555 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.555 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.555 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.555 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.555 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T01:38:28.555 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.555 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.556 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.557 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T01:38:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.559 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.559 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.559 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.559 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.559 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T01:38:28.559 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.559 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.559 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.559 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.559 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.560 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.560 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.560 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.560 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.560 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.560 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.560 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.560 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.560 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.560 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.560 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.560 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.560 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.561 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.561 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.561 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.561 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.561 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.561 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.561 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.561 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.561 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T01:38:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T01:38:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T01:38:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-09-12T01:38:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T01:38:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-09-12T01:38:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-09-12T01:38:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.565 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.566 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.566 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.566 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T01:38:28.566 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.566 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.566 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-09-12T01:38:28.566 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-09-12T01:38:28.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.566 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.566 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-09-12T01:38:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-12T01:38:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-12T01:38:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.567 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.568 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-09-12T01:38:28.568 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.568 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.568 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.568 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-09-12T01:38:28.568 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-09-12T01:38:28.568 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.568 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T01:38:28.568 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.568 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.568 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.568 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-09-12T01:38:28.569 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-09-12T01:38:28.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.569 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.569 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-09-12T01:38:28.569 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.569 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.569 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.569 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T01:38:28.569 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.569 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.570 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-09-12T01:38:28.570 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-09-12T01:38:28.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.570 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.570 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.570 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T01:38:28.570 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.570 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.570 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.570 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T01:38:28.570 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.571 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.571 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-09-12T01:38:28.571 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-09-12T01:38:28.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.571 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.571 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.571 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.571 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.571 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.571 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-09-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-09-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.573 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T01:38:28.573 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.573 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.573 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.573 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-09-12T01:38:28.573 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-09-12T01:38:28.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.573 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.573 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.573 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.573 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.574 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.574 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.574 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T01:38:28.574 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.574 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.574 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-09-12T01:38:28.574 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-09-12T01:38:28.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.574 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.574 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.575 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.575 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.575 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.575 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T01:38:28.575 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.575 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.575 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-09-12T01:38:28.575 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-09-12T01:38:28.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.575 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.576 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.576 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.576 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.576 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.576 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T01:38:28.576 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.576 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.576 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-09-12T01:38:28.576 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-09-12T01:38:28.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.577 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.577 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-09-12T01:38:28.577 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.577 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.577 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.577 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-09-12T01:38:28.577 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.577 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.577 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.577 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-09-12T01:38:28.580 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-09-12T01:38:28.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.580 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.580 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.580 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.580 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.580 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.580 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T01:38:28.580 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.581 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.581 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.581 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-09-12T01:38:28.581 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-09-12T01:38:28.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.581 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.581 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.581 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.581 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.581 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.581 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.581 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.582 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.583 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T01:38:28.584 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.584 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.584 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-09-12T01:38:28.584 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-09-12T01:38:28.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.584 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.584 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.584 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.584 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.584 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.585 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.586 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T01:38:28.586 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.586 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.586 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.586 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-09-12T01:38:28.586 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.586 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.586 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.586 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.587 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.588 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.588 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.588 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.588 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.588 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.588 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.588 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.588 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.588 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.588 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.589 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.590 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.590 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.590 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.590 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.590 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.590 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.590 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.590 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.590 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.590 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.590 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.590 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.590 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.591 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-09-12T01:38:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-09-12T01:38:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-09-12T01:38:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T01:38:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-09-12T01:38:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T01:38:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T01:38:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T01:38:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T01:38:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.596 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.596 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.596 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.596 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.596 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.596 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.596 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.596 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.596 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.596 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.596 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T01:38:28.596 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T01:38:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-09-12T01:38:28.598 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T01:38:28.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.598 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.598 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.598 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.598 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.598 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.598 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.598 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.598 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.598 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.600 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T01:38:28.600 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T01:38:28.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.600 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.600 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.600 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.600 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.600 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.600 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.600 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.600 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.600 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.600 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.601 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T01:38:28.601 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T01:38:28.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.601 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.601 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.601 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.601 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.601 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.601 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.601 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.601 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.603 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.603 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T01:38:28.603 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T01:38:28.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.603 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.603 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.603 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.603 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.603 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.603 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.603 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.604 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.604 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T01:38:28.604 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T01:38:28.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.604 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.604 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.604 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.604 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.604 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.604 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.605 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.605 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.605 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.605 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T01:38:28.605 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T01:38:28.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.605 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.605 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.605 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.605 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.605 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.605 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.606 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.607 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.608 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.608 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.608 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.608 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T01:38:28.608 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T01:38:28.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.608 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.608 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.608 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.608 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.609 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.609 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.609 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.609 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.609 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T01:38:28.609 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T01:38:28.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.609 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.609 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T01:38:28.609 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.610 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.611 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.611 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.611 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.611 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.611 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.611 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.611 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-09-12T01:38:28.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-09-12T01:38:28.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.611 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.611 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.611 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.612 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.612 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.612 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.612 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.612 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.612 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.612 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T01:38:28.612 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T01:38:28.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.612 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.613 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T01:38:28.613 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.613 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.613 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.613 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.613 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.613 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.613 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T01:38:28.613 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T01:38:28.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.614 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.614 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.614 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.614 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.614 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.614 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.614 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.614 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.614 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.614 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T01:38:28.614 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T01:38:28.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.615 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.615 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.615 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.615 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.615 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.615 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.615 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.615 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.615 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T01:38:28.616 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T01:38:28.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.616 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.616 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.616 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.616 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.616 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.616 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.616 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.616 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.616 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.616 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.617 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T01:38:28.617 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T01:38:28.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.617 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.617 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.617 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.617 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.617 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.617 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.617 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.617 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.618 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.619 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T01:38:28.619 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T01:38:28.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.619 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.619 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.619 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.619 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.619 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.619 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.619 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.619 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.620 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.620 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T01:38:28.620 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T01:38:28.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.620 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.620 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.620 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.620 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.620 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.620 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.620 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.621 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.621 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T01:38:28.621 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T01:38:28.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.621 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.621 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.621 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.621 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.621 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.622 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.622 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.622 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.622 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.622 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T01:38:28.622 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T01:38:28.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.622 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.622 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.622 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.622 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.623 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T01:38:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T01:38:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.624 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T01:38:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T01:38:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.625 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.626 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.627 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T01:38:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T01:38:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.628 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.629 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T01:38:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T01:38:28.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T01:38:28.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.632 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.632 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.632 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-09-12T01:38:28.632 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.632 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.632 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.632 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.632 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.632 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.632 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T01:38:28.632 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T01:38:28.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.633 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.633 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.633 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.633 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.633 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.633 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.633 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.633 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.633 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.633 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.634 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T01:38:28.635 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T01:38:28.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.635 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.635 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.635 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.635 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.635 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.635 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.635 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.635 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.635 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.636 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T01:38:28.636 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T01:38:28.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.636 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.636 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.636 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.636 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.636 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.636 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.636 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.636 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.637 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.638 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T01:38:28.638 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T01:38:28.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.638 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.638 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.638 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.638 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.638 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.638 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.638 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.639 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.639 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T01:38:28.639 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T01:38:28.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.639 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.639 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.639 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T01:38:28.639 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.639 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.639 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.639 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.639 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.640 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.640 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-09-12T01:38:28.640 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-09-12T01:38:28.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.640 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.640 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.640 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.640 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.640 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.640 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.641 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.641 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.641 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-09-12T01:38:28.641 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-09-12T01:38:28.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.641 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.641 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.641 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.641 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.641 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.642 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.643 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.644 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.644 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.644 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.644 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-12T01:38:28.644 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-12T01:38:28.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.644 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.644 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.644 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.644 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.644 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.645 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.645 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.645 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.645 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.645 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.645 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.645 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.645 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.645 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.646 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.647 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.647 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.647 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.647 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.647 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.647 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.647 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.647 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.648 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.648 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.648 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.648 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.648 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.648 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.648 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.648 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.648 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.648 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.648 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.650 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.650 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.650 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.650 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.650 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.650 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.650 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.650 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.650 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.652 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-09-12T01:38:28.652 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T01:38:28.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.652 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.652 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.652 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.652 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.652 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.652 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.652 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.652 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.652 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.652 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.653 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T01:38:28.653 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T01:38:28.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.653 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.653 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.653 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-12T01:38:28.653 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.653 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.653 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.653 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.653 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.653 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.654 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.654 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T01:38:28.654 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T01:38:28.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.654 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.654 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.654 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-09-12T01:38:28.654 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.654 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.654 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.654 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.654 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.656 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.656 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.656 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-09-12T01:38:28.656 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-09-12T01:38:28.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.656 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.656 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.656 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-09-12T01:38:28.656 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.656 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.656 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.656 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.657 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.657 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.657 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-12T01:38:28.657 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-12T01:38:28.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.657 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.657 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.657 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-09-12T01:38:28.657 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.657 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.657 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.658 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.659 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.660 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.660 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.660 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.660 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.660 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.660 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.660 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-12T01:38:28.660 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.661 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.662 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.662 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.662 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.662 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.662 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.662 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.662 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.662 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.662 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.662 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.663 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.663 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.663 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.663 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.663 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.663 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.663 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.663 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.663 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.663 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.664 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.664 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.664 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.664 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.664 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.664 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.664 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.664 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.664 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.664 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.665 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.665 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.665 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.665 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.665 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.665 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.665 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.665 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.665 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.665 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.665 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.666 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.667 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.667 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.667 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.667 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.667 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-09-12T01:38:28.667 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-09-12T01:38:28.667 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.667 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.667 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.667 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-09-12T01:38:28.668 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.668 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.668 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.668 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T01:38:28.668 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.668 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.668 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.668 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-09-12T01:38:28.668 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-09-12T01:38:28.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.668 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.668 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-09-12T01:38:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T01:38:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-09-12T01:38:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-09-12T01:38:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.670 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-09-12T01:38:28.670 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.670 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.670 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.670 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-09-12T01:38:28.670 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.670 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.670 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.670 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-09-12T01:38:28.670 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-09-12T01:38:28.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-09-12T01:38:28.671 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.672 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.672 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.672 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.672 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.672 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.672 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.672 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T01:38:28.672 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.672 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.672 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.672 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:28.672 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T01:38:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.673 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.675 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-09-12T01:38:28.675 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.675 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.675 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.675 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.675 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.675 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.675 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.675 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.675 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.675 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.680 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.680 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.680 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.680 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.680 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.680 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.680 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-09-12T01:38:28.680 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-09-12T01:38:28.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.680 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-09-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-09-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.682 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.682 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.682 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-09-12T01:38:28.682 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.682 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.682 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.682 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.682 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.682 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.682 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.682 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:28.682 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-09-12T01:38:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-09-12T01:38:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-09-12T01:38:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-09-12T01:38:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-09-12T01:38:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-09-12T01:38:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.684 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.685 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.685 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T01:38:28.685 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.685 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.685 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.685 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-09-12T01:38:28.685 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-09-12T01:38:28.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.685 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.685 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.685 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-09-12T01:38:28.685 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.686 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.686 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.686 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T01:38:28.686 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.686 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.686 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.686 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-09-12T01:38:28.686 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-09-12T01:38:28.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.686 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.686 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.687 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.687 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.687 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.687 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-09-12T01:38:28.687 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.687 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.687 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:28.687 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:28.687 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.687 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.687 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-09-12T01:38:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-09-12T01:38:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T01:38:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.689 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.689 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.689 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.689 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.689 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.689 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.689 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.689 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.689 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.689 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.689 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.689 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.689 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.690 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.691 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.692 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.692 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.692 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.692 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.692 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.692 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.692 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.692 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.692 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.692 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.692 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.694 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-09-12T01:38:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-09-12T01:38:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-09-12T01:38:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-09-12T01:38:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-12T01:38:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-12T01:38:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-09-12T01:38:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:38:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-09-12T01:38:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-09-12T01:38:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T01:38:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T01:38:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-09-12T01:38:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T01:38:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.697 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-09-12T01:38:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-09-12T01:38:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-09-12T01:38:28.698 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.699 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.699 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-09-12T01:38:28.699 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-09-12T01:38:28.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.699 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.699 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-09-12T01:38:28.699 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.699 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.699 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.699 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:38:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-09-12T01:38:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.701 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.702 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.703 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.703 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.703 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.703 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.703 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.703 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.703 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.703 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.703 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.703 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.703 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.704 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.704 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.704 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.704 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.704 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.704 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.704 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.704 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.704 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.704 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.704 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.704 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.705 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.705 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.705 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.705 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.705 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.705 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.705 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.705 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.705 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.705 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.706 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.706 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-09-12T01:38:28.706 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.706 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.706 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.706 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.706 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.706 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.707 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.708 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.708 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.708 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.708 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.708 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.708 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.708 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.708 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.708 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.708 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.708 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.709 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.710 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.710 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.710 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.710 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.710 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.710 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.710 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.710 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.710 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.710 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.710 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.712 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "k8sevents", 2024-09-12T01:38:28.712 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.712 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.712 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.712 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_event_retention_days": { 2024-09-12T01:38:28.712 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ceph_event_retention_days", 2024-09-12T01:38:28.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.712 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.712 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-12T01:38:28.712 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.712 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.713 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.713 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T01:38:28.713 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.713 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.713 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.713 INFO:teuthology.orchestra.run.smithi081.stdout: "config_check_secs": { 2024-09-12T01:38:28.713 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_check_secs", 2024-09-12T01:38:28.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.713 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.713 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.713 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.713 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "10", 2024-09-12T01:38:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T01:38:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.715 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.715 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.715 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.715 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.715 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.715 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.715 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.715 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.715 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.715 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.715 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.715 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.715 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.716 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.716 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.716 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.716 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.716 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.716 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.716 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.716 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.716 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.716 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.717 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.717 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.717 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.717 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.717 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.717 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.717 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.717 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.717 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.718 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.719 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.719 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.719 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.719 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.719 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.719 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.719 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.719 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.719 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.719 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.719 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.720 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-09-12T01:38:28.720 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.720 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.720 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.720 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-09-12T01:38:28.720 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-09-12T01:38:28.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.720 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.720 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.720 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-09-12T01:38:28.721 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.721 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.721 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.721 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-09-12T01:38:28.721 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T01:38:28.721 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.721 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.721 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.721 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.721 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.722 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.722 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.722 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.722 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.722 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.722 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.722 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.722 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.722 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.722 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.722 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.722 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.724 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.724 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.724 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.724 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.724 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.724 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.724 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.724 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.724 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.726 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.726 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.726 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.726 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.726 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.726 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.726 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.726 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.726 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.726 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.726 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.728 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-09-12T01:38:28.728 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-09-12T01:38:28.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.728 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.728 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.728 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-12T01:38:28.728 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.728 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.728 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.728 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-09-12T01:38:28.728 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-09-12T01:38:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-09-12T01:38:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-09-12T01:38:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T01:38:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-09-12T01:38:28.730 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-09-12T01:38:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-09-12T01:38:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-09-12T01:38:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.731 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.733 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.734 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.735 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.736 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.737 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.738 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-09-12T01:38:28.738 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.738 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.738 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.738 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.738 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.738 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.739 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.739 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.739 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.739 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.739 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.739 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.739 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.739 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.739 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.739 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.739 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.739 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.739 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.740 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.743 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.743 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.743 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.743 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.743 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.743 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.743 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.743 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.743 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.743 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.744 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.745 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.745 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.745 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.745 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.745 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.745 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.745 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.745 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.745 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.745 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.745 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.745 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.748 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.748 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.748 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.748 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.748 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.748 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.748 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.748 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.748 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.748 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.748 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.749 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.752 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.752 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.752 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.752 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.752 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.752 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.752 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.752 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.752 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.752 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.752 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.753 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.753 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.753 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.753 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.753 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.753 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.753 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.753 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.753 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.753 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.753 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.754 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-09-12T01:38:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-12T01:38:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-12T01:38:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-09-12T01:38:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-09-12T01:38:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-09-12T01:38:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.758 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.759 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.759 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.759 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.759 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.759 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.759 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.759 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.759 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.759 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.759 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.759 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.760 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.760 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.760 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.760 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.760 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.760 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.760 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.760 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.760 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.762 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-09-12T01:38:28.763 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.765 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.765 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.765 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.765 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.765 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.765 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.765 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.765 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.765 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.765 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.768 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.769 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.769 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.769 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.769 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-09-12T01:38:28.769 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.769 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.769 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.769 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.770 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.770 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.770 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.770 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.770 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.770 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.770 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.770 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.770 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.770 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.770 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.771 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.771 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.771 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.771 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.771 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.771 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.771 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.771 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.771 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.772 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.772 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.772 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.772 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.772 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.772 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.772 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.772 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.772 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.772 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-09-12T01:38:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-09-12T01:38:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-12T01:38:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-09-12T01:38:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-09-12T01:38:28.777 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T01:38:28.777 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.777 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.777 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-09-12T01:38:28.777 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.777 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.777 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.777 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-09-12T01:38:28.777 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-12T01:38:28.778 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.779 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.781 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.784 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.784 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.784 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.784 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.784 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.784 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.784 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.784 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.784 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.784 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.784 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.784 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.785 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.786 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.787 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.788 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-09-12T01:38:28.789 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-09-12T01:38:28.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.789 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.789 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.789 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.789 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.789 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.789 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.789 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.789 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.789 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.789 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.791 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.791 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.791 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.791 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.791 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.791 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.791 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.791 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.791 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.791 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.791 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.792 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.792 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.792 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.792 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.792 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.792 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.792 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.792 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.792 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.792 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.793 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.793 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.793 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.793 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.793 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.793 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.793 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.793 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.793 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.793 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.794 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.795 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.796 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.796 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.796 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-09-12T01:38:28.796 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-09-12T01:38:28.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.796 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.796 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.796 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.796 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.796 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.796 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.796 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.797 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.798 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.798 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.798 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-09-12T01:38:28.798 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-09-12T01:38:28.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.798 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.798 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.798 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-09-12T01:38:28.798 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.798 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.798 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.799 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.800 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T01:38:28.800 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.800 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.800 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.800 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T01:38:28.800 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T01:38:28.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.800 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.800 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.800 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-09-12T01:38:28.800 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.800 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.801 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.802 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.802 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.802 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.802 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.802 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.802 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-12T01:38:28.802 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-12T01:38:28.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.802 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.802 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.802 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-09-12T01:38:28.802 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.803 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.804 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.804 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-12T01:38:28.804 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-12T01:38:28.804 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-12T01:38:28.804 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.804 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.804 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.804 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.804 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.805 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-12T01:38:28.805 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.805 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.805 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.805 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.805 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.805 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.805 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.805 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.805 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.805 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.806 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.806 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.806 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.806 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.806 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.806 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.806 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.806 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.806 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.806 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.806 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.806 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.807 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.807 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.807 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.807 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.807 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.807 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.807 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.807 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.807 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.807 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.809 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.809 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.809 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.809 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.809 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.809 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.809 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.809 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.809 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.809 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.810 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.810 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.810 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.810 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.810 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.810 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.810 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.810 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-09-12T01:38:28.810 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-09-12T01:38:28.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.810 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.811 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T01:38:28.811 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.811 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.811 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.811 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.811 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.811 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.811 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.811 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-09-12T01:38:28.811 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T01:38:28.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-09-12T01:38:28.812 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-09-12T01:38:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-09-12T01:38:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-09-12T01:38:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-09-12T01:38:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.814 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.815 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.816 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.816 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.816 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.816 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.816 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.816 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.816 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.816 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.816 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.816 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.817 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.819 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.819 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.819 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.819 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.819 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.819 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.819 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.819 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.819 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.819 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.820 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.821 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.821 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.821 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.821 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.821 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.821 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.821 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.821 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.821 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.821 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T01:38:28.821 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T01:38:28.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T01:38:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.824 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-09-12T01:38:28.824 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.824 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.824 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.824 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.824 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.824 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.824 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.824 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.824 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.824 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.824 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.824 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.825 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.826 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.826 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.826 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.826 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.826 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.826 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.826 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.826 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.826 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.826 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.827 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.828 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.828 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.828 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.828 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.828 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.828 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.828 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.828 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.828 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.828 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.828 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.829 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.829 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.829 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.829 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.829 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.829 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.829 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.829 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-09-12T01:38:28.829 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.830 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.831 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.831 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.831 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.831 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.831 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.831 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.831 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.831 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.831 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.831 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.832 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.832 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.832 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.832 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.832 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.832 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.832 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.832 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.832 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.832 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.832 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.833 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.833 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.833 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.833 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.833 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.833 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.833 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.833 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.833 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.833 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.833 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.833 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.834 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.835 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.836 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.836 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T01:38:28.836 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.836 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.836 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.836 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-09-12T01:38:28.836 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.836 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.836 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.837 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.838 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.838 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.838 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.838 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.838 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.838 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.838 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.838 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.838 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.838 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.840 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.841 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.841 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.841 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.841 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.841 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.841 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.841 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.841 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.841 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.842 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.842 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-09-12T01:38:28.842 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-09-12T01:38:28.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.842 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.842 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.842 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.842 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.842 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.842 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.842 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.842 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.843 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.843 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.843 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-09-12T01:38:28.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-09-12T01:38:28.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.843 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.843 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.843 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-09-12T01:38:28.843 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.843 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.843 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.843 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.845 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.845 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.845 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.845 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-09-12T01:38:28.845 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-09-12T01:38:28.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.845 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.845 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.845 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.845 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.845 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.845 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.846 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.846 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.846 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.846 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-09-12T01:38:28.846 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-09-12T01:38:28.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T01:38:28.846 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.846 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.846 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.846 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.847 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.848 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.848 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.848 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.848 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.848 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.848 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-09-12T01:38:28.848 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-09-12T01:38:28.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.848 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.848 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.848 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.849 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T01:38:28.851 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-09-12T01:38:28.851 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.851 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.851 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.851 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.851 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.851 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-09-12T01:38:28.851 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-09-12T01:38:28.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.851 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.851 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.851 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-09-12T01:38:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-09-12T01:38:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.853 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.853 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.853 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.853 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.853 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.853 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.853 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.853 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.853 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-09-12T01:38:28.853 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-09-12T01:38:28.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.853 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.854 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.854 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.854 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.854 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.854 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.854 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.854 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.854 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.854 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.855 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-12T01:38:28.855 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.855 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.855 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.855 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-09-12T01:38:28.855 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-09-12T01:38:28.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.855 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.855 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.855 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.855 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.855 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.855 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.856 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T01:38:28.856 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.856 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.856 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.856 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-09-12T01:38:28.856 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-09-12T01:38:28.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.856 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.856 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.856 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.856 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.857 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.858 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.859 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.859 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.859 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.859 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.859 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.859 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.859 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.859 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.859 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.859 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.859 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.860 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.860 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.860 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.860 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.860 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.860 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.860 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.860 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.860 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.860 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.860 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.860 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.862 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.862 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.862 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.862 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.862 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.862 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.862 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.862 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-09-12T01:38:28.863 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.863 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.863 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.863 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.863 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.863 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.863 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.863 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.863 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.863 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.863 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.863 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.864 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.864 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.864 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.864 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.864 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.864 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.864 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.864 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.864 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.864 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.864 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.864 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.865 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.867 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.868 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.868 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.868 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.868 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.868 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.868 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-09-12T01:38:28.868 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.868 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.868 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.869 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.869 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.869 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.869 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.869 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.869 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.869 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.869 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.869 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.869 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.869 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.869 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.869 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.870 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.871 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.871 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.871 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.871 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.871 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.871 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.871 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.871 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.871 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.871 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.871 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.872 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.872 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.872 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.872 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.872 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.872 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.872 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.872 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.872 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.872 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.872 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.872 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.872 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.873 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.873 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.873 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.873 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.873 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.873 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.873 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.873 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.873 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.873 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.873 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-09-12T01:38:28.874 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:28.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.876 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.876 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.876 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-09-12T01:38:28.876 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.876 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.876 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.876 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.876 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.876 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.876 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.876 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.876 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.877 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.877 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.877 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.877 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.877 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.877 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.877 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.877 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.877 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.877 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.877 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.877 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.878 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.878 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.878 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.878 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.878 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.878 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.878 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.878 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.878 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.878 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.879 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.879 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.879 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.879 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.879 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.879 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.879 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.879 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.879 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.879 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.879 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.880 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.880 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.880 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.880 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.880 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.880 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.880 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.880 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.880 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.880 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.880 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.880 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.880 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.881 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.881 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.881 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.881 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.881 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.881 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.881 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.881 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.881 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-09-12T01:38:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-09-12T01:38:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-09-12T01:38:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.883 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.883 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.883 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.883 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.883 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.883 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.883 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T01:38:28.883 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.883 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.883 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-09-12T01:38:28.883 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-09-12T01:38:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T01:38:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-09-12T01:38:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-09-12T01:38:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T01:38:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.886 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-09-12T01:38:28.886 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-09-12T01:38:28.886 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.886 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.886 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.886 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.886 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.886 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.886 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T01:38:28.886 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.886 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.886 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.887 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-09-12T01:38:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-09-12T01:38:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-09-12T01:38:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-09-12T01:38:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-09-12T01:38:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-09-12T01:38:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T01:38:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-12T01:38:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-12T01:38:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.891 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.892 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.892 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.892 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.892 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.892 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:28.892 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:28.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.892 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.892 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.892 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-09-12T01:38:28.892 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-09-12T01:38:28.892 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.893 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.893 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.893 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.893 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.893 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.893 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-09-12T01:38:28.893 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-09-12T01:38:28.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.893 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.893 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.893 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-09-12T01:38:28.893 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.894 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.895 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.895 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.895 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.895 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.895 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.895 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-09-12T01:38:28.895 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-09-12T01:38:28.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.895 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.895 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.895 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.896 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.896 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.896 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.896 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.896 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.896 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.896 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.896 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.896 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.896 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.896 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.896 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.899 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.899 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.899 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.899 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.899 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.899 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.899 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.899 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.899 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.899 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.900 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.900 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.900 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.900 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.900 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.900 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.900 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.900 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.900 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.901 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.901 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.901 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.901 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.901 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.901 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.901 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.901 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.901 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.901 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.901 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.901 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.904 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-09-12T01:38:28.904 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-09-12T01:38:28.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.904 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.904 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T01:38:28.904 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.904 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.904 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.904 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.904 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.906 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.906 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.906 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.906 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.906 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.906 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.906 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.906 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.906 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.906 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.906 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.906 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.906 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.907 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.908 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.908 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.908 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.908 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.908 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.908 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.908 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.908 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.908 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.908 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.910 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.910 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.910 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.910 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.910 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.910 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.910 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.910 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.910 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.910 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.911 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.912 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.914 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.914 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.914 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.914 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.914 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.914 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.914 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.914 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.914 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.914 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.914 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.914 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.914 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.915 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.916 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.916 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.916 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.916 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.916 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.916 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.916 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-09-12T01:38:28.916 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-09-12T01:38:28.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.916 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.916 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.917 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-09-12T01:38:28.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.917 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.917 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.917 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T01:38:28.917 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.917 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.917 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.917 INFO:teuthology.orchestra.run.smithi081.stdout: "periodic_async_work": { 2024-09-12T01:38:28.917 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "periodic_async_work", 2024-09-12T01:38:28.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.917 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Periodically check for async work", 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.918 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T01:38:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T01:38:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-09-12T01:38:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T01:38:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T01:38:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T01:38:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.921 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-09-12T01:38:28.921 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T01:38:28.921 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T01:38:28.921 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T01:38:28.921 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-09-12T01:38:28.921 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-09-12T01:38:28.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T01:38:28.921 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.921 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.921 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-09-12T01:38:28.921 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.921 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.922 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T01:38:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T01:38:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T01:38:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T01:38:28.923 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.924 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.924 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.924 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.924 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.924 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.924 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.924 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T01:38:28.924 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T01:38:28.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.924 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.924 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.924 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.925 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.926 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.927 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T01:38:28.927 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T01:38:28.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.927 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.927 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T01:38:28.927 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.927 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.927 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T01:38:28.927 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T01:38:28.927 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T01:38:28.927 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T01:38:28.928 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T01:38:28.928 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T01:38:28.928 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T01:38:28.928 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.928 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.928 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.928 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.928 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.928 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T01:38:28.928 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T01:38:28.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T01:38:28.928 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T01:38:28.929 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T01:38:28.929 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.929 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.929 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.929 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.929 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.929 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.929 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.929 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-09-12T01:38:28.929 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-09-12T01:38:28.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-09-12T01:38:28.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T01:38:28.931 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.931 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.931 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-09-12T01:38:28.931 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.931 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.931 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.931 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.931 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.931 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.931 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.931 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-09-12T01:38:28.931 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-09-12T01:38:28.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T01:38:28.932 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T01:38:28.932 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T01:38:28.932 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T01:38:28.932 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T01:38:28.932 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T01:38:28.932 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T01:38:28.932 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T01:38:28.932 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T01:38:28.932 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T01:38:28.932 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T01:38:28.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: "services": { 2024-09-12T01:38:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: "dashboard": "https://172.21.15.81:8443/" 2024-09-12T01:38:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: "always_on_modules": { 2024-09-12T01:38:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus": [ 2024-09-12T01:38:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-12T01:38:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-12T01:38:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-12T01:38:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-12T01:38:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-12T01:38:28.934 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-12T01:38:28.934 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-12T01:38:28.934 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-12T01:38:28.934 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-12T01:38:28.934 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-12T01:38:28.934 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.934 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific": [ 2024-09-12T01:38:28.934 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-12T01:38:28.934 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-12T01:38:28.934 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-12T01:38:28.934 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-12T01:38:28.934 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-12T01:38:28.934 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-12T01:38:28.935 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-12T01:38:28.935 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-12T01:38:28.935 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-12T01:38:28.935 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-12T01:38:28.935 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.935 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy": [ 2024-09-12T01:38:28.935 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-12T01:38:28.935 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-12T01:38:28.935 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-12T01:38:28.935 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-12T01:38:28.935 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-12T01:38:28.935 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-12T01:38:28.936 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-12T01:38:28.936 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-12T01:38:28.936 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-12T01:38:28.936 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-12T01:38:28.936 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.936 INFO:teuthology.orchestra.run.smithi081.stdout: "reef": [ 2024-09-12T01:38:28.936 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-12T01:38:28.936 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-12T01:38:28.936 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-12T01:38:28.936 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-12T01:38:28.936 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-12T01:38:28.936 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: "squid": [ 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-12T01:38:28.937 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-12T01:38:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-12T01:38:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-12T01:38:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T01:38:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: "last_failure_osd_epoch": 83, 2024-09-12T01:38:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: "active_clients": [ 2024-09-12T01:38:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-12T01:38:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T01:38:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T01:38:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-12T01:38:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3376350849 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "libcephsqlite", 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 970406078 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.940 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-12T01:38:28.940 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T01:38:28.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T01:38:28.940 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-12T01:38:28.940 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2153451085 2024-09-12T01:38:28.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.940 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T01:38:28.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.940 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-12T01:38:28.940 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T01:38:28.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T01:38:28.941 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-12T01:38:28.941 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1297495055 2024-09-12T01:38:28.941 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.941 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T01:38:28.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.941 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-12T01:38:28.941 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T01:38:28.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T01:38:28.941 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-12T01:38:28.941 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2346827955 2024-09-12T01:38:28.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.942 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T01:38:28.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:28.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.942 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-12T01:38:28.942 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T01:38:28.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T01:38:28.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T01:38:28.942 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-12T01:38:28.942 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3096869484 2024-09-12T01:38:28.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.942 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T01:38:28.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:28.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T01:38:28.943 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:38:28.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:27 smithi189 ceph-mon[35357]: pgmap v322: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-12T01:38:28.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:27 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/327691603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:38:28.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:27 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2153876024' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:38:28.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:27 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2996696114' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T01:38:28.944 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:27 smithi100 ceph-mon[35275]: pgmap v322: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-12T01:38:28.944 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:27 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/327691603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:38:28.944 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:27 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2153876024' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:38:28.944 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:27 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2996696114' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T01:38:28.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.560+0000 7ff08da74640 1 -- 172.21.15.81:0/2996696114 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff0740a2d00 msgr2=0x7ff0740a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.560+0000 7ff08da74640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff0740a2d00 0x7ff0740a51c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff0881023d0 tx=0x7ff070005bf0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.560+0000 7ff08da74640 1 -- 172.21.15.81:0/2996696114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff088102cf0 msgr2=0x7ff088100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.560+0000 7ff08da74640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff088102cf0 0x7ff088100940 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7ff078005ab0 tx=0x7ff078004360 comp rx=0 tx=0).stop 2024-09-12T01:38:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.560+0000 7ff08da74640 1 -- 172.21.15.81:0/2996696114 shutdown_connections 2024-09-12T01:38:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.560+0000 7ff08da74640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7ff0740a2d00 0x7ff0740a51c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.560+0000 7ff08da74640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff08810c0c0 0x7ff0881013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.560+0000 7ff08da74640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff088103610 0x7ff088100e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.560+0000 7ff08da74640 1 --2- 172.21.15.81:0/2996696114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff088102cf0 0x7ff088100940 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.560+0000 7ff08da74640 1 -- 172.21.15.81:0/2996696114 >> 172.21.15.81:0/2996696114 conn(0x7ff088077a10 msgr2=0x7ff0880fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.560+0000 7ff08da74640 1 -- 172.21.15.81:0/2996696114 shutdown_connections 2024-09-12T01:38:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:27.561+0000 7ff08da74640 1 -- 172.21.15.81:0/2996696114 wait complete. 2024-09-12T01:38:29.007 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T01:38:29.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T01:38:29.008 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:27 smithi081 ceph-mon[30920]: pgmap v322: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-12T01:38:29.008 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:27 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/327691603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:38:29.008 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:27 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2153876024' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:38:29.009 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:27 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2996696114' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T01:38:29.264 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:29.744 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:38:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:38:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 950, 2024-09-12T01:38:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 938, 2024-09-12T01:38:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1849296, 2024-09-12T01:38:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 355754, 2024-09-12T01:38:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-09-12T01:38:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-09-12T01:38:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.109787594, 2024-09-12T01:38:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.039656269, 2024-09-12T01:38:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.054924806, 2024-09-12T01:38:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.021296672, 2024-09-12T01:38:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 937, 2024-09-12T01:38:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.040297833, 2024-09-12T01:38:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000043007 2024-09-12T01:38:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1606368, 2024-09-12T01:38:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 125840 2024-09-12T01:38:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:38:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 632, 2024-09-12T01:38:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 784, 2024-09-12T01:38:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 155952, 2024-09-12T01:38:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 636008, 2024-09-12T01:38:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 7, 2024-09-12T01:38:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 5, 2024-09-12T01:38:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.066171694, 2024-09-12T01:38:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.023446174, 2024-09-12T01:38:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.015343972, 2024-09-12T01:38:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.021296485, 2024-09-12T01:38:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 781, 2024-09-12T01:38:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.025773049, 2024-09-12T01:38:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000033000 2024-09-12T01:38:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T01:38:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 435600 2024-09-12T01:38:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:38:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 734, 2024-09-12T01:38:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 734, 2024-09-12T01:38:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 196052, 2024-09-12T01:38:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 232589, 2024-09-12T01:38:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-12T01:38:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-12T01:38:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.057256833, 2024-09-12T01:38:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.018222694, 2024-09-12T01:38:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.017166394, 2024-09-12T01:38:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.016753001, 2024-09-12T01:38:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 733, 2024-09-12T01:38:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.025947870, 2024-09-12T01:38:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000035399 2024-09-12T01:38:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-12T01:38:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3349, 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.083809690, 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000025025 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-09-12T01:38:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-12T01:38:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-12T01:38:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-12T01:38:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 0, 2024-09-12T01:38:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 0, 2024-09-12T01:38:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-09-12T01:38:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 0, 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 0, 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 0, 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 0, 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 0, 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 0, 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 0, 2024-09-12T01:38:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 0, 2024-09-12T01:38:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-09-12T01:38:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-09-12T01:38:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 1, 2024-09-12T01:38:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 0, 2024-09-12T01:38:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 0, 2024-09-12T01:38:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 0, 2024-09-12T01:38:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 0, 2024-09-12T01:38:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:38:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-09-12T01:38:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-09-12T01:38:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-09-12T01:38:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-09-12T01:38:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 0, 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 0, 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 0, 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 0 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 0, 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 0, 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 0, 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 0, 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 0, 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 0, 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 0, 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 6, 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 0, 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 2, 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 2, 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 4196127, 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 4195986, 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 6 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 3, 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 3, 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 0, 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 1, 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 1, 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 0, 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 0, 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 0, 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 0, 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 0, 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 0, 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 51008, 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 215328 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 0, 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 0, 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 0, 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 0, 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 0, 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-09-12T01:38:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-09-12T01:38:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-09-12T01:38:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-09-12T01:38:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-09-12T01:38:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-09-12T01:38:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-09-12T01:38:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-09-12T01:38:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-09-12T01:38:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-09-12T01:38:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-09-12T01:38:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:38:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:38:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-09-12T01:38:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-09-12T01:38:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 2, 2024-09-12T01:38:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 3, 2024-09-12T01:38:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 1, 2024-09-12T01:38:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 3, 2024-09-12T01:38:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-09-12T01:38:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 0, 2024-09-12T01:38:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 0, 2024-09-12T01:38:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 2175, 2024-09-12T01:38:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-09-12T01:38:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-12T01:38:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:38:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-12T01:38:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:38:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:38:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:38:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:38:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:38:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:38:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:38:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:38:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:38:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:38:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:38:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:38:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:38:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-12T01:38:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:38:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-12T01:38:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:38:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:38:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:38:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:38:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 189433, 2024-09-12T01:38:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 52, 2024-09-12T01:38:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:38:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-12T01:38:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-12T01:38:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-12T01:38:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:38:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-12T01:38:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:38:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-12T01:38:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 8128, 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 179, 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 8512, 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 13, 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-09-12T01:38:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 2083, 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 21, 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 3, 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 2083, 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2083, 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.357971896, 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000651930 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2083, 2024-09-12T01:38:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2084 2024-09-12T01:38:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 2083, 2024-09-12T01:38:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 2083, 2024-09-12T01:38:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 0, 2024-09-12T01:38:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-09-12T01:38:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-09-12T01:38:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 1350, 2024-09-12T01:38:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 0, 2024-09-12T01:38:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 731, 2024-09-12T01:38:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 0, 2024-09-12T01:38:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 0, 2024-09-12T01:38:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-09-12T01:38:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-09-12T01:38:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-09-12T01:38:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-09-12T01:38:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 0, 2024-09-12T01:38:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-09-12T01:38:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-09-12T01:38:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-09-12T01:38:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 1, 2024-09-12T01:38:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 0, 2024-09-12T01:38:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:38:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-09-12T01:38:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:38:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-09-12T01:38:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-09-12T01:38:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 91, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 9, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 5, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 5, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 0, 2024-09-12T01:38:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 2, 2024-09-12T01:38:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 0 2024-09-12T01:38:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-09-12T01:38:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 0, 2024-09-12T01:38:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:38:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-09-12T01:38:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-09-12T01:38:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2024-09-12T01:38:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-09-12T01:38:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-09-12T01:38:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 0, 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 0, 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 0, 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 2312, 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 1978560, 2024-09-12T01:38:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 2312, 2024-09-12T01:38:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T01:38:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T01:38:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2312, 2024-09-12T01:38:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1978560, 2024-09-12T01:38:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T01:38:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-09-12T01:38:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2083, 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 1828, 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2083, 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1828, 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2083, 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 2083, 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2083, 2024-09-12T01:38:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 2083, 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x55c58c77eb40": { 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T01:38:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:29.791 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:38:29.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:29 smithi081 ceph-mon[30920]: pgmap v323: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-12T01:38:30.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:29 smithi100 ceph-mon[35275]: pgmap v323: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-12T01:38:30.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:29 smithi189 ceph-mon[35357]: pgmap v323: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-12T01:38:30.647 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-12T01:38:30.648 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-12T01:38:30.648 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-12T01:38:30.648 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-12T01:38:30.648 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-09-12T01:38:30.648 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:38:30.648 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:38:30.648 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T01:38:30.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T01:38:30.895 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:31.415 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:38:31.415 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:38:31.415 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 0, 2024-09-12T01:38:31.415 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2, 2024-09-12T01:38:31.415 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 0, 2024-09-12T01:38:31.415 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 0, 2024-09-12T01:38:31.415 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-12T01:38:31.415 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2024-09-12T01:38:31.416 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.001189821, 2024-09-12T01:38:31.416 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T01:38:31.416 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.000287438, 2024-09-12T01:38:31.416 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:38:31.416 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:31.416 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:31.416 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:31.416 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:31.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:31.416 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:31.416 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:31.416 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:38:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:38:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:38:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 217, 2024-09-12T01:38:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 206, 2024-09-12T01:38:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1579424, 2024-09-12T01:38:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 126624, 2024-09-12T01:38:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2024-09-12T01:38:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-09-12T01:38:31.417 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.039020041, 2024-09-12T01:38:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.014172136, 2024-09-12T01:38:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.037704794, 2024-09-12T01:38:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:38:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 205, 2024-09-12T01:38:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.010779548, 2024-09-12T01:38:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000052583 2024-09-12T01:38:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:31.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1579424, 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 126624 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 6, 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 161, 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 3344, 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 185664, 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.015853319, 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.009566149, 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.004233318, 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:38:31.419 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 159, 2024-09-12T01:38:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.015544900, 2024-09-12T01:38:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000097766 2024-09-12T01:38:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-12T01:38:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 185664 2024-09-12T01:38:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:31.420 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:38:31.421 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:38:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:38:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:38:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:38:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:38:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:38:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-12T01:38:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:38:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-12T01:38:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:38:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:38:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:38:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:38:31.422 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:38:31.423 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 148994, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 31, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:38:31.424 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-12T01:38:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-12T01:38:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 928, 2024-09-12T01:38:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2024-09-12T01:38:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-12T01:38:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-12T01:38:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-12T01:38:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-12T01:38:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:38:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T01:38:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-12T01:38:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T01:38:31.425 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 219, 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 1548849, 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 219, 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 219, 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1548849, 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:31.426 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:38:31.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:31 smithi081 ceph-mon[30920]: pgmap v324: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 op/s 2024-09-12T01:38:32.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:31 smithi100 ceph-mon[35275]: pgmap v324: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 op/s 2024-09-12T01:38:32.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:31 smithi189 ceph-mon[35357]: pgmap v324: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 op/s 2024-09-12T01:38:32.140 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T01:38:32.140 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T01:38:32.141 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-12T01:38:32.141 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-12T01:38:32.141 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-12T01:38:32.141 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-12T01:38:32.141 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-12T01:38:32.141 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T01:38:32.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T01:38:32.385 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:32.925 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:38:32.925 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:38:32.925 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 959, 2024-09-12T01:38:32.925 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 945, 2024-09-12T01:38:32.925 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1853872, 2024-09-12T01:38:32.925 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 358436, 2024-09-12T01:38:32.926 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-09-12T01:38:32.926 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-09-12T01:38:32.926 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.121843574, 2024-09-12T01:38:32.926 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.048864879, 2024-09-12T01:38:32.926 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.058455596, 2024-09-12T01:38:32.926 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.019627413, 2024-09-12T01:38:32.926 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:32.926 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 945, 2024-09-12T01:38:32.926 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.055810315, 2024-09-12T01:38:32.926 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000059058 2024-09-12T01:38:32.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.926 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:32.927 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.927 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.927 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1609936, 2024-09-12T01:38:32.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 127568 2024-09-12T01:38:32.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.927 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:38:32.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1361, 2024-09-12T01:38:32.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1515, 2024-09-12T01:38:32.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 347829, 2024-09-12T01:38:32.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 869787, 2024-09-12T01:38:32.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 7, 2024-09-12T01:38:32.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 5, 2024-09-12T01:38:32.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.090330017, 2024-09-12T01:38:32.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.030081966, 2024-09-12T01:38:32.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.022958377, 2024-09-12T01:38:32.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.030086645, 2024-09-12T01:38:32.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:32.928 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1512, 2024-09-12T01:38:32.928 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.053040942, 2024-09-12T01:38:32.928 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000035079 2024-09-12T01:38:32.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.929 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:32.929 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.929 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.929 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.929 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T01:38:32.929 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 437568 2024-09-12T01:38:32.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.929 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:38:32.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 4, 2024-09-12T01:38:32.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 6, 2024-09-12T01:38:32.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1629, 2024-09-12T01:38:32.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 1284, 2024-09-12T01:38:32.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-09-12T01:38:32.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 4, 2024-09-12T01:38:32.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.001257292, 2024-09-12T01:38:32.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000066550, 2024-09-12T01:38:32.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.001005424, 2024-09-12T01:38:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000084525, 2024-09-12T01:38:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4, 2024-09-12T01:38:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.002044212, 2024-09-12T01:38:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000511053 2024-09-12T01:38:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:38:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:38:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-12T01:38:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-09-12T01:38:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-12T01:38:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-09-12T01:38:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-12T01:38:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-12T01:38:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3522, 2024-09-12T01:38:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.077873187, 2024-09-12T01:38:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000022110 2024-09-12T01:38:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-09-12T01:38:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-12T01:38:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-12T01:38:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-12T01:38:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 0, 2024-09-12T01:38:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 0, 2024-09-12T01:38:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-09-12T01:38:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-09-12T01:38:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 0, 2024-09-12T01:38:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-09-12T01:38:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-09-12T01:38:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 0, 2024-09-12T01:38:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-09-12T01:38:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-09-12T01:38:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 0, 2024-09-12T01:38:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 0, 2024-09-12T01:38:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 0, 2024-09-12T01:38:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 0, 2024-09-12T01:38:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 0, 2024-09-12T01:38:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 0, 2024-09-12T01:38:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-09-12T01:38:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-09-12T01:38:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 1, 2024-09-12T01:38:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 0, 2024-09-12T01:38:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 0, 2024-09-12T01:38:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 0, 2024-09-12T01:38:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 0, 2024-09-12T01:38:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:38:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-09-12T01:38:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-09-12T01:38:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-09-12T01:38:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-09-12T01:38:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 0, 2024-09-12T01:38:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 0, 2024-09-12T01:38:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 0, 2024-09-12T01:38:32.937 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2024-09-12T01:38:32.937 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-09-12T01:38:32.937 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:38:32.937 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-09-12T01:38:32.937 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 0, 2024-09-12T01:38:32.937 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 0, 2024-09-12T01:38:32.937 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-09-12T01:38:32.937 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:38:32.937 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-09-12T01:38:32.937 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:38:32.937 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:38:32.937 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:38:32.937 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:38:32.938 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:38:32.938 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 0, 2024-09-12T01:38:32.938 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:38:32.938 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:38:32.938 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:38:32.938 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:38:32.938 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:38:32.938 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:38:32.938 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 0, 2024-09-12T01:38:32.938 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:38:32.939 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 0, 2024-09-12T01:38:32.939 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 0 2024-09-12T01:38:32.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.939 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-09-12T01:38:32.939 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2024-09-12T01:38:32.939 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 0, 2024-09-12T01:38:32.939 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 0, 2024-09-12T01:38:32.939 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 0, 2024-09-12T01:38:32.939 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2024-09-12T01:38:32.939 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-09-12T01:38:32.939 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-09-12T01:38:32.940 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:38:32.940 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 0, 2024-09-12T01:38:32.940 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 0, 2024-09-12T01:38:32.940 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-09-12T01:38:32.940 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-09-12T01:38:32.940 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-09-12T01:38:32.941 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:38:32.941 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:38:32.941 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-09-12T01:38:32.941 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-09-12T01:38:32.941 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-09-12T01:38:32.941 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-09-12T01:38:32.942 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:38:32.942 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 0, 2024-09-12T01:38:32.942 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-09-12T01:38:32.942 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:38:32.942 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-09-12T01:38:32.942 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-09-12T01:38:32.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.942 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-09-12T01:38:32.942 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-09-12T01:38:32.942 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 0, 2024-09-12T01:38:32.942 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-09-12T01:38:32.943 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-09-12T01:38:32.943 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 5, 2024-09-12T01:38:32.943 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-09-12T01:38:32.943 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-09-12T01:38:32.943 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 0, 2024-09-12T01:38:32.943 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-09-12T01:38:32.943 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-09-12T01:38:32.943 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 2, 2024-09-12T01:38:32.943 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 2, 2024-09-12T01:38:32.943 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-09-12T01:38:32.943 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-09-12T01:38:32.943 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-09-12T01:38:32.944 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 4195819, 2024-09-12T01:38:32.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 4195678, 2024-09-12T01:38:32.944 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-09-12T01:38:32.944 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.944 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.944 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.944 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 5 2024-09-12T01:38:32.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.944 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-09-12T01:38:32.944 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 3, 2024-09-12T01:38:32.944 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 3, 2024-09-12T01:38:32.944 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 0, 2024-09-12T01:38:32.945 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 1, 2024-09-12T01:38:32.945 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 1, 2024-09-12T01:38:32.945 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 0, 2024-09-12T01:38:32.945 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 0, 2024-09-12T01:38:32.945 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 0, 2024-09-12T01:38:32.945 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 0, 2024-09-12T01:38:32.945 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-09-12T01:38:32.945 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 0, 2024-09-12T01:38:32.945 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 0, 2024-09-12T01:38:32.945 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 51004, 2024-09-12T01:38:32.945 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 215328 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 0, 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 0, 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 0, 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 0, 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 0, 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-09-12T01:38:32.946 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.947 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.947 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.947 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-09-12T01:38:32.947 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.947 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.947 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.947 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-09-12T01:38:32.947 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.947 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.947 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.948 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-09-12T01:38:32.948 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.948 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.948 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.948 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-09-12T01:38:32.948 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.948 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.948 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.949 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-09-12T01:38:32.949 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.949 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.949 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.949 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-09-12T01:38:32.949 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.949 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.949 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.949 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-09-12T01:38:32.949 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.950 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.950 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.950 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-09-12T01:38:32.950 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.950 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.950 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.950 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-09-12T01:38:32.950 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.950 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.950 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.951 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-09-12T01:38:32.951 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.951 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.951 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.951 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-09-12T01:38:32.951 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.951 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.951 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.951 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-09-12T01:38:32.952 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.952 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.952 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.952 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-09-12T01:38:32.952 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.952 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.952 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.952 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-09-12T01:38:32.952 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.952 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.953 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.953 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-09-12T01:38:32.953 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.953 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.953 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.953 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-09-12T01:38:32.953 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.953 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.953 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.954 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-09-12T01:38:32.954 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.954 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.954 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.954 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-09-12T01:38:32.954 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.954 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.954 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.955 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-09-12T01:38:32.955 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.955 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.955 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.955 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-09-12T01:38:32.955 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.956 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.956 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.956 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-09-12T01:38:32.956 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.956 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.956 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.957 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-09-12T01:38:32.957 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.957 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.957 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.958 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-09-12T01:38:32.958 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.958 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.959 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.959 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-09-12T01:38:32.959 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.959 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.959 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.960 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-09-12T01:38:32.960 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.960 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.960 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.960 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-09-12T01:38:32.960 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.961 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.961 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.961 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-09-12T01:38:32.961 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.961 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.961 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.962 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:38:32.962 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:38:32.962 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-09-12T01:38:32.962 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.962 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.962 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:32.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.963 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-09-12T01:38:32.963 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2024-09-12T01:38:32.963 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 2, 2024-09-12T01:38:32.963 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 1, 2024-09-12T01:38:32.964 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 2, 2024-09-12T01:38:32.964 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-09-12T01:38:32.964 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 0, 2024-09-12T01:38:32.964 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 0, 2024-09-12T01:38:32.964 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 2694, 2024-09-12T01:38:32.964 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-09-12T01:38:32.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.964 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-12T01:38:32.964 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:38:32.964 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-12T01:38:32.964 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:38:32.964 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:38:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:38:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:38:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:38:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:38:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:38:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:38:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:38:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:38:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:38:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:38:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:38:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-12T01:38:32.965 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:38:32.966 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-12T01:38:32.966 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:38:32.966 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:38:32.966 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:38:32.966 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:38:32.966 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:38:32.966 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:38:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:38:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-12T01:38:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:38:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:38:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:38:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-12T01:38:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-12T01:38:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-12T01:38:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:38:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:38:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:38:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:38:32.968 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 197473, 2024-09-12T01:38:32.968 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 55, 2024-09-12T01:38:32.968 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:38:32.968 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-12T01:38:32.968 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-12T01:38:32.968 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-12T01:38:32.968 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:38:32.968 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-12T01:38:32.968 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:38:32.968 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-12T01:38:32.968 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 8128, 2024-09-12T01:38:32.968 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 179, 2024-09-12T01:38:32.969 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:38:32.969 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:38:32.969 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-12T01:38:32.969 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-12T01:38:32.969 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 8512, 2024-09-12T01:38:32.969 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 13, 2024-09-12T01:38:32.969 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-12T01:38:32.969 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-12T01:38:32.969 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-12T01:38:32.969 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-12T01:38:32.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.969 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-09-12T01:38:32.969 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-09-12T01:38:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-09-12T01:38:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 2089, 2024-09-12T01:38:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 21, 2024-09-12T01:38:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 3, 2024-09-12T01:38:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 2089, 2024-09-12T01:38:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-09-12T01:38:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2089, 2024-09-12T01:38:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.380971409, 2024-09-12T01:38:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000661068 2024-09-12T01:38:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-09-12T01:38:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-09-12T01:38:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2089, 2024-09-12T01:38:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2090 2024-09-12T01:38:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 2089, 2024-09-12T01:38:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 2089, 2024-09-12T01:38:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 0, 2024-09-12T01:38:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-09-12T01:38:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-09-12T01:38:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 1354, 2024-09-12T01:38:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 0, 2024-09-12T01:38:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 733, 2024-09-12T01:38:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 0, 2024-09-12T01:38:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 0, 2024-09-12T01:38:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 0, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 1, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 0, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-09-12T01:38:32.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-09-12T01:38:32.973 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-09-12T01:38:32.973 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:38:32.973 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-09-12T01:38:32.973 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:38:32.973 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-09-12T01:38:32.973 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-09-12T01:38:32.973 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-09-12T01:38:32.973 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-09-12T01:38:32.973 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-09-12T01:38:32.974 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-09-12T01:38:32.974 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-09-12T01:38:32.974 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-09-12T01:38:32.974 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-09-12T01:38:32.974 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-09-12T01:38:32.974 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-09-12T01:38:32.974 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-09-12T01:38:32.974 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-09-12T01:38:32.974 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-09-12T01:38:32.974 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-09-12T01:38:32.974 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-09-12T01:38:32.974 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-09-12T01:38:32.975 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 91, 2024-09-12T01:38:32.975 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-09-12T01:38:32.975 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 9, 2024-09-12T01:38:32.975 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 6, 2024-09-12T01:38:32.975 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 6, 2024-09-12T01:38:32.975 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-09-12T01:38:32.975 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-09-12T01:38:32.975 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 0, 2024-09-12T01:38:32.975 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 2, 2024-09-12T01:38:32.976 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 0 2024-09-12T01:38:32.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.976 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-09-12T01:38:32.976 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 0, 2024-09-12T01:38:32.976 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:38:32.976 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-09-12T01:38:32.976 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-09-12T01:38:32.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.976 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2024-09-12T01:38:32.976 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-09-12T01:38:32.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.976 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-09-12T01:38:32.976 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-09-12T01:38:32.977 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:38:32.977 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-09-12T01:38:32.977 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 0, 2024-09-12T01:38:32.977 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 0, 2024-09-12T01:38:32.977 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 0, 2024-09-12T01:38:32.978 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-09-12T01:38:32.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.978 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:38:32.978 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T01:38:32.978 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-12T01:38:32.978 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T01:38:32.978 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 2320, 2024-09-12T01:38:32.978 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 1979766, 2024-09-12T01:38:32.978 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:32.978 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 2320, 2024-09-12T01:38:32.978 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T01:38:32.978 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T01:38:32.978 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2320, 2024-09-12T01:38:32.979 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1979766, 2024-09-12T01:38:32.979 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T01:38:32.979 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.979 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.979 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:32.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.979 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-09-12T01:38:32.979 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T01:38:32.979 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-12T01:38:32.979 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T01:38:32.979 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T01:38:32.979 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T01:38:32.980 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:32.980 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:32.980 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2089, 2024-09-12T01:38:32.980 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 1520, 2024-09-12T01:38:32.980 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2089, 2024-09-12T01:38:32.980 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1520, 2024-09-12T01:38:32.980 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T01:38:32.980 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.980 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.980 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:32.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.980 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-09-12T01:38:32.981 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T01:38:32.981 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-09-12T01:38:32.981 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T01:38:32.981 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T01:38:32.981 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T01:38:32.981 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:32.981 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:32.981 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2089, 2024-09-12T01:38:32.981 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 2089, 2024-09-12T01:38:32.981 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2089, 2024-09-12T01:38:32.981 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 2089, 2024-09-12T01:38:32.981 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T01:38:32.981 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T01:38:32.982 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x55df09760b40": { 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T01:38:32.983 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T01:38:32.984 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:32.984 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:32.984 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T01:38:32.984 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T01:38:32.984 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-12T01:38:32.984 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-12T01:38:32.984 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T01:38:32.984 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:32.984 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:32.984 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:32.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:32.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:32.984 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:38:33.694 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-12T01:38:33.694 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-12T01:38:33.694 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-12T01:38:33.694 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-12T01:38:33.694 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-09-12T01:38:33.694 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:38:33.694 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:38:33.695 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T01:38:33.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T01:38:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:33.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:33 smithi081 ceph-mon[30920]: pgmap v325: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:34.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:33 smithi100 ceph-mon[35275]: pgmap v325: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:34.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:33 smithi189 ceph-mon[35357]: pgmap v325: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:34.384 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T01:38:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:38:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 0, 2024-09-12T01:38:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2, 2024-09-12T01:38:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 0, 2024-09-12T01:38:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 0, 2024-09-12T01:38:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-12T01:38:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2024-09-12T01:38:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.001184688, 2024-09-12T01:38:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T01:38:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.000294761, 2024-09-12T01:38:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:38:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:34.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:38:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:38:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:38:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 223, 2024-09-12T01:38:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 210, 2024-09-12T01:38:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1582992, 2024-09-12T01:38:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 128352, 2024-09-12T01:38:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2024-09-12T01:38:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-09-12T01:38:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.046728257, 2024-09-12T01:38:34.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.015716974, 2024-09-12T01:38:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.043703877, 2024-09-12T01:38:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:38:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 210, 2024-09-12T01:38:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.016983669, 2024-09-12T01:38:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000080874 2024-09-12T01:38:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:34.388 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:34.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:34.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1582992, 2024-09-12T01:38:34.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 128352 2024-09-12T01:38:34.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:34.389 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:38:34.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 2, 2024-09-12T01:38:34.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 159, 2024-09-12T01:38:34.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 320, 2024-09-12T01:38:34.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 185216, 2024-09-12T01:38:34.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-09-12T01:38:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-12T01:38:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.012476681, 2024-09-12T01:38:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.008551003, 2024-09-12T01:38:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.001893027, 2024-09-12T01:38:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:38:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 156, 2024-09-12T01:38:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.010529626, 2024-09-12T01:38:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000067497 2024-09-12T01:38:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:34.391 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:34.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:34.391 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T01:38:34.391 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 185216 2024-09-12T01:38:34.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:34.391 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-12T01:38:34.391 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2024-09-12T01:38:34.391 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-12T01:38:34.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:34.391 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-12T01:38:34.391 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:38:34.391 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-12T01:38:34.391 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:38:34.392 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:38:34.392 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:38:34.392 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:38:34.392 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:38:34.392 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:38:34.392 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:38:34.392 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:38:34.392 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:38:34.392 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:38:34.392 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:38:34.392 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:38:34.393 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:38:34.393 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-12T01:38:34.393 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:38:34.393 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-12T01:38:34.393 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:38:34.393 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:38:34.393 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:38:34.393 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:38:34.393 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:38:34.393 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:38:34.393 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:38:34.393 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-12T01:38:34.393 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:38:34.394 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:38:34.394 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:38:34.394 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-12T01:38:34.394 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-12T01:38:34.394 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-12T01:38:34.394 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:38:34.394 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:38:34.394 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:38:34.394 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:38:34.394 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 148977, 2024-09-12T01:38:34.394 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 30, 2024-09-12T01:38:34.394 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:38:34.395 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-12T01:38:34.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-12T01:38:34.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-12T01:38:34.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:38:34.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-12T01:38:34.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:38:34.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-12T01:38:34.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2024-09-12T01:38:34.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2024-09-12T01:38:34.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:38:34.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:38:34.395 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-12T01:38:34.395 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-12T01:38:34.396 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 928, 2024-09-12T01:38:34.396 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2024-09-12T01:38:34.396 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-12T01:38:34.396 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-12T01:38:34.396 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-12T01:38:34.396 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-12T01:38:34.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T01:38:34.396 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:38:34.396 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T01:38:34.396 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-12T01:38:34.396 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T01:38:34.396 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 221, 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 1549109, 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 221, 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 221, 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1549109, 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T01:38:34.397 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T01:38:35.170 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T01:38:35.170 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T01:38:35.170 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-12T01:38:35.170 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-12T01:38:35.170 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-12T01:38:35.170 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-12T01:38:35.170 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-12T01:38:35.170 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T01:38:35.170 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T01:38:35.428 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:38:35.783 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:35 smithi100 ceph-mon[35275]: pgmap v326: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:35.981 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T01:38:35.981 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:38:35.982 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 1332, 2024-09-12T01:38:35.982 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 1213, 2024-09-12T01:38:35.982 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 2060375, 2024-09-12T01:38:35.982 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 757296, 2024-09-12T01:38:35.982 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 14, 2024-09-12T01:38:35.982 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 5, 2024-09-12T01:38:35.982 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.171685393, 2024-09-12T01:38:35.982 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.063059775, 2024-09-12T01:38:35.982 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.103332506, 2024-09-12T01:38:35.982 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.018356730, 2024-09-12T01:38:35.982 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:35.982 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1211, 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.091650181, 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000075681 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1383, 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000290000, 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000209 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1754064, 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 500144 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2354, 2024-09-12T01:38:35.983 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 1208, 2024-09-12T01:38:35.984 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1047193, 2024-09-12T01:38:35.984 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 734708, 2024-09-12T01:38:35.984 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 27, 2024-09-12T01:38:35.984 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 7, 2024-09-12T01:38:35.984 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.276638863, 2024-09-12T01:38:35.984 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.080106316, 2024-09-12T01:38:35.984 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.126414865, 2024-09-12T01:38:35.984 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.077731538, 2024-09-12T01:38:35.984 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:35.984 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1206, 2024-09-12T01:38:35.984 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.149837887, 2024-09-12T01:38:35.984 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000124243 2024-09-12T01:38:35.984 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.985 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:35.985 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2868, 2024-09-12T01:38:35.985 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000628525, 2024-09-12T01:38:35.985 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000219 2024-09-12T01:38:35.985 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.985 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 646560, 2024-09-12T01:38:35.985 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 305360 2024-09-12T01:38:35.985 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.985 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:38:35.985 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 1892, 2024-09-12T01:38:35.985 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 1666, 2024-09-12T01:38:35.985 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 528290, 2024-09-12T01:38:35.986 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 2716168, 2024-09-12T01:38:35.986 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 126, 2024-09-12T01:38:35.986 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 7, 2024-09-12T01:38:35.986 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.197968032, 2024-09-12T01:38:35.986 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.059660081, 2024-09-12T01:38:35.986 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.129797401, 2024-09-12T01:38:35.986 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.020512338, 2024-09-12T01:38:35.986 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:35.986 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1665, 2024-09-12T01:38:35.986 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.688846748, 2024-09-12T01:38:35.986 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000413721 2024-09-12T01:38:35.986 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.986 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2361, 2024-09-12T01:38:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000539539, 2024-09-12T01:38:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000228 2024-09-12T01:38:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 45568, 2024-09-12T01:38:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 1584 2024-09-12T01:38:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-12T01:38:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-09-12T01:38:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-12T01:38:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-09-12T01:38:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-12T01:38:35.988 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-12T01:38:35.988 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 556, 2024-09-12T01:38:35.988 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.137393064, 2024-09-12T01:38:35.988 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000247109 2024-09-12T01:38:35.988 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:35.988 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.988 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-09-12T01:38:35.988 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-12T01:38:35.988 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-12T01:38:35.988 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 88, 2024-09-12T01:38:35.988 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002910272, 2024-09-12T01:38:35.988 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000033071 2024-09-12T01:38:35.989 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:35.989 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.989 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-12T01:38:35.989 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 167, 2024-09-12T01:38:35.989 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 167, 2024-09-12T01:38:35.989 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-09-12T01:38:35.989 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 167, 2024-09-12T01:38:35.989 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.155573870, 2024-09-12T01:38:35.989 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000931580 2024-09-12T01:38:35.989 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.989 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-09-12T01:38:35.989 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 0, 2024-09-12T01:38:35.989 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 12, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 39, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 2, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 37, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 0, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 36, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 0, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 2, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 3, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 2, 2024-09-12T01:38:35.990 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 231, 2024-09-12T01:38:35.991 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 217, 2024-09-12T01:38:35.991 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-09-12T01:38:35.991 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 0, 2024-09-12T01:38:35.991 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:38:35.991 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-09-12T01:38:35.991 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-09-12T01:38:35.991 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-09-12T01:38:35.991 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-09-12T01:38:35.991 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 0, 2024-09-12T01:38:35.991 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 0, 2024-09-12T01:38:35.991 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 0, 2024-09-12T01:38:35.991 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 0, 2024-09-12T01:38:35.992 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-09-12T01:38:35.992 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 172, 2024-09-12T01:38:35.992 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-09-12T01:38:35.992 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 4, 2024-09-12T01:38:35.992 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 234, 2024-09-12T01:38:35.992 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 6, 2024-09-12T01:38:35.992 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 172, 2024-09-12T01:38:35.992 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-09-12T01:38:35.992 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:38:35.992 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:38:35.992 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 108, 2024-09-12T01:38:35.992 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 15, 2024-09-12T01:38:35.993 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 93, 2024-09-12T01:38:35.993 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 64, 2024-09-12T01:38:35.993 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:38:35.993 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 29, 2024-09-12T01:38:35.993 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 48, 2024-09-12T01:38:35.993 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:38:35.993 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:38:35.993 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:38:35.993 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 106, 2024-09-12T01:38:35.993 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 73, 2024-09-12T01:38:35.993 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 4, 2024-09-12T01:38:35.994 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 29 2024-09-12T01:38:35.994 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.994 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-09-12T01:38:35.994 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 23, 2024-09-12T01:38:35.994 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-09-12T01:38:35.994 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-09-12T01:38:35.994 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 0, 2024-09-12T01:38:35.994 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 48, 2024-09-12T01:38:35.994 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 2, 2024-09-12T01:38:35.994 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-09-12T01:38:35.994 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:38:35.994 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 6, 2024-09-12T01:38:35.994 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 4, 2024-09-12T01:38:35.995 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-09-12T01:38:35.995 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-09-12T01:38:35.995 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-09-12T01:38:35.995 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:38:35.995 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:38:35.995 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-09-12T01:38:35.995 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-09-12T01:38:35.995 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 2, 2024-09-12T01:38:35.995 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 29, 2024-09-12T01:38:35.995 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 15, 2024-09-12T01:38:35.995 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 0, 2024-09-12T01:38:35.996 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-09-12T01:38:35.996 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:38:35.996 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-09-12T01:38:35.996 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-09-12T01:38:35.996 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.996 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-09-12T01:38:35.996 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-09-12T01:38:35.996 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 214, 2024-09-12T01:38:35.996 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-09-12T01:38:35.996 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-09-12T01:38:35.996 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 214, 2024-09-12T01:38:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-09-12T01:38:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-09-12T01:38:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 2, 2024-09-12T01:38:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-09-12T01:38:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-09-12T01:38:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 2, 2024-09-12T01:38:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 2, 2024-09-12T01:38:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-09-12T01:38:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-09-12T01:38:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194304, 2024-09-12T01:38:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 5004206, 2024-09-12T01:38:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 0, 2024-09-12T01:38:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-09-12T01:38:35.998 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 179, 2024-09-12T01:38:35.998 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.411533507, 2024-09-12T01:38:35.998 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002299069 2024-09-12T01:38:35.998 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.998 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 0 2024-09-12T01:38:35.998 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:35.998 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-09-12T01:38:35.998 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 29, 2024-09-12T01:38:35.998 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 48, 2024-09-12T01:38:35.998 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 19, 2024-09-12T01:38:35.999 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 20, 2024-09-12T01:38:35.999 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 20, 2024-09-12T01:38:35.999 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 0, 2024-09-12T01:38:35.999 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 39, 2024-09-12T01:38:35.999 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 43, 2024-09-12T01:38:35.999 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 4, 2024-09-12T01:38:35.999 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 3, 2024-09-12T01:38:35.999 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 22, 2024-09-12T01:38:35.999 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 19, 2024-09-12T01:38:35.999 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 54672, 2024-09-12T01:38:35.999 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 231712 2024-09-12T01:38:35.999 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.000 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-09-12T01:38:36.000 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 219, 2024-09-12T01:38:36.000 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 1, 2024-09-12T01:38:36.000 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 167, 2024-09-12T01:38:36.000 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 32, 2024-09-12T01:38:36.000 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 2, 2024-09-12T01:38:36.000 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-09-12T01:38:36.000 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 8, 2024-09-12T01:38:36.000 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.005927752, 2024-09-12T01:38:36.000 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000740969 2024-09-12T01:38:36.001 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.001 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-09-12T01:38:36.001 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 97, 2024-09-12T01:38:36.001 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.017359320, 2024-09-12T01:38:36.001 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000178962 2024-09-12T01:38:36.001 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.001 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-09-12T01:38:36.001 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.001 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.001 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.001 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.001 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-09-12T01:38:36.002 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.002 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.002 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.002 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-09-12T01:38:36.002 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 9, 2024-09-12T01:38:36.002 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002727684, 2024-09-12T01:38:36.002 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000303076 2024-09-12T01:38:36.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.003 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-09-12T01:38:36.003 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.003 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.003 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.003 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.003 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-09-12T01:38:36.003 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-12T01:38:36.003 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000135333, 2024-09-12T01:38:36.003 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000135333 2024-09-12T01:38:36.003 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.003 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-09-12T01:38:36.004 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.004 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.004 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.004 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.004 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-09-12T01:38:36.004 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.004 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.004 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.004 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.004 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-09-12T01:38:36.005 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.005 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.005 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.005 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.005 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-09-12T01:38:36.005 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 10, 2024-09-12T01:38:36.005 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.001252290, 2024-09-12T01:38:36.005 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000125229 2024-09-12T01:38:36.005 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.005 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-09-12T01:38:36.006 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 8, 2024-09-12T01:38:36.006 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.013516631, 2024-09-12T01:38:36.006 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001689578 2024-09-12T01:38:36.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.006 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-09-12T01:38:36.006 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.006 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.006 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-09-12T01:38:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 10, 2024-09-12T01:38:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.050021182, 2024-09-12T01:38:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.005002118 2024-09-12T01:38:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-09-12T01:38:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-12T01:38:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000378071, 2024-09-12T01:38:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000378071 2024-09-12T01:38:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-09-12T01:38:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-12T01:38:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.004934154, 2024-09-12T01:38:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001644718 2024-09-12T01:38:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-09-12T01:38:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-12T01:38:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002749673, 2024-09-12T01:38:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001374836 2024-09-12T01:38:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-09-12T01:38:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.009 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-09-12T01:38:36.009 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.009 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.009 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.009 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-09-12T01:38:36.009 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-12T01:38:36.009 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.014005045, 2024-09-12T01:38:36.009 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.007002522 2024-09-12T01:38:36.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.009 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-09-12T01:38:36.009 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4, 2024-09-12T01:38:36.010 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.016997120, 2024-09-12T01:38:36.010 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.004249280 2024-09-12T01:38:36.010 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.010 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-09-12T01:38:36.010 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.010 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.010 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.010 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.010 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-09-12T01:38:36.010 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-12T01:38:36.010 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.001296819, 2024-09-12T01:38:36.010 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001296819 2024-09-12T01:38:36.011 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.011 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-09-12T01:38:36.011 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.011 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.011 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.011 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.011 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-09-12T01:38:36.011 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.011 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.011 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.011 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.012 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-09-12T01:38:36.012 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.012 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.012 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.012 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-09-12T01:38:36.012 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 7, 2024-09-12T01:38:36.012 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.019156984, 2024-09-12T01:38:36.012 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002736712 2024-09-12T01:38:36.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.012 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-09-12T01:38:36.012 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.012 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.013 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.013 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.013 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-09-12T01:38:36.013 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4, 2024-09-12T01:38:36.013 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.005115812, 2024-09-12T01:38:36.013 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001278953 2024-09-12T01:38:36.013 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.013 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:38:36.013 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:38:36.013 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-09-12T01:38:36.013 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.013 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.013 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.014 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:36.014 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.014 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-09-12T01:38:36.014 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 2, 2024-09-12T01:38:36.014 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 5, 2024-09-12T01:38:36.014 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 3, 2024-09-12T01:38:36.014 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 2, 2024-09-12T01:38:36.014 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-09-12T01:38:36.014 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 27, 2024-09-12T01:38:36.014 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 13, 2024-09-12T01:38:36.014 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 603, 2024-09-12T01:38:36.014 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-09-12T01:38:36.014 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:38:36.015 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:38:36.016 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:38:36.016 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:38:36.016 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-12T01:38:36.016 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:38:36.016 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-12T01:38:36.016 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:38:36.016 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:38:36.016 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:38:36.016 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:38:36.016 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:38:36.016 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:38:36.016 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 311125, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 114, 2024-09-12T01:38:36.017 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 8128, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 179, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-12T01:38:36.018 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 136981, 2024-09-12T01:38:36.019 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 1293, 2024-09-12T01:38:36.019 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-12T01:38:36.019 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-12T01:38:36.019 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-12T01:38:36.019 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-12T01:38:36.019 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.019 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-09-12T01:38:36.019 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-12T01:38:36.019 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-12T01:38:36.019 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 1039, 2024-09-12T01:38:36.019 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 828324, 2024-09-12T01:38:36.019 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 31, 2024-09-12T01:38:36.020 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 1039, 2024-09-12T01:38:36.020 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-12T01:38:36.020 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1039, 2024-09-12T01:38:36.020 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 18.539525874, 2024-09-12T01:38:36.020 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.017843624 2024-09-12T01:38:36.020 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.020 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-12T01:38:36.020 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-12T01:38:36.020 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1039, 2024-09-12T01:38:36.020 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 1087 2024-09-12T01:38:36.020 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.020 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 1039, 2024-09-12T01:38:36.020 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 204, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 835, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 11, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 17, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 181, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 28, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 579, 2024-09-12T01:38:36.021 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 187, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 22, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:38:36.022 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-12T01:38:36.023 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 91, 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 11, 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 12, 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 12, 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 49, 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 13 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.024 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 1, 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 31 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 64, 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 3, 2024-09-12T01:38:36.025 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 67, 2024-09-12T01:38:36.026 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 4, 2024-09-12T01:38:36.026 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-09-12T01:38:36.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.026 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:38:36.026 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:36.026 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T01:38:36.026 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:36.026 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 5574, 2024-09-12T01:38:36.026 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 3033860, 2024-09-12T01:38:36.026 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:36.026 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 5574, 2024-09-12T01:38:36.026 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T01:38:36.026 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 5574, 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 3033860, 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-12T01:38:36.027 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-12T01:38:36.028 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:36.028 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:36.028 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 1039, 2024-09-12T01:38:36.028 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 828760, 2024-09-12T01:38:36.028 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 1039, 2024-09-12T01:38:36.028 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 828760, 2024-09-12T01:38:36.028 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:36.028 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.028 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.028 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.029 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:36.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.029 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-09-12T01:38:36.029 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:36.029 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-12T01:38:36.029 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:36.029 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-12T01:38:36.029 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-12T01:38:36.029 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:36.029 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:36.029 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 1039, 2024-09-12T01:38:36.029 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 1039, 2024-09-12T01:38:36.030 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 1039, 2024-09-12T01:38:36.030 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1039, 2024-09-12T01:38:36.030 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:36.030 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.030 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.030 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.030 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:36.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.030 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:38:36.030 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:36.030 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-12T01:38:36.030 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:36.031 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 4, 2024-09-12T01:38:36.031 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 436, 2024-09-12T01:38:36.031 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:36.031 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 4, 2024-09-12T01:38:36.031 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T01:38:36.031 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T01:38:36.031 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 2, 2024-09-12T01:38:36.031 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 436, 2024-09-12T01:38:36.031 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:36.031 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.031 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.032 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.032 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:36.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:36.032 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x56382fc54960": { 2024-09-12T01:38:36.032 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:36.032 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-12T01:38:36.032 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:36.032 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 214, 2024-09-12T01:38:36.032 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 809902, 2024-09-12T01:38:36.032 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:36.032 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 214, 2024-09-12T01:38:36.032 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T01:38:36.032 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T01:38:36.033 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 179, 2024-09-12T01:38:36.033 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 809902, 2024-09-12T01:38:36.033 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:36.033 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:36.033 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:36.033 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:36.033 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:36.033 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:36.033 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T01:38:36.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:35 smithi189 ceph-mon[35357]: pgmap v326: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:36.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:35 smithi081 ceph-mon[30920]: pgmap v326: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:36.915 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-12T01:38:36.915 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-12T01:38:36.915 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=23 2024-09-12T01:38:36.915 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-12T01:38:36.915 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-12T01:38:36.915 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-12T01:38:36.915 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-12T01:38:36.916 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T01:38:36.916 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T01:38:37.163 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:38:37.658 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T01:38:37.658 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:38:37.658 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2108, 2024-09-12T01:38:37.658 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 2108, 2024-09-12T01:38:37.659 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 600051, 2024-09-12T01:38:37.659 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 669527, 2024-09-12T01:38:37.659 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 6, 2024-09-12T01:38:37.659 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-09-12T01:38:37.659 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.168001539, 2024-09-12T01:38:37.659 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.052911048, 2024-09-12T01:38:37.659 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.043702839, 2024-09-12T01:38:37.659 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.058151071, 2024-09-12T01:38:37.659 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:37.659 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2107, 2024-09-12T01:38:37.659 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.074359503, 2024-09-12T01:38:37.659 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000035291 2024-09-12T01:38:37.659 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.660 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:37.660 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.660 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.660 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.660 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-12T01:38:37.660 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T01:38:37.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.660 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:38:37.660 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 4, 2024-09-12T01:38:37.660 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 161, 2024-09-12T01:38:37.660 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 876, 2024-09-12T01:38:37.660 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 440410, 2024-09-12T01:38:37.661 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 6, 2024-09-12T01:38:37.661 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 4, 2024-09-12T01:38:37.661 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.010392975, 2024-09-12T01:38:37.661 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.006503513, 2024-09-12T01:38:37.661 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.002005017, 2024-09-12T01:38:37.661 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000065864, 2024-09-12T01:38:37.661 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:37.661 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 158, 2024-09-12T01:38:37.661 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.019511710, 2024-09-12T01:38:37.661 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000123491 2024-09-12T01:38:37.661 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.661 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:37.661 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.662 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.662 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.662 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T01:38:37.662 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 439712 2024-09-12T01:38:37.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.662 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:38:37.662 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 241, 2024-09-12T01:38:37.662 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 224, 2024-09-12T01:38:37.662 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1634540, 2024-09-12T01:38:37.662 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 130350, 2024-09-12T01:38:37.662 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 3, 2024-09-12T01:38:37.663 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-09-12T01:38:37.663 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.044105450, 2024-09-12T01:38:37.663 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.015604019, 2024-09-12T01:38:37.663 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.043821448, 2024-09-12T01:38:37.663 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000018648, 2024-09-12T01:38:37.663 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:37.663 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 223, 2024-09-12T01:38:37.663 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.015460247, 2024-09-12T01:38:37.663 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000069328 2024-09-12T01:38:37.663 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.664 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:37.664 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.664 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.664 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.664 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1634272, 2024-09-12T01:38:37.664 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 130032 2024-09-12T01:38:37.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.664 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-12T01:38:37.664 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-09-12T01:38:37.665 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-12T01:38:37.665 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.665 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-09-12T01:38:37.665 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-12T01:38:37.665 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-12T01:38:37.665 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3557, 2024-09-12T01:38:37.665 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.084157426, 2024-09-12T01:38:37.665 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000023659 2024-09-12T01:38:37.665 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:37.665 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.665 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-09-12T01:38:37.665 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-12T01:38:37.665 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-12T01:38:37.666 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.666 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.666 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.666 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:37.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.666 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-12T01:38:37.666 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 0, 2024-09-12T01:38:37.666 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 0, 2024-09-12T01:38:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-09-12T01:38:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-09-12T01:38:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 0, 2024-09-12T01:38:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-09-12T01:38:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-09-12T01:38:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 0, 2024-09-12T01:38:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-09-12T01:38:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-09-12T01:38:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 0, 2024-09-12T01:38:37.668 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 0, 2024-09-12T01:38:37.668 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 0, 2024-09-12T01:38:37.668 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 0, 2024-09-12T01:38:37.668 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 0, 2024-09-12T01:38:37.668 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 0, 2024-09-12T01:38:37.668 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 0, 2024-09-12T01:38:37.668 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 0, 2024-09-12T01:38:37.668 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 1, 2024-09-12T01:38:37.668 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 0, 2024-09-12T01:38:37.669 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 0, 2024-09-12T01:38:37.669 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-09-12T01:38:37.669 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 0, 2024-09-12T01:38:37.669 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:38:37.669 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-09-12T01:38:37.669 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-09-12T01:38:37.669 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-09-12T01:38:37.669 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-09-12T01:38:37.669 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 0, 2024-09-12T01:38:37.669 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 0, 2024-09-12T01:38:37.669 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 0, 2024-09-12T01:38:37.670 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 0, 2024-09-12T01:38:37.670 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-09-12T01:38:37.670 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:38:37.670 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-09-12T01:38:37.670 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 0, 2024-09-12T01:38:37.670 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 0, 2024-09-12T01:38:37.670 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 0, 2024-09-12T01:38:37.671 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:38:37.671 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-09-12T01:38:37.671 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:38:37.671 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:38:37.671 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:38:37.671 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:38:37.671 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:38:37.671 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 0, 2024-09-12T01:38:37.671 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:38:37.671 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:38:37.671 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:38:37.672 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:38:37.672 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:38:37.672 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:38:37.672 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 0, 2024-09-12T01:38:37.672 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:38:37.672 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 0, 2024-09-12T01:38:37.672 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 0 2024-09-12T01:38:37.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.672 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-09-12T01:38:37.672 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-09-12T01:38:37.673 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-09-12T01:38:37.673 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-09-12T01:38:37.673 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 0, 2024-09-12T01:38:37.673 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 0, 2024-09-12T01:38:37.673 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 0, 2024-09-12T01:38:37.673 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-09-12T01:38:37.673 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:38:37.673 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 0, 2024-09-12T01:38:37.673 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 0, 2024-09-12T01:38:37.674 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-09-12T01:38:37.674 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-09-12T01:38:37.674 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-09-12T01:38:37.674 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:38:37.674 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:38:37.674 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-09-12T01:38:37.674 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-09-12T01:38:37.674 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 0, 2024-09-12T01:38:37.674 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 0, 2024-09-12T01:38:37.675 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:38:37.675 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 0, 2024-09-12T01:38:37.675 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-09-12T01:38:37.675 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:38:37.675 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-09-12T01:38:37.675 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-09-12T01:38:37.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.675 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-09-12T01:38:37.675 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-09-12T01:38:37.675 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 0, 2024-09-12T01:38:37.676 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-09-12T01:38:37.676 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-09-12T01:38:37.676 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 4, 2024-09-12T01:38:37.676 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-09-12T01:38:37.676 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-09-12T01:38:37.676 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 0, 2024-09-12T01:38:37.676 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-09-12T01:38:37.676 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-09-12T01:38:37.676 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 2, 2024-09-12T01:38:37.676 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 2, 2024-09-12T01:38:37.677 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-09-12T01:38:37.677 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-09-12T01:38:37.677 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194304, 2024-09-12T01:38:37.677 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 4195426, 2024-09-12T01:38:37.677 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 4195285, 2024-09-12T01:38:37.677 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-09-12T01:38:37.677 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.677 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.677 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.677 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 4 2024-09-12T01:38:37.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.678 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-09-12T01:38:37.678 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 3, 2024-09-12T01:38:37.678 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 3, 2024-09-12T01:38:37.678 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 0, 2024-09-12T01:38:37.678 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 1, 2024-09-12T01:38:37.678 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 1, 2024-09-12T01:38:37.678 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 0, 2024-09-12T01:38:37.678 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 0, 2024-09-12T01:38:37.678 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 0, 2024-09-12T01:38:37.678 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 0, 2024-09-12T01:38:37.678 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 0, 2024-09-12T01:38:37.678 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 0, 2024-09-12T01:38:37.678 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 0, 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 48968, 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 215328 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 0, 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 0, 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 0, 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 0, 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 0, 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.679 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.680 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-09-12T01:38:37.680 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.680 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.680 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.680 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.680 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-09-12T01:38:37.680 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.680 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.680 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.680 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.680 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-09-12T01:38:37.680 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.680 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.681 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.681 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.681 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-09-12T01:38:37.681 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.681 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.681 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.681 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.681 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-09-12T01:38:37.681 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.681 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.681 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.681 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.681 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-09-12T01:38:37.682 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.682 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.682 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.682 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-09-12T01:38:37.682 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.682 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.682 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.682 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-09-12T01:38:37.683 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.683 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.683 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.683 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.683 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-09-12T01:38:37.683 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.683 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.683 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.683 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.683 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-09-12T01:38:37.683 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.683 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.683 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.684 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.684 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-09-12T01:38:37.684 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.684 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.684 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.684 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.684 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-09-12T01:38:37.684 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.684 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.684 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.684 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.684 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-09-12T01:38:37.685 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.685 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.685 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.685 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.685 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-09-12T01:38:37.685 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.685 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.685 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.685 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.685 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-09-12T01:38:37.685 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.686 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.686 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.686 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.686 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-09-12T01:38:37.686 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.686 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.686 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.686 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.686 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-09-12T01:38:37.686 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.686 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.686 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.686 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.687 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.688 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.688 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-09-12T01:38:37.688 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.688 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.688 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.688 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.688 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-09-12T01:38:37.688 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.688 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.688 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.688 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.688 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-09-12T01:38:37.688 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.689 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.689 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.689 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.689 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-09-12T01:38:37.689 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.689 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.689 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.689 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.689 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-09-12T01:38:37.689 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.689 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.689 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.689 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.690 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-09-12T01:38:37.690 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.690 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.690 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.690 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.690 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-09-12T01:38:37.690 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.690 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.690 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.690 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.690 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-09-12T01:38:37.690 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.691 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.691 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.691 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.691 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:38:37.691 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:38:37.691 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-09-12T01:38:37.691 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.691 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.691 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.691 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:37.691 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.692 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-09-12T01:38:37.692 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 0, 2024-09-12T01:38:37.692 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 1, 2024-09-12T01:38:37.692 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 1, 2024-09-12T01:38:37.692 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 1, 2024-09-12T01:38:37.692 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-09-12T01:38:37.692 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 0, 2024-09-12T01:38:37.692 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 0, 2024-09-12T01:38:37.692 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 1362, 2024-09-12T01:38:37.692 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-09-12T01:38:37.692 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.692 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-12T01:38:37.692 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:38:37.693 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:38:37.694 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-12T01:38:37.694 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:38:37.694 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-12T01:38:37.694 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:38:37.694 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:38:37.694 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:38:37.694 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:38:37.694 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:38:37.694 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:38:37.695 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:38:37.695 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-12T01:38:37.695 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:38:37.695 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:38:37.695 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:38:37.695 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-12T01:38:37.695 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-12T01:38:37.695 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-12T01:38:37.695 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:38:37.695 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:38:37.695 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 181347, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 49, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 8128, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 179, 2024-09-12T01:38:37.696 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:38:37.697 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:38:37.697 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-12T01:38:37.697 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-12T01:38:37.697 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 8512, 2024-09-12T01:38:37.697 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 13, 2024-09-12T01:38:37.697 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-12T01:38:37.697 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-12T01:38:37.697 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-12T01:38:37.697 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-12T01:38:37.697 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.698 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-09-12T01:38:37.698 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-12T01:38:37.698 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-12T01:38:37.698 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 2107, 2024-09-12T01:38:37.698 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 21, 2024-09-12T01:38:37.698 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 3, 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 2107, 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2107, 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 1.140970756, 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000541514 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2107, 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 2108 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 2107, 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 2107, 2024-09-12T01:38:37.699 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 0, 2024-09-12T01:38:37.700 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-12T01:38:37.700 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-12T01:38:37.700 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 1366, 2024-09-12T01:38:37.700 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 0, 2024-09-12T01:38:37.700 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 739, 2024-09-12T01:38:37.700 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 0, 2024-09-12T01:38:37.700 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-09-12T01:38:37.700 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-12T01:38:37.700 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-12T01:38:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-12T01:38:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-12T01:38:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-09-12T01:38:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-12T01:38:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-12T01:38:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-12T01:38:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 1, 2024-09-12T01:38:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-09-12T01:38:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:38:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-12T01:38:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:38:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-12T01:38:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-12T01:38:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-12T01:38:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:38:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-12T01:38:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:38:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-12T01:38:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-12T01:38:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-12T01:38:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-12T01:38:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-12T01:38:37.702 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-12T01:38:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-12T01:38:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-12T01:38:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-12T01:38:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-12T01:38:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-12T01:38:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-12T01:38:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-12T01:38:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-12T01:38:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-12T01:38:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-12T01:38:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-12T01:38:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 91, 2024-09-12T01:38:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-12T01:38:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 11, 2024-09-12T01:38:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 4, 2024-09-12T01:38:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 4, 2024-09-12T01:38:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-12T01:38:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-12T01:38:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-09-12T01:38:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 2, 2024-09-12T01:38:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-09-12T01:38:37.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.705 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-09-12T01:38:37.705 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 0, 2024-09-12T01:38:37.705 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:38:37.705 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-09-12T01:38:37.705 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-09-12T01:38:37.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.705 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-09-12T01:38:37.705 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-09-12T01:38:37.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.705 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-09-12T01:38:37.706 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-09-12T01:38:37.706 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:38:37.706 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-09-12T01:38:37.706 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 0, 2024-09-12T01:38:37.706 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 0, 2024-09-12T01:38:37.706 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 0, 2024-09-12T01:38:37.706 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-09-12T01:38:37.706 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.706 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:38:37.707 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:37.707 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T01:38:37.707 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:37.707 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 2349, 2024-09-12T01:38:37.707 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 2008774, 2024-09-12T01:38:37.707 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:37.707 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 2349, 2024-09-12T01:38:37.707 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T01:38:37.707 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T01:38:37.707 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 2349, 2024-09-12T01:38:37.708 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 2008774, 2024-09-12T01:38:37.708 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:37.708 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.708 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.708 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.708 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:37.708 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.708 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-09-12T01:38:37.708 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:37.708 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T01:38:37.708 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:37.708 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-12T01:38:37.708 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-12T01:38:37.709 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:37.709 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:37.709 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 2107, 2024-09-12T01:38:37.709 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 1127, 2024-09-12T01:38:37.709 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 2107, 2024-09-12T01:38:37.709 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1127, 2024-09-12T01:38:37.710 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:37.710 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.710 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.710 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.710 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:37.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.711 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-09-12T01:38:37.711 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:37.711 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-12T01:38:37.711 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:37.712 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-12T01:38:37.712 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-12T01:38:37.712 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:37.712 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:37.712 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 2107, 2024-09-12T01:38:37.712 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 2107, 2024-09-12T01:38:37.713 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 2107, 2024-09-12T01:38:37.713 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 2107, 2024-09-12T01:38:37.713 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:37.713 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.713 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.714 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.714 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:37.714 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.714 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:38:37.714 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:37.715 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-12T01:38:37.715 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:37.715 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-12T01:38:37.715 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-12T01:38:37.715 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:37.715 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:37.716 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T01:38:37.716 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T01:38:37.716 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-12T01:38:37.716 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-12T01:38:37.716 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:37.717 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.717 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.717 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.717 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:37.717 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:37.717 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x563f5d0d8b40": { 2024-09-12T01:38:37.718 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:37.718 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-12T01:38:37.718 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:37.718 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-12T01:38:37.718 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-12T01:38:37.719 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:37.719 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:37.719 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T01:38:37.719 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T01:38:37.719 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-12T01:38:37.719 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-12T01:38:37.720 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:37.720 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:37.720 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:37.720 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:37.720 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:37.721 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:37.721 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T01:38:37.945 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:37 smithi100 ceph-mon[35275]: pgmap v327: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:37.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:37 smithi081 ceph-mon[30920]: pgmap v327: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:38.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:37 smithi189 ceph-mon[35357]: pgmap v327: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:38.445 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-12T01:38:38.445 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-12T01:38:38.445 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-12T01:38:38.445 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-12T01:38:38.445 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-12T01:38:38.445 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:38:38.445 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:38:38.445 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T01:38:38.446 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T01:38:38.692 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:38:39.185 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T01:38:39.185 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:38:39.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 607, 2024-09-12T01:38:39.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 701, 2024-09-12T01:38:39.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 186217, 2024-09-12T01:38:39.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 296306, 2024-09-12T01:38:39.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 11, 2024-09-12T01:38:39.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 4, 2024-09-12T01:38:39.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.085885111, 2024-09-12T01:38:39.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.037449697, 2024-09-12T01:38:39.186 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.040934400, 2024-09-12T01:38:39.187 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.004112109, 2024-09-12T01:38:39.187 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:39.187 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 701, 2024-09-12T01:38:39.187 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.049208568, 2024-09-12T01:38:39.187 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000070197 2024-09-12T01:38:39.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.187 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:39.187 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1223, 2024-09-12T01:38:39.187 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000259958, 2024-09-12T01:38:39.187 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000212 2024-09-12T01:38:39.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.187 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 2640, 2024-09-12T01:38:39.187 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 9552 2024-09-12T01:38:39.188 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.188 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:38:39.188 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 343, 2024-09-12T01:38:39.188 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 325, 2024-09-12T01:38:39.188 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1667684, 2024-09-12T01:38:39.188 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 266657, 2024-09-12T01:38:39.188 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 16, 2024-09-12T01:38:39.188 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 6, 2024-09-12T01:38:39.188 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.052161456, 2024-09-12T01:38:39.188 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.017728228, 2024-09-12T01:38:39.188 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.050233034, 2024-09-12T01:38:39.188 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000286586, 2024-09-12T01:38:39.188 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:39.189 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 324, 2024-09-12T01:38:39.189 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.038690571, 2024-09-12T01:38:39.189 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000119415 2024-09-12T01:38:39.189 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.189 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:39.189 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 94, 2024-09-12T01:38:39.189 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000022820, 2024-09-12T01:38:39.189 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000242 2024-09-12T01:38:39.189 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.189 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1641072, 2024-09-12T01:38:39.189 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 133872 2024-09-12T01:38:39.189 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 113, 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 273, 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 36467, 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 814845, 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 41, 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 6, 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.030804673, 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.010169835, 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.018398157, 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000127121, 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 269, 2024-09-12T01:38:39.190 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.021640742, 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000080448 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 157, 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000027232, 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000173 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 10224, 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 450368 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-12T01:38:39.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.192 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-09-12T01:38:39.192 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-12T01:38:39.192 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-12T01:38:39.192 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 62, 2024-09-12T01:38:39.192 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.001741972, 2024-09-12T01:38:39.192 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000028096 2024-09-12T01:38:39.192 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:39.192 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.192 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-09-12T01:38:39.192 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-12T01:38:39.192 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-12T01:38:39.192 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-12T01:38:39.193 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000013670, 2024-09-12T01:38:39.193 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000006835 2024-09-12T01:38:39.193 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:39.193 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.193 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-12T01:38:39.193 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 10, 2024-09-12T01:38:39.193 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 6, 2024-09-12T01:38:39.193 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-09-12T01:38:39.193 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 6, 2024-09-12T01:38:39.193 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002331276, 2024-09-12T01:38:39.194 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000388546 2024-09-12T01:38:39.194 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.194 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-09-12T01:38:39.194 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 4, 2024-09-12T01:38:39.194 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-09-12T01:38:39.194 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-09-12T01:38:39.194 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 11, 2024-09-12T01:38:39.194 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-09-12T01:38:39.194 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-09-12T01:38:39.194 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 16, 2024-09-12T01:38:39.194 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 0, 2024-09-12T01:38:39.194 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 16, 2024-09-12T01:38:39.195 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 0, 2024-09-12T01:38:39.195 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 13, 2024-09-12T01:38:39.195 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 4, 2024-09-12T01:38:39.195 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 1, 2024-09-12T01:38:39.195 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 1, 2024-09-12T01:38:39.195 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 3, 2024-09-12T01:38:39.195 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 30, 2024-09-12T01:38:39.195 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 19, 2024-09-12T01:38:39.195 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 3, 2024-09-12T01:38:39.195 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 7, 2024-09-12T01:38:39.195 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:38:39.195 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-09-12T01:38:39.195 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-09-12T01:38:39.196 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-09-12T01:38:39.196 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-09-12T01:38:39.196 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 0, 2024-09-12T01:38:39.196 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 0, 2024-09-12T01:38:39.196 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 0, 2024-09-12T01:38:39.196 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 0, 2024-09-12T01:38:39.196 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-09-12T01:38:39.196 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:38:39.196 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-09-12T01:38:39.196 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 4, 2024-09-12T01:38:39.196 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 234, 2024-09-12T01:38:39.196 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 6, 2024-09-12T01:38:39.196 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:38:39.197 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-09-12T01:38:39.197 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:38:39.197 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:38:39.197 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:38:39.197 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:38:39.197 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:38:39.197 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 0, 2024-09-12T01:38:39.197 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:38:39.197 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 5, 2024-09-12T01:38:39.197 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:38:39.197 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:38:39.197 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:38:39.197 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:38:39.198 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 5, 2024-09-12T01:38:39.198 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:38:39.198 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 0, 2024-09-12T01:38:39.198 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 1 2024-09-12T01:38:39.198 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.198 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-09-12T01:38:39.198 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-09-12T01:38:39.198 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 16, 2024-09-12T01:38:39.198 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 11, 2024-09-12T01:38:39.198 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 12, 2024-09-12T01:38:39.198 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 0, 2024-09-12T01:38:39.198 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 0, 2024-09-12T01:38:39.198 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-09-12T01:38:39.199 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:38:39.199 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 0, 2024-09-12T01:38:39.199 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 0, 2024-09-12T01:38:39.199 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-09-12T01:38:39.199 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-09-12T01:38:39.199 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-09-12T01:38:39.199 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:38:39.199 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:38:39.199 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-09-12T01:38:39.199 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-09-12T01:38:39.199 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 2, 2024-09-12T01:38:39.200 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 11, 2024-09-12T01:38:39.200 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:38:39.200 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 0, 2024-09-12T01:38:39.200 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-09-12T01:38:39.200 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:38:39.200 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-09-12T01:38:39.200 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-09-12T01:38:39.201 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.201 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-09-12T01:38:39.201 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-09-12T01:38:39.201 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 9, 2024-09-12T01:38:39.201 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-09-12T01:38:39.201 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-09-12T01:38:39.201 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 9, 2024-09-12T01:38:39.201 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-09-12T01:38:39.201 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-09-12T01:38:39.201 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 2, 2024-09-12T01:38:39.201 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-09-12T01:38:39.201 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-09-12T01:38:39.201 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 2, 2024-09-12T01:38:39.202 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 2, 2024-09-12T01:38:39.202 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-09-12T01:38:39.202 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-09-12T01:38:39.202 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194304, 2024-09-12T01:38:39.202 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 4196802, 2024-09-12T01:38:39.202 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 0, 2024-09-12T01:38:39.202 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-09-12T01:38:39.202 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 8, 2024-09-12T01:38:39.202 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.014859578, 2024-09-12T01:38:39.202 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001857447 2024-09-12T01:38:39.202 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.203 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 0 2024-09-12T01:38:39.203 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.203 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-09-12T01:38:39.203 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 20, 2024-09-12T01:38:39.203 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 22, 2024-09-12T01:38:39.203 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 2, 2024-09-12T01:38:39.203 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 19, 2024-09-12T01:38:39.203 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 22, 2024-09-12T01:38:39.203 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 3, 2024-09-12T01:38:39.203 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 16, 2024-09-12T01:38:39.203 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 20, 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 4, 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 1, 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 6, 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 5, 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 51084, 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 223520 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 14, 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 0, 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 10, 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 21, 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 1, 2024-09-12T01:38:39.204 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.001843314, 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000614438 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.205 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000372635, 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000186317 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.206 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.207 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.207 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-09-12T01:38:39.207 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-12T01:38:39.207 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000115327, 2024-09-12T01:38:39.207 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000115327 2024-09-12T01:38:39.207 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.207 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-09-12T01:38:39.207 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.207 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.207 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.207 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.207 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-09-12T01:38:39.208 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.208 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.208 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.208 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-09-12T01:38:39.208 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.208 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.208 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.208 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-09-12T01:38:39.208 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.209 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.209 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.209 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.209 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-09-12T01:38:39.209 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.210 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.210 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.210 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-09-12T01:38:39.210 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.210 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.210 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.210 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-09-12T01:38:39.210 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.210 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.210 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.215 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 1, 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 4, 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 3, 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 1, 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 4, 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 1, 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 613, 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 264119, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 97, 2024-09-12T01:38:39.220 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 8128, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 179, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 82245, 2024-09-12T01:38:39.222 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 340, 2024-09-12T01:38:39.222 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-12T01:38:39.222 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-12T01:38:39.222 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-12T01:38:39.222 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-12T01:38:39.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.222 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-09-12T01:38:39.222 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-12T01:38:39.222 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-12T01:38:39.222 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 48, 2024-09-12T01:38:39.222 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 13241, 2024-09-12T01:38:39.223 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 31, 2024-09-12T01:38:39.223 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 48, 2024-09-12T01:38:39.223 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-12T01:38:39.223 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 48, 2024-09-12T01:38:39.223 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.206994691, 2024-09-12T01:38:39.223 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.004312389 2024-09-12T01:38:39.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.223 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-12T01:38:39.223 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-12T01:38:39.223 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 48, 2024-09-12T01:38:39.223 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 73 2024-09-12T01:38:39.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.224 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 48, 2024-09-12T01:38:39.224 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 0, 2024-09-12T01:38:39.224 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 48, 2024-09-12T01:38:39.224 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-12T01:38:39.224 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-12T01:38:39.224 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-12T01:38:39.224 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 10, 2024-09-12T01:38:39.224 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 0, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 8, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 8, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 6, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 20, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:38:39.225 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-12T01:38:39.226 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:38:39.226 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-12T01:38:39.226 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-12T01:38:39.226 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-12T01:38:39.226 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:38:39.226 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-12T01:38:39.226 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:38:39.226 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-12T01:38:39.226 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-12T01:38:39.226 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-12T01:38:39.226 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-12T01:38:39.226 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-12T01:38:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-12T01:38:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-12T01:38:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-12T01:38:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-12T01:38:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-12T01:38:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-12T01:38:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-12T01:38:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-12T01:38:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-12T01:38:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-12T01:38:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-12T01:38:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-12T01:38:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 91, 2024-09-12T01:38:39.228 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-12T01:38:39.228 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 11, 2024-09-12T01:38:39.228 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 9, 2024-09-12T01:38:39.228 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 9, 2024-09-12T01:38:39.228 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-12T01:38:39.228 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-12T01:38:39.228 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 20, 2024-09-12T01:38:39.228 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-12T01:38:39.229 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 1 2024-09-12T01:38:39.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.229 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-09-12T01:38:39.229 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 1, 2024-09-12T01:38:39.229 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:38:39.230 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-09-12T01:38:39.230 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-09-12T01:38:39.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.230 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-09-12T01:38:39.230 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 13 2024-09-12T01:38:39.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.231 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-09-12T01:38:39.231 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-09-12T01:38:39.231 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:38:39.231 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-09-12T01:38:39.231 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 0, 2024-09-12T01:38:39.231 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 0, 2024-09-12T01:38:39.231 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 0, 2024-09-12T01:38:39.231 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-09-12T01:38:39.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.231 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:38:39.231 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:39.231 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T01:38:39.231 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:39.232 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 1059, 2024-09-12T01:38:39.232 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1776903, 2024-09-12T01:38:39.232 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:39.232 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 1059, 2024-09-12T01:38:39.232 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T01:38:39.232 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T01:38:39.232 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 1059, 2024-09-12T01:38:39.232 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1776903, 2024-09-12T01:38:39.232 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:39.232 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.232 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.232 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.232 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 48, 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 13241, 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 48, 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 13241, 2024-09-12T01:38:39.233 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:39.234 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.234 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.234 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.234 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:39.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.234 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-09-12T01:38:39.234 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:39.234 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-12T01:38:39.234 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:39.234 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-12T01:38:39.234 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-12T01:38:39.234 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:39.234 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:39.235 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 48, 2024-09-12T01:38:39.235 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 48, 2024-09-12T01:38:39.235 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 48, 2024-09-12T01:38:39.235 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 48, 2024-09-12T01:38:39.235 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:39.235 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.235 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.235 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.235 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:39.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.235 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:38:39.236 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:39.236 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-12T01:38:39.236 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:39.236 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-12T01:38:39.236 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-12T01:38:39.236 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:39.236 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:39.236 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T01:38:39.236 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T01:38:39.236 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-12T01:38:39.237 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-12T01:38:39.237 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:39.237 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.237 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.237 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.237 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:39.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:39.237 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x5652cfd48960": { 2024-09-12T01:38:39.237 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:39.237 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-12T01:38:39.237 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:39.237 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 9, 2024-09-12T01:38:39.237 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 2498, 2024-09-12T01:38:39.238 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:39.238 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 9, 2024-09-12T01:38:39.238 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T01:38:39.238 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T01:38:39.238 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 8, 2024-09-12T01:38:39.238 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 2498, 2024-09-12T01:38:39.238 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:39.238 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:39.238 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:39.238 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:39.238 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:39.238 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:39.238 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T01:38:39.933 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-12T01:38:39.933 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-12T01:38:39.933 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-12T01:38:39.934 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=16 2024-09-12T01:38:39.934 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-12T01:38:39.934 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:38:39.934 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:38:39.934 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T01:38:39.935 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T01:38:39.957 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:39 smithi100 ceph-mon[35275]: pgmap v328: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:39.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:39 smithi081 ceph-mon[30920]: pgmap v328: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:40.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:39 smithi189 ceph-mon[35357]: pgmap v328: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:40.177 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:38:40.703 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-12T01:38:40.703 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:38:40.703 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 88, 2024-09-12T01:38:40.703 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 104, 2024-09-12T01:38:40.703 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 29710, 2024-09-12T01:38:40.703 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 87516, 2024-09-12T01:38:40.703 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 15, 2024-09-12T01:38:40.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-09-12T01:38:40.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.024333921, 2024-09-12T01:38:40.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.005183325, 2024-09-12T01:38:40.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.014407030, 2024-09-12T01:38:40.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000535051, 2024-09-12T01:38:40.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:40.704 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 102, 2024-09-12T01:38:40.704 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.037732133, 2024-09-12T01:38:40.704 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000369922 2024-09-12T01:38:40.704 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.704 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:40.704 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 122, 2024-09-12T01:38:40.705 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000120188, 2024-09-12T01:38:40.705 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000985 2024-09-12T01:38:40.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.705 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1968, 2024-09-12T01:38:40.705 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 5120 2024-09-12T01:38:40.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.705 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:38:40.705 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 340, 2024-09-12T01:38:40.705 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 450, 2024-09-12T01:38:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1663082, 2024-09-12T01:38:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 482022, 2024-09-12T01:38:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 8, 2024-09-12T01:38:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 5, 2024-09-12T01:38:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.060270601, 2024-09-12T01:38:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.022501703, 2024-09-12T01:38:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.052437366, 2024-09-12T01:38:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000248594, 2024-09-12T01:38:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 450, 2024-09-12T01:38:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.061357701, 2024-09-12T01:38:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000136350 2024-09-12T01:38:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 87, 2024-09-12T01:38:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000019931, 2024-09-12T01:38:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000229 2024-09-12T01:38:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1638992, 2024-09-12T01:38:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 455552 2024-09-12T01:38:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:38:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 619, 2024-09-12T01:38:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 749, 2024-09-12T01:38:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 186951, 2024-09-12T01:38:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 878767, 2024-09-12T01:38:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 43, 2024-09-12T01:38:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 8, 2024-09-12T01:38:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.093283496, 2024-09-12T01:38:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.039980606, 2024-09-12T01:38:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.048758991, 2024-09-12T01:38:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.003419466, 2024-09-12T01:38:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 746, 2024-09-12T01:38:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.047737239, 2024-09-12T01:38:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000063990 2024-09-12T01:38:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1259, 2024-09-12T01:38:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000340878, 2024-09-12T01:38:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000270 2024-09-12T01:38:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 4624, 2024-09-12T01:38:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 136432 2024-09-12T01:38:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-12T01:38:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-09-12T01:38:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-12T01:38:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-09-12T01:38:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-12T01:38:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-12T01:38:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 56, 2024-09-12T01:38:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.001573850, 2024-09-12T01:38:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000028104 2024-09-12T01:38:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-09-12T01:38:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-12T01:38:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-12T01:38:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-12T01:38:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000015525, 2024-09-12T01:38:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000007762 2024-09-12T01:38:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-12T01:38:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 6, 2024-09-12T01:38:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 3, 2024-09-12T01:38:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-09-12T01:38:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-12T01:38:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000529924, 2024-09-12T01:38:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000176641 2024-09-12T01:38:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-09-12T01:38:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 3, 2024-09-12T01:38:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-09-12T01:38:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-09-12T01:38:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 11, 2024-09-12T01:38:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-09-12T01:38:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-09-12T01:38:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 16, 2024-09-12T01:38:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 0, 2024-09-12T01:38:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 16, 2024-09-12T01:38:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 0, 2024-09-12T01:38:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 13, 2024-09-12T01:38:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 4, 2024-09-12T01:38:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 1, 2024-09-12T01:38:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 1, 2024-09-12T01:38:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 3, 2024-09-12T01:38:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 24, 2024-09-12T01:38:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 16, 2024-09-12T01:38:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 1, 2024-09-12T01:38:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 6, 2024-09-12T01:38:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:38:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-09-12T01:38:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-09-12T01:38:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-09-12T01:38:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-09-12T01:38:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 0, 2024-09-12T01:38:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 0, 2024-09-12T01:38:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 0, 2024-09-12T01:38:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 0, 2024-09-12T01:38:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-09-12T01:38:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:38:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-09-12T01:38:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 4, 2024-09-12T01:38:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 234, 2024-09-12T01:38:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 6, 2024-09-12T01:38:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:38:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-09-12T01:38:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:38:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:38:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:38:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:38:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:38:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 0, 2024-09-12T01:38:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:38:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 1, 2024-09-12T01:38:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:38:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:38:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:38:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:38:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 1, 2024-09-12T01:38:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:38:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 0, 2024-09-12T01:38:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 0 2024-09-12T01:38:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-09-12T01:38:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-09-12T01:38:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 18, 2024-09-12T01:38:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 12, 2024-09-12T01:38:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 12, 2024-09-12T01:38:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 0, 2024-09-12T01:38:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 0, 2024-09-12T01:38:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-09-12T01:38:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:38:40.719 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 0, 2024-09-12T01:38:40.719 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 0, 2024-09-12T01:38:40.719 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-09-12T01:38:40.719 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-09-12T01:38:40.719 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-09-12T01:38:40.719 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:38:40.719 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:38:40.719 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-09-12T01:38:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-09-12T01:38:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 2, 2024-09-12T01:38:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 11, 2024-09-12T01:38:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:38:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 0, 2024-09-12T01:38:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-09-12T01:38:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:38:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-09-12T01:38:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-09-12T01:38:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-09-12T01:38:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-09-12T01:38:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 6, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 6, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 2, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 2, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 2, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194304, 2024-09-12T01:38:40.721 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 4196127, 2024-09-12T01:38:40.722 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 0, 2024-09-12T01:38:40.722 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-09-12T01:38:40.722 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 5, 2024-09-12T01:38:40.722 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.008861649, 2024-09-12T01:38:40.722 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001772329 2024-09-12T01:38:40.722 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.722 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 0 2024-09-12T01:38:40.722 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.722 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-09-12T01:38:40.722 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 20, 2024-09-12T01:38:40.722 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 22, 2024-09-12T01:38:40.722 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 2, 2024-09-12T01:38:40.722 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 19, 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 23, 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 4, 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 16, 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 20, 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 4, 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 1, 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 1, 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 0, 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 50100, 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 223520 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 6, 2024-09-12T01:38:40.723 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 0, 2024-09-12T01:38:40.724 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 6, 2024-09-12T01:38:40.724 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 21, 2024-09-12T01:38:40.724 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 0, 2024-09-12T01:38:40.724 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-09-12T01:38:40.724 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.724 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.724 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.724 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.724 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-09-12T01:38:40.725 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-12T01:38:40.725 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000529924, 2024-09-12T01:38:40.725 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000176641 2024-09-12T01:38:40.725 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.725 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-09-12T01:38:40.725 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.725 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.725 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.725 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.726 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-09-12T01:38:40.726 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.726 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.726 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.726 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.726 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-09-12T01:38:40.726 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.726 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.726 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.726 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.726 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-09-12T01:38:40.726 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.727 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.727 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.727 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.727 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-09-12T01:38:40.727 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.727 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.727 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.727 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.728 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-09-12T01:38:40.728 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.728 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.728 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.728 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.728 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-09-12T01:38:40.728 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.728 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.728 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.728 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.728 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-09-12T01:38:40.728 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.729 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.729 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.729 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.729 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-09-12T01:38:40.729 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.730 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.730 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.730 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.730 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-09-12T01:38:40.730 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.730 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.730 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.730 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.731 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-09-12T01:38:40.731 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.731 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.731 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.731 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.731 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-09-12T01:38:40.731 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.732 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.732 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.732 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.732 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-09-12T01:38:40.732 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.732 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.732 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.732 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.732 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-09-12T01:38:40.732 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.733 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.733 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.733 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.733 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-09-12T01:38:40.733 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.733 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.733 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.733 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.734 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-09-12T01:38:40.734 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.734 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.734 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.734 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.734 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-09-12T01:38:40.734 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.734 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.734 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.735 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.735 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-09-12T01:38:40.735 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.735 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.735 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.735 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.735 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-09-12T01:38:40.736 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.736 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.736 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.736 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.736 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-09-12T01:38:40.736 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.736 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.736 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.737 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.737 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-09-12T01:38:40.737 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.737 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.737 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.737 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.739 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.739 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.739 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-09-12T01:38:40.739 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.739 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.739 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.739 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.739 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-09-12T01:38:40.739 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.739 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.739 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.739 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.739 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.741 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:40.741 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.741 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-09-12T01:38:40.741 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 2, 2024-09-12T01:38:40.741 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 3, 2024-09-12T01:38:40.741 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 1, 2024-09-12T01:38:40.741 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 2, 2024-09-12T01:38:40.741 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-09-12T01:38:40.741 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 2, 2024-09-12T01:38:40.741 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 0, 2024-09-12T01:38:40.742 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 605, 2024-09-12T01:38:40.742 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-09-12T01:38:40.742 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.742 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-12T01:38:40.742 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:38:40.742 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-12T01:38:40.742 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:38:40.742 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:38:40.742 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:38:40.742 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:38:40.742 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:38:40.742 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:38:40.743 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:38:40.743 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:38:40.743 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:38:40.743 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:38:40.743 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:38:40.743 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:38:40.743 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:38:40.743 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-12T01:38:40.743 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:38:40.743 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-12T01:38:40.743 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:38:40.743 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:38:40.743 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:38:40.744 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:38:40.745 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:38:40.745 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 272103, 2024-09-12T01:38:40.745 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 104, 2024-09-12T01:38:40.745 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 88, 2024-09-12T01:38:40.745 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 1, 2024-09-12T01:38:40.745 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-12T01:38:40.745 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-12T01:38:40.745 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:38:40.745 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-12T01:38:40.745 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:38:40.746 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-12T01:38:40.746 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 8128, 2024-09-12T01:38:40.746 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 179, 2024-09-12T01:38:40.746 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:38:40.746 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:38:40.746 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-12T01:38:40.746 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-12T01:38:40.746 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 82181, 2024-09-12T01:38:40.746 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 332, 2024-09-12T01:38:40.746 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-12T01:38:40.746 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-12T01:38:40.746 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-12T01:38:40.746 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-12T01:38:40.747 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.747 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-09-12T01:38:40.747 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-12T01:38:40.747 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-12T01:38:40.747 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 42, 2024-09-12T01:38:40.747 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 12215, 2024-09-12T01:38:40.747 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 33, 2024-09-12T01:38:40.747 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 42, 2024-09-12T01:38:40.747 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-12T01:38:40.747 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 42, 2024-09-12T01:38:40.747 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.223994268, 2024-09-12T01:38:40.747 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.005333196 2024-09-12T01:38:40.747 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.748 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-12T01:38:40.748 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-12T01:38:40.748 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 42, 2024-09-12T01:38:40.748 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 64 2024-09-12T01:38:40.748 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.748 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 42, 2024-09-12T01:38:40.748 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 0, 2024-09-12T01:38:40.748 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 42, 2024-09-12T01:38:40.748 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-12T01:38:40.748 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-12T01:38:40.748 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-12T01:38:40.748 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 10, 2024-09-12T01:38:40.748 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 0, 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 5, 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 8, 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 6, 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 20, 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:38:40.750 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-12T01:38:40.750 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:38:40.750 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-12T01:38:40.750 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-12T01:38:40.750 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-12T01:38:40.750 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:38:40.750 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-12T01:38:40.750 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:38:40.750 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-12T01:38:40.750 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-12T01:38:40.750 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-12T01:38:40.751 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 91, 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 11, 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 8, 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 8, 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 14, 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 1 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 1, 2024-09-12T01:38:40.752 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:38:40.753 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-09-12T01:38:40.753 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-09-12T01:38:40.753 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.753 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-09-12T01:38:40.753 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 13 2024-09-12T01:38:40.753 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.753 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-09-12T01:38:40.753 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-09-12T01:38:40.753 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:38:40.753 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-09-12T01:38:40.753 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 0, 2024-09-12T01:38:40.753 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 0, 2024-09-12T01:38:40.753 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 0, 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 1043, 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1767840, 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 1043, 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 1043, 2024-09-12T01:38:40.754 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1767840, 2024-09-12T01:38:40.755 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:40.755 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.755 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.755 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.755 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:40.755 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.755 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-09-12T01:38:40.755 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:40.755 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-12T01:38:40.755 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:40.755 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-12T01:38:40.756 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-12T01:38:40.756 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:40.756 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:40.756 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 42, 2024-09-12T01:38:40.756 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 12215, 2024-09-12T01:38:40.756 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 42, 2024-09-12T01:38:40.756 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 12215, 2024-09-12T01:38:40.756 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:40.756 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.757 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.757 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.757 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:40.757 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.757 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-09-12T01:38:40.757 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:40.757 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-12T01:38:40.757 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:40.757 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-12T01:38:40.758 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-12T01:38:40.758 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:40.758 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:40.758 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 42, 2024-09-12T01:38:40.758 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 42, 2024-09-12T01:38:40.759 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 42, 2024-09-12T01:38:40.759 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 42, 2024-09-12T01:38:40.759 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:40.759 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.759 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.759 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.760 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:40.760 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.760 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:38:40.760 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:40.760 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-12T01:38:40.760 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:40.760 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-12T01:38:40.761 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-12T01:38:40.761 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:40.761 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:40.761 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T01:38:40.761 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T01:38:40.761 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-12T01:38:40.761 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-12T01:38:40.762 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:40.762 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.762 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.762 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.762 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:40.762 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-12T01:38:40.762 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x563fc406c960": { 2024-09-12T01:38:40.762 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-12T01:38:40.762 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-12T01:38:40.762 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-12T01:38:40.762 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 6, 2024-09-12T01:38:40.763 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1823, 2024-09-12T01:38:40.763 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:40.763 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 6, 2024-09-12T01:38:40.763 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-12T01:38:40.763 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-12T01:38:40.763 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 5, 2024-09-12T01:38:40.763 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1823, 2024-09-12T01:38:40.763 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-12T01:38:40.763 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-12T01:38:40.764 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-12T01:38:40.764 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-12T01:38:40.764 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:40.764 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-12T01:38:40.764 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-12T01:38:41.520 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-12T01:38:41.521 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-12T01:38:41.521 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-12T01:38:41.521 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=18 2024-09-12T01:38:41.521 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=6 2024-09-12T01:38:41.521 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:38:41.521 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:38:41.521 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T01:38:41.521 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T01:38:41.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:41 smithi100 ceph-mon[35275]: pgmap v329: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:41.789 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:38:41.909 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:41 smithi189 ceph-mon[35357]: pgmap v329: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:41.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:41 smithi081 ceph-mon[30920]: pgmap v329: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:42.292 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T01:38:42.293 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:38:42.293 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 1582, 2024-09-12T01:38:42.293 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 1582, 2024-09-12T01:38:42.293 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1279857, 2024-09-12T01:38:42.293 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 502262, 2024-09-12T01:38:42.293 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 6, 2024-09-12T01:38:42.294 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-12T01:38:42.294 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.156562438, 2024-09-12T01:38:42.294 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.051446831, 2024-09-12T01:38:42.294 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.042451348, 2024-09-12T01:38:42.294 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.047412454, 2024-09-12T01:38:42.294 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:42.295 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1581, 2024-09-12T01:38:42.295 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.069475425, 2024-09-12T01:38:42.295 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000043943 2024-09-12T01:38:42.295 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.295 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:42.296 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.296 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.296 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.296 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.297 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-12T01:38:42.297 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T01:38:42.297 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.297 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:38:42.297 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 6, 2024-09-12T01:38:42.297 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 163, 2024-09-12T01:38:42.298 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1976, 2024-09-12T01:38:42.298 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 442666, 2024-09-12T01:38:42.298 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 7, 2024-09-12T01:38:42.298 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 5, 2024-09-12T01:38:42.298 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.010925124, 2024-09-12T01:38:42.298 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.006475142, 2024-09-12T01:38:42.298 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.002341419, 2024-09-12T01:38:42.299 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000129715, 2024-09-12T01:38:42.299 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:42.299 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 160, 2024-09-12T01:38:42.299 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.014883471, 2024-09-12T01:38:42.299 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000093021 2024-09-12T01:38:42.300 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.300 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:42.300 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.300 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.300 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.300 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.301 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T01:38:42.301 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 441328 2024-09-12T01:38:42.305 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.305 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:38:42.305 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 970, 2024-09-12T01:38:42.305 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 953, 2024-09-12T01:38:42.306 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1813837, 2024-09-12T01:38:42.306 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 362015, 2024-09-12T01:38:42.306 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 3, 2024-09-12T01:38:42.306 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-12T01:38:42.306 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.113414603, 2024-09-12T01:38:42.307 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.041771621, 2024-09-12T01:38:42.307 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.055162040, 2024-09-12T01:38:42.307 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.023310024, 2024-09-12T01:38:42.308 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:42.308 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 952, 2024-09-12T01:38:42.308 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.043708486, 2024-09-12T01:38:42.309 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000045912 2024-09-12T01:38:42.309 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.309 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:42.309 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.309 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.309 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.309 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.309 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 1634432, 2024-09-12T01:38:42.309 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 130192 2024-09-12T01:38:42.309 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.310 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-12T01:38:42.310 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-12T01:38:42.310 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-12T01:38:42.310 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.310 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-12T01:38:42.310 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T01:38:42.310 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T01:38:42.310 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3792, 2024-09-12T01:38:42.310 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.106745365, 2024-09-12T01:38:42.310 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000028150 2024-09-12T01:38:42.310 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:42.310 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-12T01:38:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T01:38:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T01:38:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-12T01:38:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-12T01:38:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-12T01:38:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-12T01:38:42.311 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.312 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.312 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.312 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.312 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-12T01:38:42.312 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-12T01:38:42.312 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-12T01:38:42.312 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-12T01:38:42.312 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 0, 2024-09-12T01:38:42.312 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-12T01:38:42.312 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-12T01:38:42.312 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 31, 2024-09-12T01:38:42.312 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 0, 2024-09-12T01:38:42.313 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 31, 2024-09-12T01:38:42.313 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-12T01:38:42.313 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 31, 2024-09-12T01:38:42.313 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-12T01:38:42.313 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-12T01:38:42.313 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-12T01:38:42.313 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 2, 2024-09-12T01:38:42.313 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-12T01:38:42.313 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-12T01:38:42.313 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-12T01:38:42.313 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-12T01:38:42.313 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:38:42.313 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-12T01:38:42.314 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-12T01:38:42.314 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-12T01:38:42.314 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-12T01:38:42.314 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-12T01:38:42.314 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-12T01:38:42.314 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-12T01:38:42.314 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-12T01:38:42.314 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-12T01:38:42.314 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:38:42.314 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-12T01:38:42.314 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 4, 2024-09-12T01:38:42.315 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 234, 2024-09-12T01:38:42.315 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 6, 2024-09-12T01:38:42.315 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:38:42.315 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-12T01:38:42.315 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:38:42.315 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:38:42.315 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:38:42.315 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:38:42.315 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:38:42.315 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-12T01:38:42.315 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:38:42.316 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:38:42.316 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:38:42.316 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:38:42.316 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:38:42.316 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:38:42.316 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-12T01:38:42.316 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:38:42.316 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-12T01:38:42.316 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-12T01:38:42.316 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.316 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-12T01:38:42.316 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-12T01:38:42.317 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-12T01:38:42.317 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-12T01:38:42.317 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 0, 2024-09-12T01:38:42.317 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-12T01:38:42.317 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-12T01:38:42.317 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-12T01:38:42.317 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:38:42.317 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-12T01:38:42.317 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-12T01:38:42.317 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-12T01:38:42.317 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-12T01:38:42.318 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-12T01:38:42.318 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:38:42.318 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:38:42.318 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-12T01:38:42.318 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-12T01:38:42.318 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 0, 2024-09-12T01:38:42.318 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 0, 2024-09-12T01:38:42.318 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:38:42.318 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-12T01:38:42.318 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-12T01:38:42.318 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:38:42.318 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-12T01:38:42.319 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-12T01:38:42.319 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.319 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-12T01:38:42.319 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-12T01:38:42.319 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 0, 2024-09-12T01:38:42.319 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-12T01:38:42.319 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-12T01:38:42.319 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 214, 2024-09-12T01:38:42.319 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-12T01:38:42.319 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-12T01:38:42.320 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 0, 2024-09-12T01:38:42.320 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-12T01:38:42.320 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-12T01:38:42.320 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-12T01:38:42.320 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-12T01:38:42.320 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-12T01:38:42.320 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-12T01:38:42.320 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-12T01:38:42.320 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 5004206, 2024-09-12T01:38:42.320 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 5004094, 2024-09-12T01:38:42.320 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-12T01:38:42.320 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.321 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.321 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.321 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.321 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 214 2024-09-12T01:38:42.321 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.321 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-12T01:38:42.321 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 20, 2024-09-12T01:38:42.321 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 24, 2024-09-12T01:38:42.321 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 4, 2024-09-12T01:38:42.321 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 11, 2024-09-12T01:38:42.321 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 11, 2024-09-12T01:38:42.322 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 0, 2024-09-12T01:38:42.322 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 31, 2024-09-12T01:38:42.322 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 31, 2024-09-12T01:38:42.322 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 0, 2024-09-12T01:38:42.322 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-12T01:38:42.322 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-12T01:38:42.322 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-12T01:38:42.322 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 48100, 2024-09-12T01:38:42.322 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 215328 2024-09-12T01:38:42.322 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.322 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-12T01:38:42.323 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-12T01:38:42.323 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-12T01:38:42.323 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-12T01:38:42.323 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-12T01:38:42.323 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-12T01:38:42.323 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-12T01:38:42.323 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.323 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.323 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.323 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.324 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-12T01:38:42.324 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.324 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.324 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.324 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.324 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-12T01:38:42.324 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.324 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.324 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.324 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.325 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-12T01:38:42.325 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.325 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.325 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.325 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.325 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-12T01:38:42.325 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.326 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.326 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.326 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.326 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-12T01:38:42.326 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.326 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.326 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.326 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.326 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.327 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.328 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-12T01:38:42.328 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.328 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.328 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.328 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.328 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-12T01:38:42.328 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.328 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.328 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.328 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.328 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-12T01:38:42.328 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.329 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.329 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.329 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.329 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-12T01:38:42.329 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.329 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-12T01:38:42.330 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.331 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.331 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.331 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.331 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-12T01:38:42.331 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.331 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.331 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.331 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.331 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-12T01:38:42.331 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.331 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.331 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.331 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.332 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-12T01:38:42.332 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.332 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.332 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.332 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.332 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-12T01:38:42.332 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.332 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.332 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.332 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.332 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-12T01:38:42.332 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.332 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.333 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.333 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.333 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-12T01:38:42.333 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.333 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.333 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.333 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.333 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-12T01:38:42.333 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.333 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.333 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.333 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.334 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.335 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.335 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-12T01:38:42.335 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.335 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.335 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.335 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.335 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-12T01:38:42.335 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.335 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.335 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.335 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.335 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-12T01:38:42.335 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.336 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.336 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.336 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.336 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:38:42.336 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:38:42.336 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-12T01:38:42.336 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.336 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.336 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.336 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:42.336 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.336 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-12T01:38:42.336 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 2, 2024-09-12T01:38:42.337 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 5, 2024-09-12T01:38:42.337 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 3, 2024-09-12T01:38:42.337 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 4, 2024-09-12T01:38:42.337 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-12T01:38:42.337 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-12T01:38:42.337 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-12T01:38:42.337 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 3152, 2024-09-12T01:38:42.337 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-12T01:38:42.337 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.337 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-12T01:38:42.337 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:38:42.337 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-12T01:38:42.337 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:38:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:38:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:38:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:38:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:38:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:38:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:38:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:38:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:38:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:38:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:38:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:38:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:38:42.338 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:38:42.339 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-12T01:38:42.340 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-12T01:38:42.340 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-12T01:38:42.340 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:38:42.340 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:38:42.340 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:38:42.340 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:38:42.340 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 189726, 2024-09-12T01:38:42.340 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 60, 2024-09-12T01:38:42.340 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:38:42.340 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-12T01:38:42.340 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-12T01:38:42.340 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-12T01:38:42.340 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 8128, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 179, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 92229, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 752, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-12T01:38:42.341 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-12T01:38:42.342 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-12T01:38:42.342 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.342 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-12T01:38:42.342 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-12T01:38:42.342 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-12T01:38:42.342 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 2311, 2024-09-12T01:38:42.342 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 26, 2024-09-12T01:38:42.342 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 4, 2024-09-12T01:38:42.342 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 2311, 2024-09-12T01:38:42.342 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-12T01:38:42.342 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2311, 2024-09-12T01:38:42.342 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 1.040977393, 2024-09-12T01:38:42.342 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000450444 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2311, 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 2312 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 2311, 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 2311, 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 0, 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 1465, 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 0, 2024-09-12T01:38:42.343 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 843, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 0, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 0, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 0, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 2, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 0, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:38:42.344 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-12T01:38:42.345 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-12T01:38:42.346 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-12T01:38:42.346 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-12T01:38:42.346 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-12T01:38:42.346 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-12T01:38:42.346 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-12T01:38:42.346 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-12T01:38:42.346 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-12T01:38:42.346 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-12T01:38:42.346 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-12T01:38:42.346 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-12T01:38:42.346 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 91, 2024-09-12T01:38:42.346 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-12T01:38:42.347 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 11, 2024-09-12T01:38:42.347 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 5, 2024-09-12T01:38:42.347 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 5, 2024-09-12T01:38:42.347 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-12T01:38:42.347 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-12T01:38:42.347 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 0, 2024-09-12T01:38:42.347 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 2, 2024-09-12T01:38:42.347 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 0 2024-09-12T01:38:42.347 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.347 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-12T01:38:42.347 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 0, 2024-09-12T01:38:42.348 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:38:42.348 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-12T01:38:42.348 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-12T01:38:42.348 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.348 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-12T01:38:42.348 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-12T01:38:42.348 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.348 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-12T01:38:42.348 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-12T01:38:42.348 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:38:42.348 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-12T01:38:42.348 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-12T01:38:42.349 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-12T01:38:42.349 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-12T01:38:42.349 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-12T01:38:42.349 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.349 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:38:42.349 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:42.349 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T01:38:42.349 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:42.349 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 2554, 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 2850481, 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 2554, 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 2554, 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 2850481, 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.350 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-12T01:38:42.351 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:42.351 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T01:38:42.351 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:42.351 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:42.351 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:42.352 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:42.352 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:42.352 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 2311, 2024-09-12T01:38:42.352 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 809912, 2024-09-12T01:38:42.352 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 2311, 2024-09-12T01:38:42.352 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 809912, 2024-09-12T01:38:42.352 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:42.352 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.352 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.352 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.352 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:42.353 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.353 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-12T01:38:42.353 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:42.353 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-12T01:38:42.353 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:42.353 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:42.353 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:42.353 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:42.353 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:42.353 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 2311, 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 2311, 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 2311, 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 2311, 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:42.354 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:42.355 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:42.355 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:42.355 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:42.355 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T01:38:42.355 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T01:38:42.355 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T01:38:42.355 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T01:38:42.355 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:42.355 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.355 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.355 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.355 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:42.355 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:42.356 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x55e331230b40": { 2024-09-12T01:38:42.356 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:42.356 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T01:38:42.356 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:42.356 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:42.356 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:42.356 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:42.356 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:42.356 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T01:38:42.356 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T01:38:42.356 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T01:38:42.356 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T01:38:42.356 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:42.357 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:42.357 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:42.357 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:42.357 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:42.357 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:42.357 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T01:38:43.263 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-12T01:38:43.264 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-12T01:38:43.264 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-12T01:38:43.264 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-12T01:38:43.264 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-12T01:38:43.264 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:38:43.264 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:38:43.264 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T01:38:43.264 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T01:38:43.513 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:38:43.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:43 smithi189 ceph-mon[35357]: pgmap v330: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:43.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:43 smithi081 ceph-mon[30920]: pgmap v330: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:44.006 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T01:38:44.007 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:38:44.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 748, 2024-09-12T01:38:44.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 750, 2024-09-12T01:38:44.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 199017, 2024-09-12T01:38:44.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 237928, 2024-09-12T01:38:44.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 6, 2024-09-12T01:38:44.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-12T01:38:44.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.072937878, 2024-09-12T01:38:44.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.024003778, 2024-09-12T01:38:44.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.019531807, 2024-09-12T01:38:44.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.021273684, 2024-09-12T01:38:44.008 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:44.008 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 748, 2024-09-12T01:38:44.008 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.031786229, 2024-09-12T01:38:44.008 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000042494 2024-09-12T01:38:44.008 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.008 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:44.008 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.008 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.008 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.008 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.008 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:38:44.008 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:38:44.008 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.009 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:38:44.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 652, 2024-09-12T01:38:44.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 810, 2024-09-12T01:38:44.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 160242, 2024-09-12T01:38:44.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 648209, 2024-09-12T01:38:44.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 7, 2024-09-12T01:38:44.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 5, 2024-09-12T01:38:44.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.076235469, 2024-09-12T01:38:44.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.025103009, 2024-09-12T01:38:44.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.018214349, 2024-09-12T01:38:44.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.025102975, 2024-09-12T01:38:44.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:44.009 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 807, 2024-09-12T01:38:44.010 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.043473862, 2024-09-12T01:38:44.010 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000053870 2024-09-12T01:38:44.010 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.010 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:44.010 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.010 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.010 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.010 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.010 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T01:38:44.010 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 441504 2024-09-12T01:38:44.011 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.011 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:38:44.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 984, 2024-09-12T01:38:44.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 965, 2024-09-12T01:38:44.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1885872, 2024-09-12T01:38:44.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 366122, 2024-09-12T01:38:44.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 3, 2024-09-12T01:38:44.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-12T01:38:44.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.133351856, 2024-09-12T01:38:44.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.042932674, 2024-09-12T01:38:44.012 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.067297081, 2024-09-12T01:38:44.012 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.029149493, 2024-09-12T01:38:44.012 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:44.012 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 965, 2024-09-12T01:38:44.012 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.058953192, 2024-09-12T01:38:44.012 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000061091 2024-09-12T01:38:44.012 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.012 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:44.012 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.013 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.013 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.013 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.013 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 1637568, 2024-09-12T01:38:44.013 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 131120 2024-09-12T01:38:44.013 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.013 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-12T01:38:44.013 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-12T01:38:44.013 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-12T01:38:44.013 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.013 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-12T01:38:44.013 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T01:38:44.013 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3551, 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.109871260, 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000030940 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.014 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 0, 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-12T01:38:44.015 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-12T01:38:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 0, 2024-09-12T01:38:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 0, 2024-09-12T01:38:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 0, 2024-09-12T01:38:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-12T01:38:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 0, 2024-09-12T01:38:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-12T01:38:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-12T01:38:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-12T01:38:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 1, 2024-09-12T01:38:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-12T01:38:44.016 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-12T01:38:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-12T01:38:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-12T01:38:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:38:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-12T01:38:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-12T01:38:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-12T01:38:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-12T01:38:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-12T01:38:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-12T01:38:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-12T01:38:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-12T01:38:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-12T01:38:44.017 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:38:44.018 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-12T01:38:44.018 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 0, 2024-09-12T01:38:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 0, 2024-09-12T01:38:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-12T01:38:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:38:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-12T01:38:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:38:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:38:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:38:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:38:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:38:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-12T01:38:44.019 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:38:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:38:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:38:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:38:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:38:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:38:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-12T01:38:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:38:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-12T01:38:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-12T01:38:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-12T01:38:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-12T01:38:44.020 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-12T01:38:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-12T01:38:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 0, 2024-09-12T01:38:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-12T01:38:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-12T01:38:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-12T01:38:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:38:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-12T01:38:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-12T01:38:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-12T01:38:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-12T01:38:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-12T01:38:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:38:44.021 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 0, 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 0, 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-12T01:38:44.022 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 0, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 9, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 0, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-12T01:38:44.023 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4196802, 2024-09-12T01:38:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 4196661, 2024-09-12T01:38:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-12T01:38:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 9 2024-09-12T01:38:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-12T01:38:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 3, 2024-09-12T01:38:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 3, 2024-09-12T01:38:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 0, 2024-09-12T01:38:44.024 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 1, 2024-09-12T01:38:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 1, 2024-09-12T01:38:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 0, 2024-09-12T01:38:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 0, 2024-09-12T01:38:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 0, 2024-09-12T01:38:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 0, 2024-09-12T01:38:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-12T01:38:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-12T01:38:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-12T01:38:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 48188, 2024-09-12T01:38:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 215328 2024-09-12T01:38:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.025 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.026 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-12T01:38:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-12T01:38:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.027 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-12T01:38:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-12T01:38:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-12T01:38:44.028 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-12T01:38:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-12T01:38:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.029 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.031 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.031 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-12T01:38:44.031 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.031 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.031 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.031 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.031 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-12T01:38:44.031 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.031 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.031 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.031 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.032 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-12T01:38:44.032 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.032 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.032 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.032 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.032 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-12T01:38:44.032 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.032 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.032 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.033 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.033 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-12T01:38:44.033 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.033 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.033 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.033 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.033 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-12T01:38:44.033 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.033 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.033 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.033 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.033 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-12T01:38:44.033 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.034 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.034 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.034 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.034 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-12T01:38:44.034 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.034 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.034 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.034 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.034 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-12T01:38:44.034 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.034 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.034 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.034 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.035 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.036 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.036 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-12T01:38:44.036 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.036 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.036 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.036 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.036 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-12T01:38:44.036 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.036 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.036 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.036 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.036 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-12T01:38:44.036 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.037 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.037 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.037 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.037 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-12T01:38:44.037 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.037 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.037 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.037 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.037 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-12T01:38:44.037 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.037 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.037 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.037 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.038 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:38:44.038 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:38:44.038 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-12T01:38:44.038 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.038 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.038 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.038 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:44.038 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.038 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-12T01:38:44.038 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-12T01:38:44.038 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 4, 2024-09-12T01:38:44.038 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 3, 2024-09-12T01:38:44.039 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 3, 2024-09-12T01:38:44.039 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-12T01:38:44.039 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-12T01:38:44.039 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-12T01:38:44.039 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 4412, 2024-09-12T01:38:44.039 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-12T01:38:44.039 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.039 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-12T01:38:44.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:38:44.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-12T01:38:44.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:38:44.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:38:44.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:38:44.040 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:38:44.040 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:38:44.040 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:38:44.040 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:38:44.040 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:38:44.040 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:38:44.040 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:38:44.040 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:38:44.040 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:38:44.040 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:38:44.040 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-12T01:38:44.040 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:38:44.040 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-12T01:38:44.041 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:38:44.041 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:38:44.041 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:38:44.041 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:38:44.041 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:38:44.041 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:38:44.041 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:38:44.041 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-12T01:38:44.041 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:38:44.041 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:38:44.041 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:38:44.041 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 189393, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 51, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:38:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 8128, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 179, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 8512, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 13, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-12T01:38:44.043 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.044 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-12T01:38:44.044 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-12T01:38:44.044 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-12T01:38:44.044 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 2137, 2024-09-12T01:38:44.044 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 21, 2024-09-12T01:38:44.044 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 3, 2024-09-12T01:38:44.044 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 2137, 2024-09-12T01:38:44.044 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-12T01:38:44.044 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2137, 2024-09-12T01:38:44.044 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 1.143975150, 2024-09-12T01:38:44.044 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000535318 2024-09-12T01:38:44.044 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.044 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-12T01:38:44.045 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-12T01:38:44.045 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2137, 2024-09-12T01:38:44.045 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 2138 2024-09-12T01:38:44.045 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.045 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 2137, 2024-09-12T01:38:44.045 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 2137, 2024-09-12T01:38:44.045 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 0, 2024-09-12T01:38:44.045 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-12T01:38:44.045 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-12T01:38:44.045 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 1387, 2024-09-12T01:38:44.045 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 0, 2024-09-12T01:38:44.045 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 748, 2024-09-12T01:38:44.045 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 0, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 0, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 0, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 1, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 0, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-12T01:38:44.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:38:44.047 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-12T01:38:44.047 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-12T01:38:44.047 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-12T01:38:44.047 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:38:44.047 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-12T01:38:44.047 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:38:44.047 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-12T01:38:44.047 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-12T01:38:44.047 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-12T01:38:44.047 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-12T01:38:44.048 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-12T01:38:44.048 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-12T01:38:44.048 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-12T01:38:44.048 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-12T01:38:44.048 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-12T01:38:44.048 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-12T01:38:44.048 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-12T01:38:44.048 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-12T01:38:44.048 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-12T01:38:44.048 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-12T01:38:44.049 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-12T01:38:44.049 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-12T01:38:44.049 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-12T01:38:44.049 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 91, 2024-09-12T01:38:44.049 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-12T01:38:44.049 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 11, 2024-09-12T01:38:44.049 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 5, 2024-09-12T01:38:44.049 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 5, 2024-09-12T01:38:44.049 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-12T01:38:44.049 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-12T01:38:44.049 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 0, 2024-09-12T01:38:44.049 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 2, 2024-09-12T01:38:44.050 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 0 2024-09-12T01:38:44.050 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.050 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-12T01:38:44.050 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 0, 2024-09-12T01:38:44.050 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:38:44.050 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-12T01:38:44.050 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-12T01:38:44.050 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.050 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-12T01:38:44.050 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-12T01:38:44.051 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.051 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-12T01:38:44.051 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-12T01:38:44.051 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:38:44.051 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-12T01:38:44.051 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-12T01:38:44.051 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-12T01:38:44.051 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-12T01:38:44.051 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-12T01:38:44.051 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.052 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:38:44.052 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:44.052 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T01:38:44.052 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:44.052 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 2380, 2024-09-12T01:38:44.052 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 2015596, 2024-09-12T01:38:44.052 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:44.052 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 2380, 2024-09-12T01:38:44.052 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T01:38:44.052 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T01:38:44.052 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 2380, 2024-09-12T01:38:44.052 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 2015596, 2024-09-12T01:38:44.053 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:44.053 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.053 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.053 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.053 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:44.053 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.053 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-12T01:38:44.053 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:44.053 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T01:38:44.053 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:44.054 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:44.054 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:44.054 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:44.054 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:44.054 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 2137, 2024-09-12T01:38:44.054 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 2503, 2024-09-12T01:38:44.054 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 2137, 2024-09-12T01:38:44.054 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 2503, 2024-09-12T01:38:44.055 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:44.055 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.055 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.055 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.055 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:44.055 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.055 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-12T01:38:44.055 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:44.055 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-12T01:38:44.055 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:44.055 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:44.055 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:44.055 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 2137, 2024-09-12T01:38:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 2137, 2024-09-12T01:38:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 2137, 2024-09-12T01:38:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 2137, 2024-09-12T01:38:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.056 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:38:44.057 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:44.057 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T01:38:44.057 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:44.057 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:44.057 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:44.057 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:44.057 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:44.057 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T01:38:44.057 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T01:38:44.057 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T01:38:44.057 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T01:38:44.057 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:44.057 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x562d73a7ab40": { 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T01:38:44.058 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T01:38:44.059 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T01:38:44.059 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T01:38:44.059 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:44.059 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:44.059 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:44.059 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:44.059 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:44.059 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:44.059 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T01:38:44.060 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:43 smithi100 ceph-mon[35275]: pgmap v330: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:44.795 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-12T01:38:45.442 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-12T01:38:45.443 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-12T01:38:45.443 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-12T01:38:45.443 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-12T01:38:45.443 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:38:45.443 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:38:45.443 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T01:38:45.443 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T01:38:45.695 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:38:45.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:45 smithi189 ceph-mon[35357]: pgmap v331: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:45.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:45 smithi081 ceph-mon[30920]: pgmap v331: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:46.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:45 smithi100 ceph-mon[35275]: pgmap v331: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:46.218 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T01:38:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:38:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 636, 2024-09-12T01:38:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 709, 2024-09-12T01:38:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 198669, 2024-09-12T01:38:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 166317, 2024-09-12T01:38:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 10, 2024-09-12T01:38:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 4, 2024-09-12T01:38:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.072111444, 2024-09-12T01:38:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.027707864, 2024-09-12T01:38:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.036761591, 2024-09-12T01:38:46.219 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.005121241, 2024-09-12T01:38:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 709, 2024-09-12T01:38:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.051763331, 2024-09-12T01:38:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000073008 2024-09-12T01:38:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1278, 2024-09-12T01:38:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000306225, 2024-09-12T01:38:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000239 2024-09-12T01:38:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:38:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:38:46.220 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:38:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 341, 2024-09-12T01:38:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 321, 2024-09-12T01:38:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1670502, 2024-09-12T01:38:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 259239, 2024-09-12T01:38:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 15, 2024-09-12T01:38:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 4, 2024-09-12T01:38:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.053286569, 2024-09-12T01:38:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.018160574, 2024-09-12T01:38:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.051463341, 2024-09-12T01:38:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000329493, 2024-09-12T01:38:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:46.221 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 320, 2024-09-12T01:38:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.027105192, 2024-09-12T01:38:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000084703 2024-09-12T01:38:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 106, 2024-09-12T01:38:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000081018, 2024-09-12T01:38:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000764 2024-09-12T01:38:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 1645472, 2024-09-12T01:38:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 134672 2024-09-12T01:38:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:38:46.222 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 46, 2024-09-12T01:38:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 204, 2024-09-12T01:38:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 10545, 2024-09-12T01:38:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 794607, 2024-09-12T01:38:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 39, 2024-09-12T01:38:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 7, 2024-09-12T01:38:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.025565068, 2024-09-12T01:38:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.007812143, 2024-09-12T01:38:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.014711676, 2024-09-12T01:38:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000194025, 2024-09-12T01:38:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 200, 2024-09-12T01:38:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.026546882, 2024-09-12T01:38:46.223 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000132734 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 36, 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000003042, 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000084 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 4272, 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 444368 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.224 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-12T01:38:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T01:38:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T01:38:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 37, 2024-09-12T01:38:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.002173918, 2024-09-12T01:38:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000058754 2024-09-12T01:38:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-12T01:38:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T01:38:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T01:38:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2, 2024-09-12T01:38:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000014413, 2024-09-12T01:38:46.225 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000007206 2024-09-12T01:38:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-12T01:38:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-12T01:38:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-12T01:38:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-12T01:38:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-12T01:38:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-12T01:38:46.226 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 11, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 16, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 0, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 16, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 13, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 4, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 3, 2024-09-12T01:38:46.227 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 17, 2024-09-12T01:38:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 10, 2024-09-12T01:38:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-12T01:38:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 7, 2024-09-12T01:38:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:38:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-12T01:38:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-12T01:38:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-12T01:38:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-12T01:38:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-12T01:38:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-12T01:38:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-12T01:38:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-12T01:38:46.228 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 4, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 234, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 6, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-12T01:38:46.229 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 19, 2024-09-12T01:38:46.230 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 13, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 12, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-12T01:38:46.231 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 2, 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 11, 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 4, 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-12T01:38:46.232 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 4, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 2, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4195426, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 0, 2024-09-12T01:38:46.233 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3, 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.005290453, 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001763484 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 0 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 20, 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 22, 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 2, 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 19, 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 23, 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 4, 2024-09-12T01:38:46.234 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 16, 2024-09-12T01:38:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 20, 2024-09-12T01:38:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 4, 2024-09-12T01:38:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-12T01:38:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-12T01:38:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-12T01:38:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 49744, 2024-09-12T01:38:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 223520 2024-09-12T01:38:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-12T01:38:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-12T01:38:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-12T01:38:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-12T01:38:46.235 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 4, 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.236 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-12T01:38:46.237 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-12T01:38:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-12T01:38:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.238 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.239 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-12T01:38:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.240 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-12T01:38:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-12T01:38:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.241 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.242 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-12T01:38:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-12T01:38:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-12T01:38:46.243 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-12T01:38:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-12T01:38:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.244 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-12T01:38:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-12T01:38:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-12T01:38:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.245 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-12T01:38:46.246 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.247 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 0, 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 1, 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 1, 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 0, 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 86, 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.248 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:38:46.249 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:38:46.250 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 262391, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 88, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-12T01:38:46.251 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-12T01:38:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:38:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-12T01:38:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:38:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-12T01:38:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 8128, 2024-09-12T01:38:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 179, 2024-09-12T01:38:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:38:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:38:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-12T01:38:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-12T01:38:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 82621, 2024-09-12T01:38:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 328, 2024-09-12T01:38:46.252 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 39, 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 11424, 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 32, 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 39, 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 39, 2024-09-12T01:38:46.253 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.211995544, 2024-09-12T01:38:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.005435783 2024-09-12T01:38:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-12T01:38:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-12T01:38:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 39, 2024-09-12T01:38:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 61 2024-09-12T01:38:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 39, 2024-09-12T01:38:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 0, 2024-09-12T01:38:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 39, 2024-09-12T01:38:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-12T01:38:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-12T01:38:46.254 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 0, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 10, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 0, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 3, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 7, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 6, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 0, 2024-09-12T01:38:46.255 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 20, 2024-09-12T01:38:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:38:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-12T01:38:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:38:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-12T01:38:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-12T01:38:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-12T01:38:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:38:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-12T01:38:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:38:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-12T01:38:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-12T01:38:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-12T01:38:46.256 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-12T01:38:46.257 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 91, 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 11, 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 9, 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 9, 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 14, 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 0, 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 1 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 1, 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:38:46.258 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-12T01:38:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-12T01:38:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-12T01:38:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 13 2024-09-12T01:38:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-12T01:38:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-12T01:38:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:38:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-12T01:38:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-12T01:38:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-12T01:38:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-12T01:38:46.259 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 1019, 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1771085, 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 1019, 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 1019, 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1771085, 2024-09-12T01:38:46.260 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:46.261 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 39, 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 11424, 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 39, 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 11424, 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:46.262 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 39, 2024-09-12T01:38:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 39, 2024-09-12T01:38:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 39, 2024-09-12T01:38:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 39, 2024-09-12T01:38:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:46.263 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:46.264 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x555a85892960": { 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 4, 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1122, 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 4, 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T01:38:46.265 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T01:38:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3, 2024-09-12T01:38:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1122, 2024-09-12T01:38:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:46.266 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:46.266 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T01:38:47.035 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-12T01:38:47.035 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-12T01:38:47.035 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-12T01:38:47.035 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=19 2024-09-12T01:38:47.035 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-12T01:38:47.035 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:38:47.035 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:38:47.035 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T01:38:47.035 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T01:38:47.281 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:38:47.778 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-12T01:38:47.778 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:38:47.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 578, 2024-09-12T01:38:47.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 651, 2024-09-12T01:38:47.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 180999, 2024-09-12T01:38:47.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 243498, 2024-09-12T01:38:47.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 10, 2024-09-12T01:38:47.778 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 4, 2024-09-12T01:38:47.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.066947996, 2024-09-12T01:38:47.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.025283913, 2024-09-12T01:38:47.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.033504227, 2024-09-12T01:38:47.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.004732250, 2024-09-12T01:38:47.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:47.779 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 649, 2024-09-12T01:38:47.779 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.039552427, 2024-09-12T01:38:47.779 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000060943 2024-09-12T01:38:47.779 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.779 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:47.779 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1174, 2024-09-12T01:38:47.779 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000265477, 2024-09-12T01:38:47.780 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000226 2024-09-12T01:38:47.780 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:38:47.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:38:47.780 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.780 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:38:47.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 63, 2024-09-12T01:38:47.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 239, 2024-09-12T01:38:47.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 13542, 2024-09-12T01:38:47.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 898026, 2024-09-12T01:38:47.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 49, 2024-09-12T01:38:47.780 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 7, 2024-09-12T01:38:47.781 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.030472028, 2024-09-12T01:38:47.781 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.008577273, 2024-09-12T01:38:47.781 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.018335073, 2024-09-12T01:38:47.781 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000897771, 2024-09-12T01:38:47.781 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:47.781 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 235, 2024-09-12T01:38:47.781 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.030905868, 2024-09-12T01:38:47.781 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000131514 2024-09-12T01:38:47.781 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.781 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:47.782 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 74, 2024-09-12T01:38:47.782 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000009968, 2024-09-12T01:38:47.782 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000134 2024-09-12T01:38:47.782 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 5840, 2024-09-12T01:38:47.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 448608 2024-09-12T01:38:47.782 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.782 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:38:47.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 390, 2024-09-12T01:38:47.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 373, 2024-09-12T01:38:47.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1672713, 2024-09-12T01:38:47.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 188035, 2024-09-12T01:38:47.782 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 7, 2024-09-12T01:38:47.783 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 5, 2024-09-12T01:38:47.783 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.058159270, 2024-09-12T01:38:47.783 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.020483866, 2024-09-12T01:38:47.783 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.051624538, 2024-09-12T01:38:47.783 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000505649, 2024-09-12T01:38:47.783 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:38:47.783 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 374, 2024-09-12T01:38:47.783 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.041247612, 2024-09-12T01:38:47.783 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000110287 2024-09-12T01:38:47.783 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.784 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:38:47.784 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 189, 2024-09-12T01:38:47.784 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000048743, 2024-09-12T01:38:47.784 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000257 2024-09-12T01:38:47.784 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.784 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 1626032, 2024-09-12T01:38:47.784 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 138496 2024-09-12T01:38:47.784 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.784 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-12T01:38:47.784 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-12T01:38:47.784 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-12T01:38:47.784 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.785 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-12T01:38:47.785 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T01:38:47.785 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T01:38:47.785 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 49, 2024-09-12T01:38:47.785 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.002084075, 2024-09-12T01:38:47.785 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000042532 2024-09-12T01:38:47.785 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:47.785 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.785 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-12T01:38:47.785 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-12T01:38:47.786 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-12T01:38:47.786 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2, 2024-09-12T01:38:47.786 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000006791, 2024-09-12T01:38:47.786 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000003395 2024-09-12T01:38:47.786 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:47.786 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.786 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-12T01:38:47.786 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-12T01:38:47.786 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-12T01:38:47.786 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-12T01:38:47.786 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.786 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.786 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.787 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.787 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-12T01:38:47.787 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-12T01:38:47.787 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-12T01:38:47.787 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-12T01:38:47.787 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 11, 2024-09-12T01:38:47.787 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-12T01:38:47.787 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-12T01:38:47.787 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 16, 2024-09-12T01:38:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 0, 2024-09-12T01:38:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 16, 2024-09-12T01:38:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-12T01:38:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 13, 2024-09-12T01:38:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 4, 2024-09-12T01:38:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-12T01:38:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-12T01:38:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 3, 2024-09-12T01:38:47.788 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 17, 2024-09-12T01:38:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 10, 2024-09-12T01:38:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-12T01:38:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 7, 2024-09-12T01:38:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:38:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-12T01:38:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-12T01:38:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-12T01:38:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-12T01:38:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-12T01:38:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-12T01:38:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-12T01:38:47.789 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-12T01:38:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-12T01:38:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:38:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-12T01:38:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 4, 2024-09-12T01:38:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 234, 2024-09-12T01:38:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 6, 2024-09-12T01:38:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:38:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-12T01:38:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:38:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:38:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:38:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:38:47.790 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-12T01:38:47.791 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-12T01:38:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 19, 2024-09-12T01:38:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 13, 2024-09-12T01:38:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 12, 2024-09-12T01:38:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-12T01:38:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-12T01:38:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-12T01:38:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:38:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-12T01:38:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-12T01:38:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-12T01:38:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-12T01:38:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-12T01:38:47.792 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 2, 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 11, 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-12T01:38:47.793 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-12T01:38:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 5, 2024-09-12T01:38:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-12T01:38:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-12T01:38:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 5, 2024-09-12T01:38:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-12T01:38:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-12T01:38:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 2, 2024-09-12T01:38:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-12T01:38:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-12T01:38:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-12T01:38:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-12T01:38:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-12T01:38:47.794 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-12T01:38:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-12T01:38:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4195819, 2024-09-12T01:38:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 0, 2024-09-12T01:38:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-12T01:38:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 4, 2024-09-12T01:38:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.007502414, 2024-09-12T01:38:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001875603 2024-09-12T01:38:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 0 2024-09-12T01:38:47.795 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-12T01:38:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 20, 2024-09-12T01:38:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 22, 2024-09-12T01:38:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 2, 2024-09-12T01:38:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 19, 2024-09-12T01:38:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 23, 2024-09-12T01:38:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 4, 2024-09-12T01:38:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 16, 2024-09-12T01:38:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 20, 2024-09-12T01:38:47.796 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 4, 2024-09-12T01:38:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-12T01:38:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-12T01:38:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-12T01:38:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 53060, 2024-09-12T01:38:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 223520 2024-09-12T01:38:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-12T01:38:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-12T01:38:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-12T01:38:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-12T01:38:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 12, 2024-09-12T01:38:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-12T01:38:47.797 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-12T01:38:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-12T01:38:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-12T01:38:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.798 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.799 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-12T01:38:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-12T01:38:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.800 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-12T01:38:47.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.801 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.801 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.801 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-12T01:38:47.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.801 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.801 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.801 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-12T01:38:47.801 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.801 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.802 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.802 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.802 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-12T01:38:47.802 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.803 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.803 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.803 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.803 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-12T01:38:47.803 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.804 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.804 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.804 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.804 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-12T01:38:47.804 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.804 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.804 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.804 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.804 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-12T01:38:47.804 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.805 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.805 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.805 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.805 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-12T01:38:47.805 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.805 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.805 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.805 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.805 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-12T01:38:47.806 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.806 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.806 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.806 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.806 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-12T01:38:47.806 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.806 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.806 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.806 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.806 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-12T01:38:47.806 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.806 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.806 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.807 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.807 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-12T01:38:47.807 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.807 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.807 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.807 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.807 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-12T01:38:47.807 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.807 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.807 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.807 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.807 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-12T01:38:47.807 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.808 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.808 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.808 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.808 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-12T01:38:47.808 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.808 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.808 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.808 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.808 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-12T01:38:47.808 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.808 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.808 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.808 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.809 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-12T01:38:47.809 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.809 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.809 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.809 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.809 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-12T01:38:47.809 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.809 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.809 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.809 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.809 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-12T01:38:47.809 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.809 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.810 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.810 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.810 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-12T01:38:47.810 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.810 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.810 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.810 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.810 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-12T01:38:47.810 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.810 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.810 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.811 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.811 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:38:47.811 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:38:47.811 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-12T01:38:47.811 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.811 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.811 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.811 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:47.811 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.811 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-12T01:38:47.811 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-12T01:38:47.811 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 2, 2024-09-12T01:38:47.811 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 1, 2024-09-12T01:38:47.812 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 1, 2024-09-12T01:38:47.812 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-12T01:38:47.812 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-12T01:38:47.812 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-12T01:38:47.812 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 583, 2024-09-12T01:38:47.812 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-12T01:38:47.812 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.812 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-12T01:38:47.812 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:38:47.812 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-12T01:38:47.812 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:38:47.812 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:38:47.812 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:38:47.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:38:47.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:38:47.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:38:47.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:38:47.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:38:47.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:38:47.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:38:47.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:38:47.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:38:47.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:38:47.813 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-12T01:38:47.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:38:47.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-12T01:38:47.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:38:47.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:38:47.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:38:47.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:38:47.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:38:47.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:38:47.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:38:47.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-12T01:38:47.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:38:47.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:38:47.814 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:38:47.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-12T01:38:47.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-12T01:38:47.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-12T01:38:47.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:38:47.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:38:47.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:38:47.815 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:38:47.815 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 254583, 2024-09-12T01:38:47.815 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 89, 2024-09-12T01:38:47.815 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:38:47.816 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-12T01:38:47.816 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-12T01:38:47.816 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-12T01:38:47.816 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:38:47.816 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-12T01:38:47.816 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:38:47.816 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-12T01:38:47.816 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 8128, 2024-09-12T01:38:47.816 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 179, 2024-09-12T01:38:47.816 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:38:47.816 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:38:47.816 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-12T01:38:47.816 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-12T01:38:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 81781, 2024-09-12T01:38:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 326, 2024-09-12T01:38:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-12T01:38:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-12T01:38:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-12T01:38:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-12T01:38:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-12T01:38:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-12T01:38:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-12T01:38:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 41, 2024-09-12T01:38:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 11907, 2024-09-12T01:38:47.817 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 33, 2024-09-12T01:38:47.818 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 41, 2024-09-12T01:38:47.818 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-12T01:38:47.818 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 41, 2024-09-12T01:38:47.818 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 4.167911452, 2024-09-12T01:38:47.818 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.101656376 2024-09-12T01:38:47.818 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.818 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-12T01:38:47.818 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-12T01:38:47.818 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 41, 2024-09-12T01:38:47.818 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 63 2024-09-12T01:38:47.818 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.818 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 41, 2024-09-12T01:38:47.818 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 0, 2024-09-12T01:38:47.819 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 41, 2024-09-12T01:38:47.819 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-12T01:38:47.819 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-12T01:38:47.819 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 0, 2024-09-12T01:38:47.819 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 10, 2024-09-12T01:38:47.819 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 0, 2024-09-12T01:38:47.819 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 4, 2024-09-12T01:38:47.819 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 8, 2024-09-12T01:38:47.819 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-12T01:38:47.819 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-12T01:38:47.820 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-12T01:38:47.820 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-12T01:38:47.820 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 6, 2024-09-12T01:38:47.820 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-12T01:38:47.820 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-12T01:38:47.820 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-12T01:38:47.820 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 0, 2024-09-12T01:38:47.820 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 20, 2024-09-12T01:38:47.820 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:38:47.820 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-12T01:38:47.820 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:38:47.820 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-12T01:38:47.820 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-12T01:38:47.821 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-12T01:38:47.821 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:38:47.821 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-12T01:38:47.821 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:38:47.821 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-12T01:38:47.821 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-12T01:38:47.821 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-12T01:38:47.821 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-12T01:38:47.821 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-12T01:38:47.821 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-12T01:38:47.821 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-12T01:38:47.821 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-12T01:38:47.821 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-12T01:38:47.822 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-12T01:38:47.822 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-12T01:38:47.822 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-12T01:38:47.822 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-12T01:38:47.822 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-12T01:38:47.823 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-12T01:38:47.823 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-12T01:38:47.823 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-12T01:38:47.823 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 91, 2024-09-12T01:38:47.823 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-12T01:38:47.823 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 10, 2024-09-12T01:38:47.823 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 9, 2024-09-12T01:38:47.823 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 9, 2024-09-12T01:38:47.823 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-12T01:38:47.824 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-12T01:38:47.824 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 14, 2024-09-12T01:38:47.824 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 0, 2024-09-12T01:38:47.824 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 1 2024-09-12T01:38:47.824 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.824 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-12T01:38:47.824 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 1, 2024-09-12T01:38:47.824 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:38:47.825 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-12T01:38:47.825 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-12T01:38:47.825 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.825 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-12T01:38:47.825 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 13 2024-09-12T01:38:47.825 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.825 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-12T01:38:47.825 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-12T01:38:47.825 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:38:47.825 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-12T01:38:47.826 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-12T01:38:47.826 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-12T01:38:47.826 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-12T01:38:47.826 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-12T01:38:47.826 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.826 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:38:47.826 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:47.826 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T01:38:47.826 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:47.826 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 1027, 2024-09-12T01:38:47.827 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1757520, 2024-09-12T01:38:47.827 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:47.827 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 1027, 2024-09-12T01:38:47.827 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T01:38:47.827 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T01:38:47.827 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 1027, 2024-09-12T01:38:47.827 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1757520, 2024-09-12T01:38:47.827 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:47.827 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-12T01:38:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-12T01:38:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 41, 2024-09-12T01:38:47.829 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 11907, 2024-09-12T01:38:47.829 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 41, 2024-09-12T01:38:47.829 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 11907, 2024-09-12T01:38:47.829 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:47.829 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.829 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.829 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.829 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:47.829 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.829 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-12T01:38:47.829 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:47.829 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-12T01:38:47.829 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 41, 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 41, 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 41, 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 41, 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:47.830 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.831 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:38:47.831 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:47.831 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T01:38:47.831 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:47.831 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-12T01:38:47.831 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-12T01:38:47.831 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:47.831 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-12T01:38:47.831 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T01:38:47.831 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T01:38:47.831 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-12T01:38:47.831 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-12T01:38:47.831 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:47.832 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.832 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.832 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.832 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:47.832 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-12T01:38:47.832 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x555fc3fac960": { 2024-09-12T01:38:47.832 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-12T01:38:47.832 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-12T01:38:47.832 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-12T01:38:47.832 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 5, 2024-09-12T01:38:47.832 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1515, 2024-09-12T01:38:47.833 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-12T01:38:47.833 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 5, 2024-09-12T01:38:47.833 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-12T01:38:47.833 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-12T01:38:47.833 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 4, 2024-09-12T01:38:47.833 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1515, 2024-09-12T01:38:47.833 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-12T01:38:47.833 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-12T01:38:47.834 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-12T01:38:47.834 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-12T01:38:47.834 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:47.834 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-12T01:38:47.834 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-12T01:38:47.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:47 smithi081 ceph-mon[30920]: pgmap v332: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:48.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:47 smithi100 ceph-mon[35275]: pgmap v332: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:48.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:47 smithi189 ceph-mon[35357]: pgmap v332: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:48.776 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-12T01:38:48.776 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-12T01:38:48.776 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-12T01:38:48.776 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=19 2024-09-12T01:38:48.776 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=6 2024-09-12T01:38:48.776 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-12T01:38:48.776 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T01:38:48.776 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T01:38:48.787 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T01:38:48.787 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:38:48.787 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:48.808 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T01:38:48.808 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:48.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T01:38:49.169 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:49.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.591+0000 7f597a95f640 1 -- 172.21.15.81:0/3314967565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5974101de0 msgr2=0x7f59741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.591+0000 7f597a95f640 1 --2- 172.21.15.81:0/3314967565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5974101de0 0x7f59741021c0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f5964009900 tx=0x7f596402a410 comp rx=0 tx=0).stop 2024-09-12T01:38:49.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.591+0000 7f597a95f640 1 -- 172.21.15.81:0/3314967565 shutdown_connections 2024-09-12T01:38:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.591+0000 7f597a95f640 1 --2- 172.21.15.81:0/3314967565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5974106f10 0x7f597410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.591+0000 7f597a95f640 1 --2- 172.21.15.81:0/3314967565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5974102790 0x7f59741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.591+0000 7f597a95f640 1 --2- 172.21.15.81:0/3314967565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5974101de0 0x7f59741021c0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.591+0000 7f597a95f640 1 -- 172.21.15.81:0/3314967565 >> 172.21.15.81:0/3314967565 conn(0x7f59740fd8c0 msgr2=0x7f59740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.591+0000 7f597a95f640 1 -- 172.21.15.81:0/3314967565 shutdown_connections 2024-09-12T01:38:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.591+0000 7f597a95f640 1 -- 172.21.15.81:0/3314967565 wait complete. 2024-09-12T01:38:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.592+0000 7f597a95f640 1 Processor -- start 2024-09-12T01:38:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.592+0000 7f597a95f640 1 -- start start 2024-09-12T01:38:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.592+0000 7f597a95f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5974101de0 0x7f5974198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.592+0000 7f597a95f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5974102790 0x7f5974198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.592+0000 7f597a95f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5974106f10 0x7f597419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.592+0000 7f597a95f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5974111f70 con 0x7f5974102790 2024-09-12T01:38:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.592+0000 7f597a95f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5974111df0 con 0x7f5974106f10 2024-09-12T01:38:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.592+0000 7f597a95f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f59741120f0 con 0x7f5974101de0 2024-09-12T01:38:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.592+0000 7f59737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5974102790 0x7f5974198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f59737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5974102790 0x7f5974198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45190/0 (socket says 172.21.15.81:45190) 2024-09-12T01:38:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f59737fe640 1 -- 172.21.15.81:0/3760445276 learned_addr learned my addr 172.21.15.81:0/3760445276 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f5973fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5974101de0 0x7f5974198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f5978efc640 1 --2- 172.21.15.81:0/3760445276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5974106f10 0x7f597419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f59737fe640 1 -- 172.21.15.81:0/3760445276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5974101de0 msgr2=0x7f5974198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f59737fe640 1 --2- 172.21.15.81:0/3760445276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5974101de0 0x7f5974198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f59737fe640 1 -- 172.21.15.81:0/3760445276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5974106f10 msgr2=0x7f597419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f59737fe640 1 --2- 172.21.15.81:0/3760445276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5974106f10 0x7f597419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f59737fe640 1 -- 172.21.15.81:0/3760445276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597419d3c0 con 0x7f5974102790 2024-09-12T01:38:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f59737fe640 1 --2- 172.21.15.81:0/3760445276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5974102790 0x7f5974198950 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f596800d770 tx=0x7f596800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f59717fa640 1 -- 172.21.15.81:0/3760445276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968017070 con 0x7f5974102790 2024-09-12T01:38:49.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f59717fa640 1 -- 172.21.15.81:0/3760445276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5968005500 con 0x7f5974102790 2024-09-12T01:38:49.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f597a95f640 1 -- 172.21.15.81:0/3760445276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f597419d6b0 con 0x7f5974102790 2024-09-12T01:38:49.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f59717fa640 1 -- 172.21.15.81:0/3760445276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968004e00 con 0x7f5974102790 2024-09-12T01:38:49.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.593+0000 7f597a95f640 1 -- 172.21.15.81:0/3760445276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59741a4f90 con 0x7f5974102790 2024-09-12T01:38:49.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.594+0000 7f597a95f640 1 -- 172.21.15.81:0/3760445276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59741021c0 con 0x7f5974102790 2024-09-12T01:38:49.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.596+0000 7f59717fa640 1 -- 172.21.15.81:0/3760445276 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5968004fa0 con 0x7f5974102790 2024-09-12T01:38:49.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.597+0000 7f59717fa640 1 --2- 172.21.15.81:0/3760445276 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f595c0a2d70 0x7f595c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.597+0000 7f59717fa640 1 -- 172.21.15.81:0/3760445276 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f59680cf230 con 0x7f5974102790 2024-09-12T01:38:49.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.597+0000 7f5973fff640 1 --2- 172.21.15.81:0/3760445276 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f595c0a2d70 0x7f595c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.597+0000 7f5973fff640 1 --2- 172.21.15.81:0/3760445276 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f595c0a2d70 0x7f595c0a5230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5964009230 tx=0x7f59640058d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:49.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.600+0000 7f59717fa640 1 -- 172.21.15.81:0/3760445276 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f596809b820 con 0x7f5974102790 2024-09-12T01:38:49.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.781+0000 7f597a95f640 1 -- 172.21.15.81:0/3760445276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5974109b60 con 0x7f5974102790 2024-09-12T01:38:49.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.781+0000 7f59717fa640 1 -- 172.21.15.81:0/3760445276 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v91) ==== 81+0+945 (secure 0 0 0) 0x7f596809fb20 con 0x7f5974102790 2024-09-12T01:38:49.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1193015276 2024-09-13T01:28:03.711343+0000 2024-09-12T01:38:49.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3474474725 2024-09-13T01:28:03.711343+0000 2024-09-12T01:38:49.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/682685112 2024-09-13T01:28:03.711343+0000 2024-09-12T01:38:49.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4219073331 2024-09-13T01:19:00.926419+0000 2024-09-12T01:38:49.781 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2162789959 2024-09-13T01:19:00.926419+0000 2024-09-12T01:38:49.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/1762827469 2024-09-13T01:19:00.926419+0000 2024-09-12T01:38:49.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/1857307616 2024-09-13T01:19:24.346074+0000 2024-09-12T01:38:49.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2577694203 2024-09-13T01:19:00.926419+0000 2024-09-12T01:38:49.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/1857307616 2024-09-13T01:19:24.346074+0000 2024-09-12T01:38:49.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4128337402 2024-09-13T01:19:24.346074+0000 2024-09-12T01:38:49.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2393807982 2024-09-13T01:19:24.346074+0000 2024-09-12T01:38:49.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/1762827469 2024-09-13T01:19:00.926419+0000 2024-09-12T01:38:49.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2591597081 2024-09-13T01:28:03.711343+0000 2024-09-12T01:38:49.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1460332159 2024-09-13T01:19:24.346074+0000 2024-09-12T01:38:49.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2591597081 2024-09-13T01:28:03.711343+0000 2024-09-12T01:38:49.782 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1806419627 2024-09-13T01:28:03.711343+0000 2024-09-12T01:38:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:listed 16 entries 2024-09-12T01:38:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.783+0000 7f597a95f640 1 -- 172.21.15.81:0/3760445276 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f595c0a2d70 msgr2=0x7f595c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.783+0000 7f597a95f640 1 --2- 172.21.15.81:0/3760445276 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f595c0a2d70 0x7f595c0a5230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5964009230 tx=0x7f59640058d0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.783+0000 7f597a95f640 1 -- 172.21.15.81:0/3760445276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5974102790 msgr2=0x7f5974198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.783+0000 7f597a95f640 1 --2- 172.21.15.81:0/3760445276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5974102790 0x7f5974198950 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f596800d770 tx=0x7f596800dc30 comp rx=0 tx=0).stop 2024-09-12T01:38:49.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.783+0000 7f597a95f640 1 -- 172.21.15.81:0/3760445276 shutdown_connections 2024-09-12T01:38:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.783+0000 7f597a95f640 1 --2- 172.21.15.81:0/3760445276 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f595c0a2d70 0x7f595c0a5230 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.783+0000 7f597a95f640 1 --2- 172.21.15.81:0/3760445276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5974106f10 0x7f597419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.783+0000 7f597a95f640 1 --2- 172.21.15.81:0/3760445276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5974102790 0x7f5974198950 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.783+0000 7f597a95f640 1 --2- 172.21.15.81:0/3760445276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5974101de0 0x7f5974198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.783+0000 7f597a95f640 1 -- 172.21.15.81:0/3760445276 >> 172.21.15.81:0/3760445276 conn(0x7f59740fd8c0 msgr2=0x7f59740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.783+0000 7f597a95f640 1 -- 172.21.15.81:0/3760445276 shutdown_connections 2024-09-12T01:38:49.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:49.783+0000 7f597a95f640 1 -- 172.21.15.81:0/3760445276 wait complete. 2024-09-12T01:38:49.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:49 smithi081 ceph-mon[30920]: pgmap v333: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:50.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:49 smithi100 ceph-mon[35275]: pgmap v333: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:50.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:49 smithi189 ceph-mon[35357]: pgmap v333: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:50.520 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:38:50.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:50.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:38:50.565 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T01:38:50.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:50.565 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:38:50.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:50.627 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-12T01:38:50.683 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:38:50.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:50.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:38:50.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:50.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-12T01:38:50.812 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:50 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3760445276' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:38:50.861 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T01:38:50.871 INFO:tasks.cephadm:Teardown begin 2024-09-12T01:38:50.872 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:38:50.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:38:51.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:50 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3760445276' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:38:51.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:50 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3760445276' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:38:51.149 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.584+0000 7f3d94500640 1 -- 172.21.15.81:0/349423989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c100b30 msgr2=0x7f3d8c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.584+0000 7f3d94500640 1 --2- 172.21.15.81:0/349423989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c100b30 0x7f3d8c100f10 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009900 tx=0x7f3d8802a470 comp rx=0 tx=0).stop 2024-09-12T01:38:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.584+0000 7f3d94500640 1 -- 172.21.15.81:0/349423989 shutdown_connections 2024-09-12T01:38:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.584+0000 7f3d94500640 1 --2- 172.21.15.81:0/349423989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d8c105f40 0x7f3d8c1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.584+0000 7f3d94500640 1 --2- 172.21.15.81:0/349423989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d8c101450 0x7f3d8c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:51.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.584+0000 7f3d94500640 1 --2- 172.21.15.81:0/349423989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c100b30 0x7f3d8c100f10 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.584+0000 7f3d94500640 1 -- 172.21.15.81:0/349423989 >> 172.21.15.81:0/349423989 conn(0x7f3d8c0fc7a0 msgr2=0x7f3d8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.584+0000 7f3d94500640 1 -- 172.21.15.81:0/349423989 shutdown_connections 2024-09-12T01:38:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.584+0000 7f3d94500640 1 -- 172.21.15.81:0/349423989 wait complete. 2024-09-12T01:38:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.584+0000 7f3d94500640 1 Processor -- start 2024-09-12T01:38:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.584+0000 7f3d94500640 1 -- start start 2024-09-12T01:38:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.584+0000 7f3d94500640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d8c100b30 0x7f3d8c1a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.584+0000 7f3d94500640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c101450 0x7f3d8c1a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d94500640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d8c105f40 0x7f3d8c19e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d94500640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c118550 con 0x7f3d8c101450 2024-09-12T01:38:51.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d94500640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c1183d0 con 0x7f3d8c100b30 2024-09-12T01:38:51.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d94500640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c1186d0 con 0x7f3d8c105f40 2024-09-12T01:38:51.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d91a9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c101450 0x7f3d8c1a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:51.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d91a9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c101450 0x7f3d8c1a4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45208/0 (socket says 172.21.15.81:45208) 2024-09-12T01:38:51.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d91a9b640 1 -- 172.21.15.81:0/2127234704 learned_addr learned my addr 172.21.15.81:0/2127234704 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:51.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d92a9d640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d8c105f40 0x7f3d8c19e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:51.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d9229c640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d8c100b30 0x7f3d8c1a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:51.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d91a9b640 1 -- 172.21.15.81:0/2127234704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d8c105f40 msgr2=0x7f3d8c19e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:51.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d91a9b640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d8c105f40 0x7f3d8c19e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:51.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d91a9b640 1 -- 172.21.15.81:0/2127234704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d8c100b30 msgr2=0x7f3d8c1a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:51.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d91a9b640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d8c100b30 0x7f3d8c1a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:51.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d91a9b640 1 -- 172.21.15.81:0/2127234704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c19f030 con 0x7f3d8c101450 2024-09-12T01:38:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d91a9b640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c101450 0x7f3d8c1a4c80 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00d740 tx=0x7f3d7c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d837fe640 1 -- 172.21.15.81:0/2127234704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c017070 con 0x7f3d8c101450 2024-09-12T01:38:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d837fe640 1 -- 172.21.15.81:0/2127234704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d7c00de50 con 0x7f3d8c101450 2024-09-12T01:38:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d94500640 1 -- 172.21.15.81:0/2127234704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8c19f320 con 0x7f3d8c101450 2024-09-12T01:38:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d837fe640 1 -- 172.21.15.81:0/2127234704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00f620 con 0x7f3d8c101450 2024-09-12T01:38:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.585+0000 7f3d94500640 1 -- 172.21.15.81:0/2127234704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8c1ab610 con 0x7f3d8c101450 2024-09-12T01:38:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.586+0000 7f3d94500640 1 -- 172.21.15.81:0/2127234704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d8c105920 con 0x7f3d8c101450 2024-09-12T01:38:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.588+0000 7f3d837fe640 1 -- 172.21.15.81:0/2127234704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f3d7c009c30 con 0x7f3d8c101450 2024-09-12T01:38:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.588+0000 7f3d837fe640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3d780a2d70 0x7f3d780a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.588+0000 7f3d9229c640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3d780a2d70 0x7f3d780a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.588+0000 7f3d837fe640 1 -- 172.21.15.81:0/2127234704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f3d7c0cef20 con 0x7f3d8c101450 2024-09-12T01:38:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.589+0000 7f3d9229c640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3d780a2d70 0x7f3d780a5230 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c19fa40 tx=0x7f3d880058d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.591+0000 7f3d837fe640 1 -- 172.21.15.81:0/2127234704 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d7c09b570 con 0x7f3d8c101450 2024-09-12T01:38:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.798+0000 7f3d94500640 1 -- 172.21.15.81:0/2127234704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d8c19fe30 con 0x7f3d8c101450 2024-09-12T01:38:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.799+0000 7f3d837fe640 1 -- 172.21.15.81:0/2127234704 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f3d7c09f870 con 0x7f3d8c101450 2024-09-12T01:38:51.799 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:38:51.799 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:38:51.799 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:38:51.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.801+0000 7f3d94500640 1 -- 172.21.15.81:0/2127234704 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3d780a2d70 msgr2=0x7f3d780a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:51.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.801+0000 7f3d94500640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3d780a2d70 0x7f3d780a5230 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c19fa40 tx=0x7f3d880058d0 comp rx=0 tx=0).stop 2024-09-12T01:38:51.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.801+0000 7f3d94500640 1 -- 172.21.15.81:0/2127234704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c101450 msgr2=0x7f3d8c1a4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:51.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.801+0000 7f3d94500640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c101450 0x7f3d8c1a4c80 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00d740 tx=0x7f3d7c00dc00 comp rx=0 tx=0).stop 2024-09-12T01:38:51.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.801+0000 7f3d94500640 1 -- 172.21.15.81:0/2127234704 shutdown_connections 2024-09-12T01:38:51.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.801+0000 7f3d94500640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f3d780a2d70 0x7f3d780a5230 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:51.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.801+0000 7f3d94500640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d8c105f40 0x7f3d8c19e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:51.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.801+0000 7f3d94500640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c101450 0x7f3d8c1a4c80 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:51.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.801+0000 7f3d94500640 1 --2- 172.21.15.81:0/2127234704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d8c100b30 0x7f3d8c1a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:51.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.801+0000 7f3d94500640 1 -- 172.21.15.81:0/2127234704 >> 172.21.15.81:0/2127234704 conn(0x7f3d8c0fc7a0 msgr2=0x7f3d8c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:51.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.801+0000 7f3d94500640 1 -- 172.21.15.81:0/2127234704 shutdown_connections 2024-09-12T01:38:51.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:51.801+0000 7f3d94500640 1 -- 172.21.15.81:0/2127234704 wait complete. 2024-09-12T01:38:51.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:51 smithi081 ceph-mon[30920]: pgmap v334: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:52.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:51 smithi100 ceph-mon[35275]: pgmap v334: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:52.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:51 smithi189 ceph-mon[35357]: pgmap v334: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T01:38:52.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:38:52.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:52 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/2127234704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:38:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:53.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:52 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/2127234704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:38:53.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:52 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/2127234704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:38:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.207+0000 7f52c2035640 1 -- 172.21.15.81:0/2373864191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52bc106f10 msgr2=0x7f52bc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.207+0000 7f52c2035640 1 --2- 172.21.15.81:0/2373864191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52bc106f10 0x7f52bc10ea90 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009ca0 tx=0x7f52b402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.207+0000 7f52c2035640 1 -- 172.21.15.81:0/2373864191 shutdown_connections 2024-09-12T01:38:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.207+0000 7f52c2035640 1 --2- 172.21.15.81:0/2373864191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52bc106f10 0x7f52bc10ea90 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.207+0000 7f52c2035640 1 --2- 172.21.15.81:0/2373864191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52bc102790 0x7f52bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.207+0000 7f52c2035640 1 --2- 172.21.15.81:0/2373864191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52bc101de0 0x7f52bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.207+0000 7f52c2035640 1 -- 172.21.15.81:0/2373864191 >> 172.21.15.81:0/2373864191 conn(0x7f52bc0fd8c0 msgr2=0x7f52bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.207+0000 7f52c2035640 1 -- 172.21.15.81:0/2373864191 shutdown_connections 2024-09-12T01:38:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.207+0000 7f52c2035640 1 -- 172.21.15.81:0/2373864191 wait complete. 2024-09-12T01:38:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.207+0000 7f52c2035640 1 Processor -- start 2024-09-12T01:38:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52c2035640 1 -- start start 2024-09-12T01:38:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52c2035640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52bc101de0 0x7f52bc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52c2035640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52bc102790 0x7f52bc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52c2035640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52bc106f10 0x7f52bc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52c2035640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc111f70 con 0x7f52bc102790 2024-09-12T01:38:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52c2035640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc111df0 con 0x7f52bc106f10 2024-09-12T01:38:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52c2035640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc1120f0 con 0x7f52bc101de0 2024-09-12T01:38:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52baffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52bc102790 0x7f52bc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52baffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52bc102790 0x7f52bc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53946/0 (socket says 172.21.15.81:53946) 2024-09-12T01:38:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52baffd640 1 -- 172.21.15.81:0/3481051517 learned_addr learned my addr 172.21.15.81:0/3481051517 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52bb7fe640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52bc101de0 0x7f52bc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52bbfff640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52bc106f10 0x7f52bc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52baffd640 1 -- 172.21.15.81:0/3481051517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52bc101de0 msgr2=0x7f52bc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52baffd640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52bc101de0 0x7f52bc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52baffd640 1 -- 172.21.15.81:0/3481051517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52bc106f10 msgr2=0x7f52bc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52baffd640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52bc106f10 0x7f52bc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52baffd640 1 -- 172.21.15.81:0/3481051517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc1a6870 con 0x7f52bc102790 2024-09-12T01:38:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.208+0000 7f52bbfff640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52bc106f10 0x7f52bc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.209+0000 7f52baffd640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52bc102790 0x7f52bc074a30 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00d950 tx=0x7f52ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.209+0000 7f52b8ff9640 1 -- 172.21.15.81:0/3481051517 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac017070 con 0x7f52bc102790 2024-09-12T01:38:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.209+0000 7f52c2035640 1 -- 172.21.15.81:0/3481051517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52bc1a6b60 con 0x7f52bc102790 2024-09-12T01:38:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.209+0000 7f52b8ff9640 1 -- 172.21.15.81:0/3481051517 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52ac009c30 con 0x7f52bc102790 2024-09-12T01:38:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.209+0000 7f52b8ff9640 1 -- 172.21.15.81:0/3481051517 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac00f6b0 con 0x7f52bc102790 2024-09-12T01:38:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.209+0000 7f52c2035640 1 -- 172.21.15.81:0/3481051517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52bc1a70a0 con 0x7f52bc102790 2024-09-12T01:38:53.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.210+0000 7f52c2035640 1 -- 172.21.15.81:0/3481051517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52bc1021c0 con 0x7f52bc102790 2024-09-12T01:38:53.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.211+0000 7f52b8ff9640 1 -- 172.21.15.81:0/3481051517 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f52ac0109d0 con 0x7f52bc102790 2024-09-12T01:38:53.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.212+0000 7f52b8ff9640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f52a80a2cf0 0x7f52a80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:53.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.212+0000 7f52bb7fe640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f52a80a2cf0 0x7f52a80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:53.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.212+0000 7f52b8ff9640 1 -- 172.21.15.81:0/3481051517 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f52ac0cf000 con 0x7f52bc102790 2024-09-12T01:38:53.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.212+0000 7f52bb7fe640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f52a80a2cf0 0x7f52a80a51b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f52a40058c0 tx=0x7f52a400a2d0 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:53.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.215+0000 7f52b8ff9640 1 -- 172.21.15.81:0/3481051517 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52ac009de0 con 0x7f52bc102790 2024-09-12T01:38:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.413+0000 7f52c2035640 1 -- 172.21.15.81:0/3481051517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52bc075a20 con 0x7f52bc102790 2024-09-12T01:38:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.414+0000 7f52b8ff9640 1 -- 172.21.15.81:0/3481051517 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f52ac09bc20 con 0x7f52bc102790 2024-09-12T01:38:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:38:53.414 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"btime":"2024-09-12T01:28:02:434331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/248009752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":248009752},{"type":"v1","addr":"172.21.15.81:6835","nonce":248009752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/530662098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":530662098},{"type":"v1","addr":"172.21.15.81:6837","nonce":530662098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:26:15.004450+0000","modified":"2024-09-12T01:28:02.384135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24448,"mds_2":24446,"mds_3":24401,"mds_4":24391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/1118446149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1118446149},{"type":"v1","addr":"172.21.15.81:6839","nonce":1118446149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/3373717964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":3373717964},{"type":"v1","addr":"172.21.15.81:6841","nonce":3373717964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.189:6833/2998951094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":2998951094},{"type":"v1","addr":"172.21.15.189:6833","nonce":2998951094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6833/2684949307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2684949307},{"type":"v1","addr":"172.21.15.100:6833","nonce":2684949307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/79706687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":79706687},{"type":"v1","addr":"172.21.15.189:6835","nonce":79706687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/3858178529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3858178529},{"type":"v1","addr":"172.21.15.100:6835","nonce":3858178529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/129654641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":129654641},{"type":"v1","addr":"172.21.15.189:6837","nonce":129654641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/2276544763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":2276544763},{"type":"v1","addr":"172.21.15.100:6837","nonce":2276544763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.189:6839/1856874876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":1856874876},{"type":"v1","addr":"172.21.15.189:6839","nonce":1856874876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3435943351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3435943351},{"type":"v1","addr":"172.21.15.100:6839","nonce":3435943351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24391,24401,24446,24448,24473]},"id":1}]} 2024-09-12T01:38:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 28 2024-09-12T01:38:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.416+0000 7f52c2035640 1 -- 172.21.15.81:0/3481051517 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f52a80a2cf0 msgr2=0x7f52a80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.416+0000 7f52c2035640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f52a80a2cf0 0x7f52a80a51b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f52a40058c0 tx=0x7f52a400a2d0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.416+0000 7f52c2035640 1 -- 172.21.15.81:0/3481051517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52bc102790 msgr2=0x7f52bc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.416+0000 7f52c2035640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52bc102790 0x7f52bc074a30 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00d950 tx=0x7f52ac00de10 comp rx=0 tx=0).stop 2024-09-12T01:38:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.416+0000 7f52c2035640 1 -- 172.21.15.81:0/3481051517 shutdown_connections 2024-09-12T01:38:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.416+0000 7f52c2035640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f52a80a2cf0 0x7f52a80a51b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.416+0000 7f52c2035640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52bc106f10 0x7f52bc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.416+0000 7f52c2035640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52bc102790 0x7f52bc074a30 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.416+0000 7f52c2035640 1 --2- 172.21.15.81:0/3481051517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52bc101de0 0x7f52bc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.416+0000 7f52c2035640 1 -- 172.21.15.81:0/3481051517 >> 172.21.15.81:0/3481051517 conn(0x7f52bc0fd8c0 msgr2=0x7f52bc0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.416+0000 7f52c2035640 1 -- 172.21.15.81:0/3481051517 shutdown_connections 2024-09-12T01:38:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:53.416+0000 7f52c2035640 1 -- 172.21.15.81:0/3481051517 wait complete. 2024-09-12T01:38:53.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:53 smithi081 ceph-mon[30920]: pgmap v335: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:53.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:53 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3481051517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:38:54.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:53 smithi100 ceph-mon[35275]: pgmap v335: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:54.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:53 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3481051517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:38:54.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:53 smithi189 ceph-mon[35357]: pgmap v335: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:54.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:53 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3481051517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:38:54.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:38:54.330 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:54.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.810+0000 7f1189ea7640 1 -- 172.21.15.81:0/3404674944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1184102ef0 msgr2=0x7f118410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:54.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.810+0000 7f1189ea7640 1 --2- 172.21.15.81:0/3404674944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1184102ef0 0x7f118410da40 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f117c009ca0 tx=0x7f117c02a950 comp rx=0 tx=0).stop 2024-09-12T01:38:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.810+0000 7f1189ea7640 1 -- 172.21.15.81:0/3404674944 shutdown_connections 2024-09-12T01:38:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.810+0000 7f1189ea7640 1 --2- 172.21.15.81:0/3404674944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1184102ef0 0x7f118410da40 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.810+0000 7f1189ea7640 1 --2- 172.21.15.81:0/3404674944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1184102570 0x7f11841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.810+0000 7f1189ea7640 1 --2- 172.21.15.81:0/3404674944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1184100e20 0x7f1184101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.810+0000 7f1189ea7640 1 -- 172.21.15.81:0/3404674944 >> 172.21.15.81:0/3404674944 conn(0x7f11840fc7d0 msgr2=0x7f11840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.810+0000 7f1189ea7640 1 -- 172.21.15.81:0/3404674944 shutdown_connections 2024-09-12T01:38:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.810+0000 7f1189ea7640 1 -- 172.21.15.81:0/3404674944 wait complete. 2024-09-12T01:38:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.810+0000 7f1189ea7640 1 Processor -- start 2024-09-12T01:38:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.810+0000 7f1189ea7640 1 -- start start 2024-09-12T01:38:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1189ea7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1184100e20 0x7f11841992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1189ea7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1184102570 0x7f1184199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1189ea7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1184102ef0 0x7f11841a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1189ea7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1184110f80 con 0x7f1184102ef0 2024-09-12T01:38:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1189ea7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1184110e00 con 0x7f1184102570 2024-09-12T01:38:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1189ea7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1184111100 con 0x7f1184100e20 2024-09-12T01:38:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1183fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1184102ef0 0x7f11841a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1183fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1184102ef0 0x7f11841a4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53954/0 (socket says 172.21.15.81:53954) 2024-09-12T01:38:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1183fff640 1 -- 172.21.15.81:0/4264116835 learned_addr learned my addr 172.21.15.81:0/4264116835 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f11837fe640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1184100e20 0x7f11841992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1182ffd640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1184102570 0x7f1184199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1183fff640 1 -- 172.21.15.81:0/4264116835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1184100e20 msgr2=0x7f11841992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1183fff640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1184100e20 0x7f11841992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1183fff640 1 -- 172.21.15.81:0/4264116835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1184102570 msgr2=0x7f1184199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1183fff640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1184102570 0x7f1184199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1183fff640 1 -- 172.21.15.81:0/4264116835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11841a4890 con 0x7f1184102ef0 2024-09-12T01:38:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f11837fe640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1184100e20 0x7f11841992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1183fff640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1184102ef0 0x7f11841a4350 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f117c02ae70 tx=0x7f117c02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1180ff9640 1 -- 172.21.15.81:0/4264116835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c034040 con 0x7f1184102ef0 2024-09-12T01:38:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1189ea7640 1 -- 172.21.15.81:0/4264116835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11841a4a60 con 0x7f1184102ef0 2024-09-12T01:38:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1180ff9640 1 -- 172.21.15.81:0/4264116835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117c030920 con 0x7f1184102ef0 2024-09-12T01:38:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.811+0000 7f1180ff9640 1 -- 172.21.15.81:0/4264116835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c045480 con 0x7f1184102ef0 2024-09-12T01:38:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.812+0000 7f1189ea7640 1 -- 172.21.15.81:0/4264116835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11841a4f10 con 0x7f1184102ef0 2024-09-12T01:38:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.813+0000 7f1189ea7640 1 -- 172.21.15.81:0/4264116835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1184101200 con 0x7f1184102ef0 2024-09-12T01:38:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.814+0000 7f1180ff9640 1 -- 172.21.15.81:0/4264116835 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f117c037020 con 0x7f1184102ef0 2024-09-12T01:38:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.814+0000 7f1180ff9640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f116c0a2cf0 0x7f116c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.814+0000 7f11837fe640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f116c0a2cf0 0x7f116c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.815+0000 7f1180ff9640 1 -- 172.21.15.81:0/4264116835 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f117c0f0330 con 0x7f1184102ef0 2024-09-12T01:38:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.815+0000 7f11837fe640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f116c0a2cf0 0x7f116c0a51b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1174009b40 tx=0x7f1174005e50 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.819+0000 7f1180ff9640 1 -- 172.21.15.81:0/4264116835 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f117c0bd060 con 0x7f1184102ef0 2024-09-12T01:38:54.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.986+0000 7f1189ea7640 1 -- 172.21.15.81:0/4264116835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11841a5140 con 0x7f1184102ef0 2024-09-12T01:38:54.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.988+0000 7f1180ff9640 1 -- 172.21.15.81:0/4264116835 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+23181 (secure 0 0 0) 0x7f117c0bc960 con 0x7f1184102ef0 2024-09-12T01:38:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T01:38:54.989 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":91,"fsid":"c1ee9932-70a4-11ef-bcea-c7b262605968","created":"2024-09-12T01:18:28.404285+0000","modified":"2024-09-12T01:38:19.417893+0000","last_up_change":"2024-09-12T01:25:26.326110+0000","last_in_change":"2024-09-12T01:25:02.138698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:21:40.649584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:26:10.753723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:26:13.254837+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":90,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc857dd4-eedc-4c48-89a0-4e69662e8e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6803","nonce":3870994528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6805","nonce":3870994528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6809","nonce":3870994528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3870994528},{"type":"v1","addr":"172.21.15.81:6807","nonce":3870994528}]},"public_addr":"172.21.15.81:6803/3870994528","cluster_addr":"172.21.15.81:6805/3870994528","heartbeat_back_addr":"172.21.15.81:6809/3870994528","heartbeat_front_addr":"172.21.15.81:6807/3870994528","state":["exists","up"]},{"osd":1,"uuid":"04b8111b-d677-4fc8-8285-90683621ccf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6801","nonce":2098299652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6803","nonce":2098299652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6807","nonce":2098299652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2098299652},{"type":"v1","addr":"172.21.15.100:6805","nonce":2098299652}]},"public_addr":"172.21.15.100:6801/2098299652","cluster_addr":"172.21.15.100:6803/2098299652","heartbeat_back_addr":"172.21.15.100:6807/2098299652","heartbeat_front_addr":"172.21.15.100:6805/2098299652","state":["exists","up"]},{"osd":2,"uuid":"763e357e-5a04-45ff-95e8-bc1abfeac056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6801","nonce":1353548110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6803","nonce":1353548110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6807","nonce":1353548110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":1353548110},{"type":"v1","addr":"172.21.15.189:6805","nonce":1353548110}]},"public_addr":"172.21.15.189:6801/1353548110","cluster_addr":"172.21.15.189:6803/1353548110","heartbeat_back_addr":"172.21.15.189:6807/1353548110","heartbeat_front_addr":"172.21.15.189:6805/1353548110","state":["exists","up"]},{"osd":3,"uuid":"99843578-1b9e-4ee0-91f1-ba419d07897e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6811","nonce":1064869637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6813","nonce":1064869637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6817","nonce":1064869637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1064869637},{"type":"v1","addr":"172.21.15.81:6815","nonce":1064869637}]},"public_addr":"172.21.15.81:6811/1064869637","cluster_addr":"172.21.15.81:6813/1064869637","heartbeat_back_addr":"172.21.15.81:6817/1064869637","heartbeat_front_addr":"172.21.15.81:6815/1064869637","state":["exists","up"]},{"osd":4,"uuid":"a5787415-0905-420e-9ce8-eb6902727561","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6809","nonce":1687792282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6811","nonce":1687792282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6815","nonce":1687792282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1687792282},{"type":"v1","addr":"172.21.15.100:6813","nonce":1687792282}]},"public_addr":"172.21.15.100:6809/1687792282","cluster_addr":"172.21.15.100:6811/1687792282","heartbeat_back_addr":"172.21.15.100:6815/1687792282","heartbeat_front_addr":"172.21.15.100:6813/1687792282","state":["exists","up"]},{"osd":5,"uuid":"879548b5-5516-407c-8517-bbdbf356c0e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6809","nonce":823474396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6811","nonce":823474396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6815","nonce":823474396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":823474396},{"type":"v1","addr":"172.21.15.189:6813","nonce":823474396}]},"public_addr":"172.21.15.189:6809/823474396","cluster_addr":"172.21.15.189:6811/823474396","heartbeat_back_addr":"172.21.15.189:6815/823474396","heartbeat_front_addr":"172.21.15.189:6813/823474396","state":["exists","up"]},{"osd":6,"uuid":"b665b97c-a9d3-475f-93f3-8a920cbb37d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6819","nonce":1522854005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6821","nonce":1522854005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6825","nonce":1522854005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1522854005},{"type":"v1","addr":"172.21.15.81:6823","nonce":1522854005}]},"public_addr":"172.21.15.81:6819/1522854005","cluster_addr":"172.21.15.81:6821/1522854005","heartbeat_back_addr":"172.21.15.81:6825/1522854005","heartbeat_front_addr":"172.21.15.81:6823/1522854005","state":["exists","up"]},{"osd":7,"uuid":"46e082c8-d071-471a-8c86-ce5b5700cec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6817","nonce":41478541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6819","nonce":41478541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6823","nonce":41478541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":41478541},{"type":"v1","addr":"172.21.15.100:6821","nonce":41478541}]},"public_addr":"172.21.15.100:6817/41478541","cluster_addr":"172.21.15.100:6819/41478541","heartbeat_back_addr":"172.21.15.100:6823/41478541","heartbeat_front_addr":"172.21.15.100:6821/41478541","state":["exists","up"]},{"osd":8,"uuid":"fb9b93ef-5a33-4ffc-926e-a78c101bbbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6817","nonce":180766860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6819","nonce":180766860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6823","nonce":180766860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":180766860},{"type":"v1","addr":"172.21.15.189:6821","nonce":180766860}]},"public_addr":"172.21.15.189:6817/180766860","cluster_addr":"172.21.15.189:6819/180766860","heartbeat_back_addr":"172.21.15.189:6823/180766860","heartbeat_front_addr":"172.21.15.189:6821/180766860","state":["exists","up"]},{"osd":9,"uuid":"0b7ec1a1-5ab9-4075-acfb-e0d82f018656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6827","nonce":1651232782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6829","nonce":1651232782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6833","nonce":1651232782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1651232782},{"type":"v1","addr":"172.21.15.81:6831","nonce":1651232782}]},"public_addr":"172.21.15.81:6827/1651232782","cluster_addr":"172.21.15.81:6829/1651232782","heartbeat_back_addr":"172.21.15.81:6833/1651232782","heartbeat_front_addr":"172.21.15.81:6831/1651232782","state":["exists","up"]},{"osd":10,"uuid":"996f8d34-fd4e-4bd8-9ae3-4ea274dcc9c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6825","nonce":3295868568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6827","nonce":3295868568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6831","nonce":3295868568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3295868568},{"type":"v1","addr":"172.21.15.100:6829","nonce":3295868568}]},"public_addr":"172.21.15.100:6825/3295868568","cluster_addr":"172.21.15.100:6827/3295868568","heartbeat_back_addr":"172.21.15.100:6831/3295868568","heartbeat_front_addr":"172.21.15.100:6829/3295868568","state":["exists","up"]},{"osd":11,"uuid":"f051e2b2-fc58-489a-ab7c-8c1ff5448553","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6825","nonce":3852230978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6827","nonce":3852230978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6831","nonce":3852230978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3852230978},{"type":"v1","addr":"172.21.15.189:6829","nonce":3852230978}]},"public_addr":"172.21.15.189:6825/3852230978","cluster_addr":"172.21.15.189:6827/3852230978","heartbeat_back_addr":"172.21.15.189:6831/3852230978","heartbeat_front_addr":"172.21.15.189:6829/3852230978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:20:47.371696+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:12.762376+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:21:37.936648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:03.950352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:28.922754+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:22:54.252149+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:18.421479+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:23:43.989505+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:08.789671+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:34.336367+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:24:59.089601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:25:23.761934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/1193015276":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/3474474725":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/682685112":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/4219073331":"2024-09-13T01:19:00.926419+0000","172.21.15.81:0/2162789959":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6800/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6801/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2577694203":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6800/1857307616":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/4128337402":"2024-09-13T01:19:24.346074+0000","172.21.15.81:0/2393807982":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6801/1762827469":"2024-09-13T01:19:00.926419+0000","172.21.15.81:6800/2591597081":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/1460332159":"2024-09-13T01:19:24.346074+0000","172.21.15.81:6801/2591597081":"2024-09-13T01:28:03.711343+0000","172.21.15.81:0/1806419627":"2024-09-13T01:28:03.711343+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:54.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.991+0000 7f1189ea7640 1 -- 172.21.15.81:0/4264116835 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f116c0a2cf0 msgr2=0x7f116c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.991+0000 7f1189ea7640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f116c0a2cf0 0x7f116c0a51b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1174009b40 tx=0x7f1174005e50 comp rx=0 tx=0).stop 2024-09-12T01:38:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.991+0000 7f1189ea7640 1 -- 172.21.15.81:0/4264116835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1184102ef0 msgr2=0x7f11841a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.991+0000 7f1189ea7640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1184102ef0 0x7f11841a4350 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f117c02ae70 tx=0x7f117c02f5d0 comp rx=0 tx=0).stop 2024-09-12T01:38:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.991+0000 7f1189ea7640 1 -- 172.21.15.81:0/4264116835 shutdown_connections 2024-09-12T01:38:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.991+0000 7f1189ea7640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f116c0a2cf0 0x7f116c0a51b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.991+0000 7f1189ea7640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1184102ef0 0x7f11841a4350 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.991+0000 7f1189ea7640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1184102570 0x7f1184199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.991+0000 7f1189ea7640 1 --2- 172.21.15.81:0/4264116835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1184100e20 0x7f11841992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.991+0000 7f1189ea7640 1 -- 172.21.15.81:0/4264116835 >> 172.21.15.81:0/4264116835 conn(0x7f11840fc7d0 msgr2=0x7f1184106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.991+0000 7f1189ea7640 1 -- 172.21.15.81:0/4264116835 shutdown_connections 2024-09-12T01:38:54.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:54.991+0000 7f1189ea7640 1 -- 172.21.15.81:0/4264116835 wait complete. 2024-09-12T01:38:55.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T01:38:55.893 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:55.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:55 smithi081 ceph-mon[30920]: pgmap v336: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:55.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:55 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/4264116835' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:38:56.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:55 smithi100 ceph-mon[35275]: pgmap v336: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:56.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:55 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/4264116835' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:38:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:55 smithi189 ceph-mon[35357]: pgmap v336: 97 pgs: 97 active+clean; 2.0 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:38:56.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:55 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/4264116835' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:38:56.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.326+0000 7f515e778640 1 -- 172.21.15.81:0/1679950438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5158100e10 msgr2=0x7f5158104e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:56.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.326+0000 7f515e778640 1 --2- 172.21.15.81:0/1679950438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5158100e10 0x7f5158104e60 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f5140009900 tx=0x7f514002a410 comp rx=0 tx=0).stop 2024-09-12T01:38:56.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.326+0000 7f515e778640 1 -- 172.21.15.81:0/1679950438 shutdown_connections 2024-09-12T01:38:56.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.326+0000 7f515e778640 1 --2- 172.21.15.81:0/1679950438 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5158105590 0x7f515810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:56.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.326+0000 7f515e778640 1 --2- 172.21.15.81:0/1679950438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5158100e10 0x7f5158104e60 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.326+0000 7f515e778640 1 --2- 172.21.15.81:0/1679950438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5158100460 0x7f5158100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.326+0000 7f515e778640 1 -- 172.21.15.81:0/1679950438 >> 172.21.15.81:0/1679950438 conn(0x7f51580fbee0 msgr2=0x7f51580fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.326+0000 7f515e778640 1 -- 172.21.15.81:0/1679950438 shutdown_connections 2024-09-12T01:38:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.326+0000 7f515e778640 1 -- 172.21.15.81:0/1679950438 wait complete. 2024-09-12T01:38:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f515e778640 1 Processor -- start 2024-09-12T01:38:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f515e778640 1 -- start start 2024-09-12T01:38:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f515e778640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5158100460 0x7f5158198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f515e778640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5158100e10 0x7f51581989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f515e778640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5158105590 0x7f515819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f515e778640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5158110e90 con 0x7f5158100e10 2024-09-12T01:38:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f515e778640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5158110d10 con 0x7f5158105590 2024-09-12T01:38:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f515e778640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5158111010 con 0x7f5158100460 2024-09-12T01:38:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f514ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5158100e10 0x7f51581989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f514ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5158100e10 0x7f51581989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53968/0 (socket says 172.21.15.81:53968) 2024-09-12T01:38:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f514ffff640 1 -- 172.21.15.81:0/3671899035 learned_addr learned my addr 172.21.15.81:0/3671899035 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f5157fff640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5158100460 0x7f5158198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f515cd15640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5158105590 0x7f515819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f514ffff640 1 -- 172.21.15.81:0/3671899035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5158100460 msgr2=0x7f5158198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f514ffff640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5158100460 0x7f5158198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f514ffff640 1 -- 172.21.15.81:0/3671899035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5158105590 msgr2=0x7f515819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f514ffff640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5158105590 0x7f515819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.327+0000 7f514ffff640 1 -- 172.21.15.81:0/3671899035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515819d430 con 0x7f5158100e10 2024-09-12T01:38:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.328+0000 7f514ffff640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5158100e10 0x7f51581989c0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f5140006010 tx=0x7f51400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.328+0000 7f5155ffb640 1 -- 172.21.15.81:0/3671899035 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514003f030 con 0x7f5158100e10 2024-09-12T01:38:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.328+0000 7f5155ffb640 1 -- 172.21.15.81:0/3671899035 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5140003ce0 con 0x7f5158100e10 2024-09-12T01:38:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.328+0000 7f515e778640 1 -- 172.21.15.81:0/3671899035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515819d6c0 con 0x7f5158100e10 2024-09-12T01:38:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.328+0000 7f5155ffb640 1 -- 172.21.15.81:0/3671899035 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140035070 con 0x7f5158100e10 2024-09-12T01:38:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.328+0000 7f515e778640 1 -- 172.21.15.81:0/3671899035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51581a5000 con 0x7f5158100e10 2024-09-12T01:38:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.329+0000 7f515e778640 1 -- 172.21.15.81:0/3671899035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5158100840 con 0x7f5158100e10 2024-09-12T01:38:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.330+0000 7f5155ffb640 1 -- 172.21.15.81:0/3671899035 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5140042030 con 0x7f5158100e10 2024-09-12T01:38:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.331+0000 7f5155ffb640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f51440a2d70 0x7f51440a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.331+0000 7f5157fff640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f51440a2d70 0x7f51440a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.331+0000 7f5155ffb640 1 -- 172.21.15.81:0/3671899035 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8513+0+0 (secure 0 0 0) 0x7f51400efa90 con 0x7f5158100e10 2024-09-12T01:38:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.331+0000 7f5157fff640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f51440a2d70 0x7f51440a5230 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5148005fd0 tx=0x7f5148005850 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.335+0000 7f5155ffb640 1 -- 172.21.15.81:0/3671899035 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51400bc770 con 0x7f5158100e10 2024-09-12T01:38:56.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.535+0000 7f515e778640 1 -- 172.21.15.81:0/3671899035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f51581a5200 con 0x7f5158100e10 2024-09-12T01:38:56.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.537+0000 7f5155ffb640 1 -- 172.21.15.81:0/3671899035 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f51400bc070 con 0x7f5158100e10 2024-09-12T01:38:56.537 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:38:56.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.540+0000 7f515e778640 1 -- 172.21.15.81:0/3671899035 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f51440a2d70 msgr2=0x7f51440a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.540+0000 7f515e778640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f51440a2d70 0x7f51440a5230 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5148005fd0 tx=0x7f5148005850 comp rx=0 tx=0).stop 2024-09-12T01:38:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.540+0000 7f515e778640 1 -- 172.21.15.81:0/3671899035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5158100e10 msgr2=0x7f51581989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.540+0000 7f515e778640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5158100e10 0x7f51581989c0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f5140006010 tx=0x7f51400042f0 comp rx=0 tx=0).stop 2024-09-12T01:38:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.541+0000 7f515e778640 1 -- 172.21.15.81:0/3671899035 shutdown_connections 2024-09-12T01:38:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.541+0000 7f515e778640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f51440a2d70 0x7f51440a5230 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.541+0000 7f515e778640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5158105590 0x7f515819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.541+0000 7f515e778640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5158100e10 0x7f51581989c0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.541+0000 7f515e778640 1 --2- 172.21.15.81:0/3671899035 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5158100460 0x7f5158198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.541+0000 7f515e778640 1 -- 172.21.15.81:0/3671899035 >> 172.21.15.81:0/3671899035 conn(0x7f51580fbee0 msgr2=0x7f51580fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.541+0000 7f515e778640 1 -- 172.21.15.81:0/3671899035 shutdown_connections 2024-09-12T01:38:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:56.541+0000 7f515e778640 1 -- 172.21.15.81:0/3671899035 wait complete. 2024-09-12T01:38:56.579 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a[30915]: 2024-09-12T01:38:56.536+0000 7f76700ba640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:38:56.579 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-a[71922]: ignoring --setuser ceph since I am not root 2024-09-12T01:38:56.579 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-a[71922]: ignoring --setgroup ceph since I am not root 2024-09-12T01:38:56.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3671899035' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T01:38:56.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-mon[30920]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:38:56.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-mon[30920]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:38:56.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/3671899035' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T01:38:56.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-mon[30920]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T01:38:56.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-mon[30920]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T01:38:56.899 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-mds[71926]: -- 172.21.15.81:0/1683348928 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561f04637c20 con 0x561f04615400 2024-09-12T01:38:56.899 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-a[71922]: starting mds.a at 2024-09-12T01:38:56.899 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-g[71507]: ignoring --setuser ceph since I am not root 2024-09-12T01:38:56.899 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-g[71507]: ignoring --setgroup ceph since I am not root 2024-09-12T01:38:56.899 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:38:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-g[71507]: starting mds.g at 2024-09-12T01:38:57.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3671899035' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T01:38:57.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-mon[35275]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:38:57.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-mon[35275]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:38:57.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/3671899035' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T01:38:57.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-mon[35275]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T01:38:57.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-mon[35275]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T01:38:57.020 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-e[65007]: ignoring --setuser ceph since I am not root 2024-09-12T01:38:57.020 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-e[65007]: ignoring --setgroup ceph since I am not root 2024-09-12T01:38:57.020 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-mds[65011]: -- 172.21.15.100:0/2660354666 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5559ad547860 con 0x5559ad524800 2024-09-12T01:38:57.020 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-e[65007]: starting mds.e at 2024-09-12T01:38:57.021 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-h[65308]: ignoring --setuser ceph since I am not root 2024-09-12T01:38:57.021 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-h[65308]: ignoring --setgroup ceph since I am not root 2024-09-12T01:38:57.021 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-mds[65312]: -- 172.21.15.100:0/2065073142 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56261ad47860 con 0x56261ad25000 2024-09-12T01:38:57.021 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-h[65308]: starting mds.h at 2024-09-12T01:38:57.021 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-k[64695]: ignoring --setuser ceph since I am not root 2024-09-12T01:38:57.021 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-k[64695]: ignoring --setgroup ceph since I am not root 2024-09-12T01:38:57.021 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-mds[64699]: -- 172.21.15.100:0/3855558511 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5624fd1d9860 con 0x5624fd1b6800 2024-09-12T01:38:57.022 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-k[64695]: starting mds.k at 2024-09-12T01:38:57.022 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b[65607]: ignoring --setuser ceph since I am not root 2024-09-12T01:38:57.022 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b[65607]: ignoring --setgroup ceph since I am not root 2024-09-12T01:38:57.022 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-mds[65611]: -- 172.21.15.100:0/2165564182 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5581d0472680 con 0x5581d0446800 2024-09-12T01:38:57.022 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-mds[65611]: -- 172.21.15.100:0/2165564182 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581d0469860 con 0x5581d0446800 2024-09-12T01:38:57.022 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:38:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b[65607]: starting mds.b at 2024-09-12T01:38:57.032 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-f[65030]: ignoring --setuser ceph since I am not root 2024-09-12T01:38:57.033 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-f[65030]: ignoring --setgroup ceph since I am not root 2024-09-12T01:38:57.033 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-mds[65034]: -- 172.21.15.189:0/3087379153 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557087a13c20 con 0x5570879f1000 2024-09-12T01:38:57.033 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-f[65030]: starting mds.f at 2024-09-12T01:38:57.033 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-i[65630]: ignoring --setuser ceph since I am not root 2024-09-12T01:38:57.033 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-i[65630]: ignoring --setgroup ceph since I am not root 2024-09-12T01:38:57.033 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-mds[65634]: -- 172.21.15.189:0/2357694487 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e3b931b860 con 0x55e3b92f8800 2024-09-12T01:38:57.033 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-i[65630]: starting mds.i at 2024-09-12T01:38:57.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3671899035' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T01:38:57.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-mon[35357]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:38:57.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-mon[35357]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:38:57.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/3671899035' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T01:38:57.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-mon[35357]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T01:38:57.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-mon[35357]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T01:38:57.035 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-l[64729]: ignoring --setuser ceph since I am not root 2024-09-12T01:38:57.035 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-l[64729]: ignoring --setgroup ceph since I am not root 2024-09-12T01:38:57.035 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-mds[64733]: -- 172.21.15.189:0/2958195953 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ac4ea23860 con 0x55ac4ea00800 2024-09-12T01:38:57.035 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-l[64729]: starting mds.l at 2024-09-12T01:38:57.035 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-c[65332]: ignoring --setuser ceph since I am not root 2024-09-12T01:38:57.035 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-c[65332]: ignoring --setgroup ceph since I am not root 2024-09-12T01:38:57.035 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-mds[65336]: -- 172.21.15.189:0/2175029824 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c615cc7860 con 0x55c615ca5400 2024-09-12T01:38:57.035 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:38:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-c[65332]: starting mds.c at 2024-09-12T01:38:57.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:38:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:57.736 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: pgmap v337: 97 pgs: 97 active+clean; 2.0 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-09-12T01:38:57.736 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.81:6838/1382172406,v1:172.21.15.81:6839/1382172406] up:boot 2024-09-12T01:38:57.736 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.100:6832/3425103478,v1:172.21.15.100:6834/3425103478] up:boot 2024-09-12T01:38:57.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.100:6833/1133833468,v1:172.21.15.100:6835/1133833468] up:boot 2024-09-12T01:38:57.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.81:6840/868802050,v1:172.21.15.81:6841/868802050] up:boot 2024-09-12T01:38:57.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.189:6832/3608868711,v1:172.21.15.189:6834/3608868711] up:boot 2024-09-12T01:38:57.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.189:6833/230128337,v1:172.21.15.189:6835/230128337] up:boot 2024-09-12T01:38:57.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.100:6837/3197015051,v1:172.21.15.100:6838/3197015051] up:boot 2024-09-12T01:38:57.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.100:6836/1325748086,v1:172.21.15.100:6839/1325748086] up:boot 2024-09-12T01:38:57.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.189:6836/1966649211,v1:172.21.15.189:6837/1966649211] up:boot 2024-09-12T01:38:57.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: mds.? [v2:172.21.15.189:6838/4195016212,v1:172.21.15.189:6839/4195016212] up:boot 2024-09-12T01:38:57.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T01:38:57.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:38:57.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:38:57.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:38:57.737 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:38:57.738 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:38:57.738 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:38:57.738 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:38:57.738 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:38:57.802 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: pgmap v337: 97 pgs: 97 active+clean; 2.0 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-09-12T01:38:57.803 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.81:6838/1382172406,v1:172.21.15.81:6839/1382172406] up:boot 2024-09-12T01:38:57.803 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.100:6832/3425103478,v1:172.21.15.100:6834/3425103478] up:boot 2024-09-12T01:38:57.803 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.100:6833/1133833468,v1:172.21.15.100:6835/1133833468] up:boot 2024-09-12T01:38:57.803 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.81:6840/868802050,v1:172.21.15.81:6841/868802050] up:boot 2024-09-12T01:38:57.803 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.189:6832/3608868711,v1:172.21.15.189:6834/3608868711] up:boot 2024-09-12T01:38:57.803 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.189:6833/230128337,v1:172.21.15.189:6835/230128337] up:boot 2024-09-12T01:38:57.803 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.100:6837/3197015051,v1:172.21.15.100:6838/3197015051] up:boot 2024-09-12T01:38:57.803 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.100:6836/1325748086,v1:172.21.15.100:6839/1325748086] up:boot 2024-09-12T01:38:57.803 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.189:6836/1966649211,v1:172.21.15.189:6837/1966649211] up:boot 2024-09-12T01:38:57.803 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: mds.? [v2:172.21.15.189:6838/4195016212,v1:172.21.15.189:6839/4195016212] up:boot 2024-09-12T01:38:57.803 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T01:38:57.803 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:38:57.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:38:57.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:38:57.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:38:57.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:38:57.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:38:57.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:38:57.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:38:57.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:38:57.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:57 smithi081 ceph-mon[30920]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:38:57.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 -- 172.21.15.81:0/3355694468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4101de0 msgr2=0x7f72f41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:57.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 --2- 172.21.15.81:0/3355694468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4101de0 0x7f72f41021c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009ca0 tx=0x7f72e402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:38:57.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 -- 172.21.15.81:0/3355694468 shutdown_connections 2024-09-12T01:38:57.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 --2- 172.21.15.81:0/3355694468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72f4106f10 0x7f72f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:57.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 --2- 172.21.15.81:0/3355694468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72f4102790 0x7f72f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:57.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 --2- 172.21.15.81:0/3355694468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4101de0 0x7f72f41021c0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:57.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 -- 172.21.15.81:0/3355694468 >> 172.21.15.81:0/3355694468 conn(0x7f72f40fd8c0 msgr2=0x7f72f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:57.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 -- 172.21.15.81:0/3355694468 shutdown_connections 2024-09-12T01:38:57.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 -- 172.21.15.81:0/3355694468 wait complete. 2024-09-12T01:38:57.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 Processor -- start 2024-09-12T01:38:57.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 -- start start 2024-09-12T01:38:57.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72f4101de0 0x7f72f41983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:57.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4102790 0x7f72f4198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:57.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72f4106f10 0x7f72f419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:57.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72f4111f70 con 0x7f72f4102790 2024-09-12T01:38:57.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f72f4111df0 con 0x7f72f4106f10 2024-09-12T01:38:57.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72faae4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f72f41120f0 con 0x7f72f4101de0 2024-09-12T01:38:57.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.884+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4102790 0x7f72f4198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:57.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4102790 0x7f72f4198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54018/0 (socket says 172.21.15.81:54018) 2024-09-12T01:38:57.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f3fff640 1 -- 172.21.15.81:0/1318483563 learned_addr learned my addr 172.21.15.81:0/1318483563 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:38:57.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f8880640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72f4101de0 0x7f72f41983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f9081640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72f4106f10 0x7f72f419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f3fff640 1 -- 172.21.15.81:0/1318483563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72f4101de0 msgr2=0x7f72f41983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f3fff640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72f4101de0 0x7f72f41983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f3fff640 1 -- 172.21.15.81:0/1318483563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72f4106f10 msgr2=0x7f72f419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f3fff640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72f4106f10 0x7f72f419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f3fff640 1 -- 172.21.15.81:0/1318483563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f419d380 con 0x7f72f4102790 2024-09-12T01:38:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f9081640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72f4106f10 0x7f72f419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f3fff640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4102790 0x7f72f4198910 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f72e800c920 tx=0x7f72e800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f1ffb640 1 -- 172.21.15.81:0/1318483563 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8007c70 con 0x7f72f4102790 2024-09-12T01:38:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f1ffb640 1 -- 172.21.15.81:0/1318483563 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72e8007e10 con 0x7f72f4102790 2024-09-12T01:38:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72faae4640 1 -- 172.21.15.81:0/1318483563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f419d670 con 0x7f72f4102790 2024-09-12T01:38:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72f1ffb640 1 -- 172.21.15.81:0/1318483563 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8018890 con 0x7f72f4102790 2024-09-12T01:38:57.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.885+0000 7f72faae4640 1 -- 172.21.15.81:0/1318483563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f41a4f50 con 0x7f72f4102790 2024-09-12T01:38:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.886+0000 7f72faae4640 1 -- 172.21.15.81:0/1318483563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f41021c0 con 0x7f72f4102790 2024-09-12T01:38:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.887+0000 7f72f1ffb640 1 -- 172.21.15.81:0/1318483563 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f72e8018a70 con 0x7f72f4102790 2024-09-12T01:38:57.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.888+0000 7f72f1ffb640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f72dc0a2cf0 0x7f72dc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:57.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.888+0000 7f72f8880640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f72dc0a2cf0 0x7f72dc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:57.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.888+0000 7f72f1ffb640 1 -- 172.21.15.81:0/1318483563 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8899+0+0 (secure 0 0 0) 0x7f72e80cf720 con 0x7f72f4102790 2024-09-12T01:38:57.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.889+0000 7f72f8880640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f72dc0a2cf0 0x7f72dc0a51b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72e4006010 tx=0x7f72e4009900 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:57.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:57.892+0000 7f72f1ffb640 1 -- 172.21.15.81:0/1318483563 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72e8014030 con 0x7f72f4102790 2024-09-12T01:38:58.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:38:58.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:57 smithi100 ceph-mon[35275]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:38:58.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: pgmap v337: 97 pgs: 97 active+clean; 2.0 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-09-12T01:38:58.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.81:6838/1382172406,v1:172.21.15.81:6839/1382172406] up:boot 2024-09-12T01:38:58.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.100:6832/3425103478,v1:172.21.15.100:6834/3425103478] up:boot 2024-09-12T01:38:58.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.100:6833/1133833468,v1:172.21.15.100:6835/1133833468] up:boot 2024-09-12T01:38:58.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.81:6840/868802050,v1:172.21.15.81:6841/868802050] up:boot 2024-09-12T01:38:58.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.189:6832/3608868711,v1:172.21.15.189:6834/3608868711] up:boot 2024-09-12T01:38:58.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.189:6833/230128337,v1:172.21.15.189:6835/230128337] up:boot 2024-09-12T01:38:58.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.100:6837/3197015051,v1:172.21.15.100:6838/3197015051] up:boot 2024-09-12T01:38:58.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.100:6836/1325748086,v1:172.21.15.100:6839/1325748086] up:boot 2024-09-12T01:38:58.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.189:6836/1966649211,v1:172.21.15.189:6837/1966649211] up:boot 2024-09-12T01:38:58.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: mds.? [v2:172.21.15.189:6838/4195016212,v1:172.21.15.189:6839/4195016212] up:boot 2024-09-12T01:38:58.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T01:38:58.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:38:58.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:38:58.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:38:58.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:38:58.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:38:58.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:38:58.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:38:58.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:38:58.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:38:58.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:57 smithi189 ceph-mon[35357]: from='mgr.15222 172.21.15.81:0/3114230192' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:38:58.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.094+0000 7f72faae4640 1 -- 172.21.15.81:0/1318483563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f72f410a0f0 con 0x7f72f4102790 2024-09-12T01:38:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.741+0000 7f72f1ffb640 1 -- 172.21.15.81:0/1318483563 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7f72e809c1c0 con 0x7f72f4102790 2024-09-12T01:38:58.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.744+0000 7f72faae4640 1 -- 172.21.15.81:0/1318483563 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f72dc0a2cf0 msgr2=0x7f72dc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:58.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.744+0000 7f72faae4640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f72dc0a2cf0 0x7f72dc0a51b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72e4006010 tx=0x7f72e4009900 comp rx=0 tx=0).stop 2024-09-12T01:38:58.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.744+0000 7f72faae4640 1 -- 172.21.15.81:0/1318483563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4102790 msgr2=0x7f72f4198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:58.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.744+0000 7f72faae4640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4102790 0x7f72f4198910 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f72e800c920 tx=0x7f72e800cde0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.744+0000 7f72faae4640 1 -- 172.21.15.81:0/1318483563 shutdown_connections 2024-09-12T01:38:58.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.744+0000 7f72faae4640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f72dc0a2cf0 0x7f72dc0a51b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.744+0000 7f72faae4640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72f4106f10 0x7f72f419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.744+0000 7f72faae4640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f4102790 0x7f72f4198910 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.744+0000 7f72faae4640 1 --2- 172.21.15.81:0/1318483563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f72f4101de0 0x7f72f41983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.744+0000 7f72faae4640 1 -- 172.21.15.81:0/1318483563 >> 172.21.15.81:0/1318483563 conn(0x7f72f40fd8c0 msgr2=0x7f72f40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:58.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.744+0000 7f72faae4640 1 -- 172.21.15.81:0/1318483563 shutdown_connections 2024-09-12T01:38:58.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:38:58.744+0000 7f72faae4640 1 -- 172.21.15.81:0/1318483563 wait complete. 2024-09-12T01:38:59.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:58 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1318483563' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:38:59.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:58 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1318483563' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:38:59.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:58 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1318483563' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:38:59.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:38:59.613 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:38:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:59 smithi081 ceph-mon[30920]: pgmap v339: 97 pgs: 97 active+clean; 2.0 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-12T01:38:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:59 smithi081 ceph-mon[30920]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:38:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:59 smithi081 ceph-mon[30920]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:38:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:59 smithi081 ceph-mon[30920]: Cluster is now healthy 2024-09-12T01:38:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:59 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1318483563' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:38:59.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:38:59 smithi081 ceph-mon[30920]: fsmap 12 up:standby 2024-09-12T01:39:00.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:59 smithi100 ceph-mon[35275]: pgmap v339: 97 pgs: 97 active+clean; 2.0 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-12T01:39:00.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:59 smithi100 ceph-mon[35275]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:39:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:59 smithi100 ceph-mon[35275]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:39:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:59 smithi100 ceph-mon[35275]: Cluster is now healthy 2024-09-12T01:39:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:59 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1318483563' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:39:00.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:38:59 smithi100 ceph-mon[35275]: fsmap 12 up:standby 2024-09-12T01:39:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:59 smithi189 ceph-mon[35357]: pgmap v339: 97 pgs: 97 active+clean; 2.0 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-12T01:39:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:59 smithi189 ceph-mon[35357]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:39:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:59 smithi189 ceph-mon[35357]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:39:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:59 smithi189 ceph-mon[35357]: Cluster is now healthy 2024-09-12T01:39:00.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:59 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1318483563' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:39:00.033 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:38:59 smithi189 ceph-mon[35357]: fsmap 12 up:standby 2024-09-12T01:39:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.094+0000 7f28a4cf6640 1 -- 172.21.15.81:0/2614906084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a010c2f0 msgr2=0x7f28a010e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.094+0000 7f28a4cf6640 1 --2- 172.21.15.81:0/2614906084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a010c2f0 0x7f28a010e790 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f2898009900 tx=0x7f289802a410 comp rx=0 tx=0).stop 2024-09-12T01:39:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.094+0000 7f28a4cf6640 1 -- 172.21.15.81:0/2614906084 shutdown_connections 2024-09-12T01:39:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.094+0000 7f28a4cf6640 1 --2- 172.21.15.81:0/2614906084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a010c2f0 0x7f28a010e790 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.094+0000 7f28a4cf6640 1 --2- 172.21.15.81:0/2614906084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a01037a0 0x7f28a010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.094+0000 7f28a4cf6640 1 --2- 172.21.15.81:0/2614906084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28a0102df0 0x7f28a01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.094+0000 7f28a4cf6640 1 -- 172.21.15.81:0/2614906084 >> 172.21.15.81:0/2614906084 conn(0x7f28a00fc7d0 msgr2=0x7f28a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.094+0000 7f28a4cf6640 1 -- 172.21.15.81:0/2614906084 shutdown_connections 2024-09-12T01:39:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.094+0000 7f28a4cf6640 1 -- 172.21.15.81:0/2614906084 wait complete. 2024-09-12T01:39:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.094+0000 7f28a4cf6640 1 Processor -- start 2024-09-12T01:39:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f28a4cf6640 1 -- start start 2024-09-12T01:39:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f28a4cf6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a0102df0 0x7f28a0100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f28a4cf6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28a01037a0 0x7f28a0100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f28a4cf6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a010c2f0 0x7f28a01014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f28a4cf6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0112110 con 0x7f28a010c2f0 2024-09-12T01:39:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f28a4cf6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0111f90 con 0x7f28a0102df0 2024-09-12T01:39:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f28a4cf6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0112290 con 0x7f28a01037a0 2024-09-12T01:39:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f289ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a010c2f0 0x7f28a01014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f289ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a010c2f0 0x7f28a01014d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54022/0 (socket says 172.21.15.81:54022) 2024-09-12T01:39:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f289ed9d640 1 -- 172.21.15.81:0/1287120057 learned_addr learned my addr 172.21.15.81:0/1287120057 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:39:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f289e59c640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a0102df0 0x7f28a0100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f289dd9b640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28a01037a0 0x7f28a0100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f289ed9d640 1 -- 172.21.15.81:0/1287120057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28a01037a0 msgr2=0x7f28a0100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f289ed9d640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28a01037a0 0x7f28a0100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f289ed9d640 1 -- 172.21.15.81:0/1287120057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a0102df0 msgr2=0x7f28a0100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f289ed9d640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a0102df0 0x7f28a0100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f289ed9d640 1 -- 172.21.15.81:0/1287120057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a01a6a50 con 0x7f28a010c2f0 2024-09-12T01:39:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.095+0000 7f289dd9b640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28a01037a0 0x7f28a0100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.096+0000 7f289ed9d640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a010c2f0 0x7f28a01014d0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f2898005ab0 tx=0x7f28980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.096+0000 7f288f7fe640 1 -- 172.21.15.81:0/1287120057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289803f030 con 0x7f28a010c2f0 2024-09-12T01:39:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.096+0000 7f288f7fe640 1 -- 172.21.15.81:0/1287120057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2898003ce0 con 0x7f28a010c2f0 2024-09-12T01:39:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.096+0000 7f28a4cf6640 1 -- 172.21.15.81:0/1287120057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a01a6ce0 con 0x7f28a010c2f0 2024-09-12T01:39:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.096+0000 7f288f7fe640 1 -- 172.21.15.81:0/1287120057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2898035070 con 0x7f28a010c2f0 2024-09-12T01:39:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.096+0000 7f28a4cf6640 1 -- 172.21.15.81:0/1287120057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a01a7210 con 0x7f28a010c2f0 2024-09-12T01:39:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.097+0000 7f28a4cf6640 1 -- 172.21.15.81:0/1287120057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a01031d0 con 0x7f28a010c2f0 2024-09-12T01:39:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.098+0000 7f288f7fe640 1 -- 172.21.15.81:0/1287120057 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f2898042030 con 0x7f28a010c2f0 2024-09-12T01:39:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.099+0000 7f288f7fe640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f28880a2d70 0x7f28880a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.099+0000 7f289e59c640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f28880a2d70 0x7f28880a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.099+0000 7f288f7fe640 1 -- 172.21.15.81:0/1287120057 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8899+0+0 (secure 0 0 0) 0x7f28980effa0 con 0x7f28a010c2f0 2024-09-12T01:39:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.099+0000 7f289e59c640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f28880a2d70 0x7f28880a5230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2890005fd0 tx=0x7f2890009680 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:00.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.102+0000 7f288f7fe640 1 -- 172.21.15.81:0/1287120057 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f28980bca40 con 0x7f28a010c2f0 2024-09-12T01:39:00.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.268+0000 7f28a4cf6640 1 -- 172.21.15.81:0/1287120057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f28a01072c0 con 0x7f28a010c2f0 2024-09-12T01:39:00.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.752+0000 7f288f7fe640 1 -- 172.21.15.81:0/1287120057 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) ==== 181+0+0 (secure 0 0 0) 0x7f28980bc340 con 0x7f28a010c2f0 2024-09-12T01:39:00.752 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:39:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.754+0000 7f28a4cf6640 1 -- 172.21.15.81:0/1287120057 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f28880a2d70 msgr2=0x7f28880a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.754+0000 7f28a4cf6640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f28880a2d70 0x7f28880a5230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2890005fd0 tx=0x7f2890009680 comp rx=0 tx=0).stop 2024-09-12T01:39:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.754+0000 7f28a4cf6640 1 -- 172.21.15.81:0/1287120057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a010c2f0 msgr2=0x7f28a01014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.754+0000 7f28a4cf6640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a010c2f0 0x7f28a01014d0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f2898005ab0 tx=0x7f28980042f0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.754+0000 7f28a4cf6640 1 -- 172.21.15.81:0/1287120057 shutdown_connections 2024-09-12T01:39:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.754+0000 7f28a4cf6640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f28880a2d70 0x7f28880a5230 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.754+0000 7f28a4cf6640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a010c2f0 0x7f28a01014d0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.754+0000 7f28a4cf6640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28a01037a0 0x7f28a0100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.754+0000 7f28a4cf6640 1 --2- 172.21.15.81:0/1287120057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a0102df0 0x7f28a0100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.754+0000 7f28a4cf6640 1 -- 172.21.15.81:0/1287120057 >> 172.21.15.81:0/1287120057 conn(0x7f28a00fc7d0 msgr2=0x7f28a00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:00.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.754+0000 7f28a4cf6640 1 -- 172.21.15.81:0/1287120057 shutdown_connections 2024-09-12T01:39:00.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:00.754+0000 7f28a4cf6640 1 -- 172.21.15.81:0/1287120057 wait complete. 2024-09-12T01:39:01.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:00 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1287120057' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:39:01.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:00 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1287120057' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:39:01.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:00 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1287120057' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:39:01.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:39:01.870 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:39:01.988 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:01 smithi081 ceph-mon[30920]: pgmap v340: 97 pgs: 97 active+clean; 2.0 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 716 B/s wr, 7 op/s 2024-09-12T01:39:01.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:01 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/1287120057' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:39:01.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:01 smithi081 ceph-mon[30920]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T01:39:02.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:01 smithi100 ceph-mon[35275]: pgmap v340: 97 pgs: 97 active+clean; 2.0 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 716 B/s wr, 7 op/s 2024-09-12T01:39:02.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:01 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/1287120057' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:39:02.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:01 smithi100 ceph-mon[35275]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T01:39:02.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:01 smithi189 ceph-mon[35357]: pgmap v340: 97 pgs: 97 active+clean; 2.0 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 716 B/s wr, 7 op/s 2024-09-12T01:39:02.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:01 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/1287120057' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:39:02.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:01 smithi189 ceph-mon[35357]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T01:39:02.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.328+0000 7f82027f9640 1 -- 172.21.15.81:0/2331403275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc100ca0 msgr2=0x7f81fc106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:02.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.328+0000 7f82027f9640 1 --2- 172.21.15.81:0/2331403275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc100ca0 0x7f81fc106840 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009930 tx=0x7f81f002a420 comp rx=0 tx=0).stop 2024-09-12T01:39:02.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.328+0000 7f82027f9640 1 -- 172.21.15.81:0/2331403275 shutdown_connections 2024-09-12T01:39:02.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.328+0000 7f82027f9640 1 --2- 172.21.15.81:0/2331403275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81fc106f50 0x7f81fc10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.328+0000 7f82027f9640 1 --2- 172.21.15.81:0/2331403275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc100ca0 0x7f81fc106840 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.328+0000 7f82027f9640 1 --2- 172.21.15.81:0/2331403275 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81fc1002f0 0x7f81fc1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.328+0000 7f82027f9640 1 -- 172.21.15.81:0/2331403275 >> 172.21.15.81:0/2331403275 conn(0x7f81fc077210 msgr2=0x7f81fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:02.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.328+0000 7f82027f9640 1 -- 172.21.15.81:0/2331403275 shutdown_connections 2024-09-12T01:39:02.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.328+0000 7f82027f9640 1 -- 172.21.15.81:0/2331403275 wait complete. 2024-09-12T01:39:02.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.329+0000 7f82027f9640 1 Processor -- start 2024-09-12T01:39:02.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.329+0000 7f82027f9640 1 -- start start 2024-09-12T01:39:02.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.329+0000 7f82027f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc1002f0 0x7f81fc101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:02.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.329+0000 7f82027f9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81fc100ca0 0x7f81fc1017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:02.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.329+0000 7f82027f9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81fc106f50 0x7f81fc101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:02.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.329+0000 7f82027f9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc111f60 con 0x7f81fc1002f0 2024-09-12T01:39:02.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.329+0000 7f82027f9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc111de0 con 0x7f81fc106f50 2024-09-12T01:39:02.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.329+0000 7f82027f9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc1120e0 con 0x7f81fc100ca0 2024-09-12T01:39:02.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.329+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc1002f0 0x7f81fc101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:02.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.329+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc1002f0 0x7f81fc101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46728/0 (socket says 172.21.15.81:46728) 2024-09-12T01:39:02.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.329+0000 7f81fbfff640 1 -- 172.21.15.81:0/547595950 learned_addr learned my addr 172.21.15.81:0/547595950 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T01:39:02.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f8200d96640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81fc106f50 0x7f81fc101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:02.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f81fb7fe640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81fc100ca0 0x7f81fc1017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:02.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f81fbfff640 1 -- 172.21.15.81:0/547595950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81fc100ca0 msgr2=0x7f81fc1017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:02.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f81fbfff640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81fc100ca0 0x7f81fc1017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f81fbfff640 1 -- 172.21.15.81:0/547595950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81fc106f50 msgr2=0x7f81fc101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:02.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f81fbfff640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81fc106f50 0x7f81fc101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f81fbfff640 1 -- 172.21.15.81:0/547595950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc1a6970 con 0x7f81fc1002f0 2024-09-12T01:39:02.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f81fb7fe640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81fc100ca0 0x7f81fc1017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:02.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f81fbfff640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc1002f0 0x7f81fc101270 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00d950 tx=0x7f81ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:02.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f81f97fa640 1 -- 172.21.15.81:0/547595950 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec017070 con 0x7f81fc1002f0 2024-09-12T01:39:02.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f81f97fa640 1 -- 172.21.15.81:0/547595950 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81ec009c30 con 0x7f81fc1002f0 2024-09-12T01:39:02.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f82027f9640 1 -- 172.21.15.81:0/547595950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81fc1a6c60 con 0x7f81fc1002f0 2024-09-12T01:39:02.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f81f97fa640 1 -- 172.21.15.81:0/547595950 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec00f6b0 con 0x7f81fc1002f0 2024-09-12T01:39:02.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.330+0000 7f82027f9640 1 -- 172.21.15.81:0/547595950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81fc1a71a0 con 0x7f81fc1002f0 2024-09-12T01:39:02.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.331+0000 7f82027f9640 1 -- 172.21.15.81:0/547595950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81fc1006d0 con 0x7f81fc1002f0 2024-09-12T01:39:02.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.333+0000 7f81f97fa640 1 -- 172.21.15.81:0/547595950 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f81ec0109d0 con 0x7f81fc1002f0 2024-09-12T01:39:02.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.334+0000 7f81f97fa640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f81e40a2cf0 0x7f81e40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:02.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.334+0000 7f81fb7fe640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f81e40a2cf0 0x7f81e40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:02.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.334+0000 7f81f97fa640 1 -- 172.21.15.81:0/547595950 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8345+0+0 (secure 0 0 0) 0x7f81ec0cf070 con 0x7f81fc1002f0 2024-09-12T01:39:02.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.334+0000 7f81fb7fe640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f81e40a2cf0 0x7f81e40a51b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f81f0000c00 tx=0x7f81f0032c70 comp rx=0 tx=0).ready entity=mgr.15222 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:02.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.337+0000 7f81f97fa640 1 -- 172.21.15.81:0/547595950 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f81ec009de0 con 0x7f81fc1002f0 2024-09-12T01:39:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.504+0000 7f82027f9640 1 -- 172.21.15.81:0/547595950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f81fc1027a0 con 0x7f81fc1002f0 2024-09-12T01:39:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.763+0000 7f81f97fa640 1 -- 172.21.15.81:0/547595950 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) ==== 169+0+0 (secure 0 0 0) 0x7f81ec097030 con 0x7f81fc1002f0 2024-09-12T01:39:02.763 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:02 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/547595950' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:39:02.763 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-12T01:39:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.765+0000 7f82027f9640 1 -- 172.21.15.81:0/547595950 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f81e40a2cf0 msgr2=0x7f81e40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.765+0000 7f82027f9640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f81e40a2cf0 0x7f81e40a51b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f81f0000c00 tx=0x7f81f0032c70 comp rx=0 tx=0).stop 2024-09-12T01:39:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.765+0000 7f82027f9640 1 -- 172.21.15.81:0/547595950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc1002f0 msgr2=0x7f81fc101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.765+0000 7f82027f9640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc1002f0 0x7f81fc101270 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00d950 tx=0x7f81ec00de10 comp rx=0 tx=0).stop 2024-09-12T01:39:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.765+0000 7f82027f9640 1 -- 172.21.15.81:0/547595950 shutdown_connections 2024-09-12T01:39:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.765+0000 7f82027f9640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.81:6800/1379528564,v1:172.21.15.81:6801/1379528564] conn(0x7f81e40a2cf0 0x7f81e40a51b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.765+0000 7f82027f9640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81fc106f50 0x7f81fc101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.765+0000 7f82027f9640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81fc100ca0 0x7f81fc1017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.765+0000 7f82027f9640 1 --2- 172.21.15.81:0/547595950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81fc1002f0 0x7f81fc101270 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.765+0000 7f82027f9640 1 -- 172.21.15.81:0/547595950 >> 172.21.15.81:0/547595950 conn(0x7f81fc077210 msgr2=0x7f81fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:02.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.765+0000 7f82027f9640 1 -- 172.21.15.81:0/547595950 shutdown_connections 2024-09-12T01:39:02.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T01:39:02.765+0000 7f82027f9640 1 -- 172.21.15.81:0/547595950 wait complete. 2024-09-12T01:39:03.018 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:02 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/547595950' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:39:03.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:02 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/547595950' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:39:03.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:39:03.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:39:03.529 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:39:03.561 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T01:39:03.562 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:39:03.578 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:39:03.600 DEBUG:teuthology.orchestra.run.smithi189:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:39:03.619 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T01:39:03.619 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T01:39:03.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.a 2024-09-12T01:39:03.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:03 smithi081 systemd[1]: Stopping Ceph mon.a for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:39:04.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:03 smithi100 ceph-mon[35275]: pgmap v342: 65 pgs: 65 active+clean; 577 KiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:39:04.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:03 smithi100 ceph-mon[35275]: from='client.? 172.21.15.81:0/547595950' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:39:04.019 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:03 smithi100 ceph-mon[35275]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T01:39:04.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:03 smithi189 ceph-mon[35357]: pgmap v342: 65 pgs: 65 active+clean; 577 KiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:39:04.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:03 smithi189 ceph-mon[35357]: from='client.? 172.21.15.81:0/547595950' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:39:04.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:03 smithi189 ceph-mon[35357]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T01:39:04.160 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:03 smithi081 ceph-mon[30920]: pgmap v342: 65 pgs: 65 active+clean; 577 KiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:39:04.160 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:03 smithi081 ceph-mon[30920]: from='client.? 172.21.15.81:0/547595950' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:39:04.160 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:03 smithi081 ceph-mon[30920]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T01:39:04.160 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a[30915]: 2024-09-12T01:39:03.895+0000 7f76758c5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:39:04.160 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a[30915]: 2024-09-12T01:39:03.895+0000 7f76758c5640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T01:39:04.436 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:04 smithi081 podman[110319]: 2024-09-12 01:39:04.161214442 +0000 UTC m=+0.357181572 container died 19c5878e9e2ac72fc952f633078363712621ec6dd71452c00f07ead6bf4af9b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:39:04.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:04 smithi081 podman[110319]: 2024-09-12 01:39:04.536775546 +0000 UTC m=+0.732742682 container cleanup 19c5878e9e2ac72fc952f633078363712621ec6dd71452c00f07ead6bf4af9b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:39:04.738 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 01:39:04 smithi081 bash[110319]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-a 2024-09-12T01:39:04.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T01:39:04.962 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:39:04.962 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T01:39:04.962 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T01:39:04.962 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.b 2024-09-12T01:39:05.269 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:05 smithi100 systemd[1]: Stopping Ceph mon.b for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:39:05.542 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:05 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-b[35271]: 2024-09-12T01:39:05.276+0000 7f1b1130c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:39:05.543 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:05 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-b[35271]: 2024-09-12T01:39:05.276+0000 7f1b1130c640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T01:39:05.543 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:05 smithi100 podman[70810]: 2024-09-12 01:39:05.349095781 +0000 UTC m=+0.189281599 container died 0ebf8c15e53571aa76749525b92bf34e3ab6a8d7da7c902f548518cba3614839 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T01:39:05.911 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:05 smithi100 podman[70810]: 2024-09-12 01:39:05.686135206 +0000 UTC m=+0.526321023 container cleanup 0ebf8c15e53571aa76749525b92bf34e3ab6a8d7da7c902f548518cba3614839 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-b, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T01:39:05.911 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 12 01:39:05 smithi100 bash[70810]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-b 2024-09-12T01:39:06.037 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T01:39:06.085 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:39:06.085 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T01:39:06.086 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T01:39:06.086 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.c 2024-09-12T01:39:06.402 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:06 smithi189 systemd[1]: Stopping Ceph mon.c for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:39:06.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:06 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-c[35353]: 2024-09-12T01:39:06.402+0000 7f1381bd0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:39:06.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:06 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-c[35353]: 2024-09-12T01:39:06.402+0000 7f1381bd0640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T01:39:06.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:06 smithi189 podman[71027]: 2024-09-12 01:39:06.423283974 +0000 UTC m=+0.139728615 container died 5934253a917bc2f5ecc54e9aef6d0b8aa14fdcb0eb9a23c09bcb9e4917244082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T01:39:07.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:06 smithi189 podman[71027]: 2024-09-12 01:39:06.794498417 +0000 UTC m=+0.510943047 container cleanup 5934253a917bc2f5ecc54e9aef6d0b8aa14fdcb0eb9a23c09bcb9e4917244082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:39:07.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 12 01:39:06 smithi189 bash[71027]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mon-c 2024-09-12T01:39:07.279 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T01:39:07.343 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:39:07.344 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T01:39:07.344 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T01:39:07.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mgr.x 2024-09-12T01:39:07.662 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:39:07 smithi081 systemd[1]: Stopping Ceph mgr.x for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:39:07.934 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:39:07 smithi081 podman[110442]: 2024-09-12 01:39:07.663351377 +0000 UTC m=+0.127854778 container died d8813b804726d14ddaae6969867eece9166683e427136ef88c445b7937b8ca50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T01:39:08.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:39:08 smithi081 podman[110442]: 2024-09-12 01:39:08.02483562 +0000 UTC m=+0.489339010 container cleanup d8813b804726d14ddaae6969867eece9166683e427136ef88c445b7937b8ca50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T01:39:08.238 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 01:39:08 smithi081 bash[110442]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-x 2024-09-12T01:39:08.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T01:39:08.477 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:39:08.478 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T01:39:08.478 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T01:39:08.478 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mgr.y 2024-09-12T01:39:08.769 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:39:08 smithi100 systemd[1]: Stopping Ceph mgr.y for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:39:09.269 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:39:08 smithi100 podman[70942]: 2024-09-12 01:39:08.810616424 +0000 UTC m=+0.131943862 container died 857d8ffb590f39a11814fe121bd294c02c3c472f1e14bd660146b21ae67d50f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:39:09.657 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:39:09 smithi100 podman[70942]: 2024-09-12 01:39:09.390172688 +0000 UTC m=+0.711500118 container cleanup 857d8ffb590f39a11814fe121bd294c02c3c472f1e14bd660146b21ae67d50f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-12T01:39:09.657 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 12 01:39:09 smithi100 bash[70942]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-y 2024-09-12T01:39:09.815 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T01:39:09.850 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:39:09.850 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T01:39:09.851 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T01:39:09.851 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mgr.z 2024-09-12T01:39:10.178 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:39:09 smithi189 systemd[1]: Stopping Ceph mgr.z for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:39:10.433 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:39:10 smithi189 podman[71160]: 2024-09-12 01:39:10.179154743 +0000 UTC m=+0.129678480 container died 7c617f0adcf85372ae7e3596aa91d9ec432e94c290762d70797f8c860340f895 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:39:10.782 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:39:10 smithi189 podman[71160]: 2024-09-12 01:39:10.550083 +0000 UTC m=+0.500606808 container cleanup 7c617f0adcf85372ae7e3596aa91d9ec432e94c290762d70797f8c860340f895 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T01:39:10.782 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 12 01:39:10 smithi189 bash[71160]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mgr-z 2024-09-12T01:39:10.976 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T01:39:11.012 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:39:11.012 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T01:39:11.013 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T01:39:11.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.0 2024-09-12T01:39:11.488 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:11 smithi081 systemd[1]: Stopping Ceph osd.0 for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:39:11.489 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:11 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0[45200]: 2024-09-12T01:39:11.287+0000 7fd8376cb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:39:11.489 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:11 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0[45200]: 2024-09-12T01:39:11.287+0000 7fd8376cb640 -1 osd.0 94 *** Got signal Terminated *** 2024-09-12T01:39:11.489 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:11 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0[45200]: 2024-09-12T01:39:11.287+0000 7fd8376cb640 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:39:16.936 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:16 smithi081 podman[110562]: 2024-09-12 01:39:16.6079305 +0000 UTC m=+5.408008830 container died 770296514b0dd3e1cec1c3d6915b484f9d5efca48363030ee106ad977655dc39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T01:39:17.196 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:16 smithi081 podman[110562]: 2024-09-12 01:39:16.937534898 +0000 UTC m=+5.737613228 container cleanup 770296514b0dd3e1cec1c3d6915b484f9d5efca48363030ee106ad977655dc39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T01:39:17.196 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:16 smithi081 bash[110562]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0 2024-09-12T01:39:17.488 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:17 smithi081 podman[110577]: 2024-09-12 01:39:17.197002319 +0000 UTC m=+0.583976498 container remove 770296514b0dd3e1cec1c3d6915b484f9d5efca48363030ee106ad977655dc39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T01:39:17.805 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:17 smithi081 podman[110665]: 2024-09-12 01:39:17.458888173 +0000 UTC m=+0.016615102 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:39:17.806 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:17 smithi081 podman[110665]: 2024-09-12 01:39:17.556363835 +0000 UTC m=+0.114090753 container create 07e21f3c3c1359e95fa3024524029be3f0a60b9ef6eae675e9ea04978ac3435e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T01:39:17.806 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:17 smithi081 podman[110665]: 2024-09-12 01:39:17.775976405 +0000 UTC m=+0.333703334 container init 07e21f3c3c1359e95fa3024524029be3f0a60b9ef6eae675e9ea04978ac3435e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T01:39:17.806 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:17 smithi081 podman[110665]: 2024-09-12 01:39:17.77970917 +0000 UTC m=+0.337436091 container start 07e21f3c3c1359e95fa3024524029be3f0a60b9ef6eae675e9ea04978ac3435e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T01:39:18.238 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:17 smithi081 podman[110665]: 2024-09-12 01:39:17.867770212 +0000 UTC m=+0.425497144 container attach 07e21f3c3c1359e95fa3024524029be3f0a60b9ef6eae675e9ea04978ac3435e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:39:18.239 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 01:39:17 smithi081 podman[110665]: 2024-09-12 01:39:17.964992285 +0000 UTC m=+0.522719216 container died 07e21f3c3c1359e95fa3024524029be3f0a60b9ef6eae675e9ea04978ac3435e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:39:18.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T01:39:18.547 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:39:18.547 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T01:39:18.547 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T01:39:18.547 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.1 2024-09-12T01:39:18.869 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:18 smithi100 systemd[1]: Stopping Ceph osd.1 for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:39:19.268 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:18 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1[39769]: 2024-09-12T01:39:18.869+0000 7fa8208fe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:39:19.268 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:18 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1[39769]: 2024-09-12T01:39:18.869+0000 7fa8208fe640 -1 osd.1 94 *** Got signal Terminated *** 2024-09-12T01:39:19.269 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:18 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1[39769]: 2024-09-12T01:39:18.869+0000 7fa8208fe640 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:39:24.634 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:24 smithi100 podman[71070]: 2024-09-12 01:39:24.313171615 +0000 UTC m=+5.564303907 container died dfd5469c3fd11a2164c01b2c38ddc45853d44a995a31a55b297b2bada1cf0096 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T01:39:25.018 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:24 smithi100 podman[71070]: 2024-09-12 01:39:24.635743028 +0000 UTC m=+5.886875320 container cleanup dfd5469c3fd11a2164c01b2c38ddc45853d44a995a31a55b297b2bada1cf0096 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T01:39:25.019 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:24 smithi100 bash[71070]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1 2024-09-12T01:39:25.019 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:24 smithi100 podman[71086]: 2024-09-12 01:39:24.845263706 +0000 UTC m=+0.530793649 container remove dfd5469c3fd11a2164c01b2c38ddc45853d44a995a31a55b297b2bada1cf0096 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T01:39:25.519 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:25 smithi100 podman[71176]: 2024-09-12 01:39:25.164757746 +0000 UTC m=+0.015580746 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:39:25.519 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:25 smithi100 podman[71176]: 2024-09-12 01:39:25.313106216 +0000 UTC m=+0.163929217 container create fd96d3834b10d25dc18d4eebce315f084d06778b4ffcbb87946a94ae46357c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T01:39:26.019 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:25 smithi100 podman[71176]: 2024-09-12 01:39:25.548715847 +0000 UTC m=+0.399538846 container init fd96d3834b10d25dc18d4eebce315f084d06778b4ffcbb87946a94ae46357c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T01:39:26.019 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:25 smithi100 podman[71176]: 2024-09-12 01:39:25.55233831 +0000 UTC m=+0.403161311 container start fd96d3834b10d25dc18d4eebce315f084d06778b4ffcbb87946a94ae46357c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-12T01:39:26.019 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:25 smithi100 podman[71176]: 2024-09-12 01:39:25.640452997 +0000 UTC m=+0.491276014 container attach fd96d3834b10d25dc18d4eebce315f084d06778b4ffcbb87946a94ae46357c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-12T01:39:26.019 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:25 smithi100 podman[71176]: 2024-09-12 01:39:25.740925502 +0000 UTC m=+0.591748504 container died fd96d3834b10d25dc18d4eebce315f084d06778b4ffcbb87946a94ae46357c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T01:39:26.311 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 12 01:39:26 smithi100 podman[71199]: 2024-09-12 01:39:26.310364747 +0000 UTC m=+0.563042001 container remove fd96d3834b10d25dc18d4eebce315f084d06778b4ffcbb87946a94ae46357c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T01:39:26.324 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T01:39:26.364 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:39:26.364 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T01:39:26.364 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T01:39:26.364 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.2 2024-09-12T01:39:26.670 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:26 smithi189 systemd[1]: Stopping Ceph osd.2 for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:39:27.032 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:26 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2[40368]: 2024-09-12T01:39:26.670+0000 7f1305a38640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:39:27.032 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:26 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2[40368]: 2024-09-12T01:39:26.670+0000 7f1305a38640 -1 osd.2 94 *** Got signal Terminated *** 2024-09-12T01:39:27.032 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:26 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2[40368]: 2024-09-12T01:39:26.670+0000 7f1305a38640 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:39:32.533 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:32 smithi189 podman[71285]: 2024-09-12 01:39:32.204398511 +0000 UTC m=+5.639623327 container stop d31fb6e473f70ec22a9d63aff164d1c18b8c47c865dd19d46fed2069d39d3041 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T01:39:32.533 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:32 smithi189 podman[71285]: 2024-09-12 01:39:32.231844073 +0000 UTC m=+5.667068885 container died d31fb6e473f70ec22a9d63aff164d1c18b8c47c865dd19d46fed2069d39d3041 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T01:39:32.837 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:32 smithi189 podman[71285]: 2024-09-12 01:39:32.629086759 +0000 UTC m=+6.064311612 container cleanup d31fb6e473f70ec22a9d63aff164d1c18b8c47c865dd19d46fed2069d39d3041 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-12T01:39:32.837 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:32 smithi189 bash[71285]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2 2024-09-12T01:39:33.246 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:32 smithi189 podman[71302]: 2024-09-12 01:39:32.838398411 +0000 UTC m=+0.625856683 container remove d31fb6e473f70ec22a9d63aff164d1c18b8c47c865dd19d46fed2069d39d3041 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T01:39:33.532 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:33 smithi189 podman[71392]: 2024-09-12 01:39:33.149816794 +0000 UTC m=+0.016428711 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:39:33.532 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:33 smithi189 podman[71392]: 2024-09-12 01:39:33.256180351 +0000 UTC m=+0.122792257 container create 7d838b1893460cd27a64eb340eb4c144cca4cc34ff5544f327c6fb63111565a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T01:39:33.533 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:33 smithi189 podman[71392]: 2024-09-12 01:39:33.49221435 +0000 UTC m=+0.358826262 container init 7d838b1893460cd27a64eb340eb4c144cca4cc34ff5544f327c6fb63111565a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-12T01:39:33.533 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:33 smithi189 podman[71392]: 2024-09-12 01:39:33.495744684 +0000 UTC m=+0.362356599 container start 7d838b1893460cd27a64eb340eb4c144cca4cc34ff5544f327c6fb63111565a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T01:39:34.032 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:33 smithi189 podman[71392]: 2024-09-12 01:39:33.600532128 +0000 UTC m=+0.467144060 container attach 7d838b1893460cd27a64eb340eb4c144cca4cc34ff5544f327c6fb63111565a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T01:39:34.032 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 12 01:39:33 smithi189 podman[71392]: 2024-09-12 01:39:33.694406139 +0000 UTC m=+0.561018061 container died 7d838b1893460cd27a64eb340eb4c144cca4cc34ff5544f327c6fb63111565a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T01:39:34.328 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T01:39:34.370 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:39:34.371 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T01:39:34.371 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T01:39:34.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.3 2024-09-12T01:39:34.738 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:34 smithi081 systemd[1]: Stopping Ceph osd.3 for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:39:35.488 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:34 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3[51660]: 2024-09-12T01:39:34.998+0000 7f80344fd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:39:35.489 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:34 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3[51660]: 2024-09-12T01:39:34.998+0000 7f80344fd640 -1 osd.3 94 *** Got signal Terminated *** 2024-09-12T01:39:35.489 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:34 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3[51660]: 2024-09-12T01:39:34.998+0000 7f80344fd640 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:39:37.032 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:36 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:36.748+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:38.032 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:37 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:37.751+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:39.032 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:38 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:38.712+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:39.032 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:38 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:38.710+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:39.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:38 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:38.853+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:39.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:39 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:39.391+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:40.032 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:39 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:39.697+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:40.032 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:39 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:39.741+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:40.268 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:39 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:39.849+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:40.739 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:40 smithi081 podman[110767]: 2024-09-12 01:39:40.36043811 +0000 UTC m=+5.794091340 container died fb9ae421ae0352412366c88e10972887c46a4a8150dc6a8f32081f7dd527e5dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T01:39:40.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:40 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:40.415+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:41.032 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:40 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:40.730+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:41.033 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:40 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:40.697+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:41.083 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:40 smithi081 podman[110767]: 2024-09-12 01:39:40.815264911 +0000 UTC m=+6.248918140 container cleanup fb9ae421ae0352412366c88e10972887c46a4a8150dc6a8f32081f7dd527e5dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T01:39:41.083 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:40 smithi081 bash[110767]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3 2024-09-12T01:39:41.268 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:40 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:40.833+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:41.416 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:41 smithi081 podman[110783]: 2024-09-12 01:39:41.083443872 +0000 UTC m=+0.721366000 container remove fb9ae421ae0352412366c88e10972887c46a4a8150dc6a8f32081f7dd527e5dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T01:39:41.736 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:41 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:41.445+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:41.736 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:41 smithi081 podman[110872]: 2024-09-12 01:39:41.41756677 +0000 UTC m=+0.099172117 container create a5626fa5768068da46e3e10841399f757f842dd7bd4bc832bfc18d50300c965f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T01:39:41.736 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:41 smithi081 podman[110872]: 2024-09-12 01:39:41.334452182 +0000 UTC m=+0.016057530 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:39:41.736 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:41 smithi081 podman[110872]: 2024-09-12 01:39:41.637049709 +0000 UTC m=+0.318655056 container init a5626fa5768068da46e3e10841399f757f842dd7bd4bc832bfc18d50300c965f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T01:39:41.737 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:41 smithi081 podman[110872]: 2024-09-12 01:39:41.640710033 +0000 UTC m=+0.322315385 container start a5626fa5768068da46e3e10841399f757f842dd7bd4bc832bfc18d50300c965f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T01:39:41.737 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:41 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:41.479+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:41.988 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:41 smithi081 podman[110872]: 2024-09-12 01:39:41.73690136 +0000 UTC m=+0.418506721 container attach a5626fa5768068da46e3e10841399f757f842dd7bd4bc832bfc18d50300c965f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T01:39:41.989 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 01:39:41 smithi081 podman[110872]: 2024-09-12 01:39:41.838502561 +0000 UTC m=+0.520107907 container died a5626fa5768068da46e3e10841399f757f842dd7bd4bc832bfc18d50300c965f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD) 2024-09-12T01:39:42.032 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:41 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:41.692+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:42.033 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:41 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:41.770+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:42.268 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:41 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:41.880+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:42.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T01:39:42.500 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:39:42.500 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T01:39:42.500 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T01:39:42.501 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.4 2024-09-12T01:39:42.738 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:42 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:42.481+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:42.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:42 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:42.474+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:42.811 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:42 smithi100 systemd[1]: Stopping Ceph osd.4 for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:39:43.032 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:42 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:42.725+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:43.033 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:42 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:42.756+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:43.268 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:42 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:42.898+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:43.269 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:42 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4[46251]: 2024-09-12T01:39:42.811+0000 7f887d8fc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:39:43.269 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:42 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4[46251]: 2024-09-12T01:39:42.811+0000 7f887d8fc640 -1 osd.4 94 *** Got signal Terminated *** 2024-09-12T01:39:43.269 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:42 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4[46251]: 2024-09-12T01:39:42.811+0000 7f887d8fc640 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:39:43.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:43 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:43.507+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:43.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:43 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:43.443+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:44.032 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:43 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:43.800+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:44.032 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:43 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:43.703+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:44.270 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:43 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:43.944+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:44.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:44 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:44.537+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:44.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:44 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:44.487+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:45.032 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:44 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:44.705+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:45.033 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:44 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:44.825+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:45.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:44 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:44.972+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:45.532 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:45 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:45.097+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:45.988 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:45 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:45.535+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:45.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:45 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:45.515+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:46.032 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:45 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:45.673+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:46.032 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:45 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:45.837+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:46.033 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:45 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:45.837+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.730278+0000 front 2024-09-12T01:39:19.730375+0000 (oldest deadline 2024-09-12T01:39:45.030361+0000) 2024-09-12T01:39:46.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:46 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:46.002+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:46.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:46 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:46.002+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:46.532 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:46 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:46.052+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:46.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:46 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:46.563+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:46.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:46 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:46.546+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:46.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:46 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:46.546+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:47.012 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:46 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:46.625+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:47.012 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:46 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:46.867+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:47.012 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:46 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:46.867+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.730278+0000 front 2024-09-12T01:39:19.730375+0000 (oldest deadline 2024-09-12T01:39:45.030361+0000) 2024-09-12T01:39:47.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:46 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:46.967+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:47.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:46 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:46.967+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:47.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:47 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:47.012+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:47.987 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:47 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:47.602+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:47.988 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:47 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:47.602+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:39:47.988 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:47 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:47.817+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:47.988 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:47 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:47.817+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.730278+0000 front 2024-09-12T01:39:19.730375+0000 (oldest deadline 2024-09-12T01:39:45.030361+0000) 2024-09-12T01:39:47.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:47 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:47.522+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:47.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:47 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:47.563+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:47.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:47 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:47.563+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:48.269 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:48 smithi100 podman[71292]: 2024-09-12 01:39:48.21355983 +0000 UTC m=+5.517765842 container died 15121556d3ce04249f4e8e6281022f63b102a2fc875e0125f42aa33183cbeb53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T01:39:48.270 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:47 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:47.966+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:39:48.270 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:47 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:47.988+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:48.270 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:47 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:47.988+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:48.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:47 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:47.988+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:48.738 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:48 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:48.599+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:48.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:48 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:48.599+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:48.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:48 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:48.475+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:48.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:48 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:48.475+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:39:48.828 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:48 smithi100 podman[71292]: 2024-09-12 01:39:48.60364475 +0000 UTC m=+5.907850760 container cleanup 15121556d3ce04249f4e8e6281022f63b102a2fc875e0125f42aa33183cbeb53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T01:39:48.829 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:48 smithi100 bash[71292]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4 2024-09-12T01:39:48.859 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:48 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:48.598+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:48.859 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:48 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:48.598+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:39:49.143 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:48 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:48.933+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:39:49.143 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:48 smithi100 podman[71308]: 2024-09-12 01:39:48.829927476 +0000 UTC m=+0.611057633 container remove 15121556d3ce04249f4e8e6281022f63b102a2fc875e0125f42aa33183cbeb53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True) 2024-09-12T01:39:49.144 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:49 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:49.020+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:49.144 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:49 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:49.020+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:49.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:48 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:48.979+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:49.282 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:48 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:48.859+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:49.282 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:48 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:48.859+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.730278+0000 front 2024-09-12T01:39:19.730375+0000 (oldest deadline 2024-09-12T01:39:45.030361+0000) 2024-09-12T01:39:49.481 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:49 smithi100 podman[71399]: 2024-09-12 01:39:49.047227324 +0000 UTC m=+0.015725847 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:39:49.482 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:49 smithi100 podman[71399]: 2024-09-12 01:39:49.155565346 +0000 UTC m=+0.124063864 container create 5473ad8be34ff7aebabb43b8b17ad2f306e2808226c6b4800b01f53ec7af464f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T01:39:49.482 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:49 smithi100 podman[71399]: 2024-09-12 01:39:49.383050935 +0000 UTC m=+0.351549456 container init 5473ad8be34ff7aebabb43b8b17ad2f306e2808226c6b4800b01f53ec7af464f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-12T01:39:49.482 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:49 smithi100 podman[71399]: 2024-09-12 01:39:49.386232809 +0000 UTC m=+0.354731330 container start 5473ad8be34ff7aebabb43b8b17ad2f306e2808226c6b4800b01f53ec7af464f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:39:49.482 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:49 smithi100 podman[71399]: 2024-09-12 01:39:49.482717358 +0000 UTC m=+0.451215889 container attach 5473ad8be34ff7aebabb43b8b17ad2f306e2808226c6b4800b01f53ec7af464f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:39:49.769 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 12 01:39:49 smithi100 podman[71399]: 2024-09-12 01:39:49.575331429 +0000 UTC m=+0.543829947 container died 5473ad8be34ff7aebabb43b8b17ad2f306e2808226c6b4800b01f53ec7af464f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T01:39:49.953 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:49 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:49.862+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:49.953 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:49 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:49.862+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.730278+0000 front 2024-09-12T01:39:19.730375+0000 (oldest deadline 2024-09-12T01:39:45.030361+0000) 2024-09-12T01:39:49.954 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:49 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:49.622+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:49.954 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:49 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:49.622+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:39:49.988 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:49.621+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:49.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:49.621+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:49.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:49.512+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:49.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:49.512+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:39:50.151 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:49 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:49.926+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:39:50.152 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:50 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:50.062+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:50.152 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:50 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:50.062+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:50.175 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T01:39:50.215 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:39:50.215 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T01:39:50.216 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T01:39:50.216 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.5 2024-09-12T01:39:50.245 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:49 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:49.954+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:50.532 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:50 smithi189 systemd[1]: Stopping Ceph osd.5 for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:39:50.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:50 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:50.588+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:50.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:50 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:50.588+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:50.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:50 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:50.471+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:50.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:50 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:50.471+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:39:50.820 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:50 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:50.598+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:50.820 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:50 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:50.598+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:39:50.820 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:50 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:50.564+0000 7f5d0090b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:39:50.820 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:50 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:50.564+0000 7f5d0090b640 -1 osd.5 94 *** Got signal Terminated *** 2024-09-12T01:39:50.821 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:50 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:50.564+0000 7f5d0090b640 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:39:50.821 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:50 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:50.820+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:50.821 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:50 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:50.820+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.730278+0000 front 2024-09-12T01:39:19.730375+0000 (oldest deadline 2024-09-12T01:39:45.030361+0000) 2024-09-12T01:39:51.268 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:50 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:50.890+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:39:51.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:51 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:51.043+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:51.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:51 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:51.043+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:51.294 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:50 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:50.937+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:51.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:51 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:51.627+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:51.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:51 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:51.627+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:51.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:51 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:51.456+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:51.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:51 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:51.456+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:39:51.827 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:51 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:51.554+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:51.827 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:51 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:51.554+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:39:52.269 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:51 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:51.855+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:39:52.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:52 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:52.047+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:52.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:52 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:52.047+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:52.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:51 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:51.919+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:52.282 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:51 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:51.827+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:52.282 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:51 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:51.827+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.730278+0000 front 2024-09-12T01:39:19.730375+0000 (oldest deadline 2024-09-12T01:39:45.030361+0000) 2024-09-12T01:39:52.833 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:52 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:52.567+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:52.833 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:52 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:52.567+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:39:52.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:52 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:52.505+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:52.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:52 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:52.505+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:39:52.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:52 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:52.654+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:52.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:52 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:52.654+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:53.268 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:52 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:52.891+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:39:53.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:53 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:53.000+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:53.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:53 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:53.000+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:53.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:52 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:52.956+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:53.283 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:52 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:52.833+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:53.283 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:52 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:52.833+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.730278+0000 front 2024-09-12T01:39:19.730375+0000 (oldest deadline 2024-09-12T01:39:45.030361+0000) 2024-09-12T01:39:53.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:53 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:53.519+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:53.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:53 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:53.519+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:39:53.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:53 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:53.519+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:39:53.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:53 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:53.506+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:53.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:53 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:53.506+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:39:53.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:53 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:53.605+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:53.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:53 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:53.605+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:54.269 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:53 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:53.932+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:39:54.269 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:53 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:53.932+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:39:54.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:54 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:54.042+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:54.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:54 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:54.042+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:54.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:54 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:54.042+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:39:54.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:53 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:53.954+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:54.282 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:53 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:53.859+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:54.282 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:53 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:53.859+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.730278+0000 front 2024-09-12T01:39:19.730375+0000 (oldest deadline 2024-09-12T01:39:45.030361+0000) 2024-09-12T01:39:54.282 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:53 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:53.859+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.931129+0000 front 2024-09-12T01:39:27.931186+0000 (oldest deadline 2024-09-12T01:39:53.831279+0000) 2024-09-12T01:39:54.738 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:54 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:54.484+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:54.738 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:54 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:54.484+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:39:54.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:54 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:54.571+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:54.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:54 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:54.571+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:54.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:54 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:54.571+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.183698+0000 front 2024-09-12T01:39:30.183577+0000 (oldest deadline 2024-09-12T01:39:53.683405+0000) 2024-09-12T01:39:54.884 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:54 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:54.549+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:54.885 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:54 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:54.549+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:39:54.885 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:54 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:54.549+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:39:55.268 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:54 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:54.907+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:39:55.269 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:54 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:54.907+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:39:55.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:55 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:55.025+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:55.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:55 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:55.025+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:55.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:55 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:55.025+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:39:55.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:54 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:54.998+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:55.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:54 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:54.998+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:39:55.283 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:54 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:54.885+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.729443+0000 front 2024-09-12T01:39:12.729216+0000 (oldest deadline 2024-09-12T01:39:38.629226+0000) 2024-09-12T01:39:55.283 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:54 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:54.885+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.730278+0000 front 2024-09-12T01:39:19.730375+0000 (oldest deadline 2024-09-12T01:39:45.030361+0000) 2024-09-12T01:39:55.283 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:54 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5[47168]: 2024-09-12T01:39:54.885+0000 7f5cfcf10640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.931129+0000 front 2024-09-12T01:39:27.931186+0000 (oldest deadline 2024-09-12T01:39:53.831279+0000) 2024-09-12T01:39:55.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:55 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:55.487+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:55.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:55 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:55.487+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:39:55.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:55 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:55.487+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:39:55.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:55 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:55.533+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:55.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:55 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:55.533+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:55.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:55 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:55.533+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.183698+0000 front 2024-09-12T01:39:30.183577+0000 (oldest deadline 2024-09-12T01:39:53.683405+0000) 2024-09-12T01:39:55.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:55 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:55.499+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:55.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:55 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:55.499+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:39:55.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:55 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:55.499+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:39:56.268 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:55 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:55.955+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:39:56.269 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:55 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:55.955+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:39:56.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:56.033+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:56.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:56.033+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:56.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:56.033+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:39:56.282 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:56 smithi189 podman[71508]: 2024-09-12 01:39:56.037623663 +0000 UTC m=+5.622915959 container died 338fcf84951332a5c4a50bc3a8e09a09105cdefd37cfef7742924a1c897f2f4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T01:39:56.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:55 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:55.997+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:56.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:55 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:55.997+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:39:56.690 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:56 smithi189 podman[71508]: 2024-09-12 01:39:56.398282952 +0000 UTC m=+5.983575237 container cleanup 338fcf84951332a5c4a50bc3a8e09a09105cdefd37cfef7742924a1c897f2f4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T01:39:56.690 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:56 smithi189 bash[71508]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5 2024-09-12T01:39:56.690 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:56.471+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:56.690 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:56.471+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:39:56.690 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:56 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:56.471+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:39:56.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:56.530+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:56.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:56.530+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:39:56.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:56.530+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:39:56.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:56.502+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:56.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:56.502+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:56.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:56 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:56.502+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.183698+0000 front 2024-09-12T01:39:30.183577+0000 (oldest deadline 2024-09-12T01:39:53.683405+0000) 2024-09-12T01:39:57.022 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:56 smithi189 podman[71524]: 2024-09-12 01:39:56.691150144 +0000 UTC m=+0.650832590 container remove 338fcf84951332a5c4a50bc3a8e09a09105cdefd37cfef7742924a1c897f2f4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-12T01:39:57.269 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:56.935+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:39:57.269 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:56 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:56.935+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:39:57.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:57 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:57.056+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:57.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:57 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:57.056+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:57.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:57 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:57.056+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:39:57.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:57 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:57.023+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:57.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:57 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:57.023+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:39:57.283 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:57 smithi189 podman[71614]: 2024-09-12 01:39:56.927257237 +0000 UTC m=+0.016018129 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:39:57.283 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:57 smithi189 podman[71614]: 2024-09-12 01:39:57.042152322 +0000 UTC m=+0.130913243 container create 3df0ff0183927da6d17140a9987867c5c80476e9943e97a7bc0e6baefcb9f481 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T01:39:57.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:57 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:57.491+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:57.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:57 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:57.491+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:39:57.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:57 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:57.491+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:39:57.783 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:57 smithi189 podman[71614]: 2024-09-12 01:39:57.3111078 +0000 UTC m=+0.399868679 container init 3df0ff0183927da6d17140a9987867c5c80476e9943e97a7bc0e6baefcb9f481 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T01:39:57.783 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:57 smithi189 podman[71614]: 2024-09-12 01:39:57.314537071 +0000 UTC m=+0.403297964 container start 3df0ff0183927da6d17140a9987867c5c80476e9943e97a7bc0e6baefcb9f481 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T01:39:57.783 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:57 smithi189 podman[71614]: 2024-09-12 01:39:57.423221425 +0000 UTC m=+0.511982304 container attach 3df0ff0183927da6d17140a9987867c5c80476e9943e97a7bc0e6baefcb9f481 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-12T01:39:57.783 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:57 smithi189 podman[71614]: 2024-09-12 01:39:57.51182819 +0000 UTC m=+0.600589080 container died 3df0ff0183927da6d17140a9987867c5c80476e9943e97a7bc0e6baefcb9f481 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T01:39:57.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:57 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:57.539+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:57.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:57 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:57.539+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:39:57.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:57 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:57.539+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:39:57.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:57 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:57.507+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:57.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:57 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:57.507+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:57.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:57 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:57.507+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.183698+0000 front 2024-09-12T01:39:30.183577+0000 (oldest deadline 2024-09-12T01:39:53.683405+0000) 2024-09-12T01:39:58.047 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 12 01:39:58 smithi189 podman[71636]: 2024-09-12 01:39:58.023082323 +0000 UTC m=+0.505536441 container remove 3df0ff0183927da6d17140a9987867c5c80476e9943e97a7bc0e6baefcb9f481 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-12T01:39:58.047 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:57 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:57.988+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:58.047 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:57 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:57.988+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:39:58.051 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T01:39:58.130 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:39:58.130 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T01:39:58.131 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T01:39:58.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.6 2024-09-12T01:39:58.269 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:57 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:57.896+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:39:58.269 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:57 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:57.896+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:39:58.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:58 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:58.106+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:58.270 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:58 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:58.106+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:58.270 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:58 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:58.106+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:39:58.426 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:58 smithi081 systemd[1]: Stopping Ceph osd.6 for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:39:58.426 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:58.425+0000 7f10e8493640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:39:58.426 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:58.425+0000 7f10e8493640 -1 osd.6 94 *** Got signal Terminated *** 2024-09-12T01:39:58.426 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:58.425+0000 7f10e8493640 -1 osd.6 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:39:58.738 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:58.551+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:58.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:58.551+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:58.739 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:58.551+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.183698+0000 front 2024-09-12T01:39:30.183577+0000 (oldest deadline 2024-09-12T01:39:53.683405+0000) 2024-09-12T01:39:58.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:58.551+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:58.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:58.551+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:39:58.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:58 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:58.551+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:39:58.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:58 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:58.462+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:58.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:58 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:58.462+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:39:58.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:58 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:58.462+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:39:59.268 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:58 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:58.849+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:39:59.269 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:58 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:58.849+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:39:59.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:59 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:59.082+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:39:59.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:59 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:59.082+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:39:59.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:39:59 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:39:59.082+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:39:59.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:59 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:59.011+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:39:59.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:59 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:59.011+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:39:59.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:59 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:59.441+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:39:59.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:59 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:59.441+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:39:59.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:39:59 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:39:59.441+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:39:59.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:59.565+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:39:59.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:59.565+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:39:59.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:39:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:39:59.565+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.183698+0000 front 2024-09-12T01:39:30.183577+0000 (oldest deadline 2024-09-12T01:39:53.683405+0000) 2024-09-12T01:39:59.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:59.574+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:39:59.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:59.574+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:39:59.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:39:59 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:39:59.574+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:00.109 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:59 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:59.855+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:40:00.109 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:39:59 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:39:59.855+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:40:00.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:59 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:59.985+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:00.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:39:59 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:39:59.985+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:00.518 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:00 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:00.109+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:00.518 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:00 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:00.109+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:00.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:00 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:00.109+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:00.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:00 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:00.467+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:00.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:00 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:00.467+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:00.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:00 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:00.467+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:00.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:00.582+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:00.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:00.582+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:00.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:00.582+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:00.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:40:00.547+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:40:00.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:40:00.547+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:40:00.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:00 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:40:00.547+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.183698+0000 front 2024-09-12T01:39:30.183577+0000 (oldest deadline 2024-09-12T01:39:53.683405+0000) 2024-09-12T01:40:01.019 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:00 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:00.837+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:40:01.019 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:00 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:00.837+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:40:01.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:00 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:00.970+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:01.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:00 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:00.970+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:01.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:00 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:00.970+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:01.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:01 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:01.099+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:01.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:01 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:01.099+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:01.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:01 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:01.099+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:01.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:01 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:01.426+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:01.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:01 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:01.426+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:01.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:01 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:01.426+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:01.988 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:01 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:40:01.553+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:40:01.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:01 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:40:01.553+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:40:01.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:01 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:40:01.553+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.183698+0000 front 2024-09-12T01:39:30.183577+0000 (oldest deadline 2024-09-12T01:39:53.683405+0000) 2024-09-12T01:40:01.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:01 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:01.589+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:01.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:01 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:01.589+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:01.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:01 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:01.589+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:02.141 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:01 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:01.846+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:40:02.141 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:01 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:01.846+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:40:02.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:01 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:01.942+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:02.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:01 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:01.942+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:02.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:01 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:01.942+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:02.518 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:02 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:02.142+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:02.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:02 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:02.142+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:02.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:02 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:02.142+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:02.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:02.440+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:02.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:02.440+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:02.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:02.440+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:02.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:40:02.594+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.280722+0000 front 2024-09-12T01:39:16.280780+0000 (oldest deadline 2024-09-12T01:39:40.980897+0000) 2024-09-12T01:40:02.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:40:02.594+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.981569+0000 front 2024-09-12T01:39:20.981643+0000 (oldest deadline 2024-09-12T01:39:45.681559+0000) 2024-09-12T01:40:02.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:40:02.594+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.183698+0000 front 2024-09-12T01:39:30.183577+0000 (oldest deadline 2024-09-12T01:39:53.683405+0000) 2024-09-12T01:40:02.989 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6[58625]: 2024-09-12T01:40:02.594+0000 7f10e4a98640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:38.284903+0000 front 2024-09-12T01:39:38.284924+0000 (oldest deadline 2024-09-12T01:40:02.385096+0000) 2024-09-12T01:40:02.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:02.589+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:02.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:02.589+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:02.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:02.589+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:02.990 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:02 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:02.589+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:03.162 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:02 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:02.853+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:40:03.162 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:02 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:02.853+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:40:03.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:02.906+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:03.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:02.906+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:03.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:02 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:02.906+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:03.518 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:03 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:03.162+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:03.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:03 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:03.162+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:03.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:03 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:03.162+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:03.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:03 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:03.475+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:03.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:03 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:03.475+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:03.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:03 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:03.475+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:03.930 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:03.620+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:03.930 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:03.620+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:03.930 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:03.620+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:03.930 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:03 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:03.620+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:04.152 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:03 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:03.813+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:40:04.152 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:03 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:03.813+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:40:04.184 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:03 smithi081 podman[110974]: 2024-09-12 01:40:03.931053569 +0000 UTC m=+5.601022615 container died 3a238f1109a818bd9178605caf6cd4888682e87e69f26b9a71dd4c06188c3b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T01:40:04.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:03 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:03.899+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:04.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:03 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:03.899+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:04.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:03 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:03.899+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:04.488 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:04 smithi081 podman[110974]: 2024-09-12 01:40:04.336381836 +0000 UTC m=+6.006350913 container cleanup 3a238f1109a818bd9178605caf6cd4888682e87e69f26b9a71dd4c06188c3b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:40:04.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:04 smithi081 bash[110974]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6 2024-09-12T01:40:04.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:04 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:04.153+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:04.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:04 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:04.153+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:04.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:04 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:04.153+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:04.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:04 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:04.468+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:04.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:04 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:04.468+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:04.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:04 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:04.468+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:04.962 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:04 smithi081 podman[110990]: 2024-09-12 01:40:04.554320018 +0000 UTC m=+0.622078429 container remove 3a238f1109a818bd9178605caf6cd4888682e87e69f26b9a71dd4c06188c3b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T01:40:04.962 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:04 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:04.629+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:04.962 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:04 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:04.629+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:04.962 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:04 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:04.629+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:04.962 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:04 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:04.629+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:05.121 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:04 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:04.845+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:40:05.122 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:04 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:04.845+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:40:05.122 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:04 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:04.845+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:38.308608+0000 front 2024-09-12T01:39:38.308525+0000 (oldest deadline 2024-09-12T01:40:04.708990+0000) 2024-09-12T01:40:05.215 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:04 smithi081 podman[111082]: 2024-09-12 01:40:04.86543798 +0000 UTC m=+0.016125073 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:40:05.215 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:04 smithi081 podman[111082]: 2024-09-12 01:40:04.963453872 +0000 UTC m=+0.114140972 container create e1b0350eae57970ef3f555a8faeef8a95e7e74d93177522b15a497537b027b3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T01:40:05.216 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:05 smithi081 podman[111082]: 2024-09-12 01:40:05.216182099 +0000 UTC m=+0.366869181 container init e1b0350eae57970ef3f555a8faeef8a95e7e74d93177522b15a497537b027b3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T01:40:05.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:04 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:04.931+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:05.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:04 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:04.931+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:05.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:04 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:04.931+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:05.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:05 smithi081 podman[111082]: 2024-09-12 01:40:05.219573737 +0000 UTC m=+0.370260820 container start e1b0350eae57970ef3f555a8faeef8a95e7e74d93177522b15a497537b027b3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T01:40:05.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:05 smithi081 podman[111082]: 2024-09-12 01:40:05.290940595 +0000 UTC m=+0.441627701 container attach e1b0350eae57970ef3f555a8faeef8a95e7e74d93177522b15a497537b027b3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T01:40:05.489 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 01:40:05 smithi081 podman[111082]: 2024-09-12 01:40:05.401911053 +0000 UTC m=+0.552598139 container died e1b0350eae57970ef3f555a8faeef8a95e7e74d93177522b15a497537b027b3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T01:40:05.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:05 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:05.122+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:05.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:05 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:05.122+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:05.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:05 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:05.122+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:05.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:05 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:05.428+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:05.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:05 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:05.428+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:05.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:05 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:05.428+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:05.960 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:05.667+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:05.960 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:05.667+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:05.960 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:05.667+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:05.961 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:05 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:05.668+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:05.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T01:40:06.016 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:40:06.016 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T01:40:06.016 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T01:40:06.017 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.7 2024-09-12T01:40:06.160 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:05 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:05.823+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:40:06.160 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:05 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:05.823+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:40:06.160 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:05 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:05.823+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:38.308608+0000 front 2024-09-12T01:39:38.308525+0000 (oldest deadline 2024-09-12T01:40:04.708990+0000) 2024-09-12T01:40:06.160 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:06 smithi100 systemd[1]: Stopping Ceph osd.7 for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:40:06.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:05 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:05.980+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:06.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:05 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:05.980+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:06.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:05 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:05.980+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:06.519 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:06 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:06.296+0000 7f3ac5395640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:40:06.519 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:06 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:06.296+0000 7f3ac5395640 -1 osd.7 94 *** Got signal Terminated *** 2024-09-12T01:40:06.519 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:06 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:06.296+0000 7f3ac5395640 -1 osd.7 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:40:06.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:06 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:06.159+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:06.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:06 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:06.159+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:06.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:06 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:06.159+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:06.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:06 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:06.159+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:06.556 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:06 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:06.457+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:06.556 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:06 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:06.457+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:06.557 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:06 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:06.457+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:06.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:06 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:06.633+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:06.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:06 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:06.633+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:06.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:06 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:06.633+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:06.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:06 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:06.633+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:07.181 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:06 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:06.818+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:40:07.181 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:06 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:06.818+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:40:07.181 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:06 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:06.818+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:38.308608+0000 front 2024-09-12T01:39:38.308525+0000 (oldest deadline 2024-09-12T01:40:04.708990+0000) 2024-09-12T01:40:07.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:06 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:06.975+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:07.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:06 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:06.975+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:07.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:06 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:06.975+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:07.451 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:07 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:07.181+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:07.451 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:07 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:07.181+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:07.451 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:07 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:07.181+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:07.452 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:07 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:07.181+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:07.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:07 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:07.456+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:07.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:07 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:07.456+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:07.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:07 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:07.456+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:07.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:07 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:07.673+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:07.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:07 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:07.673+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:07.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:07 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:07.673+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:07.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:07 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:07.673+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:08.231 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:07 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:07.776+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:40:08.231 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:07 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:07.776+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:40:08.231 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:07 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:07.776+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:38.308608+0000 front 2024-09-12T01:39:38.308525+0000 (oldest deadline 2024-09-12T01:40:04.708990+0000) 2024-09-12T01:40:08.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:07 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:07.948+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:08.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:07 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:07.948+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:08.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:07 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:07.948+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:08.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:08 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:08.231+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:08.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:08 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:08.231+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:08.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:08 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:08.231+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:08.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:08 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:08.231+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:08.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:08 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:08.421+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:08.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:08 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:08.421+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:08.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:08 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:08.421+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:08.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:08 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:08.649+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:08.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:08 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:08.649+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:08.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:08 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:08.649+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:08.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:08 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:08.649+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:09.018 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:08 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:08.730+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:40:09.018 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:08 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:08.730+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:40:09.018 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:08 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:08.730+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:38.308608+0000 front 2024-09-12T01:39:38.308525+0000 (oldest deadline 2024-09-12T01:40:04.708990+0000) 2024-09-12T01:40:09.019 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:08 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:08.730+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:44.709261+0000 front 2024-09-12T01:39:44.709290+0000 (oldest deadline 2024-09-12T01:40:08.209392+0000) 2024-09-12T01:40:09.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:08 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:08.937+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:09.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:08 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:08.937+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:09.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:08 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:08.937+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:09.518 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:09 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:09.217+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:09.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:09 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:09.217+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:09.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:09 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:09.217+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:09.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:09 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:09.217+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:09.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:09 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:09.372+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:09.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:09 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:09.372+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:09.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:09 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:09.372+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:09.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:09 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:09.637+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:09.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:09 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:09.637+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:09.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:09 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:09.637+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:09.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:09 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:09.637+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:10.018 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:09 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:09.754+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:40:10.018 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:09 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:09.754+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:40:10.019 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:09 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:09.754+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:38.308608+0000 front 2024-09-12T01:39:38.308525+0000 (oldest deadline 2024-09-12T01:40:04.708990+0000) 2024-09-12T01:40:10.019 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:09 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:09.754+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:44.709261+0000 front 2024-09-12T01:39:44.709290+0000 (oldest deadline 2024-09-12T01:40:08.209392+0000) 2024-09-12T01:40:10.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:09 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:09.932+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:10.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:09 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:09.932+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:10.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:09 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:09.932+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:10.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:10 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:10.173+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:10.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:10 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:10.173+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:10.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:10 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:10.173+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:10.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:10 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:10.173+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:10.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:10 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:10.395+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:10.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:10 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:10.395+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:10.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:10 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:10.395+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:10.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:10 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:10.608+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:10.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:10 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:10.608+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:10.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:10 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:10.608+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:10.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:10 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:10.608+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:11.018 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:10 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:10.726+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:23.106285+0000 front 2024-09-12T01:39:23.106168+0000 (oldest deadline 2024-09-12T01:39:47.206306+0000) 2024-09-12T01:40:11.019 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:10 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:10.726+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:27.206800+0000 front 2024-09-12T01:39:27.206825+0000 (oldest deadline 2024-09-12T01:39:53.007490+0000) 2024-09-12T01:40:11.019 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:10 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:10.726+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:38.308608+0000 front 2024-09-12T01:39:38.308525+0000 (oldest deadline 2024-09-12T01:40:04.708990+0000) 2024-09-12T01:40:11.019 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:10 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7[53244]: 2024-09-12T01:40:10.726+0000 7f3ac199a640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:44.709261+0000 front 2024-09-12T01:39:44.709290+0000 (oldest deadline 2024-09-12T01:40:08.209392+0000) 2024-09-12T01:40:11.284 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:10 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:10.938+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:11.284 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:10 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:10.938+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:11.284 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:10 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:10.938+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:11.284 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:10 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:10.938+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.691418+0000 front 2024-09-12T01:39:46.691403+0000 (oldest deadline 2024-09-12T01:40:10.791371+0000) 2024-09-12T01:40:11.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:11 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:11.136+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:11.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:11 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:11.136+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:11.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:11 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:11.136+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:11.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:11 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:11.136+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:11.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:11 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:11.136+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:11.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:11 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:11.368+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:11.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:11 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:11.368+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:11.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:11 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:11.368+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:11.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:11 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:11.368+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:11.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:11 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:11.618+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:11.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:11 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:11.618+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:11.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:11 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:11.618+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:11.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:11 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:11.618+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:12.129 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:11 smithi100 podman[71503]: 2024-09-12 01:40:11.83861736 +0000 UTC m=+5.628985028 container died 5f36f0b0ee45761a20302c0785b7622af2bd8dbb7c64732e2a7519812e9dc66e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T01:40:12.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:11 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:11.944+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:12.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:11 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:11.944+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:12.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:11 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:11.944+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:12.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:11 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:11.944+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.691418+0000 front 2024-09-12T01:39:46.691403+0000 (oldest deadline 2024-09-12T01:40:10.791371+0000) 2024-09-12T01:40:12.455 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:12 smithi100 podman[71503]: 2024-09-12 01:40:12.237705464 +0000 UTC m=+6.028073116 container cleanup 5f36f0b0ee45761a20302c0785b7622af2bd8dbb7c64732e2a7519812e9dc66e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T01:40:12.455 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:12 smithi100 bash[71503]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7 2024-09-12T01:40:12.455 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:12 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:12.144+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:12.455 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:12 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:12.144+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:12.455 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:12 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:12.144+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:12.455 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:12 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:12.144+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:12.455 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:12 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:12.144+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:12.768 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:12 smithi100 podman[71532]: 2024-09-12 01:40:12.455564872 +0000 UTC m=+0.610753033 container remove 5f36f0b0ee45761a20302c0785b7622af2bd8dbb7c64732e2a7519812e9dc66e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T01:40:12.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:12 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:12.325+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:12.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:12 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:12.325+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:12.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:12 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:12.325+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:12.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:12 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:12.325+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:12.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:12 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:12.599+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:12.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:12 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:12.599+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:12.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:12 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:12.599+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:12.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:12 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:12.599+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:13.032 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:12 smithi100 podman[71619]: 2024-09-12 01:40:12.676042593 +0000 UTC m=+0.016019872 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:40:13.033 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:12 smithi100 podman[71619]: 2024-09-12 01:40:12.806690221 +0000 UTC m=+0.146667545 container create 644d53ee5d285ad7e8d6f2a55b238b498a58c21d482d9b729aef30b8803c2492 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7-deactivate, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T01:40:13.033 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:13 smithi100 podman[71619]: 2024-09-12 01:40:13.034012603 +0000 UTC m=+0.373989881 container init 644d53ee5d285ad7e8d6f2a55b238b498a58c21d482d9b729aef30b8803c2492 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-12T01:40:13.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:12 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:12.915+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:13.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:12 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:12.915+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:13.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:12 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:12.915+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:13.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:12 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:12.915+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.691418+0000 front 2024-09-12T01:39:46.691403+0000 (oldest deadline 2024-09-12T01:40:10.791371+0000) 2024-09-12T01:40:13.519 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:13 smithi100 podman[71619]: 2024-09-12 01:40:13.037474362 +0000 UTC m=+0.377451642 container start 644d53ee5d285ad7e8d6f2a55b238b498a58c21d482d9b729aef30b8803c2492 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:40:13.519 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:13 smithi100 podman[71619]: 2024-09-12 01:40:13.117197922 +0000 UTC m=+0.457175208 container attach 644d53ee5d285ad7e8d6f2a55b238b498a58c21d482d9b729aef30b8803c2492 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T01:40:13.519 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 12 01:40:13 smithi100 podman[71619]: 2024-09-12 01:40:13.229047358 +0000 UTC m=+0.569024637 container died 644d53ee5d285ad7e8d6f2a55b238b498a58c21d482d9b729aef30b8803c2492 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T01:40:13.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:13 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:13.135+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:13.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:13 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:13.135+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:13.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:13 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:13.135+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:13.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:13 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:13.135+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:13.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:13 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:13.135+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:13.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:13 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:13.358+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:13.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:13 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:13.358+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:13.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:13 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:13.358+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:13.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:13 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:13.358+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:13.826 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T01:40:13.864 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:40:13.865 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T01:40:13.865 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T01:40:13.865 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.8 2024-09-12T01:40:13.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:13 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:13.622+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:13.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:13 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:13.622+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:13.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:13 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:13.622+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:13.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:13 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:13.622+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:13.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:13 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:13.622+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:14.175 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:13 smithi189 systemd[1]: Stopping Ceph osd.8 for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:40:14.175 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:13 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:13.949+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:14.175 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:13 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:13.949+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:14.175 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:13 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:13.949+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:14.176 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:13 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:13.949+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.691418+0000 front 2024-09-12T01:39:46.691403+0000 (oldest deadline 2024-09-12T01:40:10.791371+0000) 2024-09-12T01:40:14.176 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:14 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:14.175+0000 7fcb2d574640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:40:14.176 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:14 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:14.175+0000 7fcb2d574640 -1 osd.8 94 *** Got signal Terminated *** 2024-09-12T01:40:14.176 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:14 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:14.175+0000 7fcb2d574640 -1 osd.8 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:40:14.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:14 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:14.146+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:14.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:14 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:14.146+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:14.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:14 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:14.146+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:14.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:14 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:14.146+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:14.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:14 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:14.146+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:14.532 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:14 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:14.360+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:14.532 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:14 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:14.360+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:14.532 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:14 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:14.360+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:14.532 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:14 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:14.360+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:14.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:14 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:14.649+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:14.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:14 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:14.649+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:14.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:14 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:14.649+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:14.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:14 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:14.649+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:14.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:14 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:14.649+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:15.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:14 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:14.977+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:15.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:14 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:14.977+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:15.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:14 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:14.977+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:15.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:14 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:14.977+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.691418+0000 front 2024-09-12T01:39:46.691403+0000 (oldest deadline 2024-09-12T01:40:10.791371+0000) 2024-09-12T01:40:15.518 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:15 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:15.103+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:15.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:15 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:15.103+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:15.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:15 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:15.103+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:15.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:15 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:15.103+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:15.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:15 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:15.103+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:15.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:15 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:15.339+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:15.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:15 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:15.339+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:15.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:15 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:15.339+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:15.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:15 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:15.339+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:15.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:15 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:15.639+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:15.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:15 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:15.639+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:15.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:15 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:15.639+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:15.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:15 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:15.639+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:15.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:15 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:15.639+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:16.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:16 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:16.000+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:16.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:16 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:16.000+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:16.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:16 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:16.000+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:16.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:16 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:16.000+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.691418+0000 front 2024-09-12T01:39:46.691403+0000 (oldest deadline 2024-09-12T01:40:10.791371+0000) 2024-09-12T01:40:16.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:16 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:16.143+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:16.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:16 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:16.143+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:16.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:16 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:16.143+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:16.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:16 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:16.143+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:16.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:16 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:16.143+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:16.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:16 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:16.298+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:16.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:16 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:16.298+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:16.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:16 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:16.298+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:16.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:16 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:16.298+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:16.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:16 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:16.298+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:16.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:16 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:16.595+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:16.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:16 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:16.595+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:16.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:16 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:16.595+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:16.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:16 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:16.595+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:16.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:16 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:16.595+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:17.282 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:16 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:16.997+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:17.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:16 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:16.997+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:17.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:16 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:16.997+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:17.283 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:16 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:16.997+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.691418+0000 front 2024-09-12T01:39:46.691403+0000 (oldest deadline 2024-09-12T01:40:10.791371+0000) 2024-09-12T01:40:17.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:17 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:17.179+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:17.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:17 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:17.179+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:17.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:17 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:17.179+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:17.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:17 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:17.179+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:17.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:17 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:17.179+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:17.592 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:17 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:17.290+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:17.592 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:17 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:17.290+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:17.592 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:17 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:17.290+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:17.592 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:17 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:17.290+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:17.592 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:17 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:17.290+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:17.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:17 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:17.632+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:17.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:17 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:17.632+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:17.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:17 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:17.632+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:17.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:17 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:17.632+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:17.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:17 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:17.632+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:18.488 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:18 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:18.219+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:18.488 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:18 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:18.219+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:18.488 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:18 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:18.219+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:18.488 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:18 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:18.219+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:18.489 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:18 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:18.219+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:18.532 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:18 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:18.039+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:18.532 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:18 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:18.039+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:18.533 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:18 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:18.039+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:18.533 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:18 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:18.039+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.691418+0000 front 2024-09-12T01:39:46.691403+0000 (oldest deadline 2024-09-12T01:40:10.791371+0000) 2024-09-12T01:40:18.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:18 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:18.253+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:18.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:18 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:18.253+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:18.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:18 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:18.253+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:18.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:18 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:18.253+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:18.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:18 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:18.253+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:18.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:18 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:18.630+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:18.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:18 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:18.630+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:18.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:18 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:18.630+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:18.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:18 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:18.630+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:18.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:18 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:18.630+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:19.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:19 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:19.247+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:19.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:19 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:19.247+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:19.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:19 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:19.247+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:19.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:19 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:19.247+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:19.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:19 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:19.247+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:19.532 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:19 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:19.087+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.088933+0000 front 2024-09-12T01:39:22.088877+0000 (oldest deadline 2024-09-12T01:39:44.988664+0000) 2024-09-12T01:40:19.532 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:19 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:19.087+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:29.089345+0000 front 2024-09-12T01:39:29.089519+0000 (oldest deadline 2024-09-12T01:39:54.989513+0000) 2024-09-12T01:40:19.532 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:19 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:19.087+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:34.990127+0000 front 2024-09-12T01:39:34.990208+0000 (oldest deadline 2024-09-12T01:40:00.890004+0000) 2024-09-12T01:40:19.533 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:19 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8[53711]: 2024-09-12T01:40:19.087+0000 7fcb25b71640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.691418+0000 front 2024-09-12T01:39:46.691403+0000 (oldest deadline 2024-09-12T01:40:10.791371+0000) 2024-09-12T01:40:19.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:19 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:19.254+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:19.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:19 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:19.254+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:19.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:19 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:19.254+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:19.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:19 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:19.254+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:19.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:19 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:19.254+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:19.918 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:19 smithi189 podman[71728]: 2024-09-12 01:40:19.640397856 +0000 UTC m=+5.573336132 container died 85b5fbf2ec655bc3f2d92a96da41499098e772ab8273aca245765f0d495f28fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T01:40:19.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:19 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:19.662+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:19.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:19 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:19.662+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:19.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:19 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:19.662+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:19.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:19 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:19.662+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:19.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:19 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:19.662+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:20.234 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:20 smithi189 podman[71728]: 2024-09-12 01:40:20.017577636 +0000 UTC m=+5.950515911 container cleanup 85b5fbf2ec655bc3f2d92a96da41499098e772ab8273aca245765f0d495f28fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T01:40:20.234 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:20 smithi189 bash[71728]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8 2024-09-12T01:40:20.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:20 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:20.235+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:20.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:20 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:20.235+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:20.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:20 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:20.235+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:20.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:20 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:20.235+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:20.520 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:20 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:20.235+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:20.520 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:20 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:20.235+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:20.532 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:20 smithi189 podman[71743]: 2024-09-12 01:40:20.280297374 +0000 UTC m=+0.637741231 container remove 85b5fbf2ec655bc3f2d92a96da41499098e772ab8273aca245765f0d495f28fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:40:20.532 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:20 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:20.234+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:20.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:20 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:20.234+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:20.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:20 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:20.234+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:20.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:20 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:20.234+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:20.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:20 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:20.234+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:20.891 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:20 smithi189 podman[71829]: 2024-09-12 01:40:20.543733772 +0000 UTC m=+0.016320186 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:40:20.891 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:20 smithi189 podman[71829]: 2024-09-12 01:40:20.653131539 +0000 UTC m=+0.125717984 container create b745f2419d2fa086c4316a0996547433edd44023a14c38e32bcc6aa49616cb02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T01:40:20.891 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:20 smithi189 podman[71829]: 2024-09-12 01:40:20.888796884 +0000 UTC m=+0.361383286 container init b745f2419d2fa086c4316a0996547433edd44023a14c38e32bcc6aa49616cb02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T01:40:20.891 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:20 smithi189 podman[71829]: 2024-09-12 01:40:20.892150274 +0000 UTC m=+0.364736680 container start b745f2419d2fa086c4316a0996547433edd44023a14c38e32bcc6aa49616cb02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-12T01:40:20.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:20 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:20.662+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:20.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:20 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:20.662+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:20.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:20 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:20.662+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:20.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:20 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:20.662+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:20.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:20 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:20.662+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:20.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:20 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:20.662+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:52.850933+0000 front 2024-09-12T01:39:52.850836+0000 (oldest deadline 2024-09-12T01:40:20.451446+0000) 2024-09-12T01:40:21.277 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:21 smithi189 podman[71829]: 2024-09-12 01:40:21.005739778 +0000 UTC m=+0.478326184 container attach b745f2419d2fa086c4316a0996547433edd44023a14c38e32bcc6aa49616cb02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T01:40:21.277 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 12 01:40:21 smithi189 podman[71829]: 2024-09-12 01:40:21.094066663 +0000 UTC m=+0.566653067 container died b745f2419d2fa086c4316a0996547433edd44023a14c38e32bcc6aa49616cb02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T01:40:21.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:21 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:21.250+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:21.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:21 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:21.250+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:21.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:21 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:21.250+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:21.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:21 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:21.250+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:21.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:21 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:21.250+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:21.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:21 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:21.250+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:21.532 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:21 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:21.276+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:21.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:21 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:21.276+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:21.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:21 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:21.276+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:21.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:21 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:21.276+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:21.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:21 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:21.276+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:21.697 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T01:40:21.736 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:40:21.736 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T01:40:21.736 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T01:40:21.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.9 2024-09-12T01:40:21.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:21 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:21.613+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:21.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:21 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:21.613+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:21.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:21 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:21.613+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:21.990 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:21 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:21.613+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:21.990 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:21 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:21.613+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:21.990 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:21 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:21.613+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:52.850933+0000 front 2024-09-12T01:39:52.850836+0000 (oldest deadline 2024-09-12T01:40:20.451446+0000) 2024-09-12T01:40:21.990 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:21 smithi081 systemd[1]: Stopping Ceph osd.9 for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:40:22.488 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:22.054+0000 7f4de9c7f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:40:22.489 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:22.054+0000 7f4de9c7f640 -1 osd.9 94 *** Got signal Terminated *** 2024-09-12T01:40:22.489 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:22.054+0000 7f4de9c7f640 -1 osd.9 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:40:22.521 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:22 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:22.216+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:22.521 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:22 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:22.216+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:22.521 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:22 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:22.216+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:22.521 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:22 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:22.216+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:22.521 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:22 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:22.216+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:22.522 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:22 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:22.216+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:22.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:22 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:22.319+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:22.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:22 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:22.319+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:22.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:22 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:22.319+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:22.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:22 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:22.319+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:22.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:22 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:22.319+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:22.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:22.591+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:22.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:22.591+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:22.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:22.591+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:22.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:22.591+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:22.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:22.591+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:22.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:22 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:22.591+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:52.850933+0000 front 2024-09-12T01:39:52.850836+0000 (oldest deadline 2024-09-12T01:40:20.451446+0000) 2024-09-12T01:40:23.518 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:23 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:23.194+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:23.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:23 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:23.194+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:23.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:23 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:23.194+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:23.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:23 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:23.194+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:23.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:23 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:23.194+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:23.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:23 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:23.194+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:23.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:23 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:23.316+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:23.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:23 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:23.316+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:23.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:23 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:23.316+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:23.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:23 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:23.316+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:23.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:23 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:23.316+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:23.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:23.619+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:23.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:23.619+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:23.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:23.619+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:23.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:23.619+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:23.990 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:23.619+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:23.990 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:23 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:23.619+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:52.850933+0000 front 2024-09-12T01:39:52.850836+0000 (oldest deadline 2024-09-12T01:40:20.451446+0000) 2024-09-12T01:40:24.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:24 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:24.234+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:24.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:24 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:24.234+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:24.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:24 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:24.234+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:24.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:24 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:24.234+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:24.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:24 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:24.234+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:24.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:24 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:24.234+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:24.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:24 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:24.291+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:24.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:24 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:24.291+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:24.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:24 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:24.291+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:24.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:24 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:24.291+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:24.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:24 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:24.291+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:24.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:24 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:24.600+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:24.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:24 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:24.600+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:24.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:24 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:24.600+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:24.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:24 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:24.600+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:24.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:24 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:24.600+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:24.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:24 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:24.600+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:52.850933+0000 front 2024-09-12T01:39:52.850836+0000 (oldest deadline 2024-09-12T01:40:20.451446+0000) 2024-09-12T01:40:25.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:25.232+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:25.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:25.232+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:25.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:25.232+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:25.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:25.232+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:25.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:25.232+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:25.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:25.232+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:25.520 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:25 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:25.232+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:39:59.596285+0000 front 2024-09-12T01:39:59.596256+0000 (oldest deadline 2024-09-12T01:40:24.296091+0000) 2024-09-12T01:40:25.784 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:25 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:25.307+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:25.784 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:25 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:25.307+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:25.784 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:25 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:25.307+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:25.785 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:25 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:25.307+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:25.785 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:25 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:25.307+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:25.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:25.584+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:25.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:25.584+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:25.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:25.584+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:25.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:25.584+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:25.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:25.584+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:25.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:25 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:25.584+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:52.850933+0000 front 2024-09-12T01:39:52.850836+0000 (oldest deadline 2024-09-12T01:40:20.451446+0000) 2024-09-12T01:40:26.518 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:26.201+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:26.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:26.201+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:26.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:26.201+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:26.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:26.201+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:26.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:26.201+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:26.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:26.201+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:26.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:26 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:26.201+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:39:59.596285+0000 front 2024-09-12T01:39:59.596256+0000 (oldest deadline 2024-09-12T01:40:24.296091+0000) 2024-09-12T01:40:26.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:26 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:26.320+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:26.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:26 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:26.320+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:26.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:26 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:26.320+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:26.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:26 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:26.320+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:26.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:26 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:26.320+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:26.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:26 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:26.605+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.544411+0000 front 2024-09-12T01:39:12.544448+0000 (oldest deadline 2024-09-12T01:39:38.444644+0000) 2024-09-12T01:40:26.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:26 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:26.605+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:22.545868+0000 front 2024-09-12T01:39:22.545701+0000 (oldest deadline 2024-09-12T01:39:48.445810+0000) 2024-09-12T01:40:26.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:26 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:26.605+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:28.446503+0000 front 2024-09-12T01:39:28.446410+0000 (oldest deadline 2024-09-12T01:39:54.846907+0000) 2024-09-12T01:40:26.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:26 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:26.605+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:39.547959+0000 front 2024-09-12T01:39:39.548014+0000 (oldest deadline 2024-09-12T01:40:02.448097+0000) 2024-09-12T01:40:26.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:26 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:26.605+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:47.550471+0000 front 2024-09-12T01:39:47.550482+0000 (oldest deadline 2024-09-12T01:40:12.850249+0000) 2024-09-12T01:40:26.989 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:26 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9[65182]: 2024-09-12T01:40:26.605+0000 7f4de6284640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:52.850933+0000 front 2024-09-12T01:39:52.850836+0000 (oldest deadline 2024-09-12T01:40:20.451446+0000) 2024-09-12T01:40:27.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:27 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:27.215+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:27.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:27 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:27.215+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:27.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:27 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:27.215+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:27.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:27 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:27.215+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:27.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:27 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:27.215+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:27.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:27 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:27.215+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:27.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:27 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:27.215+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:39:59.596285+0000 front 2024-09-12T01:39:59.596256+0000 (oldest deadline 2024-09-12T01:40:24.296091+0000) 2024-09-12T01:40:27.728 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:27 smithi081 podman[111185]: 2024-09-12 01:40:27.369583302 +0000 UTC m=+5.439456826 container died 08794ff683a7d3751c48efa0d7949b5f393ee6b86347add64470c6807443db52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:40:27.729 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:27 smithi081 podman[111185]: 2024-09-12 01:40:27.729883495 +0000 UTC m=+5.799757015 container cleanup 08794ff683a7d3751c48efa0d7949b5f393ee6b86347add64470c6807443db52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T01:40:27.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:27 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:27.325+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:27.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:27 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:27.325+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:27.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:27 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:27.325+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:27.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:27 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:27.325+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:27.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:27 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:27.325+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:27.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:27 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:27.325+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:27.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:27 smithi081 bash[111185]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9 2024-09-12T01:40:28.334 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:28 smithi081 podman[111202]: 2024-09-12 01:40:28.006229118 +0000 UTC m=+0.630573401 container remove 08794ff683a7d3751c48efa0d7949b5f393ee6b86347add64470c6807443db52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:40:28.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:28 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:28.233+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:28.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:28 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:28.233+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:28.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:28 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:28.233+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:28.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:28 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:28.233+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:28.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:28 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:28.233+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:28.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:28 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:28.233+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:28.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:28 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:28.233+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:39:59.596285+0000 front 2024-09-12T01:39:59.596256+0000 (oldest deadline 2024-09-12T01:40:24.296091+0000) 2024-09-12T01:40:28.532 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:28 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:28.276+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:28.532 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:28 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:28.276+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:28.532 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:28 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:28.276+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:28.532 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:28 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:28.276+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:28.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:28 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:28.276+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:28.533 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:28 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:28.276+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:28.642 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:28 smithi081 podman[111291]: 2024-09-12 01:40:28.237337952 +0000 UTC m=+0.015792546 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:40:28.642 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:28 smithi081 podman[111291]: 2024-09-12 01:40:28.34870935 +0000 UTC m=+0.127163928 container create 3f86492e786c86188cdda1762a8f6bc77faf9628c58bf4ad173e51760ed0b1ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9-deactivate, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:40:28.642 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:28 smithi081 podman[111291]: 2024-09-12 01:40:28.5597265 +0000 UTC m=+0.338181087 container init 3f86492e786c86188cdda1762a8f6bc77faf9628c58bf4ad173e51760ed0b1ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T01:40:28.643 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:28 smithi081 podman[111291]: 2024-09-12 01:40:28.563207314 +0000 UTC m=+0.341661903 container start 3f86492e786c86188cdda1762a8f6bc77faf9628c58bf4ad173e51760ed0b1ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T01:40:28.643 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:28 smithi081 podman[111291]: 2024-09-12 01:40:28.642807226 +0000 UTC m=+0.421261843 container attach 3f86492e786c86188cdda1762a8f6bc77faf9628c58bf4ad173e51760ed0b1ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:40:28.988 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:28 smithi081 podman[111291]: 2024-09-12 01:40:28.746012204 +0000 UTC m=+0.524466783 container died 3f86492e786c86188cdda1762a8f6bc77faf9628c58bf4ad173e51760ed0b1ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-12T01:40:29.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T01:40:29.278 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:29 smithi081 podman[111314]: 2024-09-12 01:40:29.237700427 +0000 UTC m=+0.483156686 container remove 3f86492e786c86188cdda1762a8f6bc77faf9628c58bf4ad173e51760ed0b1ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T01:40:29.278 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:29 smithi081 systemd[1]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.9.service: Deactivated successfully. 2024-09-12T01:40:29.278 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:29 smithi081 systemd[1]: Stopped Ceph osd.9 for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:40:29.279 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 01:40:29 smithi081 systemd[1]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.9.service: Consumed 9.049s CPU time. 2024-09-12T01:40:29.293 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:40:29.293 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T01:40:29.293 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T01:40:29.293 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.10 2024-09-12T01:40:29.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:29 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:29.209+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:29.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:29 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:29.209+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:29.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:29 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:29.209+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:29.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:29 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:29.209+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:29.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:29 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:29.209+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:29.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:29 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:29.209+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:29.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:29 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:29.209+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:39:59.596285+0000 front 2024-09-12T01:39:59.596256+0000 (oldest deadline 2024-09-12T01:40:24.296091+0000) 2024-09-12T01:40:29.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:29 smithi100 systemd[1]: Stopping Ceph osd.10 for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:40:29.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:29 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:29.312+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:29.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:29 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:29.312+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:29.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:29 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:29.312+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:29.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:29 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:29.312+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:29.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:29 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:29.312+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:29.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:29 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:29.312+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:30.018 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:29 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:29.596+0000 7f464a316640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:40:30.019 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:29 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:29.596+0000 7f464a316640 -1 osd.10 94 *** Got signal Terminated *** 2024-09-12T01:40:30.019 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:29 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:29.596+0000 7f464a316640 -1 osd.10 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:40:30.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:30 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:30.172+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:30.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:30 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:30.172+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:30.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:30 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:30.172+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:30.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:30 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:30.172+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:30.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:30 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:30.172+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:30.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:30 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:30.172+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:30.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:30 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:30.172+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:39:59.596285+0000 front 2024-09-12T01:39:59.596256+0000 (oldest deadline 2024-09-12T01:40:24.296091+0000) 2024-09-12T01:40:30.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:30 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:30.299+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:30.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:30 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:30.299+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:30.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:30 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:30.299+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:30.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:30 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:30.299+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:30.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:30 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:30.299+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:30.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:30 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:30.299+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:31.518 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:31 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:31.221+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:31.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:31 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:31.221+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:31.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:31 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:31.221+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:31.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:31 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:31.221+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:31.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:31 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:31.221+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:31.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:31 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:31.221+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:31.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:31 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:31.221+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:39:59.596285+0000 front 2024-09-12T01:39:59.596256+0000 (oldest deadline 2024-09-12T01:40:24.296091+0000) 2024-09-12T01:40:31.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:31 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:31.312+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:31.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:31 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:31.312+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:31.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:31 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:31.312+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:31.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:31 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:31.312+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:31.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:31 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:31.312+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:31.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:31 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:31.312+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:32.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:32 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:32.254+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:32.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:32 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:32.254+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:32.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:32 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:32.254+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:32.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:32 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:32.254+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:32.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:32 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:32.254+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:32.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:32 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:32.254+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:32.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:32 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:32.254+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:39:59.596285+0000 front 2024-09-12T01:39:59.596256+0000 (oldest deadline 2024-09-12T01:40:24.296091+0000) 2024-09-12T01:40:32.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:32 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:32.319+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:32.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:32 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:32.319+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:32.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:32 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:32.319+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:32.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:32 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:32.319+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:32.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:32 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:32.319+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:32.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:32 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:32.319+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:32.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:32 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:32.319+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-12T01:40:07.251884+0000 front 2024-09-12T01:40:07.251956+0000 (oldest deadline 2024-09-12T01:40:31.951836+0000) 2024-09-12T01:40:33.518 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:33 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:33.207+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:33.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:33 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:33.207+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:33.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:33 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:33.207+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:33.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:33 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:33.207+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:33.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:33 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:33.207+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:33.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:33 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:33.207+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:33.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:33 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:33.207+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:39:59.596285+0000 front 2024-09-12T01:39:59.596256+0000 (oldest deadline 2024-09-12T01:40:24.296091+0000) 2024-09-12T01:40:33.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:33 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:33.339+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:33.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:33 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:33.339+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:33.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:33 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:33.339+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:33.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:33 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:33.339+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:33.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:33 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:33.339+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:33.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:33 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:33.339+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:33.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:33 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:33.339+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-12T01:40:07.251884+0000 front 2024-09-12T01:40:07.251956+0000 (oldest deadline 2024-09-12T01:40:31.951836+0000) 2024-09-12T01:40:34.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:34 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:34.241+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:12.890014+0000 front 2024-09-12T01:39:12.890085+0000 (oldest deadline 2024-09-12T01:39:38.189824+0000) 2024-09-12T01:40:34.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:34 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:34.241+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:19.890712+0000 front 2024-09-12T01:39:19.890665+0000 (oldest deadline 2024-09-12T01:39:45.190793+0000) 2024-09-12T01:40:34.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:34 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:34.241+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.292798+0000 front 2024-09-12T01:39:30.292876+0000 (oldest deadline 2024-09-12T01:39:53.792797+0000) 2024-09-12T01:40:34.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:34 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:34.241+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T01:39:36.093960+0000 front 2024-09-12T01:39:36.093933+0000 (oldest deadline 2024-09-12T01:40:06.094233+0000) 2024-09-12T01:40:34.519 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:34 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:34.241+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.094601+0000 front 2024-09-12T01:39:46.094628+0000 (oldest deadline 2024-09-12T01:40:10.794688+0000) 2024-09-12T01:40:34.520 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:34 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:34.241+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.495567+0000 front 2024-09-12T01:39:55.495544+0000 (oldest deadline 2024-09-12T01:40:19.595664+0000) 2024-09-12T01:40:34.520 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:34 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10[59938]: 2024-09-12T01:40:34.241+0000 7f4642913640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:39:59.596285+0000 front 2024-09-12T01:39:59.596256+0000 (oldest deadline 2024-09-12T01:40:24.296091+0000) 2024-09-12T01:40:34.785 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:34 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:34.326+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:34.785 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:34 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:34.326+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:34.785 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:34 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:34.326+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:34.785 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:34 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:34.326+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:34.786 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:34 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:34.326+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:34.786 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:34 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:34.326+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:34.786 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:34 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:34.326+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-12T01:40:07.251884+0000 front 2024-09-12T01:40:07.251956+0000 (oldest deadline 2024-09-12T01:40:31.951836+0000) 2024-09-12T01:40:35.269 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:35 smithi100 podman[71722]: 2024-09-12 01:40:35.00747771 +0000 UTC m=+5.516789342 container died 7b569af33fdb29ffc40f4168f06f842242eae3e5a3cebc7935bdbaefd9337f74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T01:40:35.655 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:35 smithi100 podman[71722]: 2024-09-12 01:40:35.363313081 +0000 UTC m=+5.872624695 container cleanup 7b569af33fdb29ffc40f4168f06f842242eae3e5a3cebc7935bdbaefd9337f74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T01:40:35.655 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:35 smithi100 bash[71722]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10 2024-09-12T01:40:35.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:35 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:35.369+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:35.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:35 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:35.369+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:35.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:35 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:35.369+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:35.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:35 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:35.369+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:35.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:35 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:35.370+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:35.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:35 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:35.370+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:35.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:35 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:35.370+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-12T01:40:07.251884+0000 front 2024-09-12T01:40:07.251956+0000 (oldest deadline 2024-09-12T01:40:31.951836+0000) 2024-09-12T01:40:35.972 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:35 smithi100 podman[71738]: 2024-09-12 01:40:35.656193919 +0000 UTC m=+0.643481478 container remove 7b569af33fdb29ffc40f4168f06f842242eae3e5a3cebc7935bdbaefd9337f74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:40:36.257 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:35 smithi100 podman[71828]: 2024-09-12 01:40:35.973376222 +0000 UTC m=+0.112202757 container create c4e9083ddf224528d43b1383f2c82843630dceb005f95e9518555d077a5dd986 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T01:40:36.258 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:35 smithi100 podman[71828]: 2024-09-12 01:40:35.877133692 +0000 UTC m=+0.015960240 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:40:36.258 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:36 smithi100 podman[71828]: 2024-09-12 01:40:36.175642166 +0000 UTC m=+0.314468707 container init c4e9083ddf224528d43b1383f2c82843630dceb005f95e9518555d077a5dd986 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T01:40:36.258 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:36 smithi100 podman[71828]: 2024-09-12 01:40:36.178914665 +0000 UTC m=+0.317741204 container start c4e9083ddf224528d43b1383f2c82843630dceb005f95e9518555d077a5dd986 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T01:40:36.258 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:36 smithi100 podman[71828]: 2024-09-12 01:40:36.258876159 +0000 UTC m=+0.397702696 container attach c4e9083ddf224528d43b1383f2c82843630dceb005f95e9518555d077a5dd986 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:40:36.518 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 12 01:40:36 smithi100 podman[71828]: 2024-09-12 01:40:36.366002547 +0000 UTC m=+0.504829084 container died c4e9083ddf224528d43b1383f2c82843630dceb005f95e9518555d077a5dd986 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T01:40:36.684 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:36 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:36.375+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:36.684 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:36 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:36.375+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:36.684 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:36 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:36.375+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:36.684 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:36 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:36.375+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:36.684 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:36 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:36.375+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:36.684 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:36 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:36.375+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:36.684 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:36 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:36.375+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-12T01:40:07.251884+0000 front 2024-09-12T01:40:07.251956+0000 (oldest deadline 2024-09-12T01:40:31.951836+0000) 2024-09-12T01:40:37.028 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T01:40:37.067 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:40:37.068 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T01:40:37.068 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T01:40:37.068 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.11 2024-09-12T01:40:37.370 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:37 smithi189 systemd[1]: Stopping Ceph osd.11 for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:40:37.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:37 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:37.370+0000 7f16aaf81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:40:37.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:37 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:37.370+0000 7f16aaf81640 -1 osd.11 94 *** Got signal Terminated *** 2024-09-12T01:40:37.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:37 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:37.370+0000 7f16aaf81640 -1 osd.11 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:40:37.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:37 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:37.391+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:37.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:37 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:37.391+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:37.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:37 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:37.391+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:37.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:37 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:37.391+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:37.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:37 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:37.391+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:37.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:37 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:37.391+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:37.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:37 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:37.391+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-12T01:40:07.251884+0000 front 2024-09-12T01:40:07.251956+0000 (oldest deadline 2024-09-12T01:40:31.951836+0000) 2024-09-12T01:40:38.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:38 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:38.433+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:38.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:38 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:38.433+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:38.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:38 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:38.433+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:38.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:38 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:38.433+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:38.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:38 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:38.433+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:38.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:38 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:38.433+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:38.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:38 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:38.433+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-12T01:40:07.251884+0000 front 2024-09-12T01:40:07.251956+0000 (oldest deadline 2024-09-12T01:40:31.951836+0000) 2024-09-12T01:40:39.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:39 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:39.415+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:39.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:39 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:39.415+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:39.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:39 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:39.415+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:39.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:39 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:39.415+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:39.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:39 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:39.415+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:39.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:39 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:39.415+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:39.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:39 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:39.415+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-12T01:40:07.251884+0000 front 2024-09-12T01:40:07.251956+0000 (oldest deadline 2024-09-12T01:40:31.951836+0000) 2024-09-12T01:40:40.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:40 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:40.383+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:40.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:40 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:40.383+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:40.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:40 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:40.383+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:40.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:40 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:40.383+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:40.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:40 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:40.383+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:40.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:40 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:40.383+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:40.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:40 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:40.383+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-12T01:40:07.251884+0000 front 2024-09-12T01:40:07.251956+0000 (oldest deadline 2024-09-12T01:40:31.951836+0000) 2024-09-12T01:40:41.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:41 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:41.406+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:41.782 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:41 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:41.406+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:41.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:41 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:41.406+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:41.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:41 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:41.406+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:41.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:41 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:41.406+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:41.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:41 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:41.406+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:41.783 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:41 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:41.406+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-12T01:40:07.251884+0000 front 2024-09-12T01:40:07.251956+0000 (oldest deadline 2024-09-12T01:40:31.951836+0000) 2024-09-12T01:40:42.686 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:42 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:42.370+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T01:39:16.143650+0000 front 2024-09-12T01:39:16.143787+0000 (oldest deadline 2024-09-12T01:39:36.643559+0000) 2024-09-12T01:40:42.686 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:42 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:42.370+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-12T01:39:20.744913+0000 front 2024-09-12T01:39:20.744633+0000 (oldest deadline 2024-09-12T01:39:47.145193+0000) 2024-09-12T01:40:42.687 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:42 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:42.370+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-12T01:39:30.646011+0000 front 2024-09-12T01:39:30.646148+0000 (oldest deadline 2024-09-12T01:39:52.946209+0000) 2024-09-12T01:40:42.687 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:42 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:42.370+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-12T01:39:46.348843+0000 front 2024-09-12T01:39:46.348824+0000 (oldest deadline 2024-09-12T01:40:11.048801+0000) 2024-09-12T01:40:42.687 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:42 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:42.370+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-12T01:39:55.149620+0000 front 2024-09-12T01:39:55.149730+0000 (oldest deadline 2024-09-12T01:40:16.249738+0000) 2024-09-12T01:40:42.687 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:42 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:42.370+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T01:40:00.251076+0000 front 2024-09-12T01:40:00.251145+0000 (oldest deadline 2024-09-12T01:40:27.251449+0000) 2024-09-12T01:40:42.687 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:42 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:42.370+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-12T01:40:07.251884+0000 front 2024-09-12T01:40:07.251956+0000 (oldest deadline 2024-09-12T01:40:31.951836+0000) 2024-09-12T01:40:42.687 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:42 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11[60304]: 2024-09-12T01:40:42.370+0000 7f16a357e640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.189:6820 osd.8 since back 2024-09-12T01:40:17.252844+0000 front 2024-09-12T01:40:17.252873+0000 (oldest deadline 2024-09-12T01:40:41.952834+0000) 2024-09-12T01:40:42.970 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:42 smithi189 podman[71942]: 2024-09-12 01:40:42.687261672 +0000 UTC m=+5.415149523 container died ee554f1b4713162204fa32e2c89e0bc251b9fe1a85b266db0ab042384332d695 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T01:40:43.282 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:43 smithi189 podman[71942]: 2024-09-12 01:40:43.069872722 +0000 UTC m=+5.797760563 container cleanup ee554f1b4713162204fa32e2c89e0bc251b9fe1a85b266db0ab042384332d695 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T01:40:43.283 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:43 smithi189 bash[71942]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11 2024-09-12T01:40:43.654 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:43 smithi189 podman[71959]: 2024-09-12 01:40:43.346184186 +0000 UTC m=+0.652682800 container remove ee554f1b4713162204fa32e2c89e0bc251b9fe1a85b266db0ab042384332d695 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T01:40:43.965 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:43 smithi189 podman[72046]: 2024-09-12 01:40:43.557860619 +0000 UTC m=+0.016218562 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:40:43.965 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:43 smithi189 podman[72046]: 2024-09-12 01:40:43.663576437 +0000 UTC m=+0.121934426 container create d9b991681d5189005f1d2e61f0915cd9f6e600c036fa6d7047ef41ef2c533f91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11-deactivate, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T01:40:43.965 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:43 smithi189 podman[72046]: 2024-09-12 01:40:43.891431206 +0000 UTC m=+0.349789149 container init d9b991681d5189005f1d2e61f0915cd9f6e600c036fa6d7047ef41ef2c533f91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True) 2024-09-12T01:40:43.965 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:43 smithi189 podman[72046]: 2024-09-12 01:40:43.894604989 +0000 UTC m=+0.352962932 container start d9b991681d5189005f1d2e61f0915cd9f6e600c036fa6d7047ef41ef2c533f91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T01:40:43.965 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:43 smithi189 podman[72046]: 2024-09-12 01:40:43.965990999 +0000 UTC m=+0.424348959 container attach d9b991681d5189005f1d2e61f0915cd9f6e600c036fa6d7047ef41ef2c533f91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11-deactivate, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-12T01:40:44.282 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 12 01:40:44 smithi189 podman[72046]: 2024-09-12 01:40:44.087322842 +0000 UTC m=+0.545680786 container died d9b991681d5189005f1d2e61f0915cd9f6e600c036fa6d7047ef41ef2c533f91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-osd-11-deactivate, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T01:40:44.672 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T01:40:44.713 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:40:44.713 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T01:40:44.713 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T01:40:44.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.a 2024-09-12T01:40:45.239 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:40:44 smithi081 systemd[1]: Stopping Ceph mds.a for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:40:45.239 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:40:44 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-a[71922]: 2024-09-12T01:40:44.989+0000 7f1c3e7d5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:40:45.239 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:40:44 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-a[71922]: 2024-09-12T01:40:44.989+0000 7f1c3e7d5640 -1 mds.a *** got signal Terminated *** 2024-09-12T01:40:48.914 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:40:48 smithi081 podman[111392]: 2024-09-12 01:40:48.594819636 +0000 UTC m=+3.691923140 container died 1d50f334aaba8fd4d706d37e15cad46a19199ed9295830436ec94726ee25b0ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2) 2024-09-12T01:40:49.238 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:40:48 smithi081 podman[111392]: 2024-09-12 01:40:48.988871357 +0000 UTC m=+4.085974863 container cleanup 1d50f334aaba8fd4d706d37e15cad46a19199ed9295830436ec94726ee25b0ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T01:40:49.239 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 01:40:48 smithi081 bash[111392]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-a 2024-09-12T01:40:49.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T01:40:49.606 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:40:49.607 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T01:40:49.607 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T01:40:49.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.d 2024-09-12T01:40:49.925 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:40:49 smithi081 systemd[1]: Stopping Ceph mds.d for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:40:50.238 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:40:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-d[70740]: 2024-09-12T01:40:49.925+0000 7fa1f91ff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:40:50.239 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:40:49 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-d[70740]: 2024-09-12T01:40:49.925+0000 7fa1f91ff640 -1 mds.d *** got signal Terminated *** 2024-09-12T01:40:51.792 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:40:51 smithi081 podman[111516]: 2024-09-12 01:40:51.530140335 +0000 UTC m=+1.706420527 container died cdacb5c32c75ab0be3d141557d9e7090557441fc6e98964ff81ff2ee098dc5be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T01:40:52.168 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:40:51 smithi081 podman[111516]: 2024-09-12 01:40:51.951343473 +0000 UTC m=+2.127623664 container cleanup cdacb5c32c75ab0be3d141557d9e7090557441fc6e98964ff81ff2ee098dc5be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T01:40:52.168 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:40:51 smithi081 bash[111516]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-d 2024-09-12T01:40:52.424 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 01:40:52 smithi081 podman[111527]: 2024-09-12 01:40:52.16932262 +0000 UTC m=+0.637936646 container remove cdacb5c32c75ab0be3d141557d9e7090557441fc6e98964ff81ff2ee098dc5be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T01:40:52.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T01:40:52.462 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:40:52.462 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T01:40:52.462 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T01:40:52.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.g 2024-09-12T01:40:52.738 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:40:52 smithi081 systemd[1]: Stopping Ceph mds.g for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:40:53.238 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:40:52 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-g[71507]: 2024-09-12T01:40:52.829+0000 7ffb28247640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:40:53.239 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:40:52 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-g[71507]: 2024-09-12T01:40:52.830+0000 7ffb28247640 -1 mds.g *** got signal Terminated *** 2024-09-12T01:40:56.971 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:40:56 smithi081 podman[111639]: 2024-09-12 01:40:56.601115759 +0000 UTC m=+3.916588747 container died 67bcc15999e4a84d5970e8fca40b507dc4efcd35f230aa928693ad2f4fbc7ba8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T01:40:57.238 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:40:57 smithi081 podman[111639]: 2024-09-12 01:40:57.155465737 +0000 UTC m=+4.470938717 container cleanup 67bcc15999e4a84d5970e8fca40b507dc4efcd35f230aa928693ad2f4fbc7ba8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T01:40:57.239 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 01:40:57 smithi081 bash[111639]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-g 2024-09-12T01:40:57.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T01:40:57.573 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:40:57.573 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T01:40:57.573 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T01:40:57.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.j 2024-09-12T01:40:57.738 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:40:57 smithi081 systemd[1]: Stopping Ceph mds.j for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:40:58.238 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:40:57 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-j[70330]: 2024-09-12T01:40:57.884+0000 7fd1cc622640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:40:58.239 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:40:57 smithi081 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-j[70330]: 2024-09-12T01:40:57.884+0000 7fd1cc622640 -1 mds.j *** got signal Terminated *** 2024-09-12T01:41:00.426 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:41:00 smithi081 podman[111760]: 2024-09-12 01:41:00.065836722 +0000 UTC m=+2.280059149 container died 2bfd40f1b6ab7d5ee3ef8d02a2d150be0c8d36bd7a6e5ddfb3e5723706af46f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T01:41:00.738 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:41:00 smithi081 podman[111760]: 2024-09-12 01:41:00.584663446 +0000 UTC m=+2.798885908 container cleanup 2bfd40f1b6ab7d5ee3ef8d02a2d150be0c8d36bd7a6e5ddfb3e5723706af46f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-j, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T01:41:00.739 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 01:41:00 smithi081 bash[111760]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-j 2024-09-12T01:41:00.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T01:41:00.928 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:41:00.928 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T01:41:00.928 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T01:41:00.928 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.b 2024-09-12T01:41:01.238 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:41:00 smithi100 systemd[1]: Stopping Ceph mds.b for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:41:01.518 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:41:01 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b[65607]: 2024-09-12T01:41:01.236+0000 7f3b7d762640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:41:01.518 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:41:01 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b[65607]: 2024-09-12T01:41:01.236+0000 7f3b7d762640 -1 mds.b *** got signal Terminated *** 2024-09-12T01:41:04.878 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:41:04 smithi100 podman[71940]: 2024-09-12 01:41:04.614537255 +0000 UTC m=+3.491005088 container died bb4c616ba02606c3b06fbe03c2a0e2f3bd93a21e8e11362a8741628422b5348d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T01:41:05.245 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:41:04 smithi100 podman[71940]: 2024-09-12 01:41:04.979029867 +0000 UTC m=+3.855497688 container cleanup bb4c616ba02606c3b06fbe03c2a0e2f3bd93a21e8e11362a8741628422b5348d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T01:41:05.245 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 12 01:41:04 smithi100 bash[71940]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-b 2024-09-12T01:41:05.414 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T01:41:05.449 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:41:05.450 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T01:41:05.450 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T01:41:05.450 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.e 2024-09-12T01:41:05.765 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:41:05 smithi100 systemd[1]: Stopping Ceph mds.e for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:41:06.018 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:41:05 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-e[65007]: 2024-09-12T01:41:05.765+0000 7f15fb825640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:41:06.019 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:41:05 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-e[65007]: 2024-09-12T01:41:05.765+0000 7f15fb825640 -1 mds.e *** got signal Terminated *** 2024-09-12T01:41:08.894 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:41:08 smithi100 podman[72058]: 2024-09-12 01:41:08.614061682 +0000 UTC m=+2.948226059 container died 4d4271f81e88699962c67ac744b84d61c5b615b4d6bf2282ffaa1ceb7e2f20b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-e, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-12T01:41:09.155 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:41:09 smithi100 podman[72058]: 2024-09-12 01:41:09.057366207 +0000 UTC m=+3.391530579 container cleanup 4d4271f81e88699962c67ac744b84d61c5b615b4d6bf2282ffaa1ceb7e2f20b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-e, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:41:09.155 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:41:09 smithi100 bash[72058]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-e 2024-09-12T01:41:09.473 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 12 01:41:09 smithi100 podman[72070]: 2024-09-12 01:41:09.258667356 +0000 UTC m=+0.642479893 container remove 4d4271f81e88699962c67ac744b84d61c5b615b4d6bf2282ffaa1ceb7e2f20b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-e, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:41:09.489 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T01:41:09.523 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:41:09.523 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T01:41:09.523 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T01:41:09.523 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.h 2024-09-12T01:41:09.768 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:41:09 smithi100 systemd[1]: Stopping Ceph mds.h for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:41:10.269 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:41:09 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-h[65308]: 2024-09-12T01:41:09.907+0000 7f1b87f6a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:41:10.269 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:41:09 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-h[65308]: 2024-09-12T01:41:09.907+0000 7f1b87f6a640 -1 mds.h *** got signal Terminated *** 2024-09-12T01:41:12.902 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:41:12 smithi100 podman[72189]: 2024-09-12 01:41:12.600053016 +0000 UTC m=+2.854384849 container died a15bb8afa819c0d162ad2c771902ba4fac22b72fbc3bbd73384645a3f3d7b422 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T01:41:13.219 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:41:13 smithi100 podman[72189]: 2024-09-12 01:41:13.02809672 +0000 UTC m=+3.282428555 container cleanup a15bb8afa819c0d162ad2c771902ba4fac22b72fbc3bbd73384645a3f3d7b422 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-h, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T01:41:13.220 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:41:13 smithi100 bash[72189]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-h 2024-09-12T01:41:13.454 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T01:41:13.476 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:41:13 smithi100 podman[72204]: 2024-09-12 01:41:13.22085931 +0000 UTC m=+0.614166134 container remove a15bb8afa819c0d162ad2c771902ba4fac22b72fbc3bbd73384645a3f3d7b422 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T01:41:13.476 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:41:13 smithi100 systemd[1]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.h.service: Deactivated successfully. 2024-09-12T01:41:13.476 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:41:13 smithi100 systemd[1]: Stopped Ceph mds.h for c1ee9932-70a4-11ef-bcea-c7b262605968. 2024-09-12T01:41:13.476 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 12 01:41:13 smithi100 systemd[1]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.h.service: Consumed 1.920s CPU time. 2024-09-12T01:41:13.488 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:41:13.489 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T01:41:13.489 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T01:41:13.489 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.k 2024-09-12T01:41:13.768 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:41:13 smithi100 systemd[1]: Stopping Ceph mds.k for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:41:14.269 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:41:13 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-k[64695]: 2024-09-12T01:41:13.864+0000 7fd98328c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:41:14.272 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:41:13 smithi100 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-k[64695]: 2024-09-12T01:41:13.864+0000 7fd98328c640 -1 mds.k *** got signal Terminated *** 2024-09-12T01:41:16.872 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:41:16 smithi100 podman[72310]: 2024-09-12 01:41:16.60711977 +0000 UTC m=+2.903673392 container died 2382889f003835b64a77213c418e812da45389a586cc07c3ef2be34d82ca11d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T01:41:16.872 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:41:16 smithi100 podman[72310]: 2024-09-12 01:41:16.873320038 +0000 UTC m=+3.169873659 container cleanup 2382889f003835b64a77213c418e812da45389a586cc07c3ef2be34d82ca11d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T01:41:17.131 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 12 01:41:16 smithi100 bash[72310]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-k 2024-09-12T01:41:17.306 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T01:41:17.338 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:41:17.339 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T01:41:17.339 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T01:41:17.339 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.c 2024-09-12T01:41:17.710 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:41:17 smithi189 systemd[1]: Stopping Ceph mds.c for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:41:18.032 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:41:17 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-c[65332]: 2024-09-12T01:41:17.709+0000 7f51b3f15640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:41:18.032 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:41:17 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-c[65332]: 2024-09-12T01:41:17.709+0000 7f51b3f15640 -1 mds.c *** got signal Terminated *** 2024-09-12T01:41:20.868 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:41:20 smithi189 podman[72147]: 2024-09-12 01:41:20.611661719 +0000 UTC m=+3.082110035 container died f0c12febf156b93b3fad4f69d2080b6852cfe2de50b99b8b199292260d8b9c28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:41:21.144 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:41:20 smithi189 podman[72147]: 2024-09-12 01:41:20.935156959 +0000 UTC m=+3.405605261 container cleanup f0c12febf156b93b3fad4f69d2080b6852cfe2de50b99b8b199292260d8b9c28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T01:41:21.144 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 12 01:41:20 smithi189 bash[72147]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-c 2024-09-12T01:41:21.359 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T01:41:21.393 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:41:21.393 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T01:41:21.393 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T01:41:21.393 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.f 2024-09-12T01:41:21.713 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:41:21 smithi189 systemd[1]: Stopping Ceph mds.f for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:41:22.032 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:41:21 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-f[65030]: 2024-09-12T01:41:21.714+0000 7f77fc560640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:41:22.032 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:41:21 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-f[65030]: 2024-09-12T01:41:21.714+0000 7f77fc560640 -1 mds.f *** got signal Terminated *** 2024-09-12T01:41:25.031 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:41:24 smithi189 podman[72266]: 2024-09-12 01:41:24.614420139 +0000 UTC m=+3.003052680 container died 81899e089eec6abe8465fdfa3db19debd580c4cdc71dd204ec1eea683d165cf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-f, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-12T01:41:25.282 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:41:25 smithi189 podman[72266]: 2024-09-12 01:41:25.113877659 +0000 UTC m=+3.502510202 container cleanup 81899e089eec6abe8465fdfa3db19debd580c4cdc71dd204ec1eea683d165cf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T01:41:25.282 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 12 01:41:25 smithi189 bash[72266]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-f 2024-09-12T01:41:25.507 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T01:41:25.540 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:41:25.541 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T01:41:25.541 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T01:41:25.541 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.i 2024-09-12T01:41:25.858 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:41:25 smithi189 systemd[1]: Stopping Ceph mds.i for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:41:26.282 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:41:25 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-i[65630]: 2024-09-12T01:41:25.858+0000 7f8ea3df4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:41:26.282 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:41:25 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-i[65630]: 2024-09-12T01:41:25.858+0000 7f8ea3df4640 -1 mds.i *** got signal Terminated *** 2024-09-12T01:41:28.917 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:41:28 smithi189 podman[72386]: 2024-09-12 01:41:28.613431124 +0000 UTC m=+2.854666582 container died 1ca6ae8cab529c007e07534fd0dd1a04a03d8e2779761f7c66fba9633f7838f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:41:29.268 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:41:29 smithi189 podman[72386]: 2024-09-12 01:41:29.009391724 +0000 UTC m=+3.250627171 container cleanup 1ca6ae8cab529c007e07534fd0dd1a04a03d8e2779761f7c66fba9633f7838f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T01:41:29.268 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 12 01:41:29 smithi189 bash[72386]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-i 2024-09-12T01:41:29.440 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T01:41:29.472 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:41:29.473 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T01:41:29.473 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T01:41:29.473 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.l 2024-09-12T01:41:30.032 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 01:41:29 smithi189 systemd[1]: Stopping Ceph mds.l for c1ee9932-70a4-11ef-bcea-c7b262605968... 2024-09-12T01:41:30.032 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 01:41:29 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-l[64729]: 2024-09-12T01:41:29.779+0000 7f7a7d1f6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:41:30.033 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 01:41:29 smithi189 ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-l[64729]: 2024-09-12T01:41:29.779+0000 7f7a7d1f6640 -1 mds.l *** got signal Terminated *** 2024-09-12T01:41:32.897 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 01:41:32 smithi189 podman[72508]: 2024-09-12 01:41:32.616564574 +0000 UTC m=+2.918909607 container died 88eddc80e55045deb34c8f68585974a714414c8ff3b0784363110fa1ef2cf5b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:41:33.229 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 01:41:32 smithi189 podman[72508]: 2024-09-12 01:41:32.979426257 +0000 UTC m=+3.281771295 container cleanup 88eddc80e55045deb34c8f68585974a714414c8ff3b0784363110fa1ef2cf5b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T01:41:33.229 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 12 01:41:32 smithi189 bash[72508]: ceph-c1ee9932-70a4-11ef-bcea-c7b262605968-mds-l 2024-09-12T01:41:33.364 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c1ee9932-70a4-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T01:41:33.396 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:41:33.396 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T01:41:33.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T01:41:33.598 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:41:36.085 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T01:41:36.284 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:41:38.655 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T01:41:38.857 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:41:41.243 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:41:41.277 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:41:41.305 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:41:41.331 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T01:41:41.334 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901539/remote/smithi081/crash 2024-09-12T01:41:41.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/crash -- . 2024-09-12T01:41:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T01:41:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now 2024-09-12T01:41:41.390 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901539/remote/smithi100/crash 2024-09-12T01:41:41.391 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/crash -- . 2024-09-12T01:41:41.583 INFO:teuthology.orchestra.run.smithi100.stderr:tar: /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T01:41:41.583 INFO:teuthology.orchestra.run.smithi100.stderr:tar: Error is not recoverable: exiting now 2024-09-12T01:41:41.585 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901539/remote/smithi189/crash 2024-09-12T01:41:41.586 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/crash -- . 2024-09-12T01:41:41.620 INFO:teuthology.orchestra.run.smithi189.stderr:tar: /var/lib/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T01:41:41.620 INFO:teuthology.orchestra.run.smithi189.stderr:tar: Error is not recoverable: exiting now 2024-09-12T01:41:41.622 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T01:41:41.622 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T01:41:41.663 INFO:tasks.cephadm:Compressing logs... 2024-09-12T01:41:41.664 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:41:41.706 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:41:41.709 DEBUG:teuthology.orchestra.run.smithi189:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:41:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T01:41:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:: No such file or directory 2024-09-12T01:41:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T01:41:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T01:41:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T01:41:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T01:41:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:: No such file or directory 2024-09-12T01:41:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T01:41:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T01:41:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T01:41:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T01:41:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T01:41:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T01:41:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T01:41:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T01:41:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T01:41:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T01:41:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T01:41:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T01:41:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mon.a.log: 84.5% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T01:41:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T01:41:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.log 2024-09-12T01:41:41.739 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.6.log: /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.g.log: 90.3% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T01:41:41.743 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T01:41:41.744 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T01:41:41.744 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.cephadm.log: 81.9% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T01:41:41.744 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.log 2024-09-12T01:41:41.746 INFO:teuthology.orchestra.run.smithi189.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T01:41:41.746 INFO:teuthology.orchestra.run.smithi189.stderr:: No such file or directory 2024-09-12T01:41:41.746 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T01:41:41.746 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T01:41:41.746 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T01:41:41.746 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T01:41:41.747 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T01:41:41.747 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T01:41:41.747 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T01:41:41.747 INFO:teuthology.orchestra.run.smithi189.stderr: 81.9% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T01:41:41.747 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.log 2024-09-12T01:41:41.747 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T01:41:41.747 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.log: 90.5% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T01:41:41.747 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T01:41:41.747 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.l.log: 87.6% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T01:41:41.747 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T01:41:41.749 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mgr.y.log: 90.9% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T01:41:41.750 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.8.log: 90.9% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T01:41:41.750 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T01:41:41.751 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T01:41:41.751 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T01:41:41.751 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T01:41:41.751 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.d.log: 87.6% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T01:41:41.752 INFO:teuthology.orchestra.run.smithi100.stderr: 91.8% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T01:41:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T01:41:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T01:41:41.753 INFO:teuthology.orchestra.run.smithi081.stderr: 94.5% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T01:41:41.754 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T01:41:41.755 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T01:41:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.log: /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.h.log: 87.6% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T01:41:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T01:41:41.757 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T01:41:41.758 INFO:teuthology.orchestra.run.smithi189.stderr: 91.9% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T01:41:41.760 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.j.log: 94.5% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T01:41:41.760 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T01:41:41.767 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T01:41:41.768 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T01:41:41.781 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T01:41:41.786 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T01:41:41.793 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T01:41:41.798 INFO:teuthology.orchestra.run.smithi081.stderr: 94.5% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T01:41:41.798 INFO:teuthology.orchestra.run.smithi081.stderr: 94.5% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T01:41:41.804 INFO:teuthology.orchestra.run.smithi189.stderr: 92.7% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T01:41:41.806 INFO:teuthology.orchestra.run.smithi100.stderr: 92.5% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T01:41:41.827 INFO:teuthology.orchestra.run.smithi100.stderr: 92.4% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T01:41:41.834 INFO:teuthology.orchestra.run.smithi189.stderr: 92.6% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T01:41:41.844 INFO:teuthology.orchestra.run.smithi189.stderr: 93.9% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T01:41:41.850 INFO:teuthology.orchestra.run.smithi100.stderr: 94.5% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T01:41:41.856 INFO:teuthology.orchestra.run.smithi189.stderr: 94.4% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T01:41:42.062 INFO:teuthology.orchestra.run.smithi100.stderr: 93.1% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T01:41:42.113 INFO:teuthology.orchestra.run.smithi081.stderr: 90.2% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T01:41:42.178 INFO:teuthology.orchestra.run.smithi100.stderr: 91.8% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T01:41:42.180 INFO:teuthology.orchestra.run.smithi189.stderr: 91.8% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T01:41:42.399 INFO:teuthology.orchestra.run.smithi189.stderr: 92.9% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T01:41:42.433 INFO:teuthology.orchestra.run.smithi189.stderr: 93.4% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T01:41:42.478 INFO:teuthology.orchestra.run.smithi100.stderr: 93.1% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T01:41:42.479 INFO:teuthology.orchestra.run.smithi081.stderr: 93.1% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T01:41:42.520 INFO:teuthology.orchestra.run.smithi081.stderr: 93.2% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T01:41:42.532 INFO:teuthology.orchestra.run.smithi100.stderr: 92.8% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T01:41:42.542 INFO:teuthology.orchestra.run.smithi189.stderr: 92.9% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T01:41:42.563 INFO:teuthology.orchestra.run.smithi081.stderr: 90.5% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T01:41:42.564 INFO:teuthology.orchestra.run.smithi100.stderr: 93.2% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T01:41:42.607 INFO:teuthology.orchestra.run.smithi100.stderr: 93.2% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T01:41:42.609 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-12T01:41:42.609 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m0.887s 2024-09-12T01:41:42.609 INFO:teuthology.orchestra.run.smithi100.stderr:user 0m4.095s 2024-09-12T01:41:42.609 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m0.144s 2024-09-12T01:41:42.640 INFO:teuthology.orchestra.run.smithi081.stderr: 92.8% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T01:41:42.671 INFO:teuthology.orchestra.run.smithi081.stderr: 92.9% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T01:41:42.673 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-12T01:41:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m0.952s 2024-09-12T01:41:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m4.531s 2024-09-12T01:41:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.188s 2024-09-12T01:41:42.749 INFO:teuthology.orchestra.run.smithi189.stderr: 93.0% -- replaced with /var/log/ceph/c1ee9932-70a4-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T01:41:42.752 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-12T01:41:42.752 INFO:teuthology.orchestra.run.smithi189.stderr:real 0m1.028s 2024-09-12T01:41:42.752 INFO:teuthology.orchestra.run.smithi189.stderr:user 0m3.812s 2024-09-12T01:41:42.752 INFO:teuthology.orchestra.run.smithi189.stderr:sys 0m0.148s 2024-09-12T01:41:42.752 INFO:tasks.cephadm:Archiving logs... 2024-09-12T01:41:42.753 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901539/remote/smithi081/log 2024-09-12T01:41:42.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:41:43.426 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901539/remote/smithi100/log 2024-09-12T01:41:43.426 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:41:44.009 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901539/remote/smithi189/log 2024-09-12T01:41:44.010 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:41:44.579 INFO:tasks.cephadm:Removing cluster... 2024-09-12T01:41:44.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 --force 2024-09-12T01:41:44.789 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:41:45.059 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 --force 2024-09-12T01:41:45.260 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:41:45.517 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c1ee9932-70a4-11ef-bcea-c7b262605968 --force 2024-09-12T01:41:45.719 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: c1ee9932-70a4-11ef-bcea-c7b262605968 2024-09-12T01:41:45.981 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T01:41:45.982 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T01:41:45.999 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T01:41:46.016 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T01:41:46.032 INFO:tasks.cephadm:Teardown complete 2024-09-12T01:41:46.032 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:41:46.044 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:41:46.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:41:46.047 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:41:46.058 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:41:46.195 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:41:46.206 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:41:46.206 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:41:46.209 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:41:46.211 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:41:46.221 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:41:46.223 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:41:46.226 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-12T01:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 -2143us[-2139us] +/- 62ms 2024-09-12T01:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 16 -109us[ -109us] +/- 60ms 2024-09-12T01:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +2601us[+2601us] +/- 71ms 2024-09-12T01:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:41:46.228 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:41:46.228 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-12T01:41:46.228 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 -2131us[-2128us] +/- 62ms 2024-09-12T01:41:46.228 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 -94us[ -92us] +/- 60ms 2024-09-12T01:41:46.228 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +2611us[+2613us] +/- 71ms 2024-09-12T01:41:46.228 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:41:46.230 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:41:46.230 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-12T01:41:46.230 INFO:teuthology.orchestra.run.smithi189.stdout:^* hv01.front.sepia.ceph.com 3 6 377 17 -2111us[-2080us] +/- 62ms 2024-09-12T01:41:46.230 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 16 -67us[ -67us] +/- 60ms 2024-09-12T01:41:46.230 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +2623us[+2655us] +/- 71ms 2024-09-12T01:41:46.230 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:41:46.231 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:41:46.241 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:41:46.242 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:41:46.252 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:41:46.348 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:41:46.415 DEBUG:teuthology.orchestra.run.smithi189:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:41:46.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:41:46.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:41:46.513 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:41:46.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:41:46.541 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:41:46.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:41:46.568 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:41:46.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:41:46.633 INFO:teuthology.task.internal:Duration was 1831.386595 seconds 2024-09-12T01:41:46.633 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:41:46.644 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:41:46.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:41:46.647 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:41:46.649 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:41:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:41:46.685 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:41:46.688 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:41:47.059 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:41:47.059 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T01:41:47.060 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:41:47.087 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-09-12T01:41:47.087 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:41:47.128 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-09-12T01:41:47.129 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:41:47.152 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:41:47.152 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:41:47.154 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:41:47.171 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:41:47.219 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:41:47.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:41:47.222 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:41:47.237 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:41:48.403 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:41:48.414 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:41:48.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:41:48.439 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:41:48.469 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:41:48.499 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:41:48.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:41:48.513 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:41:48.516 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:41:48.534 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-12T01:41:48.541 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-09-12T01:41:48.567 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-09-12T01:41:48.819 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:41:48.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:41:48.834 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:41:48.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:41:48.877 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:41:48.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:41:48.897 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:41:48.910 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:41:48.910 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901539/remote/smithi081 2024-09-12T01:41:48.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:41:48.981 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901539/remote/smithi100 2024-09-12T01:41:48.982 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:41:49.023 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901539/remote/smithi189 2024-09-12T01:41:49.023 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:41:49.065 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:41:49.066 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:41:49.068 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:41:49.071 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:41:49.117 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:41:49.131 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:41:49.131 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:41:49.188 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:41:49.188 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:41:49.190 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:41:49.193 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:41:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: 265958 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:41 /home/ubuntu/cephtest 2024-09-12T01:41:49.208 INFO:teuthology.orchestra.run.smithi100.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:41 /home/ubuntu/cephtest 2024-09-12T01:41:49.211 INFO:teuthology.orchestra.run.smithi189.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:41 /home/ubuntu/cephtest 2024-09-12T01:41:49.212 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:41:49.223 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:41:49.250 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} duration: 1831.3865954875946 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T01:41:49.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:41:49.341 INFO:teuthology.run:pass